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Welcome  to  the  new  Mid-Western  Educational  Researcher ; formerly  the  MWERA  Researcher. 
We  are  very  excited  about  the  changes  and  additions  that  have  been  made  in  the  publication  and  hope 
that  you  will  enjoy  the  new  format.  As  the  official  publication  of  the  Mid-Westem  Educational  Research 
Association,  we  will  continue  to  bring  you  information  concerning  the  Association.  In  addition,  we 
hope  to  provide  you  with  interesting  features  and  especially  hope  that  you  will  consider  contributing 
to  the  publication  by  submitting  articles,  news,  and  ideas. 

One  of  the  first  changes  that  you  have  probably  noticed  is  the  cover.  Each  issue  will  feature  a 
sponsoring  institution  on  the  cover  and  a brief  description  of  their  education  program  inside.  An  impor- 
tant addition  for  the  publication  was  the  addition  of  an  editorial  board.  This  distinguished  group  of 
educators  have  been  instrumental  in  providing  direction  and  ideas,  and  assist  in  the  review  of  manu- 
scripts. Each  issue  will  contain  an  interview  with  a leader  in  education,  as  well  as  the  “Voices  in  Education” 
section,  which  reports  the  responses  of  a number  of  noted  educators  to  important  questions  facing  our 
field.  Research  articles  and  other  articles  of  interest  to  the  membership  are  also  included.  A special 
pull-out  section  designed  to  provide  practitioners  with  an  accessible  interpretation  of  research  articles  is 
presented  entitled  “Research  Alive.” 

Although  we  have  instituted  some  changes,  the  success  of  the  journal  rests  with  the  membership. 
It  is  our  hope  that  you  find  this  journal  useful  and  that  it  will  help  to  draw  new  members  to  the  Asso- 
ciation. However,  the  publication  cannot  succeed  without  your  contributions  and  feedback.  We  need 
good  quality  manuscripts  for  publication.  We  need  feedback,  criticism,  and  innovative  ideas.  We  have 
been  encouraged  by  the  interest  and  support  of  the  membership  and  hope  that  you  will  view  the  Mid- 
Westem  Educational  Researcher  as  an  interactive  vehicle  for  your  ideas  and  needs. 
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The  Mid-Western  Educational  Researcher  accepts  research -based  manuscripts  that  would  appeal  to  a 
wide  range  of  readers.  All  materials  submitted  for  publication  must  conform  to  the  language,  style,  and  format  of  the 
Publication  Manual  of  the  American  Psychological  Association,  3rd  ed.t  1983  (available  from  Order  Department, 
American  Psychological  Association,  P.O.  Box  2710,  Hyattsville,  MD  20784). 

Three  copies  of  the  manuscript  should  be  submitted  typed  double  space  (including  quotations  and  references)  on 
8^2x11  paper.  Only  words  to  be  italicized  should  be  underlined.  Abbreviations  and  acronyms  should  be  spelled  out  for 
the  first  mention.  Pages  should  be  numbered  consecutively,  beginning  with  the  page  after  the  title  page. 
Manuscripts  should  be  less  than  20  pages  long.  An  abstract  of  less  than  100  words  should  accompany  the  manuscript. 

The  manuscript  will  receive  blind  review  from  at  least  two  professionals  with  expertise  in  the  area  of  the  manuscript. 
The  author’s  name,  affiliation,  etc.,  should  appear  on  the  title  page  only.  Efforts  will  be  made  to  keep  the  review  process 
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concise  clear  article.  The  author  will  be  consulted  if  any  major  changes  are  necessary’. 
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Presidential  Address: 

Catastrophe  Theory  and  Catastrophes 
in  China's  Civil  Service  Examinations-^^ » 

By  Ayres  D’Costa,  The  Ohio  State  University 

Abstract 

This  is  the  first  of  two  parts  of  the  Presidential  Address  delivered  on  October  20,  1990,  at  the  annual  meeting  of  the  Mid- 
Western  Educational  Research  Association.  This  section  introduces  the  concept  of  catastrophe  theory'.  The  second  part  will  be  pub- 
lished in  the  next  issue  and  will  present  an  outline  of  “catastrophes”  in  the  evolution  of  Chinese  national  examinations. 


Rene  Thom’s  (1975)  catastrophe  theory  was  first  pub- 
lished in  French  in  1972  as  an  outline  of  a General  Theory  of 
Mathematical  Models  using  a topological  approach.  Zeeman 
(1977),  who  has  compiled  several  of  the  key  papers  (including 
translations  from  French)  describes  catastrophe  theory  as  “a  new 
mathematical  method  for  describing  the  evolution  of  geometric 
forms  in  nature.”  It  is  hypothesized  that  the  transition  of  national 
examinations  systems  and  the  socio-political  forces  acting  on 
them  can  be  represented  geometrically  using  higher-order  mathe- 
matical forms.  A national  examination  system  will  change  to 
accommodate  itself  to  the  political  and  social  forces  that  keep 
acting  on  it.  On  rare  occasions,  these  forces  can  become  so  strong 
as  to  require  a complete  collapse  of  the  existing  examination 
system.  A totally  new  system  may  then  evolve  to  meet  the  new 
needs.  Such  a dramatic  change  is  called  a “catastrophe” 

The  genius  of  Thom’s  theory’  is  that  it  attempts  a geo- 
metric representation  of  this  phenomenon.  Depending  upon 
the  number  of  independent  forces  or  variables  acting  on  it,  the 
system  can  be  represented  by  one  of  seven  basic  geometric  forms, 
described  as  a fold,  a cusp,  a swallowtail,  etc.  (see  Figure  1).  The 
geometry  of  the  system  represents  its  resistance  and  resilience  to 
the  number  and  type  of  these  stresses. 


Graphs  of  five  of  the  e/ememan  catastrophes  (reproduced  with  permission 
from  Zeeman,  / 977.  p.  26,  34). 


Catastrophe  theory  can  be  explained  using  a simple 
example  adapted  by  Zeeman  (1977)  from  Konrad  Lorenz’s  study 


of  aggression  in  dogs  based  on  two  drives,  fear  and  rage.  These 
are  the  two  independent  variables.  Rage  is  measured  by  how 
much  the  dog’s  mouth  is  open  or  the  teeth  are  bared,  and  fear 
is  measured  by  how  much  the  dog’s  ears  lay  back.  An  intruder 
advancing  toward  the  dog  brings  on  rage.  An  intruder  who  appears 
armed  with  an  object  (e.g.,  a stick)  in  hand  brings  on  fear,  which 
increases  with  the  size  or  type  of  object.  Each  drive  can  be  ma- 
nipulated separately  or  jointly.  Typically,  as  one  increases  rage 
(intruder  advances  closer  and  closer  into  dog’s  territorial  space), 
there  comes  a point  when  the  rage  erupts  into  a vicious  fight 
(Catastrophe  Version  #1).  On  the  other  hand,  if  one  increases 
fear  (intruder’s  weapon  becomes  increasingly  more  menacing 
to  dog),  the  result  effect  will  be  flight  (Catastrophe  Version  #2). 
Fight  and  flight  are  two  manifestations  of  the  catastrophe  that 
is  likely  in  this  two-independent-variable  model  (see  Figure  2). 


The  ntspcutustTophe  dhestraring/ear  and  rage  as  l an/liering  /actors  in/Iuencng 
aggression  {reproduced  with  permission  from  Zeeman , 1 9/7,  p.  6). 

An  increase  in  fear  induces  the  dog  to  retreat  and  ulti- 
mately results  in  the  flight  catastrophe.  This  is  represented  on 
the  lower  flat  surface  by  the  line  OQiP*.  An  increase  in  rage 


Catastrophes  (continued) 


results  in  th*  fight  catastrophe,  which  is  represented  by  OQ,P,. 
The  combined  figure  PiQ^OQiPj  is  called  a cusp.  Here,  P2  and 
P,  represent  the  two  extreme  points  where  the  system  breaks 
down  and  catastrophe  occurs.  The  interesting  part  about  this 
theory  is  that,  if  the  outcome  is  assumed  to  be  unidimensional 
(x)  and  there  are  two  manipulated  variables  (a.b),  then  the  system 
is  always  represented  by  a geometric  form  called  a cusp,  which 
is  mathematically  represented  as: 

xV4  — ax  — bxVZ 

The  behavior  axis  x ranges  from  outright  flight  (low  x)  to  a vi- 
cious fight  (high  x).  For  each  combination  of  rage  (a)  and  fear 
(b),  there  is  at  least  one  most  probable  behavior  (x).  For  many  of 
the  points  (a,  b,  values)  where  either  a or  b is  predominant,  there 
will  be  just  one  probable  behavior  (x).  Near  the  center,  however, 
where  rage  and  fear  are  almost  equal,  there  are  two  probable 
behaviors,  one  high  representing  aggressiveness,  and  the  other 
low,  representing  submissiveness.  In  addition,  there  is  a third 
point  representing  the  least  likely  neutral  behavior.  Note  the 
three  layers  from  the  double  fold  or  pleat  in  the  top  surface.  The 
retreat  or  flight  catastrophe  is  shown  by  a double-headed  arrow 
representing  a free  fall  off  the  top  layer  to  the  lowest  layer.  Like- 
wise, the  attack  or  fight  catastrophe  is  shown  by  the  double- 
headed arrow  representing  the  jump  from  the  lowest  layer  to 
the  top  layer. 

If  the  edges  of  the  pleat  are  projected  on  to  the  lower 
control  surface  (a,h),  one  sees  the  cusp-shaped  curve  PiQjOQiPi- 
A.s  long  as  the  a,b  values  stay  outside  the  cusp,  the  correspond- 
ing behavior  varies  smoothly  in  relation  to  these  two  variables. 
However,  when  the  a,b  values  are  located  inside  the  cusp  and 
move  to  a critical  point  in  it,  a catastrophe  is  inevitable.  What 
type  of  catastrophe  occurs  depends  not  on  the  present  state,  but 
on  the  recent  history  of  the  system.  Adding  fear  to  an  enraged 
dog  will  produce  a different  catastrophe  outcome  from  that  pro- 
duced by  adding  anger  to  a frightened  dog. 

Catastrophe  theory  is  based  upon  complex  theorems  in 
multidimensional  geometry',  which  classify  the  ways  in  which 
discontinuities  can  occur  in  terms  of  seven  archetypal  forms. 
Thom  calls  these  forms  ‘elementary  catastrophes’  Zeeman  (1977, 
p.  1)  states  that  “although  the  proofs  are  sophisticated,  the  ele- 
mentary' catastrophes  are  both  surprising  and  relatively  easy  to 
understand  and  can  be  profitably  used  by  scientists  who  are  not 
expert  mathematicians.  Table  l shows  the  seven  elementary 
catastrophes  and  their  respective  mathematical  properties.  Thom’s 
formulations  allow  a mathematical  modeling  of  each  type  of 
system  and  the  statisrical  testing  for  best  fit  of  observed  data. 
Using  Thom's  geometric  forms,  an  analyst  can  plot  the  gradual 
buildup  of  tensions  up  to  the  point  when  the  catastrophe  occurs. 
A different  manifestation  of  the  catastrophe  will  occur  depending 
upon  which  force  was  responsible  for  the  breakdown.  Retrospec 
me  analysis  is  then  able  to  identify  the  key  causal  forces  and 
the  escalating  tensions  that  resulted  in  rhe  breakdown  of  the 


total  system,  even  to  the  point  of  identifying  the  proverbial  straw’ 
that  broke  the  camel’s  back. 
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T/ie  seven  elementary  catastrophes  (reproduced  with  permission  from  Zeeman. 

1977,  p.  27). 

Thom’s  theory  can  be  applied  in  any  field  of  science 
because  it  is  reasonable  to  postulate  that  all  systems  with  counter- 
balanced forces  have  natural  limits  on  their  endurance.  We  can 
be  patient  with  a nagging  spouse  up  to  a point;  our  body  will 
endure  substance  abuse  only  so  far;  and  our  nation’s  economy 
will  stretch  to  accommodate  its  deficit  only  up  to  a limit.  Catas- 
trophic change  is  evident  when  mutations  occur  in  biology,  or 
a stock  market  collapses  as  it  did  on  October  17,  1987;  or  as  in 
Senator  Eagleton’s  nervous  breakdown,  or  as  in  the  1989  ATS*T 
telephone  exchange  failure.  Catastrophes  are  like  human  mor- 
tality. They  may  be  expected,  but  they  cannot  be  predicted. 

Thom’s  theory’  is  primarily  geometric.  He  states  that  it 
is  topology  that  characterizes  live  versus  inert  forces  in  a system. 
Catastrophes  occur  when  there  is  a breakdown  in  the  internal 
topological  structure  of  the  system  under  pressure.  He  fhen  makes 
the  rather  startling  statement  that  ‘the  only  stable  s’  gularities 
of  all  catastrophes  are  determined  solely  by  their  dimensionality.’ 
This  simplifies  the  identification  of  the  potential  mathematical 
forms  associated  with  each  type  of  catastrophe.  Thom  identifies 
three  major  styles  of  catastrophic  change:  static,  wave-front  based, 
and  metabolic.  Presumably,  the  impact  of  these  styles  is  sub- 
ordinate to  that  imposed  by  the  dimensionality  of  the  system. 

The  appearance  or  anatomy  of  a catastrophe  varies  with  the 
system  that  it  occurs  in,  its  dimensionality,  and  its  style  of  change. 
Biology  has  its  mutations,  political  systems  their  revolutions, 
the  stock  market  its  crashes,  education  irs  major  reforms,  and 
the  human  body  its  trauma.  Catastrophes  also  occur  in  nature. 
We  see  them  as  earthquakes  and  volcanic  eruptions.  Initial  signs 
of  an  erupting  catastrophe  may  take  the  form  of  a new  lump,  as 
surface  hubbies,  as  laminar  or  plate  breaks,  as  a land  area  devas- 
tation, or  as  a totally  new  phenomenon. 

Cat.istrophe  theory  methodology  is  appropriate  for  system 
analysis  (such  as  rhe  type  described  in  Part  2 of  this  article). 

(ttmunut’d  i»it  page  4) 
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Catastrophes  (continued) 


The  methodology  permits  the  generation  of  research  hypotheses. 
It  describes  the  various  local  structures  involved  in  the  interplay. 
It  enables  the  development  of  new  theory  because  it  is  simple 
and  parsimonious.  It  attempts  to  describe  the  complex  ebb  and 
flow  of  history  in  terms  of  visual  mathematical  models  with  a 
few  critical  variables.  Just  as  the  purpose  of  human  medicine 
is  not  to  predict  the  exact  time  of  death  but  rather  to  under- 
stand  the  forces  that  cause  it,  our  purpose  is  to  learn  and  be 
able  to  prevent  and  manage  catastrophes.  Catastrophe-based 
models  can  be  used  in  gaming  or  simulation  exercises  so  as  to 
develop  complex  managerial  skills.  The  implementation  of  catas- 
trophe methodology  requires  the  analyst  to  follow  four  specific 
research  steps: 

1.  One  must  conduct  a historical  macroanalysis  to  identify  the 
critical  points  at  which  major  catastrophes  or  critical  morpho- 
genetic transitions  seem  to  have  occurred  in  the  development 
of  a system. 

2.  These  transition  points  are  then  analyzed  in  terms  of  the 
critical  local  structures  that  succumbed  to  the  catastrophic 
change.  Important  conflicting  variables  are  then  identified. 
This  allows  one  to  hypothesize  the  dimensionality  and  mathe- 
matical form  of  the  structure. 

3.  An  attempt  is  made  to  study  the  catastrophe  itself  in  order 


to  determine  its  style  of  change.  Usually,  this  would  become 
evident  in  the  expressions  of  key  persons  and  institutions. 
This  results  in  describing  how  the  external  dynamic  (forces) 
affecred  the  system,  which  structures  (groups)  specifically  were 
affected,  and  what  reactions  or  responses  might  have  occurred. 

4.  Some  recursive  analyses  (‘what  if  . . . technique)  can  be  con- 
ducted to  attempt  some  futuristic  ‘predictions’  These  are 
always  hazardous,  because  as  Thom  cautions  us,  it  is  impossible 
to  know  exactly  all  the  component  structures  in  an  existing 
system.  The  technique  is  useful  for  educational  post-hoc 
analyses,  e.g.,  to  recognize  how  much  ‘slack’  remained  in 
the  system  at  different  historical  points.  Historians  love  to 
conjecture  as  to  how  much  longer  or  how  much  further  other 
e .sting  forces  might  have  proceeded  before  a major  ‘blow-up’ 
occurred  had  a different  social  structural  style  existed. 
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Making  Education  Work 

Review  by  Pcarlmaric  Goddard 


Dumaine,  B.  (1990).  Making  education  work.  Fortune,  121  (12),  12-22. 

John  Dewey  is  quoted  as  saying,  “What  the  best  and 
wisest  parent  wants  for  his  child,  that  must  the  community 
want  for  all  its  children.”  The  entire  Spring  1990  Fortune  maga- 
zine is  a special  issue  on  “Saving  Our  Schools”  that  tells  how 
business  leaders,  parents,  teachers,  and  communities  are  starting 
to  want  for  all  its  children.  One  article  by  Brian  Dumaine, 
“Making  Education  Work,”  provides  a positive  overview'  of  a 
number  of  successful  collaborations  between  businesses  and 
schools.  Historically,  business  monies  have  primarily  been  allo- 
cated to  universities  and  vocational  schools.  More  recently, 
however,  funds  are  being  provided  to  schools  for  long-term  pro- 
grams to  foment  revolutions  in  curriculum  and  school  manage- 
ment as  well  as  small-scale  projects  that  provide  aid  to  individual 
students  by  tuition  assistance,  tutoring,  and  mentoring.  There 
is  the  overall  “desperate  for  resources”  perception  that  businesses 
have  about  public  schools,  that  any  amount  of  money,  time,  or 
expertise  that  companies  can  provide  will  help.  There  is  cited 
over  100,000  business-school  partnerships  formed  since  1983. 
Such  companies  as  IBM,  Exxon,  Coca-Cola,  RJR  Nabisco, 
Citicorp,  and  the  Fannie  Mac  programs  are  stated  as  mounting 
a virtual  crusade  to  help  save  the  public  schools.  Items  used 
to  measure  the  success  of  projects  includes  students  receiving 
higher  grades,  staying  in  schools,  earning  higher  SAT  and  ACT 


scores,  staying  off  drugs,  and  picking  a career.  Secondly,  restruc- 
turing for  site-based  management  is  suggested  as  a measure  of 
success.  This  popular  reform  in  which  principals  and  teachers, 
not  politicians,  set  budgets  and  shape  curriculum  requires  new 
skills.  Recognizing  this  need,  IBM,  Xerox,  and  AT&T  now  offer 
selected  public  school  teachers,  principals,  and  administrators 
company  manager  training  that  includes  finance,  leadership, 
team-building,  and  communication.  A third  measure  of  success 
looks  at  the  overhaul  of  antiquated  education  laws.  The  Business 
Roundtable,  consisting  of  200  CEOs  from  the  largest  American 
corporations,  has  persuaded  165  CEOs  to  adopt  a state  and 
work  closely  with  the  governor,  legislators,  and  educators  to 
pass  and  implement  laws  for  systemic  change.  Businesses  want 
a literate  work  force,  smart  consumers  for  their  money,  and— 
yes— their  employees  to  feel  good.  Currently,  this  is  not  happen- 
ing and  education  is  labeled  a crisis.  To  help  solve  this  crisis, 
politicians,  parents,  principals,  and  business  leaden  must  get 
deeply  involved.  Although  many  educators  will  dislike  terms 
such  as  “fix”  or  “save”  the  schools,  or  the  fact  that  non-educators 
are  poking  their  noses  into  the  field,  it  is  difficult  to  aigue  that 
too  many  students  and  fine  educators  are  being  lost  in  the 
current  system.  This  entire  Fortune  issue,  but  particularly  this 
article,  is  w'ritten  clearly  an  I directly  names  problems,  treat- 
ments, results,  and  recommendations. 


What  Reformers  Would  Have  Us  Do: 

Recommendations  for  Improving  Preservice  Teacher 
Preparation  Programs  Drawn  from  27  Reform  Proposals 

By  Donald  Cruickshank  and  Marilyn  Troyer,  The  Ohio  State  University 


Since  1933  more  than  two  dozen  documents  have  been 
written  that  speak  directly  to  improving  preservice  teacher  prep' 
aration  in  the  United  States.  Inspected,  they  provide  the  field 
with  reform -related  thought  spanning  six  decades.  Gleanings 
should  be  particularly  useful  at  times  such  as  the  present  when 
revisions  in  teacher  education  programs  are  being  considered, 
when  states  redesign  program  approval  standards,  and  when 
the  National  Council  for  Accreditation  of  Teacher  Education 
(NCATE)  reformulates  national  standards.  Such  an  inspection 
could  yield  a synthesis  of  recommendations.  That  was  the  intent 
of  this  study. 

Method 

Twenty-seven  documents  written  with  the  intention  of 
improving  teacher  preparation  were  analyzed  (see  references).  A 
lengthy  synthesis  of  the  content  of  the  documents  was  developed 
according  to  their  recommendations  about  (1)  preservice  teachers 
(their  recruitment,  selection  and  retention);  (2)  teacher  prepa- 
ration faculty;  (3)  the  teacher  preparation  curriculum;  (4)  instruc- 
tion in  teacher  preparation;  (5)  the  context  and  facilities  tor 
teacher  preparation;  (6)  teacher  preparation  program  evaluation; 
and  (7)  program  governance.  A matrix  wherein  the  vertical  axis 
contained  the  specific  recommendations  and  the  horizontal 
axis  the  document  authors’  names  was  created.  Entries  in  the 
matrix  cells  indicated  which  documents  were  the  source  of 
each  recommendation. 

This  article  provides  an  overview  of  results  by  way  of  an 
interpretation  of  the  complex  matrix.  Specifically,  the  question 
addressed  was,  What  is  the  nature  of  the  recommendations  made 
in  these  documents?  The  analysis  of  the  matrix  was  limited  in 
that  not  all  documents  addressed  all  variables  extant  in  teacher 
preparation  (students,  faculty,  curriculum,  instruction,  etc.). 

Results 

Of  the  157  recommendations  identified,  7°  of  them  were 
related  to  curriculum,  24  to  instruction,  21  to  faculty,  15  to  pro- 
service  teachers,  10  to  context  and  facilities,  5 to  governance, 
and  3 to  program  evaluation.  (A  summary  ot  the  results  appear 
in  Tiblc  1 on  page  6.) 

Curriculum  Three  nmo*  as  many  recommendation^  were  made 
tor  improving  cumculum  as  were  made  tot  an\  orhet  variable. 


Therein  were  27  overall  recommendations,  8 to  improve  general 
education,  19  specifying  the  need  to  improve  preservice  teacher 
subject  matter  preparation,  and  25  to  improve  professional  edu- 
cation. With  regard  to  the  27  overall  recommendations,  4 of 
them  were  mentioned  in  4 or  more  documents:  teacher  prepa- 
ration for  initial  service  should  consist  of  a 5-year  sequence 
combining  both  bachelors  and  master’s  degrees  [6];  entry-level 
professional  training  of  teachers  should  take  a minimum  of  6 
years  [41;  courses  and  programs  that  are  offered  must  grow'  out 
of  and  reflect  carefully  considered  conceptions  of  education  [4]; 
and  every1  program  for  the  initial  preparation  of  teachers  should 
include  general  education,  subject  specialization,  and  profes- 
sional studies  [4]. 

Genera/  education  Eight  recommendations  were  identified  that 
were  directed  at  this  curriculum  sub-component.  Most  notable 
was  that  16  documents  recommend  a cohesive,  planned  program 
of  general  education,  rather  than  an  accumulation  ot  courses 
scattered  across  a number  of  departments.  The  following  areas 
within  general  education  were  most  mentioned  as  desirable: 
psychology  [12],  sociology  [11],  anthropology  [8],  the  arts  [8], 
natural  sciences  [71,  structure  and  uses  of  knowledge  [71,  liter- 
ature [5],  history  [5],  mathematics  [5],  humanities  [4],  speech/ 
communication  [4],  and  philosophy  [4]. 

iAcatiemic  or  teaching  specialization  Nineteen  recommendations 
related  to  academic  or  teaching  specializations  were  made.  The 
general  conclusion  reached  in  19  documents  was  that  prospec- 
tive teachers  should  he  well-prepared  in  the  subject  field  they 
will  teach  and  in  related  fields. 

Pro/essionul  education  Twenty-five  professional  education  recom- 
mendations were  evident,  but  only  one  appeared  in  as  many  as 
four  documents:  professional  education  should  he  based  upon 
a clear  description  of  the  role  of  the  teacher  and  role  charac- 
teristics known  to  he  related  to  pupil  learning.  This  reinforced 
the  above  noted  general  curriculum  recommendation  that  pro- 
grams he  based  upon  thoughtful  conceptions.  All  but  three 
documents,  however,  made  specific  recommendations  with  regani 
to  the  professional  curriculum  topics.  Those  mentioned  most 
frequently  were:  human  growth  and  development  [17],  instruc- 
tional strategies/techniques  [16],  diagnosing  pupil  needs  and 
difficulties  [141,  learning  theory  [131,  measurement  and  evalua- 
tion [12],  instructional  media  and  technology  [12],  community 
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Recommendations  (continued) 

relations  [11],  classroom  management  [10],  self-awareness  [10], 
group  dynamics  [9],  interpersonal  relationships  [9],  curriculum 
design  and  development  [91,  selecting  or  developing  and  eval- 
uating instructional  materials  [9],  philosophy  of  education  [9], 
research  interpretation  and  application  [9],  values  clarification 
[8],  critical  thinking  and  problem  solving  [8],  exceptional  chil- 
dren [8],  planning  instruction  [8],  parent  relations  [8],  history 
of  education  [8],  communication  skills  [7]  and  formulating 
instructional  objectives  [7]. 


Instruction  The  teacher  preparation  program  variable  next  most 
mentioned  with  24,  instruction  followed  curriculum  in  number 
of  recommendations.  Eleven  had  the  concurrence  of  more  than 
four  documents  as  follows:  instruction  should  be  individualized 
to  meet  the  needs  of  specific  preservice  teachers  [11],  direct 
experiences  in  classrooms  should  be  part  of  the  entire  program 
[8],  training  and  evaluation  of  training  should  be  performance- 
based  [6],  programs  should  help  students  develop  their  own  styles 
rather  than  urging  them  to  teach  like  someone  else  [5],  instruc- 


Table  1*— Summary  of  Results 


1.  157  recommendations  gleaned  from  27  reform  teacher  edu- 
cation reform  proposals  were  identified  and  organized  into 
seven  categories:  curriculum  (79),  instruction  (24),  teacher 
preparation  faculty  (21),  preservice  teachers  (15),  context- 
facilities  (10),  governance  (5),  evaluation  (3). 

2.  Most  mentioned  recommendations  by  category  with  fre- 
quencies in  parentheses. 

a.  Curriculum  should: 

(1)  combine  the  baccalaureate  and  master’s  degree  in 
five  years  [6] 

(2)  take  a minimum  of  six  years  [4] 

(3)  grow-  out  of  a considered  conception  of  education  [4] 

(4)  include  general  education,  subject  specialization, 
and  professional  studies  [4] 

(5)  reflect  a cohesive,  planned  program  of  general  edu- 
cation [16] 

(6)  ensure  teachers  well-prepared  in  their  subject  specialty 
and  in  related  fields  [19] 

(7)  in  its  professional  part  be  based  upon  a clear  descrip- 
tion of  the  role  of  teacher  and  what  is  known  about 
effective  teaching  [4] 

(8)  in  its  professional  part  ensure  coverage  of  specific, 
identified  topics  [24] 

b.  Instruction  should: 

(1)  be  individualized  [11] 

(2)  include  a one-year  internship  [9] 

(3)  provide  experiences  in  K-12  classrooms  throughout 
the  programs  [8] 

(4)  be  performance -based  [6] 

(5)  nurture  personal  teaching  styles  [5] 

(6)  draw  upon  different  instructional  strategies  and  use 
latest  aids  and  media  [5] 

(7)  be  a demonstration  of  exemplary  teaching  [41 

(8)  engage  preservice  teachers  in  planning,  carrying-out 
and  evaluating  the  preservice  experience  [4] 


(9)  include  preservice  teacher  personal  counseling  [4] 

c . Faculty  should: 

(1)  involve,  all  university  faculty  in  teacher  prepara- 
tion [7] 

(2)  model  appropriate  instructional  techniques  [6]  (see 
7 above) 

(3)  recognize  school-based  faculty  as  regular  faculty  [6] 

(4)  be  knowledgeable  of  the  whole  field  of  teacher  prepa- 
ration, not  just  a specialty  [4] 

(5)  have  regular  scholarly  contact  and  involvement  in 
schools  [3] 

(6)  be  prepared  for  work  as  school-based  teacher  edu- 
cators [3] 

d.  Preservice  teachers  should: 

(1)  be  selected  based  upon  a system  that  is  continuously 
evaluated  [12] 

(2)  be  selected  on  the  bases  of  commitment  [7],  collegiate 
academic  success  [6],  communication  skills  [5],  per- 
sonal qualities  [5],  health-vitality  [5],  and  intellect  [5] 

(3)  prior  to  graduation,  demonstrate  successful  teach- 
ing [7] 

(4)  prior  to  certification  be  tested  to  demonstrate  knowl- 
edge of  pedagogy  related  to  effective  teaching  [5] 

e.  Context- facilities  should: 

(1)  reflect  use  of  ideal  K-12  classrooms  for  preservice 
teacher  preparation  [4] 

(2)  include  community  and  community  agencies  [41 

(3)  include  special  training  complexes  [3] 

(4)  include  libraries  containing  instructional  resources 
and  technology 

f.  Governance  should  be  a collaborative  effort  of  rhe  uni- 
versity, organized  teaching,  local  education  agencies  and 

the  public  [3] 

g.  Program  evaluation  should  he  continuous  and  result  in 

modifications  |2| 
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Recommendations  (continued) 


tion  in  the  program  should  model  different  instructional  methods 
including  use  of  the  latest  instructional  aids  and  media  [51, 
instruction  should  reflect  exemplary  teaching  practices  [4],  pro- 
grams  should  provide  for  preservice  teacher  self-direction  and 
active  participation  in  planning,  carrying-out  and  evaluating 
the  professional  experience  [4],  and  instruction  in  teacher  prepa- 
ration should  include  personal  counseling  to  enhance  preservice 
teacher  development  [4].  Instructional  alternatives  most  often 
recommended  for  use  in  teacher  preparation  were:  teaching  in 
natural  classrooms  [22],  classroom  observation  [141,  simulations 
[8],  protocol  materials  [7],  microteaching  [6],  tutoring  [5],  and 
community  and  social  agency  projects  [5]. 

Faculty  Teachers  of  teachers  received  considerable  attention 
in  the  reform  documents  and  21  related  recommendations  were 
identified.  Four  recommendations  received  the  most  support. 
Seven  reform  documents  called  for  all -uni versify  faculty  involve- 
ment in  teacher  preparation.  Six  required  teacher  educators  to 
be  exemplary’  teachers,  and  particularly  that  they  model  appro- 
priate instructional  techniques.  These  documents  supported 
excellence  in  teaching  as  a major  criterion  for  promotion  and 
tenure.  Six  argued  for  recognition  of  school-based  faculty  (e.g.} 
cooperating  teachers)  as  members  of  the  education  faculty.  Four 
documents  recommended  that  all  persons  teaching  teachers 
must  not  only  be  knowledgeable  in  their  particular  area  of  exper- 
tise but  also  have  understanding  of  the  whole  process  of  teacher 
preparation  and  its  attendant  issues  and  problems.  Mentioned 
in  three  documents  each  were  the  following  recommendations: 
teacher  educators  should  have  regular  contact  with  schools, 
they  should  be  actively  involved  in  research  and  scholarship 
directly  related  to  classroom  practices,  and  school -based  teacher 
educators  must  receive  preparation  for  their  roles  and  should 
have  joint  or  adjunct  appointments. 

Presem'ce  teachers  The  variable  which  received  the  fourth-most 
recommendations  had  to  do  with  preservice  teacher  recruit- 
ment, selection,  admission  and  retention.  Under  that  rubric, 
12  recommendations  were  mentioned  in  five  or  more  reports: 
student  selection  and  retention  should  be  a process  ot  contin- 
uous evaluation  of  each  students  progress  and  achievement, 
and  should  include  close  screening  of  candidates  at  various 
points  in  the  training  process  [12];  preservice  teachers  should 
be  admitted  based  upon  commitment  to  the  teaching  profession 
[7],  above  average  collegiate  scholarship  [6],  demonstrated  suc- 
cess academically  [6],  competence  in  communication  skills  [5], 
pcrsonal-social-emotional  qualities  [5],  physical  health  and 
vitality  [5],  and  measures  of  intellectual  competence  [5];  before 
graduation  candidates  should  demonstrate  their  ability  to  teach 
successfully  [71;  teacher  preparation  should  have  systematic 
reciuitment  programs  \t]\  and  prior  to  certification  candidates 
should  pass  an  examination  assessing  knowledge  ot  pedagogy 
related  to  effective  teaching  [5]. 


Contexr//aciIities  Ten  recommendations  were  identified  asso- 
ciated with  context  or  facilities.  Four  documents  each  recom- 
mended that:  teacher  education  programs  should  continue  to 
be  located  in  colleges  and  universities;  universities  should  work 
with  schools  to  create  ideal  K-12  classrooms  for  preservice  teacher 
preparation;  and  preservice  field  experiences  should  not  be 
limited  to  K-12  classrooms  but  should  involve  community  activ- 
ity. Three  documents  urged  that  training  complexes  should  be 
established  for  use  by  both  preseivice  and  inservice  teachers, 
and  that  facilities  for  preservice  preparation  should  include 
libraries  containing  instructional  resources  and  technology. 

Governance  Only  one  of  the  five  governance  recommendations 
was  supported  in  more  than  one  document.  That  one,  evident 
in  three  proposals,  recommended  that  governance  of  teacher 
education  should  be  a collaborative  effort  involving  the  univer- 
sity, organized  teaching,  local  education  agencies  and  the  public. 

Program  evaluation  Of  the  four  program  evaluation  recommenda- 
tions, one  received  support  in  two  documents:  the  program  should 
be  continually  evaluated  and  modified  based  on  input  from  pre- 
service  teachers,  graduates  in  service,  and  education  faculty. 

Discussion 

Since  the  recommendations  derive  from  a great  many 
documents  issued  over  a period  of  33  years  during  which  the 
socio-political  times  varied  tremendously,  and  since  they  ori- 
ginated from  a variety  of  sources  (governmental  and  nongov- 
ernmental, establishment  and  nonestablishment,  liberal  and 
conservative),  it  is  hardly  surprising  that  such  a wide  range  of 
recommendations  was  offered  and  that  consensus  on  them  seemed 
moderate.  Of  greatest  apparent  overall  concern  to  would-be 
■reformers  was  the  teacher  preparation  curriculum,  and  therein 
that  attention  be  given  to  better  general  education  for  teachers, 
improved  preparation  in  the  content  they  will  teach,  and  assur- 
ance that  they  will  be  better  trained  (i.e.  attain  specifically  iden- 
tified pedagogical  knowledge  and  skills). 

In  the  realm  of  instruction,  reformers  argued  for  indi- 
vidualization, better  and  more  direct  experiences  in  K-12  class- 
rooms, modeling  by  education  faculty  of  exemplary  teaching 
practices,  and  use  of  campus-based  laboratory  experiences.  In 
addition  to  recommending  that  education  faculty  model  good 
practice,  they  were  admonished  to  work  collectively  with  aca- 
demicians and  school-based  teacher  educators  to  improve  pre- 
service preparation,  to  get  into  the  schools,  to  know  their  field 
broadly  (not  just  their  specialty),  and  to  do  scholarship  with 
direct  application  to  classroom  teaching. 

Clearly  reformers  want  better  attention  to  preservice 
teacher  selection  and  retention,  particularly  monitoring  them 
throughout  their  program  and  giving  further  attention  to  finding 
ami  using  valid  predictors  of  teaching  success. 

(ommmai  im  page  8) 
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Fewer  recommendations  were  related  to  context/facilities, 
governance,  and  program  evaluation,  not  making  them  less 
notable  but  evidently  receiving  less  attention. 

Conclusions 

The  above  recommendations  stand  as  a motherlode  of 
ideas.  Since  they  derive  from  the  most  serious  recent  efforts 
toward  teacher  education  reform  in  the  United  States,  they 
deserve  serious  consideration  by  all  teacher  preparation  stake- 
holders:  professional  education  units,  state  program  approval 
agencies,  NCATE,  teacher  education  associations  and  others. 

It  is  incumbent  upon  teacher  {.reparation  units  to  con- 
vene faculty  to  weigh  each  recommendation  asking  such  ques- 
tions as:  Is  this  a worthy  goal?  Why  so?  Where  is  this  unit  in 
relationship  to  the  goal?  Where  does  it  want  to  be?  How,  if  we 
wish,  can  we  get  from  here  to  there? 


Similarly  agencies  responsible  for  program  accreditation 
and  approval  (NCATE,  NASDTEC,  learned  societies  and  state 
agencies)  should  review*  the  recommendations  to  determine 
the  extent  to  which  each  is  or  should  be  promoted  through 
their  standards. 

Of  course,  teacher  education  associations  (A  ACTE,  ATE) 
also  should  and  could  promote  all  or  selected  recommendations 
through  resolutions  and  by  way  of  task  forces. 

Finally,  other  stakeholders  including  the  federal  govern- 
ment, teacher  organizations  and  foundations  have  similar 
responsibilities. 

Not  to  reflect  on  this  legacy  of  reform  ideas  is  myopic  at 
best  and  nonfeasant  at  worst.  Clearly,  many  reform  recommen- 
dations have  not  been  accepted  or  at  least  not  implemented.  We 
need  to  ask,  why  not? 
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Research  Alive  is  a special  section  of  the  Mid-Western  Educational  Researcher  that  is  intended  to  identify  some 
of  the  significant  research  that  the  reader  may  be  interested  in.  Research  will  be  presented  in  an  abstracted  form  as  it  is 
assumed  that  ma*  .y  orofessionals  are  very  busy  and  can’t  scan  all  of  the  literature  that  would  be  of  interest  and  applicable 
to  their  practice.  This  section  should  provide  professionals  a brief  look  at  research  that  they  could  then  examine  further 
if  the  article  was  of  interest  to  them.  The  three  articles  that  are  abstracted  for  this  issue  have  been  chosen  by  Dr.  Snowman 
and  Dr.  Goddard.  It  is  hoped  that  the  Research  Alive  section  will  be  more  than  articles  selected  by  a few  experts,  but 
rather  an  interactive  endeavor.  That  is,  the  editors  of  this  section  of  the  Mid-Western  Educational  Researcher  will  select 
articles,  but  the  reader  may  also  suggest  articles  or  topics  of  interest.  This  places  a responsibility  on  our  readers  to  identify 
their  areas  of  interest  and  concern.  Our  goal  is  to  make  this  section  as  sensitive  to  the  needs  of  our  readers  as  possible. 
It  is  also  our  hope  that  this  section  of  the  Researcher  will  be  duplicated  and  disseminated  among  other  interested  readers 
and  colleagues.  We  would  appreciate  your  comments  and  suggestions. 

Isadore  Newman  and  Gregory  Merchant,  Co-Edirors,  Mid-VCtestein  Educational  Researcher 
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Rieber,  L.  P.  (1990).  Using  computer  animated  graphics  in  sci- 
ence instruction  with  children.  Journal  of  Educational  Psychology, 
82(1),  135-140. 

Think  back  for  a moment  to  that  first  physics  class  you 
took  in  high  school  or  junior  high  school.  How  would  you  describe 
the  experience?  For  some  the  description  might  include  such 
terms  as  boring,  dry,  confusing,  dull,  and  nonmeaningful  because 
you  had  to  leam  the  concepts  and  principles  largely,  if  not  entirely, 
from  text,  lectures,  and  chalkboard  diagrams.  Recent  research, 
however,  suggest  that  well-designed  computer-based  instruction 
may  save  today’s  students  from  that  same  terrible  fate. 

In  the  March  1990  (Vol.  82,  No.  1)  issue  of  the  Journal  of 
Educational  Psychology,  Lloyd  R.  Rieber  of  Texas  A&.M  University 
argues  that  computer-based  physics  instruction  can  be  designed 
to  include  two  features  that  may  lead  to  increased  levels  of  learn- 
ing enjoyment.  One  feature  is  the  use  of  animation  to  illustrate 
the  motion  and  trajectory  of  objects.  The  second  feature  is 
the  use  of  simulation  activities  to  practice  the  application  of 
basic  principles. 

To  test  the  effectiveness  of  animation  and  practice,  Rieber 
had  fourth-grade  and  fifth-grade  students  leam  Newton’s  laws  of 
motion  through  one  of  six  forms  of  a computer-based  lesson. 
Students  saw  a lesson  that  contained  either  no  graphics,  static 
graphics  (forces  of  motion  and  trajectory  were  represented  by 
arrows  and  path  lines),  or  animated  graphics.  Within  each  of 
these  conditions,  students  engaged  in  either  behavioral  practice 
(answering  multiple-choice  questions  and  receiving  corrective 
feedback),  cognitive  practice  (simulating  the  movement  of  a 
starship  in  a ffictionless,  gravity-free  environment  by  manipu- 
lating the  speed  and  direction  of  a free-floating  triangular  sym- 
bol), or  no  practice.  After  the  lesson,  all  students  answered  35 
multiple-choice  questions  that  measured  application  of  Newtons 
laws  and  completed  a survey  that  measured  their  attitudes  about 
computers,  science,  and  the  lesson  that  had  just  been  presented. 

Rieber’s  main  finding  was  an  interaction  between  degree 
of  visual  elaborat  ion  and  type  of  practice.  The  animated  graphics 
lesson  had  a positive  effect  only  for  those  subjects  who  engaged 
in  behavioral  practice.  Students  who  engaged  in  cognitive  prac- 
tice performed  at  the  same  level  regardless  of  whether  they  saw 
animated  graphics,  static  graphics,  or  no  graphics.  Although  this 
was  not  the  pattern  anticipated  by  Rieber  (he  expected  that 
students  would  depend  less  on  practice  as  the  visual  elaboration 
in  the  lesson  increased),  it  allows  the  same  general  conclusion 
about  the  role  of  practice  that  wc  mentioned  in  our  summary 
of  the  Cohen  and  Riel  study:  the  type  of  practice  from  which 
students  will  benefit  most  depends  on  the  presence  of  other 
factors.  The  old  prescription  “Practice  makes  perfect”  should 
be  revised  to  read  “Under  condition  X,  practice  Y makes  perfect.” 

Finally,  no  differences  in  attitude  were  observed  as  a 
function  of  either  visual  elaboration  or  practice.  Since  previous 
research  on  computer-based  instruction  has  often  reported  im- 
provements in  attitudes  toward  computers,  the  current  finding 
may  be  indicating  that  today’s  youngsters  are  more  familiar  and 
comfortable  with  computers  and  computer-based  instruction 
than  their  peers  of  five  to  ten  years  ago. 


Cohen,  M.,  & Riel,  M.  (1989).  The  effect  of  distant  audiences 
on  students  writing.  American  Educational  Research  Journal , 
26  (2),  143-159. 

There’s  an  old  story  about  a young  violin  student  who 
gets  lost  on  his  way  to  a concert  at  New  York’s  Carnegie  Hall. 
Not  wishing  to  arrive  late,  he  stops  an  elderly  passerby  and  says, 
“Pardon  me,  sir,  but  can  you  tell  me  how  to  get  to  Carnegie  Hall?” 
The  elderly  man,  noticing  the  violin  case  under  the  young  man’s 
arm,  replies,  “Practice,  practice,  practice!”  The  message  of  this 
story,  and  it  is  one  that  many  educators  accept  at  face  value,  is, 
of  course,  that  practice  makes  perfect. 

When  the  practice  makes  perfect  notion  is  applied  to 
the  teaching  of  writing,  students  are  given  one  or  more  writing 
assignments  a week  on  various  topics  that  are  usually  chosen 
by  the  teacher  (e.g.,  “How  recycling  helps  the  environment”). 
Usually  there  is  an  implicit  understanding  between  teacher 
and  students  that  the  purpose  of  the  assignments  is  to  practice 
the  implementation  of  various  writing  skills  and  that  the  teacher 
will  read  the  essays  in  order  to  evaluate  how  well  these  skills 
have  been  used. 

Does  such  practice  produce  good  good  quality  papers? 
Not  necessarily,  aigue  Moshe  Cohen  and  Margaret  Riel  in  the 
summer  1989  issue  of  the  American  Educational  Research  Journal. 
Cohen  and  Riel  see  this  approach  as  limiting  because  the  writing 
is  done  in  an  artificial  context.  That  is,  students  write  for  the 
purpose  of  having  previously  learned  skills  evaluated  by  an 
authority  figure  rather  than  for  the  more  common  purpose  of 
communicating  ideas  to  a particular  audience.  Their  argument 
is  based  on  the  findings  of  other  researchers  that  accomplished 
adult  writers  (expens,  if  you  will)  vary  the  complexity,  organi- 
zation, and  style  of  what  they  write  as  a function  of  who  they 
are  writing  for,  and  that  the  self-initiated  writings  of  primary 
grade  children  (novices)  show  more  sensitivity  to  intended  audi- 
ences than  the  teacher-imposed  assignments  of  comparable 
age-mates. 

To  test  their  hypothesis  that  students  who  write  for  a 
real  audience  produce  a better  product  than  students  who  write 
only  for  the  teacher’s  eyes,  Cohen  and  Riel  examined  the  com- 
positions produced  by  students  in  two  seventh-grade  classrooms 
in  a school  in  Jerusalem.  In  one  classroom,  students  were  told 
that  they  would  be  participating  in  something  called  the  Inter- 
Cultural  Learning  Network.  This  involved  writing  a composi- 
tion that  would  be  typed  into  a computer  and  sent  to  an  elec- 
tronic mailbox  in  the  United  States  where  other  students  would 
retrieve  it  and  read  it.  They  were  asked  to  write  about  one  of 
four  specific  topics  (e.g.,  a recent  sporting  event).  One  week 
later,  the  students  were  asked  to  write  on  the  same  topic  as  part 
of  a scheduled  exam.  The  students  in  the  second  classroom  also 
wrote  two  compositions  on  one  of  the  four  assigned  topics,  but 
in  the  opposite  sequence. 

The  papers  from  each  classroom  were  scored  wholisti- 
cally  by  the  classioom  teacher  on  a 0-100  scale  and  by  two  inde- 
pendent raters  on  a 1-4  scale  for  content,  organization,  vocabu- 
lary, language  use,  and  mechanics.  Both  teachers  and  raters  were 
unaware  of  which  papers  reflected  which  audience  condition. 

(continued) 
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Student  writing  ( continued ) 


Contrary  to  the  teacher’s  expectations,  the  papers  writ' 
ten  to  communicate  with  peers  were  rated  higher  by  both  the 
teachers  and  the  independent  raters  than  the  papers  written  for 
the  exam.  The  strongest  effects  were  found  for  organization, 
content,  and  language  use.  When  students  wrote  for  a peer 
audience,  their  composit  ions  were  more  fl uen  t , better  organized , 
and  were  more  clearly  stated  and  supported. 

The  main  reason  for  the  difference  between  compos i' 
tions,  according  to  Cohen  and  Riel,  was  that  the  seventh-grade 
students  made  fewer  assumptions  about  how  much  background 
knowledge  students  in  other  countries  were  likely  to  have  about 
their  topics.  Hence,  the  need  to  be  more  organized  and  explicit 
when  writing  for  this  audience. 

Not  surprisingly,  Cohen  and  Riel  recommend  that  stu- 
dents be  given  more  opportunities  to  write  for  real  audiences  in 
order  to  share  information  and  express  opinions.  Possible  audi- 
ences include  peers  in  other  states  and  countries;  local,  state, 
and  federal  government  officials;  executives  of  companies  that 
market  products  for  children;  and  authors  of  children’s  books. 

Even  though  Cohen  and  Riel’s  results  may  be  due  in 
part  to  Hawthorne  Effect  (a  hypothesis  that  follow-up  studies 
should  confirm  or  reject),  I think  their  recommendation  is  well 
worth  exploring.  1 remember  my  own  positive  elementary  school 
experiences  with  pen  pals  and,  more  recently,  my  daughter’s 
delight  in  writing  to  and  receiving  a reply  from  children’s  author 
Judy  Blume. 


Carpenter,  T.  L.,  Fennema,  E.,  Peterson,  P.  L,  Chiang,  C.  P, 
and  Loef,  M.  (1989).  Using  knowledge  of  children’s  mathe- 
matics thinking  in  classroom  teaching:  An  experimental  study. 
American  Educational  Research  journal,  26(4),  499-531. 

Most  assume  that  educators  who  are  aware  of  and  use 
research-based  knowledge  of  learning  processes  and  instructional 
practices  are  likely  to  be  more  effective  teachers  than  their  less 
enlightened  peers.  But  wouldn’t  it  be  nice  if  we  could  cite  some 
empirical  evidence  to  support  what  we  assume  to  be  true?  Well, 
heip  has  arrived  in  the  form  of  Thomas  P.  Carpenter,  Elizabeth 
Fennema,  penelope  L.  Peterson,  Chi-Pang  Chiang,  and  Megan 
Loef.  In  the  Winter  1989  (Volume  26,  No.  4)  issue  of  the  American 
Educational  Research  Journal,  these  researchers  explore  the  ques- 
tion, Would  first-grade  teachers’  mathematics  instruction  and 
students’  mathematics  achievement  be  influenced  if  the  teachers 
were  given  explicit  knowledge  abou*  children’s  understanding  of 
mathematics  concepts  and  problem-solving  strategies? 

The  authors  tested  two  hypotheses.  The  first  hypothesis 
was  that  when  first-grade  teachers  were  taught  about  the  differ- 
ences among  mathematical  problems,  how  students’  mathe- 
matical knowledge  and  skill  evolve,  and  the  strategies  students 
use  for  mathematical  problem  solving,  their  classroom  instruction 


would  become  more  consistent  with  their  newly  acquired  knowl- 
edge. The  second  hypothesis  was  that  such  knowledge  would 
favorably  affect  the  teachers’  ability  to  assess  their  own  students’ 
mathematical  competence  and  this  would  be  reflected  in  the 
students’  performance. 

As  part  of  a four-week  summer  workshop,  these  teachers 
were  presented  with  research  findings  on  the  learning  and  develop- 
ment of  addition  and  subtraction  concepts  in  young  children, 
and  were  given  opportunities  to  think  about  and  plan  instruction 
based  on  this  knowledge.  One  teacher  commented  that  the  impor- 
tance of  listening  to  children  was  heightened  by  knowing  what 
questions  to  ask  and  for  what  types  of  responses  to  listen.  The 
teachers  were  observed  in  their  classrooms  during  the  following 
academic  year  and  were  tested  at  the  end  of  the  year  to  see  how 
much  they  knew  of  each  students’  mathematical  strengths  and 
weaknesses.  The  students  were  given  a standardized  mathematics 
achievement  pretest  in  September  and  a series  of  posttests  in 
April  and  May. 

In  comparison  to  a control  group,  experimental  teachers 
spent  significantly  less  time  on  the  acquisition  of  number  facts 
and  significantly  more  time  on  the  use  of  various  problem- 
solving strategies.  In  addition,  experimental  teachers  spent 
significantly  more  time  listening  to  the  thinking  processes  their 
students  used  and  knew  significantly  more  about  each  students’ 
problem-solving  processes. 

Differences  in  student  achievement  were  more  modest. 
There  were  no  overall  differences  between  the  experimental  and 
control  classes  in  students’  ability  to  solve  simple  addition  and 
subtraction  word  problems.  Since  the  average  scores  for  both 
groups  were  about  88  percent  correct,  this  lack  of  difference  was 
attributed  mostly  to  a ceiling  effect.  Students  in  the  experimental 
classes  scored  significantly  higher  on  complex  addition  and 
subtraction  word  problems.  This  difference  did  not  carry  over, 
however,  to  advanced  problems  that  involved  multiple  steps, 
extraneous  information,  or  grouping  and  partitioning.  Although 
the  lack  of  transfer  is  disappointing,  the  good  news  in  these 
results  is  that  teachers  need  not  worry  that  efforts  aimed  at  im- 
proving mathematical  problem-solving  skills  can  be  made  only 
at  the  expense  of  mastery  of  basic  computational  skills. 

In  summary,  Carpenter  et  al.  answer  an  important  prac- 
tical question:  Can  the  hugh  body  of  knowledge  that  researchers 
present  about  how  children  think  make  a difference  in  the  class- 
room? This  article  has  shown  that  when  teachers  are  made  aware 
of  research  findings,  they  are  inclined  to  alter  what  and  how  they 
teach,  with  subsequent  beneficial  effects  on  students’  learning. 
Such  findings  contradict  the  quote,  “A  university  does  great 
things,  but  there  is  only  thing  it  does  not  do;  it  does  not  intel- 
lectuals its  neighborhood.”  (John  Henry  Cardinal  Newman, 
1801-1890). 
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Education  and  Automaticity: 

An  Interview  with  Benjamin  S.  Bloom 


By  Gregory’  ].  Marchanr, 
Ball  State  University 


How  did  you 
get  started  in 
education,  and 
specifically  how 
did  you  end  up 
at  the  Univer- 
sity  of  Chicago? 


I met  Ralph 
Tyler  when  1 
was  working  in 
Washington  at 
the  Civilian 
Conservation 
Corp  camps.  1 
was  working  on 
tests  with  mos- 
quitoes, and  we 
asked  Tyler  to 
come  and  re- 
view our  work 
and  tell  us  what 
we  ought  to  do 
differently.  I had 
prepared  about 
50  charts  to  ex- 
plain our  work. 

When  1 showed  Benjamin  S.  Bloom  is  one  of  the  mosi 

them  to  him,  he  With  publications  translated  into  man 

quickly  shuffled  throughout  the  world.  He  has  advance 

through  them.  /earning,  provided  insights  into  leamin 

1 felt  angry  at  development  of  automaticity  in  the  tal 

him  for  ignor- 
ing my  work.  1 soon  came  to  realize  that  he  had  a photo- 
graphic memory  and  knew  the  charts  better  than  1 did. 
So,  I decided  1 was  going  to  study  with  Ralph  Tyler,  who 
was  at  Ohio  State  at  that  time.  I applied  to  Ohio  State 
and  then  found  out  that  he  had  moved  to  Chicago.  1 had 
no  idea  what  Chicago  was  like,  bur  I took  my  application 
and  sent  it  to  Chicago  because  1 was  going  to  study  with 
this  guy.  1 went  there  and  eventually  got  to  know  him 
very  well  and  worked  with  him  on  a number  of  projects. 


Let’s  look  at  some  of  your  interests  such  as  mastery 
learning.  A number  of  countries  have  embraced  mastery 


B enjamin  S.  B/oom  is  one  of  the  most  prominent  educational  leaders  of  our  time. 
With  publications  translated  into  many  languages  he  is  known  and  respected 
throughout  the  world.  He  has  advanced  the  cause  of  education  through  mastery 
learning , provided  insights  into  learning  through  his  taxonomy,  and  explored  the 
development  of  automaticity  in  the  talented.  Phorofa  Bobbe  Wolf,  (c)  1988 


learning.  One  of 
the  things  they 
have  going  for 
them  is  that  they 
have  a national 
curriculum.  They 
know  what  they 
want  to  do,  they 
know  what  their 
goals  are.  Do  you 
advocate  a na- 
tional curric- 
ulum for  the 
United  States? 

3 It’s  a hell  of  a big 

country.  If  you 

have  a very  small 
country  and  every- 
body’s in  agricul- 
ture, then  there 
is  a very  narrow 
set  of  things  that 
need  to  be  taught. 
When  you  have  a 
country  like  the 
United  States, 
butchers  and 
bakers  and  electri- 
cians, and  every- 
thing, your  prob- 
ucational  leaders  of  our  time.  lem  really  is:  what 

■ is  known  and  respected  should  be  the 

‘ education  through  mastery  base  for  all  of 

axonomy , and  explored  the  these  people,  and 

i Bobbe  Wolf  (c)  1988  beyond  that  what 

should  be  em- 
phasized or  ignored?  There  is  variety  as  well  as  con- 
stancy. The  problem  is  really  when  do  you  go  off  in  dif- 
ferent directions. 


How  do  you  respond  to  critics  that  accuse  mastery  learn- 
ing of  strengthening  the  weakest  link  at  the  expense  of 
the  rest  of  the  chain?  In  other  words,  people  who  say, 
“Fine,  you  may  be  decreasing  the  difference  between  the 
top  and  the  bottom,  but  not  only  are  you  helping  the 
person  at  the  bottom,  but  you’re  also  holding  back  the 
person  at  the  top?” 

(continued  on  page  M) 
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An  Interview  with  Bloom  (continued) 


I don't  see  why  it’s  necessary’  to  have  the  same  person 
teach  the  guy  that  is  at  the  very’  top  along  with  the  guy 
that  is  at  the  very  bottom.  If  you  take  a bunch  of  kids 
with  IQs  above  150  and  put  them  in  the  class  with  a 
bunch  of  kids  whose  IQs  are  below  100  you  have  a prob- 
lem in  almost  any  case. 


M Do  you  see  the  development  of  automaticity  as  being 
linear,  or  do  you  believe  there’s  any  kind  of  develop- 
mental stages  or  hierarchy  that  occurs? 

~~3~j  I’m  sure  there  is,  but  1 don't  think  we’ve  really  defined 
J the  stages  as  of  yet. 


M 

How  do  you  get  away  from  the  idea  of  perpetuating 
some  kind  of  ability  grouping? 

M 

B 

Not  everyone  wants  or  needs  the  same  thing.  They  begin 
to  divide  and  you  have  to  have  classes  for  these  and  classes 

B 

for  those  even  though  the  subject  is  not  that  different. 


What  do  you  see  as  being  the  effect  of  accountability, 
teacher  accountability,  when  it  comes  to  promoting 
mastery  learning? 

If  you  have  three  groups  of  students:  one  with  1-to-l 
teaching,  one  with  l-to-30  mastery  learning,  and  one 
with  conventional  l-to-30  instruction.  What  you  have  is 
this  one  at  the  50th  percentile,  this  one  is  at  about  the 
75th  percentile,  and  this  one  here  somewhere  around 
the  90th  percentile.  Then  your  problem  is,  what  are  the 
alterable  variable  that  you  can  begin  to  work  with  under 
conventional  instruction,  under  conventional  instruction 
plus  enhanced  prerequisites,  mastery  learning,  mastery 
learning  plus  enhanced  prerequisites,  and  so  on.  So  what 
I'm  trying  to  say  is  that  we  all  don't  have  to  eat  from 
the  same  menu.  We  can  make  various  combinations.  You 
can  bring  virtually  all  the  students  up  to  the  90th  per- 
centile; but  it’s  going  to  take  time  and  effort. 


Do  you  see  any  drawbacks  to  automaticity  or  is  it  always 
a positive  efficient  process? 


ing  from  the  plane  to  an  automobile.  The  two  don't  fit 
exactly.  So  they  can  end  up  doing  something  that  they 
do  in  the  plane  on  the  ground.  You  can  also  experience 
this  problem  if  you  originally  learned  to  drive  in  the 
United  States  and  then  go  to  England. 


So  automatizing  something  wouldn’t  always  have  to  be 
good.  You  could  have  a situation  where  a person  has 
learned  oroverleamed  a bad  or  less  than  perfect  way  of 
doing  something  or  in  other  instances  it  could  blind  a 
person  to  important  details. 

A problem  with  automaticity  is  that  something  can 
become  so  automatic  that  you  don’t  realize  that  you’re 
doing  it.  Therefore,  the  problem  becomes  how  do  you 
keep  some  vigilance  when  you’re  doing  something  that 
typically  is  automatic.  So  automaticity  many  times  is  a 
blessing;  other  times  it’s  really  a curse.  The  question 
is  how  to  get  the  best  of  it  yet  not  be  blinded  to  other 
things  that  might  he  wrong. 


Could  you  describe  the  concept  of  automaticity,  which 
is  the  focus  of  much  of  your  current  work? 

Automaticity  involves  a skill  or  manipulation  that  is  so 
overleamed  that  one  needs  to  pay  very  little  attention 
to  what  is  being  done.  If  a skill  has  been  automatized, 
you  can  do  something  else  at  the  same  time.  You  can 
now'  do  two  things  at  the  same  time.  One  that  you  do 
consciously  and  the  other  that  you’re  doing  almost  with- 
out thought.  When  you’re  driving  your  car,  you  can  be 
talking  to  your  wife  or  somebody,  or  singing  while  you’re 
driving.  The  driving  is  almost  automatic.  It  1 walk  along 
the  street  and  there’s  a dip  in  the  pavement,  and  I’m 
talking  to  somekxty,  l go  down  that  dip  and  goon  without 
ever  knowing  1 did  so. 


M The  reflective  teaching  movement  suggests  that  teachers 

should  be  trained  to  constantly  analyze  and  reflect 

upon  their  behaviors.  However,  the  literature  on  expert 
teachers  describes  much  of  their  practices  as  being  pat- 
terns or  routines  that  they  perform  almost  automatically. 
What  would  you  recommend  to  teachers  or  teacher 
education  programs? 


Try  to  keep  them  fi 


:oming  automatic. 


^ You’re  work  with  talented  individuals  has  identified 
— 5 automatized  processes  as  being  central  to  their  talent. 
What  would  you  say  to  parents  that  are  interested  in 
developing  talent  in  their  children? 
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An  Interview  with  Bloom  (continued) 


B 


Parents  have  to  know  that  practicing  a half  hour  a day  is 
not  going  to  be  enough.  To  become  talented  you  may 
start  out  practicing  a half  an  hour  a day,  but  that  be- 
comes  an  hour  a day,  an  hour  and  a half,  and  two  hours 
a day.  Eventually  they  come  to  spend  a third  of  their 
day  practicing.  If  they  don’t  do  it,  they  get  rusty.  And 
if  they  have  to  change  their  repertoire,  a tremendous 
amount  of  stress  can  occur. 


I’ve  got  a bunch  of  people  working  on  evaluation  of  art, 
science,  language  arts,  and  so  on.  The  question  really 
is  what  is  the  content  and  what  are  the  behaviors  that 
you’re  after  and  under  what  conditions?  And  your  prob 
lem  really  is  how  do  you  make  a curriculum  for  one  kind 
of  student  or  another  kind  of  student,  or  is  there  a curric- 
ulum you  would  want  to  be  common  for  all  those  students? 


What  do  you  think  the  impact  is  on  their  lives,  on  them 
psychologically  or  socially  as  a result  of  having  some 
skill  that  has  set  them  apart  as  being  talented? 


B 


It  is  clear  that  the  whole  notion  of  automaticity  is  a very 
powerful  one,  and  the  problem  really  is  what  are  you 
sacrificing  while  you  are  trying  to  develop  this.  You  can- 
not get  to  be  an  automatic  pianist  or  violinist  without 
putting  in  a tremendous  amount  of  time.  And  so  even- 
tually it’s  about  a third  of  your  life.  If  you  look  at  an 
actor,  you  find  they  overleam  their  skill,  their  repertoire. 
Then  sometimes  they  have  difficulty  separating  what 
they’re  doing  on  the  stage  from  what  they’re  doing  at 
the  dinner  table.  To  watch  a clown  at  the  circus.  He 
isn’t  really  the  clown,  but  he  is  the  clown,  because  he’s 
doing  it  two  or  three  times  a day. 


M 


You’re  saying  some  people  have  a difficult  time  taking 
the  makeup  off  once  they’ve  gotten  into  it* 


B 


When  you  overleam  something  to  such  an  extent  that  it’s 
really  a major  part  of  you,  something  has  been  sacrificed. 


M 


What  do  you  see  as  being  the  most  positive  movement 
in  research,  educational  research  today? 


So  we  need  to  make  sure  that  we’re  within  the  context 
of  a particular  curriculum  and  a specific  student  group 
when  we  research  effective  teaching  and  learning.  In 
general  concerning  the  state  of  education  Judith  Lanier 
has  suggested  that  as  our  society  has  changed  from  an 
industrial  base  to  an  information  base  the  demands  on 
education  have  changed*  It’s  not  enough  to  know  what 
to  do,  now  we  must  be  able  to  think,  analyze,  synthesis, 
evaluate,  and  make  decisions* 


The  basic  thing  I see  is  some  people  say  “I  want  this  and 
I want  that,”  but  we  try  to  ask  what  are  the  objectives 
we  have.  In  almost  every1  field  there  are  knowledge  and 
comprehension  objectives.  But  then  there  are  applica- 
tions, analysis,  and  synthesis  of  objectives.  And  unless 
you  know  the  basics  you  can’t  do  that.  So  our  problem  as 
a society  really  is  that  we  have  spent  several  generations 
trying  to  teach  what  to  know  and  comprehend  and  not 
what  to  do  with  it. 


M 


Thus  far,  what  do  you  consider  as  your  biggest  contri- 
bution to  education? 


I think  the  taxonomy  was  a brave  attempt.  A simple  easy 
to  handle  taxonomy  that  dealt  with  every  subject  has 
proven  to  be  popular  and  useful  to  a number  of  people. 
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Effects  of  Training  in  Supervision 
on  the  Behavior  of  Cooperating  Teachers 

Jody  Daughtry,  Susan  Tracz,  Berta  Gonzalez 
Department  of  Educational  Research,  Administration  and  Foundations 
School  of  Education  and  Human  Development 
California  State  University,  Fresno,  CA  93740 


Abstract 

The  purpose  of  this  study  was  to  determine  the  effects  of  short-term,  intensive  training  in  supervision  on  the  behavior  of 
cooperating  teacher*..  Trained  and  untrained  cooperating  teachers  were  compared  on  17  behaviors  including  observational  practices, 
analyses  of  student  teacher  performance,  and  feedback  techniques.  A series  of  two-tailed  independent  t-tests  was  performed  on  each 
of  the  behaviors.  In  all  cases  the  means  for  the  cooperating  teachers  receiving  training  were  higher  than  those  who  did  not  receive 
training.  In  addition,  the  ratings  indicated  that  there  were  significant  differences  favoring  trained  teachers  in  5 out  of  17  behaviors. 
These  results  indicate  that  even  short-term  training  may  have  a significant,  positive  effect  on  supervisory'  behavior. 


Student  teaching  is  widely  regarded  as  the  most  signifi- 
cant component  of  teacher  training  programs,  and  supervision 
is  a key  element  in  student  teaching  (Zahorik,  1988).  While 
supervision  is  generally  provided  by  both  university  faculty  and 
cooperating  teachers,  ^search  indicates  that  cooperating  teachers 
have  by  far  the  greater  influence  on  stude  * teachers  (Seperson 
and  Joyce,  1981).  During  the  past  two  decades  numerous  super- 
vision models  have  been  developed  that  focus  on  helping  student 
teachers  to  improve  their  pedagogical  skills.  Some  models  also 
aim  at  expanding  the  student  teachers’  capacity  to  analyze  and 
be  reflective  about  their  own  teaching  and  to  alter  their  teaching 
behavior  based  on  this  reflection. 

While  graduate  programs  in  supervison  provide  ample 
coverage  of  theory  and  practice  in  supervision,  few  cooperating 
teachers  hold  advanced  degrees  in  this  area.  Most  have  had  little 
or  no  supervisory  training  of  any  kind  (Freiberg  & Wax  man, 
1988).  Cognizant  of  both  the  key  role  played  by  cooperating 
teachers  in  clinical  experiences  and  their  general  lack  of  prepa- 
ration to  carry  out  this  role,  some  colleges  and  universities  have 
begun  to  invest  time  and  money  in  supervisory  training  for  these 
teachers  (Fields.  1988;  McNergney,  Lloyd,  Mintz,  & Moore,  1988; 
M( 'rehead,  Lyman,  & Waters,  1988). 

These  training  programs  vary  widely  in  scope,  sequence, 
and  duration.  To  date,  little  research  has  been  conducted  con- 
cerning their  effectiveness. 

Methods 

The  purpose  ot  this  study  was  to  determine  the  effects  of 
short-term,  intensive  training  in  supervision  on  the  behavior  ot 
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cooperating  teachers.  In  this  study,  supervision  was  defined  as 
the  improvement  of  classroom  performance  of  the  (student) 
teacher  through  observation,  analysis,  and  treatment  of  that 
performance  (Cogan,  1964). 

Subjects  The  subjects  for  this  study  were  elementary  and  second- 
ary student  teachers  in  a large  teacher  education  department. 
They  were  mailed  a survey  concerning  their  cooperating  teachers’ 
supervisory  behavior  near  the  end  of  their  student  teaching 
experience.  Of  the  147  student  teachers  who  were  surveyed, 
70  (48  percent)  responded.  The  insistence  by  a local  teacher’s 
union  on  absolute  anonymity  for  the  cooperating  teachers  being 
assessed,  made  it  impossible  to  mail  follow-up  surveys  to  try  to 
increase  the  response  rate.  The  questionnaires  were  coded  to 
indicate  whether  the  student  teacher  had  a cooperating  teacher 
w'ho  was  trained. 

In  order  to  become  a cooperating  teacher  and  train  student 
teachers,  teachers  must  fulfill  a rigorous  set  of  requirements. 
Although  specific  requirements  differ  from  district  to  district,  all 
cooperating  teachers  must  be  identified  by  their  building  principal 
and  their  district  curriculum  coordinator  as  being  exemplary 
teachers,  as  well  as  having  the  potential  to  mentor  novice  teachers. 

In  addition,  the  cooperating  teachers  who  supervised  the 
responding  student  teachers  consisted  of  two  groups.  The  first 
group  had  attended  a special  training  program  on  student-teacher 
supervision  practices,  while  the  second  group  had  received  no 
training.  The  cooperating  teachers  who  received  training  applied 
to  a local  university  for  program  admission.  These  teachers  were 
required  to  submit  a statement  on  their  philosophy  < education 
and  a letter  of  support  from  their  principal.  They  received  a 
stipend  of  $22 5 for  attending  the  supervisory  training  program. 


Supervision  (continued) 


Instrument  Student  teachers  rated  their  cooperating  teachers’ 
behaviors  on  an  instrument  consisting  of  17  five-point  Likert- 
type  items  on  observational  practices,  analyses  of  student-teacher 
performance,  and  feedback  techniques  (see  Table  1 for  a list  of 
all  instrument  items).  This  instrument  was  designed  by  Far  West 
Laboratory  to  be  used  for  the  evaluation  of  varying  training  pro- 
grams offered  on  several  university  campuses. 


Procedures  The  training  program  for  cooperating  teachers  con- 
sisted of  15  clock  hours  of  instruction.  Four  groups,  of  approx- 
imately 100  cooperating  teachers  each,  were  trained  in  four 
separate  sessions  over  a two-year  period.  The  first  training  group 
consisted  of  both  elementary  and  secondary  teachers.  In  response 
to  a formative  evaluation  conducted  after  the  training  session, 
subsequent  training  was  done  separately  for  elementary  and 
secondary  teachers.  (continued  on  page  18) 


Table  1 

Means  and  TTest  Results  Comparing  Untrained  and  Trained  Teachers 


Variables 

Untrained 
Teachers 
Mean 
(n  = 42) 

Trained 
Teachers 
Mean 
(n  = 28) 

t 

a.  Critiqued  lesson  plans 

2.45 

3.18 

-3.32+ 

b.  Jointly  planned  lessons 

2.17 

3.00 

-4.80t 

c.  Pre-conferenced 

2.24 

3.18 

-4.30+ 

d.  Observed  20+  minutes 

3.36 

3.82 

-2.88+ 

e.  Took  detailed  observation  notes 

2.21 

2.46 

- .89 

f.  Conferenced  within  one  day 

2.88 

3.36 

-1.85 

g.  Provided  examples  of  behavior 

2.48 

2.71 

- .96 

h.  Asked  for  lesson  assessment 

2.33 

2.71 

-1.52 

i.  Coupled  suggestion  with  examples 

2.80 

3.14 

-1.89 

j.  Allowed  experimentation 

3.19 

3.25 

- .30 

k.  Checked  understanding  of  feedback 

2.62 

3.00 

-1.81 

1.  Asked  clarifying  questions 

2.48 

2.75 

-1.13 

m.  Assisted  in  analysis  of  lesson  quality 

2.64 

3.04 

-1.82 

n.  Proposed  alternatives  

2.67 

3.07 

-2.11* 

o.  Cited  examples  of  teaching  behavior 

2.50 

2.54 

- .16 

p.  Helped  with  materials 

2.74 

3.07 

-1.43 

q.  Conveyed  sense  of  value 

3.12 

3.25 

- .46 

*p  .05 
tp  .01 


Supervision  (continued) 


These  teachers  were  trained  to  use  Cogan’s  (1964)  five-step 
supervision  model  consisting  of  the  pre -observation  conference, 
observation,  lesson  analysis,  the  post-observation  conference, 
and  the  post-conference  analysis.  The  training  was  designed  to 
improve  cooperating  teachers’  abilities  in  the  following  areas: 
establishing  rapport  with  student  teachers,  observing  student 
teachers  for  key  elements  of  effective  teaching,  analyzing  obser- 
vations, conducting  post-observation  conferences,  giving  focused 
feedback  about  lessons,  and  improving  student  teachers’  capacity 
to  reflect  on  their  own  teaching. 

Cooperating  teachers  practiced  observing  and  analyzing 
lessons  through  the  use  of  videotapes  of  students  teaching  classes 
in  their  regular  student-teaching  assignments.  All  cooperating 
teachers  viewed  taped  lessons  appropriate  to  their  grade  level 
or  subject  area  (e.g.,  elementary',  bilingual  elementary',  middle 
school  physical  education,  high  school  English).  A structured 
observation  form  was  used  and  conferencing  procedures  were 
taught  that  included  both  direct  feedback  and  questioning  to 
encourage  reflection  on  the  part  of  the  student  teachers. 

Results 

A series  of  two-tailed  independent  t-tests  was  performed 
on  each  of  17  cooperating  teacher  behaviors  (see  Table  1).  In  all 
cases  the  means  for  the  trained  cooperating  teachers  were  higher 
than  those  for  the  untrained  cooperating  teachers.  In  addition, 
the  ratings  indicated  that  there  were  significant  differences 
between  trained  and  untrained  teachers  on  5 out  of  17  behaviors. 
Trained  teachers  engaged  in  the  following  behaviors  significantly 
more  often  than  untrained  teachers:  critiquing  lesson  plans, 
jointly  planning  lessons  with  student  teachers,  preconferencing 


before  observations,  observing  the  student  teacher  for  20  or 
more  minutes,  and  proposing  alternative  strategies  or  materials. 

Discussion 

While  the  literature  is  filled  with  exhortations  to  train 
cooperating  teachers,  few  studies  have  examined  the  effects  of 
such  training.  This  study  indicates  that  even  short-term  training 
can  have  a significant,  positive  effect  on  supervisory  behavior. 
However,  in  this  study,  the  relationship  between  the  specific 
content  of  the  training  and  the  areas  of  greatest  difference  between 
trained  and  untrained  cooperating  teachers  was  not  entirely  clear. 
It  appears  that  as  a result  of  the  training,  teachers  engaged  in 
preconferencing,  observation,  and  postconferencing  more  fre- 
quently than  untrained  teachers,  but  that  the  training  had  little 
effect  on  what  they  do  during  these  supervision  activities.  For 
example,  while  trained  teachers  were  found  to  observe  students 
more  frequently  than  untrained  teachers,  they  were  not  signifi- 
cantly more  likely  to  take  notes  during  observations.  The  fact 
that  the  duration  of  the  training  was  only  15  hours  might  explain 
the  lack  of  impact  on  the  finer  points  of  supervision.  Perhaps 
the  brief  training  program  simply  served  to  emphasize  the  impor- 
tance of  the  supervision  process,  encouraging  the  teachers  to  do 
more  supervision  as  opposed  to  supervising  differently. 

This  study  supports  the  position  that  supervisory  training 
for  cooperating  teachers  is  worthwhile.  This  position  would  be 
strengthened  by  replication  using  a larger  sample  size,  randomly 
selecting  the  cooperating  teachers  to  be  trained,  examination 
of  the  impact  of  training  programs  of  longer  duration,  providing 
training  in  different  models  of  supervision,  and  assessing  super- 
visory behavior  through  direct  observation. 
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Selection  as  a Validity  Concern  in  Studies  on 
the  Effectiveness  of  Training  Programs 

Timothy  A.  Brannock,  Ball  State  University 


Internal  validity  refers  to  the  ability  to  make  causal  state- 
ments regarding  two  variables  (Cook  & Campbell,  1979).  In 
other  words,  does  the  treatment  really  affect  the  treatment  group? 
In  looking  at  the  effects  of  a treatment  one  must  design  studies 
in  such  a manner  to  eliminate  or  at  least  reduce  the  possibility 
of  that  factors  other  than  the  treatment  are  causing  an  effect 
on  the  treatment  group.  These  factors  ae  considered  threats  to 
the  internal  validity  of  the  study. 

One  such  threat  to  internal  validity  that  is  of  particular 
concern  to  studies  on  program  effectiveness  is  that  of  the  selec- 
tion of  the  participants  in  the  training.  Selection  may  be  con- 
sidered a threat  to  internal  validity  “when  an  effect  may  be  due 
to  the  difference  between  the  kinds  of  people  in  one  experimental 
group  as  opposed  to  another  (Cook  & Campbell,  1979,  p.  53).” 
One  of  the  ways  in  which  selection  occurs  is  through  the  use  of 
volunteers  in  the  treatment  group.  Subjects  who  volunteer  to  be 
treated  may  possess  certain  characteristics,  such  as  motivation, 
that  non-volunteering  subjects  do  not. 

The  selection  of  people  poses  a threat  to  the  internal 
validity  of  studies  that  evaluate  the  effectiveness  of  training 
programs.  There  are  various  approaches  to  help  minimize  the 
selection  threat.  The  following  are  some  approaches  to  help 
rule  out  motivation  to  volunteer  and  differing  characteristics 
of  participants  in  program  effectiveness  studies:  assignment  of 
trainees,  examining  and  controlling  for  characteristics  of  the 
experimental  and  control  group  subjects,  comparing  pre-  and  post- 
test  behaviors  of  those  trained,  use  volunteers  for  both  groups,  have 
the  study  compare  different  treatments  for  each  group,  or  one 
might  not  control  for  the  threat  but  mention  it  as  a possible  factor. 

Having  the  authority  to  assign  people  to  participate  in 
studies  is  not  a common  occurrence.  However,  to  some  extent 
the  military  does  have  this  authority  with  its  members.  In  a study 
of  fuel  savings  for  aircraft  Edwards  (1986)  was  able  to  assign  pilots 
to  computer-based  instruction  or  traditional  instruction  groups. 

Another  method  of  minimizing  selection  problems  with 
volunteers  involves  examining  the  characteristics  of  the  volun- 
teers compared  to  those  not  volunteering.  In  a study  of  parent 
training  (Giannotti  & Doyle,  1982)  Chi-square  analyses  were 
performed  on  socioeconomic  factors  of  the  parents  who  volun- 
teered for  training  and  those  who  did  not.  Socioeconomic  factors 
and  the  results  of  attitude  inventories  may  previde  insights  into 
the  characteristics  and  motivation  of  pm  gram  participants. 

The  most  common  way  of  relating  a difference  to  a treatment 
effect  is  through  the  use  of  pre-  and  post-test  measurements  (Gxik 
Campbell,  1979).  This  was  done  by  N oiler  and  Taylor  (1989) 
and  Goetaski  (1983)  in  studies  on  parent  effectiveness  training, 
by  Kruger  and  Smith  (1987)  on  management  training,  and  by  Noe 


and  Schmitt  (1986)  in  a study  on  school  administration  training 
(in  this  study  motivation  was  linked  to  training  effectiveness). 

A fourth  way  of  lessening  the  concern  about  internal  validity 
related  to  volunteering  would  be  to  include  only  volunteers  in 
the  study.  This  can  be  accomplished  by  providing  treatment  to 
one  randomly  selected  group  of  volunteers  while  the  other  group 
does  not  receive  treatment  until  after  the  outcome  has  been 
measured.  A less  ideal  arrangement  allows  the  subjects  to  volun- 
teer for  a particular  treatment  or  nontreatment  group.  Professors 
volunteered  to  be  trained  or  simply  to  be  observed  concerning 
effective  interaction  skills  (Long,  Sadker,  & Sadker,  1986). 

Comparisons  can  also  be  made  between  two  treatment  pro- 
cedures with  two  treatment  groups.  In  this  case  volunteering 
subjects  are  placed  in  one  of  two  or  more  treatment  groups.  This 
was  done  by  Bosco  and  Wagner  (1988)  in  a study  of  safety  instruc- 
tion and  by  Kearsley  (1988)  in  a study  on  computer-based  training. 

Another  means  of  dealing  with  the  issue  of  selection  related 
to  internal  validity  without  controlling  for  it  is  to  adknowledge 
that  the  nature  of  the  subject  selection  could  provide  an  alter- 
native explanation  of  the  results.  Daughtry,  Tracz,  and  Gonzalez 
(1991)  allude  to  this  in  the  article  presented  in  this  issue  of  the 
Mid-Western  Educational  Researcher  when  they  call  for  “randomly 
selecting  the  cooperating  teachers  to  be  trained, . . . providing 
training  in  different  models  of  supervision.*’ 

Internal  validity  is  a critical  area  of  concern  for  any  study. 
Studies  concerning  the  effectiveness  of  certain  training  pro- 
cedures need  to  be  careful  regarding  the  nature  of  the  selection 
procedures  of  their  participants.  Volunteers  may  be  more  highly 
motivated  or  possess  certain  other  characteristics,  which  may 
be  as  related  to  the  outcome  of  a study  as  the  treatment  procedure 
used.  Evaluation  of  training  programs  is  to  be  encouraged,  however, 
proper  selection  procedures  are  also  necessary. 
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Voices  in  Education 


The  Midwestern  Educational  Researcher  asked  leaders  in 
education  to  respond  to  the  question: 

What  is  the  greatest  problem  facing  education  today? 

I think  the  greatest  problem  facing  American  education 
today  is  the  same  as  that  facing  American  education  since  the 
time  of  universal,  compulsory’  education.  (We  only  rediscover 
the  problem  periodically;  it  persistently  exists).  This  problem, 
simply  stated,  is  the  failure  to  educate  large  numbers  of  students 
who  are  enrolled  (some  might  say,  held  captive)  in  our  schools. 
It  amuses  me,  in  a black  humor  sort  of  way,  that  separate  task 
forces  are  being  formed  for  ‘’at-risk”  students,  dropout  prevention, 
and  compensatory  education  when  the  targets  of  these  various 
task  forces  are  the  same  students. 

— Lmin  Anderson,  University  of  South  Carolina 

. . . student  motivation  to  learn  school  subjects  from 
junior  high  up  is  the  biggest  problem,  especially  for  poor  and 
minority  children.  — David  Berliner,  Arizona  State  University 

. . . teaching  to  the  diverse  population  of  learners;  edu- 
cating them  for  conceptual  understanding,  problem  solving,  etc. 

— Hilda  Borko,  University  of  Maryland 

. . . educating  the  children  of  the  poor,  the  sick,  and 
those  who  are  very  different  horn  ourselves. 

— Christoplier  Clark,  Michigan  State  University 

. . . the  speed  at  which  things  are  changing.  Students 
have  to  move  faster,  learn  faster,  think  faster,  and  be  adaptive 
with  the  pace  of  information  flow.  They  also  have  to  have  better 
pattern  recognition  and  better  relationship  skills  to  handle  this 
kind  of  change— it’s  stress  provoking! 

— Lyn  Como,  Teachers  College  Columbia 

. . . creating  the  type  of  contexts  within  schools  that 
allow  students  to  be  interested  in  learning  and  self-regulating 


in  their  own  school-related  behaviors. 

—Edward  Deci,  University  of  Rochester 

The  greatest  problem  facing  education  is  taking  school 
reform  seriously.  For  too  many  years  small,  piece-meal  approaches 
to  the  improvement  of  educational  practice  have  been  proposed. 
We  need  to  face  up  to  the  fact  that  significant  educational 
improvement  will  require  attention  to  the  way  in  which  school  as 
a social  institution  is  organized  as  well  as  what  and  how  we  teach. 

—Eliot  Eisner,  Stanford  University 

The  tremendous  gap  between  our  research  knowledge 
base  of  best  and  most  effective  practice,  and  what  typically  takes 
place  in  vast  majority  of  classrooms  is,  l believe,  our  greatest 
problem.  —Thomas  Guskey,  University  of  Kentucky 

. . . the  widespread  practice  of  ineffective  instruction, 
hence  unsatisfying  learning.  _}ames  popham.  UCLA 

. . . collapse  of  value  concensus,  leading  to  public  schools 
being  amoral  fact  factories.  —Kevin  Ryan,  Boston  University 

. . . helping  children  learn  where  parents  have  never  had 
an  adequate  education.  — Ralph  Tyler,  Center  for  Advanced 

Study  in  Behavioral  Sciences 

. . . poor  educational  achievement  and  other  outcomes. 

—Herbert  Walberg,  University  of  Illinois  at  Chicago 

. . . the  fact  that  so  many  children  (poor  children  and 
children  of  color)  are  not  being  adequately  educated  in  our  public 
schools.  There  is  no  denying  the  evidence  on  this.  The  success 
stories  are  exceptions.  — Kenneth  Z eichner,  University  of  Wisconsin 

If  you  have  an  interesting  question  or  an  educational 
leader  that  you  would  like  to  bring  to  our  attention,  please  con- 
tact: Gregory  ).  Marchant,  Educational  Psychology,  Teachers 
College,  Ball  State  University,  Muncie,  IN  47306. 
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Welcome  to  the  new  Mid-Western  Educational  Researcher, ; formerly  the  MWERA  Researcher. 
We  are  very-  excited  about  the  changes  and  additions  that  have  been  made  in  the  publication  and  hope 
that  you  will  enjoy  the  new  format.  As  the  official  publication  of  the  Mid-Western  Educational  Research 
Association,  we  will  continue  to  bring  you  information  concerning  the  Association.  In  addition,  we 
hope  to  provide  you  with  interesting  features  and  especially  hope  that  you  will  consider  contributing 
to  the  publication  by  submitting  articles,  news,  and  ideas. 

One  of  the  first  changes  that  you  have  probably  noticed  is  the  cover.  Each  issue  features  a 
sponsoring  institution  on  the  cover  and  a brief  description  of  their  education  program  inside.  An  impor- 
tant addition  for  the  publication  was  the  addition  of  an  editorial  board.  This  distinguished  group  of 
educators  have  been  instrumental  in  providing  direction  and  ideas,  and  assist  in  the  review  of  manu- 
scripts. Each  issue  also  contains  an  interview  with  a leader  in  education,  as  well  as  the  “Voices  in  Education” 
section,  which  reports  the  responses  of  a number  of  noted  educators  to  important  questions  facing  our 
field.  Research  articles  and  other  articles  of  interest  to  the  membership  are  also  included.  A special 
pull-out  section  designed  to  provide  members  with  guidelines  and  forms  for  submitting  proposals  for 
the  MWERA  Annual  Meeting  October  16-19,  1991,  has  been  included. 

Although  we  have  instituted  some  changes,  the  success  of  the  journal  rests  with  the  membership. 
It  is  our  hope  that  you  find  this  journal  useful  and  that  it  will  help  to  draw  new  members  to  the  Asso- 
ciation. However,  the  publication  cannot  succeed  without  your  contributions  and  feedback.  We  need 
good  quality  manuscripts  for  publication.  We  need  feedback,  criticism,  and  innovative  ideas.  We  have 
been  encouraged  by  the  interest  and  support  of  the  membership  and  hope  that  you  will  view  the  Mid- 
Western  Educational  Researcher  as  an  interactive  vehicle  for  your  ideas  and  needs. 


Information  for  Contributors  to  the  Mid-Western  Educational  Researcher 


The  Mid-Western  Educational  Researcher  accepts  research -based  manuscripts  that  would  appeal  to  a 
wide  range  of  readers.  All  materials  submitted  for  publication  must  conform  to  the  language,  style,  and  format  of  the 
Publication  Manual  of  the  American  Psychological  Association,  3rd  ed.,  1983  (available  from  Order  Department, 
American  Psychological  Association,  P.O.  Box  2710,  Hyattsville,  MD  20784). 

Three  copies  of  the  manuscript  should  be  submitted  typed  double  space  (including  quotations  and  references)  on 
8Vzxll  paper.  Only  words  to  be  italicized  should  be  underlined.  Abbreviations  and  acronyms  should  be  spelled  out  tor 
the  first  mention.  Pages  should  be  numbered  consecutively,  beginning  with  the  page  after  the  title  page. 
Manuscripts  should  be  less  than  20  pages  long.  An  abstract  of  iess  than  100  words  should  accompany  the  manuscript. 

The  manuscript  will  receive  blind  review  from  at  least  two  professionals  with  expertise  in  the  area  of  the  manuscript. 
The  author’s  name,  affiliation,  etc.,  should  appear  on  the  title  page  only.  Efforts  will  be  made  to  keep  the  review  process 
to  less  than  two  months.  The  editors  reserve  the  right  to  make  minor  editorial  changes  in  order  to  facilitate  a 
concise  clear  article.  The  author  will  be  consulted  if  any  major  changes  are  necessary. 

Manuscripts  should  be  sent  with  a cover  letter  to: 

Gregory  J.  Marchant,  Co-Editor  Isadore  Newman 

MWEResearcher  Office  of  Educational  Research 

Educational  Psychology  or  College  of  Education 
Teachers  College  The  University  of  Akron 

Ball  State  University  Akron,  OH  44325-4205 

Muncie.  IN  47306-0595 
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ON  THE  COVER 

The  Ohio  State  University  College  of  Education.  Founded  in  1870,  The  Ohio  State  University  is  a comprehensive 
urban  institution  with  more  than  59,000  students  and  4,500  faculty.  It  offers  more  than  8,000  courses  in  the  arts,  sciences, 
humanities,  and  all  major  professional  fields.  Through  its  learning  centers,  special  programs,  and  research  and  development 
offices,  the  University  serves  not  only  the  State  of  Ohio,  but  the  United  States  and  the  international  community, 
becoming  one  of  our  nations  largest  academic  and  research  centers. 

The  College  of  Education  plays  an  important  role  within  the  broad  sphere  of  education  at  The  Ohio  State  University. 
Recognized  as  a leader  in  educational  research  and  scholarship,  The  Ohio  State  University  College  of  Education  has 
historically  been  respected  as  among  the  best  in  the  nation;  and  in  the  most  recent  ranking  placed  second  only  to 
Stanford.  Its  peers  in  that  group  have  included  such  private  institutions  as  Harvard,  Stanford,  Chicago,  and  Columbia’s 
Teachers  College,  as  well  as  major  research  universities  such  as  Michigan  State,  UCLA,  Wisconsin,  and  Illinois. 

With  an  annual  graduate  enrollment  of  2,500  and  a graduate  faculty  of  190,  the  College  of  Education,  through  its  four 
departments  and  one  school,  offers  more  than  40  areas  of  graduate  specialization,  each  of  which  can  be  individually 
designed  to  meet  the  needs  of  students.  The  College  confers  approximately  450  master’s  and  100  doctoral  degrees  each 
vear.  The  College  offers  an  undergraduate  program  as  well  and  awards  approximately  800  baccalaureate  degrees  annually. 
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Gender  and  Supervision 

By  Charol  Shakeshaft,  Hofstra  University 


Communication  and 
Feedback  Patterns 

Gender  and  gender  ex- 
pectations  may  partially  deter- 
mine  how  supervisors  interact 
with  those  they  supervise.  For 
instance,  research  tells  us  that 
the  sex  of  participants  affects 
what  is  communicated  and  how 
it  is  communicated  (Borisoff 
and  Merrill,  1985).  The  same 
words  spoken  by  a male  super- 
visor  have  different  meanings 
to  male  and  female  teachers. 

Conversely,  an  interaction  be- 
tween a female  principal  and  a 
male  teacher  is  not  the  same  as 
an  exchange  between  a female 
principal  and  a female  teacher 

We  know  that  men  and 
women  communicate  differ- 
ently and  that  they  listen  for 
different  information  (Borisoff 
and  Merrill,  1985).  It  may  be 
that  in  a supervisory  confer- 
ence in  which  a principal  is  dis- 
cussing an  instructional  issue 
with  the  teacher,  the  woman 
participant  is  listening  for  the 
feeling  and  the  man  for  the 
facts.  It  may  also  be,  given  what 
we  know  of  the  values  that  males  and  females  carry  into  their 
jobs  in  schools,  that  the  woman  is  focused  upon  an  instructional 
issue  or  a matter  concerning  the  child,  while  the  man  has  chosen 
to  discuss  an  administrative  problem. 

Nowhere  does  the  impact  of  gender  on  supervision 
become  more  evident  than  in  the  area  of  feedback.  Men  receive 
both  more  and  more  types  than  do  women.  Women  are  more 
likely  to  get  non-evaluative  feedback,  or  neutral  responses.  Men 
receive  both  more  positive  and  more  negative  responses. 

A 1987  study  (Shakeshaft)  found  that  male  administrators 
are  less  likely  to  give  direct  feedback  to  females  but  more  likely 
to  give  it  to  males.  For  insrance,  when  a male  subordinate  makes 
a mistake  or  doesn’t  live  up  to  the  expectations  of  his  boss,  his 
supervisor  tends  to  level  with  him,  “telling  it  like  it  is.”  When 
a female  errs,  she  often  isn't  even  informed.  Instead,  the  mistake 
is  corrected  by  others  without  her  knowledge.  The  results  are 
twofold.  For  the  male,  learning  take.',  place  instant  1\.  He  gets 


criticism  and  the  chance  to 
change  his  behavior.  He  learns 
to  deal  with  negative  opinions 
of  his  work  and  has  the  option 
of  improving. 

Females  often  never 
hear  anything  negative,  being 
given  neutral  or  slightly  posi- 
tive cues  even  if  their  perfor- 
mance is  less  than  ideal.  This 
results  in  a womans  misconcep- 
tion of  her  abilities  or  at  least 
the  level  of  her  performance. 
If  she  isn’t  directly  told  that 
her  work  is  not  meeting  expec- 
tations, she  has  neither  the 
opportunity  to  improve  nor  the 
opportunity  to  reassess  her 
abilities. 

In  interviews  with  male 
superintendents  and  princi- 
pals asking  them  why  they 
didn’t  confront  women  with 
their  misgivings  and  dissatis- 
factions, one  of  the  major  rea- 
sons that  was  given  was  the  fear 
of  women’s  tears  (Shakeshaft, 
1987).  Most  of  the  men  were 
uncomfortable  with  the  pros- 
pect of  tears.  When  questioned 
about  what  they  expected  from 
men  to  whom  they  gave  nega- 
tive feedback,  most  anticipated  anger.  While  none  of  the  ad- 
ministrators in  this  study  liked  confronting  anyone  with  negative 
feedback,  the  prospect  of  an  angry  response  wa<  easier  to  face 
than  the  prospect  of  tears.  Male  superintendents  and  principals 
said  they  didn't  like  to  deal  with  angry  subordinates,  but  that 
they  had  the  skills  to  do  so.  They  were  much  less  comfortable 
with  crying,  and  because  of  this  discomfort  most  failed  to  give 
women  important  corrective  feedback  that  would  have  allowed 
the  women  to  improve  their  performance  as  educators. 

This  fear  of  tears  led  us  to  examine  who  cries  and  how 
often.  What  we  found  was  that  there  is  not  a lot  of  crying  in  public 
schools,  and  that  although  women  cry  in  frcmt  of  supervisors 
slightly  more  than  men,  the  difference  in  frequency  is  very  small. 
However,  women  are  reported  to  cry  equally  often  in  front  of 
females  and  males  while  males  only  cried  in  front  of  women.  Thus, 
we  learn  that  it  is  the  fear  of  tears-  rather  than  overwhelming 
evidence  of  actual  crying— that  paralyzes  male  administrators. 


Dr.  Shakeshaft  is  the  Chairperson  of  Aiministration  and  Policy  Studies 
and  a Professor  at  Hofstra  University.  What  follows  is  the  luncheon 
speech  she  delivered  at  the  annual  meeting  of  the  Mid-Western  Educational 
Research  Association  in  Chicago . Illinois,  October  19,  1990.  The  text 
presented  is  greatly  abridged  due  to  space  limitations. 
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Gender  and  Supervision  (continued) 

The  importance  of  this  discussion  about  supervisory 
styles  and  feedback  is  that  gender  perceptions  are  influencing 
behavior  and  interfering  with  effectiveness.  Because  of  our  beliefs 
about  who  men  are  and  who  women  are,  many  administrative 
actions  are  censored  or  changed  depending  upon  with  whom 
we  are  interacting.  The  issues  are  difficult  for  both  men  and 
women.  Women  must  be  aware  of  the  feedback  loop  and  try  to 
determine  if  they  are  getting  helpful  evaluative  information. 
Men,  on  the  other  hand,  often  perceive  themselves  in  a “damned 
if  you  do,  damned  if  you  don’t”  position.  If  a man  treats  a woman 
as  he  does  a man,  he  may  be  accused  of  being  harsh  or  unfair. 
If  he  doesn’t  treat  a woman  in  the  same  manner,  he  may  be 
accused  of  not  giving  her  helpful  or  corrective  feedback.  We  need 
to  examine  our  expectations  about  male  and  female  behavior 
and  confront  the  issue  so  that  both  men  and  women  are  as  effec- 
tive as  they  can  be  in  a supervisory  relationship. 

Influence  of  Sexuality  on 
Working  Relationships 

Another  factor  that  may  inhibit  or  interfere  with  the 
supervisory  act  is  heterosexuality  and  our  unspoken  beliefs  about 
men  and  women  working  together.  In  a study  of  the  hiring 
practices  of  male  superintendents  (Shakeshaft,  1989),  we  asked 
them  if  they  would  hire  a traditionally  attractive  female.  We 
used  the  terminology  “traditionally  attractive”  so  that  superinten- 
dents could  make  their  own  decisions  not  only  about  what  was 
attractive,  but  also  about  what  was  attractive  within  the  accept- 
able range  of  school  administrators.  Almost  all  of  the  super- 
intendents in  our  study  said,  “Sure,  I’d  hire  an  attractive  woman.” 
When  we  asked  for  what  job,  almost  all  had  her  slotted  for  an 
elementary  principalship.  When  we  followed  up  and  asked  if 
these  superintendents  would  hire  this  imaginary  woman  as  an 
assistant  superintendent,  in  a role  that  worked  very  closely  with 
the  superintendent,  very  few  of  the  superintendents  said  they 
would.  The  issue  for  them  was  the  combination  of  the  intensity 
of  the  working  relationship  and  the  attractiveness  of  the  woman. 
Most  admitted  that  they  felt  uncomfortable  in  a close  working 
relationship  with  an  attractive  woman. 

The  first  reason  for  this  lack  of  comfort  was  the  superinten- 
dents’ concern  that  school  board  members  would  see  something 
unseemly  in  the  relationship  and  that  this  perception  would 
threaten  their  effectiveness  with  their  boards.  The  second  reason 
superintendents  shied  away  from  this  hiring  decision  was  their 
worry  that  it  would  cause  marital  friction  and  few  wanted  the 
additional  stress  of  “trouble  on  the  homefront”  added  to  their 
already  stressful  lives.  But  the  third  reason,  and  the  one  that 
hurts  women  the  most,  is  that  most  of  the  male  superintendents 
said  they  wouldn’t  feel  comfortable  working  closely  with  an 
attractive  woman  because  these  men  weren’t  sure  they  wouldn't 
be  sexually  attracted  to  her.  And  if  they  were,  it  seemed  like  a 


no-win  situation.  If  the  superintendent  were  attracted  to  his 
female  subordinate  and  she  didn’t  return  the  feelings,  the  super- 
intendent ran  the  risk  of  being  charged  with  sexual  harrassment. 
On  the  other  hand,  if  she  were  similarly  attracted,  the  super- 
intendent’s first  two  fears  (school  board  disapproval  and  marital 
discord)  might  become  reality.  Thus,  most  of  the  superintendents 
concluded  that  it  wasn’t  worth  the  risks  to  hire  an  attractive 
woman  (and  for  many  that  translated  into  woman)  into  a position 
with  which  the  superintendent  worked  closely. 

Because  of  the  lack  of  comfort  men  in  school  administra- 
tion have  with  issues  of  sexuality,  women  have  been  advised  to 
dress  and  act  in  ways  that  suppress  or  hide  their  own  sexuality. 
Womens  dress  for  success  formulas  are  more  like  dress  for  sexuality 
than  for  any  criteria  associated  with  success.  Men,  on  the  other 
hand,  are  advised  to  wear  “power  suits,”  attire  that  has  high 
sexual  appeal  among  women  (Shakeshaft,  1989). 

Gender  Differences  in  Expectations 

Another  example  of  gender  differences  and  the  possible 
effects  on  supervision  might  be  found  in  a study  done  by  Gar- 
finkel  (1988)  in  which  he  attempted  to  determine  whether  or 
not  men  and  women  superintendents  conceptualize  their  adminis- 
trative teams  differently  and  whether  or  not  these  superintendents 
and  their  team  members  value  different  traits  in  team  members. 
Garfinkel  found  that  both  men  and  women  value  competence 
and  trust,  but  that  they  give  each  a different  priority.  For  women 
superintendents,  competence  is  the  first  thing  they  look  for  in 
a team  member;  trust  is  lower  on  the  list.  Men  superintendents, 
on  the  other  hand,  identify  trust  as  their  number  one  criteria 
for  team  membership,  and  view  competence  as  less  important. 
To  complicate  matters,  especially  for  team  members,  men  and 
women  define  trust  differently.  Men,  both  superintendents  and 
team  members,  are  more  likely  to  describe  trust  as  the  “ability 
and  comfort  to  say  what  they  wished  to  say,  confident  that  the 
persons  they  were  sharing  their  thoughts  or  opinions  with  would 
not  ridicule  or  repeat  these  thoughts  elsewhere.”  (Garfinkel,  1988, 
p.  311).  Women  superintendents  defined  trust  as  “an  expectancy 
held  by  an  individual,  that  the  word,  promise  or  written  state- 
ment of  another  individual  or  group  can  be  relied  on.”  (p.  311). 

Earlier  research  (Shakeshaft,  1987)  had  indicated  that  for 
women:  (1)  relationships  with  others  were  more  central  to  all 
actions  than  they  were  for  men;  (2)  teaching  and  learning  was 
more  often  the  major  focus  than  for  men  administrators;  and 
(3)  building  community  was  more  often  an  essential  part  of  the 
woman  administrator’s  style  than  it  was  for  the  man. 

(In  a content  analysis  of  written  evaluations  of  female  teachers 
by  principals)  We  did  find  some  differences  in  the  things  that 
women  and  men  focused  on.  Women  were  more  likely  than  men 
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Gender  and  Supervision  (continued  from  page  3) 


to  encourage  the  empowerment  of  their  teachers,  to  establish 
instructional  priorities,  to  be  attentive  to  the  social  and  emo- 
tional development  of  the  students,  to  focus  on  student  relation- 
ships, to  be  attentive  to  the  feelings  of  teachers,  to  include  more 
“facts”  in  the  evaluation,  to  look  for  the  teachers’  personal 
effects  on  the  lives  of  children,  to  place  emphasis  on  the  technical 
skills  of  teaching,  to  make  comments  on  the  content  and  quality 
of  the  educarional  program,  to  provide  information  gathered 
from  other  sources,  to  involve  the  teacher  in  decision  making, 
to  issue  other  directives  for  improvement,  to  provide  immediate 
feedback  on  performance,  and  to  emphasize  curricular  programs. 
Men,  on  the  other  hand,  were  more  likely  than  women  to  empha- 
size organizational  structure  and  to  avoid  conflict. 

Summary 

We  would  argue  that  gender  makes  a difference  in  how 
we  behave  as  administrators.  Sometimes  these  behaviors  are  just 
different  and  interesting.  However,  at  other  times  they  may  signal 
treatment  that  is  not  only  different  but  that  is  more  favorable 
to  one  sex  than  to  another.  When  the  latter  is  the  case,  we  need 
to  re-examine  practice. 

How  then,  do  we  do  this?  We  would  suggest  that  first  we 
might  examine  ourselves.  All  of  us  have  been  raised  in  a sexist 
society;  therefore,  it  is  not  surprising  that  we  have  ideas  about 
what  women  and  men  can  do  and  be,  about  how  males  and 


females  act,  and  about  how  to  treat  men  and  women.  The  first 
step  is  to  acknowledge  our  backgrounds  and  training.  Under- 
standing that  we  had  no  control  over  what  we  were  taught  by 
society,  school  and  family,  but  that  we  do  have  control  over  our 
actions  today  is  a good  first  step.  One  way  to  gauge  whether  or 
not  we  are  applying  different  expectations  and  standards  to  any 
situation  is  to  substitute  a member  of  the  other  sex  in  any  scenario 
we  are  involved  in.  For  instance,  if  we  are  working  with  a man 
and  wonder  if  we  have  lowered  our  expectations,  we  might  pre- 
tend he  is  a woman  and  consider  how  that  person  would  be 
treated.  Another  way  to  examine  what  the  differences  mean  is 
to  transfer  what  we  have  learned  about  racism  to  male/female 
situations.  When  characterizing  a woman  in  a particular  way, 
consider  whether  we  would  say  the  same  thing  about  minority 
people,  and,  if  so,  would  we  say  it  aloud  in  our  community. 
Although  racism  is  still  strong,  as  a society  we  have  become 
more  cautious  about  expressing  it  publicly;  we,  as  educators, 
have  also  become  more  able  to  identify  it.  We  can  use  the  njodels 
we  have  learned  in  one  area  to  help  us  in  another. 

Working  with  school  administrators  around  these  issues 
is  crucial  if  we  are  to  change  them.  Research  demonstrates  that 
in-service  education  on  these  issues  has  gone  a long  way  toward 
changing  behavior  (Grayson,  1988).  For  a very  small  investment 
in  time  and  money,  districts  can  reduce  the  negative  effects  of 
gender  issues  and  enhance  the  positive  ones.  The  result  is  an 
environment  more  supportive  of  teaching  and  learning. 
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Catastrophe  Theory  and  Catastrophes 
in  China9 s Civil  Service  Examinations-o^m) 

By  Ayres  D’Costa,  The  Ohio  State  University 

Abstract 

This  is  the  second  of  two  parts  of  the  Presidential  Address  delivered  on  October  20,  1990,  at  the  annual  meeting  of  the 
Mid-Western  Educational  Research  Association  held  in  Chicago.  The  first  part  introduced  the  concept  of  catastrophe  theory  and  was 
published  in  the  Volume  4,  Number  1.  It  is  the  intent  of  this  second  part  to  identify  the  ‘catastrophes’  in  the  evolution  of  Chinese 
national  examinations  and  thereby  highlight  the  birth  and  demise  of  various  models  of  competence  that  were  utilized  by  the  Chinese 
over  a period  of  4000  years. 


Catastrophe  theory  analysis  (see  Part  1)  begins  by  identi- 
fying the  occurrence  of  major  discontinuities,  or  catastrophes, 
in  a system  such  as  civil  service  examinations.  It  requires  the 
positing  of  a few  major  conflicting  forces,  and  examining  their 
effect  on  the  examinations  system  using  available  historical  evi- 
dence of  the  time.  In  this  article  the  available  4000-year  Chinese 
chronology  is  divided  into  six  major  periods  based  on  five  critical 
transitions  in  the  purpose  and  process  of  the  civil  service  exami- 
nations system.  Each  pair  of  adjacent  periods  is  separated  by  a 
catastrophe,  which  is  in  a sense  a critical  transition.  Although 
descriptive  studies  of  Chinas  examinations  have  been  previously 
conducted  (e.g.,  DuBois,  1980),  this  study  goes  further  by  identi- 
fying the  major  catastrophes  in  Chinas  long  history  of  civil 
service  examinations,  analyzing  how  socio-political  forces  inter- 
acted to  produce  these  catastrophes,  and  suggesting  how  each 
catastrophe  affected  the  nature  and  impact  of  subsequent  Chinas 
civil  service  examinations. 

Along  with  innovations  such  as  gunpowder,  printing, 
and  tea,  China  deserves  credit  for  having  developed  the  world’s 
first  civil  service  system  ("Ieng  & Fairhanks,  1954).  There  is 
strong  historical  evidence  to  believe  that  China  is  also  the  first 
country  in  the  world  to  have  utilized  a national  examinations 
system  to  select  its  civil  service  officers.  Although  there  have 
been  a few  minor  periods  of  interruption  in  administering  the 
examinations,  China  holds  the  world’s  record  for  the  longest 
number  of  years  over  which  such  exams  have  heen  conducted, 
and  for  the  largest  number  of  candidates  who  have  been  examined 
in  this  manner.  In  a recent  report,  the  Chinese  State  Education 
Commission  (1986)  indicated  that  its  national  examinations  are 
held  at  some  53,000  sites  and  require  over  100,000  invigilators 
(proctors).  In  1978,  a record  six  million  students  took  the  College 
Entrance  Exam  (Pepper,  1983). 

A study  of  China’s  civil  service  examinations  from  a catas- 
trophe theory’  perspective  should  be  of  interest  to  measurement 
professionals  in  the  United  States  not  only  because  of  the  long 
and  intense  commitment  of  the  Chinese  to  standardized  tests, 
but  also  because  of  the  political  crises  the  examinations  have 
caused  and  the  violent  transitions  or  catastrophes  through  which 


they  have  evolved.  Each  catastrophe,  and  the  new  testing  system 
that  developed  subsequently,  demonstrates  the  power  that  social 
and  political  forces  can  have  on  tests  and  testing  practice. 

Methodological  Approach 

The  methodology  of  this  study  utilized  qualitative  his- 
torical data  to  identify  the  catastrophes  and  their  relevant  critical 
variables.  The  data  for  this  study  and  their  interpretation  were 
obtained  from  published  sources  and  from  interviews  with  Chinese 
educators,  but  the  responsibility  for  the  synthesis  and  the  infer- 
ences was  that  of  the  author  (an  extensive  bibliography  that 
goes  beyond  the  references  cited  in  this  study  is  available  from 
the  author). 

In  this  analysis  we  will  go  back  through  time  almost  as  many 
years  before  the  Christian  era  as  we  are  now  after  it.  As  history 
unfolds  itself  forward  from  ancient  times,  new  topological  forms 
will  become  evident  as  old  ones  self-destruct.  Our  structures  will 
relate  to  emperors,  political  leaders,  governmental  bureaucracies 
and  officials,  educational  systems,  and  most  importantly,  the 
vast  sea  of  people  struggling  to  find  identity'  for  themselves  within 
this  system.  A few  will  succeed,  most  will  be  lost  to  oblivion. 
Our  study  will  focus  on  one  institution— China’s  national  exami- 
nations. For  convenience,  the  distinction  between  civil-service- 
related  national  examinations  and  higher-education-related 
national  examinations  will  be  ignored,  although  it  does  exist. 

Catastrophes  in  Chinese  Examinations 

We  will  now  present  an  overview  of  the  five  major 
catastrophes  which  divide  Chinas  4, 000-year  history  flow  of 
national  examinations  into  six  periods.  Depending  upon  the 
type  of  catastrophe  that  occurred  (e.g.  flight  versus  fight,  using 
Lorenz’s  example  of  aggression  in  dogs  presented  in  Part  1 of 
this  article)  there  resulted  a dramatic  change  in  the  nature  and 
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purpose  of  the  civil  service  examination.  This  is  reflected  in  the 
competency  criteria  required  by  the  exams  during  the  subsequent 
period.  The  specific  catastrophe  and  its  resulting  competency 
criteria  represent  the  important  dependent  variables  of  this  study. 
Two  powerful  and  conflicting  socio-political  forces  will  be  iden- 
tified as  the  independent  variables  for  each  period.  As  a result  of 
their  interaction,  a specific  type  of  catastrophe  occurred  leading 
to  a dramatic  change  in  the  competency  criteria  expected  by 
the  examination. 

Recall  that  in  Part  1 of  this  article,  we  identified  a specific 
geometric  form  (see  Figure  1 below),  namely  the  cusp,  as  relevant 
to  a system  with  two  independent  variables  and  one  dependent 
variable.  The  catastrophe  analysis  presented  here  is  limited  to 
the  evaluation  of  various  cusp-like  shapes  over  the  4,000-year 
history,  thereby  restricting  the  analysis  to  two  conflicting  forces 
and  one  type  of  catastrophe  in  two  possible  contrasting  modes. 
The  two  conflicting  variables  presented  for  each  period  may  be 
thought  of  in  terms  of  Lorenz’s  example  of  rage  versus  fear  in  a 
dog.  Then  one  may  decide  whether  the  catastrophe  mode  that 
occurred  represented  fight  or  flight. 


Figure  1— T/u*  cusp-amis  rrop/iir  illustrating  fear  and  rage  as  conflicting  factors 
influencing  aggressiem  ( reproduced  with  permission  frenn  Zeeman,  1977,  p.  6) 


Each  period  is  labeled  in  terms  of  the  prevailing  and 
resulting  competency  criteria  and  identifies  the  two  conflicting 
independent  variables.  The  interaction  of  these  two  forces  and 
the  resulting  catastrophe  arc  documented  using  historic  evidence. 
Descriptive  phrases  indicate  the  intensity  and  level  of  the  inter- 
acting forces. 


Critical  Transition  Points  in 
China's  Civil  Service  Examinations  History 

1.  From  Good  Warriors  to  Scholar  Officials. 

DuBois  (1965)  noted  that  testing  practices  were  recorded 
in  China  as  early  as  the  reign  of  Emperor  Yao  and  Emperor  Shun 
(2367-2206  B.C.).  Emperor  Shun  examined  his  officers  every 
three  years.  After  three  such  examinations,  they  were  either  pro- 
moted or  dismissed  from  service.  The  State  Education  Commis- 
sion of  the  Peoples’  Republic  of  China  (PRC,  1986)  identifies 
the  Chou  (Zhou)  dynasty  as  establishing  the  Gongshi  system. 
In  order  to  ensure  their  power  base,  these  rulers  used  a multi- 
level system  to  select  officers  for  the  government.  Selection  pro- 
ceeded from  the  level  of  Xiangxue  (county)  to  Guoxue  (province) 
to  the  Taixue  (nation).  The  selection  criteria  at  this  time  were 
primarily  based  on  moral  conduct  and  military  feats.  The  candi- 
dates were  typically  the  eldest  sons  of  warlords  and  senior  off  icials, 
and  rarely  talented  citizens. 

After  almost  2,000  years  of  recruiting  civil  service  officers 
from  the  ruling  classes,  China  appears  to  have  undergone  a cata- 
clysmic change  as  a result  of  the  teachings  of  Confucius  (551-479 
B.C.).  Although  not  officially  a religion  like  Christianity,  Con- 
fucianism has  been  the  most  important  single  force  in  Chinese 
life  (World  Book  Encyclopedia,  1979,  p.764).  Confucius  over- 
came the  military  tendencies  of  the  ruling  classes  and  produced 
the  first  catastrophe  favoring  genteel  conduct  over  military 
strength.  It  marks  the  first  transition  point  in  this  presentation. 

Confucius  was  deeply  influenced  by  the  constant  warfare 
among  the  many  states  that  made  up  China  of  his  day.  He  feared 
that  this  threat  to  orderly  social  life  would  lead  to  the  destruc- 
tion of  civilization.  He  emphasized  gentlemanly  behavior,  which 
meant  reverence  in  worship  and  respect  for  one’s  father  and  for 
ones  ruler.  Emperors  were  bound  by  these  same  rules  of  conduct. 
The  Qin  and  later  Emperors  were  quick  to  recognize  the  value 
of  Confucianism  to  their  political  stability  and  strength  (Kracke, 

1953,  P.  21). 

The  dependent  variable,  influencing  the  type  of  the  exam 
introduced  by  the  Emperor,  teas  his  desire  to  be  strong  and 
protective  of  his  power  based  on  the  support  of  a chosen  circle 
of  key  officials.  During  this  period  the  purpose  of  examinations 
abruptly  changed  rom  “good  warriors’'  to  “scholar  officials. 

The  tuv  conflicting  variables  were  competitive  lords 
seeking  position  for  their  sons  through  military  skills,  arui  Gin- 
fuaan  ideals  of  order  and  gentlcmaniiness. 

Confucian  thought  prevailed  and  resulted  in  a dramatic 
change  in  the  nature  of  the  exam,  from  its  original  focus  on 
military  feats  to  a new  order  emphasizing  genteelness  and 
scholarliness. 
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2.  From  Sponsored  Scholar  Officials  to  Tested  National  Scholars. 

The  period  221  B.C.  to  about  618  A.D.  introduced  the 
significance  of  the  ‘scholar  official’  in  the  Chinese  empire. 
Thousands  of  ‘literati’  were  sponsored  and  attracted  for  service 
in  the  various  feudal  kingdoms.  As  power,  privilege,  and  status 
were  accrued  to  such  scholars,  the  local  examinations  and  the 
sponsoring  recommendations  became  corrupt.  Family  status, 
rather  than  a candidate’s  virtues  or  talents,  would  often  deter- 
mine  who  was  recommended.  Sometimes  a person  was  recom- 
mended as  a Xiucai  (literary  talent)  without  knowing  a single 
Chinese  letter  or  word  (Kracke,  1963,  p.  26). 

A new  battleground  was  in  place  in  China.  The  influential 
lords,  recognizing  that  the  Confucian  system  was  there  to  stay, 
began  to  corrupt  the  new  exam  system  in  order  to  serve  their 
own  ends.  The  Reform  Movement  of  Shangyang  (344  B.C  to 
605  A.D.)  was  concerned  about  these  abuses  and  attempted  to 
standardize  the  sponsorship/recommendation  process,  which  was 
ultimately  abolished  by  the  Sui  dynasty  in  587  A.D.  The  Imperial 
Examinations  System  was  initiated  in  606  A.D.  in  order  to  ensure 
fairness  in  the  selection  of  worthy  Confucian  scholars  as  officials 
of  the  Emperor.  This  serves  as  the  second  major  transition  in  this 
presentation.  Of  special  significance  is  Chinas  dedication  to 
social  equity  along  with  Confucian  scholarship. 

The  dependent  variable , or  the  goal  of  the  national 
examinations , remains  the  Emperors  desire  to  retain  power 
using  the  dominant  Confucian  thinking  prevalent  in  the  nation . 

The  two  conflicting  variables  were  the  lords ’ desire 
to  assure  their  family  of  state  privileges  through  the  national 
exam  versus  the  new  national  demand  for  fairness  in  the 
selection  process. 

China’s  national  sense  of  fairness  prevailed.  An  Imperial 
exam  system  was  set  up  with  the  final  selection  conducted 
directly  by  the  Emperor. 

3.  From  National  Scholars  to  Westernized  Urban  Elites. 

The  Tang  dynasty  ^618—907 } recognized  two  levels  of 
exams,  one  at  the  prefecture  (provincial)  level,  and  the  second 
conducted  by  the  Ministry  of  Rites  (which  included  the  present- 
day  Ministry’  of  Education).  The  Sung  dynasty  (960-1279)  added 
a final  Imperial  examination  presided  over  by  the  Emperor  himself. 
In  the  Ming  (1368-1644)  and  Qing  (1644—191 1)  dynasties  there 
were  four  levels  of  examinations,  adding  a pre-prefecture  or  local- 
level  examination. 

Passing  the  pre -prefecture  exam  led  to  the  title  of  Xiucai. 
The  prefecture  exams  conferred  the  title  Juren,  the  Ministry 
exams  the  title  Gongshi,  and  the  final  Imperial  exam  the  title 
Jinshi.  The  top  three  candidates  were  additionally  known  as 
Zhnangyuan,  Bangvan,  and  Tanhua. 

Exam  content  was  well  defined  and  eventually  dominated 
the  curriculum  m schools.  Literary  writing  and  political  aigu- 


mentation  became  the  mark  of  the  Jinshi.  The  candidate  was 
also  expected  to  have  mastered  the  five  classics  (Books  of  Songs, 
Rites,  Changes,  Spring  Annals,  and  Autumn  Annals),  as  well  as 
law,  calligraphy,  and  mathematics.  The  form  of  the  examination 
involved  filling  in  the  blanks  (Tiejing),  answering  questions  orally 
or  in  writing,  writing  poems  on  assigned  topics,  writing  political 
discourses,  and  expounding  the  truth  presented  in  a single-sen- 
tence statement  by  writing  an  essay  (Jingyi).  This  exercise  was 
heavily  dependent  upon  memorization  of  the  Chinese  classics, 
and  because  of  the  required  structure  became  invidiously  known 
as  the  eight-part  or  eight- legged  essay. 

The  Imperial  examination  system  lasted  about  1300  years, 
until  the  Chinese  were  deeply  humiliated  hy  their  defeat  by 
Western  forces  during  the  Opium  Wars  of  1840.  There  followed 
severe  criticisms  of  the  eight-legged  essays  (Teng  &.  Fairbanks, 
1954),  and  the  need  to  ‘learn  the  strong  techniques  of  the  bar- 
barians (Westerners)  in  order  to  control  them.’  The  1898  Reform 
Movement  uTged  the  abolition  of  the  civil  service  exams  because 
‘they  were  an  obstacle  to  China’s  growth  and  security.’  The 
Imperial  exams  were  abolished  by  Imperial  decree  on  Septem- 
ber 2,  1905,  which  serves  as  our  third  transition  point. 

The  dependent  variable,  or  the  purpose  of  the  exams, 
switched  to  the  Imperial  concern  for  national  security  against 
Western  forces  based  on  their  technological  superiority. 

The  two  convicting  variables  were  the  longstanding 
literary  dominance  of  Confucian  learning,  versus  the  reality 
of  the  humiliating  defeat  of  Chinese  Imperial  forces  by  techno - 
logically  superior  Western  military  and  naval  forces  during 
the  Opium  Wars. 

4.  From  Westernized  Urban  Elites  to  Rural 
Proletarian  Intellectuals. 

Shocked  into  recognizing  the  need  for  technical  knowl- 
edge and  military  skills,  Chinas  leaders  abolished  the  scholarly 
Confucian  Imperial  exams  and  called  for  the  introduction  of 
Western  and  Japanese  technology’  through  foreign  languages, 
military  science,  ship-building  and  navigation.  These  new’  sub- 
jects provided  the  new  emphases  in  the  reformed  Chinese  civil 
service  exams.  Science  and  technology  became  the  dominant 
new  segment  of  the  school  curriculum.  With  Western  influence 
came  the  downfall  of  the  long  rule  of  Chinese  Emperors  and 
the  start  of  the  Freedom  Revolution  by  Dr.  Sun  Yat-Sen  and  his 
Kuomintang  (KMT)  party. 

Anxious  to  modernize  China,  the  KMT  emphasized  higher 
education,  science  and  technology,  and  education  abroad.  This 
resulted  in  power  accumulating  in  the  urban  elite,  and  the 
ncglcct/alicnation  of  the  rural  masses.  The  country  was  up  for  a 
new  revolution.  The  Japanese  invasion  of  China  in  1937  and 
China’s  role  in  World  War  II  with  the  Allies  resulted  in  the 
strengthening  of  the  Chinese  Communist  Party  (CCP)  led  by’  Mao 
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Zedong  (also  spelled  as  Mao-tse-tung).  Mao,  although  influenced 
by  Confucian  emphasis  on  personal  motivation  and  practical 
performance,  condemned  Confucian  learning  and  book-worship. 
His  focus  was  on  the  ‘proletarian.’  Moral  and  intellectual  com- 
petence was  insufficient  without  political  commitment  for  the 
rural  masses. 

Mao’s  theory  of  knowledge,  in  his  speech  “Rectify  the  Party’s 
Style  of  Work,”  identified  only  two  kinds  of  knowledge— that 
related  to  the  country’s  struggle  for  production,  and  that  related 
to  its  class  struggle  (Taylor,  1981,  p.7).  Practical  experience  and 
collective  study  were  emphasized.  Education  was  now  integrated 
with  village  labor  and  commune-based  study.  Mao’s  rise  to  power 
with  the  establishment  of  the  people’s  Republic  of  China  (PRC) 
in  1949  served  as  the  fourth  transition  point  in  the  history  of 
China’s  civil  service  system. 

A totally  new  natioml  purpose  teas  created  for  the 
national  exam  as  a result  of  this  catastrophe.  National  security 
interests,  rather  than  power  for  the  Emperor  or  his  elite  few, 
served  to  become  the  major  purpose  of  the  new  exams  and  the 
dependent  variable  for  this  period. 

The  tvjo  conflicting  forces  at  work  in  China  were  the 
urban  elite  who  had  studied  abroad  and  brought  back  foreigri 
values,  versus  the  rising  power  of  Mao’s  Communist  Party 
with  the  avowed  purpose  of  strengthening  the  power  of  the 
rural  masses. 

5.  From  Proletarian  Intellectuals  to  Communist  Party-Based 
Modernization  Experts. 

Chinese  Communists  became  the  first  rulers  of  unified 
China  in  1949.  Their  notion  of  the  ‘ proletarian  intellectual ,’ 
though  rooted  minimally  in  a traditional  generalist  ethic,  focused 
on  the  social,  economic,  and  technological  needs  of  their  revo- 
lution. Intellectuals  were  judged  not  by  their  knowledge  or  exper- 
tise, but  by  their  commitment  to  the  party’s  social  goals.  All 
efforts  were  directed  towards  Mao’s  Great  Leap  Forward.  This 
was  to  be  the  first  step  towards  the  ultimate  formation  of  the 
class-less  society,  theoretically  an  antithesis  of  the  typical  elitist 
civil  service  system. 

Despite  Mao’s  promise  of  the  class-lcss  society,  the  Chinese 
Communist  Party  (CCP)  found  itself  unable  to  dislodge  the 
power  of  the  Civil  Service  Examination  System.  Mao-style  reform 
of  the  system  became  inevitable.  Mao  emphasized  a first-stage 
process  of  recommendation  and  selection  for  the  national  exami- 
nation  by  peasant  leaders  at  the  local  level.  Additionally,  middle 
school  graduates  had  to  spend  two  years  in  village  labor  before 
applying  for  entry  into  higher  education.  Political  qualifications 
thus  became  critical  for  entry  into  the  selection  stream.  In  prac- 
tice, however,  because  of  the  many  selection  steps,  the  high  degree 
of  selectivity,  and  the  intrinsic  power  of  the  intellectuals,  even 
this  Mao  objective  broke  down.  Real  competition  did  in  tact 


occur.  Each  selection  was  supervised  by  local  cadres,  and  educa- 
tional institutions  often  added  their  own  admissions  criteria. 
Thus  the  political  power  of  the  workers/peasants  became  diffused, 
albeit  frustrating  (Taylor,  1981,  p.38). 

It  was  the  failure  of  the  Great  Leap  Forward  through  the 
CCP’s  collective  model  that  brought  on  new  tensions  between 
moderates  and  radicals.  Nevertheless,  blame  for  China’s  lack  of 
progress  was  assigned  to  uncooperative  intellectuals  and  elites. 
It  was  alleged  that  these  groups  had  frustrated  Mac’s  ideological 
dream  to  transfer  political  control  to  the  peasant  workers. 

Thus  was  bom  the  Cultural  Revolution  (1966-1976)  and 
the  ensuing  chaos  that  destroyed  China’s  educational,  technical, 
and  cultural  structures.  Interestingly,  it  also  damaged  the  CCP’s 
Party  structure  and  brought  all  progress  to  a virtual  standstill. 
All  national  exams  were  suspended  as  also  all  forms  of  higher 
education.  The  Cultural  Revolution  is  our  fifth  (and  last  for  now) 
transition  point  in  the  history  of  the  examinations. 

This  period  saw  the  demise  of  the  national  exam  and  all 
forms  of  learning  associated  with  it.  The  dependent  variable 
defining  natioml  excellence  and  competence  was  articulated 
in  terms  of  how  well  the  Proletarian  goals  of  the  Communist 
Party  were  met. 

The  two  Competing  forces  of  this  time  were  the  public 
dissatisfaction  with  the  Communist  Five-Year  Plans,  versus 
the  Party's  determination  to  preserve  its  control  over  the 
Chinese  people. 

6.  From  Communist  Party  Oriented  Modernization  Experts 
to  Nation  Oriented  Experts. 

The  Cultural  Revolution  lasted  ten  years  and  the  devas- 
tation it  left  behind  in  China  could  not  be  ignored  despite  the 
Communist  stranglehold  on  the  Chinese  people.  Traditional 
patterns  of  education  and  of  examining  competence  have  reap- 
peared since  1977.  Leaders,  like  Chou-en-Lai  and  Deng  Xiaoping, 
argued  strongly  for  China’s  need  to  uplift  the  economic  plight 
of  its  masses  through  technological  development.  The  Four 
Modernisations  (agriculture,  industry,  defense,  and  science/tech- 
nology) have  become  the  new  slogan  for  the  nation.  In  older  to 
promote  ‘excellence,’  key  inventions  and  ‘key’  schools  have  been 
set  up.  The  word  ‘key’  denotes  special  or  promising.  National 
competition  for  admission  into  higher  education  is  once  again 
based  on  achievement  examinations  administered  on  July  7, 8, 9 
each  year.  Candidates  choose  between  the  liberal  arts  track,  and 
the  science/technology  track.  A new  form  of  elitism  seems  to  have 
emerged  with  urban  students  performing  better  on  the  exams 
than  rural  students,  especially  in  the  so-called  ‘hard’  sciences. 

Nonetheless  Mao-style  communist  ideology  still  prevails  and  is 
evident  through  the  enrollment  quotas.  These  are  used  to  ensure 
equity  for  the  21  provinces,  which  are  clearly  unequal.  Mao’s 
policy  of  favoring  persons  with  peasant  background  also  appears 
to  have  beromc  confounded  with  the  requirement  to  send  all 
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urban  senior  secondary  youth  for  rural  service.  All  youth  now- 
have  some  peasant  background,  although  not  bom  in  rural  areas. 

Meanwhile,  the  scarce  opportunities  for  leadership  are  being 
sought  through  keen  competition  in  the  national  exams.  Com- 
plaints  abound  that  the  exams  have  inappropriately  influenced 
high  school  curricula.  As  one  letter  to  the  Editor  of  Chirui  Daily 
put  it,  “these  tests  emphasize  bookdeaming  and  memorization 
(Baiping,  1986).’’  These  trends  continue  to  the  detriment  of 
creativity  (Swanson  & Zhian,  1987).  There  is  concern  that  the 
national  exams  are  too  limited  in  scope,  and  rigid  in  their  reliance 
on  a simple  indicator  like  a total  test  score.  There  is  not  enough 
effort  to  broaden  the  basis  of  the  exams,  or  to  enhance  the  com- 
plexity  of  their  scoring  and  interpretation.  As  the  old  centralized 
system  is  being  unceremoniously  dismantled,  care  needs  to  be 
taken  to  ensure  that  the  sixth  catastrophe  ushers  in  national  exanv 
i nation  >als  that  are  in  the  best  interests  of  the  Chinese  people. 

The  dependent  variable  of  interest  is  now  economic 
self-sufficiency  and  international  competitiveness.  Exams  are 
nou*  expected  to  serve  this  new  goal. 


Yet  China  retains  its  conflicting  forces . One  force 
favors  Communist-style  proletarianism , and  the  other  recog- 
nizes that  the  Chinese  economy  cannot  be  salvaged  without 
modernisation  and  capitalistic  reforms.  There  has  been  no 
catastrophic  outcome  yet,  although  the  Tiannamen  Square 
revolt  came  close  to  being  one. 

Conclusion 

This  study  illustrates  how  the  goals,  content,  form,  and 
process  of  exams  can  be  influenced  by  social  and  political  forces. 
Competence,  over  the  4,000  years  of  Chinese  history  has  come 
to  be  defined  as  military  prowess,  Confucian-style  scholarship, 
Westenvstyle  military  expertise,  proletarian  intellectualism,  and 
modem  industrial  expertise.  There  is  no  doubt  that  such  disparate 
definitions  of  excellence  came  into  being  because  of  catastrophes. 
It  would  appear  from  the  Chinese  experience  that  major  examb 
nation  changes  are  related  to  catastrophic  occurrences,  and  that 
an  analysis  of  catastrophes  helps  understand  why  the  process  and 
criteria  of  examinations  changed  over  time. 
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1990  Annual  Meeting  a Success: 

Member'A  Marge’ s Report 

By  E.  jane  Williams,  Member-At-Large 


This  year’s  conference  was  bigger  and  better  than  ever. 
We  had  the  largest  attendance  of  any  MWERA  conference, 
(N  = 322),  and  there  was  a better  respond  rate  from  participants 
when  asked  to  evaluate  sessions  (42  percent  of  sessions  were  eval- 
uated in  1989;  57  percent  were  evaluated  in  1990)  than  for  the 
1989  conferences.  An  attempt  was  made  to  evaluate  the  confer- 
ence as  a whole  in  addition  to  the  paper  sessions,  however,  very 
few  responses  were  returned,  i.e.,  less  than  20.  Consequently, 
this  paper  will  only  summarize  the  session  evaluator  results. 

This  was  the  second  year  that  the  evaluation  was  con- 
ducted for  the  paper  sessions.  The  paper  sessions  for  the  1990 
MWERA  conference  were  evaluated  using  the  instrument  devel- 
oped for  the  1989  conference.  Like  last  year,  the  results  will  be 
used  by  the  1991  Program  Chair  in  designing  the  1991  conference. 
Respondents  were  asked  to  rate  each  presentation  on  clarity, 
organization,  and  interest  and  note  if  a paper  was  provided  as 
well  as  rate  the  quality  of  the  overall  session  on  organization, 
adequacy  of  facilities,  coordination  of  topics,  amount  of  time 
for  questions/discussion,  and  how  well  questions  were  answered. 
All  items,  except  for  noting  if  a paper  was  provided,  were  rated 
on  a 5 -point  scale  ranging  from  strongly  agree  to  strongly  disagree. 
Copies  of  the  instrument  were  distributed  to  Session  Chairs  via 
their  registration  packets.  Session  Chairs  were  asked  to  have 
participants  complete  the  evaluation  forms  at  the  end  of  the 
session  and  turn  them  into  the  Session  Chair  prior  to  leaving 
that  session.  The  Session  Chair  then  returned  the  completed 
forms  to  the  registration  desk,  where  they  were  picked  up  by  the 
Member-At- Large.  All  responses  were  anonymous.  Only  overall 
results  will  be  presented  here.  If  presenters  of  papers  desire  indi- 
vidual feedback,  they  may  contact  the  Member-At-Laige. 

Completed  forms  were  returned  by  286  participants, 
evaluating  39  sessions.  The  number  of  respondents,  mean,  and 
standard  deviation  for  each  category  evaluating  the  overall  ses- 
sion are  included  in  Table  1.  The  overall  means  ranged  from  4.29 
(topics  were  cooaiinated)  to  4.58  (session  was  very  well  organized) 
with  respective  standard  deviations  of  0.89  and  0.59. 


Table  1 


Number  of  Respondents , Mean,  and  Standard  Deviation  for  Overall 
Session  Caregones  on  MWERA  ’90:  Session  Evaluation  Form 


CATEGORY 

N 

MEAN* 

SD 

The  session  was  very 

well  organized  

..  282 

4.58 

.59 

The  facilities  were  adequate 

..  286 

4.31 

.89 

The  topics  were  coordinated 

..  283 

4.29 

.89 

There  was  adequate  rime  for 
questions/discussion 

..  277 

4.51 

.84 

Questions  were 

answered  adequately 

270 

4.57 

.62 

*Note:  Items  were  rated  using  rhe  following  scale:  (5)  Strongly  Agree,  (4)  Agree, 
(3)  Undecided,  (2)  Disagree,  (1)  Strongly  Disagree. 


The  majority  of  comments  by  participants  reflected  the 
feeling  that  they  were  pleased  with  the  sessions  and  that  the 
sessions  were  well  organized.  Many  commented  that  discussants 
did  a good  job.  An  area  of  major  concern  was  the  need  for  over- 
head screens.  Additional  constructive  and  useful  suggestions 
made  by  multiple  respondents  included  the  following  comments, 
which  related  mainly  to  specific  presentations  and  sessions:  there 
should  be  stricter  guidelines  for  paper  acceptance;  use  roundtable 
format  when  papers  do  not  group  together  well  rather  than  forcing 
them  into  a session;  paper  presenters  should  be  required  to  pro- 
vide a paper  or  at  least  an  outline  of  their  presentation;  presenters 
should  not  simply  read  a paper,  but  explain,  expand,  clarify,  and/or 
develop  the  topic;  presenters  must  show  a greater  depth  in  the 
review  of  the  literature  in  relationship  to  the  topic;  and  save  the 
time  block  from  5 to  6:30  p.m.  for  MWERA  business/association 
council  meetings— paper  sessions  should  end  at  5 p.m.  Overall, 
responses  indicate  that  respondents  were  pleased  with  the  pro- 
gram and  presentations. 


Top  10  Reasons  for  Attending  the  MWERA  Annual  Meeting 

(from  the  Home  Office  in  Lincoln,  Nebraska) 


10.  You  don't  have  to  teach  classes. 

9.  Home  furnishings  sale  at  Marshall  Fields. 

8.  Free  Jrink  coupons  at  the  Bismarck. 

7.  Personally  challenge  sleep  deprivation  finding*. 
6.  Model  new  winter  wardrobe. 


5.  Ride  Chicago  subway  to  ger  ideas  for  Halloween  costumes. 

4.  Play  nose  flute  in  Avrcs  D ’Costa’s  ragtime  hand. 

L Deepdish  pizza. 

2.  Hear  papers  rejected  tor  presentation  at  AERA. 

I . Sketch  out  ridiculous  research  ideas  on  Bismarck  cocktail  napkins, 


from  Kenneth  A fucrou.  MWERA  kevnote  S/vcc/i.  October  JR  J990,  C/iicugu.  JL. 
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MWERA  1991  Annual  Meeting 

October  16-19 , 1991 


Plans  for  the  thirteenth  annual  meeting  of  the  Mid-Western  Educational  Research  Association  are  under  way.  There  are  several  new* 
activities.  There  will  be  a featured  presentation  Wednesday  night.  Joel  Levin,  editor  of  the  Journal  of  Educational  Psychology,  will  speak 
about  publishing  educational  research.  Dr.  Levin  will  also  present  the  keynote  address  Thursday  morning.  In  addition,  there  will  be  a 
featured  presentation  Thursday  afternoon.  Annemarie  Palincsar,  University  of  Michigan,  will  discuss  effective  instruction. 

Other  new  events  include  exhibits  by  publishers,  a “Meet  the  Journal  Editors”  session,  a “Midwest  in  Jest”  session,  featuring  spoofs 
of  educational  research,  and  a Saturday  morning  Fun  Run. 

Several  important  events/activities  will  continue.  We  are  honored  to  have  as  our  luncheon  speaker  Carole  Ames,  University  of 
Illinois  at  Urbana-Champaign.  Dr.  Ames  will  discuss  student  motivation.  Back  for  a second  year,  by  popular  demand,  is  Roger  Burning, 
providing  piano  accompaniment  for  the  Cracker  Barrel  Social. 

The  most  important  part  of  the  1991  conference  though  is  YOU!  We  need  your  ideas  and  research  presented  at  the  annual  meeting. 
We  also  need  you  to  pass  the  word  about  how  wonderful  the  MWERA  conferences  have  been.  Please  tell  people  about  MWERA  and 
the  1991  program  and  encourage  them  to  join  the  organization  and  submit  a proposal. 


Kenneth  A.  Kiewra,  1991  Program  Chair 


CALL  FOR  PROPOSALS 


I . GENERAL  INVITATION  FOR  PARTICIPATION 

You  are  cordially  invited  to  attend  and  participate  in  the  Thir- 
teenth Annual  Meeting  on  October  16-19, 1991,  at  the  Bismarck 
Hotel  in  Chicago,  Illinois. 

CONFERENCE  HIGHLIGHTS: 

WEDNESDAY,  OCTOBER  16 

• Training  Workshops. 

Concurrent  sessions  starting  at  noon  and  3:30  p.m. 

• Special  Night  Session,  8 to  9 p.m. 

Speaker:  Joel  Levin,  Editor,  Journal  of  Educational  Psychology 
Topic:  Tips  for  Publishing  and  Professional  Writing 

THURSDAY,  OCTOBER  17 

• Keynote  Address,  10  a. m. 

Speaker:  Joel  Levin,  University  of  Wisconsin -Madison 
Topic:  Pictorial  Strategies  for  Learning  and  Instruction 

• Special  Afternoon  Session,  5 to  6 p.m. 

Speaker:  Annemarie  Palincsar,  University  of  Michigan 
Topic:  Educational  Research:  Implications  for  Instruction 


• Evening  Social,  6 to  8 p.m. 

Piano  music  by  Roger  Bruning,  University  of  Nebraska 

• “Midwest  in  Jest"  Spoofs  of  Educational  Research 

FRIDAY,  OCTOBER  18 

• Business  Meeting 

• Luncheon 

'Speaker:  Carole  Ames,  University  of  Illinois  at 
Urbana-Champaign 
Topic:  Motivation 

• Exhibits 

• Meet  the  Editors 

The  editors  of  several  major  journal'  will  display-  and  discuss 
their  journals. 

• President’s  Reception,  Bismarck  Rcgenq'  Suite,  9 p.m. 

SATURDAY,  OCTOBER  19 

• MWERA  Fun  Run 
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II.  GENERAL  INFORMATION 

A.  Proposals  may  be  in  the  form  of  scholarly  papers,  symposia, 
workshops,  or  other  innovative  formats.  Deadline:  Must  be  post- 
marked by  May  1,  1991.  All  proposals  will  be  peer-reviewed. 

B.  Any  educational  researcher,  whether  MWERA  member  or 
not,  may  submit  a proposal.  Nonmembers  whose  papers  and/or 
symposia  are  accepted  for  presentation  must  join  MWERA 
upon  notification  of  an  accepted  proposal. 

C.  MWERA  reserves  the  right  to  reproduce  and  distribute  sum- 
maries and  abstracts  of  all  accepted  proposals.  Unless  expressly 
prohibited  in  writing  by  the  authors),  summaries  may  also 
be  made  available  to  the  press  or  other  interested  parties 
upon  request.  Such  limited  distribution  does  not,  of  course, 
preclude  subsequent  publication  of  a summary  or  complete 
paper  by  the  author(s). 

D.  All  persons  attending  the  Annual  Meeting,  including  partici- 
pants, are  required  to  register  for  this  meeting  and  be  members 
of  the  Mid-Westem  Educational  Research  Association.  All 
sessions  listed  in  the  program  will  be  open  to  anyone  regis- 
tered for  the  meeting.  A small  fee  will  be  charged,  and  enroll- 
ment may  be  limited  for  Training  Workshop  participation. 
Materials  for  registering  for  the  Annual  Meeting  will  be  pub- 
lished in  the  Midwestern  Educational  Researcher. 

E.  Participants  in  paper  sessions  and  symposia  must  distribute 
handouts  to  attendees  at  their  sessions.  Paper  presenters  are 
expected  to  have  a written  paper  available  for  prior  review 
by  the  Session  Chair  and  Discussant.  Papers  may  also  be  sub- 
mitted to  ERIC  for  limited  distribution  to  the  profession. 
This  does  not  preclude  formal  publication  in  a journal.  ERIC 
forms  will  be  available  at  the  Conference  Registration  desk. 

F.  We  are  attempting  to  have  overhead  projectors  available  in 
every  meeting  room  for  use  by  presenters.  No  other  audio- 
visual equipment  will  be  provided.  If  special  audio-visual 
equipment  is  needed,  the  presenter  will  have  to  provide  his 
or  her  own  equipment. 

III.  GUIDELINES  FOR  PAPER  PROPOSALS 

A.  General  Information  About  Paper  Proposals 

1.  Only  papers  not  previously  presented  or  published  are 
eligible. 

2.  The  Program  Committee  will  group  papers  into  sessions, 
organized  by  topics  of  interest  to  the  conference.  The  Pro- 
gram Committee  may,  at  its  discretion,  include  a discus- 
sant to  critique  the  papers  in  any  particular  paper  session. 

3.  Generally,  papers  will  be  alloted  15  minutes  per  presenta- 
tion. It  will  be  the  responsibility  of  the  Session  Chair  to 
consult  with  the  presenters,  allocate  time,  and  ensure  that 
the  agreed  schedule  is  followed. 

4.  It  is  the  responsibility  of  the  presenting  author  of  an  ac- 
cepted proposal  to  appear  at  the  Annual  Meeting  to  present 
the  paper.  If  unforeseen  circumstances  arise  that 
prevent  an  author  from  presenting  a paper,  it  is  his/her 
responsibility  to  arrange  for  a suitable  substitute  to  make 
the  presentation,  discuss  the  arrangements  with  the  Session 
Chair,  and  notify  the  Annual  Meeting  Program  Chair: 

Kenneth  A.  Kiewra,  1307  Seaton  Hall,  University  of 
Nebraska,  Lincoln,  NE  68588-0641,  402-472-3233. 

B.  Material  to  be  Submitted  with  a Paper  Proposal 

• Paper  Proposal  Cover  Sheet  (3  copies).  See  attached  form. 


• Summary  (3  copies  of  a 2 to  3 page  summary  typed  single- 
spaced on  816x11  paper).  The  Summary  will  be  used  in 
judging  the  merits  of  the  proposal.  It  should  contain  as 
many  of  the  following  guidelines  as  are  applicable. 

a.  Title  of  Presentation 

b.  Objectives 

c.  Perspective(s)  or  theoretical  framework 

d.  Methods,  techniques,  or  brief  literature  review 

e.  Data  source  (if  appropriate) 

f.  Results,  conclusions,  or  point  of  view 

g.  Educational/scientific  importance  of  the  study 

NOTE:  Only  the  Title  of  the  Paper  should  appear  as 
identifying  information  at  the  top  of  the  Summary.  Please 
do  not  include  name  or  institutional  affiliation,  in  order 
to  permit  blind  review. 

• Abstract  (3  copies).  A 100-  to  200-wotd  narrative  Abstract 
should  be  prepared  for  publication  in  the  Meeting  Ab- 
stracts. The  Abstract  should  contain,  in  abbreviated  form, 
information  listed  in  the  above  guidelines  for  the  two-  to 
three-page  Summary.  Use  clear,  precise  language  and  no 
abbreviations  confusing  to  readers  unfamiliar  with  the 
discipline.  Abstracts  should  be  typed  single-spaced  on 
8V6xll  paper.  An  abstract  longer  than  200  words  is  not 
guaranteed  publication. 

One  copy  of  the  Abstract  should  show  the  title  and  name(s) 
of  the  author(s)  typed  flush  to  the  left  margin,  in  the 
format  below: 

Title  of  Paper  (caps  and  lower  case) 

AUTHOR(S)  (ALL  CAPS),  Institution(s)  (caps  and 
lower  case) 

The  other  two  copies  should  show  Title  of  Paper,  but 
no  Name  or  Institutional  affiliation  in  order  to  allow  a 
blind  review. 

• Envelopes  (3  self-addressed,  stamped,  business-size  en- 
velopes). These  will  be  used  to  inform  you  of  (1)  the  receipt 
of  the  proposal,  (2)  the  decision  of  reviewers,  and  (3)  the 
scheduled  session  time. 

• Index  Cards  (three  3x5  index  cards).  These  should  be  pre- 
pared as  follows: 

Name  of  presenting  author  (last  name  first) 
Complete  mailing  address  (with  zip  code) 

Telephone  number  (with  area  code) 

Title  of  presentation 

IV.  GUIDELINES  FOR  SYMPOSIUM  PROPOSALS 
A.  General  Information  About  Symposium  Proposals 

A Symposium  is  intended  to  provide  an  opportunity  for  exami- 
nation of  specific  problems  or  topics  from  a variety  of  per- 
spectives. In  addition  to  allowing  for  informative  discussion, 
a Symposium  should  provide  for  presentation  of  alternative 
solutions  or  interpretations  either  of  a common  problem  or  in 
relation  to  a complementary  theme.  This  purpose  is  best  served 
when  individuals  with  diverse  or  conflicting  views  are  allowed 
to  interact  on  a topic  of  sufficient  scope  and  importance.  It 
should  be  noted  that  a Symposium  should  not  be  merely  a 
presentation  of  a set  of  related  papers.  While  such  comple- 
mentary papers  are  clearly  worthwhile,  they  should  be  sub- 
mitted as  individual  papers  with  an  indication  of  suggested 
grouping  on  the  Cover  Sheet. 

(continued ) 
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B.  Responsibilities  of  Organizers  of  Symposium 

It  is  the  responsibility  of  the  Symposium  Organizer  to  suggest 
topics  and  solicit  speakers  and  discussants.  Organizers  of  sym- 
posia  must  have  the  consent  of  all  panic ipants  before  sub' 
mitting  the  proposal.  Organizers  not  wishing  to  chair  the 
session  must  invite  chairpersons.  The  Organizer  of  a symposium 
is  responsible  for  ascertaining  that  each  person  named  as  a 
participant  will  be  present  at  the  meeting  if  the  session  is 
accepted.  Should  unforeseen  circumstances  prevent  a partici- 
pant from  attending,  it  is  the  responsibility  of  the  Organizer 
to  find  a suitable  replacement  and  notify  all  other  participants 
in  the  session  as  well  as  the  MWERA  Annual  Meeting  Program 
Chair.  In  addition,  it  is  helpful  for  the  participants  and  the 
discussant(s)  to  have  prior  access  to  summaries  of  each  presen' 
ration  so  that  they  may  be  able  to  formulate  their  remarks  in 
the  context  of  what  the  others  plan  to  say. 

Only  the  Organizer  will  be  notified  of  acceptance  of  a Sym- 
posium,  and  she/he  is  responsible  for  notifying  other  partici- 
pants in  the  Symposium. 

C . Materials  to  be  Submitted  with  a Symposium  Proposal 

• Symposium  Proposal  Cover  Sheet  (three  copies).  See 
attached  form. 

• Summary  (3  copies  of  three-  to  five-page  summary  typed 
single-spaced  on  816x11  paper).  The  summary  will  be  used 
in  judging  the  merits  of  the  proposal.  It  should  contain 
as  many  of  the  following  guidelines  as  are  applicable. 

a.  Title  of  Presentation 

b.  Objectives  of  the  symposium 

c.  Educational  or  scientific  importance 

d.  For  each  presentation,  include  a one-page  overview 

Title  of  presentation 
Objectives 

Perspectives  and/or  methods 
Data  source  (if  appropriate) 

Results,  conclusions,  or  point  of  view 

NOTE:  Please  do  NOT  show  the  Name  or  Institutional 
affiliation  of  the  presenters  on  this  Summary,  in  order  to 
allow  a blind  review. 

• Abstract  (3  copies).  A 300  to  400  word,  narrative  abstract 
should  be  prepared  for  publication  in  the  Meeting  Abstracts. 
The  Abstract  should  represent,  in  abbreviated  form,  the 
information  contained  in  the  three-  to  five-page  Summary. 
Use  clear,  precise  language  and  avoid  abbreviations  that 
might  be  confusing  to  readers  unfamiliar  with  your  field. 
Abstracts  should  be  typed  single-spaced  on  816x11  paper. 
Be  sure  that  one  copy  has  the  following  information  at 
the  top  left  margin  of  the  page: 

Title  of  Symposium  (Caps  and  lower  case) 
ORGANIZER  (ALL  CAPS),  Institution  (Caps  and 
lower  case) 

CHAIRPERSON  (ALL  CAPS),  Institution  (Caps  and 
lower  case) 

PARTICIPANTS  (ALL  CAPS),  Institutional  affilia- 
tion (Caps  and  lower  case) 

Two  copies  of  the  Abstract  should  NOT  show  any  Name 
or  Institutional  affiliation,  in  order  to  allow  a blind  review. 

• Envelopes  (3  self-addressed,  stamped,  business-size  en- 
velopes). These  will  be  used  to  inform  the  Organizer  of  (1) 
receipt  of  the  proposal,  (2)  the  reviewers’  decision,  and 
(3)  the  scheduled  session  time. 


• Index  Cards  (three  3x5  index  cards).  These  should  be 
prepared  as  follows: 

Title  of  symposium 

Name  of  organizer  (last  name  first) 

Complete  mailing  address  (with  zip  code) 

Telephone  number  (with  area  code) 

Name  of  symposium  chairperson,  if  different  from 
organizer  (last  name  first) 

Complete  address  (with  zip  code) 

Telephone  number  (with  area  code) 

• Three  copies  (816x11)  of  a list  of  all  participants  in  the 
symposium,  their  presentation  title,  and  their  mailing 
addresses.  The  chairperson,  presenters,  and  discussant(s) 
should  be  included  in  this  list. 

V.  GUIDELINES  FOR  TRAINING  WORKSHOP  PROPOSALS 

A.  General  Information  About  Training  Workshop  Proposals 

Proposed  workshop  topics  should  be  of  interest  and  use  to 
a number  of  MWERA  members.  Presenters  will  receive  an 
honorarium  based  on  the  number  of  participants  attending  the 
workshop.  All  persons  listed  as  presenters  are  required  to  appear 
at  the  conference  and  present  the  workshop  at  the  designated 
time.  All  workshops  will  be  on  Wednesday,  October  16, 1991, 
either  starting  at  noon  or  3:30  p.m.  Some  workshops  may  be 
offered  twice.  Workshop  proposals  should  be  sent  to  the  Train- 
ing Workshop  Coordinator,  Stephen  Benton  (see  address  below). 

B.  Materials  to  be  submitted  with  a Training  Workshop  Proposal 

• Cover  Sheet  (Use  Symposium  Proposal  Cover  Sheet.  See 
attached  form.)  Send  two  copies  with  all  items  complete. 
Strike  out  the  word  “Symposium”  and  write  in  “Workshop.” 
Indicate  the  total  amount  of  time  you  believe  will  be  needed. 
Please  note  that  in  special  circumstances  a workshop  may 
be  allocated  more  than  three  hours. 

• Summary  (3  copies  of  a two  - to  three-page  summary  typed 
single-spaced  on  816x11  paper).  This  will  be  used  to  judge 
the  proposal.  The  summary  should  include  information 
such  as  the  following. 

a.  Objectives  (knowledge,  skills  for  participants) 

b.  Suggested  entry-level  skills  for  participants 

c.  Educational  or  scientific  importance  of  the  topic 

d.  Perspectives,  orientations,  or  theoretical  framework 

e.  Methods  or  techniques  of  instruction 

f.  Description  of  presenter’s  relevant  experience 

• Abstract  (3  copies).  A 100  to  200-word,  narrative  Abstract 
should  be  prepared  for  publication  in  the  Annual  Meeting 
Abstracts.  This  should  briefly  describe  the  objectives, 
content,  and  methods  of  the  workshop.  Use  clear,  precise 
language  and  no  abbreviations  confusing  to  readers  un- 
familiar with  the  discipline.  Abstracts  should  be  typed 
single-spaced  on  816x11  paper.  An  abstract  longer  than  200 
words  is  not  guaranteed  publication.  For  all  copies  of  the 
abstract,  the  title  of  the  workshop  and  presenter(s)  should 
be  typed  flush  to  the  left  margin,  in  the  format  below: 

Title  of  Workshop  (Caps  and  lower  case) 
PRESENTER(S)  (ALL  CAPS),  Institution  (Caps  and 
lower  case) 

• Envelopes  (3  self-addressed,  stamped,  business-size  en- 
velopes). These  will  be  used  for  notification  of  receipt  of 
the  proposal,  the  reviewer’s  decision,  and  the  scheduled 
session  time. 
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VI. 


Vll. 


VIII. 


• Index  Cards  (three  3x5  index  cards).  These  should  be 
prepared  as  follows: 

Name(s)  of  Workshop  presenters  (last  name  first) 
Complete  mailing  address  (with  zip  code)  of  contact 
person  for  the  workshop 

Telephone  number  (with  area  code)  of  contact  person 
Title  of  Workshop 

Mail  Workshop  Proposal  to  1991  Workshop  Training  Coor- 
dinator:  Stephen  L.  Benton,  Department  of  Educational 
Psychology  and  Counseling,  Bluemont  Hall,  Kansas  State 
University,  Manhattan,  KS  66506. 

“MIDWEST  IN  JEST” 

There  will  be  a spoof  session.  No  fooling.  Submit  completed  work 
relevant  to  any  area  of  educational  research  to  Ken  Kiewra, 
Ottoman,  1307  Seaton  Hall,  University  of  Nebraska,  Lincoln, 
NE  68588-0641. 


ADDITIONAL  INNOVATIVE  FORMATS  ARE  INVITED 

Session  formats  for  the  Annual  Meeting  are  not  necessarily  limited 
to  those  listed  above  (i.e.,  papers,  symposia,  and  workshops).  Inno- 
vative  formats  (e.g.  poster  sessions  or  roundtables)  are  encouraged 
and  will  be  considered.  If  you  wish  to  propose  an  innovative  format, 
please  submit  details  by  May  1 to  the  1991  Annual  Meeting  Pro- 
gram Chair,  Kenneth  Kiewra,  1307  Seaton  Hall,  University  of 
Nebraska,  Lincoln,  NE  68588-0641. 


WHERE  TO  SUBMIT  PROPOSALS 

Proposals  for  PAPERS  and  SYMPOSIA  are  to  be  submitted  with 
a postmark  of  no  later  than  May  1,  1991,  to  one  of  the  following 
Division  Chairs.  Choose  the  Division  that  reflects  the  topic  of 
your  paper  most  appropriately. 

DIVISION  A:  ADMINISTRATION— Concerned  with  research, 
theory,  development,  and  improvement  of  practice  in  the  organi- 
zation and  administration  of  education. 

Dr.  Wenifort  C.  Washington 
College  of  Education 
'Zook  Hall  426 
The  University  of  Akron 

Akron,  OH  44325-4206  Phone:  216-972-7764 

DIVISION  B;  CURRICULUM  AND  STUDIES-Concemed 
with  curriculum  and  instructional  practice,  theory,  and  research. 
Dr.  Sarah  E.  Peterson 
Educ.  Psych.,  Couns.  and  Spl.  Educ. 

Northern  Illinois  University 

Dekalb,  IL  60115  Phone:  815-753-8471 

DIVISION  C:  LEARNING  AND  COGNITION-Concemed 
with  theory  and  research  on  human  abilities,  learning  styles, 
individual  differences,  problem  solving,  and  other  cognitive  factors. 
Dr.  Greg  Schraw 
Educational  Psychology 
1308  Seaton  Hall 
University  of  Nebraska 

Lincoln,  NE  68588-0641  Phone:  402-472-6944 

DIVISION  D:  MEASUREMENT  AND  RESEARCH  METHOD- 
OLOGY—Concerned  with  measurement,  statistical  methods, 
and  research  design  applied  to  educational  research. 


DIVISION  D ( continued ) 

Dr.  Leslie  E.  Lukin 
Educational  Psychology 
16  Hill  Hail 
University  of  Missouri 

Columbia,  MO  65211  Phone:  314-882-1310 

DIVISION  E:  COUNSELING,  HUMAN  DEVELOPMENT 
AND  SPECIAL  EDUCATION— Concerned  with  the  under- 
standing of  human  development,  special  education,  and  the  appli- 
cation and  improvement  of  counseling  theories,  techniques,  and 
training  strategies. 

Dr.  Alvin  Leung 

Department  of  Educational  Psychology 
120  Bancroft  Hall 
University  of  Nebraska 

Lincoln,  NE  68588-0345  Phone:  402-472-6948 

DIVISION  F:  HISTORY  AND  PHILOSOPHY  OF  EDUCA- 
TION—Concerned  with  the  findings  and  methodologies  of  his- 
torical research  in  education. 

Dr.  Nelson  T.  Strobert 
162  Gordon  Avenue 

Gettysburg,  PA  17325  Phone:  717-334-6386 

DIVISION  G:  SOCIAL  CONTEXT  OF  EDUCATION  AND 
MOTIVATION— Concerned  with  theory,  practice,  and  research 
on  social,  moral,  affective,  and  motivational  characteristics 
and  development. 

Dr.  Joan  S.  Timm 

Educational  Foundations 

College  of  Education  and  Human  Services 

University  of  Wisconsin-Oshkosh 

Oshkosh,  WI  54901  Phone:  414-424-1490 

DIVISION  H:  SCHOOL  AND  PROGRAM  EVALUATION— 
Concerned  with  research  and  evaluation  to  improve  school  prac- 
tice, including  program  planning  and  implementation. 

Dr.  Richard  C.  Pugh 
25 13  Buttonwood  Lane 

Bloomington,  IN  47401 Phone:  812-855-9832 

DIVISION  I:  PROFESSIONAL  AND  MEDICAL  EDUCA- 
TION—Concerned  with  educational  practice,  research,  and  eval- 
uation in  the  professions  (e.g.,  medicine,  nursing,  public  health, 
business,  law,  and  engineering). 

Dr.  Patricia  B.  Mullan 
3291  Bluett 

Ann  Arbor,  MI  48105  Phone:  313-936-1647 

DIVISION  J:  POSTSECONDARY  EDUCATION-Concemed 
with  a broad  range  of  issues  related  to  two-year,  five-year,  and 
graduate  education. 

Dr.  William  E.  Loadman 

287  Arps  Hall 

The  Ohio  State  University 

Columbus,  OH  43210  Phone:  614-292-3239 

DIVISION  K:  TEACHING  AND  TEACHER  EDUCATION- 
Concemed  with  research  on  teaching,  conditions  of  teaching, 
the  teaching  profession,  and  the  preparation  and  development 
of  teachers. 

Dr.  Charlene  M.  Czemiak 
College  of  Education 
University  of  Toledo 
2801  W.  Bancroft  Street 

Toledo,  OH  43606 Phone:  419-537-2094 
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PAPER  PROPOSAL  COVER  SHEET 


1991  MWERA  Annual  Meeting 

Please  print  or  type 

1.  Paper  Title 


2.  Presenting  Author 

LAST  NAME  FIRST  NAME  Ml 

Affiliation 

Mailing  address 

Work  phone  ( ) Home  phone  ( ) 

3.  Coauthors  [List  name(s),  institutional  affiliation(s)] 


4.  If  you  wish  to  have  this  paper  grouped  in  the  same  session  with  other  papers  submitted  to  the  convention,  please  attach  a 
separate  sheet  listing  presenting  authors  and  titles  of  the  other  papers. 

5.  Are  you  a member  of  MWERA?  □ Yes  □ No 

Please  note  that  all  presenters  must  be  current  members  of  MWERA  at  time  of  presentation  and  must  register  for  the  Annual  Meeting. 

I hereby  certify  that,  if  this  paper  is  accepted  and  placed  on  the  program,  1 will  register  for  the  Annual  Meeting,  appear,  and 
deliver  the  paper. 


SIGNATURE  DATE 

Be  certain  all  of  the  following  are  enclosed: 

THREE  SETS  OF  MATERIALS,  STAPLED  TOGETHER,  EACH  CONTAINING  ONE  OF  EACH  OF  THE  FOLLOWING: 

• Paper  proposal  cover  sheet 

• Two-  to  three-page  Summary 

• 100  to  200-word  Abstract  (to  appear  in  the  Meeting  Abstracts) 

• Self-addressed  stamped  envelope 

• 3x5  index  card  with  author’s  name,  address,  telephone  number  and  presentation  title. 

THIS  INFORMATION  MUST  BE  RECEIVED  BY  THE  APPROPRIATE  DIVISION  CHAIR  BY  MAY  1,  1991. 
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SYMPOSIUM  PROPOSAL  COVER  SHEET 


1991  MWERA  Annual  Meeting 


Please  prim  or  type 

1.  Symposium  Title 


2.  Organizer 

LAST  NAME  FIRST  NAME  Ml 

Affiliation 

Mailing  address 

Work  phone  ( ) Home  phone  ( ) 

% 

3.  Participants.  Please  attach  a separate  sheet  listing  name,  institutional  affiliation,  mailing  address,  telephone  number,  and  title 
of  presentation  for  each  participant,  including  Discussants),  Chair,  and  Organizer. 

4.  Chair  (if  different  from  Organizer) 

LAST  NAME  FIRST  NAME  Ml 

5.  Time  requested: □ 1 hour □ lVz  hours □ 2 hours 

6.  Are  you  a member  of  MWERA?  □ Yes  □ No 

Please  ncte  that  all  presenters  must  be  current  members  of  MWERA  at  time  of  presentation  and  must  register  for  the  Annual  Meeting. 

I hereby  certify  that,  if  this  symposium  is  accepted  and  placed  on  the  program,  all  presenters  of  this  symposium  will  register 
for  the  Annual  Meeting,  and  be  responsible  for  its  presentation.  I hereby  declare  that  I have  assurances  from  the  other  pan 
ticipants  that  they  will  register  and  make  their  respective  presentations. 


SIGNATURE  DATE 

Be  certain  all  of  the  following  are  enclosed: 

THREE  SETS  OF  MATERIALS,  STAPLED  TOGETHER,  EACH  CONTAINING  ONE  OF  EACH  OF  THE  FOLLOWING: 

• Symposium  proposal  cover  sheet 

• Three'  to  five-page  Summary  of  the  symposium 

• 400-word  Abstract  (to  appear  in  the  Meeting  Abstracts) 

• Self-addressed  stamped  envelope 

• 3x5  index  card  with  symposium  title,  name,  telephone  number,  and  address  of  the 
Organizer  and  Chair 

• List  of  all  participants  as  per  No.  3 above. 


THIS  INFORMATION  MUST  BE  RECEIVED  BY  THE  APPROPRIATE  DIVISION  CHAIR  BY  MAY  1,  1991. 
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The  Mid-Western  Educational  Research  Association  (MWERA)  is  a nonprofit 
organization  of  professional  educational  researchers  primarily  from  states  and  provinces 
located  in  the  mid-western  region  of  the  United  States  and  Canada.  Membership  is  open 
to  faculty,  students,  and  administrators  from  any  university,  college,  and  school.  College 
students  engaged  in  educational  research  are  especially  encouraged  to  join  as  members. 
Also  any  educational  researchers  in  business  and  industry,  as  well  as  those  in  national, 
state,  local  and  private  agencies  and  organizations  are  welcome. 

The  Association  promotes  and  disseminates  educational  research  through  its  publi- 
cations, its  scholarship  program,  and  its  Annual  Meeting. 

The  MidWestem  Educational  Researcher  is  the  official  publication  of  the  Association. 
The  three  issues  published  annually  are  mailed  to  all  members.  These  issues  include  a report 
on  the  Annual  Meeting,  some  of  the  major  presentations,  the  Call  for  Proposals,  and  the 
Program  for  the  Annual  Meeting. 

The  Annual  Meeting  of  the  Association  is  held  in  the  third  week  of  October  begin- 
ning with  presessions  starting  on  Wednesday  at  noon.  The  meeting  is  comprised  of  papers, 
symposia,  and  invited  addresses  concerning  a variety  of  topics  from  the  various  MWERA 
Divisions.  The  1991  Annual  Meeting  will  be  held  at  the  Bismarck  Hotel,  Chicago,  Illinois, 
October  16  through  19.  Contact  the  Program  Chair  for  more  information  about  the  Annual 
Meeting:  Kenneth  A,  Kiewra,  (402)  472-3233,  1307  Seaton  Hall,  University  of  Nebraska- 
Lincoln,  Lincoln,  NE  68588-064L 

The  annual  dues  of  $10  include  a subscription  to  the  M idWestem  Educatiorial  Research 
and  a reduced  registration  fee  for  the  Annual  Meeting. Address  membership  correspondence 
to:  Charles  C.  Anderson,  Jr.,  (708)  564-4796,  MWERA  Executive  Officer,  1332  Southwind 
Drive,  Northbrook,  IL  60062. 


MWERA  Membership  Application 

Name  (first,  mid.  initial,  last) 


Mailing  address 


City 

State 

Zip 

Home  phone  ( 

) 

Office  phone  ( 

> 

Highest  degree 

Area  of  specialization 

Institution/employer 


MWERA  division  preferences 
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The  Ralph  Nader  of  Education: 

An  Interview  with  Robert  Slavin 


By  Gregory  ].  Marchant,  Ball  State 
University,  and  Isadore  Newman, 
The  University  of  Akron 


Could  you  tell  us  something  ^ W* 

about  your  background, 
about  how  you  got  started 
in  educational  research? 

1 started  out  in  the  world  as 

a psychology  major  as  an  * ::S  /• 

undergraduate.  But  I was 

also  very  interested  in  edu- 

cation,  and  along  the  way  I 

started  working  toward  cer- 

tification  as  a high  school 

social  studies  teacher.  I 

undergraduate  thesis.  I had  Jm 

this  real  clever  idea  that  I Mr- 

thought  was  never  thought 

of  in  the  history  of  the  Robert  Slavin  has  numerou 
human  race,  to  see  whether  and  other  top  journals.  He 
it  would  be  a good  idea  to  eaTh  advocate  of  cooperam 
have  kids  work  in  small  "best  evidence"  approach  tt 
teams— work  in  groups.  1 

read  something  by  James  Coleman  asking  why  was  it  that 
kids  were  so  interested  in  sports  and  not  at  all  interested 
in  academics.  1 wondered  it  if  might  have  something  to 
do  with  the  social  structure  of  the  classroom  as  opposed 
to  the  athletic  social  structure.  In  the  athletic  social 
structure  your  efforts  benefit  a team,  which  benefits 
the  schools,  so  the  peers  encourage  athletic  excelelnce 
because  it’s  in  their  interest  to  do  so.  In  the  classroom 
when  somebody  does  well  it  reduces  the  chance  that 
others  will  be  successful.  There  arc  only  so  many  As  to 
go  around.  So  in  the  classroom,  kids  discourage  each 
other  from  excellence,  hard  work,  and  so  on.  I was  very 
impressed  by  that  and  was  going  to  try  to  put  it  into 
practice.  1 wound  up  as  an  undergraduate  working  with  my 
wife— well,  she  wasn’t  my  wife  then.  Together  we  designed 
this  program  that  involved  kids  working  in  small  learning 
teams  learning  lab  science.  It  turned  out  to  be  extremely 
successful.  Then  1 went  out  and  tried  to  get  a job  as  a 
social  studies  teacher,  and  this  was  when  there  weren’t 
any  jobs.  The  whole  state  of  Oregon  must  have  had  one 


Robert  Slavin  has  numerous  publications  in  A ERA  joumab 
and  other  top  journals.  He  is  a researcher  who  has  been  an 
early  advocate  of  cooperative  learning  and  has  developed  the 
“ best  evidence ” approach  to  research  synthesis . 


job,  and  I didn’t  get  it.  So  I spent 
a year  teaching  special  education. 
It  so  happened  that  1 knew  some' 
thing  about  this  because  every 
summer,  as  a summer  job,  1 was 
working  with  retarded  and  autistic 
children.  I taught  special  educa- 
tion  for  a while  and  then  went  to 
graduate  school.  The  only  place  I 
knew  of  that  knew  anything  about 
this  cooperative  learning  notion 
was  Johns  Hopkins  University. 
James  Coleman  was  the  only  per- 
son I’d  read  about  who  knew  any- 
thing about  this,  but  he  left  the 
year  I came.  But  it  turns  out  there 
were  some  people  who  had  been 
working  with  him,  such  as  David 
DeVries.  He  had  been  working  with 
Coleman  on  ways  of  having  kids 
work  in  small  groups.  I sort  of  fell 
in  with  that  work  in  the  center 
that  I work  in  now,  and  basically 
what  happened  is  that  I finished  my 
program,  my  adviser  left,  I took  his 
job,  and  I’ve  been  there  ever  since. 


Why  is  cooperative  learning  working?  I've  never  known 
a model  that  has  caught  on  in  classrooms  on  every  level 
from  elementary  school  through  college.  What  is  it  about 
cooperative  learning  that  has  made  it  so  popular,  and 
what  lesson  is  there  for  us  for  other  kinds  of  strategies? 

There  is  an  interesting  history,  in  that  a lot  of  the  coopera- 
tive learning  that  is  being  widely  used  now  was  completely 
developed,  researched,  and  packed  away  by  1978  or  there- 
abouts. There  have  been  other  models  that  have  been 
developed  since  1980,  but  the  ones  that  are  in  widest  use 
now  had  really  been  well -researched,  well -documented, 
and  well -developed  long  ago,  and  then  8 or  10  years  later 
are  all  of  a sudden  as  popular  as  the  hula-hoop.  I think 
that  what  happened  was  that  in  1978  and  into  the  early 
80s  we  were  more  in  the  age  of  mastery  learning,  of  Made- 
line Hunter,  of  trying  to  improve  or  patch  up  traditional 
teaching,  as  opposed  to  looking  at  more  serious  alterna- 
tives. 1 think  that  there  are  a whole  lot  of  trends  in  the 

(umlmiu  ti  mi  /xiqi  20) 
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An  Interview  with  Slavin  (continued) 

opposite  direction  now  toward  looking  more  broadly  at 
innovative  methods.  So  we  had  the  advantage  of  being 
ready  when  the  opportunity  arose,  because  we  had  been 
working  and  refining  cooperative  learning  methods,  get' 
ting  them  right,  and  understanding  what  the  basic  prin- 
ciples were  before  the  world  was  asking  for  them  in  large 
quantities.  I think  what’s  appealing  about  cooperative 
learning  is  that  it  allows  you  to  pursue  achievement  goals, 
allows  you  to  know  that  kids  are  going  to  do  well  on  tests 
and  all  the  usual  accountability  measures  at  the  same 
time  as  you’re  achieving  humanistic  goals. 

I see  waves  of  fads  in  education.  What  you  often  have  is 
rediscovering  principles;  they  fade  out,  come  back,  fade 
out,  and  what  seems  to  really  work  is  just  as  likely  to  go 
out  of  favor  as  things  that  are  not  working. 

I think  that  one  part  of  what’s  happened  is  that  teachers 
are  seeing  practical,  replicable,  feasible  sorts  of  things  that 
they  can  do  in  their  own  classrooms  that  also  may  happen 
to  be  effective.  But  as  I think  you’re  suggesting,  the  effec- 
tiveness of  them  is  not  the  main  explanation  for  why 
they’re  popular.  They’re  popular  because  they  solve  a prob- 
lem that  schools  are  perceiving  right  now  as  being  impor- 
tant. I chose  the  term  “as  popular  as  the  hula-hoop”  con- 
sciously because  the  hula-hoop  was  a fad.  It  didn’t  serve  a 
long-term  need.  It  was  in  and  then  it  was  out.  I think, 
unfortunately,  in  education,  that  is  the  way  innovation 
happens.  Old  things  fall  into  disuse  not  because  they  are 
wrong,  but  because  they  are  old.  New  things  are  used  be- 
cause they’re  flashy  and  new.  The  way  we  have  staff  develop- 
ment set  up,  is  that  we  have  staff  developers  who  are  not 
reinforced  for  choosing  something  effective,  sticking  with 
it  for  a period  of  years,  seeing  that  the  program  is  effectively 
used  and  is  actually  producing  the  differences  that  it’s 
supposed  to  produce,  and  then  institutionalizing  it  through 
a school  system.  They’re  rewarded  for  coming  up  with 
something  that’s  new  and  interesting  that  will  amuse  and 
excite  teachers  and  other  staff.  The  role  of  data  or  research 
is  rather  limited.  It’s  not  zero,  but  it’s  limited.  It  has  an 
indirect  effect,  because  if  there  is  good  data,  this  influences 
some  decision  makers,  some  actors  somewhere  along  the 
process  so  that  it  ultimately  gets  to  teachers  and  promotes 
or  retards  the  impact  of  the  program.  I wrote  about  the 
Madeline  Hunter  program  in  South  Carolina  as  a good 
example  of  the  limited  impact  of  research.  The  few  evalu- 
ations that  were  done  on  the  Madeline  Hunter  program 
found  zero  effects  from  it.  It’s  not  a bad  program.  There’s 
nothing  wrong  with  it.  It  has  some  nice,  interesting  ideas, 
but  as  a program  it  was  not  evaluated,  yet  was  mandated 
in  state  after  state  in  one  form  or  another.  Not  just,  “Here’s 
an  interesting  idea  you  might  fry,”  hut  mandated.  I wrote 


about  a particular  case  in  South  Carolina  that  was  inter- 
esting because  they  commissioned  a study  of  the  program, 
and  a very  careful  and  thorough  study  found  it  had  no 
impact  whatsoever  on  student  achievement.  However,  this 
didn’t  derail  the  process  at  all.  There  was  still  a commit- 
ment to  move  forward  and  have  every  teacher  trained. 

N | What  can  you  suggest  that  a school  system  or  a uni- 
versity should  do  in  identifying,  developing,  and  eval- 
uating programs? 

Clearly  what  school  districts  should  be  doing  is  trying  to 
build  some  capability  to  evaluate  and  make  decisions  based 
on  things  that  actually  have  a research  background— that 
have  some  evidence  of  effectiveness,  but  then  still  evaluate 
them  within  their  own  districts.  They  should  pilot  on  a 
small  scale  something  that  they’re  thinking  about  adopting, 
evaluate  it  very  carefully  against  control  groups,  and  then 
make  a decision  based  on  their  own  evaluations.  You  can’t 
rely  completely  on  testimonials  from  teachers  about  what 
helps  their  students  because  their  perceptions  are  so  bound 
up  with  their  own  qualities  as  teachers  that  can’t  be  sepa- 
rated from  the  effectiveness  of  the  program. 

jsj  j What  qualities  in  research  do  you  consider  necessary  for 
' determining  which  studies  present  the  “best  evidence”? 

§ I don’t  think  you  can  point  to  any  kind  of  generic  set  of 

qualities.  What  I was  talking  about  when  I was  writing  my 

best  evidence  synthesis  was  to  try  to  identify  what  was  the 
best  evidence  that  we  had  on  a particular  topic.  In  some 
cases  the  best  is  not  very  good,  in  some  cases  the  best  is 
outstanding.  As  far  as  saying  there’s  a minimum  level  that 
something  has  to  achieve,  would  be  kind  of  hard  to  do.  I 
would  strongly  emphasize  the  use  of  control  groups,  some 
kind  of  clear  evidence  that  the  experimental  and  control 
groups  were  equivalent  before  the  treatment  was  applied, 
and  that  the  measurement  was  fair  to  both  groups;  in  other 
words,  it  wasn’t  something  that  only  applied  to  the  objec- 
tives of  the  experimental  group.  Those  three  requirements 
would  probably  wipe  out  about  90  percent  of  educational 
research  or  more. 


When  is  there  enough  research  to  establish  the  best 
evidence  idea? 


S You  can’t  wait  until  the  evidence  is  perfect  before  writing 
reviews.  It’s  useful  to  take  stock  about  the  path  that  you’re 
on.  The  path  never  ends.  You’re  never  at  the  point  of 
understanding  that  you  want  to  be  at.  You  need  to  under- 
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stand  the  setting  conditions.  You  may  say,  such  and  such 
seems  to  be  effective  on  average  for  students  of  this  age 
and  these  general  characteristics.  Then  you  have  to  repli- 
cate it,  but  also  you  want  to  find  what  limiting  conditions 
exist.  You  may  find,  “OK  this  may  work  in  classes  of  this 
kind  or  that  kind,  but  it  doesn’t  work  with  classes  of  this 
systematic  kind,  or  teachers  of  this  kind  or  that  kind.” 


I don’t  see  people  doing  that  type  of  research.  They 
just  seem  to  stop  and  generalize.  I don’t  see  those  types 
of  limiting  factors  being  investigated  or  reported. 


No,  but  I think  that  our  problem  is  that  we’re  not  even 
getting  to  stage  one  of  identifying  the  larger  strategies 
that  make  a difference.  Only  when  we  know  the  overall 
effect  can  we  go  on  to  stage  two,  three,  or  four,  which  is 
to  start  identifying  a lot  of  the  setting  conditions  studying 
small  variables.  Wait-time  for  instance  is  very  problematic 
because  it’s  too  small  of  a piece  and  too  contextually 
bound  a piece  of  the  total  instructional  process  to  be  able 
to  be  studied  in  practical  experiments.  You  need  to  take 
something  bigger  like  cooperative  learning,  mastery  learn- 
ing, mastery  teaching,  individualized  instruction,  ability 
grouping,  or  departmentalization  because  they  are  less 
totally  context  bound.  When  you  pick  out  something  as 
small  as  wait-time  or  a particular  questioning  strategy, 
it  is  too  bound  with  the  context  of  the  teacher,  of  the 
students,  and  of  the  relationship  between  them.  Also,  its 
impacts  are  likely  to  be  very  modest,  but  impacts  can 
aggregate.  In  other  words,  the  impacts  of  lots  of  these  little 
things  may  be  big  news,  but  each  one  of  them  alone  is  not 
going  to  make  huge  differences  in  student  achievment. 


Your  approach  to  investigating  topics  such  as  Bloom’s 
mastery  learning  and  Madeline  Hunter  make  you  appear 
to  be  a critic  or  a consumer  protection  advocate.  What 
determines  what  topics  you  pursue? 


The  Ralph  Nader  of  education?  Well,  what  I’m  mainly 
trying  to  do  in  my  research  life  is  to  answer  one  simple 
question,  which  is:  What  works  for  student  achievement? 
And  particularly,  what  works  in  the  sense  of  things  that 
can  be  transported  and  replicated.  1 have  a particular 
interest  in  what  works  for  kids  who  are  not  typically  well 
served  by  the  school  system— disadvantaged  kids,  special 
education  kids.  Chapter  1 kids.  1 have  a real  leftover  60s 
belief  that  the  world  should  be  a whole  heck  of  a lot 
difh  rent  from  what  it  is,  and  that  there’s  a large  category 
of  kids  who  are  getting  in  very,  very  deep  trouble  very 
early  and  this  is  something  that's  unacceptable.  Whenever 
there’s  something  listed  in  the  AERA  program  that  has 


“has  effects  on”  in  the  tile,  I’ll  write  for  it  if  they  seem 
to  have  any  kind  of  potential  at  all  for  affecting  student 
achievement.  I’ve  got  reviews  that  are  percolating  all  the 
time,  because  I'm  trying  to  satify  myself.  I’m  convincing 
myself  about  which  way  to  go  on  each  of  these  kinds  of 
solutions.  1 get  close  to  things  like  mastery  learning,  not 
because  I want  to  shoot  them  down,  but  because  I was 
attracted  by  many  aspects  of  masteiy  learning  and  I wanted 
to  understand  what  its  effects  were.  Actually,  I did  a study 
of  mastery  learning  with  Nancy  Karweit  back  in  the  late 
70s  hoping  and  expecting  that  mastery  learning  was  going 
to  be  very  effective  and  that  we  could  enhance  its  effec- 
tiveness further  by  combining  it  with  cooperative  learning, 
which  mastery  learning  people  had  often  talked  about. 
In  our  study  we  found  out  that  the  mastery  learning  com- 
ponent of  what  we  were  doing  wasn’t  adding  anything  to 
achievement,  and  as  we  got  into  the  literature,  we  realized 
that  we  weren’t  the  only  ones  finding  this.  So  I got  close 
to  it  because  it  was  an  appealing  idea,  not  something  1 
wanted  to  get  rid  of. 


If  you  had  control  over  a teacher  education  department 
and  you  were  able  to  come  up  with  three  rules  or  three 
statements:  I want  all  teachers  to  know  this  about 
research,  1 want  all  teacher  education  people  to  know 
this  about  student  learning.  What  would  those  three 
or  four  statements  be? 


I just  don’t  know  if  it  can  be  boiled  down  like  that.  I can 
tell  you  the  obvious  kind  of  things,  such  as  that  teachers 
need  to  have  a range  of  effective  lesson  presentation 
strategies.  They  need  to  know  something  about  classroom 
management,  particularly  proactive-preventative  manage- 
ment, such  as  how  to  r ^ganize  classroom  events  so  that 
the  management  problems  are  not  a drag  on  the  success 
of  the  teacher.  They  need  to  have  some  understanding 
about  how  they’re  going  to  deal  with  individual  differ- 
ences in  the  classrooms,  whether  they’re  going  to  use 
grouping  strategies,  or  how  they’re  going  to  accommodate 
the  range  of  students  they’ve  got.  They’ve  got  to  have 
some  clear  sense  about  how  they’re  going  to  motivate 
students,  how  they’re  going  to  make  them  want  to  learn 
things  that  they’re  presenting. 


I think  one  of  the  problems  is  that  we  don’t  teach 
teachers  to  be  researchers  (in  a global  sense,  not  in  a 
specific  sense).  A good  researcher  is  a person  who  asks 
good  questions  and  is  interested  in  asking  questions 
because  they  want  answers. 
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An  educational  psychology  text  or  a methods  text  cant 
give  and  shouldn’t  be  giving  teachers  pat  answers  or  a 
bag  of  tricks.  It  needs  to  raise  the  issues  you  need  to  con- 
sider. I give  an  example  in  my  text  of  this  where  there’s  a 
kid  in  the  class  who’s  clowning  around  and  the  teacher 
is  now  considering  a series  of  alternatives.  What  he’s 
considering  is  theories  and  then  actions  related  to  those 
theories.  Theory  l might  be  this  kid’s  clowning  around 
because  he’s  bored  or  frustrated,  so  he  wants  to  disrupt 
the  activity.  The  solution  is  to  change  the  lesson,  the 
topic,  or  whatever.  Possibility  2 might  be  that  he’s  trying 
to  get  the  attention  of  the  rest  of  the  class.  They’re  laugh- 
ing. That’s  an  indication  that  their  laughter  is  maintain- 
ing the  behavior,  so  the  solution  might  be  to  tell  the  kids 
that  they  can  earn  extra  recess  if  the  whole  class  is  well 
behaved,  so  the  kids  will  put  pressure  on  the  kid  to  stop 
clowning  around.  Possibility  3 is  that  the  kid  doesn’t 
realize  that  the  class  really  has  norms  that  favor  appro- 
priate behavior  in  the  classroom,  so  maybe  the  solution 
is  to  discuss  what  rhe  class  rules  are  and  to  discuss  the 
idea  of  what  the  class  is  for.  The  teacher  is  like  a detective 
in  a sense.  The  teacher  has  theories  for  this  particular 
case.  The  teacher’s  got  some  evidence,  such  as  the  other 
kids  laughing.  That’s  important  information.  The  teacher 
pieces  together  little  bits  of  information  that  give  an 
understanding  of  what  the  child  is  doing.  I think  teacher 
educators  must  be  working  on  two  different  things. 
They’ve  got  to  be  working  to  develop  the  teacher  as 
researcher  or  as  detective,  but  you’ve  also  got  to  give 
them  some  theories,  some  evidence,  and  possibilities  to 
consider  and  accept  or  reject  as  the  situation  requires. 


^ What  do  you  think  of  the  expert-novice  studies  on  teachers? 

§ I think  that  expert -novice  studies  can  be  helpful  in  show- 

ing  something  about  what  does  happen;  what  kinds  of 

things  do  develop  over  teachers’  careers.  They  don’t  always 
show  you  what  should  develop  however.  1 find  the  process- 
product  studies  on  effective  teaching,  which  have  a lot 
in  common  with  expert-novice  studies,  to  be  more  pro- 
ductive in  terms  of  things  directly  relevant  to  classroom 
practice.  If  there  were  a substantial  correlation  between 
teaching  experience  and  instructional  effectiveness, 
then  expert-novice  studies  would  be  a lot  more  interest- 
ing. But  since  there  isn’t,  then  I think  chances  are  that 
among  a group  of  first-years,  there’s  a subgroup  of  teachers 
who  are  a lot  more  effective  than  the  average  experienced 
teacher,  and  studying  what  these  teachers  are  doing  is 
more  productive  than  studying  what  experienced  teachers 
are  doing. 


N 


What  criteria  do  you  think  should  be  considered  to 
assess  teacher  effectiveness? 


S 


An  effective  teacher  is  primarily  one  who  helps  all  chil- 
dren achieve  to  their  full  potential.  To  answer  a given 
question  about  how  you  enhance  student  achievement, 
of  course,  achievement  tests  are  what  you  want.  The 
problem  is  that  the  achievement  tests  that  have  been 
used  have  been  too  limited.  They’ve  been  standardized 
measures,  group  administered,  not  much  problem  solving, 
no  higher  order  thinking  skills.  But  in  concept,  if  you 
measured  the  full  range  of  what  achievement  should  be, 
and  looked  at  teacher  behaviors  in  relationship  to  their 
success  in  getting  kids  successful  on  a much  broader-based 
measure,  that’s  what  l think  would  be  an  ideal  research 
of  that  kind.  But  if  you  had  additional  interests,  as  you 
should  have,  you’d  also  look  at  process-product  research  on 
teachers  who  are  able  to  enhance  student  self-esteem,  or 
teachers  who  are  able  to  enhance  student  participation,  or 
any  number  of  other  kinds  of  criteria  that  just  haven’t  been 
done,  but  there’s  no  reason  why  they  couldn't  be  done. 


What’s  next  for  Robert  Slavin? 

The  thing  that’s  taking  most  of  my  time  right  now,  and 
I’ve  been  working  on  with  many  other  people  as  well,  is 
a program  called  “Success  for  All.”  It  is  a program  that  is 
meant  to  try  to  make  sure  that  kids  don’t  fall  behind  in 
the  first  place,  that  they  are  successful  the  first  time 
they’re  taught,  and  then  maintain  that  success  through 
the  elementary  grades.  It  has  many  elements  and  there 
are  many  other  forms  of  it  now,  but  the  program  involves 
effective  preschool  and  kindergarten  programs,  one-to-one 
tutoring  for  kids  who  are  having  difficulty  in  first  grade, 
a radical  change  in  the  beginning  reading  program  to  try 
to  increase  the  chances  that  students  will  be  successful  the 
first  time,  family  support  programs  to  deal  with  attendance, 
health,  help  for  students  that  need  but  don’t  have  glasses, 
and  so  on.  We’re  implementing  this  program  right  now  in 
about  11  schools,  with  the  number  gradually  increasing 
over  time.  We’re  seeing  some  striking  effects  on  student 
achievement,  and  l think  that  what  we’re  going  to  be  able 
to  say  soon  is:  every  kid  can  read,  absolutely  every  single 
kid,  with  very  few  exceptions  for  organic  problems.  Just 
about  every  kid,  regardless  of  disadvantage,  regardless  of 
home  background  and  so  on,  can  he  successful  in  reading 
if  we’re  willing  to  invest  in  them  and  we’re  willing  to 
provide  the  most  effective  programs  that  we  have. 


(continued  on  /\t£e  27) 
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Abstract 

Computers  have  achieved  recognition  as  powerful  tools  in  elementary  and  secondary  curricula  due  to  their  potential  for 
improving  instruction  and  learning.  However,  if  computers  are  to  be  utilized  effectively,  it  seems  appropriate  to  address  the  attitudes 
towards  computers  among  students  preparing  to  become  teachers.  In  this  study,  data  from  1,164  preservice  teachers  from  13  Michigan 
colleges  and  universities  were  analyzed.  Log-linear  techniques  were  employed  to  investigate  sex  and  certification  (elementary,  secondary) 
differences  and  their  possible  interaction  in  attitudes  towards  computers.  The  analysis  indicated  both  sex  and  certification  differences 
in  overall  positive  attitudes  of  preservice  teachers  towards  computers.  Professionals  in  teacher  education  programs  may  benefit  from 
re-evaluating  how  they  are  training  different  groups  of  preservice  teachers  in  the  most  effective  use  of  technology.  Greater  exposure 
to  computers  might  further  increase  students’  attitudes,  which  in  turn  might  enhance  their  effectiveness  in  the  classroom. 


Introduction 

In  the  early  1970s,  as  a result  of  technological  advances 
connected  with  the  U.S.  space  project,  hand-held  calculators 
and  computers  became  widely  available  and  reasonably  inexpen- 
sive. In  1980,  the  National  Council  of  Teachers  of  Mathematics 
(NCTM,  1980)  endorsed  the  integration  of  computers  into  the 
classroom.  Today,  the  educational  community  is  still  trying  to 
determine  the  best  way  to  meet  this  recommendation. 

In  recent  years,  computer  education  has  been  given  an 
increasingly  high  priority  in  initial  teacher  training  in  western 
countries  (Summers,  1988).  For  example,  many  postsecondary 
institutions  ensure  that  new  preservice  teachers  encounter 
computer  education  in  their  freshman  year,  usually  offered  in 
the  form  of  computer  orientation  courses.  As  a result,  some 
research  studies  focused  on  the  computer  experiences  teacher- 
education  students  (preservice  teachers)  should  have  when  they 
start  their  college  coursework  (Gooler,  1989;  Koohang,  1986; 
Summers,  1988).  However,  preservice  teacher  attitudes  toward 
these  experiences,  as  well  as  toward  the  incorporation  of  com- 
puters into  the  elementary  and  secondary  curriculum,  have  not 
been  studied  in  detail.  The  literature  that  exists  suggests  rhat 
there  is  very  little  agreement  on  the  general  attitudes  towards 
computer  instruction  among  preservice  teachers  (Becker,  1982; 
Hawkins,  1984;  Price  &.  Brunson,  1986;  Summers,  1988;  Ver- 
mette,  Orr,  & Hall,  1986).  Computers  arc  being  introduced  into 
classrooms  in  increasing  numbers.  The  ultimate  decision  as  to 
whether  or  how  they  will  be  used  is  generally  left  to  the  individual 
teacher  (U.S.  Congress,  Office  of  Technology  Assessment,  W8). 
Positive  teacher  attitudes  towards  computing,  therefore,  arc 


critical  if  computers  are  to  be  effectively  integrated  into  the 
elementary  and  secondary  curriculum. 

As  schools  take  steps  to  purchase  computers,  teachers 
need  to  be  properly  prepared  and  trained  in  order  to  feel  con- 
fident and  use  computers  effectively.  Some  preservice  teachers 
tend  to  see  computers  as  complex  machines  and  do  not  antici- 
pate success  in  using  them  (U.S.  Congress,  Office  of  Technology 
Assessment,  1988).  More  than  40  percent  of  the  preservice 
teachers  who  participated  in  a study  by  Summers  (1988),  started 
their  college  experience  with  negative  and  nervous  feelings 
toward  computers.  There  is  evidence,  however,  that  teacher  per- 
ceptions of,  and  attitudes  toward,  computer  applications  can  be 
improved  with  certain  training  programs  (McDermott,  1985). 
Dickey  and  Kherlopian  (1987)  reported  that  most  teachers  believe 
that  the  amount  of  computer  experience  has  a positive  effect 
on  attitude  toward  computers.  Hawkins  (1984)  indicated  that 
negative  reactions  to  computer  experience  come  mainly  from 
females.  By  contrast,  Vermette,  Orr,  and  Hall  (1986)  did  not 
find  significant  differences  between  male  and  female  teachers 
who  responded  to  an  attitude  inventory.  These  conflicting  results 
suggest  that  sex  differences,  as  they  relate  to  attitudes  towards 
computers,  merit  further  investigation.  Additionally,  sizable 
differences  in  attitudes  toward  computers  may  exist  between 
elementary  and  secondary  teachers  (Summer,  1988).  For  example, 
Lichtman  (1979)  found  that  elementary  teachers  generally  were 
less  likely  than  secondary  teachers  to  see  computers  as  improv- 
ing education. 

If  sex  diffeienccs  in  attitudes  exist,  they  must  be  iden- 
tified and  addressed.  Sizable  differences  in  attitudes  toward 
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computers  between  elementary  and  secondary  teachers  might 
suggest  a need  for  different  teacher  training  programs  in  colleges 
and  universities  for  each  group.  The  present  study  examined  the 
attitudes  of  preservice  teachers  towards  the  use  of  computers 
in  the  classroom.  More  specifically,  based  on  evidence  in  the 
literature  (Becker,  1982;  Dickey  & Kherlopia,  1987;  Summers, 
1988),  it  was  hypothesized  that: 

1.  For  preservice  teachers,  there  is  no  statistically  significant 
interaction  between  sex  and  certification  with  respect  to  atti- 
tude towards  computers. 

2.  Male  preservice  teachers  have  a more  positive  attitude  towards 
computers  than  female  preservice  teachers. 

3.  Secondary  preservice  teachers  have  a more  positive  attitude 
towards  computers  than  elementary  preservice  teachers. 


Method 

Participants  Several  states  have  established  guidelines  for  the 
use  of  technology  (including  computers)  in  the  elementary  and 
secondary  curriculum  as  well  as  guidelines  for  teacher  preparation 
in  these  areas  (U.S.  Congress,  Office  of  Technology  Assessment, 
1988).  In  1988,  a task  force  was  established  under  the  direction 
of  the  Michigan  Department  of  Education  to  examine  alter- 
natives for  incorporating  technology  training  into  teacher  prepa- 
ration programs.  This  task  force  conducted  the  Computer  Exper- 
ience Survey  (CES)  of  1,164  students  from  13  colleges  and 
universities  in  Michigan;  1,081  preservice  teachers  provided 
usable  responses  (817  females  and  264  males).  The  average  age 
of  respondents  was  26  years  with  a standard  deviation  of  6.7  years. 
The  majority  were  seniors  (70  percent),  pursuing  a teaching  cer- 
tificate in  elementary  education  (53  percent).  Forty-four  percent 
of  the  respondents  were  secondary  education  majors,  with  the 
four  most  frequent  areas  of  specialization  being  science  (19  per- 
cent), social  science  (18  percent),  English  (17  percent),  and 
mathematics  (16  percent). 

Instrumentation  The  Computer  Experience  Survey  (CES) 
(Technology  Training  for  Michigan’s  Preservice  Teachers,  1989) 
was  designed  to  measure  preservice  teachers’  levels  of  experi- 
ence with  computers  and  their  attitudes  about  the  use  of  com- 
puters in  education.  For  the  purpose  of  this  study,  only  the 
attitude  portion  of  the  survey  was  used.  The  participants  were 
asked  to  rank  their  opinions  on  21  attitude  items  using  a scale 
of  1 to  5,  where  1 indicated  strongly  agree,  2 indicated  agree, 
3 indicated  neutral,  4 indicated  disagree,  and  5 indicated  strongly 
disagree.  To  enhance  intcrpretability,  the  scale  was  reduced  here 
to  three  mutually  exclusive  categories.  Scores  of  1 and  2 were 
combined  to  indicate  agreement  (Category'  1)  and  4 and  5 were 


combined  to  indicate  disagreement  (Category  3).  A score  of  3 
indicates  neutrality  (Category  2). 

Three  of  the  21  attitude  items  were  used  for  the  present 
analysis.  The  selection  was  based  on  the  current  belief  that 
human  functioning,  in  general,  has  a cognitive  (thinking),  emo- 
tional (feeling),  and  behavioral  (acting)  dimension  (Ellis,  1982; 
Hutchins,  1982,  1984;  Ward,  1983).  In  particular,  attitudes  are 
formed  by  interpreting  and  using  information  from  the  thinking, 
feeling,  and  acting  components  of  behavior.  Thus,  three  items 
from  the  CED  were  selected  that  each  corresponded  to  one  of 
the  attitude  dimensions.  “Computer  use  enhances  student  learning” 
(LEARN)  was  selected  as  an  item  from  the  cognitive  domain; 
“Computers  make  me  uneasy”  (UNEASY)  was  used  to  represent 
the  feeling  domain;  “I  intend  to  use  computers  in  my  teaching ’’ 
(USE)  was  used  to  represent  the  acting  domain  of  respondents’ 
general  attitude  rowaid  computers.  Although  justified  by  theory, 
the  selection  of  only  these  survey  items  might  have  biased  the 
outcomes.  That  is,  results  might  change  if  different  items  were 
used  for  the  analysis.  This  should  be  kept  in  mind  when  eval- 
uating the  results  and  implications. 

Statistical  Analysis  Due  to  the  categorical/ordinal  nature  of 
the  variables  (sex,  certification,  attitudes),  a logit  analysis  was 
conducted.  For  a detailed  introduction,  consult  Hagenaars  (1990) 
or  Kennedy  (1983).  Briefly,  a logit  analysis  consists  of  tw'o  main 
model  selection  steps.  First,  residual  maximum-likelihood-ratio 
chi-squares  (L2’s)  are  examined.  Residuals  are  defined  as  differ- 
ences between  respective  observed  and  expected  frequencies. 
Starting  with  the  saturated  model,  models  are  hierarchically 
examined  until  a significant  L2  is  found.  Since  a model  with  a 
significant  residual  L2  does  not  fit  the  data  well,  this  model, 
and  in  general,  all  more  restricted  models,  are  eliminated  from 
further  consideration. 

During  the  second  step  of  model  selection,  the  component 
L2  s are  examined.  Component  Lrs  are  differences  between  pairs 
of  residual  L2’s.  The  component  L2‘s  provide  the  means  to  deter- 
mine which  specie  effects  (or  groups  of  effects)  are  contributing 
to  the  improvement  of  the  fit  between  the  observed  and  expected 
frequencies.  The  model  associated  with  the  first  significant  com- 
ponent L2  is  a candidate  for  selection  and  all  less  parsimonious 
models  generally  can  be  ignored.  Results  from  these  two  steps 
usually  indicate  the  single  model  that  best  fits  the  data. 


Results 

Table  1 shows  the  cross-classification  of  the  participating 
service  teachers  across  the  two  explanatory  variables  (SEX  and 
CERTIFICATION)  and  the  attitude  variables  (USE,  UNEASY, 
and  LEARN). 


Preservice  Teacher  Attitudes  ( continued ) 


Table  1 


Contingenc}  table  fin  the  attitude  variables  USE,  LEARN*  and 
UNEASY  vs.  sex  for  elementary  and  secondary  preservice  teachers. 


MALE 

FEMALE 

TOTAL 

ELEMENTARY 

AGREE 

45 

451 

496 

(44) 

(437) 

(481) 

HU 

[97] 

[108] 

NEUTRAL  

9 

78 

87 

(9) 

(82) 

(91) 

HU 

[118] 

[1291 

DISAGREE 

1 

4 

87 

(2) 

[15] 

(171 

[331 

[317] 

(350) 

TOTAL 

55 

533 

588 

(55) 

(534) 

(589) 

1551 

[532j 

1587] 

SECONDARY 

AGREE  

151 

217 

368 

(144) 

(212) 

(356) 

[34] 

[44] 

178) 

NEUTRAL  

45 

54 

99 

(57) 

(64) 

(121) 

[431 

[45] 

[88] 

DISAGREE 

13 

13 

26 

(57) 

(64) 

(121) 

11321 

[194] 

[326] 

TOTAL 

209 

284 

493 

(209) 

(283) 

(492) 

1209] 

[2831 

[492| 

Note.  The  values  represent  the  number  of  subjects  in  each  cell.  Top  number 
refers  to  variable  USE;  frequencies  in  ( ) refer  to  variable  LEARN;  frequencies 
in  (1  refer  to  variable  UNEASY. 


The  LOGLINEAR  procedure  of  SPSS-X  (SPSS-X  User’s  guide, 
1988)  was  used  for  the  model  selection.  For  each  attitude  vari- 
able, an  analysis  was  conducted  using  the  logit  technique  sug- 
gested by  Kennedy  (1983).  The  results  of  these  analyses  are  dis- 
played in  Table  2.  Note  that  the  procedures  followed  below  were 
previously  outlined  in  the  methods  section.  For  more  detailed 
information  regarding  model  selection  in  logit  analyses,  consult 
Kennedy  (1983). 

For  the  attitude  variable  USE,  the  null  and  sex  models 
were  eliminated  due  to  significant  residual  L1  values  (p=.000 
and  P = .001,  respectively).  No  sex  x certification)  interaction 
was  fuund  as  indicated  by  a non-significant  component  U 
(p- .9010).  Finally,  the  certification  model  was  associated  with 
the  first  significant  component  chi-square  (L2=  18.95;  p =.001) 
implying  significant  main  effects  for  the  certification  variable. 


Table  2 

The  effects  of  sex  and  certification  on  variables 
USE,  LEARN*  and  UNEASY. 


RESIDUAL 

COMPONENT 

MODEL  . . . 

L J 

df 

p 

Ll 

df 

P 

Null 

28.96 

6 

.000 

134.54 

l 

.0000 

(16.94) 

(6) 

(.010) 

(165.44) 

(1) 

(.0000) 

[7.35] 

[6] 

[.290] 

1164.711 

[11 

(.00001 

Sex 

19.16 

4 

.001 

9.8 

2 

.0073 

(9.50) 

(4) 

(.050) 

(7.44) 

(2) 

(.0242) 

17.32) 

14] 

[-120] 

1-031 

12) 

[.9851] 

Certification 

.21 

2 

.901 

18.95 

2 

.0001 

given  Sex  . . 

(-23) 

(2) 

(.892) 

(9.27) 

(2) 

(.0097) 

[1.12] 

[2] 

1.572) 

(6.2) 

[2] 

1.0451] 

Saturated 

.00 

0 

1.00 

.21 

2 

.9010 

(-00) 

(0) 

(LOO) 

(.21) 

(2) 

(.8920) 

[-00] 

[01 

[1.000] 

[1.121 

12) 

1.5718) 

Note.  Top  value  refers  to  variable  USE;  value  in  ( ) refer  to  variable 
LEARN;  value  in  []  refer  to  variable  UNEASY. 


Note  that  this  model  selection  process  provided  no  information 
regarding  concurrent  sex  effects.  However,  a significant  com- 
ponent chi-square  associated  with  sex  (L2=9.8;  p=.0073)  sug- 
gested that  differences  between  male  and  female  preservice 
teachers  exist  regarding  their  intentions  to  use  computers  in 
the  classroom. 

A similar  analysis  of  the  attitude  variable  LEARN  was 
used  to  eliminate  all  except  the  certification  model,  implying 
main  certification  effects.  Also,  the  component  chi-square  for 
sex  (L2= 7 .44;  p = .0242)  indicated  significant  sex  differences  in 
preservice  teacher  opinions  regarding  the  question  of  whether 
computer  use  enhances  learning.  For  the  variable  UNEASY, 
however,  the  selection  process  lead  to  three  (null,  sex,  and 
certification),  rather  than  a single  well-fitting  model.  The  sex 
model  was  eliminated  due  to  a non-significant  component  L2 
(p=.9851).  A significant  difference  in  chi-square  test  (Kennedy, 
1983,  p.  134)  between  the  remaining  two  models  (Ll{Nuik>mf.cai.«) 
= 7.35-  1.12=6.23;  p = .0451)  lead  to  the  selection  of  the  cer- 
tification model. 


Discussion 

The  purpose  of  this  study  was  to  examine  the  attitudes 
of  male  and  female  preservice  elementary'  and  secondary  teachers 
towards  computers.  Based  on  the  studies  by  Becker  (1982), 
Dickey  and  Kherlopia  (1987),  and  Summers  (1988),  it  was  hypo- 
thesized that  there  was  no  sex  x certification)  interaction  and  that 
males  and  secondary  preservice  teachers  had  a more  positive 

(amtinurd  on  page  26) 
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Presewice  Teacher  Attitudes  (continued) 

attitude  towards  computers  than  females  and  elementary'  teachers. 
The  results  of  the  study,  however,  might  warrant  some  different 
conclusions.  First,  it  is  encouraging  to  note  the  overall  positive 
attitude  of  preservice  teachers  towards  computers  in  the  class- 
room. Tremendous  technological  advances  in  hardware  and 
software  development  over  the  past  two  decades  have  clearly 
increased  the  use  of  computers  in  educational  settings.  Results 
indicate  that  previously  observed  attitude  discrepancies  across 
sex  and  certification  levels  seem  to  have  diminished,  even  though 
some  statistically  significant  differences  can  still  be  found.  It 
should  be  noted  that  statistically  significant  results  might  be  due, 
in  part,  to  a relatively  large  sample  size  which  increased  the 
statistical  power  of  the  logit  analysis. 

Specifically,  no  sex  differences  were  found  with  respect  to 
the  attitude  variable  UNEASY— a result  consistent  with  Vermette, 
Orr,  and  Hall  (1986)— while  statistically  significant  differences 
were  observed  in  the  other  two  variables  (USE  and  LEARN). 
Female  teachers  had  slightly  more  positive  attitudes  than  their 
male  counterparts  with  regard  to  the  use  of  computers  in  the 
classroom  and  the  computer’s  impact  on  learning.  For  example, 
79.4  percent  of  the  female  participants— vs.  71.2  percent  of  the 
male  students— agreed  that  computer  use  enhances  student 
learning.  These  results  somewhat  contradict  findings  by  Becker 
(1982)  and  Hawkins  (1984),  who  concluded  that  males  had  more 
positive  attitudes  toward  computers  than  females. 

Students  of  elementary’  education  showed  more  positive 
attitudes  on  the  variables  USE  and  LEARN  than  their  peers  in 
secondary  education,  seemingly  contradictory  results  by  Lichtman 
(1979).  Specifically,  84.4  percent  of  the  elementary  preservice 
teachers— vs.  74.6  percent  of  the  secondary  teachers— intended 
to  use  computers  in  their  teaching.  However,  the  effect  of  certifi- 
cation was  reversed  for  the  variable  UNEASY,  that  is,  66.3  per- 
cent of  the  secondary,  and  59.6  percent  of  the  elementary  students 
disagreed  that  computers  made  them  feel  uneasy. 

Inconsistencies  w-ith  previous  investigations  could  be 
due  to  several  factors: 

1.  In  this  study,  a different  instrument  was  used  to  measure 
attitude.  In  our  opinion,  attitude  may  not  be  uni-dimensional 
but  may  be  composed  of  several  factors,  and  different  instru- 
ments may  be  measuring  different  components  of  attitude. 
The  present  study  attempted  to  isolate  three  components  of 
human  functioning  (thinking,  feeling,  acting;  Hutchins, 
1984)  that  are  likely  to  affect  a person’s  attitude.  It  is  quite 
possible  that  different  results  would  have  been  obtained  if 
different  items  were  used  to  represent  the  three  dimensions 
of  human  behavior/attitude. 

2.  The  rapid  growth  of  the  implementation  of  technology  into 
education— and  into  society  in  general— might  have  affected 
present  attitudes  of  preservice  teachers.  Computers  are  more 
readily  available  and  they  are  generally  easier  to  use.  With 
change  occurring  so  rapidly,  it  seems  reasonable  to  expect 


positive  attitude  changes  within  only  a few  years,  as  suggested 
by  the  results  of  this  study.  The  positive  change  in  attitudes  of 
females  may  also  be  due,  in  part,  to  the  effects  of  such  organi- 
zations as  the  National  Council  of  Teachers  of  Mathematics 
(NCTM)  which  has  made  a concentrated  effort  to  especially 
encourage  females  to  pursue  mathematics/computer-related 
careers  (NCTM,  1980). 

3.  Presently  strong  positive  attitudes  of  elementary  education 
students  toward  computers  might  be  due  to  their  "generalist” 
orientation,  while  specializations  in  areas  such  as  history  or 
social  studies  might  have  contributed  to  the  somewhat  less 
positive  attitudes  of  secondary  education  students. 

Results  of  this  study  could  have  several  implications  for 
both,  preservice  teachers  and  college  of  education  administrators 
and  faculty.  First,  possible  sex  and  certification  differences  in 
attitudes  towards  computers  illustrate  potential  problems  in  the 
implementation  of  computer  training  programs  for  preservice 
teachers.  Teacher  preparation  institutions  might  consider  develop- 
ing comprehensive  preservice  programs  to  meet  the  unique  needs 
of  women  and  men,  as  well  as  elementary  and  secondary  educa- 
tion students.  Second,  teachers’  attitudes  toward  computers 
could  be  related  to  their  effectiveness  in  the  classreom.  Research 
suggests  that  incresed  familiarity  with  computers  tends  to  re- 
duce general  computer  anxiety  (Koohang,  1986).  Thus,  uni- 
versity curriculum  changes  reflecting  more  computer  exposure 
might  relieve  students’  anxiety,  which  in  turn  could  improve 
teacher  effectiveness. 

General  teacher  attitude  plays  an  important  role  in  the 
educational  process.  Specifically,  attitudes  toward  the  use  of 
computers  need  to  be  evaluated  to  successfully  implement  tech- 
nological advancements  into  the  classroom  (Stevens,  1982).  In 
1989,  Michigan’s  Preservice  Technology  Task  Force  addressed, 
in  part,  the  needed  evaluation  of  preservice  teachers.  Results 
of  the  present  study  confirm  their  conclusions.  Preparations  that 
future  teachers  receive  in  colleges  and  universities  will  m om 
likely  affect  whether  or  not  they  will  actually  use  computers 
in  their  classrooms.  Therefore,  teacher  preparation  institutions 
should  encourage  their  students  to  acquire  and  update  necessary 
skills  to  implement  new  technology  into  their  classrooms. 


An  earlier  version  of  this  paper  was  presented  at  the  1990 
meeting  of  the  Mid-Westem  Educational  Research  Association. 
The  authors  acknowledge  the  support  of  Carl  Berger,  Director, 
and  Dianne  Novak,  Associate  Director,  of  the  Preservice 
Technology  Project,  The  University’  of  Michigan,  for  permission 
to  use  the  data. 
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An  Interview  with  Slavin  (t  ntinued  from  page  22) 


Is  there  support  for  programs  such  as  this,  not  only 
among  educators,  but  financial  support  as  well? 


I think  so.  Right  now  there’s  a lot  of  willingness  to  con- 
sider expensive  things  if  you’re  sure  theyTl  work.  If  you’re 
really  sure  that  theyTl  make  a difference.  People  are  invest- 
ing millions  in  things  like  Writing  to  Read,  in  preschool 
programs,  and  extended  day  kindergarten  programs,  and 
in  other  programs  which  are  very  expensive.  Of  course 
the  long-term  savings  are  obvious:  reduced  special  educa- 
tion, reduced  retentions,  and  reduced  need  for  continued 


remedial  services.  But  even  those  kinds  of  things  aside, 
I *hink  that  there’s  getting  to  be  a fair  acceptance  among  legis- 
lators, the  general  populace,  as  well  as  educators  that  if  we  could 
find  things  that  really  would  prevent  learning  problems  from 
developing,  then  that’s  a legitimate  investment.  Even  if  the 
investment  may  be  large.  I may  be  wrong  about  that,  but  l think 
it’s  worth  exploring  to  outline  the  dimensions  of  what  life  could 
be  like  or  what  the  school  system  could  be  like  if  we  did  take 
the  achievement,  the  success  of  every  kid,  as  being  an  entitlement, 
something  that  the  school  can  guarantee. 


Voices  in  Education 


The  MidWestem  Educational  Researcher  asked  leaders  in 
education  to  respond  to  the  question: 

What  major  mistake(s)  do  you  believe  have  been  made 
that  have  brought  us  to  our  present  condition  in  education? 

They  are  too  numerous  to  mention.  Among  the  most 
obvious  and  common  are  (1)  the  politicizing  of  American  educa- 
tion (whereby  adhering  to  political  criteria  and  standards  is  more 
important  that  adhering  to  educational  criteria  and  standards, 
and  taking  credit  for  programs  becomes  more  important  than 
developing  credible  programs),  (2)  the  victory  of  opinion  over 
evidence  (with  researchers  divided  into  their  little  “camps” 
being  their  own  worst  enemies— one  is  reminded  of  A1  Capps 
Pogo),  and  (3)  the  failure  to  learn  from  our  mistakes  (in  regard  to 
Silberman’s  Crisis  in  the  Classroom  is  as  appropriate  today  as 
it  was  in  1970  or  1971). 

— Larin  Anderson,  University  of  South  Carolina 

School  curriculum  is  boring  for  adolescents. 

—David  Berliner,  Arizona  State  University 

(1)  Insufficient  support  for,  and  promotion  of,  teacher  profession- 
alism, innovation,  and  collegiality,  (2)  Insufficient  support  for 
tryulg  out  new  ideas  in  the  classroom.  (3)  Too  great  a focus  on 
accountability  for  performance  on  standardized  tests. 

—Hilda  Borko,  University  of  Maryland 

Centralization,  specialization,  and  self-inflicted  problems 
of  scale,  coupled  with  an  undue  emphasis  on  efficiency  and 
product  ion -system  thinking. 

— Christopher  Clark,  Michigan  State  University 

Continuing  the  status  quo  without  critical  examination 
of  its  strengths  and  weaknesses. 

— Lyn  Como,  Teachers  College  Columbia 

(1)  Lack  of  serious  attention  to  the  plight  of  the  inner 
city  poor.  (2)  An  over-emphasis  on  standardized  achievement 
test  scores  (and  later,  economic  achievement),  so  school  con- 
texts tend  to  be  too  pressuring  and  not  personally  supportive. 

—Edward  Deci,  University  of  Rochester 

Too  many  short-term  panaceas  have  been  proposed  by 
both  educational  technicians  and  political  policymakers.  The 


field  as  a whole  has  not  helped  the  public  understand  what  is 
required  to  create  a genuinely  educational  program  in  our  schools. 

—Elliot  Eisner,  Stanford  University 

Education  has  not  been  seen  as  a professional  field  based 
on  a dynamic  and  ever-expanding  knowledge  base.  Rather,  it  has 
been  seen  as  an  institution  where  practice  is  based  on  artistic 
interpretation  and  tradition. 

—Thomas  Guskey,  University  of  Kentucky 

A preoccupation  with  instructional  process,  rather  than 
the  consequences  of  instruction.  _james  popham:  UCLA 

Overly  aggressive  secularization  of  schools  and  lack  of 
defining  a strong  civic  morality.  _Kevin  Ryan>  Bos[on  University 

We  have  neglected  to  keep  pace  with  the  changing  re- 
quirements of  our  society  and  the  requirements  of  our  burgeoning 
immigrant  population.  Colleges  of  Education  and  school  districts 
seem  to  have  built-in  obsolescence.  We  lack  a plan  to  readily 
change  our  programs  and  to  assess  current  needs.  Technologically 
we  fall  far  behind  industry.  _Jan£  Swlilng5>  Tam  ^ diversity 

Trying  to  reform  schools  from  the  top  down,  rather  than 
working  with  teachers  and  parents  from  the  bottom  up. 

—Ralph  Tyler ; Center  for  Advanced 
Study  in  Behavioral  Sciences 

Short  school  year,  lack  of  national  goals,  poor  instruc- 
tion, lack  of  cooperation  of  home  and  school,  and  little  incen- 
tive to  improve.  —Herbert  Walberg , University  of  Illinois  at  Chicago 

These  problems  are  linked  with  many  other  inequities  in 
our  society  in  access  to  decent  housing,  health  care,  jobs,  etc. 
One  thing  that  has  definitely  contributed  to  the  present  crisis 
of  inequality  in  our  schools  is  the  almost  total  neglect  of  pre- 
paring teachers  to  teach  urban  and  rural  poor  children  by  our 
teacher  education  institutions. 

— Kenneth  Z eichner,  University  of  Wisconsin 

If  you  have  an  interesting  question  or  an  educational 
leader  that  you  would  like  to  bring  to  our  attention,  please  con- 
tact: Gregory  J.  Marchant,  Educational  Psychology,  Teachers 
College,  Ball  State  University,  Muncie,  IN  47306. 
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Notice  to  MWERA  Members  Attending  AERA  in  April 


The  AERA  is  meeting  in  Chicago  this  year  from  April  3-7,  1991.  The  Mid- 
Western  Educational  Research  Association  is  sponsoring  a discussion  lead 
by  Dr.  Carl  Huberty  from  the  University  of  Georgia.  The  discussion  will  focus 
on  The  Major  Issues  in  Educational  Research  in  the  1990s,  Wednesday,  April 
3,  in  the  Lincoln  Room  of  the  Bismarck  Hotel  starting  at  6 p.m.  until  7:30 
p.m.,  followed  by  a Cash  Bar  in  the  Maximilian  Room  from  7:30  to  9 p.m. 

Dr.  Carl  Huberty 


CALL  FOR  AWARDS 

The  Awards  Committee  of  MWERA  invites  nominations  of  recent  doctoral  dissertations  for  the  Mid- 
Western  Educational  Research  Association  and  Wisconsin  Educational  Research  Association  Outstanding 
Dissertation  Awards.  Eligibility  is  determined  by  a successful  defense  of  the  dissertation  during  the 
calendar  year,  1990.  Awards  will  be  made  to  those  dissertations  that  reflect  exceptional  qualities  of 
conception,  method,  presentation  and  ip-'ortance. 

The  winner  will  receive:  (1)  One-year  membership  to  MWERA;  (2)  a free  registration  to  the  annual  meeting; 
(3)  a publication  of  their  work  in  the  Mid-Western  Educational  Researcher. 

Three  copies  of  a letter  of  support  from  a doctoral  committee  member  should  accompany  the  nomi- 
nation as  well  as  three  copies  of  a summary  of  the  dissertation,  not  exceeding  15  pages  in  length.  A 
blind  review  process  will  be  used  to  screen  the  dissertation  summaries. 

Nomination  deadline:  May  15, 1991*  Send  nominations  and  materials  to:  Dr.  Dennis  W.  Leitner,  Depart- 
ment of  Educational  Psychology,  Wham  Building,  Southern  Illinois  University,  Carbondale,  1L  62901. 


The  Association  Council  and  all  of  the  membersnip  of  the  Mid-Western  Educational  Research  A ssodation 
wish  to  express  their  condolences  to  President-Elect  Barbara  P lake 
for  the  loss  of  her  husband  Donald. 

Contributions  in  memory  of  Donald  Plake  can  be  inode  to: 

Lincoln  Childrens  Museum,  1200  North  Street,  The  Atrium,  Lincoln,  Nebraska  68508. 
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We  hope  you  have  enjoyed  the  first  three  issues  of  the  Mid-Western  Educational  Researcher.  This 
current  issue  is  an  example  of  our  efforts  to  meet  the  diverse  needs  of  our  membership.  In  addition  to 
articles  that  represent  different  topics  and  methodologies,  two  new  sections  have  been  added  to  this 
issue.  “Both  Sides  Now”  presents  two  opposing  views  on  parent  choice.  “MWERA  Communication 
and  Update”  reports  the  most  recent  election  results  and  describes  MWERA’s  activities  at  this  year’s 
AERA  meeting.  Inside  the  back  cover  is  a form  requesting  the  research  activities  of  our  membership. 
This  information  will  be  printed  in  the  Winter  1992  issue  in  hopes  of  facilitating  communication  and 
collaboration  among  the  membership. 

We  wish  to  express  our  gratitude  to  all  of  the  members  who  have  submitted  manuscripts.  We 
encourage  you  to  think  of  the  M id-Westem  Educational  Researcher  whenever  you  have  a manuscript  for 
publication.  We  also  hope  that  you  will  send  us  feedback  concerning  articles  and  features  that  you  have 
read.  If  you  have  any  news  of  interest  to  the  membership,  please  send  it  our  way.  See  you  in  October. 


ON  THE  COVER 

The  University  of  Toledo . Originating  in  1872  with  a gift  of  160  acres  of  land  donated  by  prominent  Toledo  citizen, 
Jesup  W.  Scott,  the  University  of  Toledo  is  in  its  1 18th  year  of  continuous  service  to  higher  education.  The  university  is 
a member  of  the  National  Association  of  State  Universities  and  Land  Grant  Colleges,  and  it  is  the  fastest  growing  insti- 
tution of  higher  education  in  the  state  of  Ohio.  It  consists  of  seven  colleges  that  award  undergraduate  degrees,  as  well  as 
a graduate  school  and  a college  of  law  that  offer  advanced  degrees.  The  College  of  Education  and  Allied  Professions, 
with  a current  enrollment  of  4,464  undergraduate  and  graduate  students,  confers  baccalaureate,  master’s,  specialists, -and 
doctoral  degrees.  The  college  is  fully  accredited  by  NCATE  and  the  North  Central  Association  of  Colleges  and  Secondary 
Schools  as  well  as  many  discipline -centered  accreditarion  boards  and  bodies.  It  has  112  full-time  faculty  members  in  seven 
academic  departments.  The  college  mission  stresses  an  urban/suburban  multicultural  focus  with  an  emphasis  of  teaching 
that  is  well  grounded  in  research. 


Information  for  Contributors  to  the  Mid-Western  Educational  Researcher 

The  Mid-Western  Educational  Researcher  accepts  research-based  manuscripts  that  would  appeal  to  a 
wide  range  of  readers.  All  materials  submitted  for  publication  must  conform  to  the  language,  style,  and  format  of  the 
Publication  Manual  of  the  American  Psychological  Association,  3rd  cd.,  1983  (available  from  Order  Department. 
American  Psychological  Association,  P.O.  Box  2710,  Hyattsville,  MD  20784). 

Three  copies  of  the  manuscript  should  be  submitted  typed  double  space  (including  quotations  and  references)  on 
8V2xll  paper.  Only  words  to  be  italicized  should  be  underlined.  Abbreviations  and  acronyms  should  be  spelled  out  for 
the  first  mention.  Pages  should  be  numbered  consecutively,  beginning  with  the  page  after  the  title  page. 
Manuscripts  should  be  less  than  20  pages  long.  An  abstract  of  less  than  100  words  should  accompany  the  manuscript. 

The  manuscript  will  receive  blind  review  from  at  least  two  professionals  with  expertise  in  the  area  of  the  manuscript. 
The  author’s  name,  affiliation,  etc.,  should  appear  on  the  title  page  only.  Efforts  will  be  made  to  keep  the  review  process 
to  less  than  two  months.  The  editors  reserve  the  right  to  make  minor  editorial  changes  in  order  to  facilitate  a 
concise  clear  article.  The  author  will  be  consulted  if  any  major  changes  arc  necessary. 

Manuscripts  should  be  sent  with  a cover  letter  to: 

Gregory  J.  Marchant  Isadora  Newman 

Educational  Psychology  Office  of  Educational  Research 

Teachers  College  or  College  of  Education 

Ball  State  University'  The  University  of  Akron 

Muncie,  IN  47306-0595  Akron,  OH  44325-4205 
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Nonexamples:  Why  Teachers  Don’t  Use  Them 
and  Why  Teacher  Educators  Should 

By  Thomas  J.  Lasley,  Sandra  J.  Williams,  and  Patricia  M.  Hart 
University  of  Dayton 


Abstract 

Student  teaching  continues  to  he  one  of  the  most  vital  aspects  of  the  preservice  experience  for  prospective  teachers.  In  this 
study  the  authors  investigate  how  preservice  teachers  use  a specific  skill  they  learned  during  a social  studies  methods  course.  The  skill, 
concept  teaching,  was  taught  to  students  using  conventional  teacher  education  practices,  lecture  and  a limited  amount  of  teacher 
modeling.  Findings  suggest  a need  for  more  intense  modeling  and  practice  regimens  that  ensure  student  acquisition  of  requisite 
teaching  skills. 


The  teaching  of  concepts  is  at  the  heart  of  an  effective 
social  studies  curriculum.  Concepts  are  building  blocks  for  the 
generalizations  and  theories  that  enable  students  to  organize 
and  understand  the  social,  historical,  and  political  events  around 
them.  “Without  concepts,”  notes  McKinney  (1985),  “the  world 
would  become  greatly  confused  and  communication  would  be- 
come  extremely  difficult . . . concepts  help  us  organize  reality 
and  communicate  effectively  with  one  another”  (p.  66). 

Teachers  present  hundred0  of  concepts  to  students  during 
a school  year.  But  the  degree  to  which  students  acquire  under- 
standing of  those  concepts  is  dependent  on  factors  such  as:  the 
amount  of  time  teachers  devote  to  teaching  the  respective  con- 
cepts; the  clarity  with  which  ideas  are  defined  and  explained; 
the  relationship  of  new  concepts  to  old  ones;  and,  finally,  the 
capacity  of  teachers  to  use  examples  and  nonexamples  as  part 
of  the  exposition  phase  of  concept  development  lessons.  The 
use  of  examples  and  nonexamples  will  be  the  focus  of  this  paper. 

Research  by  Merrill  and  Tennyson  (1977, 1978),  Tennyson 
(1973),  and  McKinney  (1985)  suggests  that  student  acquisition 
of  concepts  can  be  enhanced  if  teachers,  using  matched  examples 
and  nonexamples,  explain  why  each  cited  instance  is  (example) 
or  is  not  (nonexample)  an  exemplar  of  the  concept  being  taught. 
As  an  illustration,  when  teaching  the  concept  of  natural  resources 
the  teacher  may  cite  the  example  “forest”  and  then  provide  a 
matched  nonexample,  “paper.”  Through  the  use  of  both  examples 
and  nonexamples,  prospective  teachers  develop  in  students  a 
more  thorough  understanding  of  the  critical  attributes  of  a con- 
cept and  are  better  able  to  help  students  discern  what  constitutes 
a form  of  the  concept.  Nonexamples,  in  particular,  extend  the 
students’  understanding  of  concepts  and  force  them  to  look  at 
each  “case”  in  terms  of  whether  it  does  or  does  not  possess  the 
necessary  critical  attributes. 

Because  prospective  teachers  have  so  much  more  exper- 
ience with  the  use  of  examples,  through  their  schooling  and 
training,  the  researchers  decided  for  purposes  of  this  study  to 
focus  on  how  (and  whether)  preservice  teachers  use  nonexamples 
in  their  teaching  of  concepts  during  student  teaching.  Partici- 


pants in  the  study  demonstrated  during  a social  studies  methods 
class  an  understanding  of  the  Tennyson  model  and  other  con- 
cept teaching  approaches  that  emphasize  the  use  of  nonexamples. 
The  authors  were  interested  in  the  transfer  of  this  knowledge 
about  the  use  of  nonexamples  into  the  lessons  taught  during 
the  student  teaching  experience. 

The  Study 

The  study  consisted  of  observing  three  student  teachers 
during  a series  of  18  social  studies  (and  science)  lessons  and  then 
interviewing  them  regarding  the  structure  and  content  of  those 
lessons.  The  student  teachers  were  selected  primarily  on  the 
basis  of  their  differential  performance  in  a social  studies  methods 
course,  a course  in  which  concept  teaching  is  discussed  in  detail. 
That  is,  the  students  were  classified  as  having  potential  for  strong 
performance  (ST-A),  average  performance  (ST-B),  and  weak  per- 
formance (ST-C).  Each  student  was  then  observed  teaching  several 
different  lessons  and  subsequently  interviewed  regarding  the  struc- 
ture and  content  of  the  lessons.  The  observer  was  not  aware  of 
the  perceived  potential  for  success  of  each  student  teacher. 

The  intent  of  the  researchers  in  this  pilot  study  was, 
simply,  to  collect  data  that  might  prove  useful  in  revising  a social 
studies  methods  course  with  regard  to  concept  teaching.  The 
researchers  observed  and  recorded  the  manner  in  which  the  “pur- 
poseful” sample  of  student  teachers  introduced  and  explained 
concepts  (such  as  bartering,  transportation,  and  culture)  in  teach- 
ing social  studies  lessons. 

The  findings  are'presented  below  and  fall  into  three  cate- 
gories. The  categories  are  intentionally  broad  and  are  inclusive 
of  the  explanations  given  by  the  student  teachers  and/or  collected 
as  part  of  the  observations  of  the  researchers.  Tne  categories 
were  inductively  formed  following  an  analysis  of  the  available 
qualitative  data. 

Finding  1:  The  preservice  teachers  relied  almost  exclusively 
on  examples  to  explain  concepts. 


2 


Mhi-W'fstrm  EtWnriinuif  Roseau  tai 


VUume  4,  Number  ^ • Summer  I1*?  I 


Nonexamples  (continued) 


The  preservice  teachers  viewed  it  as  counterproductive 
to  present  nonexamples  of  a concept  to  students.  Indeed,  18 
different  concept  lessons  were  observed  for  the  student  teachers 
and  not  a single  nonexample  was  used  by  the  participants  as  a 
means  of  explaining  to  students  an  idea  or  clarifying  a concept. 
The  explanations  for  this  behavior  varied.  One  student  teachers 
responded  that  she  disliked  the  use  of  nonexamples  because  of 
the  implied  negativism. 

I think  l might  have  tried  to  see  how  it  would  have 
gone  over.  It  was  one  method  that  l didn’t  like  because 
it  had  a negative  aspect  toward  it.  (STC) 

Another  student  claimed  that  the  use  of  nonexamples 
was  too  discrepant  from  what  she  (STA)  had  experienced  during 
her  own  schooling  experiences.  Her  teachers  had  always  relied 
on  examples  To  explain  concepts  and,  hence,  she  could  see  no 
reason  to  justify  the  use  of  nonexamples  as  part  of  a lesson. 

The  only  time  that  l had  heard  [using  nonexamples]  or 
had  experience  with  that  was  in  [the  university  social 
studies]  class.  I don't  know  if  it  was  just  that  having 
been  exposed  to  just  giving  examples  that  I never  really 
touched  on  giving  negative  examples. 

The  third  student  teacher  asserted  that  the  use  of  non- 
examples  might  confuse  students.  She  (STB)  was  not  certain 
that  elementary  age  students  had  the  cognitive  skills  to  cope 
with  the  (apparent)  complexities  of  using  nonexamples  to  explain 
a concept. 

Finding  2:  The  preserv  ice  teachers  relied  on  instructional  mater- 
ials that  emphasize  the  use  of  examples  in  explaining  concepts* 

Preservice  teachers  have  limited  exposure  to  the  use  of 
nonexamples.  Textbooks  used  by  university-level  instructors 
devote  a great  deal  of  space  to  concept  instruction,  but  give 
little  space  to  how  and  why  prospective  teachers  should  use 
nonexamples  in  the  context  of  a lesson.  Michaelis,  for  example, 
m Sociui  Studies  /or  Children  (8th  edition)  commits  fewer  than 
two  pages  of  copy  to  the  use  of  nonexamples  as  <i  technique 
for  concept  development. 

Oilier  prominent  methods  texts  implicitly  question  the 
use  of  negative  examples.  Banks,  m Tuic/inig  Strategics  jm  die 
Social  Studies  (2nd  edition),  asserts-  ’‘Although  it  is  true  ih.it 
some  learning  does  occur  with  negative  examples,  learners  are 
forced  to  spend  an  inordinate  amount  of  time,  inefficiently 
scale  lung  tor  the  appiopriate clues  leading  them  to  the  discrimi- 
nating characteristic"  (p.  86).  Banks  does  call  for  a “balancing" 
of  examples  and  nonexamples  based  on  the  instructional  needs 
of  students,  hm  he*  death  emphasizes  that  "concepts  are  most 
efficiently  learned  when  a number  ot  positive  example' arc  first 
introduced  and  rlu*  discnmmat mg  dru.ic teiist u cle.irh  estab 
lulled"  (p.  86) 


Other  texts,  such  as  Social  Studies  and  die  Elementary 
School  Child  (4th  edition)  by  Maxim,  cite  a model  using  non- 
examples,  hut  no  explanation  of  the  value  of  this  skill.  Welton 
and  Malian  (3rd  edition)  in  their  Children  and  Their  WorLl  encour- 
age college  students  to  use  “numerous  concrete  examples”  (p.  03) 
to  teach  complex  concepts,  making  no  mention  of  the  poten- 
tial of  nonexamples. 

The  bias  of  methods  text,  whether  implicit  or  explicit, 
is  manifest  in  favor  of  using  examples  and  excluding  the  use  of 
nonexamples  to  define  a concept.  The  prospective  teachers  in 
this  study  experienced  reliance  in  the  resource  materials  on 
examples  and.  as  a consequence,  expressed  reservations  about 
trying  other  techniques.  STA  commented: 

The  textbooks  that  1 had  dining  [college)  . . .never 
really  explained  how  to  use  the  Inone.xamp!e|  method. 

The  teachers'  manuals  in  schools  also  are  geared  toward  the  use 
of  examples.  The  textbook  series  used  by  the  student  teachers. 
The  United  States:  People  and  Leaders  (Modern  Curriculum  Press, 
1984),  in  their  classroom  assignments  relied  almost  exclusively 
on  concept  development  activities  that  would  best  be  described 
as  “labeling”  activities  (e.g.,  demonstrating,  using  analogies,  or 
stating  operations)  or  “prohle  vt  solving  and  inquiring”  strategies 
(i.e.,  state  a problem,  pose  quest  ions,  process  relevant  information, 
state  a conclusion). 

Two  student  teachers  noted  the  absence  of  nonexamples 
m the  teacher’s  manual”: 

They  (the  manuals]  told  you  what  kinds  of  examples  to 
give.  1 think  that  plays  a part  even  though  I tend  not  to 
rely  oh  the  manuals  a whole  lot  hut  I did  notice  that  the 
manuals  don’t  use  that  (nonexample  technique].  (STA) 

The  fact  that  you  would  follow  the  teacher’s 
manual  along  and  they  would  give  you  ideas  on  how 
to  pur  concepts  across  and  they  just  omit  mentioning 
[nonexamplesj  and  you  would  omit  it  when  you  were 
planning.  (STB) 

Finding  3:  The  preservice  teachers  relied  primarily  on  previous 
experience  to  determine  how  to  teach  concepts. 

The  extent  of  professional  preparation  experiences  on 
prospective  teachers  is  still  unknown.  Clearly,  m .in  aggregate 
sense  teacher  education  and  staff  development  efforts  can  and 
do  alter  the  dispositions  of  teachers  (see  Lvert'on,  Hawley,  6c 
Zlotmk,  1985:  Porter.  1986),  hut  just  as  evident  is  the  fact  that 
mans  teachers  continue  to  rclv  upon  previous  personal  experi- 
ences m classrooms  in  determining  how  io  teach  others  (see 
C'larlc,  Smith,  Newhv,  & Cook,  19S5);  they  continue,  in  essence, 
to  teach  as  thev  were  taught. 

1 he  student  teachers  involved  m this  study  ai  knowledged 
that  the  use  of  nonexamples  was  discussed  as  pari  of  methods 
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course  instruction.  The  exposure  was  viewed  as  sufficiently  anoma- 
lous,  however,  that  the  participants  saw  no  reason  to  change  the 
way  they  “naturally”  thought  a lesson  should  be  structured. 

I know  that  when  I took  the  [social  studies]  course,  we 
talked  a lot  about  [nonexamples].  I guess  that  all  of  my 
experiences  have  always  been  just  the  opposite  . . . The 
only  time  that  l had  heard  . . . [about  nonexamples)  was 
in  [social  studies]  class.  1 don’t  know  if  it  was  just  that 
having  been  exposed  to  just  giving  examples  that  I never 
really  touched  on  giving  negative  examples.  (ST-A) 

Prospective  teachers  are  socialized  through  12  years  of 
direct  experience  with  schools  and  teachers  and  through  four 
years  of  additional  general  and  professional  study  on  a wide  variety 
of  “acceptable”  instructional  approaches.  They  develop  a sense 
of  how  ideas  should  be  taught,  presented,  and  organized. 
Countering  that  massive  exposure  with  “new”  techniques  that 
they  have  neither  experienced  nor  find  easy  to  assimilate  is  a 
substantial  problem  for  all  those  interested  in  changing  (prospec- 
tive) teacher  behavior.  As  one  student  teacher  remarked: 

. . . [A]fter  four  years  of  education  in  [a]  teacher 
education  program,  you  spend  . . . two  weeks  on  negative 
teaching.  I don’t  think  that  is  enough  time.  When  all 
of  the  other  ways  . . . [have]  been  reinforced  throughout 
the  four  years  and  you  are  spending  two  weeks  on  this 
one  method  . . . even  if  you  did  know  how  to  do  it  you 
might  have  forgotten  about  it  because  you  didn’t  spend 
enough  time  on  it.  (ST-C) 

A number  of  studies  (Hodges,  1982;  Grant,  1981:  Kat: 
& Raths,  1982)  indicate,  as  this  one  does,  that  any  methods 
taught  in  a college  education  course  have  little  impact  on  the 
actual  methods  used  by  students  even  during  their  field  experi- 
ence. Students  in  the  high-anxiety  atmosphere  of  student  teach- 
ing, particularly,  tend  to  fall  back  on  what  is  most  familiar.  In 
most  situations,  this  would  be  the  methods  modeled  in  the  life- 
time educational  experience  of  the  student,  or  the  guidelines 
of  the  lesson  plan  being  used.  This  tendency,  sometimes  called 
the  “utilitarian  perspective,”  is  a tendency  to  do  whatever  gets 
the  lesson  completed  in  an  effective  manner  (Zeichner  & 
Teitelbaum,  1982). 

Studies  have  shown  that  a number  of  factors  lead  to  the 
reversal  of  what  is  learned  in  a student’s  academic  training,  once 
a student  enters  teaching.  The  “norms”  of  the  school,  the  tech- 
niques of  colleagues,  even  the  pupils  themselves  may  all  play 
a role  in  reversing  the  techniques  taught  in  an  academic  pro- 
gram (Zeichner  & Tabachnirk,  1981).  If  teacher  education 
programs  endeavor  to  improve  the  general  practice,  a more  com- 
prehensive system  of  instruction,  modeling  and  support  must 
be  developed. 


Discussion 

The  use  of  nonexamples  as  an  instructional  approach  was 
taught  to  the  student  teachers  in  this  study  in  what  might  best 
be  characterized  as  a “typical  fashion”  That  is,  students  read 
material  on  nonexamples  (see,  for  example,  McKinney,  1985);  they 
prepared  lessons  on  how  to  use  nonexamples;  and  the  instructor 
in  the  course  presented  a sample  lesson  in  which  nonexamples 
were  used  to  teach  the  concept  “natural  resources”  In  total, 
approximately  four  to  five  hours  of  class  time  were  spent  on  the 
topic  of  concept  teaching  using  examples  and  nonexamples. 
Students  were  subsequently  tested  to  determine  their 
understanding. 

What  resulted  was  that  prospective  teachers  “knew  that” 
it  was  desirable  to  use  nonexamples  to  help  students  understand 
a concept,  but  they  still  did  not  “know  how”  to  accomplish  it  or 
did  not  recall  its  potential  for  use  when  it  could  have  been 
employed.  As  one  student  noted: 

I didn't  think  about  using  nonexamples.  If  someone  had 
reminded  me,  I would  have  used  them.  (ST-A) 

The  gap  between  awareness  and  action  has  long  been 
evidenced  in  teacher  education  (see  Gage,  1978).  And  studiessuch 
as  this  one  suggest,  again,  how  difficult  it  is  to  bridge  that  gap. 
The  following  recommendations  are  intended  as  potential  next 
steps  for  extending  the  “effects”  of  preservice  professional 
development  experiences. 

1.  Teacher  educators  should  focus  on  fewer  instruc- 
tional skills,  but  develop  a broader  range  of  experiences  to 
foster  skill  development. 

Teacher  education  in  social  studies  and  in  other  disci- 
plines tends  to  be  eclectic.  Instructors  have  a tremendous  amount 
of  content  to  cover  and  a limited  amount  of  time.  Instead  of 
trying  to  "squeeze”  everything  in , social  studies  educators  should 
“push  material  out"  until  what  is  left  realistically  can  be  taught 
to  and  learned  by  those  about  to  enter  teaching.  Professional 
development  is  a lifelong  experience,  not  everything  can  or 
should  be  taught  in  an  undergraduate  education  curriculum.  If 
Joyce  and  Showers  (1982)  are  correct  that  changing  teacher 
behavior  with  regard  to  acquisition  of  a teaching  skill  requires 
hours  of  coaching  and  practice  sessions,  then  it  is  little  wonder 
that  “broad”  courses  covering  a wide  range  of  topics  have  so 
little  impact  on  preservice  teacher  dispositions  to  use  specific 
teaching  skills. 

2.  Teacher  educators  should  provide  a high  ratio  of 
concrete  to  abstract  experiences. 

Most  college  instruction  is,  implicitly  at  least,  based  on 
the  premise  that  undergraduates  are  formal  operations  learners 
who  can  deal  with  and  understand  abstractions.  Recent  studies 
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(Reyes,  1987),  however,  suggest  that  a majority  of  undergraduate 
students  is  still  functioning  at  Piaget’s  concrete  operational  stage 
vis-a-vis  learning  tasks  that  require  some  measure  of  objective 
reasoning.  Many,  if  not  most,  teacher  education  students  till 
function  at  a cognitive  level  approximating  che  concrete  opera- 
tions stage.  As  a result,  prospective  teachers  must  not  only  read 
about  the  use  of  nonexamples,  they  must  also  see  (on  videotape) 
multiple  examples  of  their  use,  test  their  skills  m peer  teaching 
situations,  and  then  be  “coached"  on  their  use  in  actual  class- 
room situations.  As  Joyce  and  Showers  (1982)  assert: 

At  least  15  to  20  demonstrations  of  the  model  should 
be  observed,  using  learners  with  various  characteristics 
and  several  content  areas.  Demonstrations  are  also 
needed  when  teachers  try  the  model  for  the  first  time, 
when  thev  introduce  students  to  the  model,  and  when 
they  are  learning  how  to  teach  it  to  them.  The  attain- 
ment of  competence  requires  numerous  practice  sessions. 

Each  teacher  needs  to  try  to  the  model  with  peers  and 
small  groups  of  students  from  10  to  15  times  before  a 
high  level  of  skill  becomes  evident,  (p.  6) 

3.  Teacher  educators  must  he  able  and  willing  to  model 
skills  in  classrooms. 

Prospective  teachers  must  see  skills  being  used  in  order  to 
appreciate  their  value.  They  value  the  use  of  examples  because 
that  is  what  they  know,  what  they  have  experienced.  To  gain  an 
appreciation  of  understanding  for  "new"  methods,  prospective 
teachers  must  experience  firsthand  and  as  a natural  part  of  the 
teacher  education  process  the  use  ot  techniques  such  as  the  ex- 
positional  teaching  of  concepts— concept  teaching  that  includes 
both  examples  and  nonexamples.  Modeling  is  an  important 
dynamic  to  helping  studenrs  understand  and  use  new  teaching 
strategies  in  classrooms,  and  teacher  educators  serve  as  important 
pedagogical  models.  Reece,  Berns,  and  Heath  (1985)  found  that 
preservice  teachers  do  notice  if  instructors  model  research-based 
teaching  behaviors  and  "more  than  half  of  the  students  said  this 
modeling  approach  influenced  how  they  taught  during  their 
student  teaching"  (p.  6). 

4.  Reinforce  the  technique  of  using  noncxamples  by 
choosing  cooperating  teachers  who  routinely  employ  this  tech- 


nique or  enlist  the  support  of  the  cooperating  teacher  in  encour- 
aging the  student  to  use  nonexamples  in  their  teaching. 

If  a student  teacher  is  to  have  the  confidence  to  employ 
a research -based  teaching  method,  it  is  essential  that  the  practice 
ot  that  technique,  be  modeled  and/or  supported  in  field  experi- 
ences. Without  this  support,  the  student  is  almost  certainly  going 
to  tall  hack  on  more  familiar  approaches. 

Conclusion 

The  findings  of  this  study  should  not  he  surprising  to 
anyone  familiar  with  the  complexity  ot  teaching  and  teacher 
education.  They  suggest  how  intensive  the  student  teaching 
experience  must  he  if  skills  learned  during  methods  courses  are 
to  he  evidenced  in  actual  classroom  settings.  Student  teachers, 
struggling  to  survive  the  exigencies  ot  lesson  planning  and  class- 
room management,  are  overwhelmed  by  the  task  of  teaching.  To 
survive  they  rely  on  instructional  techniques  that  are  familiar 
and,  as  a consequence,  teach  as  they  themselves  were  taught, 
which  m terms  of  concept  teaching  means  a reliance  on  examples 
and  textbook  definitions. 

The  use  of  noncxamples  is  a relatively  complex  skill  that 
requires  coaching  and  an  in-depth  knowledge  of  subject  matter. 
Appreciating  the  value  of  nonexamples  necessitates  that  prospec- 
tive teachers  receive  substantial  guided  practice  and  training 
beyond  what  is  currently  provided  in  most  teacher  education 
programs.  Fostering  the  use  of  noncxamples  as  a part  of  a teachers 
repertoire  most  likely  would  mean  the  adoption  of  a "continuous 
view"  of  teacher  education,  beginning  in  the  preservice  curric- 
ulum and  extending  through  carefully  structured  inservice  edu- 
cation. Further,  their  use  will  require  textbook  publishers  of 
collegiate  and  elementary  and  secondary  social  studies  texts  to 
rethink  how  concepts  are  presented,  explained,  and  highlighted. 
The  unfortunate  hut  very  real  reliance  of  teachers  on  textbooks 
will  necessitate  that  instructional  resources  be  modified  to 
demonstrate  how  nonexamples  can  he  used  to  explain  to  students 
concept''  central  to  the  social  studies  curriculum. 
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Note:  Some  Thoughts  on  the  Relationship  between  Catastrophe  Theory  and  Chaos 

By  William  C.  Groom,  Ph.D.,  Khosh  &.  Associates,  Cleveland,  Ohio. 


Catastrophe  theory  addresses  nonlinearities  in  systems— 
places  at  which  smooth  (inonotonic)  change  breaks  down  and 
wildly  divergent  behaviors  emerge  that  can  scarcely  he  predicted 
from  the  system’s  prior  state.  D’Costas  (1991)  elegant  and  eloquent 
example  of  using  a cusp  catastrophe1  to  illustrate  fight-fight  reac- 
tion in  a dog  underscores  the  usefulness  of  using  geometric  models 
to  aid  understanding  of  (presumably)  underlying  behavioral 
dynamics.  It  should  he  noted,  however,  that  the  body  of  research 
grouped  under  the  loose  rubric  of  “chaos  theory”  (an  unfortunate 
term)  is  applicable  here  as  well.  Chaos  theory  shares  with  catas- 
trophe theory  its  geometrical  outlook  and  claim  to  universal 
applicability.  Catastrophes  an?  concerned  with  singularities;  chaos 
is  concerned  abrupt  changes  at  boundaries.  Catastrophes  occur 
w ithin  a larger  behavioral  framework  that  is  in  some  sense,  limited. 
For  example,  the  dog  m the  example  will  light  or  flee  - we  are 
not  just  sure  which  or  when.  He  will  almost  certamh  not  sing 
opera.  Chaos  also  speaks  to  unpredtc (ahilitx  wiilun  a larger 
framework  of  limits.  1 ong  rerm  weather  prediction  has  been 


demonstrated  to  he  an  impossibility,  yet  the  probability  that  it 
will  reach  130  degrees  at  the  North  Pole  in  winter  is  vanishingly 
small.  Both  chaos  and  catastrophe  theories  are  marked  by  self- 
similarity  across  scale.  With  the  cusp  catastrophe  example,  a fall 
“off  the  surface”  near  the  fold  results  m only  a little  aggression  or 
flight;  a fall  farther  out  results  in  a more  exaggerated  response. 
Without  knowledge  of  the  scale  of  the  behavior  change  (here 
represented  by  vigor  of  artack  or  flight),  all  an  observer  can  do 
with  certainty  is  note  that  a catastrophe  has  occurred.  The 
singularity  m each  case  is  the  same,  a gradual  behavior  change 
followed  by  an  abrupt  and  “unpredictable”  discontinuity.  Chaos 
explains,  for  example,  why  coastlines,  hays,  estuaries,  river  mouths 
and  hanks  of  creeks  all  have  the  same  underlying  shape.  Wit/iom 
knowledge  of  the  scale  (here  represented  hv  distance  from  what  is 
being  observed),  an  observer  cannot  know  with  certainty  at 
what  boundary  he  or  she  is  looking.  The  underlying  sense  of 
“coastlineness”  iv  ihe  same. 

(urn tmmxl  on  Jwy  4d) 
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The  Value  of  a Well'Intentioned  Mistake: 
Notes  from  a Qualitative  Research  Methods  Course 

By  Audrey  Kleinsasser,  University  of  Wyoming 


Abstract 

Two  instructional  strategies  are  outlined  in  the  article.  Each  strategy  creates  opportunities  for  graduate  students  to  learn  from 
mistakes  and  practice  the  self-criticism  or  reflexivity  which  is  necessary  for  a qualitative  researcher.  The  strategies  are  conceptualizing 
writing  as  a process  and  conceptualizing  course  projects  as  pre-studies  or  pilots.  The  article  closes  with  recommendations  about 
evaluating  students’  writing. 


Learning  from  a mistake,  especially  a well-intentioned 
mistake,  is  one  of  the  best  ways  to  conceptualize  the  process  of 
real  research  work.  Opportunities  to  reflect  about  one’s  mistakes 
create  a context  in  a research  course  for  rethinking  the  problem 
and  the  possible  solutions  or  alternatives  to  the  problem.  The 
self-reflection  which  is  crucial  for  all  researchers  is  particularly 
important  tor  qualitative  researchers  in  educational  fields.  Quali- 
tative researchers  purposely  enter  the  research  site  as  participant 
observers  or  insiders.  For  this  reason,  the  qualitative  researcher 
must  apply  merciless  self-criticism  (merciless  self-criticism  is  a 
metaphor  for  the  critical  analysis  of  ones  self  used  by  Cary,  1991). 

In  this  article,  two  instructional  strategies  are  outlined.  Each 
strategy  creates  opportunities  for  graduate  students  to  learn  from 
mistakes  and  practice  self-criticism  or  reflexivity  which  is  neces- 
sary for  qualitative  research.  The  strategics  are  conceptualizing 
writing  as  a process  and  conceptualizing  course  projects  as  pre- 
studies  or  pilots.  While  both  of  the  strategies  are  designed  for 
use  in  a qualitative  research  course,  they  are  also  successful  in 
introduction  to  research  courses.  The  article  closes  with  recom- 
mendations about  evaluating  students’  writing. 

Writing  as  a process.  Conceptualizing  writing  as  an  opportunity 
to  learn  from  mistakes  is  substantiated  by  a research  base,  which 
is  guiding  writing  instruction  in  elementary,  secondary,  and  post- 
secondary  levels.  Writing  process  scholars  differentiate  writing 
as  a product  from  u riting  as  an  authentic  communication  with  a 
specific  audience.  (See  Enug,  1981;  Graves,  1981;  Murray,  1982, 
tor  representative  examples  of  writing  process  research  findings 
and  applications.)  In  research  courses,  an  emphasis  on  writing 
as  a process  is  legitimate  for  two  reasons.  First,  writing  helps  the 
student  think  through  the  research  problem.  Second,  wriring 
is  one  medium  commonly  used  to  communicate  the  research 
findings  to  an  audience. 

The  first  set  of  required  readings  for  the  qualitative  research 
methods  course  described  here  includes  several  chapters  front 
HowurI  Becker’s  Writing  /or  Sucw/  Scientists  (1986).  Becker  Tvmmds 
writers  of  three  important  givens:  (a)  writing  is  hard  work;  (h) 
writ ing  is  almost  always  improved  hy  having  someone  else  read  it; 
anJ  (c)  there  is  no  such  thing  as  a perfect  first  draft. 


When  research  methods  instructors  relieve  the  pressure  to 
write  a perfect  draft  of  a document,  students  approach  the  writing 
process  in  a different  manner.  They  come  to  value  the  oppor- 
tunity to  write  more  than  one  draft  rather  than  see  the  revision 
process  as  tedious  busy  work.  In  their  drafts,  students  jot  notes 
in  the  margins,  usually  questions  for  the  reader.  In  the  course, 
students  come  to  think  of  all  of  the  writing  assignments  as  work- 
ing drafts.  In  the  section  that  follows,  reflexive  journals  are 
examined  as  one  way  to  implement  a writing  to  learn  model  in 
a research  methods  course. 

Reflexive  journals.  Lincoln  and  Cuba  (1984)  recommend  that 
qualitative  researchers  keep  a reflexive  journal  in  addition  to 
field  notes.  The  journal  is  a running  conversation  the  researcher 
has  with  her  or  himself.  The  journal  differs  from  a field  notebook 
in  that  it  is  the  source  of  the  researcher’s  hunches,  worries,  and 
concerns.  The  reflexive  journal  is  a qualitative  research  tool  to 
practice  and  monitor  reflexivity.  Reflexivity  is  the  researcher’s 
ongoing  engagement  with  the  research  question  and  the  re- 
search methodology. 

Students  keep  a reflexive  journal  as  part  of  their  course 
requirement.  The  requirement  illustrates  the  importance  of 
journaling  as  a data  source  tor  a qualitative  researcher.  It  also 
forces  the  student  to  practice  the  ongoing  reflexivity  wirh  the 
research  question  that  is  part  of  the  interpretative  process  of 
qualitative  research.  While  some  of  the  journaling  occurs  out- 
side of  class  time,  students  journal  during  class  as  well.  Using 
class  time  reinforces  the  centrality  of  reflexivity  in  the  qualitative 
research  process. 

Sometimes,  the  journal  topics  arc  ones  the  instructor  directs 
students  to  think  about  and  respond  to.  More  often,  the  topics 
are  student-selected.  This  semester  some  of  the  studenrs  found 
it  particularly  helpful  to  form  groups  of  two  or  three  to  read  and 
react  to  portions  of  each  other’s  journals.  Reading  each  other's 
journal  entries  stimulated  discussions  between  and  among  stu- 
dents and  stimulated  even  more  writing. 

When  students  read  each  others  journal  entries,  the 
transition  to  reading  drafts  of  other  course -re  l a ted  writing  is 

(i  cminucd  p?i  frige  H) 
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natural  and  logical.  For  example,  students  ask  each  other  to  read 
the  draft  for  meaning,  the  flow  of  the  argument,  and  to  critique 
the  introduction.  Whenever  the  instructor  reads  their  drafts,  she 
models  the  same  process  by  asking  students  to  focus  her  reading 
on  a particular  question  or  two. 

To  summarize,  reflexive  journals  are  writing  to  learn 
opportunities  which  model  the  reality  of  the  qualitative  research 
process.  Being  a researcher  means  being  a communicator.  One 
of  the  chief  outcomes  of  a qualitative  research  methods  course 
is  to  learn  the  process  of  communicating  ones  research  findings 
accurately  and  convincingly.  Writing  reflexive  journals  gives 
students  the  opportunity  to  practice  the  merciless  self-criticism 
that  qualitative  researcher*  call  reflex iviry. 

Just  as  the  revision  process  is  an  opportunity  to  learn  from 
mistakes,  so  too,  is  the  data  collection  process.  Some  students 
are  frozen  before  they  begin.  They  are  afraid  of  making  a mistake, 
even  if  they  have  a workable  research  design.  For  this  reason,  it 
is  an  invaluable  teaching  technique  to  conceptualize  any  kind  of 
major  course  project  as  a pre-study.  Conceptualizing  the  pre-study 
as  part  of  the  research  process  is  the  topic  of  the  next  section. 

Conducting  pre-studies.  In  the  qualitative  research  methods 
course  described  here,  one  of  the  major  course  outcomes  is  con- 
ducting a pre-study.  While  there  isn’t  any  student-teacher  nego- 
tiation about  the  fact  that  a pre-study  has  to  be  completed,  the 
students  and  the  instructor  negotiate  and  re-negotiate  all  aspects 
of  the  pre-study  from  topic  selection  to  components  of  the  final 
draft.  Even  after  a student  has  made  a commitment  to  complete 
a pre-study,  the  instructor  and  the  student  continue  negotiating. 
The  following  example  from  a qualitative  research  course  illus- 
trates the  way  a graduate  student  named  Ken  and  the  instructor 
negotiated  his  pre-study. 

Ken  had  decided  to  conduct  interviews  and  participant 
observations  on  fly  fishing,  a topic  about  which  he  had  little 
formal  knowledge.  As  part  of  his  research  method,  he  observed 
and  talked  with  people  at  the  local  fly  fishing  store.  He  experi- 
enced fly  fishing  with  several  colleagues  who  were  enthusiastic 
and  expert  fly  fishermen  as  well  as  articulate  interview  respon- 
dents. Well  into  his  pre-study,  Ken  got  worried.  The  instructor 
urged  him  to  express  his  concerns  to  the  class.  He  told  the  class, 
“This  study  doesn’t  seetn  to  be  very  important.  1 mean,  what’s 
significant  about  the  culture  of  fly  fishing— if  you  can  even  call 
it  a culture?” 

The  instructor  responded,  “If  you  feel  that  strongly,  you 
might  consider  jettisoning  the  study.”  Pausing  a moment  to  allow 
the  ramifications  of  the  suggestion  to  sink  in,  she  then  said, 
“Have  you  considered  writing  up  why  you  don't  think  it  is  worth) 
as  a qualitative  pre-study.  You  could  focus  on  the  issues  of  the 
particular  and  the  general  which  are  central  to  investigation* 
using  ethnographic  methods” 

The  instructor’s  response  ro  Ken  prompted  a spirited 
cSeussion  among  the  class  members.  “Dump  a study?  Stop  in 


the  middle?  Do  researchers  really  do  that?”  Yes,  researchers  do 
that,  not  intentionally  or  with  great  enthusiasm,  hut  projects 
go  had  or  simply  fail  to  develop  according  to  the  research  plan. 
Sometimes  what  seems  to  be  the  middle  of  a study  is  really  the 
end.  Sometimes  the  data  sources  are  not  rich  enough  to  develop 
a study.  For  all  of  these  reasons,  it  is  important  for  researchers 
to  develop  pilots  or  pre-studies. 

Ken’s  dilemma  and  his  willingness  to  .share  it  brought 
home  the  point  that  conducting  a pilot  or  pre-study  makes  good 
research  sense1.  Stepping  back  to  examine  how  the  study  is 
developing  or  not  developing  is  the  kind  of  reflexivitv  student* 
can  experience  by  conducting  a pre-study. 

In  qualitative  research  courses,  it  is  valuable  to  ask  stu 
dents  to  conceptualize  all  maj.  course  projects  as  pilot  studio* 
or  pre-studies.  Catching  on  to  the  idea,  one  of  the  students  called 
his  project  a green  pilot.  The  terminology,  whether  pre-stud\, 
pilot,  or  green  pilot  emphasizes  that  the  primary  purpose  of  tin 
assignment  is  for  the  student  to  learn  about  the  process  of  con- 
ducting research.  It  also  focuses  on  the  self-criticism  a qualitative 
researcher  must  submit  to. 

Qualitative  research  methodologistsoften  use  the  expres- 
sion “researcher  as  instrument”  to  describe  what  the  researcher 
does.  Like  all  instruments,  the  human  instrument  has  strengths 
and  limitations.  For  the  qualitative  researcher,  self-criticism  is  a 
research  skill.  Part  of  the  text  of  a pre-studs  should  he  some 
evidence  that  the  researcher  critically  examined  him  or  herself 
for  motives,  observation  and  interview  decisions,  and  the  re- 
searcher’s interpretation  of  an  event.  Reflex  ivit)  i*  a measure  of 
researcher  sophistication.  !t  is  also  a clue  to  the  reader  about 
the  researcher’s  role  in  the  study. 

In  a qualitative  research  methods  course  it  is  important 
for  a student  to  have  opportunities  to  incorporate  reflexivitv  into 
his  or  her  writing.  Evidence  of  reflexivitv  should  he  found  m 
the  narrative  write  up.  Information  about  the  wav  an  imesiiga 
tton  was  conducted— how  the  researcher  .is  instrument  vva*  used 
contributes  to  the  investigation’s  credibility  and  trust  worthiness. 

In  summary,  using  the  spec  if ic  language  of  pre-studv. 
pilot,  or  green  pilot  alleviates  the  pressure  to  produce  a perfect 
draft.  Not  having  to  produce  the  perfect  write-up  require*  a \ lew 
of  writing  that  puts  a*  much  value  on  pre-w  riting  and  revisions 
as  it  does  the  final  draft.  It  also  emphasizes  iefle\ivit\,  whuh 
for  a novice  researcher  may  he  the  most  important  re*eauh 
skill  to  hone. 

Conceptualizing  writing  a*  a process  and  producing  pie 
study  drafts  that  cle-emphasize  writing  the  porlect,  otice -anJ-tnr 
all  version  requires  an  evaluation  or  grading  model  that  is  philo- 
sophically consistent.  The  grading  and  evaluation  of  i.'iirv 
assignments  is  the  final  topic  of  this  article. 

Evaluating  course  assignments.  The  oppottumtv  u 
make  mistakes  in  a research  method*  course  will  be  valuable  t.> 
students  il  the  iiisliuctor  gives  student*  credit  tor  making 
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and  learning  from  their  mistakes.  One  strategy  which  has  been 
used  w irh  considerable  success  is  a course  contract.  For  example, 
expectations  for  the  course  may  be  delineated  in  the  courst  out- 
line. For  instance,  students  may  be  required  to  submit  interview 
and  observation  protocols  and  write-ups,  a plan  for  reading  beyond 
the  required  readings,  a plan  for  journaling,  and  a field-based 
pre-study.  From  that  point,  the  negotiation  process  begins.  Draft 
writing  can  be  built  into  the  contract.  Commitment  to  the 
revision  process  demonstrates  that  all  drafts  are  valued,  not  just 
the  final  dratt. 

With  draft  writing  an  important  parr  of  all  written  assign- 
ments, there  is  more  to  read.  As  part  of  the  contract  negotiations, 
students  mav  he  asked  to  think  about  who  will  read  their  work. 
Several  students  met  the  journal  writing  component  of  the  course 
by  negotiating  to  read  segments  from  each  other's  journals.  To 
monitor  the  process,  the  instructor  may  ask  students  to  submit 
several  selected  journal  entries  during  the  course  of  the  semester, 
hut  rhe  writing  commitment  is  to  each  other,  not  to  the  instructor. 

One  of  the  benefits  of  this  approach  is  that  students 
have  more  than  one  reader  of  their  texts.  Most  students  ask  for 
comments  from  several  readers  of  their  journaling,  interview 
and  observation  protocols,  and  drafts  of  rheir  pre-studies.  The 
benefit  to  the  student  is  obvious:  more  people  read  and  react 
to  their  drafts.  By  the  end  of  the  semester,  students  are  relying 
on  one  another  in  an  authentic  way— just  like  researchers  ask 
colleagues  to  critique  their  writing.  The  instructor's  reading 
load  is  not  increased.  In  fact,  the  instructor’s  reading  of  student 
work  is  more  focused  since  students  submit  a draft  w ith  a particular 
question,  e.g.,  “Give  me  some  feedback  about  the  depth  of  ques- 


tioning in  my  interview.”  The  questions  students  ask  focus  on 
substantive  or  methodological  issues  that  are  important  to  them. 
These  are  the  methodological  issues  they  are  ready  to  learn  about. 

A final  note  about  evaluating  student  work  is  warranted. 
Having  taught  qualitative  research  methods  courses  under  a 
Satisfactory/Unsatisfactory  grading  model  and  an  A-F  model, 
rhe  S/U  model  seems  to  enable  students  to  make  and  learn  from 
mistakes  more  confidently  than  the  A-F  model. 

Instructors  of  qualitative  research  methods  courses  need 
ro  develop  a course  evaluation  model  that  complements  writing 
process  objectives,  researcher  reflexivity,  and  intellectual  risk- 
taking.  Thinking  about  the  grading  model  is  a key  to  course 
development  and  should  occur  early  in  course  development'. 


Conclusion 

The  opportunity  to  make  and  learn  from  well-intentioned 
mistakes  can  be  built  into  qualitative  research  methods  courses. 
In  course  assignments,  instructors  can  implement  teaching 
strategies  which  value  the  mistakes  students  learn  from.  Stu- 
dents can  experience  the  work  of  a qualitative  researcher  in  an 
authentic  manner  by  conceptualizing  written  work  as  a learning 
process  and  thinking  about  course  projects  as  pre-studies  or  pilots. 
If  the  teaching  strategies  are  not  anchored  in  an  evaluation  model, 
which  accounts  for  and  values  the  process  of  reflexivity  and 
revision,  students  will  not  see  research  activity  as  a process  of 
planning  a study,  implementing  a methodology,  analyzing  data, 
and  drafting  purposeful  revisions. 
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Contrasting  Three  Measurement  Techniques 

for  Scale  Development 

By  William  E.  Loadman,  The  Ohio  Stare  University,  Susan  M.  Brookhart,  Duquesne  University, 
and  Suwimon  Wongwanich,  Chulalongkom  University,  Thailand 


Abstract 

Three  different  methods  for  grouping  items  in  an  opinion  survey  were  compared  for  their  utility  in  subscale  construction: 
rational  organization  according  to  content,  factor  analysis,  and  multidimensional  scaling.  Data  were  Likert-scale  responses  to  54  items 
regarding  Holmes  Group  educational  reform  concepts  by  175  teachers,  215  public  school  administrators,  and  100  university  education 
faculty.  Criteria  used  to  evaluate  subscales  included  reliability,  additivity,  and  interpretability.  Results  indicated  that  factor  analysis 
was  a more  useful  tool  for  subscale  construction  than  multidimensional  scaling  or  rational  organization. 


The  purpose  of  this  study  was  to  compare  three  methods 
of  item  organization  for  their  utility  in  developing  reliable,  mean- 
ingful  subscales  to  measure  attitudes  toward  educational  reform 
issues.  Attitude  scales  are  often  used  in  educational  research.  It 
is  therefore  important  to  find  ways  to  construct  them  well,  for 
their  quality  affects  directly  the  insights  that  can  be  gained, 
reported,  and  discussed  from  such  scales.  This  investigation  of  a 
multidimensional  data  set  with  rational  organization,  factor 
analysis,  and  multidimensional  scaling  considered  both  how 
these  methods  grouped  the  items  differently  and,  once  grouped, 
how  well  each  of  these  sets  of  items  lent  themselves  to  becoming 
meaningful,  usable  subscales.  The  goal  was  a straightforward 
way  of  constructing  subscales  that  would  be  reliable  and  valid 
as  well  as  clearly  interpretable,  without  complicated  weighting 
schemes,  for  improving  the  quality  of  the  kind  of  data  often 
collected  in  attitude  surveys. 

One  of  the  assumptions  underlying  the  use  of  a linear 
composite  scale  is  unidimensionality  (Mclver&  Carmines,  1981). 
This  is  at  root  a validity  question:  is  the  attitude,  defined  by  the 
items  on  a scale,  a single  construct?  The  investigators  looked  at 
three  ways  of  establishing  unidimensionality.  Rational  organiza- 
tion had  been  used  for  item  generation  and  instrument  develop- 
ment. Factor  analysis  and  multidimensional  scaling  were  chosen 
as  the  two  other  techniques  for  comparison  because  these  are 
two  standard,  useful  methods  for  discovering  unmeasured  vari- 
ables or  concepts  underlying  multivariate  data  (Rummel,  1970; 
Young,  1987).  Factor  analysis  and  multidimensional  scaling 
solutions  have  been  compared.  Scaling  solutions  tend  to  be 
simpler  than  factor  anlaysis  solutions  and  be  bipolar,  while  factor 
analysis  solutions  tend  to  have  mostly  positive  loadings  (Davison, 
1981).  MacCallum  (1974)  noted  that  the  two  methods  vary  ac- 
cording to  purpose  and  type  of  data  analyzed.  Scaling  often  is 
done  for  the  purpose  of  plotting  variables,  in  this  case  items, 
along  dimensions,  and  thus  rends  to  emphasize  the  position  of 
the  measured  variables.  Factor  analysis  emphasizes  the  discovery 
of  factors  or  underlying  constructs  and  thus  tends  to  emphasize 
the  unmeasured  variables.  Napior  (1972)  recommended  using 


both  procedures  on  Likert-type  items  to  uncover  structure  in 
the  data  and  then  choosing  the  more  useful  of  the  structures 
identified  for  building  subscales.  He  meant  by  usefulness  the 
factors  or  dimensions  which  seemed  most  interpretable  for  the 
research  purpose. 

Once  unidimensional  item  groupings  are  chosen,  the 
method  of  arriving  at  a scale  score  is  often  simply  summing 
unweighted  responses  to  component  items.  Nunnally  (1978) 
argued  that  more  complicated  weighting  results  in  scores  that 
correlate  highly  with  simple  summation  scores.  Reliability  or  con- 
sistency of  scale  scores  must  also  be  considered.  There  are  two 
aspects  to  consistency,  consistency  of  items  and  of  persons.  Cron- 
hach’s  alpha  measures  internal  consistency  of  items  (SPSS,  1986). 

Scale  scores  should  also  consistently  measure  attitudes 
across  persons.  Similar  scores  on  an  attitude  scale  should  indi- 
cate individuals  with  similar  attitudes.  But  people  do  not  always 
respond  consistently  to  all  the  items  in  a set.  Simply  summing 
scores  assumes  each  item  has  equal  weight  for  each  individual 
(Napior,  1972).  Napior  suggested  using  Guttman’s  least-squares 
scaling  model  to  assign  different  weights  to  each  category  for 
each  item.  This  solution  handles  the  problem  of  interaction  or 
differential  treatment  of  items  by  respondents. 

Another  way  to  achieve  consistency  of  scale  use  by  per- 
sons is  to  transform  data  by  raising  it  to  an  appropriate  power  to 
achieve  additivity,  as  measured  by  Tu  key's  test  for  nonadditivity 
(SPSS,  1986).  The  null  hypothesis  for  this  test  is  that  there  is  no 
person-by-item  interaction  or,  equivalently,  that  there  is  homo- 
geneity of  covariance  among  pairs  of  items.  This  null  hypothesis 
should  be  accepted:  Tukey’s  test  for  non-additivity  should  not  be 
significant  in  order  to  allow  the  conclusion  that  a scale  is  addi- 
tive. The  SPSSX  output  will  provide  an  estimate  of  the  power  to 
which  data  should  be  raised  to  meet  the  assumption  of  additivity 
for  consistency  of  responses  across  persons. 

Neither  of  these  stat  istical  solutions,  Gutrman’s  differential 
weighting  of  categories  for  each  item  or  Tukey’s  data  transforma- 
tion, go  very  far  toward  a simple,  straightforward  interpretation 
of  what  the  scale  scores  might  mean,  and  meaning  is  a prime 
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Three  Methods  for  Scale  Development  (continued) 


consideration  in  educational  research.  How  does  one  interpret 
agreement  for  a reader  when,  using  Guttman’s  technique,  for 
one  item  “agree”  has  one  weight  but  for  another  item,  “agree” 
is  weighted  differently?  Or  how  does  one  justify,  as  would  have 
been  necessary  for  the  rational  scales  in  this  study,  raising  responses 
to  one  set  of  items  to  a power  of  2 .48  while  raising  another  group 
of  responses  to  a power  of  1.64,  when  the  items  were  intermixed 
on  the  instrument? 

Another  solution  is  to  refine  the  subscales  so  they  do  not 
need  transforming  in  order  to  be  consistent  across  persons.  Re- 
fining  scales  until  they  were  naturally  additive  was  the  approach 
taken  for  this  study.  The  meaning  of  the  scales,  as  simple  sums 
indicative  of  attitude  toward  individual  educational  reform  issues, 
was  a priority  because  the  goal  was  to  create  meaningful,  reliable 
subscales  which  were  clear  and  understandable,  and  thus  would 
be  used  in  applied  research  about  educational  reform. 


Method  and  Results 

The  data  were  part  of  a larger  study  (Loadman,  Brook- 
hart,  & Wongwanich,  1987)  for  which  questionnaires  had  been 
developed,  checked  for  content  validity,  administered,  checked 
for  reliability  (internal  consistency)  and  internal  validity;  des- 
criptive results  were  reported.  The  current  study  considered  the 
data  from  three  groups  of  professional  educators:  teachers,  public 
school  administrators,  and  university  education  faculty.  These 
three  groups  had  a common  Part  Two  in  their  questionnaires,  a 
set  of  54  Likert-type  items.  The  items  were  generated  as  stimuli 
for  responses  on  a scale  of  1 , strongly  disagree,  to  5,  strongly  agree. 
Complete  sets  of  responses  from  175  teachers  and  215  public 
school  administrators  in  Franklin  County,  Ohio,  and  100  univer- 
sity education  faculty  members  at  The  Ohio  State  University 
were  used  in  analysis.  The  variances  of  responses  to  each  item 
were  sufficiently  large  to  indicate  heterogeneity  of  opinion  in 
the  sample  (Hsu,  1979).  The  presence  of  variability  in  the  data 
meant  that  the  data  were  more  suitable  tor  multivariate  procedures 
such  as  factor  analysis  and  multidimensional  scaling  than  had 
there  been  homogeneity  or  agreement. 

The  distributions  for  each  item  were  checked,  since  dis- 
tributions that  were  very  skewed  could  he  expected  to  attecr  the 
factor  analysis  (Rummel,  1970).  It  is  also  the  case  that  the  dis- 
tributions of  scores  affect  the  scaled  scores.  The  modal  reaction 
to  a statement  used  in  a summative  scale  should  be  approximately 
in  the  center  of  possible  responses  (Likert,  1974).  The  range  of 
means  among  the  54  items  was  2.16  to  4.^7.  Standard  deviations 
ranged  from  .67  to  1.56.  The  distributions  were  judged  symmet- 
rical enough  to  proceed. 

Three  different  sets  of  Mihscalcs  were  constructed,  with 
the  items  organized  rationally  and  by  the  results  of  factor  anahsis 
and  multidimensional  scaling.  In  each  ease,  item"  were  grouped 
into  subsides,  Cron  bach's  alpha  was  calculated,  and  Tukev’s 


test  for  additivity  was  run.  Criterion  for  an  acceptable  alpha  was 
set  at  .70,  and  criterion  for  additivity  was  set  at  accepting  the 
null  hypothesis  for  Tu key’s  test  at  the  .05  level.  An  additional 
criterion  of  interpretability  was  used.  Consistent  with  the  pur- 
pose of  constructing  straightforward,  meaningful  subscales,  the 
investigators  evaluated  the  content  of  an  item  for  a match  with 
the  other  items  in  its  group.  Investigators,  judgments  were  based 
on  their  recent  literature  review  (Loadman,  Brookhart,  and 
Wongwanich,  1987)  of  Holmes  Group  issues. 

Rational  Organization  Four  groups  of  items  had  been  written, 
based  on  the  five  Holmes  Group  goals  (Holmes  Group,  1986); 
the  fourth  and  fifth  goals  had  been  treated  as  one  group  because 
both  concerned  public  schools,  and  items  written  for  these  two 
goals  sounded  very  similar.  Cronbach’s  alpha  and  results  of  Tukcy’s 
test  for  additivity  for  four  subscales  are  presented  in  Table  L 


Table  1 

Characteristics  of  Subscales 
Based  on  Rational  Organization  of  54  Items 


SnKc.ik*  G intent 

No.  of 
hom-. 

Chinn  bach’s 
Alph.i 

Addl* 

tivitv* 

I.  To  make  the  education  of  teachers 
intellectually  more  solid 

16 

.85 

no 

II.  To  recognize  differences  in  teachers, 
knowledge,  skill,  and  commitment  . 

. 14 

.69 

ves 

111.  Ti  create  professionally  relevant, 
intellectually  defensible  standard" 
of  entry  into  teaching 

11 

.59 

\Cs 

IV.  T»  connect  schools  of  educ.it  it  in 
to  schools,  and  to  make  schools 
better  places 

M 

.75 

no 
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Reliability  hut  not  additivity  was  acceptable  for  two  of  the  sub- 
scales.  The  other  two  scales  were  additive,  hut  reliability  was 
not  high  enough.  The  next  step  in  scale  revision  was  to  drop 
items,  one  by  one,  with  the  aim  of  acceptable  reliability  and 
additivity  measures.  Rational  organization  by  itself  provided 
no  wav  to  prioritize  which  items  to  drop. 

One  other  way  to  identify  items  which  might  he  dropped 
from  the  scales  to  refine  them  was  attempted.  Principal  axis 
factor  analysis  was  done  tor  each  ser  of  items  separately.  Reduced 
correlation  matrices,  with  squared  multiple  correlations  on  the 
diagonals,  were  analyzed  because  contributions  to  common  vari- 
ance were  of  interest.  If  a single  factor  could  he  extracted  tor 
each  rational  grouping  of  items,  the  factor  loading"  could  be 
used  to  prioritize  items  tor  inclusion  on  revised  subscales.  The 
eigenvalues  which  resulted  from  these  factor  anahscs  are  pre- 
sented in  Table  2.  Two.  ol  the  ‘our  rational  groups  of  items  were 
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Table  2 

Eigenvalue.*  from  Factor  Analyses  of  Rational  Groups  of 
Items  Princifxil  Axis  Solution,  Using  Squared  Multiple 
Correlations  for  Prior  Commumlity  Estimates 


Nii  of  factors 

Item 
Group  1 

Item 
Gnn*p  II 

Item 

Gnuip  III 

Item 

Gnuip  IV 

1 

4.%* 

2.63* 

1.38 

2.73 

.76 

.83 

1.31* 

1.11* 

3 

.43 

.31 

.23 

.39 

4 

.34 

.22 

.13 

.34 

"Number  ,.l  i.ki< 

chosen 

best  described  with  two  factors.  Rational  grouping  had  not  suc- 
ceeded in  identifying  unidimensional  subscales.  It  would  have 
been  statistically  possible  to  proceed  with  building  six  subscales, 
but  the  items  on  two  of  these  subscales  were  not  clearly  different: 
both  referred  to  academic  aspects  of  teacher  education.  For  con- 
tent reasons,  then,  the  rational  subscales  did  not  easily  lend 
themselves  to  revision  into  the  meaningful,  reliable,  valid  sub- 
scales which  were  the  goal  of  this  study. 

Multidimensional  Scaling  Nonmetric  multidimensional  scaling 
was  done  on  a matrix  of  dissimilarities  computed  as  one  minus 
the  correlations  among  the  54  items.  Nonmetric  scaling  was 
chosen  because  of  less  stringent  assumptions  about  the  properties 
of  the  Likert  scale  and  because  nonmetric  solutions  are  some- 
times clearer,  as  the  distance  estimates  are  only  constrained  by 
rank  order  (Carroll  Wish,  1982).  The  data  were  transformed 
from  similarities  measured  by  correlations  into  dissimilarities 
because  the  scaling  algorithm  was  written  for  dissimilarity  data 
and  functions  best  with  this  type  of  data  (SAS,  1983). 

The  stress  values  for  two-  through  six-dimensional 
solutions  are  presented  in  Table  3.  A three-dimensional  solution 
was  chosen  based  on  the  pattern  of  diminishing  stress  values. 
It  was  checked  against  a four-dimensional  solution  for  inter- 
pretability.  The  three  dimensions  were  interpretabie.  and  scale 
values  were  bipolar,  as  expected  (Davison,  1981). 


Table  3 

Srress  \afuc.s  for  Nonmctric 
MuItiJimcmimuil  Scaling  of  54  Items 

Pimcntion.ilitv  Strc>v  (Knis-k.il’*- Formul.i  1) 

: 2s 

3 17* 

4 n 

5 11 

P A) 

•\iirr-Kr  t , *1 


To  use  the  scaling  results  to  group  items  into  subscales, 
items  with  high  absolute  scale  values  on  all  three  dimensions 
were  dropped,  as  were  items  without  any  high  absolute  scale 
values.  These  items  were  judged  too  ambiguous  or  vague,  respec- 
tively, to  assign  to  a subscale.  A total  of  four  items  were  dropped. 
The  remaining  items  were  assigned  to  one  or  two  of  three  sub- 
scales, according  to  the  dimension  on  which  the  largest  absolute 
value(s)  appeared.  Multidimensional  scaling  acknowledges  that 
the  same  stimulus  may  elicit  reactions  from  more  than  one  per- 
spective (Young,  1987).  Consistent  with  this  concept  of  dimen- 
sionality, six  items  were  allowed  on  two  subscales. 

The  characteristics  of  the  three  subscales  based  on  the 
multidimensional  scaling  solution  are  presented  in  Table  4. 
Results  indicated  that  internal  consistency  reliability  ranged 
from  .67  to  .80.  Two  of  the  three  subscales  were  additive,  indi- 
cating no  person-by-item  interaction  which  would  interfere  with 
subscale  use.  However,  the  broadness  of  the  concepts  made  it 
difficult  to  specify  what  a high  or  low  score  on  one  of  these 
subscales  would  actually  mean. 


Table  4 

Characteristics  of  Subscales 
Based  on  Multidimensional  Scaling  of  54  Items 


SuKcale  C-ontent 

No  of 
IlOIll% 

Chn>nKichs 

Alpha 

Advli - 

ucitC 

I.  Reforming  the  structure 

ot  teacher  preparation 

. . . . 23 

.80 

no 

11.  p.vi1e>Mon.iliMn 

. . . . 16 

.68 

yc’N 

’ll.  Teacher  education 

content  and  pod«]i»og\ 

. . 16 

.67 

U‘N 

*R.ocd  on  T,iL,Vv  ic*i  of  ,iJJni\  n\ 


Two  results  were  apparent.  It  was  possible  to  construct 
subscales  from  a multidimensional  scaling  analysis  that  would, 
with  a little  revision,  meet  the  necessary  statistical  criteria.  How- 
ever, the  nature  of  the  dimensions  was,  in  this  case,  too  broad 
to  make  subscale  scores  interpretabie.  It  was  not  possible  to  say 
what  a high  or  low  score  measured.  For  example,  a high  score 
on  the  subscale  based  on  Dimension  One,  reform  of  the  struc- 
ture of  teacher  preparation,  could  be  interpreted  as  agreeing 
that  teacher  preparation  should  be  longer  or  more  academically 
stringent  or  both. 

Factor  Analysis  The  matrix  of  correlations  among  the  54  items 
with  squared  multiple  correlations  on  the  diagonal  was  subjected 
to  principal  axis  factor  analysis.  The  reduced  correlation  matrix 
was  analyzed  because  factors  underlying  common  variance  were 
the  latent  variables  ol  interest.  Table  5 presents  the  eigenvalues, 
which  led  to  choosing  a fivc-iactor  solution.  Harris-Kaiser  rotation 
ol  this  solution  yielded  five  interpretabie  factors  and  loadings 
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Table  5 

Eigt’nuiiutf  from  Factor  Analysis  of  54  hems 
Principal  A*  is  So/ufitm.  Using  Squared  Multiple  Correlations 
for  Prut r Gimmunulit>  Estimates 


No.  i't  h.Ktt'p. 

Eigenvalue 

1 

9.26 

2 

2.76 

1.89 

4 

1.72 

3 

1 .41* 

6 

/ 

95 

8 

.69 

9 

.61 

“Win?  bet  . i }..^r.  r* 

for  each  item.  Interfactor  correlations  ranged  from  -.05  to  .31; 
all  but  two  values  were  .16  or  less.  The  factors  were  relatively 
independent  of  each  other  and  approached  orthogonality,  even 
though  an  oblique  rotation  was  used. 

To  use  the  factor  analysis  results  to  create  subscales,  items 
were  assigned  to  subscales  based  on  high  factor  loadings.  Eight 
items  were  dropped  because  of  ambiguous  factor  loadings,  either 
loading  m the  .20  to  .30  range  on  three  or  more  factors  or  loading 
below  .20  on  all  factors.  Of  the  remaining  46  items,  two  had 
loadings  above  .25  on  two  factors  on  which  they  fit  substantively, 
and  thus  they  were  allowed  on  two  subscales.  FortyTour  items 
were  assigned  to  a subscale  defined  by  one  of  the  five  factors. 
An  item  was  put  on  a subscalc  if  its  factor  loading  was  greater 
than  .25  and  it  fit  the  interpretation  given  the  factor. 

The  characteristics  of  these  five  subscales  are  presented 
in  Table  6.  One  sub^cale  met  the  reliability  and  additivity  criteria. 


initial  set  of  subscales.  Revision  of  these  subscales  proceeded 
by  dropping  one  item  at  a time,  prioritized  in  order  of  factor 
loadings,  to  see  whether  all  the  scales  could  meet  the  criteria 
for  usability  which  had  been  defined.  After  an  item  was  dropped, 
the  remaining  items  were  read  for  content,  to  make  sure  content 
validity  was  not  compromised. 

The  results  in  Table  7 show  that  all  five  subscales  based 
on  factor  analysis  did,  after  revision,  meet  criteria.  All  five  sub' 
scales  were  able  to  be  made  additive,  without  data  transformation, 
and  were  able  to  meet  an  alpha  reliability  criterion  of  .70  or 
better.  The  Spearman 'Brown  computations  were  performed  for 
the  sake  of  comparing  the  scales,  and  they  are  reported  in  Table 
7.  It  is  likely,  however,  that  additional  items  might  not  be  able 
to  be  found,  realistically,  for  the  shorter  scales.  Many  items  were 
discarded  just  to  create  the  subscales  as  they  are.  Thus  the  cri- 
terion  of  .70  was  compared  with  the  obtained  alphas,  not  the 
projected  ones. 


Table  7 

Characteristics  of  Revised 
Subscales  Based  Factor  Analysis 


Subscalc  CViuent 

No  ot 
Items 

Chfnnhich'* 
A lpha 

Comrcusl 

Alpha* 

Ac- 

tivity' 

1.  Curriculum  structure  . . 

5 

.84 

.91 

vo 

11.  Curriculum  content 

10 

.77 

.i  i 

ves 

ill.  Collcmalitv  

3 

.70 

.89 

sos 

IV.  Negative  impact. 

V.  Practical  application 

5 

.70 

.82 

yes 

of  research 

4 

.71 

.86 

so 

*'"r«  .irm  in-Br.’wn  pri‘icOi<-n  <*i  nluf  .inv  Kt-o.l  ..n  10 
ImUV-  »<•-«  .'t  ...Mil;'.  n\ 


Table  6 

ChurtMcTisncs  of  Subscalc s 
Based  Factor  Analysis  54  Items 


>uh-i  i\c  CVnu-nt 

N->  "I 

Iti-nis 

t ’hr.-nhu  IV- 
Alplu 

AJJ. 

tlVltN  * 

I Curriculum  smut urc 

17 

.8° 

n.  < 

II  Curriculum  content 

10 

. i i 

\es 

III.  (Vllecnliu 

s 

74 

ni’ 

W Negatise  impao  . . . 

6 

6 J 

\e- 

V Practical  applK.iMi>n  rescan. h 

1 

-■  > 
i »- 

n > 

Of  the  remaining  four,  three  met  the  lchahihtv  criterion  ol  .70 
hut  were  not  additive.  One  MiKcale  was  additive  but  had  an 
alpha  value  of  .PA  Factor  analysis  had  led  to  the  most  promising 


Discussion 

In  educational  research,  unidimensional,  summarive 
scales  are  commonly  used  because  of  relative  ease  of  calculation 
and  apparent  clarity  of  meaning.  Am  attitude,  conceived  and 
explained  as  a measure  of  level  of  agreement  with  a set  of  items, 
is  intuitively  accessible  to  both  readers  and  researchers.  Using 
summative  scales,  however,  requires  sifting  multidimensional 
issues  with  some  procedure  that  validly  sorts  items  and  assigns 
them  to  unidimensional  scales.  The  resulting  scales  must  be 
sensible  and  accessible  to  mind,  but  their  statistical  properties 
must  not  he  compromised.  Only  then  can  a researcher  discuss 
issues  and  draw  conclusions  with  confidence. 

This  study  examined  three  procedures  for  grouping  irerns: 
rational  organization,  factor  analysis,  and  multidimensional 
scaling.  Three  different  configurations  ol  items  resulted.  Each 
of  these  three  configurate  mis  was  evaluated  acu  irding  to  whether 
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it  could  provide  the  basis  for  reliable,  interpretable  subscales. 
Results  indicated  that  with  the  subscales  based  on  factor  analysis, 
it  was  possible  to  refine  subscales  to  meet  the  criteria  of  reliability, 
additivity,  and  interpretabilitv  simultaneously.  All  three  methods 
gave  rise  to  promising  “first  draft”  subscales.  Rational  organization 
did  not  offer  criteria  for  prioritizing  items  for  subscale  revision. 
Multidimensional  scaling  resulted  in  item  groupings  on  which  a 
measure  was  not  easily  intcrpretable.  None  of  the  methods  led 
directly  to  a set  of  usable,  interpretable  subscales.  In  each  case, 
additional  effort  was  required  to  reduce  the  number  of  items  on 
the  subscales  to  get  additive  scales,  composed  of  items  which 
both  functioned  together  (reliability)  and  functioned  in  the 
same  way  (additivity). 

Many  examples  exist  in  the  social  and  behavioral  sciences 
where  a set  of  items  is  constructed  and  one  methodological  tech- 
nique is  applied  to  group  items,  without  consideration  for  reli- 
ability, additivity,  content  and  construct  validity  all  together. 
This  study  strongly  confirmed  the  need  to  critically  examine 
and  refine  subscale  procedures  before  any  interpretation  of  data 
is  attempted.  Checking  alpha  reliability  and  content  interpret- 
ability  are  common  practices;  checking  for  additivity  when 
subscale  scores  are  to  be  simple  sums  of  item  responses  is  not 
common  practice.  This  study’s  data  would  have  yielded  different 
subscale  scores,  conveying  different  information,  had  reliability 
and  interpretability  been  the  only  criteria  for  subscale  construc- 
tion. It  would  have  been  difficult  to  certify  that  such  subscales 
really  measured  the  same  attitude  for  all  respondents,  and  thus 
it  would  also  have  been  difficult  to  certify  exactly  what  the 
attitude  in  question  (the  underlying  construct)  was.  Reliability 


and  validity  would  therefore  both  have  been  in  doubt. 

This  study  has  illustrated  a way  of  arriving  at  clear,  inter- 
pretable subscales  which  can  be  applied  by  researchers  whose 
primary  interest  is  the  subscale  score.  Many  studies  need  only 
be  concerned  about  the  statistical  qualities  of  their  scales  insofar 
as  they  ensure  data  in  which  the  researcher  can  place  confidence 
and  results  which  he  or  she  can  interpret  with  assurance.  Apply- 
ing the  criteria  of  reliability,  additivity,  and  interpretability  in 
the  process  of  subscale  refinement  speaks  to  the  same  issues 
which  can  be  addressed  by  more  complex  weighting  and  scaling 
techniques.  Using  only  items  which  qualify  according  to  these 
criteria  makes  more  complicated  schemes  unnecessary'.  Straight- 
forward weighting,  in  turn,  makes  it  easier  to  define  the  attitude 
measured  by  the  subscale. 

There  is  a cost  involved  \v  ith  applying  these  criteria  before 
a scale  is  defined  and  disallowing  items  which  do  not  comply. 
The  cost  is  lost  items.  The  original  54  items  in  this  study’s  data 
set  were  reduced  to  27,  a loss  of  27  items.  Some  of  them  were 
poor  items,  but  some  were  well-written  items  which  simply  did 
not  contribute  to  reliable  and  additive  subscales.  Whether  or 
not  the  gain  in  simplicity  of  subscale  score  calculation  and  inter- 
pretation is  worth  writing  and  then  discarding  so  many  extra 
items  w-ould  depend  on  the  particular  study  in  question.  Further 
research  would  help  indicate  whether  this  technique  always  costs 
so  many  extra  items,  or  w'hether  the  large  number  dropped  w*as 
specific  to  this  survey.  It  is  also  necessary  to  guard  against  changing 
content  when  dropping  items.  Losing  content  by  removing  items 
was  not  a problem  in  this  study,  but  it  could  be  in  others,  and 
care  must  be  taken. 
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Both  Sides  Now:  Parent  Choice 

The  Mid-VGfesiem  Educational  Researcher  is  presenting  two  sides  to  an  important  issue  in  education  today.  From  the  local  to 
the  national  level  the  right  of  parents  to  choose  the  school  their  children  attend  is  being  debated.  The  President  of  the  United  States 
has  made  this  part  of  his  national  agenda  for  education.  William  R.  Hazard  was  asked  to  present  the  positive  side  of  parent  choice. 
Dr.  Hazard  is  a practicing  attorney  and  a professor  of  administration  and  social  policy  in  the  School  of  Education  and  Social  Policy 
at  Northwestern  University.  Gregory’  J.  Marchant  presents  the  negative  side  of  parent  choice.  Dr.  Marchant  is  an  assistant  professor 
of  educational  psychology  at  Ball  State  University.  The  authors  wrote  their  pieces  independent  of  each  other.  Therefore,  one  position 
is  not  a response  to  the  other.  We  encourage  you  to  write  to  us  with  your  responses. 


Some  Thoughts  on  Educational  Choice 

By  William  R.  Hazard,  Northwestern  University 

Family  choice  in  schooling  may  be  in  mortal  danger— it 
just  recently  moved  onto  President  Bush’s  political  agenda  for  the 
1992  elections.  That  fact  alone  could  spell  the  demise  of  a good 
idea  whose  time  may  be  over  long  before  it  is  given  a fair  trial. 
Building  on  the  resurrected  notion  of  Milton  Friedmans  voucher 
scheme  and  Jack  Coons’  California  Initiative  for  Family  Choice 
(Coons,  1979),  this  new  variation  on  the  older  themes  enjoys 
support  from  liberals  and  conservatives  of  all  persuasions  and  for 
diverse  reasons.  Choice  in  schooling  is,  at  this  time,  a term  of 
art.  A wide  range  of  meanings  atrach,  including  open-enrollment 
across  existing  district  boundaries,  across  attendance  boundaries 
within  districts,  open  enrollments  within  a state,  vouchers  (evi- 
dencing the  holder’s  legal  entitlement  to  X amount  of  dollars) 
redeemable  at  public  or  private  schools  of  the  holder’s  choice, 
and  many  more.  The  mechanics  of  the  choice  plans,  operative 
and  proposed,  vary’  widely  and  the  boundaries  of  the  choice 
consequences  range  across  the  schooling  landscape.  To  propound 
or  endorse  choice  in  these  fluid  settings  say  little;  clear  delinea- 
tion of  the  nature,  limitations,  and  dimensions  of  the  specific 
choices  must  give  shape  to  the  choices  chosen. 

This  brief  statement  will  attempt  clarification  of  the  basic 
notion  of  choice  in  schooling  and  a sketch  of  some  reasons  for 
current  interest  in  the  concepts  and  issues.  There  is  substantial 
literature  developed  over  the  past  two  or  three  decades  worth 
a close  examination  by  serious  students.  My  tongue- in-cheek 
opening  lines  hint  at  what  I believe  is  a more  serious  problem. 
Professor  Coons  and  his  colleagues  have  examined  the  choice 
issues  and  designed  a plan  for  California.  This  plan  envisioned 
the  creation  and  public  support  of  free-standing  family  choice 
schools  that  would  operate  essentially  free  of  burdensome  state 
regulatory  restraints  and  under  regulations  responsive  to  parent 
preferences.  The  push  in  the  Coons’  plan  focused  on  access- 
ing all  children  to  quality  education  of  choice,  regardless  of  cot - 
nornic  means  of  the  family.  Fiscal  savings  or  at  least  no  greater 
costs  (than  now  borne  by  public  schools)  were  visualized  by  the 
California  Initiative. 

In  the  “debate”  sponsored  b>  The  Khpf)<m,  Professor  R. 
Freeman  Rut rs  challenged  the  Coons’  plan.  According  to  Butts 
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Your  School:  Love  It  or  Leave  It 

By  Gregory  J.  Marchant,  Ball  State  University 

How  could  anyone  be  opposed  to  parent  involvement, 
free  choice,  rewarding  “good”  schools  and  punishing  “had”  ones? 
According  to  many  reformers,  by  simply  allowing  parents  to 
choose  ;he  best  school  for  their  children  American  education 
will  be  on  the  road  to  recovery’.  Unfortunately  there  are  no  simple 
answers,  and  a policy  that  may  satisfy  some,  may  hurt  others. 
Parent  choice  is  only  a panacea  for  some.  For  those  who  need  the 
greatest  help  it  is  a threat,  and  for  educational  reform  it  is  a lie. 

My  position  is  based  on  three  assumptions  regarding 
public  education: 

1.  Public  schools  should  provide  the  best  education  pos- 
sible for  all  children.  Schools  are  primarily  groups  of  students— 
not  teachers,  not  principals,  and  not  parents.  The  primary-  job 
of  education  is  to  teach  children— not  reward  or  punish  teachers 
or  principals  and  not  to  satisfy  parents. 

2.  Public  schools  should  he  run  as  efficiently  as  possible. 
The  education  of  all  of  the  children  in  the  United  States  is  an 
expensive  endeavor.  We  need  to  get  the  most  education  out  of 
our  education  dollars. 

3.  Those  students  with  the  greatest  needs  should  have 
available  to  them  at  least  as  many  resources  and  skilled  teachers 
as  those  students  with  the  greatest  assets.  Public  education  needs 
to  he  fair  and  equitable  in  providing  service  to  the  children. 
Children  on  the  whole  should  not  be  shortchanged  in  order  to 
benefit  a select  few. 

Having  stated  these  simple  assumptions  let  us  consider 
the  impact  that  parent  choice  could  have.  Parent  choice  advo- 
cates suggest  that  good  schools  should  be  rewarded  and  poor 
schools  should  be  punished  for  being  ineffective.  I have  already 
suggested  that  although  teachers,  principals,  and  parents  are 
all  important  players,  our  major  concern  should  be  for  the  chil- 
dren. In  particular,  I am  concerned  for  the  at-risk  children.  1 am 
concerned  about  reducing  resources  to  the  students  who  need 
them  the  most.  These  resources  are  not  just  tax  dollars.  The 
most  important  resources  are  human.  It  is  a resource  to  have 
motivated  achieving  students  in  a classroom.  It  is  a resource  to 
have  concerned  parents  providing  their  support  and  airing  their 
concerns  about  their  school  and  their  teachers.  Paronr  choice 
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Educational  Choice  (continued) 

the  choice  movement  is  driven  by  the  private  schools’  determin- 
ation to  tap  into  public  tax  support  aided  and  abetted  by  a strong 
desire  to  curb  school  taxes.  The  fatal  flaw  in  the  voucher-like 
scheme  is  its  real  capacity  to  retribalize  American  society.  He  is 
worried  that  the  choice  plan  of  Cooi  ^ would  “ . . return  a proper 
government  function  [schooling]  achieved  over  200  years  to  the 
private  markets  and  entrepreneurs.  . . ” (Butts,  1979). 

Pushed  onto  the  backbumers  by  the  public  greed  and 
private  cupidity  of  the  1980s,  the  issues  slept  along  with  our 
president.  There  were  far  more  attractive  issues  of  exploding 
national  debt,  the  military  buildup,  and  the  egregious  excesses 
of  the  Yuppie  paradise  years.  The  main  ideas  of  educational 
choice  would  not  go  away.  The  press  for  school  reform  inten- 
sified in  the  mid-1980s,  stimulated  by  numerous  national  calls 
for  excellence,  restructuring  and  overall  reform  in  our  public 
schools.  The  historic  notions  of  efficiency  (Taylor,  1911)  in  man- 
agement were  dusted  off.  given  a productivity  spin,  and  fueled 
a merciless  bashing  of  public  schooling.  Pockets  of  choice  and 
choice-colored  thinking  took  root  in  the  fertile  ground  of  public 
disenchantment  with  public  schooling. 

Minnesota  adopted  a voluntary  open-enrollment  plan 
phased  in  from  1987  through  1991.  Except  tor  three  districts 
operating  under  desegration  guidelines,  any  student  can  change 
districts  in  the  state  at  will  (Pearson,  1989).  Under  the  Minnesota 
plan,  according  to  Pearson,  the  loss  of  revenues  to  those  districts 
losing  students  could  be  disastrous.  There  is  no  way  to  avoid  the 
reality  that  painful  dislocations  can  follow  ill-designed  choice 
plans.  Such  severe  dislocations  can  be  avoided  and  the  public 
interest  still  be  served  by  healthy  competition  occasioned  by 
choice.  To  argue  against  choice  in  general  by  pointing  to  the 
problems  of  a particular  plan  is  silly.  The  object  of  family  choice 
is  to  empower  parents  to  choose  among  competing  schooling 
options.  If  a given  option  is  not  effective,  over  time  it  will  lose 
client  support.  If  a given  choice  plan  is  defective  and  carries 
harmful  side  effects,  its  sponsors  should  revise  the  plan  to  elimi- 
nate the  defects  and  retain  the  choice.  We  are  way  beyond  the 
time  when  informed,  concerned  parents  should  be  given  take- 
it-or-leave-it  public  schooling.  Most  of  us  as  school  professionals 
occasionally  think  we  know  what’s  best  for  children  and  parents. 
And  occasionally  we  do.  But  the  fact  is  that  most  parents  care 
as  much  or  more  than  we  do  about  their  children,  their  schooling, 
and  their  childrens  future  and  can  make  excellent  choices. 
Properly  informed,  most  parents  do  a pretty  fair  job  sorting  out 
options  for  their  family  interests. 

In  its  simplest,  school  choice  aims  to  give  all  parents 
the  options  enjoyed  now  by  the  affluent  parents.  Under  smart 
choice  plans,  good  schools  will  attract  and  serve  parents  and 
children  and  bad  schools  will  not.  Obviously,  the  ’‘death”  of  a 
school  is  painful  and  sad.  There  is  no  reason , however,  to  support 
ineffective  schools  after  they  have  had  a fair  chance  to  succeed. 
To  argue  for  poor  schools  is  to  sacrifice  generations  of  children 
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Love  It  or  Leave  It  (amunued) 

allows  these  resources  to  be  shifted  to  “better”  schools.  But  what 
happens  to  the  children  left  behind.7  This  is  a clear  case  of  the 
rich  getting  richer  and  the  poor  getting  poorer.  By  taking  resources 
from  the  poor  and  redistributing  them  to  the  rich,  public  educa- 
tion w'ould  be  acting  as  Robin  Hood  in  reverse. 

Although  there  is  not  a great  deal  of  research  to  draw 
upon,  there  was  one  extensive  study  on  a parent  choice  voucher 
system  in  Alum  Rock,  California.  What  follows  are  the  conclu- 
sions presented  by  Linda  Darling-Hammond  of  the  Rand  Cor- 
poration (1983)  to  a House  subcommittee: 

. . .after  four  years  of  extensive  bilingual  publicity,  a 
quarter  of  the  parents  in  Alum  Rock  did  not  know'  the 
voucher  system  existed,  and  a much  larger  proportion 
did  not  have  accurate  information  about  the  program  or 
the  specific  schools.  Parents  of  low  income  levels  and 
lower  educational  attainment  were  less  well-informed 
than  other  parents  . . . only  about  20  percent  of  students 
attended  schools  outside  their  neighborhoods.  The 
alternatives  created  by  the  voucher  plan  proved  most 
attractive  ro  socially  advantaged  parents . . .we  have 
no  evidence  that  parent  choice  results  in  increased 
student  achievement.  Nor  do  we  have  evidence  that 
the  mere  existence  of  alternatives  will  provide  better 
educational  options,  especially  for  the  children  we  are 
concerned  about  here  (Chapter  I).  (p.  75-77) 

In  a time  when  many  communities  are  attempting  to 
gain  more  control  of  their  schools,  parent  choice  works  against 
this  effort.  If  children  in  a neighborhood  are  going  to  several 
different  schools,  there  is  little  local  ownership  of  a school. 

If  the  cost  to  at-risk  students  in  resources  and  to  the 
community  in  local  ownership  is  not  enough,  there  is  the  poten- 
tial cost  and  management  of  student  transportation.  If  all  parents 
are  really  to  have  a choice,  transportation  has  to  be  provided 
for  their  children  to  their  school  of  choice.  One  can  imagine 
the  complexity  and  cost  of  a system  wrhere  four  children  living 
next  to  each  other  would  need  to  be  transported  to  four  different 
schools  in  different  geographical  locations.  This  would  require  a 
substantial  amount  of  instructional  money  be  diverted  to  trans- 
portation (Finch,  1985),  w'hich  would  not  seem  to  be  the  most 
efficient  or  effective  way  to  run  schools. 

Another  question  that  a number  of  school  districts  with 
magnet  or  special  schools  have  already  faced  is,  what  do  you 
do  w'hen  there  is  not  enough  room  in  the  preferred  school  for 
all  of  the  students.7  What  is  admission  going  to  be  based  on.7 
Test  scores?  This  will  clearly  skim  the  higher  achieving  students 
and  likely  be  biased  against  minorities.  First  come,  first  served? 
Parents  have  been  known  to  camp  out  in  lines  for  several  days 
in  order  to  get  their  children  into  the  school  of  choice.  This 
means  that  children  with  parents  not  interested  or  nor  able  to 
commit  themselves  to  this  kind  of  practice  will  he  left  out. 
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Educational  Choice  (continued) 

on  the  altar  of  the  status  quo.  I’m  mindful  that  the  terms  used 
are  loaded  way  beyond  reason,  hut  to  turn  away  from  parent 
choice  and  competitive  school  options  is  to  condemn  all  but 
the  wealthier  children  in  most  urban  settings  to  highly  troubled 
school  experiences.  Of  course  there  are  bright  spots  and  many 
well-intended,  caring  public  school  people.  The  fact  remains 
that  tor  whatever  reasons,  many  of  these  schools  admittedly 
aren’t  serving  many  parents  and  many  children.  The  historic 
role  of  public  schools  as  the  common  denominator  of  cultural 
transmission  and  value  development  is  no  longer  accepted  in 
many  racially,  culturally,  socially,  economically  and  politically 
diverse  communities.  Perhaps  it  is  time  to  try  some  other  models. 

Nathan  (1989)  reminds  us  that  we  can  make  informed 
decisions  about  school  choice.  There  is  a body  of  scholarship 
and  research  that  reduces  the  risk  of  inadvertent  failure  and  harm 
when  choice  plans  are  undertaken,  Nathan  (1989)  identified 
three  assumptions  underlying  public  school  choice: 

1.  There  is  no  single  kind  of  school  best  for  all  students 
or  educations. 

2.  Controlled  competition  can  help  stimulate  improve- 
ment among  schools. 

3.  Increasing  options  expands  opportunity. 

Let  me  add  two  more:  (4)  the  effectiveness  of  choice  can 
be  studied  fairly  and  systematically,  and  (5)  until  we  try  carefully 
designed  choice  options,  we  will  never  know  their  virtues  or 
their  vices.  Nathan  further  opines  that  consensus  is  emerging 
as  to  key  features  in  choice  plans.  We  do  not  have  to  fly  blind 
into  the  choice  setting. 

I regret  that  the  published  debates  about  choice  seem  to 
exalt  stridency  and  cant  above  calm,  lower-keyed  debate.  The 
fiery'  language  on  either  side  of  the  choice  issue  doesn’t  promote 
thorough  examination.  Pearson  (1989)  postulated,  for  example, 
that  open  enrollment  may  violate  provisions  in  both  the  Min- 
nesota and  the  U.S.  Constitutions.  It  seems  to  me  that  the  Con- 
stitutional history  since  the  Brotm  decision  clearly  demonstrates 
the  flaws  of  our  current  non-choice  school  systems.  It’s  hard  to 
believe  that  giving  parents  and  children  reasonable  choices  as 
the  form  and  substance  of  schooling  need  be  unconstitutional. 

Whatever  problems  that  may  flow  from  public  school 
choice  plans  (and  clearly  there  are  many)  can  be  avoided  or 
remedied.  Unbridled  competition  among  schools  can  be  cutthroat 
and  hurtful;  but  competition  can  be  bridled  and  its  benefits 
enjoyed.  The  Constitutional  barrier  to  using  public  funds  for 
private  purposes  has  a hollow  ring.  The  child-benefit  doctrine 
has  been  with  us  since  the  Cochrane  decision  in  1930.  If  that 
doctrine  (admittedly  a legal  fiction)  has  sustained  extensive 
devotion  of  tax  funds  to  nonpublic  school  uses,  it’s  no  great  step 
to  giving  the  fair  share  of  educational  entitlement  money  to  a 
child  via  vouchers  and  let  the  voucher  follow  the  child.  It  choice 
leads  to  “skimming”  the  cream  from  the  public  schools  bounded 
choice  can  prevent  that  mischief.  It  is  mu  necessary  to  argue 
tor  decimating  public  schools  m older  to  support  choice.  Choice 


Love  It  or  Leave  It  (continued) 

Unregulated  vouchers  would  result  in  certain  classes  of 
parents  not  being  able  to  secure  the  quality  education 
they  want  for  their  children  if  schools  are  allowed  to 
practice  selective  admissions  of  any  kind. 

(Darling-Hammond,  1983,  p.  76) 

Parent  choice  is  not  a means  of  improving  schools.  It  is 
a way  to  avoid  the  tough  questions  of  change  by  allowing  the 
most  concerned  parents  (voters)  to  leave  undesirable  situations. 
“Love  it  or  leave  it”  was  not  an  appropriate  response  to  those 
dissatisfied  with  conditions  in  the  sixties,  nor  is  it  an  appropriate 
policy  for  improving  schools.  Parents  need  to  be  involved.  How- 
ever, involvement  is  not  a one  time  choice.  Parent  involvement 
needs  to  be  an  ongoing  process  to  bring  about  positive  change. 
We  need  to  improve  our  schools,  not  abandon  them.  Educational 
reform  is  needed.  However,  parent  choice  is  not  the  kind  of  edu- 
cational reform  which  will  improve  our  troubled  schools.  It  is 
politics,  and  it  is  politics  tor  those  who  need  it  the  least. 
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need  not  lead  to  wastelands  in  public  schools.  There  may  he 
some  public  schools  that  should  wink  out.  They  may  not  be  able 
to  compete  on  any  fair  criteria  in  a choice  setting.  If  so,  let  them 
go.  Choice  need  not  threaten  long-term  public  school  stability. 
In  fact,  choice  may  promote  greater  stability  by  clearly  offering 
parents  an  opportunity  to  support  their  school  choice.  If  parents 
need  information  to  make  wise  choices,  then  we  give  them  infor- 
mation. I’ll  say  it  again.  Whatever  problems  choice  may  open, 
they  can  be  solved  by  carefully  planned  and  monitored  dimen- 
sions. If  problems  arise,  then  redesign  to  solve  the  problem  but 
preserve  choice. 

CkkxI  schooling  costs  money.  It’s  a serious  mistake  to 
think  that  choice  schemes  somehow  will  produce  big  results 
without  paying  the  costs.  If  we  go  into  choice  thinking  it  will 
save  money,  the  children  will  pay  the  price  saved  for  the  tax- 
payer. Choice  need  not  give  the  sectarian  schools  access  to  the 
public  trough.  If  choice  leads  to  sectarian  tribal i:at ion,  we  will 
all  lose.  (omtinuid  on  pag<  18) 


Lessons  for  Minority  Recruitment 
in  Teacher  Education 


The  first  issue  in  teacher  education  that  Mary  Kennedy 
addiessed  in  the  May  1991  Kappan  was  that  of  minority  represent 
tation  in  teaching.  Attracting  and  retaining  minorities  in  teaching 
and  teacher  education  is  a growing  concern.  One  large  founda- 
tion has  taken  the  lead  in  sponsoring  efforts  to  recruit  and  retain 
minorities  in  the  area  of  journalism.  Perhaps  they  have  some 
ideas  that  education  can  borrow. 

In  a recent  meeting,  the  Knight  Foundation  debunked 
many  of  the  major  myths  concerning  minority  journalism  stu- 
dents by  describing  the  results  of  some  of  the  programs  the 
foundation  lias  sponsored.  The  Knight  Foundation  granted  2.3 
million  dollars  to  six  institutions  in  the  last  four  years.  These 
institutions  were:  The  University  of  Florida,  College  of  Journalism 
and  Comm  unicat  ion,  Dean  Ralph  Lowenstein,  Directors  Helen 
Aller  and  Charles  J.  Harris;  University  of  Missouri,  School  of 
Journalism,  Dean  Dean  Mills,  Program  Director  Gail  Baker- 
Woods;  San  Francisco  State,  Center  for  Integration  and  Improve- 
ment of  Journalism,  Dean  Betty  Metsger,  Center  Director  John 
Funabiki;  Wayne  State  University,  Journalism  Institute  for  Minor- 
ities, Program  Director  Ruth  Seymour;  Michigan  State  University, 
School  of  Journalism,  Director  Stan  Soffin;  and  Florida  A&.M, 
School  of  Journalism,  Dean  Bob  Ruggles.  These  universities  used 
the  grants  to  establish  and  support  minority  journalism  programs. 
At  the  University  of  Missouri,  a sophisticated  marketing  plan 
using  direct  mail,  advertising,'  and  personal  contact  directed  at 
state  high  school  students  has  tripled  the  number  of  prejoumalism 
minority  students.  At  the  University  of  Florida  the  number  of 
black  juniors  and  seniors  in  print  journalism  and  advertising  was 
substantially  increased  by  recruiting  and  providing  scholarship 
support  up  to  $3,000  a year  to  college  freshmen  and  sophomores 
and  community  college  students.  The  professional  community 
has  become  involved  at  San  Francisco  State  University’s  Center 
for  the  Integration  and  Improvement  of  Journalism  where  more 
than  170  Bay  Area  journalists  volunteer  as  writing  coaches  and 
mentors.  This  summer  Michigan  State  University  is  offering  a 
one-week  college  credit  program  to  help  minority  high  school 
teachers  and  publications’  advisors  to  better  guide  their  students 


toward  journalism  careers.  The  Florida  Agricultural  and  Mechan- 
ical University  and  Wayne  State  University  also  participated  in 
the  workshop  and  have  special  programs.  At  the  January  1991 
Knight  Foundation  meeting  lead  by  Jim  Spaniolo.  Knight  Foun- 
dation Vice  President,  and  Scott  McGeehee,  representatives  of 
each  of  the  institutions  in  the  minority  recruitment  programs 
shared  their  insights  and  pooled  information.  The  Knight  Foun- 
dations focused  funding  approach  and  the  meeting’s  presentation 
and  discussion  format  provided  grant  recipients  with  the  oppor- 
tunity to  increase  their  collaborative  efforts.  This- process  also 
yielded  a variety  of  successful  recruitment  procedures  and  reten- 
tion programs  that  should  be  of  interest  to  anyone  attempting  to 
increase  minority  recruitment. 

It  has  often  been  said  that  throwing  money  at  a problem 
will  not  make  it  go  away.  Baker  (1991)  has  suggested  that  this  is 
not  true  when  it  comes  to  educating  the  nation’s  children.  The 
programs  of  the  Knight  Foundation  indicate  that  money  may 
also  be  able  to  help  alleviate  some  of  the  problems  that  occur 
in  the  educational  system.  All  of  these  programs  had  formative- 
evaluative  designs,  which  Is  ado  re  Newman  of  The  University  of 
Akron  assisted  in  developing.  The  intent  of  the  designs  was  to 
give  effective  feedback  to  increase  the  likelihood  of  achieving 
success  and  providing  evidence  of  that  success. 

For  additional  information  regarding  these  successful  and 
innovative  programs,  one  can  contact  the  program  directors  at 
their  respective  institutions  or  James  D.  Spaniolo,  Vice  President 
and  Secretary,  Knight  Foundation,  One  Biscayne  Tower,  Suiu 
3800,  2 South  Biscayne  Blvd.,  Miami,  Florida  33131. 
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Educational  Choice  (continued) 

If  we  are  lucky,  educational  choice  will  survive  its  brutali- 
zation at  the  hands  of  the  politicians  and,  after  the  national 
elections,  we  may  be  wise  enough  to  try  it  out. 
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Should  We  Forget  About  Mnemonics ! 


When  I began  my  doctoral  studies  20  years  ago,  the  nature 
and  effectiveness  of  mnemonic  (i.e.,  memory  enhancing)  devices 
occupied  a prominent  place  in  the  psychological  and  educational 
research  literature.  Hundreds  of  studies  were  done  to  determine 
which  cognitive  processes  came  into  play  during  mnemonic  use 
and  the  conditions  under  which  mnemonics  were  most  effective. 
In  general,  these  studies  found  many  mnemonic  devices  to  be 
quite  useful  for  a variety  of  memory  tasks  because  they  invoked 
the  use  of  fundamental  encoding  and  retrieval  principles.  At  the 
same  time,  several  books  were  published  that  explained  how 
mnemonics  could  aid  in  the  recall  of  academic  and  non-academic 
information  (like  remember  the  names  of  the  12  cranial  nerves, 
appointments,  speeches,  and  people’s  names).  Perhaps  the  most 
popular  of  these  memory  improvement  books  was  one  by  Harry 
Lorayne  and  Jerry  Lucas  called  The  Memory  Book  (1974).  If  memory 
serves  me  correctly  (and  wouldn’t  it  be  ironic  if  it  didn’t),  The 
Memory  Book  remained  on  one  or  another  best-seller  list  for  many 
months.  Because  of  the  above-mentioned  research  findings  and 
the  popularity  of  memory  improvement  books,  teachers  were 
strongly  encouraged  to  teach  their  students  how  to  formulate 
and  use  mnemonic  devices. 

But  that  was  then.  The  atmosphere  today  seems  to  me 
to  be  decidedly  different.  One  of  the  first  indications  I received 
that  attitudes  about  mnemonic  use  in  the  classroom  had  changed 
was  a March  16,  1987,  article  in  the  St.  Louis  Post-Dispatc/i  en- 
titled “Memory  Tricks?  Oh,  Just  Forget  it?”  In  that  article, 
Geraldine  Clifford,  professor  of  education  at  the  University  of 
California  at  Berkeley,  is  quoted  as  saying  about  mnemonics: 
“I  really  don’t  see  much  future  for  them.  They’re  like  commence- 
ment addresses;  their  time  is  past.”  According  to  Clifford,  more 
time  should  be  spent  on  teaching  students  how  to  find  than  how 
to  memorize  information.  In  the  same  article,  Patrick  Suppes, 
professor  of  philosophy  at  Stanford  University,  is  quoted  as  saying: 
“The  emphasis  is— and  should  be— on  problem  solving,  not  rote 
memorization.  Problem  solving  is  a lot  more  difficult  than  mere 
memory,  and  it’s  a lot  more  difficult  to  teach.” 


While  the  importance  of  teaching  students  the  skills  o 
critical  thinking  and  problem  solving  cannot  be  denied,  the 
attitude  that  memorization  skills  are  less  important  than  or  ir 
relevant  to  higher-order  thinking  seems  to  me  to  be  misguidec 
on  at  least  three  counts.  First,  we  know  that  the  establishmen 
of  a well-organized,  meaningful  knowledge  base  from  whicl 
information  can  be  reliably  and  accurately  retrieved  is  a prerequi 
site  to  effective  problem  solving.  Second,  mnemonic  instruct ior 
should  be  thought  of  in  terms  of  the  “little  idea”  vs.  the  “bij 
idea.”  The  little  idea  behind  mnemonic  instruction  is  that  sucf 
devices  help  students  reliably  recall  isolated  bits  of  informatior 
in  verbatim  form.  When  viewed  this  way,  I agree  with  the  criti 
cism  that  mnemonics  are  of  limited  use.  But  the  big  idea  behinc 
mnemonic  instruction  is  the  lesson  that  students  can  and  shoulc 
control  the  nature  of  their  cognitive  activity  in  order  to  achieve 
their  academic  goals.  A well-conceived  instructional  program  ir 
thinking  skills  will  try  to  teach  students  that  variations  in  learn 
ing  materials,  test  demands,  and  instructional  characteristic 
require  the  use  of  different  learning  tactics  in  order  to  achieve 
the  best  possible  outcome.  Given  this  view,  mnemonic  device, 
can  be  presented  as  a type  of  learning  tactic  that  are  ideally  suitec 
to  certain  memorization  outcomes.  As  I have  written  elsewhere 
only  in  this  way  can  students  learn  to  become  strategic  learners 
Third,  recent  research  has  shown  that,  with  some  clever  modi 
fications,  certain  mnemonic  devices  can  be  more  powerfu 
than  normal  as  memory  enhancers  and  can  help  students  under 
stand  the  relationships  among  hierarchically  organized  bodie 
of  knowledge. 

The  mnemonic  device  that  has  garnered  the  most  atten 
tion  from  researchers,  and  that  seems  capable  of  facilitatinj 
higher-level  outcomes  as  well  as  verbatim  memory  outcomes,  i 
the  keyword  method.  Originally  developed  as  a means  of  leaminj 
foreign  language  vocabulary,  the  keyword  mnemonic  has  beer 
shown  to  aid  in  the  learning  of  several  tasks  that  require  asso 
ciating  one  thing  with  another.  When  applied  to  foreign  language 

(continued  on  page  2C 
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learning,  the  technique  is  fairly  simple  and  involves  two  steps. 
First,  isolate  some  part  of  the  foreign  word  that,  when  spoken, 
sounds  like  a familiar  English  word.  This  is  the  keyword.  Second, 
form  an  interacting  visual  image  between  the  keyword  and  the 
English  translation  of  the  foreign  word.  I would  like  to  summarize 
for  you  four  recent  studies  of  its  effectiveness.  The  first  two 
studies  constitute  an  integrated  set  since  they  share  a common 
purpose,  materials,  procedures,  and  were  conducted  by  most  of 
the  same  researchers.  The  last  two  studies  also  constitute  a set 
for  the  same  reasons. 

In  the  first  study,  Martin  Rosenheck,  Mary  Levin,  and 
Joel  Levin  (Journal  of  Educational  Psychobgy,  1989,  Vol.  81,  No.  2) 
examined  how  well  a pictorial/keyword  technique  helped  college 
students  leam  both  the  facts  and  relationships  contained  in  a 
botanical  taxonomy. 

Rosenheck  et  al  argue  that  the  common  practice  of  pro- 
viding students  with  a figural  box-and-line  representation  of  a 
scientific  taxonomy  is  likely  to  be  a weak  learning  aid  because 
it  provides  no  specific  means  for  learning  either  the  connections 
among  the  elements  of  a taxonomy  or  the  specific  meaning  of 
each  element.  The  taxonomy  used  in  their  study  was  a four-level 
plant  classification  system.  The  top  level,  labeled  division,  con- 
tained the  box  vascular  plants.  This  broken  down  into  the  sub- 
divisions angiosperms  andgymnosperms.  Angiosperms  was  broken 
down  in  the  classes  dicotyledons  and  monocotyledons.  Gymno- 
sperms  was  broken  down  into  the  classes  conopsida  and  gnetopsida. 
Each  class  was  then  broken  down  into  two  or  three  orders.  Sapin- 
dales,  rosales , and  rubiales f for  example,  were  the  orders  for  the 
class  dicotyledons.  All  boxes  were  connected  by  angled  lines  to 
form  a typical  figural  display. 

The  subjects  in  this  study  were  randomly  assigned  to 
either  a mnemonic  treatment  condition,  a taxonomic  treatment 
condition,  or  a free  study  condition.  Subjects  in  the  mnemonic 
condition  first  learned  a set  of  16  concrete  keywords  to  help 
recall  the  names  of  each  plant  group.  For  example,  the  respective 
/keywords  for  angiosperm,  dicotyledon , and  sapindales  were  angel, 
dinosaur ; and  sap.  They  were  then  given  a booklet  that  included 
the  botanical  name  and  major  distinguishing  feature  of  each 
plant  group  and  were  told  to  concentrate  on  learning  its  structure. 
To  help  them  do  this,  each  page  of  the  booklet  was  accompanied 
by  something  called  a pictorial  mnemonomy.  These  were  illus- 
trated representations  of  the  keywords,  that,  through  their  place- 
ment on  the  page,  approximated  the  higher  and  lower  positions 
of  the  categories  in  the  taxonomy.  For  example,  to  illustrate  the 
fact  that  dicotyledons  are  a class  of  the  subdivision  angiosf>e77ns, 
students  saw  a picture  of  an  angel  standing  on  a cloud  holding  a 
leash  at  the  end  of  which,  and  placed  below  the  angel,  was  a 
dinosaur.  Students  were  then  given  a second  version  of  the  booklet 
to  read.  Although  the  text  of  the  second  version  was  identical 
to  the  first,  the  students  were  told  now  to  concentrate  on  remem- 
bering the  distinguishing  characteristics  of  each  plant  group  by 
using  a new  set  of  16  mnemonic  illustrations.  These  pictures 
combined  the  same  keyword  illustrations  from  the  first  booklet 
with  details  that  represented  the  unique  features  of  that  plant 


group  (e.g.,  a picture  of  an  angel  holding  flowers  to  represent  that 
angiosperms  are  flowering  plants). 

Subjects  in  the  taxonomic  condition  were  asked  to  first 
familiarize  themselves  with  the  16  plant  group  names  and  then 
read  through  two  versions  of  the  text,  concentrating  first  on  the 
taxonomic  structure  and  then  on'  the  characteristics  of  each 
plant  group.  Version  one  contained  the  standard  taxonomic  figure 
described  earlier  as  an  aid  to  learning  the  taxonomy’s  hierarchical 
structure.  The  second  booklet  contained  boxed  information 
(e.g.,  angiosperms  produce  flowers)  as  an  aid  to  learning  the  char- 
acteristics of  each  plant  group. 

The  free  study  subjects  also  read  the  passage  twice  but 
were  told  to  use  their  own  methods  for  learning  the  hierarchical 
relationships  and  the  plant  group  characteristics. 

Each  subject  took  four  tests.  The  first  two,  taxonomy 
production  and  taxonomy  use,  were  taken  after  the  initial  reading 
of  the  passage.  The  latter  two,  definitions  and  problem  solving, 
were  taken  after  the  second  version  of  the  booklet  had  been  read. 
All  four  tests  were  taken  again  two  days  and  two  months  later. 

The  taxonomy  production  test  required  the  students  to 
draw  a standard  taxonomic  diagram  comprised  of  plant  group 
names  in  boxes  connected  by  lines.  The  taxonomy  use  test  re- 
quired students  to  label  40  statements  like  “All  sapindales  are 
dicotyledons  ” as  true  or  false.  The  definitions  test  required  students 
to  provide  the  identifying  characteristic  that  distinguished  each 
plant  group  from  the  others  at  the  same  taxonomic  level.  The 
problem-solving  test  required  the  combined  use  of  classification 
and  characteristic  information.  Students  had  to  decide  which 
order  or  orders  a “mystery"  specimen  could  be  given  only  one 
or  two  of  the  three  necessary  distinguishing  characteristics. 

As  expected,  the  mnemonic  group  outscored  the  taxo- 
nomic and  free  study  groups  by  a sizable  and  statistically  signifi- 
cant amount  on  most  of  the  measures  and  over  most  of  the  time 
periods,  thereby  demonstrating  its  superiority  as  a means  of 
mastering  both  the  structure  of  a scientific  taxonomy  and  the 
characteristics  of  its  members.  Although  the  mnemonic  group 
outscored  the  taxonomic  group  on  the  problem-solving  test  all 
three  times,  the  difference  was  statistically  significant  only  for 
the  two-day  delayed  test. 

In  the  second  study  in  this  series  ( Reading  Psychology, 
1988,  Vol.  9),  Mary  Levin,  Martin  Rosenheck,  and  Joel  Levin 
looked  at  the  relative  effectiveness  of  the  “full"  mnemonic  treat- 
ment examined  in  the  first  study  versus  two  “partial”  mnemonic 
treatments  and  a non-mnemonic  condition.  The  original  treat- 
ment was  called  full  because  it  contained  pictorial/keyword  tech- 
niques designed  to  help  students  leam  both  the  classification 
system  and  the  characteristics  of  each  plant  group.  The  partial 
treatments  contained  pictorial/keyword  techniques  designed  to 
help  students  acquire  either  the  classification  information  or 
the  characteristic  information.  The  reading  material,  procedures, 
and  criterion  measures  were  identical  to  those  in  the  first  study. 
The  only  difference  in  criterion  test  administration  was  the 
elimination  of  the  two-month  delay  Hence,  all  comparisons  are 
for  immediate  and  two-day  delayed  testing. 
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There  were  four  conditions  to  which  115  undergraduates 
were  randomly  assigned.  The  first  condition  replicated  the 
mnemonic  treatment  of  the  first  study.  In  the  second  condition, 
subjects  learned  the  keywords  for  each  plant  group  and  studied 
the  pictorial  mnemonomy  that  accompanied  the  text  in  booklet 
1 as  a way  of  learning  the  classification  system,  but  were  told  to 
use  their  own  best  study  method  as  they  read  through  booklet  2 
to  leam  the  plant  group  characteristics.  Subjects  in  the  third 
condition  were  given  a box-and-line  figural  taxonomy  in  booklet 
1 and  the  set  of  16  keyword  mnemonic  illustrations  in  booklet  2. 
to  leam  the  plant  group  characteristics.  Subjects  in  the  third 
condition  were  given  a box-and-line  figural  taxonomy  in  booklet 
1 and  the  set  of  16  keyword  mnemonic  illustrations  in  booklet  2. 
Subjects  in  the  fourth  condition  saw  the  box-and-line  figural 
taxonomy  in  booklet  1 and  were  told  to  use  their  own  study 
method  in  booklet  2 to  leam  the  plant  group  characteristics. 

The  pattern  of  results  in  this  study  was  slightly  different 
than  was  the  pattern  for  the  first  study.  The  statistically  signifi- 
cant difference  in  taxonomy  production  disappeared  although 
it  is  worth  noting  that  three  times  as  many  students  in  the 
mnemonic  group  produced  a perfect  taxonomy  as  did  students 
in  the  non-mnemonic  group  (33  percent  vs.  10  percent,  respec- 
tively).  The  statistically  significant  difference  in  taxonomy  use 
was  maintained  only  on  the  two-day  delayed  test.  The  statistically 
significant  difference  for  the  definitions  test  was  maintained  on 
both  the  immediate  and  delayed  tests.  Finally,  the  statistically 
significant  difference  in  problem  solving  was  maintained  only 
on  the  two-day  delayed  test. 

There  seems  to  me  to  be  two  broad  conclusions  that  can 
be  drawn  from  the  data  produced  by  these  two  studies.  First,  the 
keyword  mnemonic  (and  perhaps  others)  can  be  modified  so  that 
it  aids  in  the  performance  of  higher-order  transfer  tasks  that 
depend  on  accurate  retrieval  of  factual  information.  This  is 
certainly  good  news  for  those  who  continue  to  hold  mnemonic 
instruction  in  high  regard.  Second,  even  clever  mnemonic  devices 
like  the  pictorial  mnemonomy  are  not  uniformly  effective.  The 
mnemonomy  works  better  than  alternative  techniques  only  for 
certain  measures,  testing  times,  and  types  of  items. 

To  give  you  some  idea  of  the  flexibility  of  the  keyword 
mnemonic,  I’m  going  to  turn  now  to  two  related  studies  that  ex- 
amine its  effectiveness  as  an  aid  to  learning  fine  arts  information. 

In  a three-experiment  study  (American  Educational  Re- 
search Journal,  1988,  Vol.  25,  No  1),  Russell  Carney,  Joel  Levin, 
and  Charles  Morrison  examined  how  well  an  adaption  of  the  key- 
word mnemonic  helped  undergraduates  leam  to  associate  the 
names  of  30  artists  and  their  paintings. 

The  purpose  of  the  first  experiment  was  to  see  how  well 
the  mnemonic  materials  and  procedures  would  help  students 
match  artists  with  their  paintings  in  comparison  to  a free  study 
group.  Subjects  assigned  to  the  free  study  condition  were  given 
a booklet  that  contained  (1)  a list  of  the  30  artists’  names,  (2) 
photocopies  of  the  artists’  paintings  with  brief  titles  (e.g.,  "Man 
with  hoe"),  and  (3)  pictures  of  the  30  paintings  with  each  artist’s 
last  name  and  hrief  title  typed  underneath.  They  were  told  to 


familiarize  themselves  with  the  artists’  names,  paintings,  and 
brief  titles  of  each  work,  and  then  use  whatever  method  would 
best  help  them  associate  the  name  of  each  artist  with  his  or 
her  painting.  Subjects  assigned  to  the  mnemonic  condition  were 
given  a booklet  that  contained  (1)  a list  of  the  artists’  names  and 
a corresponding  keyword  (e.g.,  Millett — mallet),  (2)  pictures  of 
the  artists’  paintings  accompanied  by  the  artist/keyword  name 
pairs  and  a sketch  that  depicted  a meaningful  interaction  be- 
tween the  keyword  and  the  scene  (e.g.,  Millet’s  painting  of  a 
man  leaning  on  a hoe  was  drawn  as  a man  leaning  on  a croquet 
mallet),  and  (3)  pictures  of  the  30  paintings  with  each  artist’s 
last  name  and  brief  title  typed  underneath.  They  were  instructed 
to  familiarize  themselves  with  the  artists’  names  and  paintings 
and  to  use  the  mnemonic  materials  to  help  them  associate  each 
artist  with  his  or  her  respective  painting. 

Each  student  took  two  tests.  For  the  first  (painting  recog- 
nition), the  student  was  given  the  artist’s  name  and  had  to  choose 
the  corresponding  painting  from  a set  of  photocopies.  For  the 
second  test,  (artist  recognition)  the  student  was  given  the  paint- 
ing and  had  to  choose  the  corresponding  name  from  a set  of  34 
names.  The  results  were  almost  identical  for  both  tests:  the  pic- 
torial mnemonic  group  significantly  outscored  the  free  study 
group  (by  about  86  percent  vs.  67  percent). 

The  second  experiment  was  designed  to  see  how  well  the 
previous  materials  and  procedures  would  help  students  recall  artists’ 
names  immediately  and  two  days  later,  and  whether  a verbal 
form  of  the  mnemonic  would  work  as  well  as  the  pictorial  form. 
'The  materials  for  the  verbal  mnemonic  condition  were  identical 
to  the  pictorial  materials  with  one  exception:  a verbal  description 
replaced  the  keyword/drawing  interaction.  The  description  of 
the  mnemonic  picture  for  the  Millett  painting  was:  “Imagine 
that  the  hoe  is  a croquet  mallet.  This  man  is  considering  his  next 
shot  through  a wicket."  All  students  were  given  immediate  and 
delayed  tests  of  artist  recall  and  artist  recognition. 

Both  the  pictorial  and  verbal  mnemonic  groups  signifi- 
cantly outscored  the  free  study  group  on  the  immediate  and 
delayed  artist  recognition  tests,  thereby  replicating  the  finding 
of  experiment  one  and  extending  it  to  the  use  of  an  equivalent 
verbal  mnemonic.  For  the  recall  tests,  the  only  finding  of  note 
was  that  the  verbal  mnemonic  group  significantly  outscored 
both  the  free  study  and  pictorial  mnemonic  groups  on  the  imme- 
diate test. 

Experiment  three  was  designed  to  allow  for  a more  direct 
comparison  of  the  pictorial  and  verbal  mnemonic  groups.  With 
the  exception  of  two  changes  in  the  study  materials  of  the  pic- 
torial group,  all  materials,  procedures,  and  tests  were  identical  to 
those  of  experiments  one  and  two.  As  in  experiment  two,  the 
pictorial  and  verbal  mnemonic  groups  outscored  the  free  study 
group  on  the  immediate  and  delayed  recognition  tests.  There 
were  no  effects  for  the  recall  tests. 

In  a follow-up  study,  Russell  Camey,  Joel  Levin,  Avonna 
Schirmann,  and  Angie  Stika  (Comem/wrary  Educational  Psy- 
chology, in  press)  argued  that  a multiple  keyword  adaption  of  the 
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the  keyword  mnemonic  could  be  more  effective  in  certain  cir- 
cumstances  for  associating  artists’  names  with  their  paintings. 
To  associate  the  artist  Fragonard  with  one  of  his  paintings,  you 
would  create  a multiple  keyword  that  encompasses  all  or  most 
of  the  artist’s  name  (as  in  frog  on  air)and  construct  a mental  image 
that  combines  the  keyword  with  an  element  in  the  painting. 
Since  the  Fragonard  painting  contained  a woman  with  an  out- 
stretched hand,  you  might  imagine  a frog  hopping  from  the 
woman’s  hand  to  the  water  below.  When  faced  with  a test,  the 
painting  should  elicit  the  image,  the  image  should  elicit  the 
keyword,  and  the  keyword  should  elicit  the  artist’s  name. 

Carney  et  al.  compared  the  performance  of  three  groups 
of  college  students:  a free  study  group,  a single  keyword  group, 
and  a multiple  keyword  group.  Although  all  subjects  had  to  asso- 
ciate the  names  of  the  30  artists  with  their  paintings,  the  scoring 
and  statistical  analysis  was  based  only  in  the  20  artists  whose 
names  lent  themselves  to  both  single  and  multiple  keywords 
(e.g.,  frog  and  frog  on  air  for  Fragonard).  Before  beginning  the 
task,  all  subjects  familiarized  themselves  with  the  names  of  10 
of  the  20  artists  by  writing  each  name  six  times.  This  was  done 
to  determine  the  joint  effect  of  familiarity  and  mnemonic  con- 
dition on  recognition  and  recall. 

The  free  study  group  was  given  a list  of  the  30  artists’ 
names,  a list  of  the  30  paintings,  and  told  to  use  their  own  method 
to  learn  them.  The  single  and  multiple  keyword  groups  studied 
a list  of  the  keyword/artist  pairs  and  then  viewed  for  20  seconds 
apiece  photocopies  of  each  painting  accompanied  by  the  keyword 
and  a verbal  description  of  the  keyword/painting  interaction. 
Immediately  and  five  days  later,  subjects  took  an  artist  recall  test 
(i.e.,  write  the  artist’s  name  given  the  painting)  and  an  artist 
recognition  test  (i.e.,  match  each  painting  with  the  artist’s  name). 

On  both  the  immediate  and  delayed  recognition  tests,  and 
for  practiced  items  (the  artists  whose  names  were  written  six  times) 


as  well  as  nonpracticed  items,  the  single  and  multiple  keyword 
groups  significantly  outscored  the  control  group  by  about  the  same 
amount.  The  pattern  for  immediate  and  delayed  recall . however, 
was  different.  On  the  immediate  and  delayed  recall  tests,  the 
multiple  keyword  groups  significantly  outscored  the  single  keyword 
and  free  study  groups  (who  did  not  differ  from  each  other)  but  only 
for  practiced  items.  When  nonpracticed  items  were  the  criterion, 
the  multiple  keyword  group  significantly  outscored  only  the 
control  group  and  only  on  the  immediate  test. 

As  with  the  first  set  of  studies,  the  data  from  the  two 
Camey  et  al.  studies  illustrate  two  basic  points.  First,  the  keyword 
mnemonic  is  sufficiently  flexible  that  it  can  be  modified  and 
applied  to  a variety  of  subject  matters  and  criterial  tasks.  Second, 
the  keyword  mnemonic  is  not  a sure-fire,  all-purpose  learning  aid. 
There  is  no  such  thing.  Like  all  learning  tactics,  the  keyword 
mnemonic  works  well  for  some  material  and  outcomes  but  not 
others.  In  the  present  instance,  the  multiple  version  seems  to  work 
better  than  the  single  version  and  a do-your-own-thing  approach 
for  recall  of  certain  names  with  which  one  has  had  a chance  to 
become  familiar.  On  the  other  hand,  the  single  keyword,  which 
is  simpler  and  thus  more  convenient  to  use,  works  just  as  well  for 
name  recognition  tasks. 

In  sum,  the  differential  effectiveness  of  tactics  like  the 
pictorial  mnemonomy  and  the  multiple  keyword  mnemonic 
contains  a strong  implication  for  those  interested  in  learning  skills 
training:  teach  students  how  to  match  learning  tactics  to  a 
particular  situation  in  order  to  achieve  a particular  goal.  Stated 
another  way,  students  need  to  be  tai  St  how  to  analyze  a learning 
situation  and  formulate  an  effective  learning  plan  if  their  behavior 
is  to  be  truly  strategic.  When  viewed  in  this  light,  the  answer  to 
the  question  that  serves  as  the  title  of  this  column  must  be 
“Absolutely  not.” 
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New  Conceptualizations  of  Intelligence: 

An  Interview  with  Robert  Sternberg 


By  Carolyn  R.  Benz, 
University  of  Dayton 


* At 


How  did  you  come  to  ques- 
tion  the  traditional  defini- 
tions of  intelligence? 

IVe  written  for  many  years 
about  intelligence.  As  I un- 
covered anomalies  with  re- 
spect to  test  scores,  I became 
interested  in  people  with 
high  IQ’s  who  were  “losers” 
and  those  with  low  IQ’s  who 
performed  highly  in  various 
areas.  Dramatic  variations 
in  students  applications  tor 
graduate  programs  stimu- 
lated my  thinking  about 
what,  in  fact,  intelligence 
really  was.  Intelligence 
might  not  be  one  and  the 
same  thing  in  all  instances. 


Could  you  describe  your 
triarchic  theory  of  intelli- 
gence for  me? 


Yes.  Not  only  is  there  the  variate  data  analysis  with 

internal  world  of  the  indi-  variables.  He  is  a productiv 

vidual  (learning  how  to  do  matdy  30  and  authc, 

things,  planning,  and  ac-  articles  and  book  chapters,  b 
tually  doing  things),  there’s  of  the  Mind  (1990),  puhUh 
the  external  world  of  the  in- 
dividual. This  is  the  context 

the  person  must  adapt  to.  Thirdly,  there  are  those  things 
that  the  individual  does,  the  activities  that  require  both 
novelty  and  automatization.  1 basically  see  these  three, 
then,  as  subtheories  of  intelligence.  The  first  explains 
what’s  usually  referred  to  as  information  processing  or 
cognition,  the  second  addresses  how  intelligence  relates 
to  the  context  of  one’s  experience  or  behavior,  and  the 
third  is  a theory  that  deals  with  how  people  select  trom 
a wide  spectrum  of  tasks  and  experiences  where  intelli- 
gence is  used.  These  three  suhtheories  together.  I'm  pio 
posing,  do  a better  job  of  explaining  what  we  mean  by 
intelligence  than  does  our  traditional  way. 


Robert  J.  Sternberg , IBM  Professor  of  Psychology  and  Educa- 
tion, Yale  University's  Psychology  Department  has  developed  the 
triarchic  theory  of  intelligence,  which  he  discussed  in  this  inter- 
view. A graduate  of  Yale  and  Stanford  Universities , his  research 
has  dealt  with  theories  of  intelligence , individual  differences  in 
cognition , thinking  and  reasoning,  problem  solving , and  multi- 
variate data  analysis  with  latent  variables  and  observable 
variables.  He  is  a productii'c  writer,  having  authored  approxi- 
mately 30  books,  and  authored  or  coauthored  more  than  300 
articles  and  book  chapters.  His  mosf  recent  book  is  Metaphors 
of  the  Mind  (1990),  puH  \hedby  Cambridge  University  Press. 


What  do  you  see  as  appli- 
cations for  measuring  in- 
telligence in  these  new 
ways?  Are  there  practical 
applications  particularly 
for  educators? 

I’ll  give  you  an  example.  In- 
cluded as  one  aspect  of  this 
conceptualization  of  intelli- 
gence is  the  ability  to  use 
context  to  leam,  for  example. 
Using  context  to  effectively 
adapt  requires  thinking. 
We  need  to  teach  thinking 
skills;  infuse  thinking  into 
books.  We  can  test  these 
skills.  Testing  and  training 
go  together. 


Is  intelligence  testing,  then, 
the  testing  of  thinking? 

No,  not  always.  Not  every 
thinking  process  is  related  to 
intelligence.  Testing  intel- 
ligence, however,  includes 
testing  the  ability  to  think. 


Tell  me  more  about  those 
individuals  who  piqued  your 
interest  in  intelligence,  i.e*, 
the  “stars?’ 


g Often  people  have  one  well- 

developed  skill,  not  a wide 

diversity  of  skills  or  abilities.  However,  they  have  an  extra- 
ordinary’ ability  to  capitalize  on  that  one  skill.  They’re 
able  to  make  it  work  for  them  to  an  unusually  high  level. 
This  phenomenon  led  me  to  consider  that  what  we  need 
are  more  reality-oriented  measures— measures  of  things 
that  relate  to  the  “real  world.”  These  behaviors  are  the 
kinds  of  behaviors  that  relate  to  all  sorts  of  human  per- 
formances, not  just  intellectual  abilities. 


What  would  be  an  example! 
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An  Interview  with  Sternberg  (continued) 


g IQ  test  questions  assume  that  there’s  only  one  answer  and 
— only  one  way  to  the  solution  to  a problem . That’s  not  l ike 
life.  There  is  a practical  intelligence;  such  as  how  to 
manage  yourself,  or  how  to  make  decisions  about  your 
career,  for  example.  Those  are  kinds  of  intelligence,  too. 


B That  reminds  me  of  Seymour  Epstein’s  test  of  construe- 
— tive  thinking  or  some  of  the  new  ways  of  defining  intel- 
ligence that  Howard  Gardner  writes  about;  that  there 
are  multiple  intelligences — spatial,  musical,  logical-mathe- 
matical, etc.,  as  well  as  interpersonal  and  intrapersonal 
intelligence.  Aren’t  some  of  these  what  we’d  call  mental 
health.7  And,  aren’t  some  psychotics  geniuses? 


Well,  psvehotics  could  be  geniuses.  But  "no”  to  your  first 
question— mental  health  is  not  intelligence.  An  anxiety 
problem  could  affect  your  ability  to  use  your  intelligence. 
If  a person’s  mental  health  is  good,  they’re  better  able  to 
exploit  the  ability  that  they  have.  We  have  to  distinguish 
the  criteria  from  intelligence,  the  thing  itself.  By  this  I 
mean  we  have  to  distinguish  what  we  define  as  intelligence 
itself  from  the  criteria  we  use  to  show  evidence  of  it.  Doing 
.well  in  business,  for  example,  might  be  evidenced  by  a 
salary'  increase,  the  number  of  people  who  like  you,  posi- 
tive personnel  evaluations,  etc.  Having  the  ability  and 
choosing  the  most  effective  business  strategies  is  the  intel- 
ligence. That’s  a good  example  of  a "real  world”  intel- 
ligence. Similarly,  having  a high  social  intelligence  is 
made  up  of  a certain  set  of  abilities  and  skills,  but  might 
be  evidenced  by  having  many  friends. 


§ There’s  no  such  thing.  One  always  measures  intelligence 
in  a cultural  context. 


3 For  a couple  of  years  at  MWERA  we’ve  discussed  the 

— relative  merits  of  qualitative  and  quantitative  research. 
How  do  you  respond  to  the  ongoing  debate  about  quali- 
tative and  quantitative  research  methods? 

g I don’t  think  there’s  one  right  answer  or  one  right  way  to 

— conduct  research.  Qualitative  and  quantitative  research 
strategies  are  convergent  operations.  You  need  to  go  where 
your  skills  and  interests  take  you.  In  our  profession  we 
have  people  who  I think  are  exemplary  in  each  strategy. 

For  a long  time  we’ve  assumed  quantitative  data  had  a 
higher  priority.  In  IQ  testing,  for  years,  we’ve  had  all  the 
data  in  the  world.  That  didn’t  prevent  us  from  misinter- 
preting what  it  measured  and  misapplying  ir.  We’ve  basi- 
cally been  deceiving  ourselves.  Hard  numbers  don’t  tell 
you  enough.  We  need  both  qualitative  and  quantitative, 
actually.  1 think  the  recent  moves  by  the  Educational 
Testing  Service  toward  expanding  the  National  Teacher 
Examination  to  include  performance  and  portfolio  com- 
ponents in  addition  to  the  traditional  paper-and-pencil 
tests  is  a very  good  idea. 


B What’s  currently  needed  in  intelligence  testing? 


3 So  much  testing  in  schools  is  being  mandated  by  law 
— today.  What  about  the  issue  of  culture  bias?  Are  you 
concerned  about  assuring  culture-free  tests? 


I’d  say  what’s  most  important  is  our  need  for  measures 
that  assess  real-world  intelligence,  as  well  as  academic 
intelligence. 
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Correlates  of  Examinee  Item  Choice 
Behavior  in  SelfAdapted  Testing 

By  Phillip  L.  Johnson,  Linda  L.  Roos,  Steven  L.  Wise,  and  Barbara  S.  Plake 
University  of  Nebraska-Lincoln 


Abstract 

This  exploratory  study  looked  at  examinee  item  choice  behavior  in  a variant  ot  computerized  adaptive  testing,  called  self- 
adapted  testing,  which  allows  each  examinee  to  choose  the  difficulty  levels  ot  the  test  items  that  he/she  is  administered.  Examinees 
who  chose  more  difficult  first  items  (a)  initially  expressed  greater  capability  and  higher  confidence,  and  (b)  reported  less  anxiety  just 
prior  to  testing  and  to  math  in  general.  Correlations  of  capability  and  confidence  with  item  choice  decreased  with  subsequent  items 
on  the  test.  The  strategies  that  examinees  employed  in  choosing  items  was  also  investigated  with  the  finding  that  examinees  tended 
to  move  to  a more  difficult  level  after  one  or  more  successes  at  a particular  difficulty  level  and  to  a less  difficult  level  after  one  or 
more  failures  at  a given  level.  High  correlations  were  found  between  the  difficulty  levels  chosen  and  examinee  ability  level  indicating 
that  examinees  showed  a strong  tendency  to  choose  items  that  were  of  moderate  difficulty  for  them. 


The  advent  of  item  response  theory  (RT)  has  made  com- 
puterized adaptive  testing  a viable  alternative  to  traditional  test- 
ing methods.  Rocklin  and  O’Donnell  (1987)  proposed  a variant 
of  computerized  adaptive  testing,  called  self-adapted  testing, 
whereby  examinees  are  allowed  to  choose  their  own  items  from 
among  a number  of  difficulty  levels.  They  compared  examinee 
performance  on  a self-adapted  test  with  the  performances  of 
examinees  taking  two  fixed-item  tests  from  the  same  40-item  pool. 
One  of  the  fixed-item  tests  consisted  of  the  20  most  difficult 
items,  while  the  other  consisted  of  the  20  easiest  items.  Rocklin 
and  O’Donnell  found  that  the  self-adapted  test  yielded  a signifi- 
cantly higher  mean  score  than  either  of  the  fixed-item  tests. 

There  are  many  questions  surrounding  self-adapted  testing 
that  have  yet  to  he  explored.  The  purpose  of  this  study  was  to 
look  at  a number  of  these  questions  about  self-adapted  testing, 
especially  those  concerning  the  behaviors  that  examinees  exhibit 
when  making  item  difficulty  level  choices. 

This  study  was  exploratory'  in  nature.  The  strategies  that 
examinees  employ  in  making  difficulty  level  choices  were  of 
primary  interest.  Are  examinees  likely  to  behave  in  an  adaptive 
manner?  That  is,  will  an  examinee  choose  a less  difficult  item 
level  after  answering  an  item  incorrectly  and  choose  a more  dif- 
ficult item  level  after  answering  an  item  correctly  as  was  sug- 
gested by  Rocklin  (1989)?  Examinee  anxiety  and  self-perception 
are  important  issues  in  testing.  These  issues  may  have  an  influ- 
ence on  examinee  choice  of  difficulty  levels.  In  addition,  what 
other  influences  are  there  on  item  difficulty  level  choices? 

An  additional  question  concerns  the  degree  of  match 
between  an  examinee’s  ability  and  the  difficulty  of  the  items 
that  he/she  chooses  in  a self-adapted  test.  In  computerized  adap- 
tive testing,  the  primary  goal  of  the  computer  algorithm  is  to 
administer  items  to  examin  es  that  match  their  ability  levels, 
resulting  in  efficient  ability  estimation.  In  self-adapted  testing, 
however,  examinees  are  free  to  choose  whatever  difficulty  levels 


they  prefer.  To  what  degree  do  examinees,  when  administered  a 
self-adapted  test,  choose  items  that  match  their  difficulty  levels? 

Method 

Subjects  The  subjects  were  148  students  enrolled  in  an  intro- 
ductory’ statistics  course  at  a large  midwestem  university.  The 
subjects  included  88  females  and  60  males.  About  20  percent  of 
the  subjects  were  graduate  students,  and  about  80  percent  were 
undergraduates.  Participation  in  the  study  was  a requirement  of 
the  course,  and  the  results  were  used  to  determine  which  students 
were  in  need  of  remediation  in  basic  algebra  skills. 

Instruments  The  primary’  instrument  used  in  this  study  was  a 
self-adapted  computerized  algebra  test  designed  to  measure  stu- 
dent readiness  for  an  introductory  statistics  course.  The  items  on 
the  test  used  a four-option  multiple  choice  format,  and  each 
examinee  was  administered  20  items.  These  items  were  chosen 
from  a pool  of  93  items  which  tested  basic  algebra  skills.  Wise, 
Plake,  Johnson  &.  Roos  (1991)  provide  a detailed  explanation  of 
the  development  of  the  item  pool.  The  93  items  were  ranked 
according  to  item  difficulty  (h)  parameters  and  divided  into  eight 
levels  of  roughly  equal  size.  Each  level  contained  11  or  12  items. 
Each  time  an  examinee  chose  a given  difficulty  level,  an  item 
was  chosen  randomly,  without  replacement,  from  that  level. 

The  test  was  administered  on  Macintosh  SE/30  micro- 
computers using  a HyperCard  program.  Prior  to  the  algebra  portion 
of  the  test,  each  examinee  was  given  a practice  item  followed 
by  two  questions  designed  to  measure  the  examinees  level  of 
self-efficacy.  The  first  of  the  self-efficacy  questions  concerned 
perceived  capability  and  read: 

The  difficulty  level  of  the  sample  item  was  4,  which  is 
moderate  difficulty  for  the  items  on  this  test.  Now  that 

(loniinuoi  on  page  26) 
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Self-Adapted  Testing  (continued) 


you  have  seen  the  sample  item,  how  capable  do  you  feel 
that  you  can  solve  the  problems  on  this  test? 

The  examinees  provided  their  answers  using  a 7 -point 
scale,  with  1 indicating  “not  capable”  and  7 indicating  ‘capable.” 
The  second  question  concerned  perceived  confidence  on  the 
test  and  read: 

How  confident  do  you  feel  that  you  will  do  well  on  this 
test?  The  options  for  the  answer  ranged  from  “not  confident” 
to  “confident”  using  a 7-point  scale. 

After  answering  each  item  of  the  algebra  test,  the  exam- 
inees  were  informed  of  the  difficulty  level  of  the  item,  whether 
they  had  answered  correctly  or  incorrectly  and  asked  to  choose 
the  difficulty  level  of  the  next  item.  Since  no  level  contained 
more  than  12  items,  examinees  sometimes  exhausted  the  items 
from  a particular  level.  In  those  cases,  examinees  were  asked  to 
choo*e  an  item  from  another  level. 

Maximum-likelihood  estimation  was  using  to  compute  an 
IRT  ability  score  for  each  examinee.  This  score  was  compared  to  a 
cutoff  value  of  — .20  to  determine  those  students  requiring  algebra 
remediation.  The  program  also  computed  the  testing  time  for 
each  item  and  the  standard  error  of  ability  for  each  examinee. 

In  addition  to  the  algebra  test,  three  other  instruments 
were  used.  Each  of  these  used  a paper  and  pencil  format.  The 
Revised  Mathematics  Anxiety  Rating  Scale  (RMARS;  Plake  & 
Parker,  1982)  was  used  to  measure  examinee  mathematics  anxiety. 
The  Test  Anxiety  Inventory  (TA1;  Spielberger,  1980)  was  used 
to  measure  student  anxiety  toward  taking  tests.  Three  TA1  scores 
were  used  in  this  study;  the  Worry  subscale,  the  Emotionality  sub- 
scale,  and  the  Total  score.  The  State  Anxiety  Scale  (Spielberger, 
Gorsuch,  &.  Lushene,  1970)  was  administered  before  and  after  the 
algebra  test  to  measure  situation-specific  anxiety  of  the  examinees. 

Procedure  During  the  first  class  session,  students  supplied  demo- 
graphic information,  completed  the  RMARS  and  the  TAI,  and 
signed  up  for  an  algebra  test  administration  time.  The  students 
were  infonned  that  those  who  obtained  a low  score  on  the  algebra 
test  would  be  required  to  attend  a one-hour  algebra  remediation 
session  to  be  held  during  the  second  week  of  class.  The  student* 
who  scored  below  the  cutoff  were  informed  during  class  after 
the  completion  of  all  testing. 

The  algebra  test  was  administered  in  a laige  room  con- 
taining 10  Macintosh  SE/30  microcomputers.  When  students 
arrived  for  testing,  they  were  seated  at  a computer  and  asked 
to  complete  the  State  Anxiety  Scale.  Next,  the  examinee  was 
given  a few  basic  instructions  concerning  use  of  the  computer 
and  he/she  starred  the  algebra  test.  A medium  difficulty  practice 
item  was  administered  followed  by  the  capability  and  confidence 
questions.  The  examinee  was  then  asked  to  choose  the  level  of 
the  first  item  for  the  algebra  test.  Scratch  paper  and  pencils  were 
provided,  and  calculators  were  not  allowed.  No  time  limit  was 
imposed  during  testing.  Upon  completion  of  the  algebra  tesi, 
the  State  Anxiety  Scale  was  again  administered. 


Results  and  Discussion 

Two  aspects  of  the  results  warrant  explanation.  First,  due 
to  its  exploratory  nature,  a substantial  number  of  correlation 
coefficients  were  computed  in  this  study.  To  perform  significance 
tests  on  this  many  correlations  would  be  to  encourage  the  presence 
of  Type  I errors.  To  avoid  this  problem,  the  results  of  significance 
tests  are  not  reported.  Instead,  the  reader  is  encouraged  to  con- 
sider the  magnitudes  of  the  correlation  coefficients,  keeping  in 
mind  that,  for  148  examinees,  the  standard  error  of  the  correla- 
tion will  be  no  larger  than  .08.  Second,  the  difficulty  choices 
made  by  the  examinees  in  their  20-item  tests  were  restricted  by 
there  being  only  11  items  in  some  levels  and  12  in  the  remaining 
levels.  That  is,  after  the  11th  item  choice,  some  examinees  were 
forced  to  choose  a difficulty  level  different  from  that  which  they 
had  chosen  for  the  first  11  items.  Hence,  all  examinees  were  able 
to  make  unrestricted  choices  only  through  the  first  11  items. 

Descriptive  Statistics  for  the  Sample  To  help  orient  the  reader 
to  the  characteristics  of  the  sample  of  examinees,  means  and 
standard  deviations  were  calculated  for  a number  of  the  variables 
used  in  this  study.  These  descriptive  statistics,  shown  in  Table  1, 
contain  some  particularly  noteworthy  information.  First,  the 
group  of  examinees  passed  approximately  74  percent  of  the  items 
administered.  Second,  the  mean  estimated  ability  value  of  .18 
indicates  that  the  groups  ability  level  was  comparable  to  that  of 
the  calibration  sample.  Third,  there  was  not  much  difference 
between  the  pre-test  and  the  post-test  state  anxiety  levels.  Rocklin 
and  O’Donnell  (1987)  hypothesized  that  the  use  of  self-adapted 
testing  should  decrease  examinee  anxiety  levels.  In  this  study, 
however,  the  state  anxiety  levels  showed  a small,  nonsignifi- 
cant increase. 


Table  1 
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Distribution  of  Examinee  Difficulty  Level  Choices  While  all 
the  difficulty  levels  were  used  rhroughour  the  rest,  the  group 


Self  ^Adapted  Testing  (continued) 


showed  a tendency  toward  more  difficult  items  as  the  testing 
progressed.  Figure  1 shows  the  distributions  of  difficulty  level 
choices  for  the  1st,  11th,  and  20th  items.  The  mean  difficulty 
levels  for  these  items  were  4.79,  5.32,  and  5.25,  respectively. 
Inspection  of  Figure  1 shows  a clear  shift  in  the  distribution 
from  the  1st  item  to  the  11th  item  toward  the  upper  categories. 
After  the  11th  item,  when  some  examinees  had  exhausted  a level 
of  its  items,  the  distribution  showed  a little  change.  The  trend 
toward  more  difficult  items  found  in  this  study  should,  however, 
be  interpreted  with  caution.  If  the  item  pool  had  been  substan- 
tially more  difficult,  an  opposite  trend  may  have  occurred. 


Figure  1 

Distribution  of  Difficulty  levels  Chosen 
for  Items  l,  1 1,  and  20 


Examinee  Choices  of  Difficulty  Levels— 1st  Item 
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Examinee  Choices  of  Difficulty  Leveb—1 1th  Item 
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Examinee  Ounces  of  Difficulty  Levels— 20th  Item 


Correlates  of  the  First  Item  Choice  Which  variables  were 
related  to  the  examinees  choices  of  initial  difficulty  level.’  Table  2 
shows  the  correlations  between  the  first  item  choice  and  eight 
other  variables  measured  in  the  study.  The  strongest  correlate 
was  perceived  capability  followed  by  perceived  confidence.  Math 
anxiety  and  pre-test  state  anxiety  showed  moderate  correlations, 


Table  2 

Correlates  of  the  Examinee's  Choices  of  Their 
First  Item  Difficulty  Levels 


Variable  Correlation 


TAlObuil) -0.18 

TAl  (Worry) -0.12 

TA1  (Emotionality) -0.19 

Math  Anxiety -0.48 

PreTest  State  Anxiety —0.46 

Years  Since  Last  Algebra  Course -C.i6 

Perceived  Capability  0.85 

Perceived  Confidence  0.74 


and  test  anxiety  (TAI)  and  number  of  years  since  last  algebra 
course  showed  relatively  weak  correlations.  To  summarize  the 
directions  of  the  stronger  correlations,  examinees  choosing  a 
more  difficult  first  item  expressed  greater  capability  and  higher 
confidence,  while  reporting  less  anxiety  just  prior  to  testing  and 
to  math  in  general.  vAr 

Although  the  correlates  of  the  first  item  «fc>ice  were  not 
surprising,  the  correlations  of  capability  and  confidence  on  sub- 
sequent choices  were  interesting.  For  capability,  the  correlations 
for  the  1st,  11th,  and  20th  difficulty  levels  were  .85,  .69,  and  .53, 
respectively.  For  confidence,  the  correlations  were  .74,  .63,  and 
.46,  respectively.  These  decreasing  correlations  of  capability 
and  confidence  with  item  choice  were  likely  due  to  the  feed- 
back provided  by  earlier  test  items  exerting  an  increasing  influence 
on  difficulty  level  choice. 

Strategies  of  Item  Selection  In  self-adapted  testing,  examinees 
may  choose  a variety  of  strategics  for  selecting  the  difficulty  levels 
of  their  items.  Rocklin  (1989)  proposed  three  common  strategies: 

(1)  “flexible,”  in  which  examinees  choose  a higher  level  after 
passing  an  item  and  choose  a lower  level  after  failing  an  item. 

(2)  “failure  tolerant,”  in  which  examinees  choose  a higher  level 

when  they  pass  an  item  and  choose  the  same  level  when  they 
fail  an  item,  and  (3)  “failure  intolerant,”  in  which  a lower  level  is 
chosen  failing  an  item  and  the  same  level  is  chosen  after  passing 
an  item.  Identification  of  these  strategies,  however,  is  complicated 
hy  hounded  nature  of  the  difficulty  level  choices.  That  is,  an 
examinee  who  passes  an  item  at  the  highest  difficulty  level  cannot 
use  either  a flexible  or  a failure  tolerant  strategy  because  there 
arc  no  higher  levels  to  choose.  (continued  on 
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Self-Adapted  Testing  (continued) 

In  this  study,  inspection  of  the  data  file  was  used  to  at- 
tempt to  describe  the  strategies  that  examinees  employed.  From 
this  analysis,  some  tentative  inferences  can  he  drawn.  First,  few 
(if  any)  examinees  showed  a strong  adherence  to  a flexible,  failure 
tolerant,  or  a failure  intolerant  strategy.  Instead,  most  examinees 
exhibited  what  might  be  termed  a “sluggishly  flexible”  strategy. 
In  this  strategy,  examinees  chose  more  difficult  items  after  either 
passing  an  item  or  passing  a string  of  several  items.  Likewise, 
these  examinees  moved  to  a less  difficult  level  after  they  failed 
a single  item  or  a set  of  several  items.  Instances  of  examinees 
choosing  a lower  difficulty  level  after  passing  an  item  or  choosing 
a higher  difficulty  level  after  failing  an  item  were  rare.  Figure  2 
illustrates  this  point;  it  shows,  broken  down  by  whether  the 
previous  item  had  been  passed  or  failed,  the  difficulty  level 
choices  made  by  examinees  for  items  2-11.  Note  that,  regardless 
of  whether  the  previous  item  was  passed  or  failed,  the  most 
frequent  choice  was  to  remain  at  the  same  difficulty  level. 


Figure  2 

Frequencies  of  relative  difficulty  level  choices  depending 
on  whether  the  answer  to  the  previous  item  uas  right  or  urong. 
The  frequencies  are  based  on  choices  2 through  i I . 
taken  across  examinees. 
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There  were  some  examinees  who  inflexibly  chose  either 
the  easiest  or  the  most  difficult  items  available.  That  is,  they  chose 
all  of  the  level  1 (or  level  8)  items  until  none  were  left,  and  then 


chose  level  2 (or  level  7)  items  for  the  remainder  of  the  test.  It  is 
possible  that  these  examinees  would  have  also  exhibited  a slug- 
gishly flexible  strategy  if  there  had  been  easier  or  more  difficult 
items  in  the  pool.  Further  research  should  be  directed  toward 
understanding  the  choice  behavior  of  these  examinees. 

Match  Between  Items  Chosen  and  Ability  Possibly  the  most 
interesting  results  found  in  this  study  concern  the  relationships 
between  the  difficulty  levels  chosen  and  examinee  ability  level. 
Note  that,  according  to  an  item  response  theory,  the  location  of 
an  examinee's  ability  estimate  is  not  dependent  upon  the  items 
administered.  Hence,  an  examinee  should  expect  the  same  ability 
estimate  regardless  of  which  items  he/she  chose.  In  computerized 
adaptive  testing,  the  computer  algorithm’s  goal  is  to  administer 
items  whose  difficulty  levels  match  an  examinee’s  ability.  In  this 
study,  examinees  tended  to  choose  items  whose  difficulty  levels 
were  strongly  matched  to  their  ability  levels.  The  correlations 
between  ability  and  the  difficulty  levels  chosen  for  the  first  1 1 
items  ranged  from  .64  (item  1)  to  .83  (item  1 1).  The  magnitudes 
of  these  correlations  indicate  that,  in  self-adaptive  testing, 
examinees  are  aware  of  how  difficult  their  items  should  be.  This 
implies  a metacognitive  awareness  on  the  part  of  the  examinees 
that  warrants  further  study. 

Conclusions 

The  goal  of  this  study  was  to  investigate  how  examinees 
behave  when  taking  a self-adaptive  test,  and  to  explore  correlates 
of  examinee  test-taking  behavior.  The  results  of  this  study  indi- 
cate that  self-adaptive  testing  may  represent  a viable  alternative 
to  computerized  adaptive  testing.  In  addition,  the  findings  of 
Wiseet  al.  (199 1 ) suggest  that  examinees  may  perform  better  on 
a self-adaptive  test  than  on  a computerized  adaptive  test.  The 
capability  of  self-adaptive  testing  to  take  into  .ount  an  exam- 

inee’s knowledge  of  his/her  affective  and  motivational  state  may 
be  important  for  a valid  assessment  of  examinee  ability. 
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Abstract 

The  results  of  a recent  search  committee  screening  to  hire  new  faculty  for  an  entry-level  tenure  track  position  found  that  fewer 
than  one-third  of  the  41  applicants  submitted  credentials  that  met  two-thirds  of  the  advertised  criteria.  Although  80  percent  of  the 
applicant  pool  had  attained  their  doctorates,  only  43  percent  were  qualified  in  curriculum  development,  the  required  area  of  speciali- 
zation. Lack  of  documented  expertise  in  this  area  eliminated  over  half  of  the  applicants  from  further  scrutiny.  After  this  initial  screen- 
ing, applicants’  potential  for  prestige  (published  research)  and  positive  graduate  and  undergraduate  teaching  experiences  weighed  heavily 
in  selecting  candidates  to  be  interviewed.  The  three  candidates  invited  for  interviews  presented  their  credentials  superbly:  qualifica- 
tions for  the  position  were  specifically  and  clearly  articulated  in  the  cover  letter,  vitae,  and  personalized  letters  of  recommendation. 
As  a result  of  this  faculty  search,  recommendations  for  candidates  applying  for  similar  positions  in  higher  education  are  suggested. 


A search  committee  at  a small,  private  Midwestern  uni- 
versity recently  reviewed  the  applications  of  41  candidates  for 
an  entry-level  assistant  professor  position.  The  applicants  had 
applied  in  response  to  an  advertisement  in  the  Chronicle  of  Higher 
Education.  The  range  of  submissions  varied  enormously  with 
fewer  than  one-third  of  the  applicants  meeting  two-thirds  of  the 
advertised  criteria. 

Several  assumptions  appeared  to  be  at  work  in  this  selec- 
tion process.  Some  candidates  seemed  to  expect  that  the  search 
committee  members  would  have  sufficient  time,  insight,  and 
motivation  to  ferret  out  the  salient  features  of  their  application 
that  were  not  obvious.  Faculty  search  committee  members,  on 
the  other  hand,  expected  that  the  applicants  would  possess  a 
Ph.D.,  be  qualified  in  the  specified  content  area,  and  that  they 
would  present  their  credentials  in  an  organized,  personalized 
and  professional  manner. 

Perhaps  this  mismatch  of  expectations  may  simply  be  a 
lack  of  information.  A recent  review  of  the  literature  found  scant 
research  on  academic  selection  processes  and  none  that  described 
the  differences  among  successful  and  unsuccessful  candidates 
who  survived  selection  committee’s  screening  and  were  recom- 
mended for  interviews. 

The  goals  of  this  study  were  twofold:  First,  to  identify 
the  differences  between  successful  and  unsuccessful  applicants 
for  entry-level  higher  education  teaching  positions  and,  second, 
to  provide  direction  and  recommendations  that  contribute  to 
candidates  successfully  competing  in  this  job  market. 

A recent  review  of  the  literature  found  few  current  refer- 
ences to  academic  hiring  practices,  and  none  addressed  differ- 
ences among  candidates  in  the  selecrion  process.  Most  articles 
lacked  an  empnical  base.  They  either  advised  fledgling  teachers 
(Dewey  & Gardner,  1983;  Kopctskie,  1983;  Jarchow,  1081)  or 
surveyed  department  chairs,  search  committee  members  and'or 


newly  hired  fact  lty  on  what  they  thought  were  the  characteristics 
of  successful  applicants  in  higher  education  (Klesges,  Sanchez, 
&.  Stanton,  1982;  Klugh,  1964;  McDowell  Mrozla,  1987; 
Rand  &.  Ellsworth,  1979).  Both  Perlman  (1976)  and  Shetty  (1988) 
wrote  about  the  job  hunt  from  personal  and  vastly  different  ex- 
periences as  new  Ph.D.’s  in  psychology  and  economics,  respec- 
tively. Wilbur  (1988)  wrote  of  the  importance  of  having  a mentor 
and  publishing  at  the  pre-Ph.D.  level. 

Several  themes  emerged  from  a review  of  the  literature: 
Competition  for  academic  positions  is  keen  and  position  open- 
ings have  not  kept  up  with  demand  (Klesges  et  al,  1982;  Klugh, 
1964;  Perlman,  1976;  Rand  & Ellsworth,  1979;  Shetty,  1988; 
Wilbur,  1988);  candidates  should  apply  only  for  positions  for 
which  they  qualify  (Klesges  et  al,  1982);  the  letter  of  application, 
resume,  and  letters  of  recommendation  can  be  an  invitation  for 
further  inquiry  or  a source  of  immediate  rejection  (McDowell  & 
Mrozla,  1987;  Perlman,  1976;  Rand  &.  Ellsworth,  1979;  Shetty, 
1988;  Wilbur,  1988).  Teaching  mattered  (Rand  &.  Ellsworth, 
1978)  and  prestige  or  the  promise  of  prestige  (i.e.  publications) 
was  very  important  (Klesges  et  al,  1982;  Klugh,  1964;  McDowell 
& Mrozla  1987;  Rand  & Ellsworth  1979;  Wilbur,  1988).  Com- 
munication skills,  one’s  knowledge  ol  subject  area,  the  potential 
for  conducting  research,  and  an  ability  to  fill  departmental  or 
institution  needs  distinguished  new  faculty  hires  (Klesges  et  al, 
1982;  McDowell  & Mrozla,  1987;  Rand  & Ellsworth,  1979). 

Methods 

The  following  research  was  conducted  evpost-facto  to 
study  the  differences  among  successful  and  unsuccessful  candi- 
dates recommended  for  interviews  by  a faculty  search  committee. 
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Employment  in  Higher  Education  (continued) 


Forty-one  candidates  responded  to  an  announcement  in 
the  Chronic/e  of  Higher  Education  (see  Table  i). 


Table  1 

Announcement  of  Position  Found  in  the 
Chronicle  of  Higher  Education 

Assistant  Professor  of  Education 

S^coiuiarv  Education— Candidates  should  hold  an  earned  doctorate  m 
education  with  a strong  background  in  curriculum  development  and 
secondary  education.  Three  years  experience  in  elementary  and/or 
secondary  schools  and  oral  proficiency  in  English  language  are  required. 
Responsibilities  will  include  teaching  methods  and  foundations  courses 
at  both  the  graduate  and  undergraduate  levels.  Candidates  should  be 
committed  to  conducting  research  as  well  as  to  teaching. 

Appointment  and  Salon— 'Tenure  track,  nine-month  appointment,  possibility 
of  additional  summer  teaching,  competitive  salary. 

Application  Procedures— Applicants  should  address  inquiries  or  forward 
letter  of  application,  curriculum  vitae,  and  a minimum  of  three  current 
letters  of  recommendation  ro:  Chair,  Department  of  Teacher  Education. 


Measures  Nine  criteria  were  deduced  from  the  advertisement 
by  the  Search  Committee  Chair.  They  were: 

1.  Earned  doctorate  in  education 

2.  Strong  background  in  curriculum  development 

3.  Three  years  experience  in  elementary  and/or 
secondary  schools 

4.  Proficiency  in  English  language 

5.  Commitment  to  conducting  research 

6.  Commitment  to  teaching 

7.  Undergraduate  teaching  experience 

8.  Graduate  teaching  experience 

9.  Positive  relationship  with  college  students 

Candidates  received  a "l”  if  they  fulfilled  advertised  cri- 
teria, “.5“  if  they  partially  fulfilled  criteria  and  “0"  if  requested 
information  or  experiences  were  missing.  A perfect  score  to  fulfill 
search  committee  criteria  would  have  been  a “9.”  No  effort  was 
made  to  rank  criteria  in  order  of  importance. 

Procedures  and  Analysis  Candidate  application  files  (letters 
of  application,  vitae,  and  letters  of  recommendation)  were  re- 
viewed and  ranked  on  the  strength  of  submitted  documentation 
on  each  of  the  nine  advertised  criteria.  This  was  done  indepen- 
dently and  informally  by  the  search  committee  in  their  selection 
process.  Files  were  later  reviewed  by  these  authors  who  codified 
the  findings.  Interrater  reliability  exceeded  .95. 

Descriptive  statistics  o!  the  sample  were  developed  for 
each  criteria  item  based  on  search  committee  rankings.  A ire 
quency  distribution  of  the  sum  total  of  each  candidates  score 
was  plotted  to  discover  the  range  of  qualifications  in  this  sample. 


Additionally,  a series  of  2,  2 group  K-mean  cluster  analyses  was 
used  to  identify  the  characteristics  between  selected  and  un- 
selected applicants,  independent  of  search  committee  rankings. 
Conclusions  and  recommendations  were  drawn. 

Results 

Means  and  standard  deviations  were  calculated  from  the 
search  committee’s  scoring  of  candidates  on  the  nine  criteria 
(see  Table  2). 


Table  2 

Mean  Quafi/ioHiom  of  Applicants 

Means  Standard  Deviation 


Earned  doctorate  in  education 817  .290 

Background  in  curriculum  development  . . .439  .502 

Three  yean,  experience  in  schools 805  .314 

Proficiency  in  English  language 634  .251 

Commitment  to  research 317  .429 

Commitment  to  teaching 707  .353 

Undergraduate  reaching  experience 695  .4  3 1 

Graduate  teaching  experience 159  A61 

Positive  relationship  with  college  students  .524  .192 


Earned  Doctorate-  Approximately  82  percent  of  the  candidates 
(n  = 33)  who  applied  for  the  position  had  earned  their  doctorate. 
Then  were  “all  hut  dissertation and  received  partial  credit  (.5) 
for  this  item.  Two  candidates  received  no  credit:  One  gave  no 
evidence  of  doctoral  work  and  another  had  been  “ABD”  for 
over  five  years  and  gave  no  evidence  of  a completion  date  in 
the  near  future.  Of  the  three  candidates  selected  for  interviews, 
two  had  obtained  their  doctorates  within  the  last  three  years, 
and  the  third  was  expected  to  finish  within  the  half  year. 

Curriculum  Development  Less  than  half  of  the  candidates 
(44  percent)  had  a background  in  curriculum  development  and 
received  full  credit  for  this  item.  Twenty-three  candidates  showed 
no  evidence  of  specific  knowledge  in  this  area  and  received 
no  credit.  Two  of  the  three  finalists  specialized  in  curriculum 
development,  one  held  a specific  degree,  taught  and  wrote  on 
the  subject  the  other  was  ABD  and  teaching  in  that  area.  The 
third  finalist  was  involved  in  writing  and  planning  curricula 
in  the  secondary  schools. 

Experience  in  Elementary/Secondary  Schools  This  item  ful- 
fills state  teaching  certification  requirements.  Twenty-eight 
candidates  (68  percent)  had  taught  a minimum  of  Three  years 
at  the  elementan  or  secondary  level.  Ten  applicant-'  received 
partial  credit  for  elcmentary/secondary related  activities  and 
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three  gave  no  evidence  of  teaching  at  that  level.  All  three  inter- 
viewees had  extensive  experience  at  the  secondary  level;  two 
were  social  studies  teachers  and  the  third  taught  English. 

Proficiency  in  English  Language  Although  oral  proficiency  in 
English  language  was  stated  as  a qualification  for  the  position  in 
the  initial  screening,  only  written  examples  of  English  language 
use  were  considered.  Ability  in  English  language  was  reflected  in 
the  letter  of  application,  accompanying  research  papers  or  articles 
(if  any)  and/or  an  undergraduate  major  in  English.  Only  12  appli- 
cants earned  full  credit  on  this  item  for  clear,  organized,  well 
thought-out,  prose.  Twenty-eight  (68  percent)  of  the  candidates 
were  judged  to  write  adequately.  One  applicant  submitted  un- 
focused letter  of  application  with  obvious  grammatical  and  seman- 
tic errors  and  earned  no  credit. 

Two  of  the  finalists  received  full  credit  for  proficiency  in 
the  English  language.  Both  were  teaching  on  the  college  level, 
gave  evidence  of  extensive  writing,  and  wrote  clear  compelling 
letters  of  application  that  individually  addressed  each  criteria 
item  mentioned  in  the  C/ironfcIe  of  Higher  Education  advertise- 
ment. Additionally,  they  both  included  unsolicited  research  papers 
with  their  application  materials.  The  third  candidate  received 
partial  credit  for  English  proficiency  due  to  a tersely  worded  letter 
of  application  and  was  later  requested  to  submit  a research  paper. 

Commitment  to  Research  Ten  candidates  (24  percent)  gave 
evidence  of  publication  of  books  or  articles  in  refereed  journals. 
Six  others  (15  percent)  received  partial  credit  for  coauthored 
articles,  articles  in  press,  book  reviews  or  articles  written  but  not 
yet  published.  Most  applicants  (n=25)  were  not  published.  Full 
credit  was  earned  by  all  three  finalists  for  evidence  of  research. 
All  three  had  published  articles  in  refereed  journals,  and  one 
interviewee  had  two  books  in  print. 

Commitment  to  Teaching  Over  half  of  the  applicants  (n  = 2 3) 
were  able  to  demonstrate  that  they  had  been  involved  with  teach- 
ing over  the  length  of  their  professional  careers.  About  34  percent 
had  been  involved  in  teaching  at  one  time,  but  not  in  the  recent 
past.  Two  applicants  gave  no  evidence  of  teaching  experiences; 
two  others  had  extensive  careers  in  counseling,  rather  than  reach- 
ing. All  three  of  the  candidates  invited  to  campus  had  been 
cited  for  their  excellence  in  teaching  by  students  and/or  peers. 

Undergraduate  Teaching  Experiences  Twenty-six  applicants 
had  experience  teaching  at  the  undergraduate  college  level.  An 
additional  five  applicants  worked  as  graduate  assistants,  paper 
graders,  or  lab  assistants.  Ten  candidates  had  no  direct  or  indirect 
experience  with  an  undergraduate  college  population.  Two  inter- 
viewees had  someexperiep.ee  teaching  undergraduate  classes;  the 
third  did  not. 

Graduate  Teaching  Experience  Six  applicants  (15  percent) 
had  taught  at  the  graduate  level;  one  candidate  received  hall 


credit  for  conducting  a graduate-level  course  in  computers  for 
teachers.  The  overwhelming  majority  (83  percent)  had  no  grad- 
uate teaching  experience.  None  of  the  finalists  indicated  in  their 
vitaes  that  they  had  taught  graduate  courses. 

Relationship  with  College  Students  Indications  of  positive 
relationships  with  college  students  were  found  in  letters  of  recom- 
mendation. Four  candidates  received  full  credit  for  specific  refer- 
ences to  their  excellent  rapport  with  a college  population;  35 
applicants  were  given  partial  credit  based  on  their  potential  to 
deal  well  with  this  student  group.  Only  two  candidates  received 
no  credit  because  their  ability  to  relate  to  college  students  was 
not  mentioned  by  them  or  their  references. 

Two  of  the  interviewees  received  full  credit  for  their  ability 
to  relate  to  college  students.  These  two  were  currently  teaching 
at  the  college  level  and  had  referenes  made  regarding  their  ability 
to  effectively  deal  with  that  population.  The  third  interviewee 
was  cited  as  an  excellent  secondary  teacher  with  potential  to  be 
an  outstanding  college  teacher.  Due  to  the  strength  of  his  refer- 
ences, this  candidate  was  given  half  of  a credit  for  this  item. 

Range  of  Qualifications 

When  individual  criteria  scores  were  tabulated,  the  quali- 
fications of  the  applicant  field  ranged  from  2 .0  to  9.0.  The  average 
candidate  score  was  5.088.  The  three  candidates  invited  for  inter- 
views all  ranked  within  the  top  third  of  the  sample  and  scored 
above  6.5  (see  Figure  1). 


Figure  1 

The  Range  of  Candidate  Qualifications 
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The  bottom  third  ot  the  sample  (n  = 19)  made  a weak  im- 
pression on  the  search  committee.  Scores  ranged  from  2.0  to  4.5. 
Six  of  these  candidates  were  ABD  and  only  one  was  qualified  in 
the  area  of  curriculum  development.  Ot*  the  11  Ph.D.’s  that  applied 
for  the  position,  only  three  were  qualified  in  secondary  education 
and  curriculum  development.  Two  candidates  did  not  mention 
Ph.D.  level  qualifications  or  a concentration  in  curriculum. 

The  middle  group,  (n-12),  with  scores  from  5.5  to  6.0, 
had  at  least  half  of  the  qualifications  listed  in  the  advertisement, 
but  displayed  them  in  ways  that  was  often  difficult  to  find.  Several 
criteria  such  as  proficiency  in  English  language,  ability  to  deal 
with  college  students,  and  commitment  to  teaching  and  research 
was  gleaned  from  the  candidates’  self  statements  or  from  letter^ 
of  recommendations.  If  strengths  were  not  obvious  in  those  areas, 
the  search  committee,  for  the  most  part,  did  not  look  beyond 
the  written  statement.  Perhaps  some  of  this  group  could  have 
been  boosted  into  the  top  quarter  and  become  finalists  if  they 
had  been  more  articulate  about  their  qualifications. 

The  top  third  of  the  group  (n  = 10),  from  which  the  three 
interviewees  were  selected,  very  clearly  had  most  of  the  qualifi- 
cations for  the  position.  Scores  ranged  from  6.5  to  9.0.  They 
overwhelmingly  addressed  the  different  criteria  items  in  their 
cover  letters  and  documented  their  strengths.  Vitacs  were  pro- 
fessional looking  and  well-organized.  Recommendations  rended 
t o be  job  specific  and  outstanding. 

Cluster  Analysis 

A hierarchical  cluster  analysis  (Hartigan,  1975)  was  con- 
ducted on  the  applicant  pool  to  determine  whether  committee 
selection  and  statistical  clustering  processes  would  select  similar 
individuals.  Because  cluster  analyses  can  be  forced  to  create 
clusters  where  there  are  none,  a series  of  two  clusters  analyses 
were  performed. 

After  the  first  cluster  analysis,  candidates  were  separated 
into  two  groups  with  29  (70.7  percent)  applicants  disqualified 
and  12  (29.3  percent)  maintained;  Six  criteria  items  significantly 
discriminated  between  selected  and  unselectcd  candidates:  A 
doctorate,  relationship  to  college  students,  graduate  teaching, 
undergraduate  teaching,  commitment  to  teaching,  and  commit- 
ment to  research  (see  Ttblc  3). 
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The  three  candidates  who  eventually  received  invitations 
to  campus  survived  the  first  statistical  cut  as  well  as  the  second 
cluster  analysis  in  which  eight  candidates  remained  under  con- 
sideration. The  differences  among  the  individuals  in  the  final 
applicant  pool  was  now  slight  and  closely  matched  search  com- 
mittee’s selections.  Statistically,  differences  among  candidates 
in  the  final  cluster  were  nonsignificant. 

Discussion 

Although  the  search  committee  was  asked  to  evaluate 
candidates  on  their  ability  to  meet  certain  criteria,  other  factors 
surfaced  and  clearly  came  in  to  play  when  making  the  final  inter- 
view selections.  Armed  with  checklists  o.  position  qualifica- 
tions, the  committee  scrutinized  each  candidate’s  credentials 
arid  selected  eight  candidates  for  further  consideration.  Members 
lobbied  within  the  committee  to  gain  support  for  their  favorites 
and  to  seek  out  additional  information  on  candidates  advocated 
by  other  commitee  members.  Qualitative  considerations,  such 
as  match  with  department  needs,  were  critical  to  candidates 
being  selected  for  an  interview. 

After  much  discussion,  inquiry,  and  several  phone  calls 
to  verify  information,  three  candidates  were  selected  to  be  inter- 
viewed. Although  the  committee  would  participate  in  the  inter- 
view process,  much  of  what  would  now  occur  would  be  on  the 
candidate’s  shoulders— qualities  like  communication,  clarity, 
focus,  competence,  interpersonal  skills  would  have  to  be  demon- 
strated b\  the  invitee.  Additionally,  faculty,  students,  and  the 
dean  would  have  input  on  the  selection.  Regardless  of  their 
ranking  on  the  initial  screening,  they  were  all  on  equal  footing 
as  invitees. 

Successfully  surviving  the  inirial  screening,  however, 
was  the  first  order  of  business.  In  this  initial  screening,  unfavor- 
able information  has  double  weight  over  favorable  information 
(Hakel,  1970).  Regrettably,  much  information  about  hiring  prac- 
tices treats  the  interview  as  the  first  “test”  for  qualified  candi- 
dates (Dewey  & Gardner,  1983;  Kopetske  1983;  Jarc how,  1981). 
In  this  instance  candidates  had  to  make  the  first  cut,  which 
eliminated  two-thirds  ot  the  applicant  pool,  and  then  they  had 
to  win  advocacy  within  the  search  committee  among  all  of  the 
members.  This  was  no  easy  task. 

Thus,  while  the  applications  of  individual  candidates 
must  be  initially  appealing  to  attract  the  favorable  attention 
of  at  least  one  committee  member,  the  submission  must  also  be 
complete  and  detailed  enough  to  withstand  the  careful  scrutiny 
of  the  committee  as  a whole.  Furthermore,  each  committee 
member  who  failed  to  select  a particular  applicant  now  worked 
to  legitimize  their  initial  decision  oi  why  they  did  not  initially 
select  the  applicant.  Conversely,  applicants  that  were  put  forth 
hy  some  and  rejected  by  other  committee  members  were  now 
looked.it  inoreclo&eh  .tstowln  they  were  initially  lecommondeJ. 
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The  candidates  who  clearly  bad  the  advantage  were  those 
who  responded  specifically  to  the  advertisement  and  made  the 
committee  members  job  easier  both  by  presenting  clearly  marked, 
professionally  looking  documents  accompanied  by  personal  letters 
of  application  and  crisp  laser  printed  copies.  Successful  candidates 
had  clearly  delineated  their  areas  of  consideration,  their  dates  of 
employment,  and  the  dates  and  institutions  of  their  degrees. 
Personal  letters  of  recommendation  wre  critical  in  obtaining 
committee  support  and  proved  especially  important  for  neophyte 
candidates  attempting  to  establish  their  potential  for  college 
teaching  and  research  as  well  as  their  ability  to  relate  to  a cob 
lege  population. 

Poor  quality  in  the  reproduction  of  resumes,  out-of-date 
recommendations,  and  unspecific  cover  letters  hurt  some  of  the 
candidates.  Committee  members  wondered  if  this  lack  of  atten- 
tion  to  detail  and  professional  presentation  would  carry  over  to 
the  work  situation.  Also,  as  committee  members  had  limited 
time  and  resources,  they  were  reluctant  to  dig  further  after  a 
poor  first  impression. 

The  candidate  qualities  that  appeared  to  be  most  impor- 
tant in  this  initial  search  committee  screening  were: 

1 . Possessed  a doctorate  in  education,  or  if  they  would 
complete  the  degree  in  the  immediate  future. 

2.  Speciality  in  a curriculum  area  or  demonstrated 
knowledge  of  the  content  of  curriculum. 

3.  Superior  teaching  skills. 

4.  Communication  skills. 

Later  in  the  screening  process  when  the  field  was  narrowed 
down,  other  criteria  came  to  have  more  impact.  The  applicant 
pool  was  scrutinized  as  to: 

1 . Ability  to  relate  to  college  students,  which  was  found 
in  letters  of  recommendation  or  in  documentation  of 
previous  positive  college-level  teaching  experiences. 

2.  Undergraduate  and  graduate  teaching  ability. 

3.  Ability  to  conduct  research  at  the  university. 

Not  to  be  overlooked  was  the  wide  range  of  credentials 
that  were  presented  tor  the  same  position.  Some  obvious  errors 
of  judgment  occurred  in  the  lower  level  of  the  sample  such  as  an 
absence  of  letters  of  recommendation  or  the  lack  of  congruence 
with  the  job  description.  For  a large  number  of  applicants,  whose 
scores  were  in  the  middle  range,  qualifications  were  often  ubiqui- 
tous. Documentation  did  not  clearly  establish  their  competency 
in  the  search  committee’s  mind.  The  three  candidates  that  were 
invited  for  the  interviews  came  from  a pool  of  applicants  having 
scores  from  6.5  and  above.  However,  this  was  not  known  until 
the  files  were  coded  and  clustered.  In  addition,  it  should  be  noted 
that  the  three  individuals  invited  for  interviews  did  not  possess 
the  top  three  scores  but  did  fall  within  the  top  cluster. 

It  is  reasonable  to  assume,  that  any  number  of  these 
middle  candidates  with  scores  from  5 to  6.5  might  have  been 


thrust  into  the  cluster  for  final  consideration  if  they  had  done 
several  of  the  following  things:  Presented  a more  favorable  first 
impression  in  terms  of  application  letter,  recommendations,  and 
resumes;  personalized  documentation,  clearly  articulated  their 
qualifications  for  the  position;  and  documented  material  in  a 
way  that  the  search  committee  could  find  it  and  not  have  to 
guess  at  wfhat  qualities  were  present  or  absent. 

Summary  and  Recommendations 

The  results  of  a recent  search  committee  to  hire  new 
faculty  found  that  only  one-third  of  the  applicants  presented 
credentials  that  allowed  serious  search  committee  consideration. 
Although  80  percent  of  the  applicant  pool  had  attained  their 
Ph.D.’s,  only  43  percent  were  qualified  in  curriculum  develop- 
ment. Lack  of  expertise  in  this  area  immediately  eliminated  more 
than  half  of  the  applicant  pool.  In  those  that  were  selected  for 
final  interviews,  personalized  letters  of  submission,  updated 
resumes,  and  recent  recommendations  that  spoke  to  the  candi- 
date’s strength  for  the  position  were  pivotal  in  being  selected. 

The  criteria  items  that  seemed  to  matter  most  in  the 
initial  screening  were  the  overall  match  with  the  institution’s 
needs  (doctorate,  curriculum  specialist,  and  evidence  of  teaching 
experience).  In  the  final  selection  for  candidates  to  be  inter- 
viewed, the  applicant’s  potential  for  prestige  (published  research) 
and  graduate  and  undergraduate  teaching  experience  w»as  scruti- 
nized more  closely. 

There  was  the  general  perception  that  some  candidates 
were  more  qualified  than  their  submissions  indicated  and  that 
several  candidates  could  have  presented  their  credential  more 
effectively.  Effort  and  attention  to  detail  for  something  as  impor- 
tant as  acquiring  a job,  especially  with  all  the  implications  of  relo- 
cation. thousands  of  dollars  in  potential  pay,  etc.,  would  seem  to 
indicate  that  increased  expertise  in  this  area  w'ould  be  w’ell  worth 
while.  There  appears  to  be  a need  in  higher  education  for  train- 
ing on  how  to  more  effectively  compete  for  a job  opening. 

As  a result  of  this  search  committee’s  findings,  the  following 
recommendations  are  suggested  for  candidates  in  higher  education: 

1 . Apply  for  positions  in  which  you  meet  at  least  half 
of  the  criteria.  Search  commitees  do  not  expect  a 
perfect  match,  hut  they  do  expect  that  serious  appli- 
cants meet  most  of  the  qualifications. 

2.  Demonstrate  or  document  expertise  in  the  area  of 
concentration.  Failure  to  do  so  may  result  in  imme- 
diately being  eliminated  for  consideration. 

3.  Clearly  articulate  qualifications  in  cover  letter,  vitae, 
and  letters  of  recommendation.  Faculty  search  com- 
mittees arc  < prone  to  probe  further  if  applicant'* 
qualifications  are  ambiguous. 
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4.  Present  credentials  in  an  organized,  professional 
manner.  Better  marketing  skills  may  have  made  the 
difference  for  20  percent  of  the  candidates  in  this 
applicant  pool. 


Like  a prizefighter,  there  are  rounds  to  win  in  the  appli- 
cant  process.  Only  individuals  who  survive  successive  rounds 
will  succeed  in  the  candidate  selection  process. 
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Abstract 

Restructuring  of  large  urban  school  districts  places  general  decision-making  responsibilities  with  local  teachers,  parents,  com- 
munity members  and  principals.  Delivery  of  mental  health  services  within  the  restructured  organization  demands  expertise  and 
specialized  knowledge  of  childhood  pathology,  legal  mandates  and  intervention  treatments.  A combination  of  centralized  coordi- 
nation of  school  psychological  service,  blended  with  a sensitivity  to  local  school-site  priorities,  will  assure  the  most  efficient  model 
for  the  delivery  of  psychological  service  within  urban  school  restructuring. 


Educational  literature  currently  reflects  a variety  of  re- 
structuring constructs  which  are  gaining  popularity  throughout 
the  nation.  Site-based  management,  teacher  empowerment, 
school  autonomy  and  school-based  management  are  powerful 
concepts  defining  the  merging  trends  in  urban  educational  struc- 
ture. Minimal  empirical  evidence  exists,  however,  to  clearly 
demonstrate  the  effectiveness  of  these  programs  (David,  1989), 
yet  many  traditional  educational  patterns  are  attempting  to 
mirror  corporate  management  structures  that  delegate  authority 
and  flexibility  to  school  staff  (Kanter,  1983). 

It  should  be  noted  that  the  notion  of  site-based  manage- 
ment is  not  a new  concept  nor  a single  process.  Site-based  man- 
agement describes  an  educational  philosophy  that  has  been 
around  for  some  time,  the  belief  that  local  control  of  schools 
improves  educational  quality.  One  could  view  site-based  manage- 
ment as  a response  to  the  numerous  calls  for  reform  beginning 
with  A Nation  At  Risk  (National  Commission  on  Excellence  in 
Education,  1983).  The  first  wave  of  these  reform  efforts  tended 
to  be  sweeping,  centralized  approaches  to  change,  while  the 
second  wave  of  reform  efforts  focused,  tor  the  most  part,  on  the 
individual  school.  John  Goodland  (1984)  emphasized  the  need 
for  decentralization  and  shared  participation  in  the  management 
of  schools.  While  he  noted  that  the  significance  of  the  school 
as  a unit  tor  improvement  and  that  those  who  inhabit  the  school 
are  the  persons  who  must  ultimately  affect  change,  he  recog- 
nized the  need  for  some  centralization,  as  a system  of  checks 
and  balances,  realizing  that  authority  and  responsibility  need 
to  be  differentiated  and  distributed  across  the  system. 

Within  the  restructuring  model,  centralized  administra- 
tion is  redistributed  through  experimental  patterns  offering  a 
greater  degree  of  decision-making  opoons  io  the  local  school 
level.  This  t\pe  of  empowerment  frequently  involves  teacher, 
patent,  community  members,  and  principal  (Harrison,  Killiou, 
& Mitchell.  198V).  The  principal  hnutions  similar  lo  a t hict 
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in  participative  structure  and  exercises  significantly  expanded 
authority  and  responsibility. 

Site-based  management  philosophy  encourages  schools 
to  contract  with  central  office  personnel  for  sendees  (Harrison, 
et  al.,  1989)  after  building  personnel  have  established  priority 
at  the  local  level.  Centralized  staff  change  from  decision-makers 
to  support  personnel  based  on  the  perceived  needs  of  school-based 
management  teams  as  they  take  on  roles  as  facilitators.  New 
responsibilities  of  central  staff  include  providing  technical  support 
and  access  to  information  which  will  enhance  site-based  and 
district-wide  decision  making.  Shared  decision  making  is  viewed 
as  the  vital  process  in  creating  an  effective  school  culture  (Purkey 
Smith,  1985). 

Although  there  exists  many  different  approaches  to  site- 
based  management,  research  on  the  subject  supports  the  fact 
that  roles  and  relationships  at  both  the  central  office  and  school 
level  change.  The  school  hoaai  provides  direction  through  broad 
educational  philosophy  and  mission  statements  for  the  district, 
the  superintendent  delegates  authority  and  power  to  the  local 
site  level  and  teachers  and  principals  participate  in  goal  setting 
site-based  decisions  (“Task  Force,”  1986). 

Expansion  of  these  restructuring  efforts  into  large  urban 
educational  centers  involves  the  critical  need  to  explore  com- 
petent models  of  school  psychology  delivery-service.  While  the 
literature  is  vast  with  information  pertaining  to  school  improve- 
ment and  organizational  change,  minimal  references  are  found 
focusing  on  the  delivery  of  auxiliary  services,  specifically  mental 
health  services  within  the  new  restructuring  models.  Will  the 
local  site-based  management  teams  have  the  technical  knowl- 
edge to  oversee  and  coordinate  mental  health  services  or  will 
arbitrary  decisions  be  made  that  nu>  lack  the  overall  view  of 
psvchologic.il  service  within  the  total  district.1 

Recent  data  suggests  public  schools  continue  to  under 
identity  and  underset vc  handicapped  children  throughout  the 
nation  (Zill  Csl  Schochbmn,  1°90).  Surveys  report  teachers  are 
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encountering  more  pupils  with  severe  leamingdisahilities,  family 
problems,  health  problems  and  high  mobility  rates. 

In  fact,  over  the  last  10  years,  the  number  of 
children  diagnosed  as  learning  disabled  has  increased 
140  percent  to  about  1.9  million  children.  While  edu- 
eators  argue  over  the  meaning  of  the  term  and  debate 
possible  reasons  for  the  increase,  veteran  teachers  claim 
that  they  have  never  before  seen  so  many  children  with 
problems  of  comprehension  and  basic  skills  in  their 
classes  (Reed  & Sautter,  1990,  p.  7). 

New  social  epidemics  of  homeless  children,  children 
horn  with  drug  exposure,  abused  youngsters,  as  well  as  depressed 
and  suicidal  youth  continue  to  tax  the  resources  of  public  schools. 
These  children  are  desperately  in  need  of  competent  mental 
health  services  that  may  best  be  coordinated  through  a cen- 
tralized  model. 

The  need  for  traditional  psychological  services  in  an 
urban  setting  must  be  paramount  in  the  design  of  public  school 
organization.  The  recently  enacted  Individuals  with  Disabilities 
Education  Act  (IDEA)  supersedes  the  Education  of  the  Handi- 
capped  Act  (PL:  94T42)  and  expands  the  services  awarded  to 
handicapped  pupils.  In  addition,  PL:  99-457  mandates  diagnostic 
and  program  options  for  pre-school  handicapped  youth,  thus  the 
traditional  psychometric  skills  of  school  psychologists  are  indis- 
pensable in  meeting  state  and  federal  mandates  and  in  providing 
technical  assistance  for  legal  defense  when  local  decisions  are 
challenged. 

In  addition' to  the  traditional  psychometric  emphasis, 
contemporary  school  psychologists  have  gained  expertise  in 
dealing  with  a variety  of  emerging  trends  within  the  urban  realm. 
Specialization  in  crisis  intervention,  social  skills  training, 
inservice  development,  program  evaluation,  research,  and  case 
management  are  but  a few  of  the  new  subspecialities  of  large 
urban  psychology  divisions.  The  days  of  school  psychologists 
existing  only  to  verify  a child’s  special  education  eligibility  are 
no  longer  appropriate.  School  psychologists  will  continue  to  be 
the  leaders  of  mental  health  services  in  the  public  school  setting 
regardless  of  the  educational  structure  surrounding  their  delivery. 
The  method  of  access  and  type  of  service  obtained  may  vary 
greatly  depending  on  the  model  employed  within  the  district. 

Historically,  school  psychology  “was  a blend  of  many 
kinds  of  educational  and  psychological  practitioners,  loosely 
mobilized  around  a dominant  Rile  of  psychoeducational  assess- 
ment for  special  class  placement”  (Fagan,  1990,  p.  913).  Con- 
temporary school  psychology  attempts  to  stress  prevention, 
consultation  and  accountability  through  research  and  evaluation 
while  providing  the  necessary  assessment  and  intervention  func- 
tion^ (Fagan,  1990).  The  methods  by  which  this  type  of  service 
b delivered  are  crucial  m assuring  adequate  coverage  to  all  stir 
dents  requiting  assistance  regardless  of  the  urban  restructuring 
component.  A recent  field  study  ot  parent  perceptions  of  schoi  , 


psychology  delivery  in  an  urban  setting  revealed  an  overwhelming 
positive  response  when  an  organizational  model  of  centralized 
service  was  utilized  (Bard  & Perry,  1989). 

Placement  of  psychological  services  within  the  urban 
district  depends  on  the  politics  of  the  educational  system  and 
its  historical  structure.  Models  currently  in  place  vary  in  line 
staff  arrangement  and  supervision  credentials.  The  following 
configurations  are  reported  in  the  literature  (Tilley,  1990): 

1.  Pychological  Services— Separate  Depart- 
ment: This  organization  allows  for  the  most  autonomy 
and  opportunity  to  provide  a wide  range  of  services 
throughout  the  district.  The  supervisor  of  psychological 
sendees  reports  directly  to  the  Superintendent  or  Assis- 
tant Superintendent. 

2.  Psychological  Services  within  Pupil  Person- 
nel: This  structure  provides  less  direct  contact  with 
senior  staff  and  thus  is  not  as  powerful  in  distributing 
the  sendees,  depending  on  the  philosophy  of  the  director 
of  pupil  sendees.  Often  the  administrator  in  'harge  of 
the  supervisor  of  psychologists  is  not  trained  as  a ps\- 
chologist  thus  paigram  administration  may  he  curtailed 
to  meet  the  preconceived  needs  of  the  director. 

3 . Psychological  Sendees  within  Special  Educa- 
tion: This  is  perhaps  the  most  narrow  of  confinements 
within  the  traditional  urban  organizational  structure. 
Independence  is  sacrificed  and  psychologists  are  viewed 
as  gatekeepers  tor  special  education  identification. 
Depending  on  state  unit  funding  allotments,  some 
psychologists  are  permitted  to  work  only  with  handi- 
capped youth,  disregarding  the  intense  mental  health 
issues  ot  crisis  intervention  and  other  nontraditional 
services  needed  by  regular  education  pupils. 

4.  Psychological  Sendees  on  a Contract  RaMv 
This  model  places  the  entire  delivery  system  outside  ot 
the  public  school  domain.  Responsibility  and  super- 
vision of  psychologists  is  removed  from  the  schools  and 
placed  in  the  hands  of  a business  corporation  which 
employs  psychologists  for  full-  or  part-time  employment . 

This  arrangement  may  promote  cost  efficiency  through 
the  contract  bidding  procedure,  although  many  problems 
are  encountered,  focusing  on  loyalty,  adherence  to  li  »cal 
procedures  (written  and  unwritten),  internal  politics, 
follow-up  services,  individual  competency  and  profes- 
sional supervision. 

Regardless  of  the  configuration  adopted  for  psychological 
delivery,  close  involvement  with  the  building  psychologist  should 
be  emphased  by  the  site-based  management  team  to  assure  that 
building  priorities  related  to  mental  health  services  a re  appro- 
priate and  handled  in  an  competent  fashn.;*  The  building  Rood 
school  psychologist  is  in  need  of  free  access  to  faculty  and  stm 
dents  in  order  to  monitor  intervention  plans  and  student  progress. 
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building-level  intervention  assistance  teams  are  often  formed 
to  staff  at  risk  children  and  to  develop  appropriate  behavioral 
and  learning  strategies.  For  this  reason,  open  and  ongoing  com- 
munication between  teachers,  administrators  and  the  school 
psychologist  should  be  stressed  when  restructuring  plans 
are  designed. 

In  summary,  the  question  of  whether  or  not  the  local 
site-based  management  team  is  the  most  informed  group  to 
make  decisions  of  such  far-reaching  legal,  social,  and  ethical 
dimensions  as  those  involved  in  school  psychological  delivery 
service  remains  to  be  seen.  While  the  shared  decision-making 
process  may  prove  to  be  an  excellent  model  when  decisions  about 
budget,  staffing,  and  curriculum,  are  needed,  the  expertise  re- 
quired to  implement  federal  and  state  mandates  and  to  orchestrate 
the  overall  need  for  mental  health  services  in  large  urban  districts 
is  most  likely  better  managed  through  the  central  office  adminis- 
tration ot  psychological  services. 

"Central  office  must  continue  to  make  some  decisions 
to  ensure  equity,  balance,  and  uniformity  (Harrison,  et  <iL,  1989, 
p.  57)”  even  if  the  site-based  management  concept  is  utilized. 
The  equity,  balance  and  uniformity  of  psychological  services 
is  best  displayed  when  the  model  of  delivery  encompasses  the 
independence  to  operate  without  internal  constraints  or  special 
interest  encumbrances. 


When  planning  the  access  of  mental  health  services 
within  an  urban  reorganization  model,  careful  review  of  the 
following  issues  is  suggested: 

1.  While  a variety  of  information  is  available 
relating  to  site-based  management  theory  and  practice, 
empirical  data  based  research  studies  are  lacking. 

2.  Equity  of  auxiliary  services  throughout  the 
system  should  be  balanced  to  assure  adequate  coverage. 

3.  A site-based  management  system  needs  to  be 
composed  of  checks  and  balances  which  includes  a 
careful  blend  of  interdependency  between  central  staff 
and  site-based  personnel. 

4.  The  site-based  model  must  define  relation- 
ships among  all  members,  build  in  accountability  and  be 
sensitive  to  the  equal  distribution  of  all  auxiliary  services. 

5.  Mental  health  services,  specifically  school 
psychology,  can  exist  within  any  public  school  structure, 
but  will  thrive  in  a structure  exhibiting  competent  and 
adequate  staffing  patterns,  accurate  needs  assessment 
and  professional  coordination  between  and  among 
central  staff  and  site-based  teams. 
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Voices  in  Education 


The  Mid-Western  Educational  Researcher  asked  leaders  in 
education  to  respond  to  the  question: 

Where  is  the  greatest  need 
for  future  research  in  education? 


The  greatest  need  for  future  research  in  my  est*.  ation  is 
expanding  the  ways  in  which  we  think  about  the  nature  of  cog- 
nition and  the  social  forms  through  which  it  is  stimulated,  prac- 
ticed, and  developed.  Our  views  of  cognition  are  tied  much  too 
closely  to  the  use  of  language  and  number. 

—Elliot  Eisner ; Stanford  University 


Three  areas  of  research  come  to  mind.  First,  research 
establishing  clear  linkage  between  teaching  and  learning  (as 
opposed  to  research  on  teaching  and  research  on  learning). 
Second,  research  investigating  the  plight  of  economically  dis- 
advantaged, low-achieving  children.  In  my  opinion  our  schools 
will  never  be  stronger  (or,  in  the  current  jargon,  “more  effective”) 
than  they  are  for  our  weakest  children . Third,  research  on  schools 
and  classrooms  which  takes  into  consideration  the  complexity 
of  schools  and  classrooms  and  uses  analytical  techniques  that 
are  of  similar  complexity. 

— Lfirm  Anderson,  University  o/Sont/i  Carolina 


The  greatest  need  is  clearly  in  the  area  of  change:  how 
it  can  be  planned  and  facilitated  at  institutional,  programmatic. 


and  individual  levels. 


—Thomas  Guske y.  UniVersity  of  Kentucky 


Research  and  development  directed  toward  the  creation 
of  high-stakes  assessment  devices  aimed  at  defensible  educa- 
tional targets.  —James  Po/>/uim.  UCLA 


Components  of  the  morally  effective  school. 


•Kevin  R\an,  Boston  L’niversir\ 


Curriculum  reform  in  the  junior  high  and  senior  high 
school  years.  -David  Berliner.  Anvma  State  Universus 


Naturalistic  intervention  studies  that  include  teacher  learning 
(e.g.  of  research-based  teaching  and  learning  strategies)  and 


student  learning. 


—Hilda  Borko,  University  0/ Mankind 


Longitudinal  studies  are  needed  to  examine  the  remit  of 
teacher  preparation  models.  What  are  the  experiences  necessary 
to  work  effectively  with  diverse  populations?  How  do  four-year 
and  five-year  programs  differ  when  context  is  held  constant? 
What  are  the  required  components  of  effective  mentoring  systems, 
i.e.,  what  is  working?  —Jane  Stallings.  Texas  A#M  University 


On  the  collective  experiences  of  school  children  across 
the  13  years  of  compulsory  schooling. 

— C/insro/>/ier  Clark.  Michigan  State  University 

In  ways  to  make  perceptible  changes  that  have  the  largest 
potential  payoff.  We  do  too  many  things  for  little  result.  We 
should  he  using  all  our  skills — reading,  looking,  listening,  research, 
and  using  common  sense  to  judge,  i.e.,  by  results.  For  example, 
I believe  the  kinds  of  studies  that  Tom  Good  did  in  the  late 
seventies,  which  took  as  a sample  classroom  teachers  who  had 
up  to  five  years  of  consistently  high-achieving  students  and 
studying  carefully  what  they  do  is  a good  model.  Perhaps  widening 
the  scope  of  outcomes  included  in  identifying  “successful”  reach- 
ing  * now  in  order.  -l.v„  Teachers  College  Columbia 

How  to  support  the  development  of  the  human  being  in 
school  settings.  s-lfduinJ  Pcu.  Uniiv»Mfy  <■/  RoJiestu 


To  help  us  understand  the  required  environment  for 
having  to  he  a good  citizen  in  a democratic  society. 

—Ralph  Tyler,  Center  for  Alvanced 
Study  in  Behai  ioral  Sciences 

Incentives,  restructuring,  national  goals,  international 
comparisons.  —Herbert  Wallwg,  University  of  Illinois  at  Chicago 

To  move  it  from  the  isolation  of  universities  into  a model 
of  school-based  inquiry’  r hat  involves  a focus  on  real  school  prob- 
lems by  teams  of  university  and  school  researchers. 

—Kenneth  Zeit/mer,  (.  ‘nil miry  «>/  Wivomin 

If  you  have  an  interesting  question  or  an  educational 
leader  that  you  would  like  to  bring  to  our  attention,  please  con- 
tact: Gregory  J.  Matchant,  Educational  Psychology,  Teachers 
College,  Rail  State  University,  Muncie,  IN  47306. 
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MWERA  Communication  & Update 


MWERA  at  AERA  As  the  wrecking  ball  was  making  its  first 
impact  against  the  walls  of  the  Comisky  Park  baseball  field,  Bo 
Jackson  was  signing  with  the  Chicago  White  Sox,  and  educational 
researchers  from  across  the  country  were  taking  the  field  at  the 
Hyatt  and  Marriott  hotels  in  the  windy  city.  Members  of  the 
Mid-Western  Educational  Research  Association  were  well  repre- 
sented in  the  dugout  and  on  the  field.  More  than  100  MWERA 
members  took  advantage  of  special  room  rates  and  called  the 
Bismarck  Hotel  home  base,  and  approximately  50  members  did 
some  heavy  hitting  as  participants  in  conference  presentations. 

The  first  evening  of  the  conference  MWERA  sponsored 
a twilight  doubleheader  featuring  Carl  Huberty,  University  of 
Georgia,  and  Andrew  Porter,  University  of  Wisconsin.  Huberty 

expressed  concern  regard- 
ing the  quality  of  training 
* that  doctoral  students  re- 
ceive in  research  and  sta- 
tistical methodology,  al- 
though he  is  seeing  some 
improvement  due  to  an 
influx  of  new  faculty.  He 
stated  that  there  needs  to 
Carl  Huberty  (left),  Andrew  Porter  be  more  methodologists 

serving  as  coauthors  with 
substantive  researchers,  and  that  every'  manuscript  considered  for 
publication  should  be  reviewed  by  a methodologist.  He  also  noted 
the  poor  quality  of  some  new  textbooks. 

Porter  discussed  a new  committee  formed  by  the  National 
Research  Council  and  National  Academy  of  Science  with  the  goal 
of  establishing  the  role  of  the  federal  government  in  educational 
research.  He  emphasized  the  very  brief  history*  that  educational 
research  has  enjoyed.  He  noted  how  educational  research  has 


become  much  more  complex,  more  practitioner-oriented,  and 
more  interdisciplinary*.  Porter  stated  that  we  need  to  make  an 
investment  in  educational  research  that  reflects  the  importance 
we  place  on  education.  He  suggested  one  or  two  percent  of  the 
budget,  which  would  be  a mammoth  increase,  would  still  be  shy 
of  the  eight  percent  spent  by  businesses.  He  urged  that  more 
grants  should  be  field  initiated  and  not  directed  by  the  govern- 
ment. He  also  suggested  that  too  much  moeny  goes  to  centers 
instead  of  individual  researchers,  and  that  there  needs  to  be 
more  stability  in  research  priorities. 

- r* . Friday  even ing  Adria  Karle- 

Weiss  took  the  plate— and 
passed  it  to  her  guests  as 
she  hosted  a MWERA 
party.  Attendance  was  very 
gGod  as  guests  filled  her 
suite  and  spilled  out  into 
the  hallway  during  the 
seventh  inning  stretch  be- 
(L-R)  Mria  KarleWeiss.  John  Pohlmann  fore  AERA  winded  down 

and  Jack  Snotcman  for  the  weekend. 

Overall  it  would 
appear  that  MWERA  has 
a strong  team  that  can 
play,  and  research,  with 
anybody  in  the  country. 
It  is  sure  to  be  quite  an 
event  when  the  MWERA 
All-Stars  assemble  in  Chi- 
23  cago  again  in  October  for 
Rick  Broun,  Ralph  O.  Mueller,  and  the  MWERA  annual  meet- 

Puuw  Dupre?  ing.  Plan  to  be  there. 


Rie/c  Braun,  Rafph  O.  Mueller,  find 
Puuitf  Dupre? 


1991  MWERA  Election  Results 


A.  Officers  Elected 


1.  Vice-President  and 
1992  Program  Chair 

2.  Member-At-Large 

3.  Association 
Council  Members 


Successful  Candidas 


Richard  Pugh 


Sharon  McNeely 

Thomas  Andre 
Sonya  Blixt 
Alice  Corkill 
MaryAnn  Flowers 
John  Pohlmann 
E.  Jane  Williams 
Jane  Zaharias 


University 


Indiana  U. 


NE  Illinois  U. 

Iowa  State  Univ. 

Kent  State  Univ. 

Univ.  of  W.  Ontario 
Univ.  of  Toledo 
S.  Illinois  Univ. 
Columbus  Public  Schools 
Cleveland  State  Univ. 


Term  of  Office 


1991-92.  Automatically  moves  in 
as  President  Elect,  President,  and 
Past-President  in  following  years. 

1991-93 

1991-93 

1991-93 

1991-93 

1991-93 

1991-93 

1991-93 

1991-93 


B.  Resolution  on:  (a)  Dues  Increase:  Yes 

(b)  Calendar  Changes:  Yes 


($18  regular,  and  $10  student,  effective  January  1992) 
(End  of  Annual  meeting  starts  new  Term  of  Oltice) 


M/JAVcircm  DfiiuUionul  /u1 

H r'-X 


\olumr  4.  \umlvi  l * Summer  1*W| 
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MWERA  Communication  and  Update  (continued) 


Special  TIP  Issue  on  Evaluation  MWERA  member  James 
Altschuld,  The  Ohio  State  University,  served  as  the  guest  editor 
of  the  Winter  1991  special  issue  of  Theory  Into  Practice.  The  issue, 
“Educational  Evaluation:  An  Evolving  Field,”  investigates 
educational  evaluation  with  respect  to  several  key  areas,  including 
changes  in  purpose  and  methodologies;  trends  in  the  teaching  of 
evaluation;  evaluating  teaching  in  higher  education;  classroom 
observation;  state  and  local  initiatives;  and  mandated  competency 
testing.  Individual  copies  are  available  for  $6  from  the  College 
of  Education  Business  Office,  174  Arps  Hall,  1945  North  High 
Street,  Columbus,  OH  43210. 

Important  Contributors  The  editors  of  the  Mid-Western 
Educational  Researcher  would  like  to  express  their  thanks  to 
everyone  who  submitted  a manuscript  for  publication.  If  your 


manuscript  was  not  accepted,  we  want  to  thank  you  for  thinking 
of  us,  and  we  encourage  you  to  submit  work  to  us  again.  We  would 
also  like  to  express  our  gratitude  to  the  following  professionals  for 
reviewing  papers  over  the  past  year.  It  was  obvious  that  a great  deal 
of  time  and  effort  was  put  into  the  reviews,  and  many  of  these 
individuals  reviewed  several  papers  with  very  tight  time  con- 
straints. Thanks  to:  Robert  Brennan,  American  College  Testing 
Program;  Lawrence  Gerstein,  Ball  State  University;  Betty  Gridley, 
Ball  State  University;  Judson  Harmon,  Wisconsin  Department 
of  Public  Instruction;  Donald  Jones,  Ball  State  University;  Mark 
Kiselica,  Ball  State  University;  Dennis  Leitner,  Southern  Illinois 
University;  William  Loadman,  The  Ohio  State  University;  Jay 
Price,  University  of  Wisconsin-Stevens  Point;  Ulrich  Reitzug, 
Ball  State  University;  Marcia  Summers,  Ball  State  University; 
Harolyn  VanEvery-Filson,  Ball  State  University;  and  Roy  Weaver, 
Ball  State  University. 


Catastrophe  and  Chaos  Theory  (continued  from  page  6) 

Chaos  theory  provides  insight  into  biology  and  medicine, 
economics,  ecology,  epidemiology,  metalluigy,  physics,  chemistry, 
and  many  other  ti  dds.  Without  claiming  an  exhaustive  review, 
Gleik  (1987)  lists  over  300  references  and  citations  on  chaos 
theory  and  its  avenue  of  expression,  fractal  geometry.  Chaos 
explains  how  cardiac  arrhythmias  and  epileptic  seizures  propagate. 
It  demonstrates  why  efforts  to  inoculate  a population  against 
disease  sometimes  result  in  an  increase  in  cases  the  next  season. 
It  describes  how  adding  new  roads  to  relieve  traffic  congestion 
can  result  in  longer  travel  times,  and  what  happens  when  metal 
breaks  and  watet  freezes.  Chaos  may  pawide  important  insights 
into  mood  states  and  how  individuals  undergo  abrupt  ideological 
conversions  or  tenaciously  cling  to  irrational  ideas  in  the  face  of 
evidence  to  the  contrary’.  It  explains  why  experimental  error  is 
inevitable  and  knowledge  of  any  system,  no  matter  how  seemingly 
trivial  the  system,  is  forever  incomplete. 

The  overall  aim  of  this  note  is  to  suggest  that  catastrophes 
may  be  thought  of  as  a special  case  of  chaotic  behavior  (as  a 
circle  is  a special  case  of  an  elipse),  more  specifically,  a repre- 
sentation of  what  happens  at  the  chaotic  boundaries.  “Chaotic” 
serves  to  describe  the  system— the  “macrobehavior —‘catastrophic” 
describes  what  happens  as  a result  of  the  inherent  chaos  in  the 
system,  or  the  “microbehavior”  The  cusp  catastrophe  example 
given  might  also  be  mapped  onto  the  “bifurcation”  fractal  (Figure 
1)  that  is  sometimes  used  to  model  the  population  dynamics  in 
a predator-prey  relationship  or  with  increasing  food  supply  or 
fecundity.  Reading  from  the  left,  the  population  remains  steady 
at  increasing  levels  of  X until  a certain  value,  then  a bifurcation 
appears.  There  are  now  two  equally  probable  population  sues  (the 
Y coordinate)  for  that  value  of  X.  A catastrophe  has  occurred 
at  the  bifurcation.  It  is  interesting  that  no  matter  how  much 
one  “magnifies”  the  bifurcation  in  an  effort  to  see  where  it 
“really”  starts,  it  forever  recedes  from  view.  One  has  knowledge 


of  prior  events  and  later  events,  but  the  catastrophe  itself  remains 
modestly  invisible.  It  is  at  this  point  the  dog  fights  or  flees. 
“Adding  anger  to  a frightened  dog”  leads  to  one  path,  “adding 
fear  to  an  enraged  dog”  leads  to  another.  The  rest  of  the  figure 
is  not  relevant  to  this  note,  but  represents  what  happens  as  a 
behavior  system  becomes  more  and  more  “driven  ” At  some  point 
on  the  X axis,  the  Y variable  becomes  chaotic,  but  within  limits. 

The  aim  of  this  note  is  not  to  reconcile  catastrophe  and 
chaos  theory,  but  simply  to  share  some  thoughts  that,  at  best, 
have  some  heuristic  value. 

References 

D’Costa  (1991).  Catastrophe  Theory  and  Catastrophes  in  Chinas 
Civil  Service  Examinations.  Mid-Western  Educational  Researcher ; 
4(1),  2-4. 
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1 Anyone  who  has  unintentionally  jihed  a sailboat  in  a following  wind  h«i\  vivid 
firsthand  knowledge  of  a cusp  catastrophe. 
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MWERA  Research  Exchange 

Educational  research  can  be  a demanding  as  well  as  rewarding  endeavor.  Even  the  smallest  of  proj- 
ects  requires  a great  deal  of  knowledge  and  skills.  It  is  not  always  easy  to  find  a colleague  with  your  research 
interests.  Sometimes  a few  extra  subjects  would  make  a big  difference.  In  some  cases  it  would  be  helpful  just 
to  compare  notes  concerning  references. 

In  an  effort  to  mediate  the  knowledge  and  skills  of  its  membership,  the  MidAVestem  Educational 
Researcher  is  requesting  its  members  to  complete  the  form  below  and  return  it  by  October  14.  A directory 
will  be  published  in  the  Winter  1992  issue.  You  may  indicate  one  or  two  specific  areas  of  interest  (please 
use  concise  working  that  includes  information  such  as  grade  level,  subject  matter,  research  approach,  etc.). 
This  information  may  be  edited  due  to  space  limitations. 


Name  __ 
Address 


Specific  Research  Interest  #1 


(Please  check  all  that  apply) 

□ 1 can  provide  information  and  references  in  this  area 

□ I can  provide  access  to  subjects  in  this  area 

□ 1 can  provide  skills  in  analysis  or  design  in  this  area 

□ I am  seeking  a co-author  and/or  assistance  in  this  area 

□ I am  seeking  additional  information  in  this  area 

□ I am  seeking  research  design  or  statistics  information 

□ I need  additional  subjects  in  this  area 

□ other 

Specific  Research  Interest  #2 


(Please  check  all  that  apply) 

□ I can  provide  information  and  references  in  this  area 

□ I can  provide  access  to  subjects  in  this  area 

□ I can  provide  skills  in  analysis  or  design  in  this  area 

□ I am  seeking  a co-author  and/or  assistance  in  this  area 

□ I am  seeking  additional  information  in  this  area 

□ I am  seeking  research  design  or  statistics  information 

□ I need  additional  subjects  in  this  area 

fl  other .... 


Please  return  this  fonn  by  October  14  to:  Gregory  J.  Marchant,  Educational  Psychology,  Teachers  College, 
Rail  State  University,  Muncic,  IN  47306-0595,  ur  bring  it  to  the  MWERA  annual  meeting  October  16-19. 
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October  16-19,  1991 


MWERA  Communication  & Update 

The  Mid-Western  Educational  Researcher  is  now  among  periodicals  deposited  in  the  Library  of 
Congress.  In  addition,  all  substantive  articles  from  the  Mid-Wfestem  Educatfona!  Researcher  are  now 
indexed  in  ERIC’s  CIJE.  When  you  are  considering  a place  to  submit  your  MWERA  papers  or  other 
manuscripts  for  publication,  consider  your  Mid-Wfcstem  Educational  Researcher. 


Information  for  Contributors  to  the  Mid-Western  Educational  Researcher 

The  Mid-Western  Educational  Researcher  accepts  research-based  manuscripts  that  would  appeal  to  a 
wide  range  of  readers.  All  materials  submitted  for  publication  must  conform  to  the  language,  style,  and  format  of  the 
Pwblican'on  Manual  of  the  American  Psychological  Association,  3rd  cd.,  1983  (available  from  Order  Department, 
American  Psychological  Association,  P.O.  Box  2710,  Hyattsville,  MD  20784). 

Three  copies  of  the  manuscript  should  be  submitted  typed  double  space  (including  quotations  and  references)  on 
8Vzxll  paper.  Only  words  to  be  italicized  should  be  underlined.  Abbreviations  and  acronyms  should  be  spelled  out  for 
the  first  mention.  Pages  should  be  numbered  consecutively,  beginning  with  the  page  after  the  title  page. 
Manuscripts  should  be  less  than  20  pages  long.  An  abstract  of  less  than  100  words  should  accompany  the  manuscript. 

The  manuscript  will  receive  blind  review  from  at  least  two  professionals  with  expertise  in  the  area  of  the  manuscript. 
The  author’s  name,  affiliation,  etc.,  should  appear  on  the  title  page  only.  Efforts  will  be  made  to  keep  the  review  process 
to  less  than  two  months.  The  editors  reserve  the  right  to  make  minor  editorial  changes  in  order  to  facilitate  a 
concise  clear  article.  The  author  will  be  consulted  if  any  major  changes  are  necessary. 

Manuscripts  should  be  sent  with  a cover  letter  to: 

Gregory  J.  Manchant  Isadore  Newman 

Educational  Psychology  Office  of  Educational  Research 

Teachers  College  or  College  of  Education 

Ball  State  University  The  University  of  Akron 

Muncie,  IN  47306-0595  Akron,  OH  44325-4205 


The  Mid-VCtairm  Eduamoiwl  Researcher  (ISSN  1056-5997)  is  published  quarterly  by  the  Mid-Western  Educational  Research  Association  through 
Tire  University  of  Akron.  The  fall  issue  serves  as  the  annual  meeting  program.  Second-class  postage  paid  at  Akron.  Ohio,  and  additional 
mailing  offices.  POSTMASTER  Send  address  changes  to  Charles  Anderson,  1552  Southwind  Drive.  Nonhhmok,  IL  60062 
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October  16-19,  1991 


Thirteenth  Annual  Meeting 


Program  Orientation 

Welcome  to  the  1991  program.  It  is  big,  boasting  nearly  200 
presentations;  it  is  unique,  introducing  a number  of  new  activities; 
and  it  is  traditional,  retaining  the  many  events  that  make  our 
conference  special.  A brief  description  of  conference  highlights 
follows. 

A New  Beginning 

The  1991  conference  begins  a day  earlier  than  usual.  Following  the  preconference  training 
workshops  on  Wednesday  afternoon,  the  conference  kicks  off  Wednesday  evening  with  an  Invited 
Presentation.  Joel  Levin,  University  ofWisconsin-Madison,  and  Editor  of  the  Journal  of  Educational 
Psychology , presents  Tips  for  Publishing  and  Professional  Writing  from  8-9  p.m. 

The  conference  ends  on  a new  note,  too.  The  customary  Presidential  Address  and  Business 
Meeting  are  absent  from  Saturday's  agenda.  Instead,  a full  slate  of  Saturday  Sessions  runs  from 
9 a.m.  - 1 p.m.  Please  make  your  travel  arrangements  in  line  with  this  revised  schedule. 

Invited  Speakers 

Another  unique  feature  is  the  added  number  of  invited  speakers  with  conference-wide  appeal. 
Joel  Levin,  in  addition  to  his  Wednesday  evening  address,  makes  the  traditional  Keynote  Address 
Thursday  at  9:45  a.m.  The  topic  is  Pictorial  Strategies  for  Learning  and  Instruction. 

Annemarie  Palinscar,  University  of  Michigan,  presents  Enhancing  Scientific  Reasoning 
Through  Collaborative  Problem  Solving  in  a special  Thursday  evening  session  from  5-6  p.m. 

Carole  Ames,  University  of  Illinois  at  Urbana-Champaign,  makes  the  traditional  luncheon 
address  on  Friday  afternoon.  Her  topic  is  Enhancing  Student  Motivation. 

A special  Friday  evening  session  features  Michael  Pressley,  University  of  Maryland,  who 
presents  What  It  Takes  to  Get  the  Nation’s  Children  to  be  Good  Readers:  Issues  and  Methods  from  4:30- 
6 p.m. 

There  is  more  in  the  way  of  invited  sessions.  Several  divisions  have  arranged  invited  addresses 
scheduled  throughout  the  conference. 

Professional  Development 

Three  new  events  are  included  to  facilitate  professional  growth.  On  Friday,  conference 
registrants  can  visit  Exhibits  and  Meet  the  Editors  of  several  professional  journals.  Exhibitors  will 
display  books  and  other  educational  materials.  The  editors  will  describe  their  journals  and  discuss 
topics  such  as  hints  for  publishing  and  trends  in  educational  research. 

On  Saturday,  consecutive  sessions  pertaining  to  Multicultural  Education  are  scheduled.  One 
of  these  is  an  invited  address  by  Richard  A.  Shweder,  University  of  Chicago,  who  presents  Are  the 
Pilgrims  Your  Forefathers  and  Other  Problems  of  Multicultural  Education.  A second  invited  address, 
Research  Dimensons  of  Multicultural  Education,  is  by  James  Boyer,  Kansas  State  University. 

The  professional  development  of  area  school  personnel  continues  as  a primary  emphasis  of  the 
M WER  A conference.  Conference  programming  reflects  this  emphasis  by  scheduling  relevant  sessions 
in  the  evening  and  on  Saturday.  A training  workshop  entitled  Teaching  Learners  How  to  Learn  is 
presented  by  Kenneth  A.  Kiewra,  University  of  Nebraska,  Wednesday  evening  from  4-7  p.m.  Invited 
addresses  are  scheduled  for  Wednesday,  Thursday,  and  Friday  evenings.  In  addition,  several  sessions 
related  to  teaching  and  learning  are  scheduled  for  Saturday.  Special  registration  rates  are  available  to 
area  school  personnel.  Contact  Program  Chair,  Kenneth  Kiewra,  for  details  (402-472-3233). 
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As  usual,  the  1991  program  is  brimming  with  social  activities.  The  executive  committee  hosts 
a New  Member  Welcome  Thursday  at  9 a.m.  First-time  conference  attendees  will  be  introduced  to  the 
organization  in  general  and  to  the  conference  in  particular. 

Midwest  Hospitality  greets  all  conference  participants  Thursday,  Friday,  and  Saturday  mornings. 
Join  friends  for  coffee  and  pastries. 

The  traditional  Crackerbarrel  Social  is  from  6-8  p.m.  on  Thursday.  Piano  accompaniment  is 
again  provided  by  Roger  Bruning,  University  of  Nebraska. 

Friday  night  is  the  President's  Reception  beginning  at  9 p.m . Wine  and  beer  are  complementary. 
The  reception  should  break  up  in  time  for  the  inaugual  Along  the  Lake  Shore  Shuffle.  This  low- 
key  run  (walking  and  crawling  are  options,  too)  is  approximately  2 miles  long.  It  begins  around  7 a.m. 
Saturday,  near  the  Chicago  Yacht  Club. 


Chronological  Summary  of  Events 


Wednesday,  October  16 

12:00-7:00  p.m. 

Preconference  Training  Workshops 

8:00-9:00  p.m. 

Invited  Address,  Joel  Levin 

Thursday,  October  17 

8:30-9:45  a.m. 

Midwest  Hospitality 

9:00-9:45  a.m. 

New  Member  Welcome 

9:45-10:50  a.m. 

Keynote  Address,  Joel  Levin 

11:00  a.m.-4:50  p.m. 

Sessions 

5:00-6:00  p.m. 

Invited  Address,  Annemarie  Palinscar 

6:00-8:00  p.m. 

Crackerbarrel  Social 

Friday,  October  18 

7:30-9:00  a.m. 

Midwest  Hospitality 

9:00  a.m.-  4:00  p.m. 

Exhibits 

9:00-10:50  a.m. 

Sessions 

11:00-11:50  a.m. 

General  Business  Meeting 

12:00-1:50  p.m. 

Luncheon,  Invited  Address  by  Carole  Ames 

2:00-4:20  p.m. 

Sessions 

2:00-4:00  p.m. 

Meet  the  Editors 

4:30-6:00  p.m. 

Invited  Address,  Michael  Pressley 

9:00  p.m.-???? 

Presidential  Reception 

Saturday,  October  19 

7:00  a.m. 

Around  the  Lake  Shore  Shuffle 

7:30-9:00  a.m. 

Midwest  Hospitaltiy 

9:00  a.m.-l:00  p.m. 

Sessions 

9:00  a.m.-l  :00  p.m. 

Special  Sessions  on  Multicultural  Education 
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1991  Program  Committee 

Many  people  helped  plan  the  1991  conference.  A special  thanks  to  the  following: 

Program  Chair 

Kenneth  A.  Kiewra,  University  of  Nebraska 
Program  Assistant 

Mary  E.  Weiss,  University  of  Nebraska 
Division  Chairs 

A.  E.  Jean  Harper,  Wright  State  University 
Wenifort  C.  Washington,  University  of  Akron 

B.  Alice  Darr,  Kent  State  University 

Sarah  E.  Peterson,  Northern  Illinois  University 

C.  Alice  J.  Corkill,  University  of  Western  Ontario 
Gregory  Schraw,  University  of  Nebraska 

D.  Ralph  O.  Mueller,  University  of  Toledo 
Leslie  E.  Lukin,  University  of  Missouri 

E.  Jennifer  T.  Parkhurst,  University  of  Nebraska 
S.  Alvin  Leung,  University  of  Nebraska 

F.  Fred  Buddy,  Spelman  College 

Nelson  Strobert,  Lutheran  Theological  Seminary 

G.  Mary  R.  Sudzina,  University  of  Dayton 

Joan  S.  Timm,  University  of  Wisconsin-Oshkosh 

H.  Carolyn  R.  Benz,  University  of  Dayton 
Richard  C.  Pugh,  Indiana  University 

I.  Bunny  Pozehl,  University  of  Nebraska 
Patricia  B.  Mullan,  University  of  Michigan 

J.  M.  Cecil  Smith,  Northern  Illinois  University 
William  E,  Loadman,  Ohio  State  University 

K.  Mary  Ann  Flowers,  University  of  Toledo 
Charlene  M.  Czerniak,  University  of  Toledo 

Workshop  Coordinators 

Carolanne  Kardash,  University  of  Missouri 
Stephen  L.  Benton,  Kansas  State  University 

MggUhs.Editors  Coordinator 

Carolanne  Kardash,  University  of  Missouri 

Local  Coordinator  and  Exhibits  Coordinator 
Sharon  McNeely,  Northern  Illinois  University 

Registration  Coordinators 

Cathy  A.  Pohan,  University  of  Nebraska 
Julie  McGowan,  University  of  Nebraska 

Midwest  Hospitality  Coordinator 
Adria  Karle-Weiss,  Akron,  Ohio 

Graphic Artists 

Kenneth  Jensen,  Travis  Wagner,  University  of  Nebraska 

A special  thank-you  to  all  of  you  who  reviewed  proposals,  to  Charles  Anderson  (Executive  Officer)  and  to 
Executive  Committee  Members  Leitner,  D’Costa,  Plake,  Price,  Williams,  Anderson,  Marchant  and  Newman. 


MWERA  Researcher 


Volume  4 Number  4 


Association  Business 
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Dennis  W.  Leitner,  Southern  Illinois  University 
President 

Ayres  G.  D’Costa,  Ohio  State  University 
President-Elect 

Barbara  S.  Plake,  University  of  Nebraska 

Vice  President 

Kenneth  A.  Kiewra,  University  of  Nebraska 

Sfigretar.Y. 

Jay  R.  Price,  University  of  Wisconsin-Stevens  Point 


E.  Jane  Williams,  Columbus,  Ohio 


Charles  C.  Anderson,  Jr.,  Northbrook,  Illinois 


Gregory  J.  Marchant,  Ball  State  University 
Isadore  Newman,  University  of  Akron 


Donald  R.  Cruickshank,  Ohio  State  University 
Orpha  K.  Duel!,  Wichita  State  University 
John  Frass,  Ashland  College,  Ohio 


Issue  #1;  Change  of  Dates  for  Term  of  Office 

The  term  of  office  for  Association  Council 
will  begin  at  the  close  of  the  annual  meeting 
of  the  Association  through  the  next  annual 
meeting. 

Issue  #2:  Membership  Dues  Increase 

Duesforregularmembers  will  be  raised  from 
$10.00  to  $18.00  beginning  in  1992.  Student 
membership  dues  will  remain  at  $10.00. 


Vice  President:  Richard  C.  Pugh,  Indiana  University 
Member-at-Large:  Sharon  McNeely,  Northeastern 
Illinois  University 
Association  Council  (1991-1993): 

Tom  Andre,  Iowa  State  University 
Sonya  L.  Blixt,  Kent  State  University 
Alice  J.  Corkill,  University  of  Western  Ontario 
Mary  Ann  Flowers,  University  of  Toledo 
John  Pohlmann,  Southern  Illinois  University 
E.  Jane  Williams,  Columbus  Public  Schools 
Jane  Zaharias,  Cleveland  State  Universitv 


aiwi.Uck 


Larry  Gruppen,  University  of  Michigan 

E.  Jean  Harper,  Wright  State  University 

Nancy  J.  Kadunc,  Albion  College 

John  J.  Kennedy,  Ohio  State  University 

Richard  P.  Lipka,  Pittsburgh  State  University,  Kansas 

Gregory  J.  Marchant,  Ball  State  University 

Sharon  McNeely,  Northeastern  Illinois  University 

Ralph  O.  Mueller,  University  of  Toledo 

Richard  C.  Pugh,  University  of  Indiana 

Robert  Rosemier,  Northern  Illinois  University 

Joan  S.  Timm,  University  of  Wisconsin -Oshkosh 

Steven  L.  Wise,  University  of  Nebraska 


MWERA  Association  Council  and  Program  Chairs 
Thursday,  October  17 
2:00  - 3:20,  Medill 

MWERA  General  Business  Meeting 
Friday,  October  18 
1 1 :00  - 1 1 :50,  Maximilian 

MWERA  Executive  Council  Meeting 
Saturday,  October  19 
1:00-3:00,  Blackhawk 
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How  to  Get  to  the  Conference 


When  coming  into  Chicago,  attendees  have  a variety  of  transportation  options  presented  below.  Please 
read  these  to  plan  your  trip  accordingly. 

Midwest  Airlines,  along  with  Uniglobe  Travel,  is  offering  discounted  fares  to  MWERA  Conference 
attendees:  40%  off  regular  coach  and  5%  off  the  lowest  fares.  Call  800-458-5455  for  information. 

O’Hare  Airport  to  the  Bismarck  Hotel  (3  options) 

1)  Take  a CTA  train  to  downtown  for  $1.25.  Catch  the  train  in  the  basement  of  Terminal  3.  Take  an  A or  B line.  Getoffat 
Lake  Transfer.  This  is  in  the  basement  of  the  State  of  Illinois  Building.  Climb  the  stairs  and  proceed  to  the  Bismarck,  one 
block.  This  is  the  fastest  way  during  rush  hours  and  the  cheapest. 

2)  Take  the  Continental  Bus  for  $12.50  one-way  or  $22.00  round  trip.  No  reservations  are  required  from  the  airport.  See  the 
agent  at  the  booth  in  the  lower  level  baggage  claim  area. 

3)  Take  a cab  for  around  $20.00,  Wait  in  the  cab  stand  area.  In  off-hours  a ride  takes  about  30  minutes.  In  rush  hours  (7-10 
a.mM  3-7  p.m.),  the  ride  could  take  an  hour  or  more.  Tip  should  depend  on  time  and  cost;  fifteen  percent  is  average. 


Midway  Airport  to  the  Bismarck  Hotel  (3  options) 

1 ) Take  a CTA  bus  and  train  to  downtown  for  $ 1 .25.  Catch  the  Cicero  Bus  54B  (headed  North)  on  Cicero  Avenue,  across  from 
the  airport.  Ask  for  a transfer  for  the  train  when  you  board.  Get  off  at  22nd  and  Cicero.  Catch  the  Douglas-0 ’Hare  line 
train  going  East  (to  the  Loop).  Get  off  at  the  Lake  Transfer  station.  This  is  in  the  basement  of  the  State  of  Illinois  Building. 
Climb  the  stairs  and  proceed  to  the  Bismarck,  one  block. 

2)  Take  a Continental  Airport  Bus  for  $9.50  one  way  or  $16.75  round  trip.  No  reservations  are  required.  See  the  agent  at  the 
booth  for  tickets. 

3)  Take  a cab  for  around  $18.00.  See  O’Hare  information  above  regarding  time.  SS*  / 

Driving  But  NOT  Parking  Downtown  (3  options) 

From  the  North  or  West 

1)  Park  near  a Metra  station  and  take  a MetraTrain  downtown.  From  the  Metra  station  you  will  need  to  take  a cab  to  the  hotel. 
Depending  on  where  you  board  the  train,  your  ride  can  be  inexpensive.  For  details  call  (312)  836-7000.  Be  certain  to  find 
out  about  return  trips,  especially  on  weekends. 

2)  Park  at  O ’Hare  remote  (follow  highway  signs  to  O’Hare),  take  a shuttle  into  O’Hare  and  follow  any  of  the  O’Hare  options. 
Remote  parking  is  inexpensive. 

3)  Park  at  a Kiss  and  Ride  at  either  the  Cumberland  or  die  Harlem  Avenue  exits  off  of  1-94  (the  Kennedy).  Take  the  CTA  train 
(See  O’Hare  option  1).  Parking  is  inexpensive. 


From  the  South  or  East 

1)  Park  near  a Metra  Station  and  take  a Metra  Train.  See  1 above. 

Driving  And  Parking  Downtown  (4  options) 

• Listen  to  the  Radio  (670  or  780  am)  for  traffic  reports. 

• Remember,  rush  hour  is  7-10  a.m.  and  3-7  p.m.  in  both  directions.  Travel  in  the  city  takes  time.  There  is  a lot  of  construction. 

Plan  at  least  two  hours  from  the  near  suburbs  to  downtown.  Plan  one-half  hour  (minimum)  in  downtown  traffic. 

1 ) Coming  in  on  1-94  from  the  North:  1-94  junctions  with  the  Kennedy  at  Irving  Park  Road.  Continue  downtown.  If  traffic 
is  good,  it  should  take  20  minutes  from  the  junction.  Beyond  the  Ohio  Street  exit,  get  in  the  right  hand  lane.  Exit  at 
Washington  Street  going  East.  At  LaSalle,  make  a left,  go  one  block  and  make  a right  on  Randolph  to  the  hotel.  After  you 
drop  off  your  baggage  you  can  park  your  car  in  a self-park  (about  $15.00  per  day)  or  have  the  hotel  park  it. 

2)  Coming  in  on  1-90  from  the  Northwest:  Follow  1-90  downtown.  This  becomes  the  Kennedy.  It  is  under  construction. 
Double  your  normal  city  travel  time.  Follow  directions  of  1 above  for  exits  and  parking. 

3)  Coming  in  on  I-90/I-94  from  the  Southeast:  Take  the  1-90  (Skyway)  in.  The  toll  will  be  $1 .50,  but  it  will  save  you  a lot 
of  time.  Get  in  the  Express  Lanes  to  downtown.  When  you  approach  the  LOOP  follow  the  signs  saying  1-94,  Kennedy  and 
Wisconsin.  Exit  at  Monroe  street  and  head  east.  At  LaSalle  take  a left,  then  a right  on  Randolph  to  the  hotel.  After  you 
drop  off  your  baggage  you  can  park  your  car  in  a self-park  (about  $15.00  per  day)  or  have  the  hotel  park  it. 

4)  Coming  in  from  the  South  or  Southwest:  Take  the  1-57  in.  This  junctions  with  1-94  and  1-90.  Read  3 above. 

If  you  are  arriving  some  other  way,  or  have  any  questions,  please  call  Sharon  McNcely  at  (312)  794-2788  before  yourtrip.  She  will 
bo  happy  to  help. 
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Conference  Registration  Information 

General  Information 

1.  The  Conference  sessions  begin  Wednesday,  October  16,  1991  and  end  Saturday,  October  19, 
1991.  Please  make  travel  arrangements  accordingly. 

2.  Pre-register  for  the  conference  using  the  following  registration  materials.  Be  certain  to  register 
for  the  conference,  make  hotel  reservations,  and  if  interested,  register  for  one  or  two  preconference 
training  workshops.  Workshop  descriptions  are  on  pages  9-10. 

3.  All  conference  participants  must  be  members  of  MWERA.  Please  pay  1991  dues  if  you  have 
notalreadydoneso.  Now  is  an  excellent  time  to  pay  1992  dues  as  well.  Membership  in  MWERA 
includes  a subscription  to  the  Midwestern  Educational  Researcher. 

4.  On-site  registration  and  packet  pickup  are  in  the  lobby  of  the  Bismarck  Hotel  at  the  following 
times: 


Wednesday,  October  16,  1991 
Thursday,  October  17,  1991 
Friday,  October  18, 1991 
Saturday,  October  19,  1991 


11:00  - 4:00  p.m. 
8:00  - 4:00  p.m. 
8:00  -4:00  p.m. 
8:00  - 10:00  a.m. 


5.  Please  bring  this  program  with  you  to  the  conference.  A replacement  copy  will  cost  $2.00 

6.  Please  share  your  conference  program  and  registration  materials  with  co-authors,  colleagues 
and  students  and  invite  them  to  attend. 


Un 
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Mid-Western  Educational  Research  Association 
Annual  Meeting  Registration  Form 

Required  of  New  Members  Only  : 

Highest  Degree: 

MWERA  Division  Preference: 

(See  list  next  page) 

Major  Area  of  Specialization:  

Telephone 

Office: Home: 

Is  this  your  first  MWERA  conference? yes no 

ANNUAL  MEETING  REGISTRATION  FEE.  Check  your  membership  status  below: 

Graduate  Student  (pre-registration  fee  $25,  on-site  $30) 

Regular  Professional  (pre-registration  fee  $35,  on-site  $45) 

Non-member  (pre -registration  fee  $45,  on-site  $55) 


Please  print  or  type  all  information 

Name 

Institution 

Complete  Mailing  Address 


1991  MEMBERSHIP  DUES  $10  $ 

1992  MEMBERSHIP  DUES 
Graduate  Students  $10 

Regular  Member  $ 1 8 $ 

PRE-CONFERENCE  WORKSHOP(S).  Indicate  your  choice(s)  below: 

12:00  noon,  $15.00  fee 

Workshop  A or  Workshop  B $ 

4:00  p.m.,  $15.00  fee 

Workshop  C or  Workshop  D $ 

Total  Amount  Due:  $ 


*Special  registration  rates  are  available  to  Area  School  Personnel* 
Contact  Program  Chair,  Kenneth  Kiewra  (402  472-3233) 
Please  make  your  check  payable  to: 

Mid-Western  Research  Association  (MWERA) 

Mail  this  completed  registration  form  and  your  check  by  October  8 to: 


-4r*=~- 


Charles  C.  Anderson 
1332  Southwind  Drive 
Northbrook,  Illinois  60062 


Hotel  Reservation  Form 

Mid-Wcstcm  Educational  Research  Association  Conference 
October  16  - October  19, 1991 
Bismarck  Hotel  (312)  236-0123 
171  West  Randolph  Street 
Chicago,  Dlinois  60601 

Please  reserve: 

Single  Room(s):  $50.00 

Double  Room(s):  (Double  Bed  or  Twin  Beds):  $60.00 

•Date  and  Time  Arriving: (a.m.)  (p.m.)  • Date  and  Time  Departing: (a.m.)  (p.m.) 

Namc(s) 

Affiliation 

Address 

This  Hotel  Reservation  must  be  mailed  to  the  Bismarck  Hotel  by  October  5, 1991 

— 1 I i n 
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A.  Adminstration 

B.  Curriculum  Studies 

C.  Learning  and  Instruction 

D.  Measurement  and  Research  Methodology 

E.  Counseling,  Human  Development  and  Special  Education 

F.  History  and  Philosophy  of  Education 

G.  Social  Context  of  Education  and  Motivation 

H.  School  and  Program  Evaluation 

I.  Professional  and  Medical  Professions 

J.  Postsecondary  Education 

K.  Teaching  and  Teacher  Education 


Medill 

Room 

120 


Meeting  Rooms 
(Layout  of  Third  Floor, 
Bismarck  Hotel) 


Parlor  A 
40 


Parlor  B 
40 


1 Black- 
hawk 
\ 40 


Ladies 


Parlor  C 
40 


Parlor  D 
40 


Parlor  E 
40 


Parlor  F 
85 


Lincoln  Room 
100 


Maximilian 
Room  150 


O 


Note:  Regency  Suite  is  on  the  1 8th  Floor. 
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MWERA  Pre-Conference  Training  Workshops 

MWERA  is  sponsoring  four  training  Workshops  in  conjunction  with  the  199 1 Annual  Meeting.  The  Workshops 
have  been  peer-reviewed  or  invited  and  selected  to  span  a variety  of  interests.  Workshops  will  begin  at  12:00  noon 
and  at  4:00  p.m.  on  Wednesday,  October  16,  1991.  A separate  registration  fee  of  $15.00  per  Workshop  will  be 
charged  each  participant.  The  number  of  participants  permitted  in  each  Workshop  is  limited;  hence,  applications 
will  be  honored  on  a “first-come,  first-serve”  basis.  To  apply,  indicate  choice  of  Workshop(s)  on  the  preceding 
Conference  Registration  Form  and  include  the  fee  in  the  total  amount  enclosed.  Only  applications  and  fees  received 
by  October  8,  1991  can  be  guaranteed 


Workshop  A:  12:00  noon  - 3:00  p.m.,  Parlor  A 

Social/ Multicultural  Foundations  of  Education  as  a Key 
Component  in  an  Undergraduate  Teacher  Education 
Program:  Portfolios,  Video  Vignettes,  and  Field 

Experiences 

Presenters: 

Tonya  Huber,  Jeannie  Parseal,  Scott  Hieger, 

Wichita  State  University 

Workshop  participants  will:  (1)  gain  a working 
knowledge  of  portfolio  assessment  and  field  experience 
components  employed  in  a teacher  education  program, 
(2)  identify  the  instructional  possibilities  of  video  case 
literature  and  video  vignettes  of  teaching  episodes  in  a 
mediated  instruction  delivery,  (3)  review  case  literature 
to  identify  the  value  of  anthropology  of  education 
techniques  in  determining  culturally  responsive/ 
responsible  pedagogy  for  diverse  student  populations, 
and  (4)  analyze  taxonomic  data  developed  from  a ten- 
year  review  of  literature  on  cognitive  styles,  at-risk 
youth,  minorities,  and  culturally  responsible  pedagogy 
models  representing  the  paradigm  shift  from  traditional 
teaching  in  American  school  culture  to  holistic  education . 

The  workshop  will  provide  interactive  experiences 
involving  participants  in  (1)  small  group  shared  inquiry, 
(2)  discussion  of  case  literature  video  clips  of  teaching 
episodes,  and  (3)  analysis  of  student  artifact  displays/ 
graphics. 

Anthropology  of  education  research  techniques  will 
be  exhibited  and  culturally  responsible  pedagogy  will  be 
modeled.  Participant  packets  will  include  culturally 
responsible  pedagogy  case  literature,  portfolio  handbook 
illustrations,  and  bibliographic  information. 


Workshop  B:  12:00  noon  - 4:00  p.m.,  Parlor  C 

An  Introduction  to  Correspondence  Analysis 

Presenters: 

Hak  P.  Tam,  John  Kennedy,  Ohio  State  University 

The  workshop  introduces  the  history,  geometry, 
algebra,  computational  features,  and  computer 
applications  (BMDP  & SPSS)  of  correspondence  analysis 
(CA) — a relatively  new  statistical  technique  that  describes 
complex  variable  relations  through  graphical  depiction. 
The  workshop  is  designed  for  researchers  who  possess 
little  or  no  knowledge  of  this  technique.  CA  is  presently 
being  used  by  sophisticated  data  analysts  to  explore  and 
summarize  crossed-categorical  variables  within  the 
context  of  a correspondence  map,  the  principal  vehicle 
used  in  CA  to  graphically  display  the  nature  of  complex 
relations.  Along  with  log-linear  modeling  and  logistic 
regression,  CA  is  assuming  an  increasingly  important 
position  in  statistical  methodology  by  revolutionizing 
the  analysis  of  categorical  data.  Its  potential  for  creative 
use  in  educational  research  and  evaluation  is  unlimited. 
Due  to  a lack  of  knowledge  on  the  part  of  researchers, 
however,  few  applications  of  CA  have  been  observed  in 
educational  research.  Through  lecture,  examples,  and 
computer  illustrations,  the  instructors  will  promote  a 
conceptual  understanding  of  CA  and  describe  how  this 
exploratory-graphical  technique  can  be  used  to  great 
advantage  in  educational  inquiry  when  an  assessment  of 
multiple  categorical  variables  is  desired. 
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Workshop  C:  4:00  p.m.  - 7:00  p.m.,  Parlor  A 

Seeking  Answers  and  Getting  Results:  Utilizing  Effective 
Survey  Research  Strategies  in  Education 

Presenters: 

Judith  M.  Hudgins,  Kent  State  University 

Carolyn  R.  Benz,  University  of  Dayton 

Recognizing  the  potential  usefulness  of  the 
information  available  and  widespread  use  of  survey  in 
educational  research,  the  purpose  of  this  interactive 
training  workshop  is  to  provide  participants  with  a 
rationale  for  using  survey  methodology  and  determining 
whether  it  is  the  appropriate  means  to  investigate  a 
particular  problem.  Presenters  will  identify  key  references 
for  survey  construction  and  implementation.  Participants 
will  receive  information  about  survey  data  collection 
methods,  research  instruments,  sampling  and  data 
analysis.  Participants  will  practice  question  construction 
and  examine  a variety  of  survey  formats.  Emphasis  is  on 
providing  practical  suggestions  that  enhance  survey 
completion  and  return.  Methodological  aspects  of  a 
recent  doctoral  study  with  elementary  and  high  school 
principals  which  yielded  high  return  (83%)  will  be 
discussed.  Questions  and  comments  are  welcome.  An 
opportunity  to  address  researchers’  individual  concerns 
and  problem-solving  is  planned. 


Workshop  D:  4:00  p.m.  - 7:00  p.m.,  Medill 

Teaching  Learners  How  to  Learn 

Presenter: 

Kenneth  A.  Kiewra,  University  of  Nebraska 

Effective  instructors  help  students  in  two  ways.  One, 
they  teach  in  a manner  that  is  learner-compatible.  For 
example,  students  learn  best  when  information  is  well 
organized  and  mapped  onto  background  knowledge. 
Learner-compatible  instructors  therefore  present 
organized  information  that  is  integrated  with  the  student’ s 
background  knowledge.  Learner-compatible  instruction 
should  result  in  instruction  so  effective  that  students 
learn  despite  their  own  ability  and  motivation.  Two, 
effective  instructors  teach  students  how  to  learn.  They 
embed  the  teaching  of  learning  strategies  within  the 
context  of  their  course,  be  it  history,  science,  or  literature. 
They  thereby  produce  autonomous,  life-long  learners 
who  can  learn  despite  poor  instruction. 

This  workshop  is  aimed  at  instructors,  admi  nistrators 
and  parents  who  want  to  help  students  of  any  age  learn 
how  to  learn. 


Training  Workshops 


Wednesday,  Oct.  16, 12:00-3:00  Workshop  A 
1 .0.0  Social! Multicultural  Foundations  of  Education 
as  a Key  Component  in  an  Undergraduate  Teacher 
Education  Program:  Portfolios,  Video  Vignettes,  and 
Field  Experiences 
Parlor  A 

Presenters:  Tonya  Huber,  Jeannie  Parseal,  Scott 
Hieger,  Wichita  State  University 


Wednesday,  Oct.  16,  12:00-4:00  Workshop  B 
1.0.1  An  Introduction  to  Correspondence  Analysis 
Parlor.C 

Presenters:  Hak.  P.  Tam,  John  Kennedy,  Ohio  State 
University 


Wednesday,  Oct.  16, 4:00-7:00  Workshop  C 
1.1.0  Seeking  Answers  and  Getting  Results: 
Utilizing  Effective  Research  Strategies  in  Education 

Parlor  A 

Presenters:  Judith  M.  Hudgins,  Kent  State 
University 

Carolyn  R.  Benz,  University  of  Dayton 


Wednesday,  Oct.  16, 4:00-7:00  Workshop  D 
1.1.1  INVITED  WORKSHOP  Teaching  Learners 
How  to  Learn 
Medill 

Presenter:  Kenneth  A.  Kiewra,  University  of 
Nebraska 


October  16-19, 1991 


Thirteenth  Annual  Meeting 


Conference  Program 

Wednesday,  Oct.  16, 8:00-9:00  p.m. 

1.2.0  INVITED  ADDRESS  Tips  for  Publishing  and  Professional  Writing 

Mcffll 

Presenter:  Joel  Levin 

Editor,  Journal  of  Educational  Psychology , University  of  Wisconsin-Madison 

Thursday-At-A-Glance 


Division 

Time  ABCDEFGHI  JK 

8:30-9:45 Midwest  Hospitality 

9:00-9:45 — — New  Member  Welcome 

9:45-10:50  — Keynote  Address  - Joel  Levin 

11:00-12:20  / / ✓ ✓ ✓ 
12:30-1:50  ✓ ' ✓ ✓ ✓ ✓ 

2:00-3:20  / / / ✓ / 

2:00-3:20 Association  Council  Meeting 

3:30-4:50  / ✓ ✓ // 

5:00-6:00 Invited  Address  - Annemarie  Palinscar 

6:00-8:00 Cracker  Barrel  Social 


Thursday,  Oct.  17,  8:30-9:45 

2.0.0  Midwest  Hospitality  Coffee  and  Friends 

Maximillian 

Sponsored  by:  Coral  Cab  Company 

Thursday,  Oct.  17, 9:00-9:45 

2.1.0  New  Member  Welcome  All  new  members  are 

encouraged  to  attend  this  orientation  session. 

Parlor  F 

Host:  Executive  Committee 


Thursday,  Oct.  17, 9:45-10:50 

2.2.0  KEYNOTE  ADDRESS  Pictorial  Strategies 

for  Learning  and  Instruction 

Mamimillian 

Welcome:  Ayres  D ’Costa 

President,  MWERA 
Ohio  State  University 
Introduction:  Kenneth  A.  Kiewra 

Program  Chair,  MWERA 
University  of  Nebraska 
Keynote:  Joel  Levin 

University  of  Wisconsin-Madison 


Suggestions  To  Presenters 

To  make  conference  sessions  as  helpful  and  enjoyable  as  possible,  the  Executive  Committee  asks  presenters  to 
please  follow  these  guidelines. 

1 . Send  a completed  copy  of  your  paper  to  the  Session  Discussant  so  that  it  is  received  no  later  than  September  30, 
1991.  Discussants  are  not  obligated  to  discuss  papers  received  after  this  date. 

2.  Bring  at  least  40  copies  of  your  paper  to  the  conference.  People  interested  in  your  paper  should  receive  a copy 
at  the  conference. 

3.  Make  overheads  and  handouts  that  are  attractive  and  readable. 

4.  Plan  to  present,  rather  than  read,  your  paper  in  the  time  allotted. 
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Thursday,  Oct.  17, 11:00-12:20 

2.3.0  Factors  and  Forces  Impacting  the 

Superintendency 

Parlor  A 

Division  A Paper  Session 

Chair:  William  Sharp,  University  of  Akron 

The  New-To-Site  Superintendent 
Ronald  Davison,  Wichita  State  University 
Jean  S.  Lavid,  Stockton  School  District 

Relationships  Between  Superintendents  and  Boards  of 
Education:  Year  Two  of  a Longitudinal  Study 
William  Sharp,  Isadore  Newman,  University  of 
Akron 

Factors  and  Issues  Affecting  Board  of  Education 

Decisions:  A Case  Study 

Linda  Lyman,  Bradley  University 

Discussant:  Dennis  Zuelke,  H-Z  Consultants 


Thursday,  October  17, 11:00-12:20 

2.3. 1  Current  Issues  and  Methods  in  Instruction 

Parlor  B 

Division  B Paper  Session 

Chair:  Alice  Darr,  Kent  State  University 

ST  AD  in  College 

William  J.  Gagney,  Kimberly  Ostrowski,  Illinois 
State  University 

Closing  the  Literacy  Gap  in  the  American  Workplace: 

A Description  of  A Research  Program  for  Trainers 

and  Human  Resource  Specialists 

Ronald  Morgan,  Loyola  University  of  Chicago 

Edward  Gordon,  Roosevelt  University 

Judy  Ponticell,  University  of  Illinois  at  Chicago 

Logo  Based  Instruction  in  Geometry 

Mian  Yusuf,  University  of  Wisconsin-Parkside 

Perspective  Consciousness:  A Summary  of  Rationale 
Sandra  J.  LeSound,  California  State  University, 
Fresno 

Discussant:  Donald  Reyes,  Northern  Illinois 
University 


Thursday,  October  17, 11:00-12:20 

2.3.2  Statistics  and  Research  Methodology 
Parlor  D 

Division  D INVITED  SESSION 

Status  of  Educators  on  the  NEA,  NCME,  AFT  Teacher 
Competencies  in  Education  Assessment 

Barbara  S.  Plake,  Jennifer  Fager,  University  of 
Neoraska 

James  C.  Impara,  Virginia  Polytechnic  Institute 


Thursday,  October  17, 11:00-12:20 

2.3.3  Potpourri:  Motivation  Issues  in  Learning: 
Contexts  for  Substance  Abuse 
Parlor  F 

Division  G Paper  Session 

Chair:  Roger  Carlson,  University  of  Dayton 

Motivation,  Preference  for  Andragogy  or  Pedagogy 
and  Reasoning  Abilities  for  Late  Adolescents 
Jaclyn  Huber,  Pembroke  State  University 
Carl  Basford,  Lewis-Clark  State  College 

A Consumer  — Contract  Model  of  Instructor 
Evaluation  and  Success  — Failure  Attributions 
Peter  Brady,  Clark  State  Community  College 

The  Effect  of  Participation  in  Activities  Outside  the 
School  and  Family  Structure  on  Substance  Use  by 
Middle  and  Secondary  School  Students 
Van  C.  Nelson,  Jay  Thompson,  Christina  M.  Rice, 
Ball  State  University 
Dr.  Van  Cooley,  Westfield  School  Corp. 

Should  Students  Work?  The  Relationship  Between 
Part-Time  Work  and  Substance  Useage 
Christina  M.  Rice,  Jay  Thompson,  Jr.,  Van  E. 
Cooley,  Van  C.  Nelson,  Ball  State  University 


Thursday,  October  17, 11:00-12:20 

2.3.4  Reflective  Thinking 
Lincoln 

Division  K Paper  Session 

Chair:  Rose  M.  Scott,  Mankato  State  University 

Ur, 


October  16-19, 1991 

The  Relationship  Between  Instructional  Domain  and 
the  Content  of  Reflection  Among  Preservice  Teachers 
Diana  Cantrell,  Ohio  State  University-Newark 

What  do  Preservice  Teachers  Reflect  About? 

Deborah  Bainer,  Ohio  State  University-Mansfield 

Using  Student  Remembrances  in  a Preservice  Teacher 
Education  Course 

David  Gliessman,  Indiana  University 

Teaching  as  Inquiry:  Helping  Inservice  Teachers 
Examine  their  Theoretical  Perspectives  on  Curriculum 
Patricia  Wheeler,  Indiana  University 

Discussant:  Jose  Cruz,  Ohio  State  University 

Thursday,  October  17, 12:30-1:50 

2.4.0  Issues  in  Post-Secondary  Education:  Session  I 
Parlor  B 

Division  J Paper  Session 

Chair:  E.  Jane  Williams,  Columbus  Public  Schools 

A Study  of  Faculty  and  Computer  Center  Personnel 
Perspectives  on  the  Issues  Surrounding  Campuswide 
Microcomputer  Networks 
Steven  Scott,  Pittsburgh  State  University 

Education  Faculty  Roles:  Teaching,  Research, 

Service,  Stress,  Satisfaction,  and  Activity 
Gregory  J.  Marchant,  Ball  State  University 
Isadore  Newman,  University  of  Akron 

A Study  of  the  Effectiveness  of  the  Use  of  Cartoons  in 
Improving  Computer  Assisted  Instruction  (CAT):  An 
Experimental  Study 

Christina  Brownlee,  Isadore  Newman,  University  of 
Akron 

Higher  Education  Criticism:  Do  University  Faculty 
Members  and  Community  Professionals  Have 
Different  Viewpoints? 

Linda  Chiang,  Anderson  University 

Discussant:  E.  Jane  Williams,  Columbus  Public 
Schools 

Thursday,  October  17, 12:30-1:50 

2.4.1  Individual  Differences  in  Learning 

Parlor.  C 

Division  C Paper  Session 


Thirteenth  Annual  Meeting 

Chair:  Alice  Corkill,  University  of  Western  Ontario 
Constraints  on  the  Calibration  of  Comprehension 
Lori  Nebelsick-Gullet,  Gregory  Schraw,  Maria 
Potenza,  University  of  Nebraska 

Cognitive  Flexibility:  Construct  Validation 
Ronna  F.  Dillon,  Timothy  S.  Brannan,  Southern 
Illinois  University 

Test-Retest  Reliability  of  Three  Learning  Style 
Instruments 

Timothy  J.  Sewall,  University  of  Wisconsin-Green 
Bay 

The  Relationship  Between  Students’  Beliefs  About  the 
Nature  of  Knowledge  and  Academic  Experiences 
Marlene  Schommer,  Wichita  State  University 

Discussant:  Alice  Corkill,  University  of  Western 
Ontario 


Thursday,  October  17, 12:30-1:50 

2.4.2  Recurring  and  Emerging  Themes  in  History 
and  Philosophy  of  Education 
Parlor.  D 

Division  F Paper  Session 

Chair:  E.  Jean  Harper,  Wright  State  University 

The  Ancient  Greek  Definition  of  Liberal  Education  in 
American  Political  and  Educational  Thought 
Arthur  T.  Vrettas,  University  of  Akron 

Deindustrialization  and  the  Financial  Support  of 
Public  Education 

Donald  P.  Spayd,  Warren  City  School  District 
Charles  M.  Dye,  University  of  Akron 

The  Development  of  Electronic  Distance  Education 
Delivery  Systems  in  the  United  States 
Michael  Buckland,  Charles  M.  Dye,  University  of 
Akron 

The  Dynamics  of  Educational  Systems  and  Low 

Achieving  Dislocated  Students 

Don  Richard  Castle,  Ashland  University 

Discussant:  Fred  Buddy,  Spelman  College 
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Thursday,  October  17, 12:30-1:50 

2.4.3  Contemporary  Research  Topics  in  Counseling 

Pallor  E 

Division  E Paper  Session 

Chair:  Paula  J.  Dupuy,  University  of  Toledo 

Descriptive  Results  from  an  AIDS  Questionnaire: 
Knowledge  About  the  Disease  and  Associated 
Behavior 

Paula  J.  Dupuy,  Ralph  O.  Mueller,  University  of 
Toledo 

Social  Support  and  Psychological  Stress: 

Relationship  to  Perceived  Risk  of  HIV  Infection  in  a 
Population  of  Gay /Bisexual  Men 
Paula  Britton,  University  of  Akron 

A Comparative  Investigation  of  the  Responses  of 
Emotionally  Disturbed  Black  and  White  Adolescent 
Males  to  the  Thematic  Apperception  Test  (TAT)  and 
the  Themes  Concerning  Blacks  Test  (TCB) 

Dorris  N.  Cooper,  Ronald  R.  Morgan,  Loyola 
University  of  Chicago 

The  Underlying  Structure  of  Spontaneous  Casual 

Thinking:  Counseling  Implications 

Karen  D.  Mutton,  University  of  Missouri-CoJ.umbia 

Discussant:  Cynthia  Boone-Hawkins,  University  of 
Akron 


Thursday,  October  17, 12:30-1:50 

2.4.4  Moral  Education  in  Different  Settings: 
Families,  Home  and  Youth  Organizations 
Parlor  F 

Division  G INVITED  SYMPOSIUM 

Chair:  Joan  Timm,  University  of  Wisconsin-Oshkosh 

AESOP  in  the  Classroom:  The  Use  of  Literature  in 
Moral  Discussions 

Joan  Timm,  University  of  Wisconsin-Oshkosh 

Talking  Good:  Moral  Education  through  Family 
Discussion 

Marvin  W.  Berkowitz,  Marquette  University 

Moral  Education  and  Volunteer  Youth  Organizations 
Clark  Power,  Notre  Dame  University 


Thursday,  October  17, 12:30-1:50 

2.4.5  African-American  Male  Single-Sexed 
Schooling:  What  are  the  Pros  and  Cons? 

Lincoln 

Division  K INVITED  PANEL  DISCUSSION 

Chair:  Mary  Ann  Flowers,  Cleveland  State  University 

Panel:  Du  von  Winborne,  Cleveland  State  University 
Thomas  Midgette,  University  of  Arkansas 
Fayetteville 

Eric  Stockard,  University  of  Toledo 
Robert  L.  Jackson,  Lucas  County  Children’s 
Service,  Maumee,  Ohio 


Thursday,  October  17, 2:00-3:20 
2.5.0  Administrative  Career  Decisions  and 
Recruitment  Strategies 
Parlor  A 

Division  A Paper  Session 

Chair:  Wenifort  Washington,  University  of  Akron 

The  Strategies  and  Decision  Criteria  of  School 
Superintendents  in  Recruitment  of  Prospective 
Principals 

Charles  Kline,  Karen  Okeafor,  Purdue  University 

Career-Bound  and  Place-Bound  Superintendents’ 
Attitudes  Toward  Collective  Bargaining 
Rich  Hoffman,  Miami  University 
John  Granger,  Edgerton  Local  School  District 

The  Decision  Processes  and  Criteria  Used  to  Select 

Building  Level  Administrators 

Karen  Okeafor,  Charles  Kline,  Purdue  University 

Discussant:  Martin  Jason,  Roosevelt  University 


Thursday,  October  17, 2:00-3:20 

2.5.1  Issues  in  Post-Secondary  Education:  Session 
II 

RadaLB. 

Division  J Paper  Session 

Chair:  Albert  Bugaj,  University  of  Wisconsin 
Center-Marinette  County 
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Financial  Exigency  as  Just  Cause  for  Dismissal  of 
Tenured  Faculty  in  Higher  Education:  What  are  the 
Legal  Issues? 

Mary  Beth  Karr,  Edward  R.  Hines,  Illinois  State 
University 

Community  Colleges,  Four-Year  Colleges,  and 
Universities [ as  Providers  of  Corporate  Education 
Sheila  A.  Sorrentino,  Kankakee  Community  College 
Edward  R.  Hines,  Illinois  State  University 

Corporate  Philanthropy  in  American  Higher 
Education:  An  Investigation  of  Attitudes  Towards 
Giving 

Elisabeth  F.  Meuth,  Isadore  Newman,  University  of 
Akron 

Discussant:  Susan  Brookhart,  Dequesne  University 


Thursday,  October  17, 2:00-3:20 

2.5.2  The  Role  of  Knowledge  and  Experience  in 

Learning 

Parlor  C 

Division  C Paper  Presentation 

Chair:  Gregory  Schraw,  University  of  Nebraska 

Learning  at  A Glance:  Investigating  Efficiencies  of 
External  Representations 

Daniel  H.  Robinson,  Gregory  Schraw,  University  of 
Nebraska 

The  Importance  of  Tacitly  Acquired  Knowledge  in 
Medical  Education 

Ronna  F.  Dillon,  JoLynn  Smith,  Evelyn  Jackson, 
Catherine  Aubertin,  Southern  Illinois  University 

Assessing  Understanding 

Buford  E.  Wilson,  Governors  State  University 

The  Long-Term  Effects  of  Sex,  Interest,  and 
Experience  on  a Text-Based  Approach  for  Facilitating 
Conceptual  Change  in  Learning  Science 
Sharon  K.  Chambers,  Thomas  Andre,  Iowa  State 

Discussant:  Gregory  Schraw,  University  of 
Nebraska 


Thursday,  October  17, 2:00-3:20 

2.5.3  Career  Development  and  Counseling 
Parlor  E 

Division  E Paper  Presentation 

Chair:  Diane  L.  Kjos,  Governors  State  University 

Breaking  Ground:  A Study  of  Gestalt  Theory  and 
Holland’s  Theory  of  Vocational  Choices 
Paul  Hartung,  Northeastern  Ohio  Universities 

Perceived  Control  as  a Motivational  Variable  in 
Career  Maturity 

Darrell  Luzzo,  Johnson  County  Community  College 

Gifted  High  School  Students’  Attitudes  Toward 
Careers  and  Sex  Roles 

Patricia  Dunneli,  Linda  Bakken,  Wichita  State 
University 

Discussant:  S.  Alvin  Leung,  University  of  Nebraska 


Thursday,  October  17, 2:00-3:20 

2.5.4  The  Influence  of  Role  in  Collaborative  Work: 

First  Person  Narratives  in  a Dialogue 

Lincoln 

Division  K Panel  Discussion 

Chair:  Marilyn  Johnston,  Ohio  State  University 

Panel:  Don  Cramer,  Gables  Elementary  School 
Denise  Dallmar,  Ohio  State  Elementary 
Denise  Harrison,  Douglas  Elementary  School 
Joann  Hoenbrink,  Ohio  State  University 


Thursday,  October  17, 2:00-3:20 

2.5.5  Association  Council  Meeting 
Medill 

All  current  and  elected  association  council 
members  and  program  chairs 


Thursday,  October  17, 3:30-4:50 

2.6.0  Shared  Decision-Making  and  Related  Factors 

Parlor  A 

Division  A Paper  Session 

Chair:  William  Thiel,  Thiel  Enterprises-Consultants 
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The  Adoption  of  Shared  Decision-Making  as  a Model 
for  Promoting  Changes  in  School  Climate  and  Culture 
William  Evans,  Phedonia  Johnson,  Geraldine 
Oberman,  Carol  Perry,  Chicago  Public  Schools 

The  Relationship  Between  Jungian  Personality  and 
Situational  Leadership 

Jess  E.  House,  Dean  L.  Meinke,  University  of  Toledo 

The  Relationship  Between  the  Interpersonal  Values 
and  Job  Satisfaction  of  School  Superintendents 
Kenneth  Strand,  Daniel  Schweers,  David  L. 
Franklin,  Illinois  State  University 

Perceptions  of  Participative  Decision-Making, 
Professionalism  and  Job  Satisfaction  by  Teachers  in  a 
Site-Based  Managed  High  School  in  Comparison  with 
Teachers  in  a Traditional  School 
Sally  Childs,  Central-Hower  High  School 
William  Sharp,  University  of  Akron 

Discussant:  Reene  Alley,  University  of  Akron 


Thursday,  October  17, 3:30-4:50 

2.6.1  Statistical  Techniques 

Parlor  D 

Division  D Paper  Session 

Chair:  Deborah  Buchman,  University  of  Toledo 

Confounding  Covariates  in  Nonrandomized  Studies 
Shlomo  S.  Sawilowsky,  Wayne  State  University 
R.  Clifford  Blair,  University  of  South  Florida 

A Simple  Monte-Carlo  Order  Statistic  Test  for 

Unknown  Distributions 

John  Pohlman,  Southern  Illinois  University 

Exploratory  Multivariate  Analysis  of  Variance: 
Determining  Important  Contrasts  and  Variables 
Ronald  S.  Elliot,  Robert  S.  Barcikowski,  Ohio 
University 

The  Use  of  Correspondence  Analysis  in  the  Study  of 
Error  Patterns 

Hak  P.  Tam,  Ayres  D’Costa,  Vivian  Heinrich,  Ohio 
State  University 

Discussant:  Dennis  W.  Lcitner,  Southern  Illinois 
University 

i ^ 1 


Thursday,  October  17, 3:30-4:50 

2.6.2  Research  Symposium  in  Child  Development 
Parlor  E 

Division  E Symposium 

Chair:  Jennifer  Parkhurst,  University  of  Nebraska 

Written  Language  in  Exceptional  Male  Elementary 

School  Children:  A Comparative  Analysis  of  the 

Learning-DisabledlGifted 

Lawrence  W.  Sherman,  Miami  University 

Drug-Exposed  Children:  Critical  Instructional  Issues 
Arlene  Adams,  University  of  Wisconsin-Parkside 

Psychosocial  Functional  and  Self -Concept  of  Young 
Children  with  Hemangiomas 
Cynthia  A.  Dietrich-Miller,  Cleveland  State 
University 

Reframing  Class  Clowns  into  Type  T Persons:  Test  of 
a Model 

Nelson  J.  Gordon,  University  of  Wisconsin,  Oshkosh 
Discussant:  Christy  Horn,  University  of  Nebraska 


Thursday,  October  17, 3:30-4:50 

2.6.3  Field  Experience  and  Supervision 

Parlor  F 

Division  K Paper  Session 

Chair:  Sheila  M.  Kendrick,  Robinson  Junior  High 
School,  Toledo 

The  Third  Ear  Mechanical  Device  — A Supervision 
Alternative 

Carmen  R.  Giebelhaus,  Jose  Cruz,  Ohio  State 
University 

Field  Placements:  Exploring  the  Problems  Involved 
in  Bridging  the  Gap  Between  Theory  and  Practice 
Rosemary  F.  Shiavi,  University  of  Evansville 

Attention  to  Climate:  A Case  Study  of  Two  Decades  of 
Personalized  and  Field-Based  Teacher  Preparation 

Diane  Hoffbauer,  Bill  Olszewski,  Betty  Borchardt, 
Mankato  State  University 

A Field-Based  Introduction  to  Urban  Education  at  the 
Middle  School 

Susan  M.  Brookhart,  Duquesne  University 


October  16-19, 1991 


Thirteenth  Annual  Meeting 


Thursday,  October  17, 3:30-4:50 
2.6.4  Instructional  Concerns 
UngQln 

Division  K Paper  Session 

Chair:  Sanza  Clark,  Cleveland  State  University 

Instructional  Preference  of  Academically  Talented 

Preservice  Teachers 

Charles  E.  Skipper,  Miami  University 

The  Effects  of  a Controlled  Laboratory  Experience  on 

Preservice  Teachers'  Instructional  Behavior 

Kim  K.  Metcalf,  Southwest  Missouri  State  University 


Perspectives  on  Learning  Oriented  Classrooms 

Gregory  J.  Marchant,  Yasser  Al-Hilawani,  Ball 
State  University 

Isadore  Newman,  University  of  Akron 

Teaching  a Cognitive  Learning  Strategy:  Can 
Teachers-In-Training  Assist  Middle  School  Students  to 
Utilize  a Matrix  Technique  to  Form  Comparisons, 
Contrasts  and  Generalizations? 

Ruth  Stabler  Tompkins,  University  of  Southern 
Indiana 


Thursday,  October  17, 5:00-6:00 
2.7.0  INVITED  SPEAKER 
Msdill 

Enhancing  Scientific  Reasoning  Through 
Collaborative  Problem  Solving 
Annemarie  Palinscar,  University  of  Michigan 


Thursday,  October  17, 6:00-8:00 
2.8.0  Cracker  Barrel  Social 
Maximilian 

Background  piano  music  by  Roger  H.  Bruning, 
University  of  Nebraska 


Friday- At-A-Glance 


Division 

Time  ABCDEF  GH  I JK 

7:30-9:00 Midwest  Hospitality — - 

8:30-9:50  ✓ / ✓ / / 

9:00-4:00 - -Exhibits 

10:00-10:50  ✓ ✓ ✓ ✓✓ 

1 1 :00-l  1 :50 General  Business  Meeting 

12:00-1:50  Luncheon  - Carole  Ames,  Invited  Speaker 

2:00-4:00 - - - Meet  The  Editors 

2:00-3:20  ✓ / / ✓ ✓ / 

3:30-4:20  ✓ / /✓ 

4:30-6:00 - Invited  Address  - Michael  Pressley 

9:00-???? President’s  Reception 
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Friday,  October  18, 7:30-9:00 

3.0.0  Midwest  Hospitality  Coffee  and  Friends 

Maximilian 

Sponsored  by:  Coral  Cab  Company 


Friday,  October  18, 8:30-9:50 

3.1 .0  Issues  in  Medical  Training  and  Practice 

Parlor  A 

Division  I Paper  Session 

Chair:  Patricia  Mullan,  Michigan  State  University 

Predictors  of  Hospital  Readmissions  Among  Non- 
Institutionalized  Elderly 

Rosemarie  Suhayda,  Rush-Presbyterian  St.  Luke’s 
Medical  Center 

Jack  Kavanagh,  Loyola  University  of  Chicago 

A Comparison  of  the  Initial  Hypotheses  of  Novices 
and  Experts  in  Clinical  Problem  Solving 
Larry  D.  Gruppen,  University  of  Michigan 
Janies  O.  Woolliscroft 

Talking  About  Sex:  Comparisons  of  Medical 
Students’  and  Simulated  Patient-Instructors’  Ratings 
of  Sexual  History  Interview  Performance 
Patricia  Mullan,  Andrew  Zweifler,  Fredric  Wolf, 
Lori  Dickens,  Denise  Lenhard,  Michigan  State 
University  of  Michigan 

Teaching  Pharmacy  Students  Problem  Solving: 
Enhancing  Higher  Order  Thinking  Skills 
Suzanne  Soled,  University  of  Cincinnati 


Friday,  October  18, 8:30-9:50 

3.1.1  Helping  Students  Become  Better  Learners 

Parlor  C 

Division  C Paper  Presentation 

Chair:  Bernard  M.  Frank,  University  of  Wisconsin- 
Eau  Claire 

Older  Adults’  Implicit  Theories  About  Reading 
M.  Cecil  Smith,  Northern  Illinois  University 

Help  Seeking  and  the  Need  for  Assistance  Among 
University  Students 

Deborah  Bainer,  Carol  A.  Jenkins,  Ohio  State 
University-Mansfield 


Developing  a Self-Regulated  Learning  Inventory:  A 
Preliminary  Report  and  Analysis 
Reinhard  W.  Lindner,  Bruce  Harris,  Western 
Illinois  University 

The  Effects  of  Teacher  Initiated  Interaction  with 

Female  Mathematics  Students 

Roberta  A.  Fuller,  Illinois  State  University 

Discussant:  Bernard  M.  Frank,  University  of 
Wisconsin-Eau  Claire 


Friday,  October  18, 8:30-9:50 

3.1.2  Personnel  Evaluation 

Parlor.  E 

Division  H Paper  Session 

Chair:  Richard  Pugh,  Indiana  University 

Evaluating  Prereferral  Systems:  What  Should  be  the 
Component  Parts? 

Jane  W.  Andringa,  Governors  State  University 
Arthur  R.  Keller,  Kirby  School  District,  Illinois 

Educational  Reform  and  Teacher  Evaluation 
Ralph  Darr,  University  of  Akron 

A Competency  Based  Merit  Evaluation  System  for 
University  Faculty 

John  T.  Pohlman,  Southern  Illinois  University 

Evaluation  of  Applications  for  Employment  in  Higher 
Education:  A Search  Committee’ s Screening  and 
Selection  Criteria 

Mary  R.  Sudzina,  University  of  Dayton 
Discussant:  Thomas  Schwandt,  Indiana  University 


Friday,  October  18, 8:30-9:50 

3.1.3  Innovative  Approaches  to  Curriculum  and 
Assessment  for  Gifted  Secondary  Students 
Parlor  F 

Division  B INVITED  PANEL  DISCUSSION 

Chair:  Judy  Werbach,  St.  Charles  Public  Schools 

Panel:  Dr.  Marcelline  Barrons,  Illinois  Mathematics 
and  Science  Academy 
Bruce  Galbraith,  Park  Tudor  Schools. 
Indianapolis 


1 o 
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Friday,  October  18, 8:30-9:50 

3.1.4  Restructuring  to  Reclaim  Middle  School  Youth 
at  Risk:  Culturally  Responsible  Pedagogy 
Lincoln 

Division  G Multi-Media  Presentation 

Chair:  Tonya  Huber,  Wichita  State  University 

Presenters:  Tonya  Huber,  Jeannie  Parseal,  Scott 
Hieger,  Wichita  State  University 
Eldon  Chlumsky,  Wichita,  Kansas 

Discussant:  Cornel  Pewewardy,  American  Indian 
Magnet  School,  St.  Paul,  Minnesota 

Friday,  October  18, 9:00-4:00 

3.2.0 

Mcditt 

EXHIBITS 


Friday,  October  18, 10:00-10:50 

3.3.0  Reflections  as  an  Educational  Historian 

Parlor  B 

Division  F INVITED  ADDRESS 

Chair:  Nelson  Strobert,  Gettysburg  Lutheran 
Seminary 

Speaker:  Charles  Dye,  University  of  Akron 


Friday,  October  18, 10:00-10:50 

3.3.1  Test  Validation 
Parlor  D 

Division  D Paper  Presentation 

Chair:  Luz  G.  Bay,  Southern  Illinois  University 

Evaluating  the  Validity  of  Career  Maturity  Measures: 

A Multimethod-Multitrait  Anotysis 

Darrell  A.  Luzzo,  Johnson  Community  College 

Coopersmith  Self-Esteem:  Two  Different 
Hypothesized  Factor  Solutions  — Both  Acceptable  for 
the  Same  Data  Structure 

Rich  Hoffmann,  Larry  B.  Sherman,  Miami 
University 

Discussant:  Patricia  B.  Elmore,  Southern  Illinois 
University 


Friday,  October  18, 10:00-10:50 

3.3.2  Reading  and  Reading  Assessment 

Parlor  £ 

Division  K Paper  Session 

Chair:  Susan  M.  Brookhart,  Duquesne  University 

The  Relationship  Between  Undergraduate  Course 
Work  and  Theoretical  Orientation  to  the  Reading 
Process 

Mary  Ann  Wham,  Northern  Illinois  University 

Reading  Assessment  Portfolio  Style:  A Perspective 
from  the  Classroom 

Judy  Lambert,  University  of  Wisconsin 

Friday,  October  18, 10:00-10:50 

3.3.3  Teaching  Skill  Acquisition 
Lincoln 

Division  K Paper  Session 
Chair:  Carol  L.  Muskin 

Using  Video  and  Videodisc  Technology  in  the  Teacher 
Education  Classroom:  A Research  Based  Approach 
Donald  Reyes,  Northern  Illinois  University 

Selecting  Skills  for  Teacher  Training:  The 
Identification  of  Critical  Teaching  Skills 

John  Laut,  Jim  Rouschenbach,  Melissa  Dudley, 
Ohio  State  University 

Cognitive  Learning  and  the  Acquisition  of  Teaching 
Skills 

David  Gleissman,  Richard  Pugh,  Indiana  University 


Friday,  October  18, 10:00-10:50 

3.3.4  Focus  on  Evaluation  of  Schools  in  the  1990’ s 
Parlor  E 

Division  H INVITED  PANEL  DISCUSSION 

Panel:  From  the  Perspective  of  State  of  the  Art... 
Daniel  L.  Stufflebeam,  Western  Michigan 
University 

From  the  Perspective  of  Educational  Systems... 
Gary  Wegnke,  Des  Moines  City  Schools 

From  the  Perspective  of  Preparation  of 
Educational  Leaders... 

Darrell  Root,  University  of  Dayton 
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Friday,  October  18, 11:00-11:50 

3.4.0  General  Business  Meeting  — All  MWERA 

Members 

Maximilian 


Friday,  October  18, 12:00-1:50 

3.5.0.  Luncheon 
Walnut  Room 

Speaker:  Carole  Ames,  University  of  Illinois  at 
Urbana-Champaign 

Title:  Enhancing  Student  Motivation 

All  registrants  are  invited  to  attend. 


Friday,  October  18, 2:00-4:00 
Meet  the  Editors 

Meditt 


Friday,  October  18, 2:00-3:20 

3.6.0  Organizational  and  Policy  Issues 

Parlor.  A 

Division  A Paper  Session 

Chair:  Marilyn  Grady,  University  of  Nebraska 

Assessing  Personal  and  Organizational  Predictors  of 
Managerial  Commitment  in  Schools 
Hyun-Seok  Shin,  University  of  Wisconsin-Madison 
Pedro  Reyes,  University  of  Texas  at  Austin 

Academic  Sanctions:  Implications  for  Higher 
Education  Policies 

S.M.  Winchip,  E.R.  Hines,  Illinois  State  University 

The  Job  Satisfaction  — Life  Satisfaction  Relationship 
for  Educators:  A Cross-Cultural  Study 
Patricia  Klass,  Noreen  Michael,  Illinois  State 
University 

Discussant:  Donald  McCarty,  Madison,  WI 

Friday,  October  18, 2:00-3:20 

3.6. 1 Current  Issues  for  At-Risk  and  Non- At-Risk 
Preschool  and  Kindergarten  Children 

ParlQLB 

Division  B Paper  Session 

Chair:  Jack  K.  Barshinger,  DeKalb  Community 
Schools 

or\  ——————— 


Marvelous  Me  — Preschool  Edition:  Enhancing  Self 
Concept  Development  in  i reschool  Children 
Kara  Sullivan,  Temple 
Ruth  David,  National-Louis  University 

Childrearing  Expectations  of  Parents  of  At-Risk  and 

Non-At-Risk  Preschoolers 

Therese  Shepston,  Bradley  University 

The  Use  of  Kindergarten  Screening  Scores  to  Identify 
the  Need  for  Reading  Intervention:  A Logit 
Regression  Study 

Jayn  H.  Craii,  Ashland  Public  Schools 
John  W.  Fraas,  Ashland  University 

Enhancing  the  Achievement  of  Minority  Children:  An 
Afterschool  Program  that  Works 
Lynne  Hudson,  David  Bergin,  Carolyn  Chryst, 
Mary-Jo  Abascal-Hildebrand,  University  of 
Toledo 

Mark  Resetar,  Regent  University 

Discussant:  Harvey  N.  Switzky,  Northern  Illinois 
University 


Friday,  October  18, 2:00-3:20 

3.6.2  A Cross  Institutional  Analysis  of 
Characteristics  of  Entering  Freshman 
Parlor  C 

Division  J Symposium 

Chair:  William  Loadman,  Ohio  State  University 

Presenters:  Susan  M.  Brookhart,  Duquesne 
University 

Craig  DeVille,  Ohio  State  University 
Timothy  Miller,  Morehead  State 
University 

Discussant:  William  E.  Loadman,  Ohio  State 
University 


Friday,  October  18,  2:00-3:20 

3.6.3  Research  and  Practical  Issues  in  Parenting 

Parlor  E 

Division  E Paper  Session 

Chair:  Thomas  Parish,  Kansas  State  University 

f.M 
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Help  for  Developing  Responsible  and  Disciplined 
Students 

Donald  A,  Boy'1  '"homas  Parish,  Kansas  State. 
University 

Ligkthouse  Parenting  Scale:  Some  Evidence  of 
Construct  Validity 

Elmer  A.  Lemke,  Mark  D.  Godley,  Margaret 
Raabe,  Illinois  State  University 

Beliefs  as  Predictors  of  Parenting  Skills 
Barbara  Duffield,  University  of  Toledo 

Friday,  October  18, 2:00-3:20 
3.6.4  Sequential  Program  Structures  for  Preservice 
Socialization  in  Technology  and  Cooperative 
Learning 
Parlor  F 

Division  G Symposium 

Chair:  Douglas  M.  Brooks,  Miami  University 

Sophomore  Year  Educational  Psychology:  The 
Application  of  Cooperative  Learning  and  Audiotape 
Technology  to  Enhance  Course  Content  and  Student 
Conceptual  Level 

Mary  R.  Sudzina,  University  of  Dayton 

Junior  Year  Methods  Block:  Using  Cooperative 
Learning  and  Videotape  Technology  to  Facilitate  the 
Acquisition  of  Classroom  Management  Skills 
Robert  Shearer,  Miami  University 

Senior  Year  Internship:  The  Applications  of 
Cooperative  Learning  and  Videotape  Technology  for 
Improved  Professional  Conflict  Resolution 
Douglas  M,  Brooks,  Miami  University 


Friday,  October  18, 2:00-3:20 

3.6.5  School-University  Partnership  in  the  Academic 

Preparation  of  Prospective  Teachers 

Liacaln 

Division  K Panel  Discussion 

Chair:  Wendy  Stack,  Chicago  Teachers’  Center 
Northeastern  Illinois  University 

Panel:  Nancy  S.  Green,  Elaine  C.  Koffman, 
Northeastern  Illinois  University 
Jolie  Sklair,  Shirley  Woodley,  Wolfgang  A. 
Mozart  Elementary  School 


Friday,  October  18, 3:30-4:20 

3.7.0  Guessing  and  Cheating  on  Multiple-Choice 

Exams 

Parlor  D 

Division  D Paper  Session 

Chair:  Lori  Nebelsick-GuIIet,  University  of 
Nebraska 

Error-Similarity  Analysis  and  Other  Methods  for 
Detecting  Cheating-by  Copying  in  a Multiple-Choice 
Exam 

Luz  Bay,  Davis  Eubanks,  Southern  Illinois 
University-Carbondale 

Are  Rasch  Item  Parameter  Estimates  Still  Invariant 
Across  Distribution  Characteristics  When  Guessing  is 
Simulated? 

Ken  W.  Godin,  Kent  State  University 

Discussant:  Paula  L.  Woehlke,  Southern  Illinois 
University 


Friday,  October  18, 3:30-4:20 

3 .7 . 1 Themes  in  Gender  and  Bias  Reflected  in 

Literature 

Parlor  E 

Division  G Paper  Session 

Chair:  Robert  Rosemier,  Northern  Illinois  University 

The  Perils  of  Nancy  Drew:  Social  Identity  in  Popular 
Children’s  Fiction 

Linda  Christian-Smith,  University  of  Wisconsin- 
Oshkosh 

Bias  in  Children’s  Storybooks:  Gender,  Race,  Class 
and  Ethnicity 

Joan  S.  Timm,  University  of  Wisconsin-Oshkosh 

Perceptions  of  Sex-Appropriate  Behavior  in  Middle- 
School  Students 

Dyanne  Tracy,  Oakland  University 
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Friday,  October  18, 3:30-4:20 

3.7.2  Parent  Involvement  and  SchoollTeacher 

Improvement 

Parlor  F 

Division  K Paper  Session 

Chair:  Mary  Ann  Wham,  Northern  Illinois 
University 

An  Operational-Strategy  for  Improving  Inner-City 
Schools 

Shiela  Kendrick,  Robinson  Junior  High  School 

Strategies  for  Training  Student  Teachers  in  Parent 
Involvement  Competencies 

Lenore  Peachin  Wineberg,  University  of  Wisconsin- 
Oshkosh 

Restructuring  Teacher  Effectiveness  Through  Teacher / 

Student  Research 

Mark  Krabbe,  Miami  University 


Friday,  October  18, 3:30-4:20 

3.7.3  Teacher  Characteristics  and  Relationship  to 

Standardized  Testing 

Lincoln 

Division  K Paper  Session 

Chair:  Richard  Reynolds,  Ohio  State  University 

Teacher  Characteristics 
Ralph  Darr,  University  of  Akron 


The  NTE:  Effects  of  Standardized  Testing  on 
Curriculum 

Craig  DeVille,  Micheline  Chalhoub,  William 
Loadman,  Ohio  State  University 

Voices  from  the  Field:  Science  and  Social  Studies 
Teachers  Speak 

Adria  Karle-Weiss,  Diana  M.  Hunn,  University  of 
Akron 

Friday,  October  18, 4:30-6:00 
3.8.0  INVITED  ADDRESS 
Maximilian 

Chair  and  Organizer:  Alice  Corkill,  University  of 
Western  Ontario 

Speaker:  Michael  Pressley,  University  of  Maryland 

Topic:  What  it  Takes  to  Get  the  Nation’s  Children  to 
be  Good  Readers:  Issues  and  Methods 


Friday,  October  18, 9:00-???? 

3.9.0  President’s  Reception:  Beer,  Wine  and  Cheese 
Regency 

Hosted  by:  Ayres  D’Costa 

President  MWERA 
Ohio  State  University 

All  registrants  are  invited  to  attend. 

Please,  no  smoking. 


Saturday- At-A-Glance 
Division 

Time  ABCDEFGH  I 

7:00-8:00  - Fun  Run - — 

7:30-9:00 — Midwest  Hospitality 

9:00-1:00 Special  Multicultural  Education  Sessions 

9:00-10:50  / / 

9:00-9:50  / / 

10:00-10:50 

11:00-12:30  / / 

11:00-11:50  1 <j  c 

11:00-1:00  1 ✓ 
12:00-1:00  ✓ 

1:00-3:00 - Executive  Committee  Meeting 
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Saturday,  October  19, 7:00  a.m. 

FUN  RUN --'2  Miles  C 

Chicago  Yacht  Club,  Monroe  Street  and  Lake  Shore 
Drive  ' 

Run  Director:  Ken  Kiewra,  University  of  Nebraska 

Saturday,  October  19, 7:30-9:00 

4.0.0  Midwest  Hospitality  Coffee  and  Friends 

Maximilian 

Sponsored  by:  Coral  Cab  Company 


Saturday,  October  19, 9:00-10:50 

4.1.0  Role  Delineation  in  the  Health  Professions: 

Methods,  Outcomes,  and  Issues 

P^lpr  A 

Division  I Symposium 

Chair:  Ayres  D’Costa,  Ohio  State  University 

An  Overview  of  Role  Delineation  Methods  and  Issues 
Ayres  D’Costa,  Ohio  State  University 

Relationship  of  Functions  Performed  by  Hospital 
Chief  Information  Officers  and  Organization,  Job,  and 
Person-Related  Characteristics 
Merida  L.  Johns,  Ohio  State  University 

Role  Delineation  of  Entry-Level  and  Experienced 

Medical  Record  Practitioners 

Carol  E.  Osborn,  Ohio  State  University 

Relationship  of  Burnout  to  Job-Related  Stress, 
Hardiness  and  Selected  Organizational  Socio- 
Demographic  Characteristics  Among  Medical  Record 
Department  Directors 
Melanie  S.  Brodnik,  Ohio  State  University 

Discussant:  William  Loadman,  Ohio  State 
University 


Saturday,  October  19, 9:00-10:50 

4.1.1  Graphic  Organizers 
Parlor  C 

Division  C Symposium 

Chair:  Jean  W.  Pierce,  Northern  Illinois  University 


+ 


Towards  the  Development  of  a Model  of 
Representation  for  Self-Regulated  Learning 
Nelson  F.  DuBois,  SUNY-Oneonta 

A Literature  Review  of  Student-Generated  Graphic 
Representation 

Jean  W.  Pierce,  Northern  Illinois  University 

Using  Graphic  Organizers  to  Improve  Notetaking 
Behavior  in  Community  College  Students 
Robert  J.  Keller,  Office  of  Research,  Evaluation,  and 
Policy  Studies,  Northern  Illinois  University 

Graphic  Organizers  in  Content-Area  Reading 
Materials 

Margaret  Tinzman,  NCREL 

How  the  Structure  of  Graphic  Organizers  Affect  Note- 
Taking 

Nancy  Risch,  Kenneth  A.  Kiewra,  University  of 
Nebraska 

Maribeth  Christensen,  Ricks  College 
Sung  II  Kim,  Utah  State  University 
Stephen  L.  Benton,  Kansas  State  University 

Discussant:  Jean  W.  Pierce,  Northern  Illinois 
University 


SPECIAL  MULTICULTURAL  SESSION  •••• 

Saturday,  October  19, 9:00-9:50 

4.2.0  Are  the  Pilgrims  your  Fore-Fathers,  and  Other 
Problems  of  Multiculturalism 

Medill 

Division  E INVITED  ADDRESS 

Chair:  Jennifer  Parkhurst,  University  of  Nebraska 

Speaker:Richard  A.  Shweder,  University  of  Chicago 

Saturday,  October  19, 9:00-9:50 

4.2. 1 Computer  Adaptive  Tests 
Parlor  D 

Division  D Paper  Session 

Chair:  Leslie  Lukin,  University  of  Missouri-Columbia 

Will  Converting  Paper-and-Pencil  Tests  to  a CAT 
Format  Produce  the  Same  Placement  Decisions? 

Janies  A.  Jones,  JoAnn  Uslick,  Thomas  E.  llinero, 
Kent  State  University 
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Comparison  of  Item  Targeting  Strategies  for  Pass/Fail 
Computer  Adaptive  Tests 
Betty  A.  Bergstrom,  Mary  E.  Lunz,  American 
Society  of  Clinical  Pathologists 

Discussant:  Steven  L.  Wise,  University  of  Nebraska 


Saturday,  October  19, 9:00-9:50 

4.2.2  Teachers’  Development 
Parlor  F 

Division  K Special  Session 

Independent  Studies  as  a Means  of  Facilitating 
Preservice  Teachers’  Development 
Shari  Saunders,  David  Fisher,  Aliza  McCormick, 
University  of  Michigan,  Ann  Arbor 


....  SPECIAL  MULTICULTURAL  SESSION  •••• 
Saturday,  October  19, 10:00-10:50 

4.3.0  Research  Dimensions  of  Multicultural 
Education 

Medill 

INVITED  ADDRESS 

Speaker:  James  Boyer,  Arizona  State  University 


Saturday,  October  19, 10:00-10:50 

4.3. 1  Studies  of  Needs  of  Minority  Students 
Parlor  E 

Division  K Symposium 

Chair:  Ayres  D’Costa,  Ohio  State  University 

Needs  and  Concerns  of  Asian-American  Students  in 
Relation  to  Academic  and  Socio-Economic 
Backgrounds 

Linda  Hulman,  Ohio  State  University 

The  Relationship  of  Number  of  Years  as  US  Immigrant 
to  the  Cultural  and  Academic  Accommodation  of 
Asian-American  Students 
Divya  Soares,  Ohio  State  University 

A Study  of  Healt  hi  Wellness  Benefits  Accrued  by  Black 
Students  as  a Result  of  Membership  in  Two  Different 
Church  Denominations:  Seventh  Day  Adventists  and 
Baptists 

Twinet  Parmer,  Tecora  Rogers,  Ohio  State 
University 


Saturday,  October  19, 11:00-12:30 

4.4.0  Issues  for  the  2 1st  Century 
Parlor  A 

Division  A Paper  Session 

Chair:  William  Evans,  Chicago  Public  Schools 

Assessing  Public  Opinion  on  Collaborative  School 
Improvement 

Patricia  A.  O’Connell,  Jeffrey  B.  Hecht,  Noreen 
Michael,  Patricia  H.  Klass,  Illinois  State 
University 

Administrators’  Perceptions  of  Selected  Regular 
Education  Initiative  Issues 

Ronald  Small,  David  Suddick,  Donald  Goode, 

Governors  State  University 

A Study  of  Time  Allocated  to  Instructional 
Leadership  Skill  Areas  by  Superintendents  of  Indiana 
Schools 

Mark  Myers,  Ball  State  University 

The  Relationship  of  District  and  School 
Characteristics  with  the  Provision  of  First-Year- 
Teacher  Staff  Development  Programs 
Joan  F.  McGuire,  Jackson  Elementary  School 
Patricia  H.  Klass,  Illinois  State  University 
Garth  Piercy,  East  Peoria  High  School 

Discussant:  E.  Jean  Harper,  Wright  State  University 


Saturday,  October  19, 11:00-12:30 

4.4. 1  Learning  and  Instruction  in  Elementary 

Science  and  Social  Studies 

Parlor  B 

Division  B Paper  Session 

Chair:  Mary  Link,  Miami  University 

Fostering  Global  Citizenship  Through  the  Elementary 

Social  Studies  Curriculum 

Gloria  Alter,  Northern  Illinois  University 

Teacher  and  Parent  Attitudes  Towards  AIDS 
Education  in  the  Elementary  School 
Stephanie  Jones,  Ruth  Taylor,  Lian-Hwang  Chiu, 
Indiana  University  at  Kokomo 


October  16-19, 1991 

The  Effect  of  Instruction  Delivery  Systems  on  Content 
Knowledge  and  Learner  Attitudes  Toward  Computer- 
Based  Instruction 

Beth  A.  Wiegmann,  Thomas  E.  Thompson, 

Northern  Illinois  University 

Hands-On  Inquiry-Based  Science  Curriculum  for  a K- 
3 Teacher  Enhancement  Program 
Cory  Cummings,  Northern  Illinois  University 
Kristin  Ciesemier,  Fermilab  Education  Office 

Discussant:  Susan  M.  Hegland,  Iowa  State  University 


Saturday,  October  19, 11:00-12:30 

4.4.2  The  Identification  of  Master  Teachers 
Lincoln 

Division  K Symposium 

Char:  Richard  P.  Lipka,  Pittsburgh  State  University 

In  the  Classrooms  of  Master  Teachers:  An 
Observational  Study 

Rozanne  Sparks,  Richard  P.  Lipka,  Pittsburgh  State 
University 

Pros  and  Cons  of  High  and  Low  Inference 
Observation  Instruments 
Charles  Mote,  Michelle  Burris,  Pittsburgh  State 
University 

Notes  From  the  Field:  Informal  Learnings  from  an 
Observational  Study 

Selinda  Staib,  Lonnie  Parker,  Pittsburgh  State 
University 

Master  Teacher  Research:  A Formal  Reply 
Jay  Price,  University  of  Wisconsin-Stevens  Point 

Discussant:  Jay  Price,  University  of  Wisconsin- 
Stevens  Point 


•••♦  SPECIAL  MULTICULTURAL  SESSION  •••• 

Saturday,  October  19, 11:00-11:50 

4.5.0  Multicultural  Education  and  Ethnic  Concerns 
Medill 

Division  K Paper  Session 

Chair:  Deborah  L.  Bainer,  Ohio  State  University 


Thirteenth  Annual  Meeting 

An  Analysis  of  Multicultural  Factors  in  Ohio's 

Teacher  Education  Programs 

Mary  Ann  Flowers,  University  of  Toledo 

Images  of  Ethnic  Minorities:  Perceptions  of  Graduate 
Students  from  a Predominantly  White  College 
Rose  Mary  Scott,  Joan  Kennedy,  Mankato  State 
University 

A Comparison  of  Knowledge  Acquisition  and 
Attitudinal  Change  Between  an  Integrated  Model  and 
a Subject-Specific  Model  in  Multicultural  Education 
William  G.  Sparks  III,  Elizabeth  Verner,  Illinois 
State  University 

Discussant:  Thomas  Midgette,  University  of  Arkansas 


Saturday,  October  19, 11:00-1:00 

4.6.0  Program  Evaluation 
Parlor  P 

Division  H Paper  Session 

Chair:  Cindy  Boone,  University  of  Akron 

Adult  Literacy:  Program  Evaluation 

Susan  J.  Daniels,  Caryl  A.  Hess,  University  of  Akron 

Kathleen  M.  Meyer,  Kent  City  Schools 

Comprehensive  Program  Evaluation:  Blending 
Qualitative  and  Quantitative  Methods  to  Validate 
Program  Implementation  and  Operation 
Carol  B.  Furtwengler,  Wichita  State  University 
Carolyn  May,  Wichita  Public  Schools 

A Comparative  Study  of  Three  Methods  of  Promoting 
Literacy  in  Young  Children 
Nancy  Mawrogenes,  Mavis  Hageman,  Trudy 
Wallace,  Chicago  Public  Schools 

Four  Alternative  Methods  of  Reporting  Process 
Evaluations 

Keith  McNeil,  New  Mexico  State  University 

Evaluation  of  a Process  Model  for  Statewide 
Improvement  of  Administrative  Practices 
Theresa  Strand,  Educational  Testing  Service 

Discussant:  Daniel  Mueller,  Indiana  University 
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Saturday,  October  19, 11:00-1:00 

4.6. 1 Studies  in  Efficacy,  Beliefs  and  Attitudes 
Parlor  F 

Division  K Paper  Session 

Chair:  Charlene  M.  Czerniak,  University  of  Toledo 

Examination  of  the  Relationships  Between  Perceived 
Potential,  Commitment,  and  Efficacy  and 
Performance,  Satisfaction,  Preparation,  Career 
Orientation,  and  Academic  Ability 
Mari  Kemis,  Iowa  State  University 

The  Identification  of  Academic,  Personal,  and 
Affective  Predicators  of  Student  Teaching 
Performance 

Ronald  N.  Marso,  Fred  L.  Pigge,  Bowling  Green 
State  University 

A Study  of  Science  Teaching  Efficacy  Using 
Qualitative  and  Quantitative  Research  Methods 
Charlene  Czerniak,  University  of  Toledo 

The  Effect  of  Student  Teaching  on  Attitudes  Toward 
Effective  Teaching 

Gregory  J.  Marchant,  Ball  State  University 

Teacher  Educators’  Beliefs  as  to  the  Esteem  in  Which 
They  are  Held  by  Academics  in  Other  Disciplines 
Richard  J.  Reynolds,  Ohio  State  University 

Discussant:  Barbara  Duffield,  University  of  Toledo 


Saturday,  October  19, 11:00-1:00 

4.6.2  Can  NCATE  Standards  be  Validated?  If  so 
How? 

Parlor  E 

Division  K Discussion  Panel 


Chair:  Donald  R.  Cruickshank,  Ohio  State 
University 

Panel:  Ayres  D’Costa,  Donald  Haefele,  Thomas  R. 
Knapp,  William  Loadman,  John  J. 
Kennedy,  Ohio  State  University 

Discussant:  Donald  R.  Cruickshank,  Ohio  State 
University 


••••  SPECIAL  MULTICULTURAL  SESSION  •••• 

Saturday,  October  19, 12:00-1:00 

4.7.0  Cross  Cultural  Values,  Comparisons,  and 

Stereotypes 

Medill 

Division  G Paper  Session 

Chair:  Sharon  McNeely,  Northeastern  Illinois 
University 

Alerting  American  Teachers  to  Stereotypes  of  Arabs 
Micheline  Chalhoub,  Ohio  State  University 

Cross-Cultural  Comparison  of  Self-Concept  American 
vs.  Indian  and  Swazi 

Naim  Gupta,  Angela  Simpson,  Betty  Gridley,  Ball 
State  University 

Chinese-American  Students’  Values  and  Attitudes 

Towards  Schoolwork  and  Learning 

Jupian  J.  Leung,  University  of  Wisconsin-Oshkosh 


Saturday,  October  19, 1:00-3:00 

4.8.0  Executive  Committee  Meeting 
Blackhawk 


Abstracts  and  Papers 

Abstracts  of  papers  presented  at  the  199 1 Annual  Meeting  are  published  separately  and  will  be  available  to  all 
Conference  Participants  (at  no  cost)  at  the  Registration  Desk  at  the  Bismarck  Hotel  Lobby  during  Registration  hours. 
Additional  copies  may  be  ordered  from  the  Executive  Officer,  Charles  Anderson,  at  a cost  of  $3.00  to  cover  prepaid 
postage  and  handling. 

Papers  presented  at  the  1991  Annual  Meeting  are  eligible  for  inclusion  in  the  ERIC  System.  A form  with 
instructions  is  available  at  the  Registration  Desk.  Participants  are  encouraged  to  use  this  opportunity  to  achieve 
greater  exposure  for  their  research. 


October  16-19, 1991 


Thirteenth  Annual  Meeting 


In  Memoriam 

Nancy  Palchik,  University  of  Michigan,  Ann  Arbor 

May  4, 1991 

We  will  miss  Nancy  Palchik  at  our  Annual  Meeting  this  year.  She  died  of  Cancer.  Nancy  was  an 
active  member  of  MWERA  for  many  years.  Nancy  joined  MWERA  in  1984,  and  served  our  organization 
as  an  Association  Council  member  (1988-90),  as  the  Hospitality  Chair  for  the  1989  Conference,  and  as 
Division  I Program  Chair.  More  importantly,  Nancy  was  an  enthusiastic  supporter  of  MWERA,  its  goals, 
and  its  programs. 

Nancy  held  various  posts  at  the  University  of  Wisconsin  over  a 1 6 year  period.  Nancy  was  involved 
with  the  University  Health  Service,  the  School  of  Education,  the  Highway  Safety  Research  Institute,  and 
the  Medical  School.  Most  recently  she  served  as  Director  of  the  Education  Component  of  the  Michigan 
Multipurpose  Arthritis  Center,  and  headed  the  Osteoporosis  Prevention  Project  of  Michigan,  supported  by 
the  Michigan  Department  of  Public  Health.  She  was  active  in  teaching  clinical  skills  to  medical  students, 
and  in  developing  methods  of  enhancing  and  assessing  students'  clinical  reasoning  skills. 

Those  wishing  to  contribute  to  the  MWERA  Scholarship  Fund  in  her  name  should  send  their 
contributions  to  Charles  Anderson,  1332  Southwind  Drive,  Northbrook,  IL  60062. 


1992  Annual  Meeting 

Next  year ’s  Annual  Meeting  w ill  be  held  at 
the  Bismarck  Hotel  in  Chicago  from 
Wednesday,  October  14  through  Saturday, 
October  17. 

Program  chairs  are  needed  as  are  volunteers 
to  help  with  other  aspects  of  conference 
planning.  Interested  individuals  are 
encouraged  to  contact  the  1 992 program  chair. 

Richard  C.  Pugh 
School  of  Education 
W.  W.  Wright  Building 
Indiana  University 
Bloomington,  IN  47405 

Suggestions,  ideas  and  comments  related  to 
the  1992  program  are  also  welcome. 


Ya’l  come  back  now! 
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The  Bismarck  Hotel . In  1894  the  first  Bismarck  Hotel  was  established  in  a 40-foot  building  on 
Randolph  Street  in  Chicago.  Since  then  it  has  grown  and  expanded  to  provide  excellence  in  accommodations, 
dining,  and  entertainment.  With  550  rooms  and  banquet  and  meeting  facilities,  the  Bismarck  offers  the 
Mid-Western  Educational  Research  Association  a quality  affordable  site  for  its  annual  meeting. 
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As  we  begin  our  second  year  as  editors  of  the  MidWestem  Educational  Researcher,  we  would  like 
to  take  this  opportunity  to  thank  all  of  you  who  have  contributed  to  the  publication.  We  are  seeing 
an  increase  in  both  the  quantity  and  quality  of  manuscripts  submitted  for  review.  We  hope  that  you 
will  consider  our  publication  as  an  outlet  for  your  work. 

We  would  like  to  thank  our  exiting  editorial  board  members  and  welcome  three  new  members. 
Laura  L.  B.  Barnes  replaces  William  Loadman;  Immediate  Past-P resident  Ayres  D’Costa  replaces  Dennis 
Leitner;  and  past  President  of  MWERA  and  AERA  and  newly  elected  President  of  the  American 
Psychological  Association,  Frank  Farley,  replaces  the  current  MWERA  President,  Barbara  Plake.  We 
greatly  appreciate  the  efforts  of  our  editorial  board  and  the  ad  hoc  reviewers  that  spend  a great  amount 
of  time  and  effort  to  evaluate  the  manuscripts.  Their  expertise  provides  guidance  for  manuscript  revision 
as  well  as  direction  for  the  publication  as  a whole.  At  the  annual  meeting  many  of  the  members  had 
comments  for  us  concerning  the  journal.  We  are  pleased  to  hear  them  and  are  especially  happy  to 
receive  new  ideas.  We  hope  that  you  enjoy  this  issue  and  will  let  us  know. 


Northern  Illinois  University. . On  the  cover  is  a photograph  of  Graham  Hall  at  Northern  Illinois  University  in  DeKalb. 
Chartered  in  1899  as  a State  Normal  School,  NIU  now  has  seven  academic  colleges.  The  College  of  Education  con- 
sists of  four  departments:  Curriculum  and  Instruction;  Educational  Psychology,  Counseling,  and  Special  Education; 
Leadership  and  Educational  Policy  Studies;  and  Physical  Education.  Degrees  in  education  are  awarded  at  the  bacca- 
laureate, master’s,  specialist,  and  doctoral  levels.  All  basic  and  advanced  programs  are  fully  NCATE  accredited. 


Correction:  In  the  memoriam  for  Nancy  Palchik,  the  Program  Issue  of  the  Mid-Western 
Educational  Researcher  incorrectly  identified  her  institutional  affiliation.  She  was  with  the  University 
of  Michigan  for  more  than  16  years.  The  “Nancy  S.  Palchik  Arthritis  Educational  Research  Award” 
has  been  established  in  her  memory.  Contributions  to  support  this  award  may  be  sent  to  the  Arthritis 
Health  Professions  Association,  do  Ruth  Martin,  Executive  Director,  1314  Spring  Street  NW, 
Atlanta,  GA  30309. 
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The  M idWestem  Educational  Researcher  accepts  research-based  manuscripts  that  would  appeal  to  a 
wide  range  of  readers.  All  materials  submitted  for  publication  must  conform  to  the  language,  style,  and  format  of  the 
Publication  Manual  of  the  American  Psychological  Association,  3rd  ed.,  1983  (available  from  Order  Department, 
American  Psychological  Association,  P.O.  Box  2710,  Hyatts ville,  MD  20784). 

Three  copies  of  the  manuscript  should  be  submitted  typed  double  space  (including  quotations  and  references)  on 
8 Vi x 1 1 paper.  Only  words  to  be  italicized  should  be  underlined.  Abbreviations  and  acronyms  should  be  spelled  out  for 
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On  Research  in  Classrooms 

By  Joel  R.  Levin 

University  of  Wisconsin,  Madison 


For  the  past  two  years  as 
Editor  of  the  Journal  of  Psychology , I 
have  reviewed  more  than  a dozen 
classroom-based  instructional-inter- 
vention  studies  that  contain  the  same 
“fatal”  research-methodology/data- 
analysis  flaw.  Most  recently,  a gen- 
uinely  concerned  author  of  one  such 
study  sought  my  advice  on  potential 
preventive  measures  that  could  be 
taken  to  prevent  that  particular  flaw 
from  occurring  again  in  the  future. 
This  presentation  provides  me  with  an  occasion  to  discuss  some 
of  those  “flaw-ointment”  possibilities. 

In  the  presentation,  I do  not  attempt  to  quarrel  with 
arguments  in  favor  of  replacing  the  usual  laboratory  treatment- 
comparison  approach  with  instructional  comparisons  in  actual 
school  settings,  based  on  legitimate  concerns  about  ecological 
validity  (e.g.,  Bracht  &.  Glass,  1968),  social  validity  (e.g.,  Wolf, 
1978),  political  and  national  accountability,  and  the  like.  Neither 
do  I contemplate  the  definitional  question  “What  qualifies  as 
classroom  research?”  other  than  to  include  any  situation  where 
an  instructional  treatment  or  intervention  is  administered  within 
a classroom  or  classrooms.  That  is,  in  order  to  maintain  a broad 
perspective,  ignored  here  will  be  such  issues  as  (a)  the  size,  homo- 
geneity, and  composition  (“as  is”  or  randomly  formed)  of  the 
classrooms;  (h)  whether  the  instructional  intervention  of  interest 
is  teacher-  or  researcher-administered;  and  (c)  the  duration  and 
relevance  of  the  intervention. 

Six  “Common  Contentions” 

About  Classroom-Intervention  Research 

Let  me  begin  by  presenting  (and  then  arguing  against) 
six  ’‘common  contentions”  (Boruch,  1975)  about  conducting 
empirical  classroom-based  intervention  research.  In  particular, 
compared  to  laboratory-based  treatment  studies: 

1.  Classroom  research  is  more  expensive  (i.e.,  it  is  more 
iabor-,  time-,  and  resource-intensive). 

2.  Classroom  research  is  more  difficult  to  conduct  (in  terms 
of  scheduling  and  implementation  constraints). 

3.  Classroom  research  addresses  important  teaching-and- 
Laming  issues  (as  opposed  to  trivial  ones). 

4.  Classroom  research  investigates  real  student  processes 
and  performance  (as  opposed  to  contrived  ones,  or  theoretical 
propositions). 


5 . Classroom  research  must,  of  necessity,  be  less  i cell  con- 
trol led  (or,  to  quote  Martin  & Aykroyd,  1970s,  the  classroom  is 
a “wild  and  crazy”  place). 

6.  Classroom  research  legitimizes  reliance  on  qualitative 
evidence , including  testimonies,  subjective  evaluations,  personal 
impressions,  ethnographic  data— see  Wineburg  (1991)  for  an  effec- 
tive combination  of  quantitative  and  qualitative  data;  Jaeger 
(1988)  for  a discussion  of  relevant  methodological  considerations; 
and  Salomon  (1991)  for  an  alternative  conceptualization  of  the 
problem,  in  terms  of  “analytic”  and  “systemic”  research  approaches. 

My  responses  to  these  six  contentions  are,  respectively: 
generally  yes,  probably  yes,  maybe,  not  always,  definitely  no,  and 
nonsense!  In  a less-flippant  vein,  consider  the  contentions  in 
terms  of  simplified  (dichotomized)  two-dimensional  representa- 
tions, with  one  dimension  defined  by  type  of  research  (classroom 
vs.  laboratory')  and  the  other  defined  by  quality  of  the  research 
(“good”  vs.  “poor,”  according  to  any  of  the  just-stated  six  con- 
tentions). My  contention  is  that  in  the  literature,  one  can  iden- 
tify counter-stereotypical  examples  of  each  combination  (e.g., 
methodologically  sound  classroom  research  and  methodologically 
weak  laboratory  research;  instructional^  important  laboratory 
research  and  instructional ly  trivial  classroom  research).  So,  so 
much  for  the  contentions:  They  are  specious  at  best. 

The  remainder  of  my  presentation  targets  specifically 
Common  Contentions  5 and  6 (methodology  and  data  analysis)— 
for  related  discussion  in  the  context  of  program-evaluation  studies, 
see  Levin  and  Levin  (1991). 

Classroom  Research, 

Scientific  Credibility,  and  the  Publication  Process 

First,  it  will  be  useful  to  distinguish  among  three  different 
kinds  of  empirical  educational  investigation.  The  distinction 
is  not  just  a nominal  one,  but  one  that  bears  on  the  scientific 
“credibility”  of  the  evidence  resulting  from  the  investigation.  In 
particular,  the  distinction  pertains  equally  forcefully  to  the  objec- 
tives, procedures,  and  assumptions  associated  with  the  particular 
kind  of  investigation. 

With  rum-research  classroonr  demonstrations,  one  is  justified 
in  concluding,  for  example,  that:  “This  is  what  happened  to 
students1  reading-achievement  scores  when  they  were  instructed 
by  Method  A . . ” For  non-research  demonstrations,  only  descrip- 
tive statements  of  this  kind  are  warranted,  as  there  is  no  standard 
against  which  to  measure  the  success  of  the  intervention  or  the 
magnitude  of  the  intervention  effect.  In  cases  where  the  instruc- 
tional method  is  a more  global  instructional  program,  non- 
research evaluation  studies  constitute  a special  case. 
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On  Research  in  Classrooms  (continued) 


Pre^experimental  classroom^'esearch  studies  are  those  that 
allow  for  hypothesis  exploration  or  generation,  as,  for  example: 
“After  students  in  one  classroom  had  been  instructed  by  Method 
A and  students  in  another  classroom  has  been  instructed  by 
Method  B,  there  was  a between-classroom  difference  in  average 
reading  achievement.  Perhaps  this  difference  was  attributable 
to  method  of  instruction...  [but  perhaps  it  was  not].”  The  dis- 
tinguishing characteristic  of  such  studies  is  that  despite  the 
inclusion  of  a standard  or  comparison,  the  comparison  is  not 
free  of  contaminants  that  could  themselves  account  for  the 
observed  difference(s). 

Experimental  classroom^esearch  studies , based  on  random- 
assignment  procedures  of  the  kind  discussed  later,  permit  scien- 
tifically sound  hypothesis  confirmation  or  validation.  This  is 
evident  in  the  following  statement  and  conclusion:  “After  several 
randomly  assigned  classes  received  two  different  methods  of  in- 
struction (A  and  B),  there  was  a between-method  difference  in 
the  classes’  average  reading  achievement.  This  difference  was 
due  to  method  of  instruction..  ” 

Further  attention  to  scientifically  credible  classroom- 
research  studies  is  given  in  five  general  methodological/statistical 
principles  that  I have  found  to  characterize  “good”  experimental 
research  (see  also  Levin,  1985): 

1.  Sensible  (reasonable).  There  must  be  logical  connections 
among  the  substantive  research  questions,  research  methodology, 
and  data  analysis. 

2.  Selective  (planful).  There  should  be  a prior  considera- 
tion of  the  nature  and  number  of  hypotheses  tested.  In  that 
regard:  (1)  fewer  is  usually  better  than  more;  (2)  predicted,  rather 
than  “postdicted”  outcomes,  comprise  more  credible  scientific 
evidence;  and  (3)  “discriminating”  (Campbell  and  Fiske,  1959), 
“strong-inference”  (Platt,  1964)  hypotheses  are  to  be  tested 
whenever  possible. 

3.  Sound  (valid).  Here  I refer  to  methodological  consider- 
ations, following  Campbell  and  Stanley’  (1966)  notions  of  internal 
and  external  validity.  I also  refer  to  various  technical  assumptions 
required  for  valid  statistical  analysis  of  the  data,  as  reflected  by 
Cook  and  Campbell's  (1979)  statistieu/<(mclusi>m  validity.  With 
respect  to  classroom-intervention  research,  in  particular,  many- 
reasonable  methodological  and  statistical  approaches  can  be 
“borrowed”  and  adapted  from  other  disciplines,  including  eco- 
nomics, medicine,  and  applied  behavior  analysis. 

4.  Sensitive  (precise,  powerful).  A researcher  should  adopt 
methods  of  analysis  that  are  optimally  sensitive  to,  and  powerful 
for,  his/her  stated  research  questions  or  hypotheses.  Often  this 
can  be  accomplished  by  testing  one’s  hypothesis  as  planned  con- 
trasts (consistent  with  the  second,  selective,  principle),  rather 
than  in  the  context  of  omnibus  tests. 

5.  Simple  (straightforward).  All  other  things  being  equal, 
one  should  consider  selecting  statistical  procedures  that  are  easier 
(rather  than  “sophisticated”  hut  also  more  complicated)  to  under- 


stand, employ,  or  explain  (see,  for  example,  Cohen,  1990;  and 
Marascuilo  & Levin,  1983). 

Suggestions  for  Various  Classroom 
(or  Other  “Aggregate”) 
Intervention-Research  Situations 

One  classroom.  The  usual  one-classroom  intervention 
study  consists  of  assessing  pretest-to-posttest  changes  on  one  or 
more  designated  dependent  measures  following  an  instructional 
intervention  of  some  kind.  Using  Campbell  and  Stanley’s  (1966) 
notation,  one  can  refer  to  this  as  a one-classroom  OXO  design, 
where  the  first  O represents  a pretest,  X represents  the  interven- 
tion, and  the  second  O represents  a posttest.  An  alternative 
instance  of  a “pre-experimental”  classroom-research  study  dis- 
cussed earlier,  this  usual  type  of  pretest-intervention-posttest 
design  has  a critical  methodolo^'oi/  problem  associated  with  it, 
namely  the  confounding  of  the  instructional  intervention  with 
any  number  of  other  extraneous  factors  (e.g. , student  maturation, 
leaming/schooling  effects  that  are  unrelated  to  the  intervention, 
teacher  effects,  novelty,  contagion,  and  so  forth).  There  is  a critical 
data^amlysis  problem  associated  with  this  design  as  well  (to  be 
discussed  in  the  context  of  the  typical  two-classroom  study,  which 
follows),  when  mean  pretest-to-posttest  changes  are  analyzed  via 
a standard  correlated-sample  t test. 

For  this  type  of  study  to  furnish  credible  statistical  support 
for  the  presence  or  absence  of  an  intervention  effect,  a few 
alternative  approaches  can  he  considered: 

• ime-gn:>up  intenupted  tone-series  (OCOOOOXOOCXXX)) 
design,  assuming  that  a sufficiently  large  number  of  pre-  and 
post-intervention  measures  are  taken.  Data-analysis  possibilities 
include  parametric  time-series  analysis  (e.g.,  Glass,  Willson,  & 
Gottman,  1975)  and  Edgingtons  (1975)  nonparametric  analysis 
(see,  for  example,  Kratochwill  & Levin,  in  press). 

• ABAB . . . A B'type  designs  (where,  over  time,  A represents 
baseline  or  nonintervention  phases,  and  B represents  intervention 
phases),  followed  by  nonparametric  “pennutation”  or  “randomi- 
zation” tests  (e.g.,  Levin,  Marascuilo,  & Hubert,  1978). 

• randomised  experiment  tnt/iin  the  classroom,  to  assess 
either  the  intervention  as  a whole  (macro-experiment)  or  com- 
ponents of  the  intervention  (micro-experiment).  Refer  to  Lehrer’s 
research  on  computer  instruction  in  Logo  for  examples  of  the 
former  (e.g.,  Lehrer,  Guckenberg,  & Lee,  1988;  Lehrer,  Randle, 
& Sancilio,  1989). 

Tit  o classrooms.  Historically,  one  of  the  most  commonly 
applied  strategies  in  educational  “experiments”  has  students  in 
one  classroom  receiving  an  instructional  intervention  and  those 
in  another  not  (or  the  latter  receive  a placebo  or  some  alterna- 
tive intervention).  Sadly,  however,  there  are  three  potentially 
irreparable  sources  of  difficulty  associated  with  one-classroom- 
per-treatment  designs  of  this  kind  (see  also  Levin,  1985). 
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First,  there  is  the  methodological  problem  previously  alluded 
to  for  pro-experimental  classroom-research  studies,  namely  the 
confounding  of  the  instructional  treatment  with  any  number  of 
other  factors— including  teacher  characteristics,  student  charac- 
teristics if  the  classes  are  not  randomly  constituted,  time-of-day 
effects,  “lawn mower  effects”  (Page,  1965),  and  “compensatory 
rivalry' ’’/“John  Henry”  effects  (Saretsky,  1972)  if  the  classrooms 
are  situated  in  the  same  school.  Such  confounding  is  present 
even  when  the  classroom  to  receive  the  intervention  is  randomly 
specified,  when  students  are  randomly  assigned  to  the  two  class- 
rooms, or  when  the  same  teacher  is  present  in  both  classrooms. 

The  second  source  of  difficulty  is  an  ethical  one— in  partic- 
ular, determining  which  classroom  gets  the  “good”  or  “innovative” 
instructional  treatment.  Unless  a “wait-list”  control  approach 
is  employed  (wherein  students  in  the  non-intervention  class- 
room are  scheduled  to  receive  the  instructional  treatment  after 
the  formal  study  has  been  completed),  then  the  withholding  of 
potentially  beneficial  instruction  from  some  (but  not  all)  students 
becomes  an  ethical  issue  to  which  the  researcher  must  attend. 

Finally,  there  is  a crucial  stmistiozl-anafvsis  problem- 
one  that  is  often  ignored  by  otherwise  careful  researchers— even 
though  it  has  been  recognized  in  our  field  as  a data-analysis 
thorn  for  at  least  50  years  (Lindquist,  1940).  Because  the  singly- 
administered  intervention  can  potentially  affect  all  students 
within  the  classroom  in  interrelated  ways,  this  design  produces 
nonindependent  “units  of  analysis,”  which  renders  invalid  an 
independent-sample  t test  of  the  effect  of  the  intervention— 
along  with  its  associated  confounded  teacher,  student,  and 
classroom-contextual  effects. 

What  can  be  done  when  one-classroom-per-treatment 
constraints  necessitate  this  type  of  design?  What  follows  are  a 
few  recommendations: 

• replicated  one-group  or  two-group  time-series  designs  and 
analyses,  which  would  address,  respectively:  (a)  the  general iza- 
bility  of  the  intervention  effect  across  classrooms;  and  (b)  the 
difference  between  the  intervention  and  nonintervention  effect 
across  classrooms;  and  (b)  the  difference  between  the  interven- 
tion and  a nonintervention  (or  an  alternative  intervention)  series. 

• replicated  ABAB  . . A B-type  designs  and  nonparametric 
analyses  (Busk  & Marascuilo,  in  press). 

• randarnffed  experiments  within  the  classrooms,  as  men- 
tioned earlier. 

• alternative-treatment  or  two-group  comparisons  based 
on  two  or  more  predictably  different  and  distinct,  or  “transfer- 
appropriate  processing”  (Morris,  Bransford,  & Franks,  1977)  out- 
come measures— (see,  for  example,  Jones  & Hall,  1982);  or  in 
the  context  of  two-period  crossover  designs  (e.g.,  Cotton,  1989), 
which  are  sensitive  to  both  the  methodological  and  ethical  con- 
cerns expressed  earlier. 

Four  classrooms.  With  four  classrooms  (or  subgroups  within 
classrooms)  and  the  capability  of  staggering  the  introduction  of 
an  intervention  from  one  randomly  designated  classroom  (or 


subgroup)  to  the  next,  a researcher  can  produce  scientifically 
credible  results  through  the  application  of  a multiple-baseline 
design  implemented  across  classrooms  (e.g.,  Kratochwill,  1978). 
When  at  least  four  classrooms  (or  subgroups)  are  available,  it  is 
possible  to  document  a statistically  significant  (p  < .05)  inter- 
vention effect  on  the  basis  of  an  efficient  nonparametric  permu- 
tation test  (Wampold  & Worsham,  1986). 

Six  or  more  classrooms.  The  remainder  of  my  presentation 
will  focus  on  instruct ional-intervention  experiments  in  which 
six  or  more  classrooms  can  be  randomly  assigned  to  intervention 
and  control  (or  alternative  intervention)  conditions.  With  at 
least  three  classrooms  per  instructional  condition  and  using  class- 
rooms as  the  units  of  analysis— or  equivalently,  a “hierarchical 
design”  with  classrooms  “nested”  within  conditions  (Kirk,  1982; 
Raudenbush  & Bryk,  1988)— one  can  show  that:  (a)  a nonpara- 
metric permutation  test  is  able  to  document  statistically  signifi- 
cant (p  < .05)  intervention  effects;  and  (b)  corresponding  para- 
metric analyses  will  yield  adequate  power  to  detect  effects  that 
are  “worth  writing  home  about”  (Barcikowski,  1981). 

What  follows  are  a variety  of  reported  research  examples 
and  proposed  logical  extensions  of  the  “classrooms  as  units  of 
analysis”  philosophy.  These  arc  divided  into  three  general  cate- 
gories: (1)  one-factor  designs  that  focus  on  the  effect  of  the 
intervention  per  se;  (2)  designs  with  more  than  one  experimental 
factor,  where  both  main  effects  and  interactions  are  of  interest; 
and  (3)  designs  where  ones  primary  interest  is  in  the  interaction 
between  the  experimental  factor  and  selected  student  charac- 
teristics. Each  of  these  situations  is  considered  in  turn. 

1.  To  analyze  the  effect  of  an  intervention  per  se,  one 
can  conduct: 

• betu'een-classroom  comparisons  on  a single  outcome 
measure,  as  illustrated  in  Figure  1 and  by  several  studies  in  which 
either  laige-  or  small-group  means  comprised  the  units  of  analy- 
sis for  assessing  the  effects  of  competing  vocabulary-learning, 


Figure  1 

Intervention  Effects:  Basic  Design  and  Analysis 
(Y=  Performance  on  the  Dependent  Measure) 
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word-identification,  and  reading-comprehension  strategies  (e.g., 
Byrne  & Fielding-Bamsley,  1991;  Duffy,  Roehler,  et  ah,  1986, 
1987;  Levin,  Levin,  Glassman,  & Nondwall,  1991;  Levin,  Press- 
ley,  McCormick,  Miller,  &.  Shriber,  1979;  Stevens,  Slavin,  & 
Famish,  1991). 

• be  tween-classroom  compariscms  of  gains  or  trends,  as  may 
be  seen  in  Footman  et  al  .’s  (1991)  use  of  trend  analysis  to  com- 
pare two  different  word-identification  instructional  approaches 
throughout  the  course  of  a school  year  (see  Figure  2). 


Figure  2 

Intervention  Effects : Change  Scores 
(d=Time  2— Time  I,  or  d = Linear  Tend.  etc.) 
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9 between-classroom  comparisons  on  a covariate-adjusted 
outcome  measure.  In  opting  for  this  approach,  one  must  be  mind- 
ful of  the  way  in  which  the  covariate  is  taken  into  account.  For 
example,  Duffy  et  al.  (1987)  based  their  analysis  on  classroom-level 
adjusted  means.  However,  an  approach  that  is  both  more  logical 
and  statistically  more  powerful  would  be  to  take  the  covariate 
into  account  at  the  student  level  (based  on  the  pooled  within- 
treatment,  within-classroom,  slope)  and  then  to  perform  the 
analysis  on  those  student-level  adjusted  classroom  means  (see 
Figure  3).  This  as-yet  untested  classroom  ANCOVA  strategy  goes 
hand  in  hand  with  the  logic  for  investigating  classroom-based 
interactions  between  interventions  and  student-level  individual 
differences  characeristics  (see  No.  3 on  page  6). 

• between-classroom  comparisons  of  variability,  wherein  one 
compares  classroom-average  measures  of  variability  (e.g.,  mean 
variances)  to  determine  whether  an  instructional  intervention 
affected  student  variability’— in  an  analogous  fashion  to  traditional 
tests  of  homogeneity  of  variance  (Kirk,  1982). 

• u'i£/n‘n'da5snx)m  comparisons  of  subgroups  via  counterbal- 
anced repeated-measures  designs  (i.e.,  Latin  square  arrangements). 

• combmcd  between-  and  wit/iin-clussroom  comparisons 
via  the  previously  mentioned  crossover  designs  (a<  applied 
to  classrooms). 


Figure  3 

Intervention  Effects:  Covariate-Adjusted  Means 
(Based  on  Pooled  Within-Treatment,  Within-Classroom  Slope) 


Tl 

Treatment 

t2 

tk 

Class  1 (Tk) 

Y*11 

Y 21  - ■ ■ 

y*ki 

Class  2(Tk) 

7*12 

Y*22 

Y K2 

Class  N(Tk) 

Y*1Ni 

Y*2N2 

Y*KNK 

Means  of  Means 

Y*1 

Y*2 

Yk 

2.  It  is  a straightforward  matter  to  adapt  the  just-discussed 
approaches  to  the  investigation  of  main  effects  and  interactions 
involving  two  or  more  factors,  as  in: 

• combined  between - and  within-'imit  repeated-measures  (split- 
plot)  designs.  This  approach  is  illustrated  in  Figure  4 and  by  a study 
by  Copeland  (1989)  using  a two-level  between- teachers  factor 
(teacher  philosophy— inquiry  vs.  traditional  crossed  within  a two 
level— within  teacher).  For  each  teacher,  time-percentage  scores 


Figure  4 

Interactions  With  Student  Characteristics : Categorized 
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associated  with  a set  of  pre-specified  behaviors  were  recorded. 
These  data  were  then  aggregated  across  days/sessions  to  form 
two  scores  for  each  teacher:  one  for  the  computer-mediated 
classes  and  the  other  for  the  teacher-mediated  classes.  With 
teachers  as  the  units  of  analysis,  this  permitted  for  analyse^  of 
teaching-philosophy  effect,  type-of-instruction  effects,  and 
their  interaction. 

3.  A common  criticism  directed  at  conducting  analyses 
based  on  classroom  means  (rather  than  individual  students’ 
scores)  is  that  this  renders  impossible  the  investigation  of  inter- 
actions  involving  the  intervention  and  selected  student  differ- 
ences. Such  criticism  is  not  well  founded,  however,  as  at  least 
two  different  reasonable  approaches  can  readily  accommodate 
such  interactions  into  the  present  framework.  In  particular,  con- 
ditions-by-student-differences  can  be  examined: 

• with  students  categorized  on  some  student-differ- 
ences dimension  (e.g.,  high  vs.  low  levels  of  achievement).  For 
example,  with  students  classified  as  either  “higher”  or  “lower” 
achievers,  a mean  high-low  difference  can  be  computed  within 
each  classroom.  An  analysis  of  between-conditions  differences 
in  the  mean  within-classroom  difference  of  higher  and  lower 
achievers  (as  in  Figure  4)  provides  an  appropriate  and  direct  test 
of  the  intervention-by-achievement-level  interaction  (see,  for 


Figure  5 

Interactions  With  Student  Characteristics : Continuous 
(B=Wit/im-7reatmem,  Wit/iin'Qassroo?n  Slope) 
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example,  Levin  et  al.,  1991).  Alternatively,  one  could  also  avoid 
the  units-of-analysis  problem  by  investigating  between-conditions 
differences  separately  for  higher  and  lower  achievers  (with  a sta- 
tistical procedure  that  controls  the  family-wise  Type  I error,  if 
desired)  in  a manner  analogous  to  either  ANOVA  “simple-effects” 
comparisons  or  MANOVA  variable-by-variable  comparisons 
(e.g.,  Marascuilo  & Levin,  1983). 

* in  terms  of  a continuous  student-differences  variable,  via 
between-conditions  slope  comparisons  (Levin  & Peterson,  1984; 
see  Figure  5).  This  represents  a sensible  and  sensitive  approach  to 
analyzing  student-differences  interactions  at  the  classroom  level. 
For  example,  suppose  that  six  classes  are  randomly  assigned  to  one 
method  of  instruction,  and  six  to  another.  The  interaction  be- 
tween methods  and  some  student  aptitude  measure  can  be  assessed 
by  computing  a slope  (predicting  students’  performance  from  the 
aptitude  variable)  within  each  classroom,  and  then  comparing 
the  mean  slope  associated  with  the  six  Method  1 classrooms  with 
the  mean  slope  associated  with  the  six  Method  2 classrooms. 

Summary  and  Conclusions 

In  summary,  the  “good  news”is  that  it  certainly  is  pos- 
sible to  conduct  scientifically  credible  instructional-intervention 
research.  The  “bad  news”  is  that  it  is  not  always  simple  or  straight- 
forward to  do  so.  Being  credible  usually  requires  abandoning  the 
“tried  and  true”  traditional  research  methodologies  and  data- 
analysis  strategies  (as  applied  to  independent  treatment  adminis- 
trations and  student  outcomes),  and  opting  instead  for  strategies 
that  are  compatible  with  the  questions  and  assumptions  associated 
with  the  “units”  for  which  scientific  generalizability  is  desired. 

Also  in  contrast  to  the  “usual,”  technically  inappropriate, 
classroom-research  approach,  I advocate  an  alternative  “best 
possible”  classroom-research  philosophy.  According  to  this  philos- 
ophy, a researcher  should  start  by  considering  the  “best  possible” 
study  (with  respect  to  scientific  credibility)  and  working  down 
from  there  to  the  “next  best  possible”  study  given  the  existing 
constraints  (such  as  resources,  scheduling,  degree  of  researcher 
control,  and  the  like),  to  the  “next  best  possible”  study.  In  prac- 
tice, creative  solutions  are  often  required.  Fortunately  for  the 
classroom  researcher,  however,  technically  sound,  creative  solu- 
tions are  becoming  available. 
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Entering  Teacher  Candidates’ 
Conceptions  of  Good  Teaching 

By  Susan  M.  Brookhart 
Duquesne  University 

Abstract 

Beliets  about  teaching  affect  students’  involvement  in  teacher  preparation.  To  describe  some  of  the  conceptions  of  teaching 
with  which  entering  teacher  candidates  begin  their  programs*  22  students  enrolled  in  their  first  teacher  education  course  were  asked 
to  describe  their  most  memorable  assignments  and  their  favorite  teachers  from  their  school  experiences.  Results  contradicted  the 
traditional  findings  of  teaching  as  telling  and  as  an  extended  form  of  parenting.  Student  group  and  project  work  accounted  for  59 
percent  of  the  assignments  described.  Academic  and  intellectual  qualities  were  cited  for  64  percent  of  the  good  teachers  described. 
Warm  and  friendly,  caring  personal  qualities  were  an  important  theme  in  the  students’  writings.  But  so  were  respect,  skilled  presen- 
tation of  academic  material,  and  careful  guidance  of  pupils  in  academic  tasks. 


Teacher  preparation  is  unique  among  college  and  univer- 
sity programs  in  the  amount  of  familiarity  with  which  students 
come  to  their  programs  of  study.  All  entering  teacher  candidates 
have  spent  thousands  of  hours  in  “the  apprenticeship  of  obser- 
vation” (Lortie,  1975),  and  so  all  teacher  candidates  enter  their 
programs  with  some  ideas  about  what  good  teaching  is  and  how 
good  teachers  behave.  This  apprenticeship  only  exposes  stu- 
dents to  their  teachers’  classroom  performances,  not  the  thinking 
behind  the  behavior  (Clark,  1988).  The  apprenticeship  of  obser- 
vation is  not  an  analytical  experience  and  is  not  deliberative; 
rather,  ir  »s  “intuitive  and  imitative"  (Lortie,  1975,  p.  62).  Fur- 
ther, since  each  student  is  exposed  to  and  impressed  by  different 
teachers,  the  apprenticeship  of  observation  does  not  contribute 
to  the  construction  of  a shared  technical  knowledge  about  teach- 
ing. Instead,  it  encourages  a conservative  imitation  of  common 
school  practices  (Lortie,  1975,  p.  67). 

There  is  no  one  “view  of  teaching”  held  by  all  teachers: 
different  teachers  hold  different  views  of  what  teaching  is  (Zeich- 
ner,  Tabachnik,  Densmore,  1987;  Bunting,  1988;  Kilgore,  Ross, 
Zbikowski,  1990).  There  does  seem  to  be  evidence,  however, 
that  commonly  held  view’s  of  teaching  tend  to  be  managerial 
and  conservative  (Lortie,  1975;  Hoy  &.  Rees,  1977;  Lanier 
Little,  1986;  Brousseau,  Book,  & Byers,  1988).  Pretraining  influ- 
ences contribute  to  teachers’  conceptions  of  teaching  (Lortie, 
1975;  Zeichner,  Tabachnick,  & Densmore,  1987).  Beliefs  about 
teaching  affect  students’  involvement  in  teacher  preparation 
(Lanier  Little,  1986).  Students  will  filter  the  content  of  their 
teacher  preparation  coursework  through  their  own  definitions 
of  what  teaching  is.  Thus  entering  teacher  candidates’  beliefs 
will  help  shape  the  conceptions  of  teaching  they  take  from  their 
college  training  into  student  teaching  and  into  initial  practice. 
Practicing  teachers  use  their  beliefs  about  teaching  to  define 
classroom  tasks  and  choose  strategies  lor  dealing  with  them 
(Nespor,  1987).  Teachers*  theories  and  beliefs,  along  with  other 
thought  piocesses,  influence  and  are  influenced  bv  teachers’ 


actions  under  the  constraints  and  opportunities  of  a particular 
classroom  context  (Clark  &.  Peterson,  1986). 

Just  as  teacher  beliefs  are  not  homogeneous,  neither 
are  they  static.  Beliefs  about  teaching  can  develop  and  change 
throughout  preservice  and  inservice  work.  Studies  of  the  develop- 
ment of  teacher  beliefs  describe  modifications,  often  based  on 
interactions  with  other  teachers,  to  extant  beliefs.  Teacher  beliefs 
about  how  student-centered  and  how  directive  instruction  should 
be  can  change  during  the  student  teaching  experience,  and  this 
change  is  partly  related  to  the  views  of  cooperating  teachers 
(Bunting,  1988).  If  beginning  teachers  have  supp*  arrive  colleagues, 
they  can  grow  and  develop  by  reflecting  on  their  work  (Kilgore, 
Ross,  <Sl  Zbikowski,  1990).  Teacher  beliefs  continue  to  change  with 
additional  years  of  experience,  although  these  changes  are  not 
all  in  a positive  direction;  more  experienced  teachers  are  more 
likely  to  believe  their  students  are  trustworthy  and  that  schools 
should  be  agents  for  change,  but  they  are  also  more  likelv  to 
favor  a common  curriculum  and  to  demonstrate  a reduced  sense 
of  teaching  efficacy  (Brousseau,  Book,  &.  Byers,  1988). 

Weinstein  (1989)  studied  teacher  education  students’ 
preconceptions  of  teaching.  She  found  that  prcseivice  teachers 
were  overly  optimistic  about  their  own  abilities  and  held  self- 
serving  biases:  they  tended  to  rate  as  more  important  for  teaching 
■ ' attributes  they  felt  they  themselves  possessed.  In  order  to 
ee»cigate  reasons  for  this  finding,  she  asked  students  to  list 
characteristics  of  "a  really  good  teacher.”  She  found  tha(  students 
described  good  teaching  in  terms  of  warm,  caring  interpersonal 
relationships  and  deemphasized  academic  aspects  of  teaching. 
This  finding  essentially  replicated  the  work  ot  Book.  Bvers,  and 
Freeman  (198T).  The  preservice  teachers  in  their  study  viewed 
teaching  as  “an  extended  form  of  parenting,  about  which  there 
is  little  to  learn  other  than  through  instincts  and  ono  own 
experiences  as  a child  m the  network”  (Book,  Bver^,  6a  Freeman. 
1985.  P.  10). 
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Entering  Teacher  Candidates  Conceptions  of  Teaching  (continued) 


The  present  study  was  based  on  the  assumption  that  what 
entering  teacher  candidates  believe  about  good  teachers  and 
good  teaching  will  influence  their  construction  of  their  own 
tasks  as  students  in  teacher  preparation  programs.  Students’  con- 
ceptions about  good  teaching  will  influence  their  expectations 
for  program  content  and  outcomes.  Introductory  education  text- 
books often  invite  students  to  reflect  on  their  past  experiences 
with  good  teachers  (see,  for  example,  Parkay  &.  Hardcastle,  1990). 
A second  assumption  for  this  study  was  that  entering  teacher 
candidates’  conceptions  of  good  teaching  will  be  drawn  in  large 
part  from  their  own  experiences  in  school  (Lortie,  1975;  Lanier 
& Little,  1986). 

This  study  was  guided  by  two  questions.  (1)  W'hat  do 
students  consider  characteristics  of  good  teaching,  as  evidenced 
by  their  thoughts  about  memorable  assignments  from  their  own 
schooling?  (2)  What  do  students  consider  characteristics  of  a 
good  reacher,  as  evidenced  by  rheir  thoughts  about  their  own 
favorite  teachers? 


Method 

The  sample  consisted  of  22  students  (6  male,  17  female) 
enrolled  in  one  secrion  of  Introduction  to  Education  at  Duquesne 
University,  a private,  urban  institution.  All  were  19-year-old 
second  semester  freshmen,  mostly  from  moderate-sized  suburban 
high  schools.  The  data  were  paragraphs  students  wrote  on  two 
separate  occasions.  For  the  first  paragraph,  students  were  asked 
to  write  about  a memorable  assignment  from  their  own  school 
davs.  Entering  elementary  (n  = 12)  and  secondary7  (n  = 10)  teacher 
candidates  were  asked  to  write  about  an  elementary  or  secondary- 
assignment.  respectively.  The  concept  of  an  apprenticeship  of 
observation  guided  this  choice:  if  students  were  to  take  ideas 
from  their  own  school  days,  they  would  most  likeiy  take  into 
their  own  teaching  repertoire  ideas  from  the  appropriate  level 
of  schooling.  For  the  second  paragraph,  students  were  asked  to 
write  about  their  favorite  teacher,  again  with  the  thought  that 
students  would  be  most  likely  to  emulate  teachers  they  liked  or 
admired.  The  student?  .vere  not  asked  to  write  in  general  about 
“What  is  a good  teacher?”  or  “What  is  good  teaching?”  The 
writing  tasks  were  concrete  and  personal  so  that  students  would 
give  specific  examples.  The  tasks  were  designed  to  tap  the  “obser- 
vations” from  which  the  “apprentices”  would  reason  iiv1' •'■lively 
to  arrive  at  their  conceptions  of  good  teaching. 

Handwritten  paragraphs  were  collected  and  typed  verbatim. 
Separare  analyses  were  done  for  the  memorable  assignment  and 
favorite  teacher  paragraphs.  The  typescripts  were  read  indepen- 
dently by  two  teacher  educators.  Content  categories  were  allowed 
to  emerge  from  the  data;  a category  was  created  if  at  least  five 
students  mentioned  the  same  idea.  After  independent  review, 
the  two  readers  reviewed  the  data  jointly  to  finalize  (a)  what 
content  categories  should  be  used  and  (h)  which  statements  in 
each  student  paragraph  constituted  an  instance  of  a particular 


category.  All  disagreements  were  resolved  through  discussion. 
After  categories  had  been  finalized  and  statements  in  the  para- 
graphs had  been  coded  accordingly,  frequencies  and  percentages 
were  calculated  for  each  category.  In  addition,  quotations  exem- 
plifying each  category  were  identified.  Chi-square  tests  of  homo- 
geneity by  gender  of  student  and  by  level  (elementary  or  sec- 
ondary-) were  done  separately  for  each  category.  Yates’  correction 
was  applied  to  single-df  tables.  A liberal  decision  rule  (p  < 15) 
was  chosen  because  of  the  exploratory'  nature  of  the  analysis. 

Results 

Memorable  Assignments  Separate  chi-square  analyses  of  each 
of  the  categories  from  the  memorable  assignment  paragraphs 
indicated  no  significant  variations  according  to  either  level  (ele- 
mentary’, secondary)  or  gender  of  student  (see  Table  1 for  fre- 
quencies). More  of  the  memorable  assignments  involved  group 
work  than  individual  work.  The  particular  assignments  described 
were  classified,  and  rru  ,\z  than  a third  of  them  involved  plays  or 
oral  presentations.  One  student  described  studying  learning  dis- 
abilities in  a high  school  Sociology  class.  Her  most  memorable 
assignment  was  participating  in  a skit  in  which  she  portrayed  “a 
pregnant  woman  about  to  challenge  the  problems  of  raising”  a 
handicapped  child.  Another  student’s  most  memorable  assign- 
ment was  a Political  Science  skit  in  which  she  portrayed  one  of 
five  elementary  school  teachers,  sole  survivors  of  a nuclear  disaster, 
talking  about  how  to  rebuild  civilization.  A third  student’s  most 
memorable  assignment  was  portraying  Frederick  Douglass  in  a 


Table  1 

Content  AmiKsts  of  Paragraphs  on  Effective  Assignments  in  School 
(12  Elementary,  10  Secondary  assignments  described) 
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59 
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9 

41 
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5 
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4 
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fourth  grade  Social  Studies  play.  Another  student  described  his 
fourth  grade  play  in  terms  of  strictly  affective  outcomes.  He  did 
not  mention  the  topic  of  the  play  at  all.  “This  was  the  first  time 
l got  up  in  front  of  so  many  people,"  he  wrote. 

Five  students  (2  elementary,  3 secondary1)  mentioned 
some  kind  of  written  report  as  their  most  memorable  assignment. 
All  five  were  long-term  projects,  for  example,  a written  plan  to 
start  a successful  business  or  a creative  writing  assignment  based 
on  a poem.  Four  students  (3  elementary,  1 secondary)  described 
constructing  or  making  something  as  their  most  memorable 
assignment.  The  secondary  student  recalled  a chemistry  party  to 
which  students  brought  food  in  the  shapes  of  atoms  or  molecules. 
She  remembered  bringing  a cheese  ball  (nucleus)  orbited  by 
olives  (electrons)  held  in  place  by  toothpicks. 

When  students  described  what  they  had  learned  in  their 
memorable  assignments,  13  listed  affective  outcomes  and  17 
listed  cognitive  outcomes  (8  described  both).  Affective  outcomes 
included  developing  self-confidence,  developing  pride  in  one’s 
work,  overcoming  fear,  developing  a personal  interest  in  a subject, 
learning  to  work  with  others,  and  having  fun  learning.  Cognitive 
outcomes  were  noted  each  time  a student  described  the  academic 
content  or  understanding  he  or  she  remembered  from  an  assign- 
ment. These  outcomes  covered  a wide  range  of  topics,  including 
spelling  words,  volcanoes,  atoms  and  elements,  starting  a small 
business,  the  Civil  War,  Germany,  the  imagery.’  of  Stephen  Crane, 
and  Shakespeare’s  Julius  Caesar 

Favorite  Teachers  Separate  chi-square  analyses  of  each  of  the 
categories  from  the  favorite  teacher  paragraphs  indicated  three 
which  differed  according  to  the  student’s  gender  and  two  which 
differed  according  to  the  favorite  teacher’s  (elementary  or  sec- 
ondary) level  (see  Table  2). 

The  gender  of  the  favorite  teacher  differed  by  gender  of 
student.  All  of  the  male  teacher  candidates  described  men  as 
their  favorite  teachers,  except  for  one  who  changed  the  assignment 
so  he  could  write  about  two  favorite  teachers,  one  man  and  one 
w'oman.  One  quarter  of  the  female  entering  teacher  candidates 
also  described  men  as  their  favorite  teachers. 

Eight  of  the  students  wrote  comments  about  their  favorite 
teachers  demonstrating  energy,  excitement,  or  enjoyment  of 
their  subject  matter.  For  example,  one  student  wrote,  “because 
he  seemed  to  enjoy  so  much  what  he  taught  1 certainly  enjoyed 
learning  it."  Another  wrote,  “He  was  so  enthused  about  the 
importance  of  his  subject,  he  tended  to  rub  off  on  you."  Men- 
tioning this  category*  varied  by  gender  of  student:  males  used 
this  category  more  frequently  than  females  to  describe  their 
favorite  teachers. 

Thirteen  of  the  entering  teacher  candidates  described 
their  favorite  teachers  by  writing  about  their  friendliness.  A 
response  was  coded  in  this  category  if  it  specified  or  implied  a 
peer-like  relationship  as  opposed  to  an  adult  to-child  or  authority- 
to-subordinate  relationship.  Mention  ot  this  category  did  not 


Table  2 

Content  Analysis  of  Paragraphs  on  Favorite  Teachers  in  School 
(7  Elementary , 15  Secondary  teachers  described) 
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Freq. 

% 

Gender  of  teacher 
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!2 

60 
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8 

40 
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36 
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14 

64 
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Teacher  was  friendly,  related 
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13 

59 
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9 

41 

Teacher  commanded  respect, 

admiration,  authority 
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10 

45 

This  category  was  used  more 
often  to  describe  secondary 
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12 

55 
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Teacher  presented  material  at  appropriate  speed  or  level 
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8 

36 

Not  mentioned 

14 

64 

Teacher  offered  individual  help,  had  the  goal  of 

understanding  for  every  student 
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8 

36 
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Not  mentioned 

14 

64 

(XJ  = 3.46,  df=  1,  p < .10) 

Teacher  displayed  positive  affective  qualities  (other  than  friendliness  or  energy) 

Mentioned 

n 

59 

Females  used  this  category’ 
more  frequently  than  males 
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9 

41 

(X,  = 2.27.df=l.p<  .15) 

Teacher  displayed  academic/intcllcctual  qualities 

Mentioned 14  64 

Not  mentioned 8 36 


vary  with  gender  of  student  or  with  level  of  teacher.  Examples 
of  responses  coded  into  this  category  inciude  the  following.  “He 
acted  as  our  friend  and  spent  time  with  us  both  in  and  out  of 
the  classroom.  He  would  play  sports  with  us,  party  with  us . . .he 
would  relate  with  us  whether  it  was  dealing  with  girls  or  grades.” 
“We  were  all  on  the  same  level,  not  teacher  and  students  but 
all  teachers  and  students . . .she  treated  us  as  equals.”  ‘‘She  made 
sure  she  got  to  know  all  of  the  students  and  spend  a little  time 
w’ith  each  student  on  a personal  level.” 

On  the  other  hand,  1 0 of  the  entering  teacher  candidates 
described  their  favorite  teachers  as  the  object  of  respect  and 
admiration  or  the  source  of  influence,  as  an  adult  to  a child. 
Four  of  these  10  students,  all  describing  secondary  teachers, 
used  both  this  category  and  the  friend  category  to  describe  their 
favorite  teachers.  Overall,  students  used  this  category  more 
often  to  describe  secondary  than  elementary  teachers.  One 

(continued  on  page  1 0) 
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student  wrote,  “She  was  a teacher  we  all  respected  a lot  and  ad" 
mired.”  Another  wrote,  “We  respected  her  and  knew  that  she 
had  a purpose  to  her  assignments”  One  described  his  admira" 
tion,  “l  would  be  very  lucky  if  l could  emulate  his  style” 

Eight  of  the  entering  teacher  candidates  described  the 
particular  teaching  of  presenting  material  at  the  appropriate  speed 
or  level  for  students  to  leam  it  as  a quality  for  which  they  appre- 
ciated  their  favorite  teachers.  Mention  of  this  category  did  not 
vary  with  gender  of  student  or  level  of  teacher.  One  student 
referred  to  “the  ability  to  explain  things  on  a level  which  the 
students  can  understand.”  Another  wrote,  “She  went  at  our  pace.” 

A seemingly  related  category  did  differ  by  level  of  teacher. 
Eight  students  mentioned  their  favorite  teacher  offering  indi" 
vidual  help  or  being  concerned  that  each  student  understood  the 
lesson.  Students  used  this  category'  to  describe  elementary  teachers 
more  often  than  secondary  teachers.  One  wrote,  “Mrs.  S . . .would 
see  that  everyone  understood  it  before  moving  on,  even  if  she 
had  to  walk  around  and  give  individual  help.”  Another  wrote, 
“My  teacher  is  walking  around  the  room  commenting  on  each 
students  drawing  or  painting.”  Students  described  their  favorite 
teachers  in  terms  of  a variety  of  other  positive  affective  qualities, 
beyond  the  friendliness  and  energy  mentioned  frequently  enough 
to  merit  their  own  categories.  Warmth,  understanding,  honesty, 
happiness,  “a  positive  attitude  towards  life,”  caring  about  students, 
caring  about  their  own  families,  and  a sense  of  humor  are  examples 
of  qualities  coded  into  this  category-.  Mention  of  positive  affective 
qualities  differed  by  gender  of  student.  Females  mentioned  these 
qualities  more  frequently  than  males. 

F urteen  students  described  their  favorite  teachers  in 
terms  o;  positive  academic  or  intellectual  qualities.  This  was  the 
most  frequent  kind  of  description.  Mention  of  a teacher’s  aca- 
demic  and  intellectual  qualities  did  not  vary  with  gender  of  stU" 
dent  or  level  of  teacher.  Some  of  these  references  were  general: 
“there  were  a lot  of  activities  that  were  always  centered  on  the 
subject  matter”;  and  “she  would  lecture  very-  effectively,  giving 
us  hard  topics  to  discuss.”  Others  were  specific:  “telling  the  story 
of  Cyclops”;  “understand  the  confusing  lawsuit  of  Dred  Scott,  a 
slave”;  and  “she  could  really  discuss  l.rerature” 

Discussion 

Taken  together,  these  results  suggest  that  entering  teacher 
candidates  come  to  teacher  preparation  with  varying  conceptions 
of  what  good  teaching  is  (Zeichner,  Tabachnick,  & Densmore, 
1987).  Each  entering  teacher  candidate  mentioned  a slightly 
different  mix  of  qualities  when  describing  his  or  her  most  memor- 
able' assignment  or  favorite  teacher. 

These  results  also  suggest  that  at  least  some  entering 
teacher  candidates  do  not  hold  the  view  that  teaching  is  typified 
only  by  warm  personal  relationships  (Book,  Byers,  & Freeman. 
1983;  Weinstein,  1989).  Warm  and  friendly,  caring  personal 
qualities  were  an  important  theme  in  the  students’  writings,  but 


(cuiirinued) 

so  were  respect,  skilled  presentation  of  academic  material,  and 
careful  guidance  of  pupils  in  academic  tasks.  Good  teachers 
seemed  to  be  individuals  who  could  provide  personal  support  for 
students  to  do  academic  work.  Memorable  assignments  were, 
for  the  most  part,  remembered  for  both  academic  content  and 
personal  experience. 

These  results  also  suggest  that  the  very-  best  assignments 
are  not  in  line  with  a conservative  concept  of  teaching.  The 
assignments  that  stood  out  in  memory  as  the  best  were  all  long- 
term projects;  all  required  active  student  involvement  in  the 
learning  tasks.  They  seemed  to  be  remembered  fondly  for  this 
reason.  These  entering  teacher  candidates  did  not  identify’  routine 
or  ordinary’  lessons  as  the  best  assignments  (cf.  Lortie,  1975;  Lanier 
& Little,  1986).  They  remembered  the  unusual  assignments,  and 
they  remembered  them  for  their  academic  content  as  well  as  for 
being  fun.  If  the  entering  teacher  candidates  tried  to  reason  by 
induction  from  these  memories  to  a concept  of  good  teaching, 
they  would  arrive  at  a dynamic  and  active  conception  of  teaching 
(cf.  Scardamalia  & Bereiter,  1989).  It  is  worth  noting  that  the 
students  in  this  study  were  asked  to  describe  their  most  memor- 
able assignments.  They  may  well  have  remembered  many  hours 
of  routine  seatwork.  But  they  did  not  write  about  routine  seat- 
work  when  asked  to  describe  the  best  lessons. 

The  scope  of  this  study  was  small.  Its  results  do  not  gen- 
eralize beyond  the  class  in  which  it  was  conducted.  Because  of 
small  sample  size,  chi-square  results  were  used  to  identify  points 
for  discussion  and  not  for  generalization.  But  without  generalizing 
the  results  to  other  entering  teacher  candidates,  three  conclu- 
sions can  be  supported.  First,  there  did  exist  different  concep- 
tions of  good  teaching  and  good  teachers,  and  these  were  not 
entirely  independent  of  gender  of  student  or  level  of  teaching. 
Second,  these  teacher  candidates  recognized  and  remembered 
the  academic  and  cognitive  aspects  of  teaching  in  addition  to 
the  personal  aspects.  Third,  the  best  lessons  in  the  memories 
of  these  teacher  candidates  were  not  traditional,  conservative 
assignments  but  active  participation  in  group  projects.  Most  of 
the  students  in  this  sample  entered  teacher  preparation  with  con- 
ceptions of  good  teaching  that  would  make  them  open  to  training 
in  content  and  pedagogy  stressing  group  activities,  communica- 
tion of  subject  matter  content,  and  academic  as  well  as  emo- 
tional care  of  children.  These  students  were  ready  for  the  best 
in  teacher  preparation. 
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Both  Sides  Now:  Business  and  Education 

As  the  schools,  the  public,  and  government  search  for  ways  to  improve  the  education  of  America’s  children,  a new  ally  has 
emerged.  Businesses  across  the  country  are  becoming  more  actively  involved  in  education.  Corporate  business,  which  has  been  known 
to  spend  a good  portion  of  their  money  on  training,  is  looking  to  improve  the  quality  of  the  workers  of  the  future.  To  this  end  they 
are  contributing  time,  energy,  and  funds  to  improve  public  education.  Although  help  from  almost  any  source  is  welcome,  some  see 
the  price  of  accepting  the  help  of  the  business  community  as  being  too  high. 

Rebecca  G.  Gilliam,  from  GenCorp,  and  Pearlmarie  Whitford  Goddard,  Ed.D.,  from  The  University  of  Akron,  believe  that 
business  and  education  can  form  a powerful  partnership  in  shaping  public  education  for  the  betterment  of  America’s  children.  How- 
ever, Dan  Carpenter,  a columnist  for  the  Indianapolis  Star,  considers  the  relationship  as  dangerous,  and  believes  that  the  motives  of 
corporate  America  may  not  serve  the  best  interest  of  the  future  citizens  of  this  country. 


An  Investment  in  Knowledge : 

Business  Involvement  in  Educational  Reform 

By  Rebecca  G.  Gilliam,  GenCorp,  Fairlawn,  Ohio, 
and  Pearlmarie  Whitford  Goddard, 

The  University  of  Akron,  Akron,  Ohio 

Why  should  business  personnel  get  involved  with  the 
business  of  education?  After  all,  they  are  certainly  not  the  experts 
in  curriculum  development,  theories  of  learning,  or  methods  of 
teaching.  Why,  then? 

For  two  very  basic  reasons.  First  of  all,  today’s  students 
are  tomorrow’s  employees  and  customers.  Corporations  currently 
spend  an  inordinate  amount  of  their  training  budget  on  basic 
skills  and  literacy  programs  to  elevate  some  workers*  skills  to  the 
level  required  for  new  and  modified  jobs  (Rennie,  1989).  These 
training  programs  are  necessary  because  of  the  increasing  number 
of  workers  who  were  not  taught  “how  to  think”  and  “how  to 
learn”  in  high  school.  Many  corporate  leaders  believe  that  pre- 
ventive dollars  spent  today  in  reforming  the  education  system 
may  save  remedial  dollars  spent  tomorrow  on  poorly  educated 
workers  (MacDowell,  1989).  It  has  been  reported  that  11  percent 
of  companies  with  100  or  more  employees  are  providing  remedial 
training  in  basic  reading,  writing,  and  math.  One  third  of  the 
companies  with  10,000  or  more  employees  remedially  train  in 
the  same  (Gordon,  1990). 

Secondly,  the  decline  in  the  output  of  the  educational 
system  has  been  well  documented  since  the  early  1980s  when  A 
Nation  at  Risk  was  first  published.  If  a corporation  had  the  same 
failure  rate  as  many  of  our  school  systems,  it  would  not  stay  in 
business  very  long.  Publicly  held  corporations  have  internal  and 
external  reporting  requirements  so  that  their  performance  can 
be  evaluated.  Yet  what  set  of  checks  and  balances  is  at  work 
when  it  comes  to  our  schools?  Do  most  of  our  school  boards 
really  have  the  authority  to  make  radical  change  in  the  system. 
Are  they  accountable  to  the  voters?  If  the  general  public  is  dis- 
satisfied with  the  output  of  the  schools,  the  normal  response  is 
to  reject  a levy.  This  sends  a message  but  docs  not  provide  any 
meaningful  reform.  Muson  (1991)  reports  that  some  business 
leaders  are  lobbying  legislators  and  administrators  to  clear  out  the 

(ami  mut’d  on  page  12) 


Public  Education  is  Not  Their  Business 

By  Dan  Carpenter,  Indianapolis  Star 

Forget  the  Jeffersonian  and  Emersonian  ideal  of  educa- 
tion as  the  lifelong  process  of  developing  a contemplative,  inde- 
pendent, skeptical  democratic  citizen.  Today’s  public  discussion 
of  the  quality  of  American  schooling  revolves  around  a simpler 
proposition:  How  can  the  young  citizen  be  fashioned  into  a tool 
for  making  some  company  more  money? 

The  language  used  by  big  business  and  its  political  friends 
in  their  annexation  of  the  education  issue  has  been  more  euphe- 
mistic than  that,  but  not  much.  Consider  “Help  Wanted,” 
a series  of  articles  published  by  the  Indianapolis  daily  news- 
papers recently  as  part  of  “a  national  public  information  cam- 
paign to  educate  Americans  about  the  dire  consequences  of 
declining  economic  competitiveness  due  to  poor  schools  and 
unskilled  workers.” 

One  installment  in  the  series  was  a mail-in  ballot  on 
which  readers  could  express  their  opinions  about  the  issues  raised 
therein.  If  readers  sought  education-related  questions,  they  had 
to  wait  until  the  second  section  of  the  ballot.  The  first  section 
asked  them  to  assign  ratings  to  “problems  that  some  people  say 
threaten  our  standard  of  living."  The  first  “problem”  was  “too 
much  government  regulation  of  business.”  The  second  “problem” 
was  “too  many  Americans  who  aren’t  willing  to  work  hard  any 
more.”  Not  until  the  fourth  “problem”  was  the  subject  of  schools- 
and-skills  even  raised,  and  that  was  a pause  on  the  way  to  “size 
of  the  federal  budget  deficit,”  “unfair  trading  practices  by  other 
countries”  and  the  indispensable  “demands  for  higher  wages  by 
American  labor  unions.” 

Talk  about  bias  in  testing!  Here  is  a summary’  of  the  con- 
temporary corporate  agenda,  dressed  as  an  appeal  for  belter 
schools.  And  getting  away  with  it.  This  identification  of  the 
desires  of  one  powerful  element  of  the  body  politic  with  the 
obligation  of  everyone’s  schools  hears  the  imprimatur  of  a pre- 
ponderance of  elected  officials  and  a born-again  host  of  edu- 
cators themselves. 

“Help  Wanted,”  sponsored  by  such  organizations  as  the 
Business  Roundtable  and  Business-Higher  Education  Forum,  was 

(omiinuol  on  fxx^e  12) 
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An  Investment  in  Knowledge  (commit 

thicket  of  rules  and  restrictions  so  that  teachers  can  be  empowered 
to  change  and  revitalize  school  programs. 

For  general  information,  Gordon  (1990)  states  that  since 
1983,  approximately  100,000  school-business  partnerships  have 
sprung  up.  That  is,  seven  partnerships  for  each  of  the  15,000 
school  districts  in  the  United  States.  These  companies  include 
American  Electric  Power,  Ameritech,  Amoco,  Capital  Holding, 
Caterpillar,  Eastman  Kodak,  Ford  Motors,  GenCorp,  Hewlett- 
Packard,  Procter  and  Gamble,  Rubbermaid,  and  Sears-Roebuck 
(Keehn,  1991). 

So  then,  how  can  these  business  people  help  education 
by  investing  in  knowledge?  Business  personnel  can  volunteer 
their  workers  and  pledge  financial  support  to  a school  or  school 
district.  Input  as  to  what  skills  are  necessary  to  be  employable 
in  todays  market  should  be  utilized  in  curriculum  planning. 
Business  people  can  also  share  their  expertise  with  educators 
on  planning,  training,  administering,  learning  technology,  and 
evaluating  performance  and  program  (Cranotta,  1991;  Herhily 
& Day,  1989).  When  businesses  band  together  to  form  coalitions 
or  foundations,  their  impact  can  be  felt  at  the  state  level  as  well, 
where  radical  change  to  the  roots  of  the  system  can  be  made. 

GenCorp  has  yet  additional  reasons  for  its  involvement. 
The  role  as  a corporate  citizen  is  taken  very  seriously.  GenCorp’s 
philosophy  regarding  community  relations  can  best  be  expressed 
by  Rip  Tilden,  Vice  President,  Communications. 

Like  many  companies  in  America,  we  are  coming  to 
realize  more  every'  day  the  powerful  impact  which  we 
have  in  the  communities  where  we  operate  our  plants  or 
maintain  offices.  GenCorp  is  a corporate  citizen  of  more 
than  25  communities  in  the  United  States. 

It  has  become  increasingly  apparent  to  us  in  recent 
years  that  our  actions  within  those  communities  have 
a significant  impact.  At  the  same  time,  the  economic, 
physical,  and  social  environment  in  which  we  operate 
has  a powerful  impact  on  our  future  success  as  a company. 

We  affect  the  quality  of  life  in  those  communities  and 
that  affects  our  success  as  a company. 

It  is  proper  for  us  as  a corporate  citizen  to  give  our 
time  and  money  to  meet  the  needs  of  the  communities 

where  we  operate One  of  the  powerful  tools  we  have 

available  to  us  in  addressing  community  needs  is  the 
GenCorp  Foundation ...  a vehicle  to  fund  charitable  and 
educational  organizations  supported  by  GenCorp  and 
its  employees. 

The  GenCorp  Foundations  highest  priority  is  the 
support  of  education. 

Giving  our  time  and  money  to  meet  the  needs  of  our 
communities  matters.  It  enables  us  to  contribute  to  the 
health  of  our  communities,  which  contributes  to  the 
health  of  our  company. 

Slightly  more  than  50  percent  of  the  GenCorp  Founda- 
tion’s $1.5  million  annual  contributions  arc  given  to  education. 

(onirmwcd  f\igc  23) 


Public  Education  is  Not  Their  Business  (continued) 

launched  with  a press  release  quoting  Indiana  University  Presi- 
dent Thomas  Ehrlich  as  exhorting  Americans  “to  meet  the 
challenge  of  creating  a skilled  workforce  in  regaining  the  com- 
petitive edge.1’ 

So  what’s  wrong  with  a patriotic  pep  talk  from  a leader 
in  higher  education?  Everything.  It  is  not  his  job— not  the  job 
of  any  professor,  teacher  or  principal— to  help  any  group  of  busi- 
nesses under  any  particular  flag  to  compete.  It  is  the  job  of  edu- 
cation to  nurture  thinkers  who  will  choose  their  work. 

Such  thinkers  would  of  necessity  be  skeptics.  They  would 
question  several  premises  of  the  business-driven  education  debate: 

—Whether  the  majority  of  Americans  can  benefit  from 
increasing  competitiveness  of  American  companies,  purchased 
as  it  is  with  such  hard  coinage  as  reduced  wages,  relaxes  pollu- 
tion controls  and  exportation  of  jobs: 

—Whether  growth  is  necessary  to  economic  health; 

—Whether  capitalism  is  the  only  economic  system  appro- 
priate for  the  United  States; 

—Whether  the  American  standard  of  living,  with  its 
voracious  appetite  for  oil,  soil,  water  and  other  natural  capital 
here  and  abroad,  if  not  already  high  enough;  and 

—Whether  we  truly  have  poured  money  into  our  schools 
(or  other  social  needs)  and  now  must  make  the  best  of  re- 
duced resources. 

The  last  two  assumptions  bear  an  especially  close  relation. 

I submit  we  have  rich  country,  a society  of  material  excess,  whose 
problem  is  not  insufficient  GNP  but  inequitable  distribution. 

In  an  article  in  the  September  1991  issue  of  Phi  Delta 
Kappan  examining  the  multiple  needs  of  high-risk  schoolchil- 
dren, Harold  Hodgkinson  wrote: 

Like  the  Reagan  administration  before  it,  the  Bush 
administration  has  made  a major  point  of  saying  that 
Americans  overspend  on  education.  ‘Throwing  money  at 
problems  will  not  make  them  go  away1  became  the  recur- 
rent litany  of  these  presidents  and  their  advisers.  However, 
the  data  they  cite  to  show  that  Americans  spend  more 
than  other  industrialized  nations  for  education  include 
figures  for  higher  education,  on  which  we  spend  a prodi- 
gious amount.  (The  United  States  has  5 percent  of  the 
world’s  elementary  and  secondary  students  and  25  percent 
of  the  world’s  higher  education  students.)  (p.  14) 

On  the  other  hand,  if  we  compare  the  percent  of  its  gross 
domestic  product  that  America  spends  on  K-12  education  with 
similar  expenditures  in  other  nations,  the  results  are  spectacularly 
different.  Even  with  the  difficulties  ot  establishing  ‘levels  of  effort’ 
for  different  nations,  it  is  clear  that  many  nations  invest  a larger 
share  of  their  wealth  in  their  children’s  education  than  we  do. 
“In  addition,  the  discrepancies  in  per-pupil  expenditures  within 
the  United  States  are  unmatched  by  any  nation  with  a centralized 
education  system.  In  many  states  in  the  U.S.,  the  amount  spent 
on  some  children  is  three  or  four  times  the  amount  spent  on 
children  in  the  same  stare  (Hodgkinson,  1991,  p.  13).“ 

(commut'd  on  frige  23) 
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Highlights  of  the  13th  Annual  Meeting  of 
the  MidWestern  Educational  Research  Association 


The  13th  annual  meeting  of  the  Mid -Western  Educa- 
tional Research  Association  met  October  16-19  at  the  Bismarck 
Hotel  in  Chicago.  The  program,  organized  by  MWERA  Vice- 
President  Ken  Kiewra,  featured  a number  of  new  activities  along 
with  the  traditional  conference  events. 

The  conference  officially  began  Wednesday  evening. 
After  the  preconference  training  workshops,  Joel  Levin,  Univer- 
sity of  Wisconsin-Mad ison  and-Editor  of  the  Journal  of  Educa- 
tional Psychology . presented  “Tips  for  Publishing  and  Professional 
Writing.”  His  paper  on  this  topic  will  appear  in  the  next  issue 
of  the  Mid-Westeni  Educational  Researcher.  On  Thursday  a special 
New  Member  Welcome  Session  introduced  first-time  members  to 
the  Association  and  the  conference.  Joel  Levin  presented  the 
keynote  address  on  Research  in  Classrooms  (see  article  on  page  2). 

The  first  invited  speaker  of  the 
conference  was  Annemarie  Pal  in- 
scar (left)  from  the  University  of 
Michigan.  Her  presentation  was 
"Enhancing  Scientific  Reasoning 
Through  Collaborative  Problem 
Solving”  She  noted  that  a num- 
ber of  reports  and  experts  have 
emphasized  the  need  to  improve 
the  instruction  of  science  and 
mathematics  in  our  schools.  She 
presented  the  following  wish  list 
for  science  instruction  distilled 
from  a number  of  sources: 

• Establish  a developmentally  sequenced  curriculum. 

• Provide  opportunity  for  cumulative  reference  which  builds 
knowledge  over  the  course  of  the  curriculum. 

• Focus  on  significant  and  important  science  content. 

• Take  a problem  rather  than  a process  or  tact  focused  approach. 

• Involve  students  in  the  generation  as  well  as  the  solution 
ot  problems. 

• Determine  outcomes  that  are  related  tv  1 society  as  well  as  science. 

• Use  instruction  that  is  anchored  in  the  lives  ot  the  learners. 

• Immerse  children  in  the  language  and  discourse  ot  science. 

Currently  Dr.  Palinscar  is  conducting  research  with  sixth 
grade  students  concerning  matter  and  molecules.  Although  the 
content  of  the  science  curriculum  remains  relatively  unchanged, 
design  and  explanation  problems  are  included.  The  instruction 
focuses  on  the  argumentation  and  explanation  of  problems  and 
possible  solutions.  Group  problem  solving,  including  social  norms, 
is  emphasized.  The  social  norms  include:  we  contribute  and 
help  others  to  contribute  to  the  group  work;  we  support  ideas 
by  giving  reasons;  we  work  to  understand  others’  ideas  through 
restatement  and  questioning;  and  we  build  on  one  another’s 
ideas.  Although  no  comparison*'  have  been  made  based  on  stand- 


ardized achievement  tests,  measures  of  conceptualizations  have 
favored  the  experimental  approach. 

During  Fri- 
day’s luncheon  the 
gavel  was  passed 
from  Ayres  D ’Costa 
to  new'  President 
Barbara  Plake  (far 
right).  Richard  Pugh 
assumed  the  role 
of  Vice-President 
(seen  below,  near 
right,  discussing 
next  year’s  confer- 
ence with  Piesident- 
Elect  Ken  Kiewra). 

Aw-ards  were  given 
to  the  34  charter 
MWERA  members 
that  are  still  active 
members.  Certifi- 
cates of  apprecia- 
tion were  given  to 
Donald  Cruick- 
shank,  Ohio  State 
University;  Adria 
Karle-Weiss,  Lake  Erie  College;  Sharon  McNeely,  Northeastern 
Illinois  University;  and  Isadore  Newman,  The  University  of 
Akron.  An  outstanding  service  plaque  was  given  to  MWERA 
Executive  Officer  Charles  Anderson  and  to  outgoing  President 
Ayres  D’Costa. 

The  luncheon  address  was  presented  by  Carole  Ames 
(pictured  below)  of  the  University  of  Illinois.  Her  topic  was 
“Enhancing  Student  Motivation”  She  began  by  stating  that 
motivation  involves  goals  ot  behaviors.  This  is  the  “why”  of 

student  behavior.  We  want  students 
to  be  focused  on  developing  new 
skills,  learning,  the  process  of  learn- 
ing, and  to  want  to  participate  in 
the  process  of  learning.  We  want 
them  to  have  a mastery  goal  orien- 
tation by  putting  forth  effort  in 
participating  in  learning.  The  class- 
mom  environment  shapes  learning. 
In  many  classrooms  the  focus  is  on 
the  students’  ability,  nor  their  ef- 
fort. This  leads  to  a valuing  of 
success  over  effort  or  real  learning, 
and  a valuing  of  normative  success  over  others. 
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MWERA  Annual  Meeting  Highlights  (continued) 


To  create  a mastery  learning  orientation  the  teacher  should: 

• use  tasks  that  are  diverse,  novel,  and  have  personal  challenge, 

• focus  on  the  process,  rather  than  the  product  of  learning, 

• set  goals  that  are  personally  relevant  and  meaningful  to 
the  students, 

• give  the  students  real  choices, 

• give  the  students  responsibility,  but  also  provide  them  with 
strategies  and  guidance, 

• avoid  public  recognition  such  as  awards  which  disenfranchise 
some  students  by  acknowledging  others, 

• make  students  feel  like  they  belong  in  the  classroom, 

• avoid  extrinsic  incentive  rewards  which  undermine  the  intrinsic 
value  to  tasks, 

• not  use  ability  grouping, 

• use  private  evaluation  which  is  based  on  progress  and 
mastery*,  and 

• understand  that  motivation  permeates  the  curriculum. 

She  went  on  to  suggest  that  changes  need  to  he  made  at 

the  school  level.  Principals  need  to  be  instructional  leaders. 

However,  we  may  not  be  able  to  change  the  schools  without 

changing  parents’  understanding  of  learning  and  motivation. 


Parents  need  to  be  given  information  to  facilitate  interactions  with 
their  children  concerning  academics  and  the  process  of  learning. 

Michael  Pressley; 
University  of  Mary- 
land, presented  a 
speech  on  transac- 
tional instruction 
after  participating 
in  a “Meet  the  Edi- 
tors” session  (see 
accompanying  arti- 
cle). Saturday  started 
with  a two-mile 
fun  run  around  the 
Chicago  lake  shore. 
Special  sessions  on  multicultural  education  were  featured  Saturday 
morning  with  invited  addresses  by  Richard  A.  Shweder,  Univer- 
sity of  Chicago,  and  James  Boyer,  Kansas  State  University.  (The 
next  issue  of  the  Mid-V&srem  Educational  Researcher  will  feature 
a special  section  on  multicultural  education. 


Michael  Pressley  holds  “court"  at  the 
Presidential  Reception. 


Transactional  Instruction 
of  Comprehension  Strategies 

By  Michael  Pressley,  University  of  Mary- land 


There  are  many  opinions  about  what  strategies-based 
instruction  is,  should  be,  or  could  be.  There  are  differing  con- 
ceptions of  what  happens  to  students  during  strategies  instruction 
and  of  the  role  of  the  teacher  in  that  process. 

At  one  extreme  are  those  who  view  any  cognitive  process 
instruction  as  necessarily  mechanistic  and  behavioral.  They 
contend  that  such  instruction  provides  the  child  with  an  explicit 
set  of  directions  about  how  to  perform  a task.  The  child  is  por- 
traveu  as  learning  a set  of  responses,  with  those  responses  ideally 
matching  the  responses  of  any  child  receiving  the  instruction. 
The  student  is  not  considered  an  interpreter  of  the  instruction, 
nor  someone  who  is  free  to  adapt  the  procedures  according  to 
their  needs  or  styles  or  the  demands  of  the  situation.  In  this 
model , the  teacher  is  equally  constrained  by  the  curriculum. 


The  ideal  curriculum  is  scripted  and  “teacher  proof.”  In  fact, 
instruction  might  best  he  computerized. 

At  the  other  extreme,  students  would  receive  little  or  no 
explicit  instruction  in  cognitive  strategies.  In  the  best  of  all  pos- 
sible worlds,  children  would  discover  the  cognitive  strategies 
they  need  to  function  competently  in  school  and  in  the  world  at 
large.  Those  subscribing  to  this  position  emphasize  complex, 
naturalistic  learning  environments  and  tasks,  albeit  ones  arranged 
so  that  children  will  be  likely  to  discover  how  to  complete  assign- 
ments competently.  This  is  done  largely  through  presenting  tasks 
that  are  in  the  student’s  “zone  of  proximal  development”  to  use 
Vygotsky's  term— that  is,  just  a bit  beyond  what  the  student  can 
now  complete  independently.  Adult-child  dialogues  as  children 
attempt  such  tasks  constitute  instruction  in  these  contexts. 


Transactional  Instruction  of  Comprehension  Strategies  (amtmued) 


Children  query  about  the  tasks  and  adults  respond  as  co-partici- 
pants,  providing  gentle  nudges  in  productive  directions  where 
discoveries  are  most  likely  to  occur.  Children  gradually  internalize 
these  exploratory  dialogues  with  adults  until  the  dialogues  become 
child 'generated  internal  cognitions  that  can  direct  behavior. 
When  that  occurs,  little  if  any  adult  prompting  is  required  for 
task  completion. 

1 have  never  accepted  either  of  these  extremes  as  repre- 
sentative  of  what  strategy  instruction  is,  should  be,  or  could  be 
(see  forthcoming  paper  in  Educational  Psychology  Review).  My  view 
is  that  even  the  most  explicit  of  strategy  instruction  involves 
unique,  individual  constructions  of  knowledge  and  processes. 
Similarly,  successful  discovery  learning  environments  necessarily 
include  more  explicit  instruction  than  constructivist  purists 
acknowledge.  Moreover,  effective  strategies  instruction  can  be 
based  on  an  explicit  curriculum  provided  by  external  authority. 
It  is  critical,  however,  that  the  curriculum  provide  sufficient 
freedom  for  the  teacher  to  maneuver  to  exploit  individual  learner 
needs  and  styles  in  specific  instructional  contexts.  The  curric- 
ulum generally  specifies  its  intended  effects  on  learners,  specific 
guidelines  about  what  to  teach  to  achieve  those  goals,  and  some 
general  guidelines  about  how  to  teach.  Within  these  guidelines, 
instruction  varies  considerably  with  a great  deal  of  creativity, 
adaptation,  interpretation,  and  construction  of  unique  under- 
standings by  both  teachers  and  students  as  instruction  continues. 

One  purpose  of  my  talk  was  to  provide  a concrete  example 
of  strategies-based  instruction  that  is  both  explicit  and  construc- 
tivist in  the  sense  I just  suggested.  A second  purpose  was  to  make 
clear  that  the  nature  of  such  instruction  varies  tremendously 
with  the  characteristics,  needs,  and  responses  of  the  children 
being  taught.  These  purposes  were  accomplished  by  present- 
ing information  about  a strategies-based  instructional  program, 
Students  Achieving  Independent  Learning  (SAIL),  under  devel- 
opment in  the  Montgomery*  County  MD  public  schools.  Both 
the  explicit  and  constructivist  elements  of  such  a program 
were  highlighted. 

The  designers  of  the  SAIL  program  assume  that  compe- 
tent reading  is  highly  strategic.  That  is,  while  good  readers  always 
read  for  meaning,  they  read  differently  in  different  contexts, 
depending  on  their  purposes  for  reading,  the  nature  and  difficulty 
of  the  text,  their  knowledge  of  the  world  to  which  the  text  refers, 
interest  in  the  text  being  read,  and  their  motivation  to  understand 
or  remember  the  content  being  read.  All  these  variables  make 
competent  reading  a decision-making  process.  Good  readers  make 
decisions  about  reading  rate  and  focus,  basic  processing  strategies 
(e.g.,  word-for-word,  skimming),  and  strategies  for  monitoring, 
problem-solving,  and  evaluation.  Good  readers  anticipate  what 
might  happen  in  a text,  evaluate  their  expectations  as  reading 
proceeds,  generate  questions  about  the  text,  visualize  its  con- 
tent, seek  clarification  when  confused,  identifying  main  ideas, 
and  selectively  attend  to  important  and  interesting  parts  of  the 
material.  Good  readers  are  generally  active  as  they  read,  making 


associations  between  their  prior  knowledge  and  content  en- 
countered in  text.  Good  readers  evaluate  the  text  (e.g.,  whether 
they  like  it,  whether  it  is  serving  its  intended  purpose).  Good 
readers  possess  extensive  metacognition  about  the  strategies  they 
use,  especially  recognizing  where  and  when  those  strategies  can 
be  applied  profitably.  Such  metacognition  is  crucial  to  the  regula- 
tion and  appropriate  use  of  the  strategies  learned  in  the  curriculum. 

SAIL  involves  explicit  instruction  in  these  processes  that 
comprise  capable  reading.  Thus,  students  are  taught  to  predict, 
visualize,  and  summarize  as  they  read.  Generally  active  processing 
of  text  is  stimulated  by  having  students  think-aloud  during  read- 
ing instruction,  with  associations  to  background  knowledge  en- 
couraged as  part  of  think-alouds.  Such  thinking  aloud  is  expected 
to  reduce  impulsive  responses  and  encourage  planning  prior  to 
and  during  reading.  This  use  of  language  to  support  cognitive 
actions  is  consistent  with  theoretical  positions  developed  by 
Vygotsky  as  well  as  Meichenbaum. 

Since  SAIL  students  always  receive  reading  instruction  in 
texts  at  or  about  grade  level,  problem-solving  strategies  emphasize 
dealing  with  difficult  words  when  reading  for  gist.  For  instance, 
w’hen  encountering  a new  word  in  text,  it  can  be  skipped,  con- 
text clues  can  be  used  to  infer  its  meaning,  the  reader  can  guess 
what  the  meaning  might  be,  or  the  reader  can  reread  for  addi- 
tional clues  to  meaning. 

Teachers  model  and  explain  these  comprehension  strate- 
gies as  part  of  regular  reading  group  lessons,  using  outstanding 
children’s  literature  from  trade  books,  magazines,  or  basal  reader 
anthologies.  A lesson  begins  w*ith  the  teacher  reading  first, 
thinking  aloud  about  how-  the  text  ought  to  serve  his  or  her  pur- 
poses and  how  its  content  and  structure  relate  to  prior  knowledge. 
The  teacher  may  make  predictions,  report  images  stimulated  by 
the  text,  or  note  consistencies  and  inconsistencies  between  text 
ontent,  text  structure,  and  reader  expectations.  Then  the  teacher 
invites  students  to  try  using  the  SAIL  procedures  with  the  text. 
Each  member  of  the  reading  group  takes  a turn  reading  aloud. 
Throughout  the  process,  student  interpretations  of  text  are  en- 
couraged. Reading  group  participants  are  thus  exposed  to  a variety 
of  interpretations  of  the  text  and  processes  for  constructing  and 
evaluating  those  interpretations. 

My  colleagues  and  I refer  to  the  type  of  instruction  ob- 
served in  SAIL  as  rransacticmal  strategies  instruction.  It  is  transac- 
tional because  what  happens  during  reading  group  is  co-detcr- 
mined  by  a teacher  and  student  in  interaction  with  a text  and  in 
particular,  the  interpretations  of  text  are  co-detennined  by  teacher- 
student-text  transactions,  much  as  specified  by  reader  response 
theorists  such  as  Louise  Rosenblatt.  Years  of  transactions  in- 
volving predictions,  questioning,  clarifications,  visualizations, 
associations,  and  summaries  are  intended  to  produce  indepen- 
dent, successful  readers  who  engage  in  such  processes  on  their 
own.  My  current  research  is  aimed  at  determining  whether  that, 
in  fact,  is  the  case. 
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Educational  Research  and  AERJ: 

An  Interview  with  Hilda  Borko 


By  Thomas  J.  Lasley 
University  of  Dayton 


What  are  some  of  the  major 
impediments  to  the  com 
duct  of  quality  research 
in  education? 

The  first  thing  that  comes 
to  mind  is  resources.  By 
resources  I mean  not  just 
money,  but  time  and  people. 
It  takes  a lot  of  time  to  do 
quality  research.  That  is  true 
whether  you  are  conducting 
experimental  work  or  quali- 
tative, interpretive  research. 
The  specific  nature  of  re- 
sources and  how  you  allo- 
cate those  resources  may 
vary,  but  basically  it  takes 
resources  to  do  research  and 
some  amount  of  financial 
support  is  often  necessary. 
Since  1980,  financial  sup- 
port has  become  less  available 
to  educational  researchers. 
So  it  is  more  difficult  to  do 
large  scale  research  now 
than  it  has  been  in  the  past. 


HiUa  Borko  is  a professor  at  the  University  of  Colorado. 
Her  current  research  interests  are  in  teacher  cognition  and  the 
interface  between  educational  psychology  and  teacher  education. 
She  has  recently  completed  work  on  an  NS F grant  on  learning 
to  teach  mathematics.  She  is  authoring  chapters  in  the  Handbook 
of  Research  in  Mathematics  Education  and  the  Handbook  of 
Educational  Psychology. 


Do  you  think  the  problem  of  limited  resources  is  evi- 
denced more  in  institutions  that  have  historically  had  a 
strong  research  thrust  than  it  was  15  to  20  years  ago?  Is 
the  resource  allocation  problem  going  to  hit  the  traditional 
research  universities  in  a more  dramatic  way? 

Yes,  and  one  thing  that  is  changing  now  is  the  availability 
of  internal  support.  A lot  of  state  universities  are  experi- 
encing financial  difficulties.  For  example,  at  the  Univer- 
sity of  Maryland  some  of  the  internal  resources  that  we 
were  able  to  get  in  the  form  of  graduate  assistanrships 
and  small  allocations  of  money  to  pay  for  materials  and 
participants  are  drying  up.  The  internal  support  is  going 
to  be  increasingly  problematic. 


L What  issues  would  you  like 
* to  focus  on  in  terms  of  edu- 
cational research  and  what 
kinds  of  manuscripts  would 
you  like  to  have  in  AERJ 
that  are  not  in  there  now? 

3 Five  years  ago  there  was  a 

call  for  increased  attention 

on  subject  matter  specific 
to  teaching  and  learning.  I 
agree  with  that  thrust.  For 
example,  in  my  own  current 
work  we  have  been  studying 
the  process  of  becoming  a 
mathematics  teacher.  We 
are  particularly  interested  in 
changes  in  novice  teachers’ 
knowledge  of  mathematics 
and  of  how  teachers  can  best 
represent  mathematical 
skills  and  concepts  to  their 
students.  I think  this  is  an 
4 area  that’s  getting  increasing 

trsity  of  Colorado.  attention,  and  I am  seeing 

>r  cognition  and  the  manuscripts  that  focus  on 

d teacher  education.  subject  matter  specific  teach- 

F grant  an  (earning  kig  an^  learning.  It’s  also  an 

ers  in  the  Handbook  area  that  needs  more  work, 

d the  Handbook  of  Another  area  that 

needs  attention  is  educa- 
tional diversity.  It  is  clear 
that  diversity  in  the  popula- 
tion of  learners  is  increasing.  We  need  more  research  on 
how  teaching  is  being  adapted  to  accommodate  these 
changes  and  how  teaching  can  be  adapted  even  more 
within  the  classroom  context.  A third  area  is  critical 
thinking  and  problem  solving— learning  critical  thinking 
and  problem-solving  skills  and  teaching  through  critical 
thinking  and  problem  solving.  For  example,  we  still  don’t 
know  very  much  about  the  processes  of  learning  how  to 
teach.  We  need  to  take  an  in-depth  look  at  what  novice 
teachers  look  like  and  how  they  differ  from  experts.  We 
don’t  know  or  have  a good  sense  of  the  process  that 
teachers  go  through  as  they  learn  to  teach.  That’s  the 
important  area  that  needs  work. 


(cun tinned  on  page  18) 
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An  Interview  with  Borko  (continued) 


Why  those  areas?  Why  did  you  identify  them? 


Looking  back  historically  and  seeing  what  we’ve  learned, 
research  has  taught  us  a lot  about  life  in  the  classroom.  I 
don’t  think  that  there  is  a burning  need  to  know  more 
about  teacher  behaviors,  but  we  do  need  to  know  more 
about  internal  cognitive  processes  such  as  teacher  and 
student  problem  solving,  critical  thinking  and  reflect ivity. 
We  just  don’t  know  as  much  about  these  “invisible”  pro- 
cesses  as  we  do  about  teachers’  observable  behaviors.  I also 
see  gaps  in  our  understandings  related  to  the  diversity  of 
learners  and  their  needs  in  terms  of  teaching  and  learning. 
It  is  hard  for  educational  research  to  keep  up  with  all  the 
significant  needs  that  exist. 


L Do  you  want  to  say  something  about  the  methodo- 
—I  logical  approaches  that  should  be  taken  in  approaching 
these  issues? 

3 I We  need  more  qualitative  research,  especially  on  teaching, 
— ' learning,  and  learning  how  to  teach.  In  the  latest  Handbook 
of  Research  on  Teaching  (1986),  there  is,  for  the  first  time, 
a chapter  on  qualitative  research.  That’s  an  indication  that 
the  perspectives  of  the  anthropologist  and  sociologist  are 
becoming  more  visible  in  educational  research.  They  offer 
orientations  toward  teaching  and  learning  processes  that 
an  educational  psychologist,  like  myself,  does  not  possess, 
and  I think  we  will  get  an  even  richer  understanding  if  we 
can  collaborate  and  work  together  on  problems.  The  other 
methodological  recommendation  would  be  more  collabora- 
tive research.  I see  a need  for  collaboration  between  the 
researchers  of  different  disciplines  and  for  collaboration 
between  researchers  and  teachers.  Again,  to  use  my  work 
as  an  example,  our  research  team  has  an  educational  psy- 
chologist, an  anthropologist,  and  mathematics  educators. 
I know  that  our  understanding  of  learning  to  teach  is  much 
richer  because  of  the  multiple  perspectives  we  bring  to 
the  project. 


Do  you  think  universities  are  willing  to  support  collabo- 
ration between  persons  in  the  different  disciplines?  1 
like  that  idea  but  it  seems  that  a lot  of  universities  find 
it  difficult  to  reward  collaboration* 


From  my  perspective,  the  major  difficulty  with  collabora- 
tion is  the  fact  that  people  are  really  coming  from  different 
places  using  different  languages  to  focus  on  related  issues. 
You  have  to  work  really  hard  together  in  order  to  do  good 
collaborative  research. 


Share  your  thoughts  about  the  quality  of  the  research  you 
are  receiving  for  AERJ.  Do  you  think  that  the  quality  of 
the  research  manuscripts  you  are  receiving  is  improving? 


3 I w^nt  to  answer  “yes,”  but  I’m  not  really  sure.  Part  of  the 

' ' reason  is  that  I am  surrounded  with  manuscripts.  It’s  hard 

to  judge  overall  quality  because  I read  so  many.  I can’t  step 
back  and  say  the  manuscripts  now',  as  a group,  are  qualita- 
tively better  than  the  manuscripts  we  received  in  the  past. 

I l I Many  people  feel  that  the  training  doctoral  students  have 

' ' received  recently  (during  the  1980s)  has  been  superior  to 

that  provided  back  in  the  1950s  and  1960s.  Do  you  agree? 

3 We  have  made  so  many  methodological  advances  and 

that  is  certainly  reflected  in  AERJ.  However,  I think  it’s 

an  oversimplification  to  say,  for  example,  that  quantitative 
research  which  uses  current  state-of-the-art  kinds  of  analysis 
is  necessarily  an  improvement.  Look  at  some  of  the  exem- 
plary’ process-product  studies  of  the  1970s.  For  w-hat  we 
knew  at  the  time  they  were  outstanding  pieces  of  research. 

1 don’t  even  know'  if  it’s  fair  to  compare  them  using  the 
same  criteria.  Certainly,  though,  the  methodological  ad- 
vances are  obvious. 

One  thing  that  I have  noticed  is  that  the  quality’  of 
manuscripts  varies  tremendously.  I have  received  a lot  of 
outstanding  manuscripts,  even  more  than  I can  accept.  And 
I’ve  received  manuscripts  on  the  other  end  of  the  spectrum. 
1 also  see  an  incredible  amount  of  variability  in  research 
paradigms  as  well  as  quality.  One  of  my  priorities  is  to 
enhance  the  variety’  of  the  available  research.  We  are  seeing 
more  good  research  with  a wider  variety  of  perspectives.  I’m 
seeing  good,  interpretative  research,  more  action  research, 
more  research  that  draws  upon  concepts  from  disciplines 
other  than  psychology.  From  my  perspective  as  an  editor, 
the  key  is  not  just  that  research  is  better  now;  the  greater 
variety’  is  also  important. 


One  last  question.  Do  you  see  that  there  is  too  much  of 
an  emphasis  on  research  and  scholarship?  Do  you  think 
that  teaching  is  de-valued  or  de-emphasized? 


3 That’s  a tough  question.  I think  that  the  answer  is  “yes,” 
— — ' in  a sense.  In  some  institutions  research  is  valued  and 

rewarded  to  a greater  extent  than  teaching.  But  I think  the 
answer  is  “no”  in  the  sense  that  expectations  for  the  amount 
of  teaching,  the  amount  of  service,  and  the  amount  of  re- 
search are  typically  the  same  for  all  faculty.  Unless,  of 
course,  there  is  external  funding  that  pays  for  faculty  time. 
I really  support  the  notion  of  differentiated  responsibilities. 
I believe  that  some  faculty  members  are  stronger  in  some 
areas  than  others,  and  given  the  nature  of  their  expertise 
they  have  more  opportuniries  in  some  areas.  For  example, 
when  I first  went  to  Virginia  Tech,  I was  amazed  at  all  of 
the  service  that  some  faculty  members  were  providing. 
People  in  reading  education  and  math  education  were 
constantly  called  for  workshops  or  inservice.  They’  had 
opportunities  that  I just  didn’t  have  its  an  educational 
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psychologist.  One  of  the  things  that  I don’t  see  happening 
is  the  opportunity  for  the  faculty  members  to  put  time 
and  energy  in  areas  where  their  skills  are  most  evident 
and  significant.  Faculty  members  should  be  regarded  for 
their  accomplishments  in  the  areas  they  choose  to  env 
phasize.  Hence,  for  faculty  members  who  are  strong  in 
service,  there  should  be  an  expectation  that  they  achieve 
as  much  as  their  colleagues,  but  to  do  it  in  service.  And 
the  faculty  member  who  wants  to  focus  on  teaching  should 
be  rewarded  for  excellence  in  that  area,  but  he  or  she 
should  have  different  teaching  loads  than  a faculty  mem- 
ber who  wants  to  focus  on  research.  Teaching  in  the  field 
and  working  as  a supervisor  or  a teacher  educator  in  the 
field  takes  an  enormous  amount  of  time.  It’s  more  than 
just  teaching  a course.  If  we  want  teacher  education  done 
right  we  have  to  recognize  and  reward  the  component  of 


teaching  just  as  we  recognize  and  reward  high  quality 
research.  One  person  does  not  have  enough  time  to  focus 
his  or  her  energy  on  all  the  areas.  1 know  that  this  idea 
is  hard  to  operationalize  so  that  it’s  done  fairly,  but  I 
think  it  is  something  we  should  work  on.  One  of  the 
arguments  against  this  sort  of  “role  differentiation”  is 
that  it  would  create  a class  society  where  the  researcher 
might  be  held  in  higher  esteem  than  the  teachers  who  are 
heavily  involved  in  teaching,  or  professors  who  focus  on 
service.  That  could  be  a possible  outcome,  but  1 don’t 
think  it  needs  to  be. 
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Abstract 

An  experimental  program,  eight  weeks  in  length,  on  mental  arithmetic  computation  was  conducted  with  fourth  grade  students 
(males,  N = 30;  females,  N = 21)  and  compared  to  a group  of  control  students  (males,  N = 18;  females,  N=26).  Pre-  and  post-tests  were 
conducted  on  both  arithmetic  problem  solving  and  arithmetic  computation.  For  both  types  of  tests  the  experimental  groups  performed 
significantly  higher.  Females  appeared  to  benefit  more  from  the  instructional  program  than  males,  suggesting  that  age-appropriate 
strategies  oould  be  beneficial  in  removing  stereotypes  in  lessened  female  mathematics  achievement. 


Introduction 

Mental  computation  skills  are  considered  by  professional 
groups  and  curricula  reviewers  as  important  aspects  for  citizen- 
ship today  (National  Science  Board  Commission  on  pre-College 
Education  in  Mathematics,  Science  and  Technology  [NSBC], 
1983;  National  Council  of  Supervisors  of  Mathematics,  1988; 
National  Council  of  Teachers  of  Mathematics  [NCTM],  1989; 
Reynolds,  1989;  Kutz,  1991).  The  new  curriculum  and  evalua- 
tion standaids  of  NCTM  (1989)  state  that  increased  attention 
should  be  placed  on  mental  computation  in  K-4  mathematics. 
The  current  emphasis  in  schools  on  this  topic,  however,  is  very 
limited  and  few  materials  or  research  efforts  exist  to  guide  teachers 
in  helping  students  develop  this  skill.  The  importance  of  mental 
computation  notwithstanding,  because  of  the  heavy  emphasis 
on  written  algorithms,  the  attention  to  instruction  in  mental 
computation  has  been  neglected  (Hazekamp,  1986;  Kutz,  1991; 
Reys  & Reys,  1986).  Mental  computation  is  seldom  encouraged 
or  suggested  in  many  basal  text  series  and  standardized  tests  do 
not  include  assessment  of  mental  computation  ability  (Flournoy, 
1967;  Maier,  1977;  NCTM,  1989;  Reys  & Reys,  1986). 

Like  many  other  aspects  of  school  mathematics  (e.g.,  set 
theory),  the  use  of  mental  computation  has  a history  of  prior 
usage;  mental  computation  was  an  integral  part  of  mathematics 
instruction  as  early  as  the  middle  of  the  19th  century  and  was 
woven  into  the  presentations  for  upper  elementary  grades  in  a 
1896  textbook  (Walsh,  1896).  However,  the  use  of  mental  arith- 
metic  had  few  advocates  in  the  early  20th  century  (exceptions 
were  Suzzallo,  1911  and  Smith,  1913)  and  a complete  reliance  on 
written  algorithms  became  the  norm  (Flournoy,  1957;  Reys,  1986; 
Reys  & Reys,  1986).  While  there  has  been  an  ebb  and  flow  in 
regard  to  emphasizing  mental  computation,  as  indicated  earlier, 
the  NSBC  and  NCTM  have  recently  recommended  their  stronger 


emphasis;  indeed,  many  of  the  newer  basal  texts  such  as  the 
Harcourt  Brace  Jovanovich  series  (Abbot  & Wells,  1987)  have 
recently  begun  incorporating  various  illustrations  of  mental 
computations. 

Gender  Differences 

Generally  speaking,  gender  differences  in  mathematics 
achievement  occur  (when  found)  after  fourth  grade  (Fennema, 
1974;  Hall  & Hoff,  1988).  Lloyd  (1983)  found  gender  differences 
favoring  males  in  grades  3 through  6,  though  low-ability  females 
generally  outperformed  low-ability  males.  Esquivel  and  Brenes 
(1988)  showed  that  Costa  Rican  male  students  scored  signifi- 
cantly higher  than  females  for  all  grades  tested  above  fourth 
grade  (6th,  7th,  10th  and  11th  grades). 

Strategies  have  been  used  to  reduce  or  eliminate  gender 
differences.  Berliner  and  Casanova  (1987)  showed  that  compe- 
titive activities  enhanced  male  learning  of  mathematics  in  grades 
four  and  five,  w’hereas  cooperative  activities  enhanced  female 
mathematics  learning.  Saltzen  (1981)  showed  that  females  scored 
higher  than  males  (p  < .01)  in  a program  with  continuous  student 
progress  including  individualized  or  modified  group  settings, 
wherein  the  pace  was  set  by  criterion  referenced  tests  and  a 
sequentially  coordinated  math  curriculum.  Females  in  traditional 
settings  scored  lower  than  all  other  groups.  Males  showed  little 
difference  regarding  outcomes  and  instructional  strategies. 

Method 

Two  classrooms  of  fourth  grade  students  were  selected  to 
be  involved  with  learning  mental  computation  as  an  emphasized 
port  of  their  mathematics  instruction.  Prior  to  the  beginning  of 
instruction,  a set  of  materials  worn  constnicted  to  guide  classnxmi 
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Gender  Differences  in  an  Experimental  Program  (continued) 


teachers  as  they  prepared  mental  computation  lessons.  Then 
sessions  were  conducted  with  the  teachers  involved,  explain- 
ing  the  rationale  for  mental  computation,  together  with  giving 
them  access  to  the  materials  and  help  with  using  the  materials 
for  instruction.  Two  classrooms  of  students  who  would  not  have 
specific  instruction  and  emphasis  were  chosen  as  controls.  All 
four  classrooms  were  from  a small  upper  midwest  city  (population 
approximately  7,200).  There  were  no  socioeconomic  differences 
between  the  experimental  and  control  groups;  most  students’ 
parents  were  working  class  or  middle  class;  ethnically,  the  students 
were  generally  of  Scandanavian  or  German  origin. 

A test  was  prepared  that  had  two  main  components;  a 
13-item  test  of  arithmetic  problem  solving  and  a 40-item  test 
of  arithmetic  computation.  An  example  of  the  arithmetic  prob- 
lem solving  is: 

“There  are  700  letters  and  315  postcards  to  be  delivered. 
How  many  more  letters  than  postcards  must  be  delivered?” 

An  example  of  the  arithmetic  computation  test  is:  604. 

-298 

Reliability  was  established  for  both  tests  through  the  use  of  the 
KR-20  (Kuder  &.  Richardson,  1937),  a measure  of  homogeneity. 
The  KR-20  was  calculated  for  both  the  arithmetic  problem  solv- 
ing and  arithmetic  computation;  thev  were,  respectively,  .78  arid 
.85 . The  pretests  were  administered  in  the  beginning  of  the  school 
year.  The  students  were  given  25  minutes  to  complete  the  arith- 
metic computation  test  and  10  minutes  to  complete  the  arith- 
metic problem  solving  test.  The  experimental  group  was  then 
given  5-10  minutes  of  systematic  instruction  and  practice  on 
mental  computation  each  day  for  eight  weeks.  The  control  group 
received  their  usual  instruction.  The  posttests  were  then  given. 

Results 

Tihles  1 and  2 report  the  results  of  the  analysis  of  co- 
variance (ANCOVA)  for  the  arithmetic  problem  solving. 
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Table  2 
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Both  method  differences  (p  .001)  and  gender  x method  inter- 
action (p  < .01)  are  significant.  Using  Tukcy’s  test,  the  female 
experimental  group  exceeds  the  female  control  group  (t  = 5.(sfr. 
p < .01),  the  male  control  group  (t  = 4.79,  p<*.01)  and  the  male 
experimental  group  (t  = 2.75,  p < .05)  in  regard  to  the  adjusted 
posttest  means.  The  male  experimental  group  also  exceeds  the 
female  control  group  (t  = 3.28,  p < .01).  The  significant  inter- 
action is  due  to  the  females  in  the  experimental  group  performing 
significantly  hotter  than  all  other  groups  (including  the  male 
experimental  group),  while  the  females  in  the  control  group  have 
the  lowest  adjusted  postfest  scores.  The  result  for  arithmetic 
computation  are  shown  in  Tihles  3 and  4. 
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Table  4 
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Gender  Differences  in  an  Experimental  Program  (continued) 


Again,  both  a method  difference  (p  < .01)  and  gender  x method 
interaction  (p  < .01)  are  found  in  regard  to  arithmetic  compu- 
tation. While  the  order  of  the  adjusted  posttest  scores  is  the 
same  as  was  found  for  arithmetic  problem  solving,  the  magni- 
tude of  the  differences  among  the  means  is  dissimilar.  For  arith- 
metic computation,  significance  (using  Tukeys  Test)  is  in  regard 
to  the  female  control  group  which  is  significantly  lower  than 
both  the  female  (t  — 3.42 , p < .01)  and  male  (t  = 5 .35 , p < .01) 
experimental  groups  and  the  male  control  group  (t =3 .00,  p< 
.05).  In  regard  to  the  interaction,  again,  the  females  in  the  con- 
trol group  are  the  lowest  scoring  gro^p  and  the  female  experi- 
mental group  is  the  highest  scoring  group  on  the  adjusted 
(and  nonadjusted)  posttest  means. 

Discussion 

Two  major  outcomes  are  seen  with  this  study.  First,  the  use 
of  systematic  instruction  in  mental  computation  has  positive 
effects  on  achievement  and  the  use  of  this  paKess  should  be 


more  broadly  encouraged.  Second,  and  in  one  sense,  the  most 
important  outcome  is  in  regard  to  the  gender  x method  inter- 
action. The  use  of  mental  computation  for  fourth  graders  appears 
to  be  significantly  more  helpful  to  females  than  males.  In  that 
most  research  on  mathematics  achievement  and  gender  tends 
to  show  higher  male  achievement,  the  present  study  has  shown 
that  females  have  benefited  more  than  males  from  exercises  in 
mental  computation.  Perhaps  such  age  specific  interventions 
with  appropriate  instructional  strategies  could  be  not  only  bene- 
ficial to  all  groups  of  students,  but  in  particular,  could  help 
reduce  the  purported  deficits  in  mathematics  achievement  asso- 
ciated with  females.  If  those  strategies  that  have  positive  effect 
on  female  mathematics  achievement,  such  as  mental  compu- 
tation, as  shown  here,  or  programs  such  as  continuous  progress, 
as  described  by  Saltzen  (1981)  were  to  be  instituted  as  a permanent 
part  of  mathematics  instruction,  rather  than  being  allowed  to 
fall  into  disuse,  then  mathematics  achievement  might  be  in- 
creased overall.  More  importantly,  achievement  of  females  could 
be  greatly  enhanced  perhaps  erasing,  with  time,  the  so-called 
gender  gap  in  mathematics  achievement. 
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An  Investment  in  Knowledge  (commit) 

Much  harder  to  quantify  are  the  hours  spent  by  GenCorp  volun- 
teers in  local  education  programs.  One  such  program,  GenCorp 
BEARS  (Business  Education  Alliance  to  Reach  Schools),  is  now 
in  its  third  year  and  is  a partnership  between  GenCorp,  a middle 
school  in  Akron,  and  The  University  of  Akron.  One  of  the  goals 
is  to  demonstrate  to  the  students  that  the  skills  they  are  learning 
in  school  are  needed  in  later  life,  whether  or  not  they  plan  on 
going  to  college.  Another  goal  is  to  encourage  students  to  stay  in 
school  longer  so  that  they  can  increase  their  skills  base.  Research 
done  during  both  of  the  first  two  years  of  the  program  indicates 
that  the  goals  have  been  met,  at  least  in  terms  of  student  response. 

The  program  creates  a mock  work  site  in  the  student 
cafeteria  for  two  class  periods,  once  a week  for  18  weeks.  Jobs 
are  created  based  on  skills  which  they  possess  at  the  sixth  grade 
level.  As  in  a real  job,  they  go  through  job  interviews,  they  get 
real  paychecks  which  they  can  cash  for  BEAR  BUCKS,  they  have 
a uniform  which  they  must  wear  to  work,  and  they  have  a year- 
end  annual  meeting  and  report.  The  President  of  GenCorp  has 
attended  this  year-end  meeting  the  past  two  years. 

The  long-term  plans  for  the  program  are  to  export  it  to 
other  GenCorp  facilities  as  well  as  to  other  schools  in  the  Akron 
area.  Although  it  has  just  taken  one  hour  and  20  minutes  of  class 
time,  the  program  has  meant  many,  many  hours  of  planning  on 
the  part  of  all  programs  and  their  partners. 

It’s  not  often  that  one  individual  in  a large  corporation 
can  feel  that  he/she  is  personally  having  an  impact  for  good  in 
the  community.  Granted,  as  part  of  a team,  everyone’s  role  is 
important  in  the  corporation  s efforts,  both  internally  and  exter- 
nally. But  in  this  education  program,  each  student,  parent,  edu- 
cator, and  business  person  involved  is  crirically  important  to  the 
program.  The  results  of  individual  efforts  are  gauged  with  each 
student.  Furthermore,  there  is  a measured  positive  impact  on  the 
students  as  they  report  that  they  have  more  reasons  for  staying  in 
school.  Yes,  business  personnel  should  be  involved  in  education. 
They  can  no  longer  afford  to  not  invest  in  knowledge. 

References 

Cranotta,  L.  J.  (1990,  June).  How  we  forged  an  alliance  for  science. 
Executive  Education,  p.  20. 

Gordon,  J.  (1990,  August).  Can  business  save  the  schools?  Training, 
pp.  19-27 

Herlihy,  J.  J.,  &.  Day,  W.  (1989).  With  corporate  help,  we’re  building 
the  schools  of  the  future  right  now.  The  American  School  Board 
Journal,  39-40. 

Keehn,  J.  (1991,  October).  How  business  helps  the  schools.  Fortune, 

pp.  161-180. 

MacDowell,  M.  A.  (1989,  October).  Partnerships:  Getting  a return 
on  the  investment.  Educational  Leadership,  pp.  8-11. 

Mason,  H.  (1991,  July-August).  Can  business  create  guerrilla  teachers? 
Across  the  Board,  pp.  27-30. 

Rennie,  J.  C.  (1989,  November).  Business  and  schools:  A dynamic 
duo.  Personnel,  pp.  40-44. 


Public  Education  is  Not  Their  Business  (continued) 

The  message:  Comparatively  speaking,  a nation  habitually 
and  fashionably  critical  of  its  schools  doesn’t  want  to  put  its 
money  where  its  mouth  is.  Where  is  the  money?  Perhaps  more 
than  evet  before,  it’s  at  the  top,  where  the  corporate  CEOs  live. 
According  to  a Congressional  Budget  Office  analysis  (Center 
For  Community  Change,  1990),  the  wealthiest  1 percent  of 
Americans  saw  their  annual  after-tax  income  rise  from  $174,500 
to  $303,900  between  1977  and  1988,  an  increase  of  74  percent. 
The  top  10  percent  enjoyed  a 27  percent  jump.  The  poorest  10 
percent  suffered  a decrease  in  average  income  of  9 percent.  Is 
it  any  wonder  homelessness  rose  in  this  period  and  urban  edu- 
cation declined? 

“The  point  is  that  there  is  a tremendous  amount  of  wealth 
being  made  by  the  top  20  percent  of  Americans— wealth  that 
results  in  large  part  from  public  investments  in  infrastructure, 
education,  health  care  and  welfare,”  the  Center  for  Community 
Change,  a national  assistance  organization  for  low-income  com- 
munity groups,  said  in  a 1990  report.  “But  this  growing  wealth 
is  not  being  adequately  taxed,  which  means  the  burden  falls 
increasingly  on  middle-income  taxpayers,  who  understandably 
often  lead  the  outcry  against  higher  taxes.” 

As  politicians  pander  to  these  voters,  the  constituency 
that’s  supposed  to  be  both  model  for  and  beneficiary  of  better 
schools  shirks  the  burden  of  materially  supporting  them.  The 
Center  for  Community  Change  report  cites  a study  placing  the 
United  States  below  20  of  22  industrialized  nations  in  total  taxes 
as  a percentage  of  output.  Even  granting  that  money  isn’t 
everything,  one  would  think  we  could  take  the  price  of  a few 
months’  untaxed  overseas  profits  or  a few  days  of  Operation 
Desert  Storm  and  fully  fund  Head  Start. 

If  corporate  America  truly  sees  an  education  system  in 
need  of  rescue  or  resurrection,  it  can  demonstrate  its  concern  by 
offering  to  help  bring  our  tax  outlay  to  the  level  of,  say,  Japan’s. 
Putting  up  its  share  of  the  money,  however,  would  not  entitle  the 
business  community  or  any  other  societal  interest  to  dictate  and 
narrow  the  role  of  education.  If  our  schools  were  incubators  of 
inquiring  minds,  it  is  doubtful  the  nation  would  have  tolerated 
the  shortsighted  social  priorities  of  its  government.  If  the  cur- 
rent pedagogy  of  competitiveness  continues  its  popularity,  we 
can  expect  to  hold  first  place  in  the  developed  world— in  such 
categories  as  infant  mortality  and  prison  population— and  to 
compete  for  last  in  investment  in  our  people. 
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Educational  Applications  of  the 
TFA  Counseling  System 

By  Ralph  O.  Mueller  and  Paula  J.  Dupuy 
The  University  of  Toledo 


Abstract 

How  an  individual  thinks,  feels,  and  acts  are  all  part  of  general  human  behavior.  Depending  on  the  specific  context,  a person 
might  approach  situations  by  emphasizing  more  the  Thinking  (T),  the  Feeling  (F),  or  the  Acting  (A)  component  of  behavior.  The 
TFA  system  considers  the  situation  specific  interaction  of  thoughts,  feelings,  and  actions;  it  provides  a systematic  way  to  assess  TF-A 
orientations  and  can  be  used  to  facilitate  effective  communication  between  individuals.  Originally  developed  as  a counseling  model, 
educators  in  school  settings  might  find  the  TFA  system  to  have  useful  applications  in  their  day-to-dav  struggle  of  balancing  their  roles 
as  content  deliverers,  mentors,  and  classroom  managers. 


The  purpose  of  this  paper  is  to  introduce  the  TFA  (Think' 
ing'Feeling'Acting)  behavior  model  to  educators  in  school  set- 
tings. The  model  might  be  beneficial  to  those  who  want  to 
explore  an  alternative  approach  to  student  behavior  assessment 
and  the  analysis  of  student-teacher  interactions  with  children 
mainly  in  grades  4 through  12.  Hutchins’  (1979,  1982,  1984) 
TFA  system  originally  was  developed  as  a counseling  model  to 
help  clients  achieve  therapy  goals.  The  major  tenet  of  the  model 
is  the  systematic  integration  of  the  cognitive  (Thinking),  affec- 
tive (Feeling),  and  behavioral  (Acting)  components  of  human 
functioning.  Depending  on  the  particular  problem  situation, 
a client  might  emphasize  primarily  the  Thinking,  Feeling,  or 
Acting  dimension,  and  the  counselor  should  select  an  appro- 
priate intervention  strategy  based  on  prior  knowledge  of  the 
client’s  orientation  (Hutchins,  1984). 

Hutchins’  TFA  model  is  just  one  of  a variety  of  counsel- 
ing approaches  that  defined  behavior  as  consisting  of  several 
dimensions  (e.g.,  Ellis,  1982;  Glasser,  1984;  Lazarus,  1981).  Many 
of  these  approaches  were  modified  and  adapted  to  educational 
settings.  For  example,  Glasser’s  (1984)  concept  of  “total  behavior” 
(Thinking,  Feeling,  Doing,  and  Physiologicing)  is  an  integral 
part  of  Reality  Therapy.  Over  the  last  two  decades,  this  approach 
has  been  applied  successfully  to  classroom  settings  as  suggested 
in  books  such  as  Schools  Without  Failure  (Glasser,  1969),  Control 
Theory  in  the  Classroom  (Glasser,  1986),  and  most  recently,  The 
Quality  School:  Managing  Students  Without  Coercion  (Glasser, 
1990).  To  our  knowledge,  however,  the  only  counseling  model 
that  systematically  considers  the  interaction  of  the  cognitive, 
affective,  and  behavioral  dimensions  is  Hutchins’  TFA  system. 
This  paper  was  written  with  two  main  goals  in  mind:  (a)  to  infor- 
mally introduce  educators  to  the  major  aspects  of  the  TFA  model 
and  (b)  to  spark  interest  in  further  research  on  possible  appli- 
cations of  the  system  to  a variety  of  educational  settings. 


A Summary  of  the  TFA  Counseling  System 

In  his  first  article  on  the  TFA  (Thinking-Feeling-Acting) 
system,  Hutchins  (1979)  defined  behavior  “as  including  how  a 
person  thinks,  feels,  acts”  (p.  529).  He  theorized  that  effective 
counseling  involves  addressing  client  concerns  in  all  three 
behavior  dimensions.  Built  on  this  Thinking-Feeling-Acting 
trichotomy,  he  proposed  defining  a client’s  behavior  in  a specific 
situation  as  having  either  a primarily  Thinking-Feeling,  Feeling- 
acting, or  Acting-Thinking  orientation.  Hutchins  (1979)  con- 
cluded that  counselors  should  take  these  differences  in  client 
behavior  orientations  into  consideration  when  selecting  inter- 
vention strategies. 

In  1982,  Hutchins  extended  the  TFA  model  to  classify  a 
variety  of  specific  counseling  theories  in  terms  of  their  relative 
emphasis  on  cognitive  (Thinking),  affective  (Feeling),  and 
behavioral  (Acting)  dimensions.  For  example,  while  Ellis’  (1971) 
rational-emotive  therapy  can  be  classified  as  a mainly  cognitive 
approach,  Roger’s  (1961)  client-centered  theory  uses  a more  affec- 
tive orientation  to  counseling.  Hutchins’  (1982)  classification 
system  was  developed  to  assist  the  counselor  in  selecting  appro- 
priate techniques  to  increase  the  probability  of  achieving  coun- 
seling goals.  The  selection  process  should  be  based  partly  on 
the  client’s  situation  specific  behavior  orientation  (Thinking- 
Feeling,  Feeling-Acting,  or  Acting-Thinking),  in  order  to  achieve 
a maximum  match  between  the  client’s  behavior  and  the  coun- 
selor’s intervention  strategy  (Hutchins,  1984). 

Since  Hutchins’  (1979,  1982,  1984)  theoretical  articles, 
the  TFA  system  has  been  applied  in  several  areas,  e.g.,  counselor 
education  (Hawkins,  1988;  Hutchins  & Cole,  1992),  student 
personnel  (Mueller  & Hutchins,  1991),  and  group  counseling 
(Clow,  Hutchins,  & Vogler,  1990).  In  the  educational  field, 
Vogler  and  Hutchins  (1988)  proposed  the  use  of  the  TFA  system 
in  assisting  parents  helping  their  10-  through  14-year-old  children 
complete  homework  and  develop  more  effective  study  habits. 
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Applications  of  the  TFA  System  (continued) 


Specifically,  they  suggested  a three-step  sequence:  (a)  assessing 
the  child’s  TFA  orientation  when  completing  homework  assign- 
ments,  (b)  identifying  the  child’s  behavioral  strengths  based  on 
this  TFA  assessment,  and  (c)  building  on  these  strengths,  helping 
the  child  to  utilize  more  latent  behavioral  dimensions  to  develop 
effective  learning  strategies. 

Vogler  and  Hutchins  (1988)  used  a triangular-shaped  figure 
to  graph  and  display  a child’s  TFA  behavior  pattern  for  a given 
situation.  Figure  1 shows  a TFA  Triangle  (bold  lines)  with  the 
dimensions  Thinking  (T),  Feeling  (F),  and  Acting  (A)  at  its  ver- 
tices. In  general,  the  assessment  of  TFA  orientations  is  broken 
down  into  four  steps: 

1.  On  the  T-A  axis  of  the  TFA  Triangle,  an  “x”  is  placed 
in  one  of  three  places  depending  on  whether  the  individual’s 
behavior  is  characterized  by  (a)  an  emphasis  on  the  thinking 
component,  (b)  an  emphasis  on  the  Acting  component,  or  (c) 
a balanced  Thinking-Acting  orientation. 

2.  On  the  A-F  axis,  an  “x”  is  placed  in  one  of  three 
places  on  the  continuum  depending  on  whether  the  persons 
behavior  is  characterized  by  (a)  mainly  the  Acting  component, 
(b)  mainly  the  Feeling  component,  or  (c)  equally  emphasizing 
both  Acting  and  Feeling. 

3.  On  the  FT  axis  of  the  TFA  Triangle,  an  “x”  is  placed 
in  one  of  three  places  depending  on  whether  behavior  is  charac- 
terized by  (a)  primarily  the  Feeling  component,  (b)  primarily  the 
Thinking  component,  or  (c)  a balance  between  the  Feeling  and 
Thinking  dimensions  of  behavior. 


Figure  1 


4.  Finally,  the  three  marks  (x)  that  were  placed  on  the 
TFA  Triangle  are  connected  to  form  the  TFA  Triad  (Figure  l, 
shaded  triangle),  indicating  the  individual’s  behavior  orientation. 

For  example,  the  Triad  in  Figure  1 could  represent  a child’s 
TFA  orientation  when  parents  are  confronted  with  math  home- 
work completion  problems.  Note  the  relative  emphasis  on  the 
Feeling  and  Thinking  components  coupled  with  a relative  absence 
of  the  Acting  dimension.  The  child  might  feel  anxious,  over- 
whelmed, or  just  bored  when  confronted  with  a particular  math 
assignment  that  is  due  the  following  day.  The  child  may  think 
about  the  problems  and  the  deadline  but  seems  to  vacillate 
between  the  Thinking  and  Feeling  realms  without  ever  really 
getting  started  on  the  assignment.  This  relative  absence  (latency) 
of  the  Acting  dimension  of  behavior  needs  to  be  addressed  to 
help  the  child  complete  the  assignment.  Hutchins  and  Vogler 
(1988)  suggested  that  one  way  to  approach  the  development  of 
the  latent  dimension  is  to  build  on  the  child’s  strength(s)  (the 
dominant  TFA  component[s]).  In  the  above  example,  parents 
could  build  on  the  child’s  Feeling  dimension  by  listening  em- 
pathically  and  validating  the  child’s  emotional  experience.  In 
addition,  they  could  ask  the  child  to  verbalize  their  thoughts 
and  analyses  of  the  assignment,  thus  using  the  strength  of  the 
Thinking  component  within  the  child’s  current  behavior.  Finally, 
the  introduction  of  the  latent  dimension  (Acting)  might  be  ac- 
complished by  structuring  the  assignment  into  smaller,  more 
approachable  sections,  helping  the  child  to  actually  begin 
the  assignment. 

In  addition  to  the  procedure  suggested  by  Vogler  and 
Hutchins  (1988),  the  assessment  of  TFA  orientations  of  adoles- 
cents and  adults  can  be  completed  more  formally  by  using  the 
Hutrhins  Behavior  Inventory  (HB1)  (Hutchins,  in  press).  Initial 
validity  and  reliability  evidence  suggests  that  this  instrument 
consistently  measures  individuals’  Think ing-Feeling-Acting  orien- 
tations (Mueller,  Hutchins,  & Vogler,  1990;  Wheeler,  1986). 
Briefly,  the  development  of  the  two  main  scales  of  the  HBI  fol- 
lowed four  steps  (also  see  the  HBI  manual,  Hutchins  & Mueller, 
in  press).  First,  a list  of  carefully  chosen  words  characterizing 
primarily  thinking  (T),  feeling  (F),  or  acting  (A)  persons  was 
compiled  (Walker,  1984).  Second,  each  word  in  one  category 
(T,  F,  or  A)  was  paired  with  each  word  in  the  other  two  categories. 
This  resulted  in  a total  of  75  word -pairs,  25  pairs  in  each  of  three 
combinations:  tninking-Feeling  (T-F),  Feeling-Acting  (F-A),  and 
Acting-Th inking  (AT).  For  example,  the  word -pair  “rational- 
emotional”  represents  the  T-F  category,  “sensitive-doing”  the 
F-A  category,  and  the  pair  “decisive-logical”  represents  the 
A-T  category. 

Third,  three  bipolar  scales  (Tf,  Fat  and  At)  were  developed 
to  measure  the  degree  of  interaction  of  the  behavior  components, 
Thinking,  Feeling,  and  Acting.  Scores  on  the  Tf  scale  signify 
how  many  T words  were  chosen  in  the  T-F  category  of  word-pairs; 
the  Fa  scale  indicates  how  many  F adjectives  were  chosen  in  the 
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Applications  of  the  TFA  System  ( continued) 


FA  category;  and  scores  on  the  At  scale  indicate  the  number  of 
A words  chosen  from  word-pairs  in  the  AT  category.  Scores  on 
the  bipolar  scales  can  be  used  to  obtain  a person’s  TFA  Triad  for 
a particular  situation  by  labeling  each  TFA  Triangle  axes  from  0 
to  25  and  plotting  and  connecting  bipolar  scores  (see  Figure  1). 
Fourth,  respondents  were  asked  to  indicate  how  characteristic  a 
chosen  adjective  is  of  their  behavior  in  the  a priori  specified 
situation:  somewhat,  moderately,  or  very  characteristic.  This  led 
to  the  definition  of  three  characteristic  scales  (1c,  Fc,  and  Ac) 
that  were  designed  to  provide  some  information  regarding  be- 
havior intensity  in  each  of  the  three  areas,  Thinking,  Feeling, 
and  Acting. 

Overall,  the  HBI  was  designed  for  healthy  and  normal 
individuals  with  a lOth-grade-reading  level.  The  administration 
of  the  instrument  should  take  no  longer  than  15  minutes,  and 
the  test  can  be  both  hand-scored  or  machine-read.  The  results 
from  an  HBI  assessment  can  be  interpreted  by  the  teacher  who 
is  familiar  with  the  TFA  system  or  more  formally  analyzed  by 
the  publishing  company. 

Possible  Applications  to  Education 

Even  though  the  development  of  the  TFA  system  is  fairly 
recent,  applications  of  the  model  are  expanding  in  the  area  of 
counseling  (e.g.,  student  personnel:  Mueller  Hutchins,  1991; 
spouse  abuse:  Clow,  Hutchins,  &.  Vogler,  1990).  Currently,  Parents 
as  Tutors  (Vogler  &.  Hutchins,  1988)  is  the  only  publication  that 
includes  suggestions  to  apply  the  TFA  system  in  an  educational 
setting.  However,  the  attempt  to  integrate  modalities  of  behavior 
of  different  individuals  in  different  situations  is  of  concern  to 
educators  as  well  as  counselors.  In  the  following  paragraphs,  two 
possible  classroom  applications  of  the  TFA  system  are  suggested: 
student  behavior  assessment  and  student-teacher  interactions. 
In  addition,  the  TFA  system  could  be  utilized  as  a conceptual 
model  and  set  of  techniques  for  other  educational  programs. 

Consider  the  case  of  17-yearold  Mark  who  exhibits  school 
behaviors  that  are  related  to  class  disruptions,  underachievement, 
and  low  self-esteem.  In  general,  Mark  could  be  described  as  being 
compassionate,  sympathetic  to  others,  assertive,  and  persuasive. 
However,  in  school,  Mark  is  often  sullen,  resentful,  impulsive,  and 
bossy.  He  usually  has  trouble  concentrating  and  often  approaches 
assignments  impulsively  without  thinking  them  through.  Mark’s 
behavior  orientation  could  be  assessed  either  formally  with  the 
HBI  or  informally  by  using  the  three-point  TFA  Triangle,  as  sug- 
gested by  Vogler  and  Hutchins  (1988).  Mark’s  TFA  Triad  is  shown 
in  Figure  2.  Note  the  relative  absence  of  the  Thinking  com- 
ponent but  the  emphasis  on  the  Feeling  and  Acting  dimensions 
of  Mark’s  behavior. 

His  teacher,  Ms.  Hayes,  has  tried  unsuccessfully  to  help 
Mark  overcome  his  difficulties  in  school.  She  teaches  science 
and  works  hard  at  presenting  material  in  interesting  and  stimu- 
lating ways.  Ms.  Haves’  approach  to  teaching  is  content  oriented, 


methodical  and  organized,  and  highly  structured.  When  students 
are  experiencing  problems  with  specific  class  material,  Ms.  Hayes 
is  quick  to  offer  advice,  usually  in  the  form  of  additional  read- 
ings, experiments,  or  study  techniques.  Her  TFA  orientation 
with  regard  to  her  interaction  with  students  is  also  shown  in 
Figure  2.  Note  the  emphasis  on  the  Thinking  and  Acting  com- 
ponents with  a simultaneous  absence  of  the  Feeling  dimension. 

In  this  example,  the  Acting  component  of  behavior  is  a 
primary  dimension  for  both  student  and  teacher  (note  the  over- 
lap of  the  two  TFA  Triads  in  Figure  2)  while  the  Thinking  and 
Feeling  component  is  a secondary  (latent)  dimension  for  Mark 
and  Ms.  Hayes,  respectively.  In  the  science  laboratory',  Mark  is 
able  to  follow  Ms.  Hayes’  action-oriented  directions  and  actually 
enjoys  completing  designated  tasks.  However,  when  Ms.  Hayes 
teaches  within  a mainly  cognitive  and  theoretical  framework, 
Mark’s  inappropriate  behavior  tends  to  increase.  She  responds 
to  his  sullen  and  resentful  attitude  (Mark’s  primarily  Feeling 
orientation)  with  several  attempts  to  make  the  content  more 
interesting  (Ms.  Hayes  primarily  Thinking  orientation).  For  the 
most  part,  however,  these  attempts  are  unsuccessful.  The  com- 
munication between  Mark  and  his  teacher  seems  to  break  down 
since,  in  this  situation,  Mark  is  operating  primarily  from  the 
Feeling  component  and  Ms.  Hayes  is  responding  with  a primarily 
Thinking  orientation. 

Writing  about  the  counseling  process,  Hutchins  (1984) 
suggested  tha  ' e counselor  should  address  the  client’s  particular 
behavior  orientation  to  avoid  this  type  of  communication  break- 
down. In  the  above  example,  Hutchins’  recommendations  would 
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Applications  of  the  TFA  System  (continued) 


translate  into  Ms.  Hayes  building  on  Mark’s  Feeling-Acting  orien- 
tation (acknowledging  feelings  and  praising  appropriate  actions) 
to  develop  strategies  that  increase  the  utilization  of  his  more 
latent  behavior  dimension  (Thinking).  More  generally,  the  TFA 
system  might  assist  teachers  when  they  encounter  interaction/ 
communication  difficulties  with  individual  students.  The  model 
appears  to  provide  a convenient  and  useful  way  to  assess  the 
interaction  of  a persons  behavior  components  (Thinking,  Feeling, 
and  Acting)  and  to  help  the  teacher  develop  effective  interven- 
tion strategies.  Also,  awareness  of  differences  in  TFA  behavior 
orientations  across  several  students  and  a variety  of  situations 
offers  the  teacher  an  additional  way  of  conceptualizing  individual 
differences  within  the  classroom. 

Finally,  the  TFA  system  could  be  used  as  a self-exploration 
technique,  helping  students  to  better  understand  themselves 
and  their  ways  of  behaving  in  different  situations.  More  specifi- 
cally, teachers  involved  with  undertakings  such  as  peer  coun- 
seling, teacher  advisory  and/or  drug  education  and  prevention 
programs  could  introduce  the  TFA  model  as  an  easy  to  use  system 
to  identify  primary'  and  latent  behavior  components.  Within  these 
programs  the  use  of  the  system  might  serve  as  another  useful 
technique  in  the  development  of  flexibility,  decision  making, 
and  communication  skills.  However,  extensive  research  is  needed 
to  evaluate  the  effectiveness  and  identify'  additional  potential 
applications  of  the  TFA  system  in  the  educational  setting. 

Summary 

Although  originally  developed  and  researched  in  the 
counseling  discipline  (Hutchins,  1979,  1982,  1984),  the  TFA 


system  appears  to  provide  a useful  model  for  educators  in  the 
classroom.  Within  this  model,  behavior  is  defined  as  the  inter- 
action of  Thinking,  Feeling,  and  Acting  (Hutchins,  1979).  These 
T-F-A  orientations  are  situation  specific  and  can  be  assessed 
either  with  the  Hutchins  Behavior  Inventory  (HBI)  (Hutchins, 
in  press)  or  with  a more  informal  procedure  first  suggested  by 
Vogler  and  Hutchins  (1988).  Within  the  counseling  literature, 
development  of  the  TFA  and  HBI  approach  to  behavior  assess- 
ment led  to  applications  in  areas  such  as  school  counseling 
(Hutchins,  1979),  spouse  abuse  (Clow,  Hutchins,  & Vogler,  1990), 
and  student  personnel  (Mueller  &.  Hutchins,  1991). 

In  education,  Vogler  and  Hutchins  (1988)  were  the  first 
to  suggest  that  parents  could  use  the  TFA  system  to  assist  their 
children  with  homework.  The  current  paper  dealt  with  the  appli- 
cation of  the  model  in  school  settings.  More  specifically,  the 
assessment  of  students’  TFA  orientations  could  be  used  to  help 
conceptualize  behavior  as  well  as  teacher-student  communica- 
tion problems  and  to  select  appropriate  intervention  strategies. 
Furthermore,  the  TFA  model  might  be  helpful  in  peer  counseling 
and  other  affective  or  decision-making-skill  programs.  Although 
much  of  the  theoretical  and  research  literature  on  the  TFA  system 
has  focused  on  individuals  or  dyads,  it  seems  that  the  model  has 
value  with  groups  as  well  (see  Clow,  Hutchins,  & Vogler,  1990, 
for  a group  counseling  application).  In  both  educational  and 
therapeutic  settings,  however,  more  extensive  research  is  needed 
for  this  specific  application.  In  our  opinion,  the  TFA  system 
warrants  further  attention  and  investigation  in  school’s  and  other 
educational  settings. 
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Voices  in  Education 


The  Mid-Western  Educational  Researcher  asked  leaders  in 
education  to  respond  to  the  question: 

What  changes  in  how  we  educate  our  children  do  you  see  as 
necessary  to  deal  with  meeting  the  challenges  of  the  future? 


We  need  to  help  children  learn  to  deal  with  problems 
not  simply  by  assigning  problematic  tasks  to  them  in  school, 
but  by  giving  them  opportunities  to  formulate  their  own  goals 
and  to  work  out  strategies  for  their  achievement. 

—Elliot  Eisner,  Stanford  University 


1 would  begin  my  search  for  an  answer  to  this  question  by 
reading  the  educational  scholars  of  the  1920s,  1930s,  and  early 
1940s.  I believe  you  can  find  an  insightful  and  detailed  discussion 
of  virtually  every  problem  we  are  facing  today  in  this  literature. 

— L orin  Anderson,  University  of  South  Carolina 

Stop  pushing  academics  down  the  grade  levels.  Try  to 
preserve  childhood.  Provide  social  and  educational  services 
at  one  site.  —David  Berliner,  Arizona  State  University 


Attention  to  individual  differences.  Greater  focus  on 
higher  order  thinking,  problem  solving,  and  teaching  for  con- 
ceptual  understanding.  -Hilda  Boric o,  University  of  Maryland 

We  must  recognize  that  community  building  and 
community  maintenance  (and  learning  how  to  do  so)  are  much 
more  important  than  amassing  soon-to-be-obsolete  knowledge, 
information,  and  technical  skills. 

— Christopher  Cbrk,  Michigan  State  University 

The  old  saws,  but  not  yet  heeded . . . reduce  class  size, 
foster  teacher  creativity7,  alternative  ways  of  reaching  kids/instruct- 
ing,  really  use  the  power  of  the  electronic  age. 

— Lyn  Como,  Teachers  College  Columbia 

More  attention  to  personal  development  and  to  fostering 
the  motivation  to  learn  and  to  be  effective,  rather  than  the  obses- 
sion  with  achievement  scores. 

—Edward  Deci,  University  of  Rochester 


Education  is  in  dire  need  of  greater  levels  of  support, 
both  financial  and  personal,  from  private  and  especially  from 
government  agencies.  —Thomas  Guskey,  University  of  Kentucky 

Reaffirming  of  a moral  mission  of  schools.  Smaller  school- 
communities.  More  authority  and  better  training  for  teachers. 

— Kevin  Ryan,  Boston  University 

We  need  to  organize  our  schools  to  allow  for  flexible 
scheduling  and  integration  of  subject  areas.  Technology  must  be 
embedded  in  every  aspect  of  school  life.  Teachers  must  be  more 
aware  of  cultural  differences  and  bridge  the  gap  between  chil- 
dren's background  knowledge  and  what  is  to  be  learned  in 


the  curriculum. 


- Jane  Stallings , Texas  A&M  University 


Changes  furnished  by  relevant  research. 

—Ralph  Tyler,  Center  for  Advanced 
Study  in  Behavioral  Sciences 

Increase  school  year  to  220-240  days.  Formulate  national 
educational  goals.  Make  use  of  superior  instructional  techniques, 
provide  parent-education  programs. 

—Herbert  Walberg,  University  of  Illinois  at  Chicago 

Both  parents  and  teachers  need  to  gain  more  significant 
roles  in  determining  key  school  policies.  Much  of  what  cur- 
rently exists  under  the  banner  of  site-based  management  does 


not  do  this. 


— Kenneth  Zeichner,  University  of  Wisconsin 
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MWERA  Research  Exchange 

The  following  is  a list  of  research  interests  for  some  of  the  membership  of  the  Mid-Western  Educational  Research  Association. 
Please  write  to  request  information  or  to  inform  the  member  of  your  ability  to  provide  information  or  services.  Please  note  the  following  key: 


pi  = 1 can  provide  information  and  references  in  this  area 
ps  = I can  provide  access  to  subjects  in  this  area 
pd  j=  I can  provide  skills  in  analysis  or  design  in  this  area 
sa  = I am  seeking  a coauthor  and/or  assistance  in  this  area 


si  = I am  seeking  additional  information  in  this  area 
sr  = I am  seeking  research  design  or  statistics  information 
ns  = I need  additional  subjects  in  this  area 


Administrative  recruitment  and  selection (pi,  si) 

Charles  Kline,  Educational  Administration,  G-10  S.  Campus  Ct.  PU,  West  Lafayette, 
IN  47906. 


Assessment  of  primary  school  children (ps,  pd,  sa) 

David  Way,  719  Maple  Ridge  Drived  Cincinnati,  OH  45150 

Beliefs  and  attitudes  in  teaching (pi,  pd,  si,  ns) 

Greg  Marchant,  Educational  Psychology,  Ball  State  University,  Muncie,  IN  47306 

Beliefs  and  performance  of  preservice  teachers (sa,  si) 

Carol  Muskin,  1928  W.  Morse  41,  Chicago,  IL  606 26 

Board  of  education  decision  making (pi,  pd,  sa,  si,  sr,  ns) 

Linda  Lyman,  Bradley  University,  308  Westlake  Hall,  Peoria,  1L  61625 

Career  indecision,  antecedents  of  career  choice (pi,  si,  sr) 

Paul  J.  Hartung,  218  Bowman  Drive,  Kent,  OH  44240 

Chronic  illness  in  children,  psych,  dev.  and  education (pi,  sa,  si) 


Cynthia  DietericlvMiller,  1983  E.  24th-Rhodes,  CSU,  Cleveland,  OH  44115 


Computers  as  tool  for  instruction,  LOGO  for  math/geometry  . ...  (pi,  pd,  sa,  si) 
Mian  M.  Yusuf,  Teacher  Ed.,  UW-Parkside,  Box  2000,  Kenosha,  W1  53141 


Cooperative  teaching  in  mathematics (sa,  si) 

Mian  M.  Yusuf,  Teacher  Ed.,  UW-Rirkside,  Box  2000,  Kenosha,  W1  53141 


Creativity,  assessment  and  enliancement (pi,  pd,  si,  sr,  ns) 

Albert  Bugaj,  Psych.,  UW-Marinette,  750  W.  Bay  Shore,  Marinette,  WI  54143 


Discipline  and  curriculum  design,  high  school (pi,  ps.  pd,  sa,  sr,  ns) 

Arthur  T.  Vrettas,  24376  Fairway  Hills  Drive,  Novi,  Ml  48374 

Educational  administration,  H.S.,  multicultural  population (ps,  pd,  sa,  sr) 

Arthur  T.  Vrettas,  24376  Fairway  Hills  Drive,  Novi,  MI  48374 

Generaliiability  theory,  equating  and  scaling  (pi,  pd) 

Robert  L.  Brennan,  ACT,  RO.  Bax  168,  Iowa  City,  1A  52243 

Gifted,  career  development pd,  si,  st,  ns) 

Albert  Bugaj,  Psych.,  UW-Marinctte,  750  W.  Bay  Shore,  Marinette,  WI  54143 

Learning  opportunity  differences (pr.  sa) 

Carol  Muskin,  1928  W.  Morse  41,  Chicago,  IL  60626 

Mnemonic  learning  strategy  applications (pi,  ps,  pd) 

Russell  N.  Carney,  Psych.,  SW  Missouri  State  University,  Springfield,  MO  65804 


Multicultural  education,  culturally  responsible  pedagogy (pi,  ps,  pd,  si,  sr) 

Tonya  Huber,  Education,  Box  28,  Wichita  State  University,  Wichita,  KS  67208 

Multiculturai/equity  education,  K-12,  teacher  ed-  (pi,  ps,  pd,  si,  sr,  ns) 

William  G.  Spa ks  III,  101B  McCormick  Hall,  1SU,  Normal,  Illinois  61761 

Mulriailtural/urban  settings,  problems  faced  by  teachers (pi,  pd,  si,  ns) 

Deborah  L.  Bainer,  OSU-Mankield,  1680  University  Drive,  Mansfield,  OIT44906 

Observation  as  a pedagogical  skill (pt.  ps,  si) 

Pamela  Allison,  Sch  of  HPER,  Bowling  Green  State  University,  Bowling  Green, 
OH  43403 

Perceptions  regarding  higher  education (si,  ns) 

Linda  H.  Chiang,  1100  E.  5th  Street,  Anderson  University,  Anderson,  IN  46012 

Performance  evaluation  of  classroom  teaching (pi,  pd,  so,  ns) 

David  Way,  719  Maple  Ridge  Drive,  Cincinnati,  OH  45150 

Preparation  of  pre-  and  in-service  teachers  in  assessment (pi,  ps,  pd,  sa) 

Cynthia  Dieterich-Miller,  1983  E.  24th-Rhodes,  CSU,  Cleveland,  OH  44115 


Representation  use (pt,  pd,  sa,  si,  sr) 

Rcinhaid  Lindner,  Educ.,  Horrabin  Hall  80,  W.I.U.,  Macomb,  IL  61455 

Self-concept  in  beginning  teachers,  induction  programs (ps,  si) 

Linda  H.  Chiang,  1100  East  5th  Street,  Anderson  University,  Anderson,  IN  46012 

Self-concept/self-esteem  and  teacher  effectiveness  (ps,  sa,  si,  sr) 

William  G.  Sparks  III,  101  B McCormick  Hall,  ISU,  Normal,  Illinois  61761 


Self-regulated  learning ' (pt,  pd,  sa,  si) 

Reinhard  Lindner,  Educ.,  Horrabin  Hall  80,  W.I.U.,  Malcomb,  IL  61455 

Structural  equation  modeling  (LISREL),  path  analysis (pi,  pd) 

Ralph  O.  Mueller,  Educational  Research,  University'  of  Toledo,  Toledo,  OH  43606 

Supervision  of  instruction  (pt,  si) 

Ralph  O.  Mueller,  Educational  Research,  University  of  Toledo,  Toledo,  OH  43606 

Teacher  support  behaviors  and  interactions (pt,  si) 

Deborah  L Bainer,  QSU-Mansfteld,  1680  University  Drive,  Mansfield,  OH  44906 


Testing,  bias,  Iegal/validity  aspects  in  credential  exam (pt,  pd) 

Ayres  D’Costa,  287  Arps  Hall,  1945  N.  High  Street,  OSU,  Columhus,  OH  43210 
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The  Mid-Western  Educational  Research 
Association  (MWERA)  is  a nonprofit  organi- 
zation of  professional  educational  researchers 
primarily  from  states  and  provinces  located  in 
the  midwestem  region  of  the  United  States  and 
Canada.  Membership  is  open  to  faculty,  stu- 
dents, and  administrators  from  any  university, 
college,  and  school.  College  students  engaged 
in  educational  research  are  especially  encour- 
aged to  join  as  members.  Also  any  educational 
researchers  in  business  and  industry,  as  well 
as  those  in  national,  state,  local  and  private 
agencies  and  organizations  are  welcome.  The 
Association  promotes  and  disseminates  edu- 
cational research  through  its  publications,  its 
scholarship  program,  and  its  Annual  Meeting. 


MWERA  Membership  Application 


Namgjfitst,  mid,  initial,  last) 


Mailing  address 

City 

State 

Zip 

Home  phone  ( ) 

Office  phone  ( 

) 

Highest  degree 

Area  of  specialization 

Institution/employer 

The  1992  dues  of  $ 10  for  students  and  $ 18 
for  professional  membership  include  a subscrip- 
tion to  the  Mid-Western  Educational  Researcher 
and  a reduced  registration  fee  for  the  Annual 
Meeting.  Address  membership  correspondence  to: 
Charles  C.  Anderson,  Jr.,  MWERA  Executive 
Officer,  1332  Southwind  Drive,  Northbrook, 
IL  60062;  phone  (708)  564*4796. 


MWERA  division  preferences 


AERA  member? 


If  applying  for  student  membership,  please  include  a copy  cf  your  student  ID. 


William  E.  Klingele.  dean 

College  of  Education 
Akron,  OH  44325-4201 


* Nonprofit  Organizatior 
BULK  RATE 
U.S.  Postage  Paid 
Akron,  Ohio 
Permit  Number  222 


GARY  HAUNG,  ASST. DIR. 
ERIC/CRESS,  P.O.BOX  1348 
APPALACHIA  EDUCATIONAL  LAB. 
1031  QUARRIER  STREET 
CHARLESTON,  WV  25325 
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As  the  minority  populations  of  the  United  States  increase,  greater  attention  is  being  paid  to  the 
educational  needs  of  minority  children.  Educators  and  educational  researchers  are  beginning  to  respond  to 
these  needs  through  increasing  efforts  to  investigate  and  facilitate  their  learning. 

In  an  effort  to  address  the  topic  MWERA  presented  a series  of  invited  addresses  on  multicultural  issues 
at  its  1991  Annual  Meeting.  We  also  planned  to  include  a multicultural  section  in  this  issue.  That  section  has 
grown  to  consume  almost  the  entire  issue,  containing  several  articles  and  the  reviews  of  two  books  which  have 
received  considerable  attention.  In  late  September  1991  when  Publishers  Weekly  replaced  their  $30,000  cover 
ad  with  a letter  recommending  that  Geotge  Bush  read  Savage  Inequalities , it  seemed  to  be  a book  that  merited 
our  attention  as  well.  Henty  Giroux’s  new  book,  Border  Crossings , presents  a theoretical  basis  that  is  also 
likely  to  have  broad  implications  for  education  and  educational  researchers.  There  is  power  in  diversity  that 
should  be  explored,  supported,  and  celebrated. 

As  always,  we  hope  you  enjoy  the  MidWestem  Educational  Researcher.  We  especially  hope  that  you 
will  contribute  to  the  journal  with  your  comments  and  manuscripts.  The  MuJ-Vfestern  Educational  Researcher 
is  an  excellent  place  to  publish  your  AERA  papers  and  other  manuscripts;  so  please  submit  your  papers  and 
encourage  your  colleagues  and  students  to  do  so. 

Are  we  in  your  library?  You  can  do  a lot  to  help  MWERA  and'the  Mid-Westem  Educational  Researcher. 
In  addition  to  encouraging  your  colleagues  and  students  to  join  the  Association,  you  can  make  sure  that  the 
Mid-Western  Educational  Researcher  is  available  in  your  college  library.  Your  college  library  can  join  MWERA 
just  like  any  individual  for  the  price  of  a membership  (currently  $18).  This  is  an  incredibly  low  price  for  a library 
to  pay  for  a quarterly.  Please  take  whatever  procedures  are  necessary  to  add  the  MidA%stem  Educational 
Researcher  to  the  shelves  of  your  library. 

MWERA  Communication  & Update— See  you  in  San  Francisco!.  MWERA  is  sponsoring  a get' 
together  in  April  at  the  annual  meeting  of  the  American  Educational  Research  Association.  The  event  will 
be  held  Wednesday  evening,  April  22,  in  the  room  of  Greg  Marchant  and  Isadora  Newman  at  the  Hilton  Hotel. 
More  details  will  be  available  at  the  conference.  Please  stop  by. 
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The  Virtues  of  an  Educational  Semiotic 

By  Gary  D.  Shank,  Northern  Illinois  University,  and 
Donald  J.  Cunningham,  Indiana  University 


Between  the  two  of  us,  we  have  dedicated  a substantial 
amount  of  effort  to  the  topic  of  semiotics— some  thirty  years  of 
study,  several  hundred  articles,  hook  chapters,  and  conference 
papers;  two  fellowships;  attendance  and  participation  in  at  least 
six  major  summer  long  institutes  and  at  least  fifty  shorter  con- 
ferences and  sessions;  organizing,  chairing  and  fostering  over 
thirty  “open*’  sessions  and  special  interest  groups  at  various 
scholarly  meetings;  editing  and 'or  contributing  to  two  special 
issues  of  journals  on  semiotics  and  education  (one  in  education 
and  one  in  semiotics);  and  steadv  work  on  a collaborative  book 
on  the  topic  that  will  be  finished.. .some  day. 

In  the  face  of  all  this  effort,  there  is  a question  that  man\ 
people  in. the  field  feel  too  polite  to  ask,  but  which  nonetheless 
lingers  under  the  surface  of  many  of  our  joint  and  individual 
interactions  with  our  colleagues  in  education:  What  is  the  point 
of  all  this  work  on  semiotics,  any  wav?  Or,  what  good  is  semiotics 
in  education  after  all?  We  would  like  to  help  out  our  friends  and 
co-workers  in  education,  and  raise  that  question  ourselves  in  this 
brief  article.  We  are  working  to  help  define  and  implement  a 
discipline  of  educational  semiotic.  Why  should  anyone  do  this? 
In  short,  we  argue  that  educational  semiotic  deserves  to  exist, 
because  it  is  a virtuous  idea. 

Virtue  is  one  of  those  words  which,  ironically,  have  a 
semiotic  history  to  them.  In  our  culture,  the  term  ‘virtue  has 
worn  a puritanical  connotation,  so  that  anyone  who  uses  the 
term  risks  triggering  images  of  repression  and  authoritarian  pre- 
scription in  the  name  of  some  narrowly  defined  band  of  ‘goodness.’ 
We  use  the  term  ‘virtue  deliberately,  because  we  want  to  address 
that  sense  of  exclusion  and  superiority  head  on.  Educational 
semiotic  thinking  and  practice  is  virtuous  not  because  it  excludes 
ways  of  thinking,  hut  because  it  inserts  and  builds  upon  new 
wavs  of  thinking.  It  is  the  virtue  of  discovery,  and  not  the  virtue  of 
verified  restricted  action.  The  primary  virtue  in  education 
is  clarity.  However,  before  we  can  extol  the  virtues  of  semiotics, 
wc  need  to  define  it. 

Some  Preliminaries 

We  will  not,  in  this  brief  space,  provide  a comprehen- 
sive overview  of  semiotic  theory  (see  the  reference  list  tor  papers 
in  which  we  attempt  this).  But  we  need  to  briefly  characterize 
the  central  concept  underlying  semiotics,  the  sign,  before  dis- 
cussing the  virtues  of  the  general  approach.  Simply  put,  the 
subject  matter  of  semiotics  is  semiosis,  the  action  of  signs  in 
all  domains  of  life.  Within  semiotics,  these  domains  are  limitless, 
from  the  action  of  genes  to  the  co-evolutionary  analysis  of  Gaia. 


As  educational  semioticians,  we  are  interested  in  the  action  of 
signs  in  educational  practice  and  research. 

Signs  are  things  that  stand  for  something  else.  A sign 
is  operating  when  it  brings  to  mind  something  other  than  itself, 
as  when  the  word  “pencil”  brings  to  mind  the  object  with  which 
we  write,  smoke  brings  to  mind  the  fire  that  caused  it,  or  the 
stick  figure  on  the  restroom  door  brings  to  mind  the  gender  of 
the  preferred  user. 

Semiotics  as  a field  makes  the  hold  assertion  that  human 
cognition  is  accomplished  entirely  with  signs,  that  we  have  no 
direct  access  to  the  real  world.  Our  understanding  of  the  world 
is  entirely  mediated  by  signs,  and  therefore  to  understand 
human  cognition,  we  must  understand  the  nature  of  our  signs: 
What  is  a sign?  How  is  one  sign  related  to  another  sign?  What 
do  signs  reveal  about  the  real  world?  What  do  they  obscure? 
How  are  signs  formed?  What  are  the  ways  in  which  signs  can 
stand  for  something  else? 

Traditional  approaches  to  human  cognition  are  grounded 
on  one  side  or  the  other  of  the  classic  philosophical  conun- 
drum: realism  vs.  idealism.  Realist  views,  the  more  common 
in  educational  circles  today,  argue  that  human  cognirion  has 
the  potential  to  he  a mirror  of  reality.  Sign-like  processes,  if  they 
are  considered  at  all,  tend  to  be  regarded  as  error— of  perception, 
memory,  intelligence,  etc.  Idealist  approaches  posit  nothing 
but  sign  process,  where  reality  is  that  which  we  construct  with 
our  minds.  Semiotics,  in  our  thinking,  constitutes  a genuine 
third  alternative,  not  simply  some  compromise  between  realism 
and  idealism.  While  we  disagree  among  ourselves  about  the 
character  of  this  third  alternative  (this  is  not  the  place  to  pursue 
this  debate),  we  agree  that  the  solution  is  grounded  in  the  notion 
that  signs  are  sluucd,  that  they  exist  fundamentally  as  a means 
of  commumctition  between  organisms,  and  that  we  literally  bring 
forth  the  worlds  in  which  we  find  ourselves  in  a form  of  structural 
coupling  with  other  organisms. 


Semiotic  Virtues 

While  there  are  many  ways  that  we  can  describe  the 
‘virtues’  or  ‘rightness’  of  an  educational  semiotic,  we  feel  that 
there  are  three  main  sources  or  venues  of  virtue  that  an  educa- 
tional semiotic  can  foster  in  our  field. 

Semiotics  restores  discovery/invention  in  inquiry.  The  firs! 
virtue  of  an  educational  semiotic  is  based  on  the  fact  that  it 
is  a powerful  tool  for  the  basic  researcher  m education.  Basic 
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research  in  education  has  fallen  upon  hard  times  lately.  We  are 
living  in  practical  times,  and  it  has  become  the  mission  of  the 
educational  researcher  to  tell  us  what  is  happening  in  schools 
today,  why  these  things  are  happening,  and  what  ought  to 
be  done  next. 

We  are  supportive  of  the  notion  of  applied  research  in 
education,  but  we  are  nervous  about  the  naivete  underneath  the 
theoretical  base  of  these  applied  actions.  For  instance,  there 
is  a great  deal  of  effort  in  the  area  of  improving- reading  in  our 
schools.  Researchers,  to  their  credit,  are  going  into  the  schools 
to  find  out  what  is  actually  happening  when  children  learn  to 
read.  But  the  gist  of  the  approach  is  that  the  researchers,  whether 
they  realize  it  or  not,  are  actually  trying  to  confirm  or  discontirm 
whether  certain  theoretical  things  are  going  on  in  the  reading 
process  (i.e.,  whether  reading  is  behavior  change,  information 
processing,  etc.). 

Why  iscontirmation/disconfirmation  such  an  important 
part  of  the  research  process.7  Simply  put,  research  is  built  upon 
the  logic  of  verification.  When  we  do  research,  we  try-  to  see  if 
our  empirically  formulated  theories  can  be  confirmed  by  more 
directed  empirical  evidence  gathering  and  analysis.  The  impli- 
cation of  this  position  is  to  push  the  venue  of  basic  research  into 
the  arena  of  building  theories,  while  applied  research  becomes 
the  act  of  trying  to  confirm,  deny,  or  modify  those  theories, 
based  on  what  actually  happens  in  ecologically  valid  settings 
of  inquiry.  We  feel  that  the  logic  of  verification  inserts  certain 
virtues  into  the  research  process.  First  of  all,  it  makes  the  link 
between  theory’  and  practice  clear.  Second,  it  allows  for  indepen- 
dent and  non-subjective  means  to  confirm/disconfirm  theories. 
Finally,  it  should  allow  researchers  to  use  the  acts  of  confirmation 
and  disconfirmation  to  correct,  based  on  the  findings  of  research, 
flawed  practices  that  go  on  in  the  schools. 

The  virtues  of  verification  are  not  the  same  as  the  virtues 
of  discovery.  The  educational  semiotic  ian  goes  into  the  schools 
with  an  entirely  different  mission,  and  armed  with  an  entirely 
different  logic.  The  educational  semiotician  (hereafter  called 
the  ES)  looks  at  the  netting  on  its  own  terms,  as  an  environment 
imbued  with  layer  after  layer  of  meaning.  The  act  of  the  ES  is 
to  uncover,  reveal,  and  examine  those  layers  of  meaning,  and  in 
particular,  to  articulate  meaning  patterns  that  have,  until  then, 
been  only  covert.  This  logic  of  discovery  is  based  on  the  need 
to  treat  the  objects  of  experience  as  signs:  signs  to  the  people 
involved  in  the  setting,  signs  to  the  researcher,  and  signs  to  others 
who  come  to  experience  these  settings.  Furthermore,  these  signs 
point  to  powerful  trends  of  meaning  which  often  derive  much 
of  their  power  from  being  unarticulated. 

Let  us  try  to  characterize  this  virtue  with  a concrete 
example.  Suppose  we  stroll  into  a second  grade  classroom  and 
observe  a reading  circle  m progress.  The  verificationist  researcher 
will  immediately  monitor  this  reading  circle  to  see  which  basic 
theory7  of  reading  instruction  is  being  instantiated.  Once  she 
discerns  this,  her  next  move  is  to  determine  how  well  the  theory 


has  been  applied.  Then,  and  finally,  she  determines  how  much 
effect,  if  any,  this  applied  version  of  the  theory,  has  had  on  the 
improvement  of  reading  skills  of  these  second  graders,  using  the 
techniques  and  measures  consistent  w-ith  that  theory. 

The  discovery  researcher,  armed  with  an  educational 
semiotic  perspective,  is  up  to  something  entirely  different.  She 
is  more  interested  in  monitoring  the  situation  as  a complex  of 
experiences.  What  are  the  children  doing.7  Are  they  paying  atten- 
tion to  the  task?  Are  they  daydreaming?  If  we  ask  them,  what 
will  they  say  that  reading,  and  reading  circles,  mean  to  them? 
What  are  the  underlying  assumptions  about  teaching  that  seem 
to  inform  the  teacher,  and  how7  does  the  teacher  feel  about 
second  graders?  Are  there  any  behaviors,  or  actions,  or  material 
cultural  artifices,  in  the  setting  that  draw  our  curious  attention 
to  them?  If  w'e  apply  a metaphorical  frame  to  the  reading  circle, 
what  do  w7e  find?  What  do  wre  find  when  we  apply  several  dif- 
ferent metaphorical  frames,  such  as  ‘reading  circles  are  like  fac- 
tories,1 or  'reading  circles  are  like  clubs,’  or  'reading  circles  are 
like  corporate  board  meetings’  and  on  and  on,  up  to  the  creative 
discretion  of  the  discovery  inquirer? 

Treating  the  world  as  a panoply  of  signs  allows  the  discovery- 
inquirer  the  justification  to  do  her  research,  without  having  to 
twist  and  turn  the  research  to  make  it  look  like  an  example  of 
verification  research.  In  other  words,  the  fundamental  virtue 
of  an  educational  semiotic  in  basic  research  is  that  it  gives  the 
researcher  permission  to  do  a sty.e  of  work  that  has  no  place  in 
a world  where  only  verificational  research  is  allowed.  Note  that 
this  does  not  replace  the  need  to  do  verificational  research;  it 
expands  the  process  of  inquiry7. 

Semiotics  increases  the  bandwidth  of  educational  thinking 
Currently,  educational  theory,  research  and  practice  is  derived 
from  a fairly  narrow7  band  of  theory7  and  method.  Most  research 
is  grounded  in  psychology,  some  anthropology,  some  sociology, 
and  a smattering  of  field  wisdom  and  common  sense.  Theory  is 
based  on  verificational  research  findings  and  a fairly  narrow  range 
of  philosophical  and  policy  w-orks.  Finally,  practice  filters  these 
prior  effects  through  an  inertial  system  of  administrative  and 
grassroots  practices. 

The  worldview  of  education  reflects  the  prevailing  world- 
view7  of  our  entire  culture,  which  is  one  of  specialization,  or 
narrowidth  thinking.  Specialization  is  not  a fundamental  property 
of  reality,  hut  is  a cultural-historical  accident  of  the  fact  that  the 
institution  of  education  flourished  during  the  industrial  revolu- 
tion, where  specialization  was  the  order  of  the  day.  Now  that 
we  have  mewed  into  the  information  age,  we  see  that  specializa- 
tion needs  to  he  constantly  tempered  with  a more  broad  band- 
width of  thinking  and  modeling.  Narrowcast  applications  of 
educational  theories  are  in  fact  being  replaced,  more  or  less  nnsys 
temancally,  with  broadcast  patterns  of  thought  and  insight.  Our 
system  is  in  need  of  some  way  to  gei  a handle  on  this  problem, 
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and  we  teel  that  educational  semiotic  is  part  of  the  answer.  The 
secret  lies  in  the  fact  that  the  ‘sign  is  strictly  a formal  concept 
and  so  is  not  dependent  on  content  per  se.  Therefore,  a system 
of  signs  can  he  as  broadcast  as  wc  might  want  it  to  be,  and  if 
the  elements  all  function  as  signs,  they  can  be  incorporated  into 
a larger  and  systematic  frame. 

Let  us  conclude  this  section  with  a concrete  example. 
The  ES  is  back  in  front  of  the  reading  circle.  What  avenues  of 
learning  and  understanding  can  the  ES  bring  to  bear  in  this 
situation?  Well,  he  can  draw  from  a vast  domain  of  related  fields. 
How  is  reading  like  singing?  They  both  involve  the  decoding  of 
written  symbols  to  vocal  sounds.  How  is  reading  like  playing  a 
musical  instrument?  They  both  involve  the  means  to  interpret 
existing  text  and  to  construct  new  texts.  Are  the  similarities  and 
difference  informative?  Here,  we  have  the  ability  to  create  a com- 
plex interplay  between  the  reading,  the  singing,  and  the  playing. 
Both  singing  and  playing  a musical  instrument  are  often  done  in 
group  settings,  typically  requiring  a complicated  coordination 
of  separate  but  related  actions.  What  might  reading  look  like 
it  similar  conditions  were  imposed  in  the  instructional  setting? 
Note  that  there  is  no  prior  requirement  that  the  question  raised 
should  make  immediate  sense:  this  is  discovery,  even  invention 
research,  after  all,  and  not  verification  research.  In  short,  the 
link  between  the  discovery  aspects  of  the  inquiry  and  the  abstract 
nature  of  the  sign  act  to  invite,  rather  than  exclude,  correlated 
and  even  non -correlated  avenues  of  inquiry. 

We  are  not  arguing  for  a completely  “free-form”  mode 
of  inquiry.  The  extent  to  which  a consideration  of  alternative 
means  of  interpreting  a situation  (of  applying  an  alternative 
sign  system)  is  useful  must  always  be  submitted  to  some  sort  of 
instrumentality  criterion:  Does  this  analysis  inform  our  under- 
standing of  the  complex  social  situation  which  typifies  the  edu- 
cational process?  Do  the  insights  stand  up  to  the  test  of  more 
traditional  verification  research?  In  essence,  we  are  proposing 
that  educators  and  educational  researchers  heed  Sherlock  Holmes' 
warning,  that  it  is  premature  to  theorize  before  all  the  “facts”  are 
in.  We  must  collect  as  many  observations  as  we  can  from  as  many 
perspectives  as  seem  relevant,  and  then  hypothesize  a theoretical 
state  of  affairs  in  which  the  observations  make  sense.  Unlike 
Holmes,  however,  we  educators  seldom  have  anything  as  con- 
crete as  a dead  body  or  a smoking  gun  on  which  to  ground  our 
theorizing.  This  makes  our  task  at  once  both  more  frustrating 
and  rewarding. 

Semiotics  redefines  pedagogy 

So  far  we  have  stressed  the  openness  of  semiotics,  its 
ability  to  entertain  a variety  of  perspectives  in  a seemingly  ecu- 
menical, self-reflexive  manner.  But  semiotics  also  entail  a set  of 
values  of  what  are  appropriate  virtues  to  be  pursued  in  various 
applied  settings:  medicine,  science,  music,  and  education.  Thar  is, 
semiotics  also  has  a perscriptive  side:  Given  that  human  semiosis 


is  the  action  of  signs,  what  is  the  purpose  of  education?  If  semiosis 
is  an  ongoing  process  (and  may  even  be  thought  of  as  a definition 
of  life),  what  role  is  left  to  the  educator? 

Again,  we  have  written  extensively  on  this  topic  else- 
where and  can  only  briefly  summarize  our  view  here.  Since 
semiosis  is  the  action  of  signs  and  our  knowledge  of  the  world 
is  always  mediated  by  signs,  one  overriding  goal  for  education 
is  to  provide  experience  with  the  semiosic  process.  How  do  the 
signs  we  use  color  or  influence  our  worldview?  What  are  the 
consequences  of  using  alternative  signs?  A pervasive  and  largely 
benign  effect  of  semiosis  is  that  we  tend  to  use  those  signs  through 
which  the  world  makes  good  sense  to  us,  that  seem  “right.”  And 
we  tend  to  assume  that  others  see  things  in  roughly  the  same  way 
we  do.  That  our  worldview  is  constructed  from  signs  is  largely 
invisible.  Providing  experience  which  elevates  our  world  view  to 
a conscious  level  typically  entails  bringing  up  alternative  views 
for  comparison,  as  when  children  study  cultures  different  from 
their  own. 

In  a classroom  with  which  we  have  worked,  the  teacher 
is  exchanging  material  (stories,  letters,  photographs,  HyperCard 
stacks,  etc.)  with  a similar  classroom  in  Northern  Ireland.  The 
children  in  both  cultures  are  constantly  surprised  by  the  differ- 
ences that  have  been  revealed,  from  simple  things  like  the  way 
a date  is  written  or  the  likelihood  that  the  family  owns  a car, 
to  the  extreme,  as  when  the  children  in  Northern  Ireland  talk 
about  the  “Troubles”  (the  sectarian  violence).  The  children  in 
both  cultures  are  invited  to  put  themselves  in  the  perspective 
of  the  other,  and  examine  their  own  cultural  practices  based 
upon  this  new  perspective.  What  would  it  be  like  to  live  in  a 
town  where  Army  patrols  can  be  seen  several  times  a day?  To 
come  upon  a policeman  with  a cocked  semi-automatic  weapon? 
On  the  other  hand,  what  is  if  like  to  live  in  a culture  where 
personal  crime  is  common  (such  crimes  are  rare  in  Northern 
Ireland  in  comparison  to  the  United  States)? 

This  example  embodies  many  of  the  principles  of  a 
semiotic  pedagogy  about  which  we  have  written  elsewhere. 
Specifically,  we  have  proposed  the  following  guidelines: 

• Provide  experience  with  the  semiosic  process. 

• Provide  experience  with  and  appreciation  for  multiple 
perspectives. 

• Embed  learning  in  realistic  and  relevant  contexts. 

• Encourage  ownership  and  voice  in  the  learning  process. 

• Embed  learning  in  social  experience. 

• Encourage  the  use  of  multiple  modes  of  representation 
(alternate  sign  systems). 

• Encourage  self-awareness  of  the  semiosic  process  (reflex ivity). 

Eatlier  we  proposed  that  at  the  heart  of  semiotics  lies  the 
notion  that  signs  are  shared,  that  they  emerge  from  a communi- 
cative coupling  between  individuals.  This  theme  pervades  all 
of  the  guidelines  listed  ahove.  But  we  want  to  be  clear.  Wc  arc 
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Multicultural  Education: 

Thoughts  and  Suggestions  for  Commitment 

By  Mary  Ann  Flowers,  Cleveland  State  University 

Abstract 

The  article  presents  two  points  regarding  multicultural  education:  that  multicultural  education  is  misunderstood,  and  that 
there  is  a lack  of  commitment  toward  multicultural  education  hy  the  educational  profession  as  well  as  allied  professions.  The  author  gives 
definitions  for  multicultural  education  and  makes  suggestions  as  to  how  professionals  can  become  advocates  for  multicultural  education. 


A population  growth  for  the  2 1st  century  in  America 
is  projected  for  racial  and  ethnic  groups  of  color  according  t o 
demographer  Harold  Hodgkinson  (1985).  The  population  boom 
is  predicted  for  African-Americans  and  Hispanic  Americans 
by  the  ye^r  2000.  For  the  first  time  in  America’s  development, 
people  o color  will  outnumber  Whites.  This  increased  diversity 
in  the  U lited  States  has  attracted  the  attention  of  educators, 
researche*s,  scholars,  as  well  as  people  in  the  business  sector. 
In  turn,  this  demographic  shift  seems  to  have  brought  about  a 
heightened  interest  in  multicultural  education  and  issues  related 
to  diversity  in  the  United  States.  Yet,  multicultural  education 
seems  to  be  a cliche  phrase  used  to  portray  a sense  of  a fore- 
boding inevitable  future:  A drastic  necessity  to  change  a much 
practiced  and  covenant  point  of  view.  This  prescribed  mainstream 
view  is  one  of  male,  White,  Anglo-European,  and  status  quo. 
Although  the  phenomena  of  diversity  concerns  arc  not  new,  as 
witnessed  through  civil  rights  struggles  of  African-Americans, 
Hispanic  Americans,  Native  Americans,  women,  Englislvas-a- 
second-language  populations,  handicapped  persons,  religious 
minorities,  and  most  recently  improved  rights  for  sexual  prefer- 
ence; there  is  a surprising  lack  of  comprehension  of  the  scope 
and  application  of  multicultural  practices  throughout  the  nation’s 
educational  system  in  particular.  So  why  the  lip  service  to  multi- 
cultural education  and  issues  of  diversity?  The  answer  seems 
simple,  a misunderstanding  of  the  premises  on  which  multicul- 
tural education  arc  founded  and  a lack  of  commitment  based 
upon  these  misunderstandings. 

What  is  clear  about  this  demographic  change  is  that 
those  who  have  been  traditionally  tagged  as  racial  minorities 
will  soon  not  be  minorities  in  the  raw  definitions  utili:ed  in 
previous  decades,  i.e.  the  1950s  through  1980s.  What  also  seems 
clear  is  the  need  to  address  the  ignorance  associated  with  the 
definitions  and  assumptions  of  multicultural  education.  Advocates 
of  the  movement  recognize  rhe  realities  of  the  human  experience 
in  a myriad  of  intricate  interactions.  Additionally,  the  concept 
acknowledges  that  requisite  to  the  educational  processare  issues 
of  nice,  culture,  ethnicitv.  gender,  language,  sexuality,  socioeco- 
nomic status,  religion,  and  exceptionalities  (Banks  Ranks, 
1989.  Grant  & Sleerer,  ,r>89;  Hernandez,  1989).  These  important 


premises  encompass  the  notion  that,  “multicultural  education 
is  for  all  students  (Hernandez,  1989,  p.  10),”  and  that  multicultural 
education  is  equated  with  effective  teaching  (Hernandez,  cited 
in  Payne,  1983).  Because  teachers  play  a significant  role  in  stu- 
dents’ academic  development  and  subsequent  achievement,  they 
make  an  important  difference  in  the  lives  of  children  (Ashton 
Webb,  1986).  The  National  Council  for  Accreditation  of 
Teacher  Education  (NCATE)  has  recognized  the  need  for  multi- 
cultural education  as  a professional  component  in  teacher  educa- 
tion programs  in  its  policy  manual  (NCATE,  1987). 

With  the  nation’s  continued  interest  in  educational 
reform,  the  need  for  the  “best  and  brightest”  becoming  attracted 
to  the  education  profession,  and  improved  student  achievement 
outcomes,  why  has  multicultural  education  been  overlooked  as 
a response  to  these  issues?  Knowing  within  less  than  a decade 
the  United  States’  population  will  become  far  more  diverse  in 
race,  language,  and  ethnicity  than  ever  recorded  in  our  nation’s 
history',  why  does  multicultural  education  remain  more  at  the 
discussion  level  and  less  at  the  implementation  level?  In  a word, 
the  answer  to  these  questions  is  commitment.  A pervasive  internal 
change  in  attitudes  among  educators,  scholars,  researchers, 
therapists,  practitioners,  textbook  writers,  publishers,  historians, 
and  curriculum  developers  is  necessary  toward  making  commit- 
ment for  multicultural  education  a reality  within  the  American 
school  system . All  segments  that  interact  with  our  nation’s 
schools,  such  as  social  service  agencies,  are  also  targets  for  the 
same  need  in  attitude  adjustment. 

At  this  point  in  time,  a national  plan  of  action  would 
seem  premature.  Discussion  of  the  issues  tend  to  take  the  form 
of  mere  rhetoric  or  the  voiced  concerns  of  underrepresented 
populations.  However,  these  multicultural  education  advocates 
offer  a few  suggestions  to  encourage  the  discussion  of  the  isstie> 
related  to  diversity.  First,  educators  should  become  converts 
realizing  that  the  concerns  of  a diverse  society  will  not  go  away 
just  because  they  are  not  consciously  acknowledged.  Second, 
a>  professionals  we  should  spread  the  word  through  journals, 
newsletters,  workshops,  seminars,  colk  i,  professional  forums, 
u inferences,  and  formal  and  inform  ' ctissions.  We  should 
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Multicultural  Education  (continued  from  page  5) 


write  letters  to  educational  departments  on  the  state  and  national 
levels,  attend  school  board  meetings  for  the  expressed  purposes 
of  diversity  issues,  meet  with  church  leaders  and  groups,  and 
pursue  any  other  available  avenues  of  communication.  The 


commitment  toward  multicultural  education  has  to  become  a 
core  element  of  professionalism.  Its  value  can  only  be  transmitted 
through  assertive  widespread  efforts  via  modeling,  practices, 
and  applications. 
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The  Virtues  of  an  Educational  Semiotic  (continued  from  fxige  4) 


not  proposing  that  education  is  largely  a process  of  transmitting 
a message  from  a source  to  a destination,  from  a teacher  to  a 
student.  Rather,  the  process  is  one  of  dialogue,  negotiation  of 
meaning  from  shared  social  experience.  The  teacher,  as  mentor, 
becomes  a person  who  attempts  to  extend  the  range  of  experi- 
ence from  which  the  learner  can  construct  knowledge,  serving 
a scaffolding  function  like  that  described  by  Vygotsky.  The  “mes- 
sage" or  the  “meaning”  emerges  from  both  the  source  and  the 
destination  in  a dynamic  process:  semiosis.  Thus,  it  is  impossible 
to  think  of  semiosis,  and  therefore  learning,  as  an  isolated  process, 
taking  place  within  the  confines  of  any  individual  (any  individual 
mind).  Education,  as  all  forms  of  semiosis,  takes  place  in  the 
dynamic  interplay  of  sign  structures  between  individuals. 

Signposts  for  the  Future 

As  we  have  said  throughout  this  arricle,  the  purpose  oi  an 
educational  semiotic  is  to  make  the  entire  process  of  education 
horror.  Wc  feel  that  the  virtues  of  controlled  discovers',  broad 
domains  of  inquiry',  and  meaning-oriented  pedagogy  will,  if  pur 
in  place,  modify  our  field  for  the  better.  Wc  recognize  that  other 
positions  (e  g.,  constructivism)  hold  similar  goals,  hut  nigue  that 


they  do  so  without  the  advantage  of  a well-developed,  formal 
doctrine  of  signs. 

What  then,  would  the  future  hold  for  the  educational 
semiotician?  We  see  three  areas  of  particular  promise  over  the 
horizon  (semioticians  like  to  think  in  terms  of  triads).  First  of 
all,  an  educational  semiotic  base  would  allow  for  an  educational 
system  where  specialities  become  less  departmental,  and  more 
interdisciplinary*.  Can  you  imagine  children  studying  the  aesthe- 
tics, history*,  and  biophysics  of  dance?  Or  the  poetics  and  philoso- 
phies of  government? 

Second,  a system  grounded  in  an  educational  semiotic 
would  allow  for  teachers  to  witness  their  philosophies  of  teach- 
ing, rather  than  simply  transmit  them.  When  we  focus  reflex ively 
on  our  impact  as  a sign  of  learning,  we  become  more  vibrant  and 
alive  as  teachers,  instead  of  being  simple  conduits  of  knowledge. 

Third,  and  most  importantly,  we  see  that  an  educational 
semiotic  could  help  us  restore  a world  of  learning  where  the 
questions  are  just  as  important,  and  actually  even  more  impor- 
tant, than  the  answers.  One  way  of  characterizing  semiotics  is 
to  say  that  it  is  a view  of  the  world  where  every  experience  is 
the  answer  to  at  le.V't  one  unstated  or  unknown  question.  In  a 
sense,  life  is  one  big  game  of  Jeopardy,  where  our  roles  as  edu- 
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Multicultural  Concerns  in  Educational  Research 

By  James  Boyer,  Kansas  State  University 


The  new  knowledge  generated  by  academic  practitioners 
concerned  with  educational  research  will  continue  to  be  a priority 
for  some  time  to  come.  Perhaps  no  other  area  of  work  within  pro- 
fessional  education  is  as  complex  as  the  concerns  about  research, 
especially  that  produced  by  graduate  students  and  their  mentors 
who  may  seek  external  funding  for  the  conduct  of  that  research. 
Multicultural  concerns  include  the  raising  of  the  priority  of  such 
research  to  focus  on  issues  of  diversity  in  topics,  in  research  teams, 
in  the  framework  of  dissemination,  and  a host  of  other  endeavors. 

There  are  several  critical  dimensions  of  multicultural 
education  which  the  research  community  must  embrace  in  order 
to  remain  a viable  entity  within  the  academic  framework  of 
American  education.  Implications  for  race,  gender,  economic 
class,  language,  exceptionality,  leadership,  and  ethnicity  are  all 
part  of  such  dimensions.  Common  themes  of  multicultural  con- 
siderations include  the  following:  (a)  recognizing  racial/ethnic 
identities,  (b)  understanding  diversity,  (c)  multiple  learning  en- 
vironments, (d)  relationship  of  issues  to  academic  disciplines,  (e) 
human  rights,  social  justice,  and  choice,  and  (0  inclusion  of 
diverse  populations.  Add  to  these  concerns  the  continuing  fac- 
tors of  policy,  program,  and  procedures  and  one  realizes  how 
critical  it  is  for  educational  research  to  expand  its  parameters 
when  discussing  “research.”  There  is  no  denial  that  traditional 
research  methods  are  essential  to  the  research  activity  within 
the  educational  community.  However,  the  definition  of  research 
has  been  too  narrow’  to  embrace  much  which  needs  to  be  ad- 
dressed. The  following  are  categories  that  lend  themselves  to 
educational  research  activity,  but  which  rarely  get  attention, 
particularly  at  the  doctoral  level  in  American  education: 

1.  Historical  research— that  which  builds  a chronology 
of  persons,  groups,  or  issues  not  normally  studied  by  traditional 
researchers  in  the  professional  research  community. 

2.  Descriptive  research— that  which  defines  a reality 
and  offers  findings  which  do  not  readily  lend  themselves  to  quan- 
titative reporting— though  they  may  contribute  to  professional 
understanding  of  teaching,  learning,  or  consumer  issues. 

3 . Creative  research— that  which  is  the  result  of  composi- 
tions in  educational  theatre,  music,  art,  drama,  photography,  or 
other  areas— including  poetry. 

In  addition  to  traditional  experimental  research,  these 
categories  will  need  to  be  addressed  within  educational  research 
courses,  and  certainly  within  the  framework  of  approved  theses 
and  dissertations.  Experimental  research  designs  have  long  had 
something  of  a monopoly  on  the  conduct  of  educational  research. 
In  the  future,  multicultural  concern*  will  include  friendly  con- 
frontations with  the  assumption  that  historical,  descriptive,  and 
creative  research  designs  have  equal  merit  in  attempting  to 
generate  new  knowledge  on  which  to  base  professional  practice. 


Multicultural  Research  Production 

New  definitions  of  research  production  must  include  issues 
of  diversity.  Failure  to  embrace  such  issues  will  call  for  major 
limitations  on  its  dissemination,  appropriateness  for  professional 
practice  with  diverse  student  populations,  and  certainly  its  use- 
fulness in  understanding  human  service  in  public  education. 


Multicultural  Research  Consumption 

Which  research  is  consumed  most  by  those  who  would 
offer  their  services  in  instructional  roles  in  America,  particular- 
ly in  cross-racial,  cross-ethnic  settings?  lb  what  extent  does  this 
consumption  of  published  research  impact  perspectives  on  teach- 
ing and  learning  for  this  decade?  Answers  to  this  kind  of  ques- 
tion must  now  become  part  of  preparation  in  educational  re- 
search courses. 

Research  Topics  Chosen 

As  doctoral-level  research  topics  are  chosen  and  approved 
by  university  advisers  and  committees,  one  must  begin  to  review 
patterns  of  topics  which  get  under-emphasized,  lo  what  extent 
are  candidates  encouraged  to  engage  in  research  activity  on  topics 
which  include  gender,  race,  and  economic  exploitation?  To  what 
extent  are  new  researchers  encouraged  to  pursue  topics  which 
address  language  diversity  and  respect  for  the  ancestral  heritage 
of  diverse  student  populations? 

Given  the  changing  demographics  of  America  and  Ameri- 
can education,  the  research  community  is  now  being  charged 
with  expanding  its  framework,  its  philosophy  of  acceptable  re- 
search activity,  and  its  practices  and  findings  including  the  per- 
spectives associated  with  those  findings. 


The  Educational  Research  Team 

Because  of  the  powerful  impact  of  research  findings,  par- 
ticularly as  they  impact  national,  regional  and  state  policy  for 
schooling,  many  groups  are  now  becoming  concerned  about  the 
composition  of  the  research  teams  who  conceptualize,  produce, 
and  disseminate  such  findings. 


Authentic  Research  vs.  Basic  Research 

A basic  research  study  (of  any  design)  is  one  conducted 
hv  persons  on  populations  ot  which  they  are  not  a member.  For 
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Multicultural  Concerns  in  Educational  Research  (,  xmrinufti  from  page  7) 


example,  an  African-American  male  who  conducts  research  on 
a population  of  Asian  females  can,  at  best,  only  produce  a study 
which  we  term  as  basic  research  activity.  He  (the  African-Ameri- 
can male  researcher)  may  feel  that  he  is  bringing  total  objectivity 
to  such  research  activity,  particularly  if  he  has  not  known  Asian 
females  at  an  earlier  time  in  his  life  experiences  or  academic 
environment.  His  data  may  be  quite  clear,  and  he  may  have 
controlled  for  a number  of  variables,  and  he  may  have  knowl- 
edge of  many  historical,  cultural,  or  other  factors.  His  study  is 
still  basic  research  because  he  is  not  an  Asian  female  (or  Asian- 
American  female). 

An  Authentic  Research  study  can  only  occur  when  a 
member  of  the  research  samples  (groups)  being  studied  is  a part 
of  the  research  conceptualization  team,  who  also  involves  him- 
self or  herself  during  the  conduct  of  the  study  and  the  writing 
of  the  research  report.  This  person  brings  a lifetime  of  that 
profiles  experiences  to  the  research  activity.  An  Asian  woman 
(or  if  it  is  Asian-American  women  being  studied)  would  then 
need  to  be  part  of  the  research  team  conducting  research  on 
such  women.  This  kind  of  analysis  will  be  high  priority  for  edu- 
cational research  in  the  future. 


One  of  the  primary  concerns  is  addressing  the  essentially 
monocultural,  basic  nature  of  much  educational  research.  This 
includes  the  materials  used  in  treatment  as  well  as  in  training 
new  researchers  for  participation  in  educational  endeavor.  Much 
research  still  needs  to  be  done  on  many  topics  including  cul- 
turally-influenced learning  styles,  the  racial  history  of  teachers, 
the  gender  history  of  teachers,  authorships  of  textbooks  for 
teacher  educaton,  studies  on  images  presented  in  educational 
materials,  studies  on  cross-racial,  cross-ethnic  teaching  and 
learning,  studies  on  ethnic  literacy,  and  studies  on  administrative 
policy-making.  The  role  of  culture,  ethnicity,  language,  and  eco- 
nomic background  in  impacting  research  activity  is  now  under- 
explored. Educational  research  has  a critical  role  to  play  in  ex- 
panding the  perceptions  now  held  by  many  in  the  academic 
arena.  Multicultural  education  becomes  the  framework  through 
which  much  of  this  discussion  must  emerge.  Theory-building 
research  is  also  necessary  if  American  educational  research  is 
to  maintain  its  lofty  position  as  a chief  influencer  of  thought 
and  practice  for  the  year  2000. 


The  Virtue  of  an  Educational  Semiotic  (continued  from  (xigc  6) 


cators  is  to  help  learners  ask  more  and  more  interesting  and 
sophisticated  questions. 

In  the  final  analysis,  we  could  say  that  the  role  of  an 
educational  semiotic  is  to  reassert  the  fact  that  curiosity  is  a noble 


human  trait,  whether  expressed  by  researchers,  teachers,  or  stu- 
dents. If  we  can  advance  the  cause  of  curiosity  in  education, 
then  the  future  of  the  field  will  be  bright  and  the  virtuous  status 
of  educational  semiotics  will  be  permanently  ensured. 
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Case  Studies  in 

Culturally  Responsible  Pedagogy 

By  Tonya  Huber,  Scott  Hieger  and  Jeannie  N.  Parscal 
The  Wichita  State  University 


Abstract 

Multicultural  education  is  education.  The  main  goal  of  a multicultural  curriculum  is  to  provide  quality  learning  experiences 
consisting  of  both  formal  and  informal  study  and  interactive,  collaborative  classroom  and  field  experiences  based  on  a culturally 
responsible  pedagogy.  Educators  have  a moral  and  ethical  responsibility  to  facilitate  and  nurture  the  growth  of  responsible  citizens 
of  the  world.  A team  of  researchers  collected  case  study  data  in  three  middle  school  teachers’  classrooms  to  explore  and  define  “cul- 
turally responsible  pedagogy”  in  action. 


The  determination  to  become  culturally  responsible  in 
Americas  ever-increasingly  diverse,  global  society  goes  one  step 
beyond  multiculturalism  as  it  has  been  implemented  in  many 
American  public  schools.  Culturally  responsible  educators  are 
not  content  to  teach  about  ethnic  groups— they  are  responsive 
to  the  cultural  identity  of  the  learner,  as  well. 

Accreditation  standards  focusing  on  equality  in  the  pro- 
fessional education  unit  require  that  institutions  address  the 
issue  of  diversity  and  multiculturalism.  Teacher  educators  “have 
a moral  and  ethical  responsibility  to  prepare  teachers  to  be  cul- 
turally responsive”  (Smith,  1991),  that  is,  to  enable  teachers  to 
create,  implement  and  evaluate  curriculum  and  instruction  that 
respond  to  the  educational  needs  of  diverse  learners.  Culturally 
responsible  content  and  approaches  recognize  the  influences  of 
culture,  language,  ethnicity,  race,  gender,  religion,  exceptionality, 
socioeconomic  level,  and  home  environment.  Culturally  respon- 
sible attitudes  reflect  an  appreciation  of  the  cultural  and  social 
norms  of  each  learner. 

This  interpretation  of  culture  goes  beyond  the  “tacos  on 
Tuesday,  Indians  at  Thanksgiving,  Black  history  month”  approach 
to  diversity.  Curricula,  instructional  methodologies,  and  pedagogy 
evolve  from  a knowledge  base  including  (a)  identification  of 
cultures,  (b)  understandings  about  how  cultural  characteristics 
influence  learning  and  thinking,  and  (c)  respectfully  sensitive 
identification  of  individual  and  home  cultures. 

Anthropological  studies  of  education,  exploring  the  cul- 
ture of  schooling  (Longstreet,  1978;  Bennett,  1990)  in  the  tradi- 
tional model  of  education  in  America,  have  highlighted  the 
need  to  explore  schooling  in  a cultural  context  (Roberts  & 
Akinsanya,  1976;  Spindler  & Spindler,  1987;  Trueba,  1987; 
Spindler,  1988;  Ah i -Nader,  1990).  As  explained  by  Ricardo  Garcia 
(1991)  in  Hutching  in  a Pluralistic  Society. 

The  view  of  teaching  and  learning  that  has  prevailed 
reflect^  the  values,  attitudes  and  beliefs  of  middle-class 
Americans,  seeming  to  reflect  the  nature  of  all  srudents 


and  presuming  to  provide  standards  of  that  culture  as 
the  final  criteria  of  right  and  wrong.  In  his  synoptic 
view,  middle-class  culture  sits  at  the  hub  of  the  teaching- 
learning  universe;  other  cultures  are  far  removed  or 
nonexistent.  The  presumption  is  that  only  one  model 
citizen  exists,  (p.  9) 

A teacher  whose  philosophy  is  founded  on  this  narrow 
view  of  students  perceives  reality  as  a unified  whole  with  a single 
correct  answer  to  any  question.  A teacher  planning  and  imple- 
menting curriculum  from  a culturally  responsible  perspective 
perceives  reality  as  a diversified  whole  with  differing  correct 
answers  to  any  question.  It  is  paramount  to  a teacher  in  a multi- 
cultural, pluralistic  society  to  develop  the  ability  to  see  reality 
from  the  perspective  of  other  cultural  and  ethnic  groups. 

Cultural  awareness  is  targeted  by  Bowers  and  Flinders 
(1990)  in  their  definition  of  “responsive”  teaching. 

The  professional  judgments  of  the  teacher  should  he 
based  on  an  understanding  of  how  i hi-  student’s  behavior 
and  thought  processes  involve,  to  a larger  extent  than 
is  generally  recognized,  the  reenactment  of  cultural 
patterns.  Being  responsive. . .thus  means  to  he  aware 
of  and  capable  of  responding  in  educationally  construc- 
tive ways  to  the  ways  in  which  cultural  patterns  influence 
the  behavioral  and  mental  ecology  of  the  classtoom. 
(1990,  p.  vii) 

Case  Studies  to  Define 
Culturally  Responsible  Pedagogy 

A premise  of  this  research  is  that  the  culturally  responsible 
educator  recognizes  and  is  knowledgeable  about  each  student’s 
cultural,  home,  and  individual  background  (Ahi-Nader,  1991). 
Addressing  the  issue  of  excellence  in  multicultural  classrooms, 
LadvoivBillings  (1989)  identified  teachers’  background  experi- 
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Case  Studies  in  Culturally  Responsible  Pedagogy  (continued) 


ences  as  primary  in  preparing  them  to  work  with  students  who 
come  from  non-mainstream  lives.  Although  Ladson-Billings  was 
specifically  addressing  the  topic  successful  teachers  of  Black 
students,  her  guidelines  are  generalizable  to  successful  teachers 
of  diverse  students.  Based  on  the  premise  that  there  are  teachers 
who  are  establishing  successful  and  effective  learning  environ- 
ments and  engendering  student  self-esteem,  three  case  studies 
were  developed  to  investigate  how  teachers  create  a learning 
environment  where,  regardless  of  a learner’s  background,  social, 
academic,  and  personal  development  are  maximized.  Fifteen 
teachers  were  identified  as  effectively  interacting  with  diverse 
student  populations  through  community  endorsement  by  adminis- 
trators and  peers.  Three  of  the  six  that  were  willing  to  participate 
were  interviewed  using  ethnographic  interview  techniques  (Sprad- 
ley,  1979)  and  had  classroom  observations  (Spindler  & Spindler, 
1987)  of  over  50  hours  (half  of  which  were  videotaped).  Half 
ot  the  students  in  each  class  were  interviewed,  and  two  of  the 
teachers  kept  informal  journals. 

The  Case  of  Josefina  Guzman* 

developed  by  Tonya  Huber 

As  each  situation  in  life  represents  a challenge  to  man  and 
presents  a problem  for  him  to  solve , the  question  of  the  meaning 
of  life  may  actually  be  reversed.  Ultimately,  man  should  not 
ask  what  the  meaning  of  his  life  is,  but  rather  he  must  recog- 
nize that  it  is  he  who  is  asked.  In  a word,  each  man  is  ques- 
tioned by  life;  to  life  he  can  only  respond  by  being  responsible. 

—Frankl 

Josefine  Guzman  recorded  this  passage  from  Viktor  E. 
Frankl’s  story  of  Auschwitz  in  Man’s  Search  for  Meaning  more 
than  a year  before  she  would  encounter  the  concept  of  culturally 
responsible  pedagogy  in  a graduate-level  research  course.  A 
second-generation  Mexican-American  educator,  Josefina  espoused 
culturally  responsible  pedagogy  before  she  was  ever  asked  to 
define  it.  Josefina’s  affirmation  of  responsibility  equally  affirms 
conclusions  reached  by  Giroux  (1986),  Ladson-Billings  (1989), 
and  McLaren  (1989)  about  a void  in  the  research  literature  on 
education— the  voice  of  the  minority  teacher  in  the  stories 
teachers  tell. 

Teacher  Conceptions  of  Self/Other 

Guzman’s  understanding  of  her  students,  whether  fully 
conscious  to  her  or  not,  appears  directly  connected  to  what 
Ladson-Billings  has  identified  as  the  critical  factor  ot  background. 
Following  the  initial  interview,  Josefina  wrote  in  her  journal: 

I hail  my  initial  interview  with  Dr.  Huber.  1 believe  1 answered 
her  questions  sincerely  and  honestly.  The  feelings  that  stirred 
inside  of  me  were  somewhat  scary.  Feelings  from  the  past 


were  stirred  ...as  if  to  say  that  my  upbringing  has  been  mstru- 
mental  in  my  teaching  style.  1 kept  picturing  myself  as  a 
student  in  a confused  world,  [redjn.1.1] 

Josefina’s  writings  uphold  her  initial  comments  during  the 
first  interview  when  she  characterized  her  background  as  that  of 
“an  ESL  student  without  an  ESL  program”  [redint.  1.1] 

The  ethnic  diversity  in  Josefina’s  classroom  was  enhanced 
by  the  ESL  (English  as  a second  language)  group  of  four  students 
which  she  had  voluntarily  “taken  in.” 

/ added  the  limited  English  stuilents  because  the  ESL  teacher 
needed  planning  time.  These  students  were  at  level  one  in 
English  proficiency.  I brought  these  students  into  my  room 
for  one  period  so  that  I could  help  them  learn.  1 also  saw 
this  as  an  excellent  time  to  have  the  students  peer-tutored. 
[redjn.1.21 

Guzman’s  focus  on  the  positive  and  expectations  for 
success  reverberated  in  the  classroom.  As  one  parent  responded 
on  the  parent/guardian  questionnaire:  “She  wants  them  to  be  the 
best  they  can  be.’' 

Teacher/Student  Social  Relations 

When  the  female  ESL  student  who  had  recently  arrived 
from  Vietnam  appeared  at  the  door  of  the  classroom  at  the 
wrong  time,  rather  than  send  her  away,  Josefina  wrapped  her 
arm  around  the  girl  and  included  her  in  a small  group  demon- 
stration of  letter  writing  at  the  hoard. 

“Right  here,  babe,  right  here,"  [redobs.  1-2.1]  soothed  Josefina 
as  she  continued  to  embrace  the  girl  who  was  obviously  distressed 
at  not  understanding  where  she  was  to  be.  As  she  worked  with 
four  ESL  students  at  the  board,  she  directed  the  activities  of  the 
other  29  students  in  the  room.  Her  directions  to  the  four  at  the 
board  were  dotted  with  supportive  statements  to  other  students 
in  the  classroom: 

• Lin,  keep  Vm  in  your  pack,  hon,  for  now.  [redobs.  1-2.2) 

• Be  sincere  in  what  you  say.  Be  positive.  No  putdoicns  or  negative 
language.  Would  someone  please  explain  this  to  the  kids  who  were 
not  here  yesterday,  [redobs.  1-2. 2] 

• Did  you  find  your  poetry  folder ? Well  get  it.  son,  don't  worry  about 
it.  [redobs.  1-2. 3) 

• Dommers,  come  here!  It's  neat  to  see  all  you  guys  so  excited  about 
retuling  these!  [redobs.  1-2  A) 

• Thank  you  babe,  You’re  a sweetheart,  [redobs. 8 -9.1] 

Multiple  levels  of  culturally  relevant  teaching  occurred  in 
this  brief  ten-minute  period  of  time.  Josefina’s  terms  of  affection— 
babe,  hon,  son,  sweetheart,  and  pet  nicknames  like  Hummers— 
helped  to  develop  the  feeling  of  community  that  is  obvious  to 
the  observer  Het  constant  awareness  of  different  abilities  and 
individual  concerns  means  that  students  ate  often  working  on 


Case  Studies  in  Culturally  Responsible  Pedagogy r (continual) 


different  projects  and  activities;  her  encouragement  of  collabora- 
tive efforts  develops  this  sharing  and  community  building. 

During  the  poetry'  reading  that  occurred  in  the  second  half 
ot  this  specific  lesson,  Josefinas  courtesy  and  commitment  to 
community  building  were  a constant: 

• VWioaJ  Whoa!  Whoa!  I need  paper  Joint.  I need  to  see  your  mouth 
move.  Do  you  have  gum  in  your  mouth ! (Student  nodded  and 
immediately  removed  the  gum  to  a piece  of  paper.)  Thank  you! 
[redobs.  I -2. 5] 

• When  Tommy’s  turn  came  to  read,  she  responded,  “J  haven't /own  J 
a suitable  one."  Jose fina  smiled  reassuringly  and  responded,  “O.  K." 
and  returned  to  her  after  six  more  students  had  responded. 
[redobs.  1-2. 5 -6] 

Josefina  respectfully  interacted  with  her  sixth-grade  stu- 
dents showing  the  logic  of  her  requests,  recognizing  their  unique 
perceptions  of  events,  and  reassuring  them  through  her  suppor- 
tive nonverbal  and  verbal  interactions.  As  she  explained  in  her 
journal:  I’ve  got  to  make  contact.  [Ye  got  to  open  every  heart  in  that 
class  for  that  little  bit  of  time.  They  need  to  open  up  their  hearts  to 
hear  what  l have  to  say  [redjn.4. 1) 

The  students  believed  Josefina  when  she  said,  as  she 
often  did,  “This  is  gonnci  be  something  pretty  non  threatening  to 
start  with.”  [redobs. 3-4. 2) 

• Thin/c  it  through,  guys,  [redobs. 3-4.2) 

• You  don’t  have  to  struggle.  All  you  have  to  do  is  ask . [redobs. 3-4. 2] 

• These  are  difficult.  I don't  expect  you  to  knoivall  these,  [redobs. 3 -4. 3] 

• Now  are  you  with  me?  Do  you  need  some  more  guidance  here ! 
Can  you  go  on  your  own!  [redobs. 3-4-1 1] 

• Car/otta.  do  you  need  time  out!  No!  Then  l don't  want  you  doing 
that  again,  [redobs.6-7.il 

• Think.  Get  closer  to  it!  [ redobs. 8-9. 3] 

• Don’t  fret.  Don't  get  frustrated.  I will  help  you  get  it.  [redobs.8-9.4] 

Josefinas  interactions  with  students  were  not  only  cul- 
turally responsible  to  the  individual  learners  they  were  liberutory 
in  the  truly  Freirean  (Freire,  1986)  sense  of  the  term.  In  Josefinas 
classroom,  students  were  empowered  to  le?m. 

‘The  Fight’— 

A Vignette  from  the  Case  of  Alice  Dale 
developed  by  Scott  Hieger 

To  this  day  one  of  the  similarities  among  various  Indian 
peoples  is  a awiet  snjt-spi'ken  manner  of  dealing  irith  others 
which  results  from  a icnrUvicu'  (hat  all  belong  to  one  another 
and  should  he  treated  accordingly  (Bendrro,  Brokenleg, 

<St  Van  Bockcm,  1990,  p.  37) 

The  9:30  a.iTt.  bell  rang  and  a flood  of  students  from 
Higlnv.it er  Middle  School  poured  our  ot  rhe  classrooms  into  the 


freedom  of  the  halls.  Students  were  milling  about  Alice  Dales 
eighth-grade  language  arts  class.  At  the  very  front  row  stood 
James,  a male  of  African  heritage,  looking  around  his  desk 
for  something. 

“ Where’s  my  pens!"  his  mature  voice  boomed. 

To  the  astonishment  of  the  two  observers,  James  took  a 
swing  at  Austin  with  his  fist.  The  punch  connected  to  Austin’s 
jaw  and  the  students  around  the  two  made  comments  like  “Ooou” 
and  “Gau'd.”  I think  the  students  around  James  and  Austin 
thought  this  was  just  shadow  boxing  between  friends. 

Austin  aimed  a blow  back  at  James,  which  caught  James 
on  the  chest.  But  James  countered  by  grabbing  Austin’s  arm  and 
proceeded  to  stagger  Austin  with  powerful  punches  to  his  rib 
cage.  James  stepped  back  and  the  two  “friends”  separated.  It 
seemed  that  some  of  the  students  around  the  scuffle  now  realized 
this  was  not  “play,”  and  yet  the  boys  in  the  room  laughed  and 
cheered  the  two  on.  The  girls,  however,  were  concerned.  One  in 
particular,  Chenoa,  made  an  attempt  to  stop  the  scuffle. 

“Now  quit  it!”  she  yelled. 

“Now  quit  it!”  another  boy  mimicked  as  Chenoa,  grabbed 
at  James’s  arm. 

“You  ain’t  going  to  hit  me  yet?”  he  taunted  Austin. 

Lunging  forward,  Austin  swung  and  landed  a thundering' 
blow  on  his  opponent’s  chest.  James  staggered  back  several  steps 
and  then  proceeded  to  go  after  Austin  with  a look  of  rage  in 
his  eyes.  Again  the  guys  in  the  class  laughed  and  cheered  the 
two  on.  In  alarm,  1 kicked  up  from  the  camera  towards  Dr.  Huber, 
wondering  why  the  teacher  hadn’t  noticed  what  was  going  on. 

Meanwhile,  the  two  “friends”  had  taken  their  battle 
towards  the  back  of  the  room,  knocking  over  desks  and  threatening 
the  video  equipment. 

“James . . .James . . .James! . . Stop  now!  ’ ’ Mrs.  Dale’s  voice 
started  to  rise  as  she  came  around  from  behind  her  desk  at  the 
front  of  the  classroom. 

1 ‘James! . . . James! . . . James! 

With  these  commands,  Alice  Dale  calmly,  hut  hurriedly, 
walked  toward  the  youths.  1 got  between  the  two  and  separated 
them.  James  went  to  the  front  of  the  room  and  turned  back  to 
Austin  and  the  crowd  of  students:  “COME  OUTSIDE  PUNK!" 

"Way  ta  go,  Janies!"  a boy  replied. 

"James,  come  here. . James,  come  here!" 

James  ignored  his  teacher's  command  and  went  to 
the  doorway. 

"COME  OUTSIDE  PUNK!"  he  yelled  back  to  Austin. 

“Yeah,  way  to  go,  James!"  another  student  added. 

Austin  moved  up  to  rhe  front  of  the  classroom  in  an 
attempt  to  have  another  go  at  James.  Alice  Dale  followed  after 
the  hoys  with  a look  of  concern  on  her  face.  Before  Austin  reached 
the  front  of  the  room  a fellow  student  held  him  back.  Putting 
his  one  arm  around  Austin’s  shoulder,  he  parted  the  glowering 
student  on  the  chest  with  his  other  hand. 
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James  left  the  room  and  stood  outside  the  doorway.  I 
moved  back  to  the  video  camera  and  returned  to  filming.  Alice 
Dale  and  the  entire  class  crowded  around  the  doorway.  Austin 
kept  inside  the  room  and  watched  as  James  still  taunted  him 
from  the  hallway. 

Austin  went  out  into  the  hall  with  Alice  Dale  and  the 
students  began  to  wander  away  from  the  doorway  and  mill  about 
the  classroom. 

“There  ain’t  never  been  anything  bad  like  this  in  the  class 
before!"  exclaimed  Chenoa  as  she  went  back  to  her  desk.  Several 
male  students  were  acting  out  the  punches  thrown  during  the 
fight;  they  were  obviously  excited  by  the  spectacle  they  had 
just  witnessed. 

People ...  People ..  Mrs.  Dale  spoke  in  a calm  even 

voice  as  she  re-entered  the  classroom. 

“Note  be  quiet!"  Chenoa  advised  her  fellow  classmates. 

“This  is  what  I want  you  to  do.  I want  you  to  get  a textbook, 
and  then  I want  you  to  take  out  a sheet  of  paper  and  write  down 
what  you  remember  about  the  story  that  we  read  yesterday" 

“We  didn't  finish  it!" 

“ l know  we  didn't  finish  it.  I just  want  you  to  write  doivn 
the  part  that  you  remember.. . I'll  be  right  back" 

I was  silently  amazed.  Her  voice  was  calm,  as  if  nothing 
had  ever  happened.  Yet  after  class  that  day  she  stated  that  in  11 
years  of  teaching  this  was  the  first  fight  she  ever  had.  She  didn’t 
seem  disturbed  at  all  as  she  left  the  classroom  to  go  on  down  to 
the  office.  Even  more  surprising  was  the  fact  that  the  students 
immediately  went  to  the  book  shelf  to  get  textbooks. 

“Who  needs  a book?"  asked  Chenoa  as  she  walked  down 
the  row  of  desks  with  an  armload  of  textbooks.  While  she  was 
doing  this  Billy  continued  a blow-by-blow  description  of  the 
fight  to  the  student  behind  him. 

“Shsh,  be  quiet  said  Chenoa. 

It  was  amazing.  In  a few  short  minutes  the  classroom 
transformed  from  a free-for-all  into  a quiet,  productive  classroom, 
minus  any  supervision  from  an  instructor.  Each  student  opened 
up  a book  and  began  to  review  the  story. 

Shortly  afterwards,  Alice  Dale  returned  to  the  classroom 
and  the  lesson  began.  In  her  calm  restrained  voice,  she  continued 
with  the  class  as  if  nothing  peculiar  had  occurred. 

When  examining  this  case  vignette,  emphasis  should  not 
be  placed  upon  the  actual  altercation  in  the  classroom;  rather, 
emphasis  should  be  placed  upon  the  restoration  of  a productive 
atmosphere  by  the  instructor  and  the  students.  It  is  hard  to 
reproduce  in  print  the  calm  restrained  tone  of  voice  which  was 
exhibited  by  Alice  Dale  and  was  so  admirably  captured  on  the 
videotape.  She  remained  tn  control  the  entire  time  and  imparted 
this  sense  of  calm  to  her  students. 

One  might  expect  that  as  soon  as  the  instructor  left  the 
room  the  class  would  dissolve  into  chaos  w ith  students  discussing 
the  fight  and  doing  very  little  of  the  work  assigned  to  them.  Yet, 


the  class  quickly  distributed  the  needed  textbooks  and  quietly 
began  work  on  the  assignment. 

Were  the  students  responding  to  the  voice  and  demeanor 
of  the  instructor?  The  actions  of  the  instructor  must  be  instru- 
mental in  assessing  the  students’  behavior.  While  giving  instruc- 
tions, Alice  Dale’s  demeanor  reassured  the  students  after  the 
confusion  of  the  fight  and  set  a classroom  atmosphere  conducive 
to  unsupervised  activity. 

The  Native  American  heritage  of  the  instructor  may  well 
be  a possible  source  of  her  calm  demeanor.  During  one  interview 
Alice  Dale  stated,  “I  identify  very  strongly  as  being  Indian.” 
[pplint.3.14]  A person’s  beliefs,  mores,  and  behaviors  are  usually 
part  of  one’s  unconscious  worldview  and  have  a direct  effect  upon 
our  outward,  or  explicit  actions  (Garcia,  1991).  Many  Native 
American  peoples  stress  observation,  restraint,  and  respect 
(Hurtado,  1979;  Doomek,  1990). 

During  an  interview  nearly  two  months  before  the  day  of 
the  fight,  Alice  explained: 

I like  for  the  students  to  feel  a calmness  with  me.  I think  that 
they  cannot  feel  calm  with  me  unless  we  have  mutual  trust 
and  respect,  [pplint.1.6] 

Alice  Dale  believes  that  many  things  go  into  expressing 
this  calmness: 

I guess  it  goes  back  again  to  presenting  an  accepting  demeanor 
in  the  classroom  that  is  readily  apparent  to  my  students, 
and  so  much  of  it  is  through  body  bnguage,  through  eye  con - 
tact,  through  tone  of  voice,  through  the  things  that  you  say. 
[pplint.  1.10] 

How  she  develops  this  demeanor  in  the  classroom  is  hard 
even  for  Alice  Dale  to  explain: 

I feel  that  I have  to  have  a trust  or  rapport,  or  at  least  give  a 
reassurance  to  that  student  tbit  l care  about  him  or  her  in 
a personal  way,  that  l care  whether  they  make  it.  Tk.it  I'm 
really  interested  in  them  making  it,  and  the  atmosphere  to 
me  ..just  an  atmosphere  in  a classroom  is  of  tantamount 
importance. . . and  yet  it's  very,  very  difficult  for  me  to  explain 
how  it  is  that  I create  the  kind  of  atmosphere  that  l like  to  see 
in  a classroom.  To  me  it  is  a feeling  of  mutual  trust  and 
respect  between  the  teacher  and  the  student,  and  yet  equally 
its  important  is  the  trust  that  is  developed  between  the  students 
themsekes . and  their  honoring  of  one  another,  [pplint. 1.51 

Five  students  in  this  class  of  nineteen  self-identified 
Native  American  heritage.  One  of  these  students,  Chenoa,  tried 
to  stop  the  fight  and  was  instrumental  in  getting  the  class  hack 
on  task  when  Alice  Dale  left  the  classroom.  The  transcription 
of  the  fight  revealed  further  evidence  of  Chenoa’s  leadership 
role  in  the  absence  of  the  teacher.  She  passed  out  textbooks  to 
students  and  then  admonished  a fellow  classmate  for  reenacting 
the  fight.  However,  Chenoa  was  not  the  only  student  to  show 
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leadership  in  the  classroom,  as  the  video  recording  of  the  event 
visually  documented.  Two  other  female  students,  also  of  mixed 
Native  American  and  African-American  heritage  helped  to  pass 
out  books  to  fellow  classmates  and  then  proceeded  to  work  on 
the  assignment. 

Reviewing  the  literature  on  Native  American  worldview 
affords  an  interpretation  based  on  the  noninterference  model 
of  cognitive  development  as  it  has  been  documented  by  Ted  lock 
& Tedlock  (1975),  Scallon  & Scallon  (1979),  and  Tafoya  (1982). 

Children  are  allowed  a very  wide  range  of  behavior.  Only 
actions  that  might  result  in  serious  physical  damage  are 
prevented.  Minor  damages  such  as  the  bums  that  might 
develop  from  touching  a stove  are  usually  taken  as  less 
serious  than  interfering  in  a child’s  behavior  and  a child 
is  rarely  told  not  to  do  something — It  is  necessary  for 
the  person  in  the  superordinate  position  to  ignore  the 
behavior  of  the  child  in  order  to  avoid  an  inversion  of 
the  relationship.  Paying  too  much  attention  to  the  child 
would  be  tantamount  to  taking  a spectator  role  and  to 
placing  oneself  in  a position  that  is  subordinate  to  the 
child... When  the  child  expects  indifference  and  gets 
strong  intervention  instead  we  can  suppose  that  this  inter- 
vention is  felt  to  be  all  the  more  significant.  (Scallon 
& Scallon,  1979,  p.  31) 

Alice  Dale’s  actions  during  the  fight  demonstrated,  per- 
haps  unconsciously  on  her  part,  this  worldview.  She  did  not 
interfere  with  the  scuffle  until  the  participants  were  a threat 
not  only  to  themselves  but  to  the  entire  class.  At  that  moment, 
she  switched  from  calling  out  the  boys’  names  to  commanding 
the  two  to  stop.  When  desks  began  to  he  knocked  over,  she  walked 
back  to  stop  the  two  males  from  fighting. 

The  use  of  quiet  authority  in  stressful  situations  can  have 
a dramatic  effect  on  student  behavior.  Students  often  cue  their 
behavior  from  persons  in  positions  of  authority.  If  an  instructor 
exhibits  panic  or  distress,  the  students  may  become  panicked  or 
distressed;  likewise,  if  an  instructor  exhibits  a sense  of  calmness 
and  assurance,  then  the  students  will  show  the  same  demeanor. 
Being  culturally  responsive  to  the  overall  needs  of  the  students 
is  of  primary  importance.  A traditional  Native  American  world- 
view may  provide  an  instructor  with  an  emotional  perspective 
necessary  to  deal  with  stressful  and  dangerous  situations  and 
their  aftermath. 

“Little  Nato” 

developed  by  Jeannie  Parscal 

“Little  Nato”  is  located  in  what  might  be  described  as  a 
transitional  area  of  a metropolitan  city.  The  classroom  is  a no- 
frills  portable  beige  unit,  one  of  nine  placed  in  double  rows 
alongside  the  main  school  building.  Although  the  first  impres- 
sion might  he  one  of  drabness,  as  1 enter  the  classroom  the  con- 


trast of  the  interior  is  a shock  to  my  senses.  Sunlight  filtering 
through  a wall  of  windows  casts  a pleasant  glow  that  is  reflected 
off  of  the  plants  within  the  room.  Desks  are  temporarily  clustered 
in  groups  of  three  or  four,  interspersed  with  the  greenery  and 
aquariums,  bird  cages,  and  bookshelves.  An  area  approximately 
one-fourth  of  the  room  size  is  carpeted  and  furnished  with  a 
rocking  chair  and  plush  throw*  pillows.  Inhabitants  of  the  room 
are  diverse  and  often  entertaining:  Baby  often  flies  about  the 
room  when  she  is  not  perched  on  the  teacher’s  shoulder;  Ginger, 
Baby’s  partner,  breaks  any  threat  of  silence  with  a myriad  of 
mating  calls;  and  Sylvester  and  Sebastian  are  always  available  to 
comfort  and  console  the  remaining  human  population.  Although 
the  latter  two  are  deemed  lowly  in  stature  by  most  of  us,  the 
white/black  and  white  rats  are  definitely  the  most  sought  after 
and  loved  by  the  students.  Drop-im  are  always  welcome,  as  every- 
one seems  to  know  that  snakes  and  L nd  crabs  and  fish  of  various 
sort  fit  right  into  this  creative,  educational  atmosphere. 

In  this  setting,  6th-grade  students  learn  language  arts, 
social  studies,  and  life.  The  carpeted  area  is  the  “rain  forest”  and 
is  used  randomly  by  students  whenever  they  feel  the  need  to 
stretch  out,  or  is  utilized  by  small  groups  whenever  more  indi- 
vidualized instruction  is  called  for. 

The  creator  of  this  unlikely  place  of  learning  is  a 47- 
year-old  African-American  female  who  is  known  to  me  best  as 
“Katherine-with-a-K.”  A name  she  chose  because  of  its  ancestral 
significance,  which  is  accompanied  by  an  explanation  grounded 
in  historical  and  racial  pride. 

Coming  from  a family  of  professional  educators,  Katherine 
has  taught  for  27  years  in  elementary*  and  adult  education.  My 
first  encounter  with  her  was  unusual,  in  that  she  wore  clothes 
of  a by-gone  era,  with  a bandanna  tied  around  her  head.  As  we 
spoke  for  the  first  time,  she  began  to  peel  an  unsightly  scar  from 
her  tace.  She  had  just  returned  from  one  of  her  many  perfor- 
mances of  Harriet  Tubman,  which  she  delights  in  sharing  with 
other  schools,  churches  and  community  organizations. 

A simple  conversation  between  two  African-American 
hoys  exemplifies  one  of  the  majoi  findings  in  Katherines  case: 
her  polite  and  positive  manner  used  in  communicating  with 
her  students: 

51  “Did  M.  K tell  you  to  vacuum  the  floor!" 

52  (while  vacuuming  the  Amazon)  “No.'  she  asked  me.” 

The  tone  of  voice  and  the  young  man’s  response  indicated 
the  difference  that  he  felt  between  being  asked  to  do  something 
and  being  told  to  do  it.  1 observed  many  times  as  students  ini- 
tiated the  vacuuming  of  the  carpet  or  feeding  and  watering  of 
the  animals.  Their  sense  of  pride  was  apparent  in  the  contribu- 
tions that  they  made,  which  might  otherwise  have  been  thwarted 
by  a less  sensitive  teacher.  Two  factors  arc  significant  in  regard 
to  self-esteem  and  education.”  A strong  bond  exists  between  a 
student  and  a competent  caretaker  which  aids  in  development 
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of  skills  and  confidence,  and  social  skills  and  self-esteem  enable 
a child  to  take  advantage  of  educational  opportunities  (Comer, 
1988).  In  the  absence  of  positive,  nurturing  caretakers,  the  respon- 
sibility of  fostering  healthy  emotional  development  may  be  left 
to  the  teacher.  Secondly,  sociocultural  misalignment  may  also 
occur  between  home  and  school,  and  it  becomes  the  teacher’s 
responsibility  to  bridge  the  cultural  gap  by  understanding  the 
home  culture  of  the  students.  Katherine  is  well  aware  of  the 
sociocultural  misalignment  that  can  occur  between  home  and 
school,  when  scholastic  ethnicity  interferes  with  family  ethnicity: 

Then  there  are  kids  who . . . perhaps  didn’t  get  any  re'  ‘ They 
got  home  and  Mom  and  Dad  were  dunkin’  and  fussm'  and 
fightin,  and  they  had  to  leave  everything  and  go  seek  shelter 
somewhere ...  or  move  around  from  house  to  house  for  two 
weeks  at  a time  just  to  keep  Momma’s  boy  friend  from  finding 
them.  That’s  a reason;  that’s  not  an  excuse.  I make  allowances 
for  that.  [Int.3] 

Katherine  understands  the  developmental  needs  and 
cultural  backgrounds  of  her  students.  She  gives  her  students  a 
reason  to  care  by  facilitating  their  personal  growth  as  well  as 
academic.  Believing  that  students  should  become  responsible 
for  their  education,  she  constructs  a learning  environment  that 
caters  to,  as  she  calls  it,  “The  needs  of  their  growing  bones.”  [Int.  2] 
Students  and  teachers  are  “products”  of  their  culture— 
the  framework  in  which  they  meet.  Involved  since  the  age  of  17 
in  civil  rights  issues;  Katherine’s  empowering  of  her  people  is 
brought  to  life  anew  within  the  classroom  as  she  seeks  to  empower 
her  students.  By  structuring  a positive,  creative  learning  environ- 
ment, Katherine  facilitates  the  natural  curiosity  and  quen  for 
knowledge  that  her  students  bring  to  the  classroom.  Attending 
to  the  intellectual,  emotional,  and  physical  needs  of  the  child, 
Katherine  successfully  reflects  a pedagogy  that  is  indeed  cul- 
turally responsible.  As  one  student  so  astutely  observed  about 
the  “jungle”  environment  she  had  created:  “This  room  helps 
us  breathe  naturally.” 


Conclusion 

Three  different  teachers,  three  different  cases— each  pro- 
vides a model  for  the  exploration  of  culturally  responsible  peda- 
gogy and  educational  excellence  in  meeting  the  needs  of  diverse 
learners  and  facilitating  success  for  all  students.  As  culturally 
responsible  educators,  these  teachers  eacn  recognize  the  signifi- 
cance of  the  students  cultural,  home,  and  individual  background. 
Equally,  each  of  the^e  educators  is  vitally  aware  of  her  heritage 
and  individual  background. 

While  American  classrooms  have  continued  to  diversity, 
the  view  of  teaching  and  learning  that  has  prevailed  in  this 
country  reflects  the  values,  attitudes,  and  beliefs  of  middle-class 
Americans.  But  as  the  traditional,  mechanistic  paradigm  of 
education  is  being  challenged  by  a more  holistic,  qualitative 
paradigm,  we  are  discovering  that  teachers’  experiences  and 
backgrounds  play  a more  significant  role  in  education  than  has 
been  recognized. 

If  culturally  responsible  minority  educators  provide  models 
for  learning,  mentoring,  and  cultural  patterning,  then  educators 
can  learn  from  these  teachers  and  additional  case  studies  of 
culturally  responsible  educators  can  enrich  the  knowledge  base 
for  teacher  education. 

Note.  All  names  have  been  changed  to  ensure  confidentiality 
of  participants.  Bracketed  information  indicates  color  coding  for 
each  teacher  (e.g.,  red,  purple=ppl)  and  whether  the  information 
was  obtained  from  a journal  entry'  (jn),  classroom  observation 
(obs),  or  an  interview  (int). 

“Restructuring  to  Reclaim  Youth  at  Risk:  Culturally 
Responsible  Pedagogy,”  which  included  the  research  vignettes 
included  in  this  manuscript,  was  presented  at  the  Thirteenth 
Annual  Meeting  of  the  Mid-Western  Educational  Research  Asso- 
ciation, October  16-19,  1991,  Chicago,  Illinois. 
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The  MWERA  1991  Annual  Conference  Evaluation  Results 

A Report  from  the  Member-at-Large:  By  E.  Jane  Williams 


Since  the  1989  MWERA  Annual  Conference,  evaluations  of 
paper  sessions  have  been  conducted.  Prior  attempts  to  evaluate  the  overall 
program  were  unsuccessful.  However,  at  the  1991  conference,  evaluations 
rating  presentations  by  Invited  Speakers  and  the  overall  program,  in  ad- 
dition  to  the  paper  sessions,  were  successful.  This  article  summarizes 
results  of  these  evaluations. 

The  purpose  of  the  MWERA  conference  evaluations  is  to  pro- 
vide rhe  Program  Chair  with  attendees’  input  for  designing  the  next  con- 
ference. The  instrument  used  to  evaluate  the  paper  presentations  pro- 
vided ratings  to  evaluate  both  individual  presentations  as  well  as  rhe 
overall  session.  Respondents  rated  each  presentation  on  clarity,  organiza- 
tion and  interest  as  well  as  noting  if  a paper  was  provided.  The  quality 
of  the  overall  session  was  rated  on  organization,  adequacy  of  facilities, 
coordination  of  topics,  amount  of  time  for  questions/discussion,  and  how 
well  questions  were  answered.  All  items  were  rated  on  a 5-point  scale  rang- 
ing from  strongly  agree  to  strongly  disagree.  A similar  format  was  used 
to  evaluate  presentations  by  Invited  Speakers.  Evaluation  forms  were 
distributed  and  collected  at  the  end  of  the  session.  All  responses  were 
anonymous. 

Evaluation  of  the  annual  program  included  ratings  on  the  follow- 
ing program  aspects:  the  usability  of  the  printed  program,  the  number 
of  invited  speakers,  Wednesday  night  presentations,  Saturday  morning 
sessions,  the  Friday  afternoon  Business  Meeting,  exhibitors,  a “meet  the 
editors”  session,  multicultural  education  sessions,  social  events,  and  the 
overall  conference.  All  aspects  of  the  program  were  rated  on  a 5 -point 
scale  from  very  high  to  very  low. 

Only  overall  results  and  summary  comments  will  be  presented. 
It  should  be  noted,  however,  that  specific  comments/suggestions  have 
been  forwarded  to  the  appropriate  individuals.  Participants  desiring  in- 
dividual feedback  may  contact  the  Memher-At-Large. 

Paper  Sessions*  Completed  fonns  were  returned  by  a total  of  2 18 
people  attending  3 1 sessions.  Although  there  were  fewer  sessions  evaluated 
in  1991,  the  percentage  of  sessions  returning  evaluations  (60%)  was  higher 
than  in  1990  (57%)  and  1989  (42%).  Results  are  presented  in  Tihle  1. 


Table  1 

Evu/uatton  Ratings  by  Category  of  t/ie  MWERA  Riper  Sessions 


C\iu*g**r\ 

N 

Mran 

sn 

Tile  session  was  very  well  organized 

218 

4.57 

.65 

Tlie  facilities  were  adequate 

217 

4.29 

.88 

Tlie  topics  were  coordinated  

There  was  adequate  time  for 

217 

4.55 

.80 

quest  ion>/di>cussion 

214 

5.80 

1.55 

Questions  were  answered  adequatclv 
Note.  A 5-pomt  scale  was  used. 

l°7 

4.27 

.81 

Again,  as  in  1990,  the  item  with  the  highesr  overall  rating 
was  The  session  was  very  well  organized’  (Table  1).  The  item  that 
showed  the  greatest  change  from  1990  was  There  was  adequate  time  for 
quest ums/discussion.'  Responses  to  tins  item  for  1991  were  less  positive 
than  in  1990(1990:  X = 4.*>1,  SP— .84).  Attendees’  indicated  the  desire 
for  more  time  for  audience  partieipation/involvement  either  by  decreas- 
ing the  number  of  presenters  per  session  or  by  increasing  the  ttn.il 
amount  of  time  per  session.  Discussants  were  considered  an  asset  to  the 
sessions.  Discussants  were  deemed  especially  beneficial  when  they  were 
organized;  made  reflective,  insightful  and  helpful  comments/suggestions; 
allowed  for  questions  and  audience  participation;  gave  equal  time  to  all 
prr«renrcnq  and  were  not  cynical. 


Additional  written  comments  included  suggestions  in  the  areas 
of  scheduling/planning,  and  sessions  in  general  and  specifically.  Sugges- 
tions included  requests  to  provide  screens  to  permit  improved  readability 
of  overheads,  to  provide  a column  to  evaluate  the  discussant;  to  schedule 
a lunch  break;  not  to  schedule  sessions  during  the  Association  Council 
Meeting;  to  have  presenters  provide  papers;  and  to  have  presenters  provide 
the  discussant  with  a copy  of  the  paper  prior  to  the  session.  Overall, 
respondents  appeared  to  he  very  pleased  with  the  presentations  and 
paper  sessions. 

Invited  Speakers.  A total  of  55  completed  evaluations  were  re- 
turned evaluating  two  of  the  Invited  Speakers,  Drs.  Levin  and  Palincsar. 
Comments  regarding  Dr.  Levin’s  presentation  evolved  around  three  major 
areas:  the  presentation,  topic,  and  time.  Many  noted  that  this  was  a very- 
good  presentation,  timely  both  personally  and  professionally,  and  well 
organized.  It  raised  philosophical  questions  such  as  “What  constitutes 
‘scientific?’  ” and  “What  provides  the  most  benefit  to  a discipline?” 

Comments  about  Dr.  Palincsar’s  presentation  were  reflective  of 
her  ability  to  present,  i.e.,  being  a fine  presenter,  having  a high  energy 
level,  and  serving  as  a wonderful  role  model.  One  individual  noted  that 
Palincsar’s  talk  was  a nice  follow-up  to  Levin’s  talk  or*  classroom  research! 

Overall  Conference.  Results  are  displayed  in  Table  2. 


Table  1 

Euihuitum  Ratings  by  Category  of  the  MVi'ERA  Annual  Meeting 

Catm*r> 

N 

Mean 

sn 

The  design  of  printed  program 

57 

4.35 

.79 

Usability  of  conference  program 

57 

4.30 

.88 

Having  large  number  of  Invited  Speakers  . 

57 

4.35 

.79 

Beginning  sessions  Wednesday  night 

35 

3.89 

1.16 

Having  Saturday  morning  sessions 

35 

3.03 

1.14 

Holding  Business  Meeting  on  Friday 

31 

3.74 

1.06 

Having  exhibitors 

35 

3.94 

1.09 

Having  ‘Meet  the  Editors’  session 

35 

4.M 

.76 

Having  Multicultural  Education  session  . . 

36 

3.92 

1.23 

Having  social  events 

37 

4.24 

.68 

Note-.  A 5-pomt  scale  was  used. 

Item  responses  were  fairly  consistent  across  membership  gamps. 
Written  commenrs  included  the  following  areas:  the  meeting  in  general, 
presentations,  the  luncheon  and  speaker,  the  program,  and  organizational 
matters  Much  praise  was  given  to  the  overall  conference,  i.e.,  its  variety, 
the  allowance  for  the  infusion  of  young  and  more  experienced  scholars 
as  well  as  student  presentations  and  professional  development,  its  organiza- 
tion with  the  incorporation  of  a welcome  for  new  members  and  social 
events  such  as  hospitality  sessions.  Other  specific  comments/suggestions 
included:  sending  guidelines  to  chairs,  presenters,  *nd  discussants;  holding 
round  tabic  sessions  of  work  in  progress;  allowing  time  at  the  luncheon 
to  socialize  before  beginning  the  program;  keeping  the  luncheon  ‘less 
busy’;  keeping  the  Business  Meeting  on  Saturday  rather  than  Friday; 
noting  that  a large  number  of  Invited  Speakers  could  become  problematic; 
having  a “Meet  the  Editors”  session  is  good,  but  not  every  year;  and  put- 
ting more  effort  into  pre-conference  workshop  details.  The  Bismarck  was 
considered  a good  location. 

Overall,  findings  relevant  to  future  program  planning  included 
such  suggestions  as:  providing  opport  unities  for  discussions  ai  paper  ses- 
sions by  eithei  decreasing  the  number  of  presenters  per  session  or  increas- 
ing the  total  amount  of  time  per  session,  and  equipping  nmms  with  screens 
for  overheads.  Again,  overall  ratings  and  comments  by  respondent  about 
i be  paper  sessions,  invited  speakers,  and  the  overall  program  indicated 
that  this  was  a urv  good  conference. 
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MWERA  1992  Annual  Meeting 

October  14-17,  1992 


Plans  for  the  fourteenth  annual  meeting  of  the  Mid-Western  Educational  Research  Association  arc  under  way.  There  are  key  activities 
which  include  a featured  presentation  Wednesday  evening.  Tom  Good,  University  of  Missouri,  will  speak  on  Small  Group  Learning:  Problems  and 
Potential.  He  will  also  present  the  keynote  address  on  the  topic  of  Research  on  New  Directions  in  Teacher  and  Student  Expectations  Thursday 
morning.  The  Presidential  Address  by  Barbara  Plake,  University  of  Nebraska-Lincoln,  will  be  presented  on  Friday  morning.  Her  topic  will  be 
Teachers1  Assessment  Literacy.  The  following  three  events  are  specifically  included  to  facilitate  professional  growth:  Graduate  Student  Workshop 
(Thursday),  Exhibits  (Friday),  and  Meet  the  Editors  (Friday). 

Several  important  evcnts/activitics  will  continue  on  Friday  and  Saturday.  We  will  have  as  our  luncheon  speaker  Tony  Riccio,  The  Ohio 
State  University-Columbus.  His  topic  will  be  Making  the  Big  Decisions.  Paper  and  symposium  sessions  will  be  scheduled  until  noon  on  Saturday. 

The  most  important  part  of  the  1992  conference  though  is  YOU!  We  need  your  ideas  and  your  research  presented  at  the  annual  meeting. 
We  also  need  you  to  pass  the  word  about  how  wonderful  the  MWERA  conferences  have  been.  Please  tell  eolleagues/students  about  MWERA  and 
the  1992  program  and  encourage  them  to  join  the  organization  and  submit  a proposal.  MWERA  encourages  students  to  present  their  research. 
Incentive  awards  are  presented  to  students  who  author/co-author  a research  paper  and  attend  the  Business  Meeting. 

Richard  C.  Pugh,  1992  Program  Chair 


Call  for  Proposals 


I.  GENERAL  INVITATION  FOR  PARTICIPATION 

You  are  cordially  invited  to  attend  and  participate  in  the 
Fourteenth  Annual  Meeting  on  October  14-17,  1992,  at  the 
Bismarck  Hotel  in  Chicago,  Illinois. 

CONFERENCE  HIGHLIGHTS: 

WEDNESDAY,  OCTOBER  14 

• Training  Workshops. 

Concurrent  sessions  starting  at  noon  and  3:30  p.m. 

• Special  Night  Session,  8 to  9 p.m. 

Speaker:  Thomas  Good 
University  of  Missouri 

Topic:  Small  Group  Learning:  Problems  and  Potential 
THURSDAY,  OCTOBER  15 

• Keynote  Address 
Speaker:  Thomas  Good 
University  of  Missouri 

Topic:  Research  on  New  Directions  in  Teacher  and 
Student  Expectations 

• Division  Discussion  Meetings 

• Graduate  Student  Workshop 

• Evening  Social,  6 to  8 p.m. 

FRIDAY,  OCTOBER  16 

• Pres  id  i ntial  Address 

Barbara  Plake 

University  of  Nebraska-Lincoln 
Topic:  Teachers'  Assessment  Literacy 


• Business  Meeting 

Student  Research  Incentive  Awards 

• Luncheon 
Speaker:  Tony  Riccio 

The  Ohio  State  University-Columbus 
Topic:  Making  the  Big  Decisions 

• Exhibits 

• Meet  the  Editors 

The  editors  of  several  major  journals  will  display  and 
discuss  their  journals. 

• President’s  Reception,  Bismarck  Regency  Suite,  9 p.m. 
SATURDAY,  OCTOBER  17 

• MWERA  Fun  Run 

• Paper  and  Symposium  Sessions  scheduled  until  noon. 

II.  GENERAL  INFORMATION 

A.  Proposals  may  be  in  the  form  of  scholarly  papers,  symposia, 
workshops,  or  other  innovative  formats.  Deadline:  Must  be 
postmarked  first-class  by  May  15, 1992.  All  proposals  will  be 
peer-reviewed. 

B.  Any  educational  researcher,  whether  MWERA  member  or 
not,  may  submit  a proposal.  Nonmembers  whose  papers 
and/or  symposia  are  accepted  for  presentation  must  join 
MWERA  upon  notification  of  an  accepted  proposal. 

C.  MWERA  reserves  the  right  to  reproduce  and  distribute 
summaries  and  abstracts  of  all  accept cd  proposals.  Unless 
expressly  prohibited  in  writing  by  the  nuthor(s),  summaries 
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may  also  be  made  available  to  the  press  or  other  interested 
parties  upon  request.  Such  limited  distribution  does  not,  of 
course,  preclude  subsequent  publication  of  a summary  or 
complete  paper  by  the  author(s). 

D.  All  persons  attending  the  Annual  Meeting,  including 
participants,  are  required  to  register  for  this  meeting  and  be 
members  of  the  Mid-Westcm  Educational  Research 
Association.  All  sessions  listed  in  the  program  will  be  open 
to  anyone  registered  for  the  meeting.  A small  fee  will  be 
charged,  and  enrollment  may  be  limited  for  Training 
Workshop  participation.  Materials  for  registering  for  the 
Annual  Meeting  will  be  published  in  the  Mid-Western 
Educational  Researcher . 

E.  Participants  in  paper  sessions  and  symposia  must  distribute 
handouts  to  attendees  at  their  sessions.  Paper  presenters  are 
expected  to  have  a written  paper  available  for  prior  review  by 
the  Session  Chair  and  Discussant.  Papers  may  also  be 
submitted  to  ERIC  for  distribution  to  the  profession.  This 
docs  not  preclude  formal  publication  in  a journal.  ERIC  forms 
will  be  available  at  the  Conference  Registration  desk. 

F.  We  arc  attempting  to  have  overhead  projectors  available  in 
every  meeting  room  for  use  by  presenters.  No  other 
audio-visual  equipment  will  be  provided.  If  special 
audio-visual  equipment  is  needed,  the  presenter  will  have  to 
provide  his/her  own  equipment  at  presenter’s  expense. 

HI.  GUIDELINES  FOR  PAPER  PROPOSALS 

A.  General  Information  About  Paper  Proposals 

1.  Only  papers  not  previously  presented  or  published  are 
eligible. 

2.  The  Program  Committee  will  group  papers  into  sessions, 
organized  by  topics  of  interest  to  the  conference.  The 
Program  Committee  may,  at  its  discretion,  include  a 
discussant  to  critique  the  papers  in  any  particular  paper 
session.  Those  presenters  assigned  a discussant  are  to 
provide  a copy  of  the  paper  to  the  discussant  two  weeks 
prior  to  the  meeting. 

3.  Generally,  papers  will  be  allotted  15  minutes  per 
presentation.  It  will  be  the  responsibility  of  the  Session 
Chair  to  consult  with  the  presenters,  allocate  time,  and 
ensure  that  the  agreed  schedule  is  followed. 

4.  It  is  the  responsibility  of  the  presenting  author  of  r.n 
accepted  proposal  to  appear  at  the  Annual  Meeting  to 
present  the  paper.  If  unforeseen  circumstances  arise  that 
prevent  an  author  from  presenting  a paper,  it  is  his/her 
responsibility  to  arrange  for  a suitable  substitute  to  make 
the  presentation,  discuss  the  arrangements  with  the 
Session  Chair,  and  notify  the  Annual  Meeting  Program 
Chair:  Richard  C.  Pugh,  School  of  Education,  Indiana 
University,  Bloomington,  IN  47405,  812-855-4053. 

B.  Material  to  bo  Submitted  with  a Paper  Proposal 

♦ Paper  Proposal  Cover  Sheet  (3  copies).  See  attached 
fo  nn. 

• Summary  (3  copies  of  a 2-3  page  summary  typed  single- 
spaced on  V/i  x 1 1 paper).  The  Summary  will  be  used  in 
judging  the  merits  of  the  proposal.  It  should  contain  as 
many  of  the  following  guidelines  as  arc  applicable. 

a.  Title  of  Paper 

b.  Objectives 

c Pcrspective(s)  or  theoretical  framework 
d.  Methods,  techniques,  or  brief  literature  review 
c Data  source  (if  appropriate) 
f Results,  conclusions,  or  point  of  view 


g.  Edueational/seientific  importance  of  the  study 

NOTE:  Only  the  Title  of  the  Paper  should  appear  as 
identifying  information  at  the  top  of  the  Summary.  Please 
do  not  include  name  or  institutional  affiliation,  in  order  to 
permit  blind  review. 

• Abstract  (3  copies).  A 100-200  word  narrative  abstract 
should  be  prepared  for  publication  in  the  Annual  Meeting 
Abstracts.  The  Abstract  should  contain,  in  abbreviated 
form,  information  listed  in  the  above  guidelines  for  the 
2-3  page  Summary.  Use  clear,  precise  language  and  no 
abbreviations  confusing  to  readers  unfamiliar  with  the 
discipline.  Abstracts  should  be  typed,  single-spaced  on 
8*A  x 1 1 paper.  An  abstract  longer  than  200  words  will 
not  be  published.  One  copy  of  the  Abstract  should  show 
the  title  and  name(s)  of  the  author(s)  and  their  affiliated 
institution(s)  typed  at  the  top  left  margin  of  the  page,  in 
the  format  below:. 

Title  of  Paper  (Caps  and  lower  case) 

AUTHOR(S)  (ALL  CAPS).  Institutional  affiliation(s) 
(Caps  and  lower  case) 

Two  copies  should  show  Title  of  Paper,  but  no  Name(s) 
or  Institutional  affiliation(s)  in  order  to  allow  a blind 
review. 

• Envelopes  (3  self-addressed,  stamped,  business-size 
envelopes).  These  will  be  used  to  inform  you  of  (1)  the 
receipt  of  the  proposal,  (2)  tli  reviewers’  decision,  and 
(3)  the  scheduled  session  time. 

• Index  Cards  (three,  3x5  index  cards).  These  should  be 
prepared  as  follows: 

Title  of  Paper 

Name  of  presenting  author  (last  name  first) 

Institutional  affiliation 

Complete  address  (with  zip  code) 

Telephone  number  (with  area  code) 

• Three  copies  (8 '/z  x 11)  of  a list  of  all  author(s),  including 
name(s),  institutional  affiliation^*),  complete  addrcss(es), 
and  telephone  numbcr(s). 

IV.  GUIDELINES  FOR  SYMPOSIUM  PROPOSALS 

A.  General  Information  About  Symposium  Proposals 

A Symposium  is  intended  to  provide  an  opportunity  for 
examination  of  specific  problems  or  topics  from  a variety  of 
perspectives.  In  addition  to  allowing  for  informative 
discussion,  a Symposium  should  provide  for  presentation  of 
alternative  solutions  or  interpretations  cither  of  a common 
problem  or  in  relation  to  a complementary  theme.  This 
purpose  is  best  served  when  individuals  with  diverse  or 
conflicting  views  are  allowed  to  interact  on  a topic  of 
sufficient  scope  and  importance.  It  should  be  noted  that  a 
Symposium  should  not  be  merely  a presentation  of  a set  of 
related  papers.  While  such  complementary  papers  arc  clearly 
worthwhile,  they  should  be  submitted  as  individual  papers 
with  an  indication  of  suggested  grouping  on  the  Cover  Sheet 

B.  Responsibilities  of  Organizers  of  Symposium 

It  is  the  responsibility  of  the  Symposium  Organizer  to  suggest 
topics  and  solicit  speakers  and  discussants.  Organizers  of 
symposia  must  have  the  consent  of  all  participants  before 
submitting  the  proposal.  C,-  guni/ers  not  wishing  to  chair  the 
session  must  invite  chaiqxrsom  The  Organizer  of  a 
symposium  is  responsible  for  ascertaining  that  each  person 
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named  as  a participant  will  be  present  at  the  meeting  if  the 
session  is  accepted.  Should  unforeseen  circumstances  prevent 
a participant  from  attending,  it  is  the  responsibility  of  the 
Organizer  to  find  a suitable  replacement  and  notify  all  other 
participants  in  the  session  as  well  as  the  MWERA  Annual 
Meeting  Program  Chair.  It  is  expected  that  the  discussant(s) 
and  the  participants  have  access  to  summaries  of  each 
presentation  two  weeks  prior  to  the  meeting  so  that  they  may 
be  able  to  formulate  their  remarks  in  the  context  of  what  the 
others  plan  to  say.  Only  the  Organizer  will  be  notified  of 
acceptance  of  a Symposium,  and  she/he  is  responsible  for 
notifying  other  participants  in  the  Symposium. 

C . Materials  to  be  Submitted  with  a Symposium  Proposal 

• Symposium  Proposal  Cover  Sheet  (three  copies).  Sec 
attached  form. 

• Summary  (3  copies  of  3-5  page  summary  typed 
single-spaced  on  8*^  x 11  paper).  The  summary  will  be 
used  in  judging  the  merits  of  the  proposal.  It  should 
contain  as  many  of  the  following  guidelines  as  arc 
applicable. 

a.  Title  of  Presentation 

b.  Objectives  of  the  symposium 

c.  Educational  or  scientific  importance 

d.  For  each  presentation,  include  a one-page  overview 
with: 

Title  of  presentation 
Objectives 

Perspectives  and/or  methods 
Data  source  (if  appropriate) 

Results,  conclusions,  or  point  of  view 

NOTE:  Please  do  NOT  show  the  Names  or  Institutional 
affiliations  of  the  presenters  on  this  Summary,  in  order  to 
allow  a blind  review. 

• Abstract  (3  copies).  A 300-400  word,  narrative  abstract 
should  be  prepared  for  publication  in  the  Annual  Meeting 
Abstracts.  The  Abstract  should  represent,  in  abbreviated 
form,  the  information  contained  in  the  3-5  page 
Summary.  Use  clear,  precise  language  and  avoid 
abbreviations  that  might  be  confusing  to  readers 
unfamiliar  with  your  field.  Abstracts  should  be  typed 
single-spaced  on  8^  x 11  paper.  An  abstract  longer  than 
400  words  will  not  be  published.  Be  sure  that  one  copy 
has  the  following  information  at  the  top  left  margin  of  the 
page: 

Title  of  Symposium  (Caps  and  lower  case) 

ORGANIZER  (ALL  CAPS),  Institutional  affiliation 
(Caps  and  lower  case) 

CHAIRPERSON  (ALL  CAPS),  Institutional  affiliation 
(Caps  and  lower  case) 

PARTICIPANTS  (ALL  CAPS),  Institutional  affiliation 
(Caps  and  lower  case) 

Two  copies  of  the  Abstract  should  NOT  show  any 
Namc(s)  or  Institutional  affiliation(s),  in  order  to  allow  a 
blind  review. 

• Envelopes  (3  self-addressed,  stamped,  business-size 
envelopes).  These  will  be  used  to  inform  the  Organizer  of 
(1)  receipt  of  the  proposal,  (2)  the  reviewers1  decision, 
and  (3)  the  scheduled  session  time. 

• Index  Cards  (three,  3x5  index  cards).  These  should  be 
prepared  as  follows: 


Title  of  symposium 

Name  of  organizer  (last  name  first) 

Institutional  affiliation 
Complete  address  (with  zip  code) 

Telephone  number  (with  area  code) 

Name  of  symposium  chairperson  (last  name  first) 

Institutional  affiliation 

Complete  address  (with  zip  code) 

Telephone  number  (with  area  code) 

• Three  copies  (8 ]/i  x 1 1)  of  a list  of  all  participants  in  the 
symposium,  including  their  individual  presentation  title, 
names,  institutional  affiliations,  complete  addresses,  and 
telephone  numbers.  The  chairperson,  discussant(s),  and 
presenters  should  be  included  in  this  list,  and  identified  as 
such. 

GUIDELINES  FOR  TRAINING  WORKSHOP  PROPOSALS 

A.  General  Information  About  Training  Workshop  Proposals 
Workshop  topics  should  be  of  interest  and  use  to  a number  of 
MWERA  members.  Presenters  will  receive  an  honorarium 
based  on  the  number  of  participants  attending  the  workshop. 
All  persons  listed  as  presenters  arc  required  to  appear  at  the 
conference  and  present  the  workshop  at  the  designated  time. 
All  workshops  will  be  on  Wednesday,  October  14,  1992, 
cither  starting  at  noon  or  3:30  p.m.  Some  workshops  may  be 
offered  twice.  Workshop  proposals  should  be  sent  to  the 
Training  Workshop  Coordinator,  Stephen  Benton  (sec  address 
on  page  5). 

B . Materials  to  be  submitted  with  a T raining  Workshop  Proposal 

• Cover  Sheet  (Use  Symposium  Proposal  Cover  Sheet.  See 
attached  form.)  Send  two  copies  with  all  items  complete. 
Strike  out  the  word  "Symposium"  and  write  in 
"Workshop."  Indicate  the  total  amount  of  time  you 
believe  will  be  needed.  Please  note  that  in  special 
circumstances  a workshop  may  be  allocated  more  than 
three  hours. 

• Summary  (3  copies  of  a 2-3  page  summary  typed 
single-spaced  on  8V£  x 1 1 paper).  This  will  be  used  to 
judge  the  proposal.  The  summary  should  include 
information  such  as  the  following. 

a.  Objectives  (knowledge,  skills  for  participants) 

b.  Suggested  entry-level  skills  for  participants 

c.  Educational  or  scientific  importance  of  the  topic 

d.  Perspectives,  orientations,  or  theoretical  framework 
c.  Methods  or  techniques  of  instruction 

f.  Description  of  presenter’s  relevant  experience 

• Abstract  (3  copies).  A 100-200  word,  narrative  Abstract 
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Culture,  Style,  and  Equity  in  Education: 


An  Interview  with  Asa  Hilliard 


By  E.  Jean  Harper 
Dayton  Public  Schools 


Q 


You  have  stated  that  the 
learning  styles  of  African- 
American  children  are  often 
misunderstood  by  Ameri- 
can educators*  This  mis- 
understanding leads  to  un- 
realistic expectations  and 
the  miseducation  of  Afri- 
can-American children* 

Could  you  elaborate  on 
this  point*? 

There  are  three  issues  that 
need  to  be  explored  relative 
to  the  learning  styles  of  Afri- 
can^American  children.  First, 
there  is  a question  as  to 
whether  there  is  any  reality 
to  cultural  style.  Are  Afri- 
can-Americans unique  in 
any  behavioral  way?  There  is 
a data  base  that  overwhelm- 
ingly shows  that  African- 
Americans  have  something 
special.  Some  chose  not  to 
consider  this  data  base  and 
disagree  philosophically.  For 

example,  some  liberal  types  refuse  to  acknowledge  differ- 
ences. They  just  want  happiness  all  over  the  world.  To 
them,  difference  fc  threatening.  Though  all  people  are 
fundamentally  the  same,  if  they  spend  a great  deal  of 
time  together,  they  tend  to  act  alike.  They  share  a com- 
mon core  culture. 

The  second  issue  in  style  is  racial.  Empirically  we 
can  prove  that  some  people  have  a habitual  way  of  ap- 
proaching situations,  but  it  does  not  have  anything  to 
do  with  biology.  If  you  have  a country  that  is  organized 
politically  around  race,  you  will  have  created  a culture 
that  is  different  from  the  culture  of  another  race.  They 
will  develop  patterns  that  are  distinctive  because  they 
are  socialized  together.  The  general  category  is  race  and 
the  subtopic  is  cognitive;  and  you  can  spot  those  different 
modes  of  functioning.  This  does  not  mean  that  everyone 
that  is  Black  is  going  to  act  like  everyone  else  who  is 
Black.  It  does  mean  that  there  is  a majority  who  will 


A sa  Hilliard,  Ph.D.,  Fuller  E.  Callaway  Professor. ; Department 
of  Educational  Foundations , Georgia  State  University , Atlan- 
ta, Georgia.  Dr. ; Hilliard  is  a psychologist,  historian  and  educator. 
He  is  the  author  of  numerous  articles  and  books  focusing  on  the 
needs  of  African-Americans. 


Q 


behave  in  similar  ways  and 
who  will  be  identifiable,  cul- 
turally, because  of  their  race. 

Business  people  know 
that  when  they  are  trying 
to  sell  something  to  an  Afri- 
can-American audience, 
the  promotion  is  different 
than  when  they  try  to  sell 
to  a white  audience.  For 
example  if  they  play  coun- 
try’ and  western  music,  they 
probably  will  not  attract  a 
black  audience.  Business 
has  no  problem  “segment- 
ing” the  market.  They  know 
what  appeals  to  African- 
Americans,  what  appeals  to 
Hispanics,  and  what  appeals 
to  European  Americans.  As 
a result,  they  tailor  their 
approach  to  those  constit- 
uencies. Educators,  on  the 
other  hand,  because  we  are 
not  profit  driven,  have  not 
responded  inkind. 

Third,  although  style 
is  correlated  with  race  due 
to  economic  and  political 
factors,  is  it  pedagogically 
meaningful?  Educators  might 
want  to  design  pedagogy'  based  upon  what  we  know  about 
the  styles  of  African-American  students. 


What  are  some  elements  of  the  African-American  style? 


A.  Improvisation  versus  preconception.  African-Ameri- 
cans prefer  to  have  a pattern,  but  yet  there  is  a need  to 
have  the  freedom  to  vary1  within  the  performance  of  the 
pattern.  An  example  of  that  is  improvisational  jazz.  Pre- 
conception, rather  than  improvisation  is  more  typical 
of  the  European  style.  You  have  polar  opposites  in  terms 
of  the  rules  for  creative  development.  It  is  also  clear  that 
since  Europeans  and  Africans  have  been  occupying  the 
same  space,  there  is  a great  deal  ot  crossover.  Dance,  is 
another  example.  Europeans  tend  to  preconceive  all  of 
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An  Interview  with  Hilliard  ( continued ) 

their  moves  and  execute  their  plans.  Though  that’s  an 
example  of  dance,  the  same  is  true  of  teaching.  Style  is 
so  generic  and  fundamental.  Style  manifests  itself  in 
many  areas,  such  as  language.  To  say  that  there  is  no  dif- 
ference  in  style,  one  would  have  to  be  totally  blind  and 
incapable  of  identifying  differences.  Style  is  learned,  if 
you  can  learn  one  style,  then  you  can  learn  another.  You 
may  not  want  to  adopt  tht  other  style,  but  you  can  leam 
it.  The  big  issue  is  whether  the  existing  style  in  educa- 
tion can  be  enhanced  by  using  alternative  styles.  1 believe 
this  will  improve  the  overall  learning  environment  of  all 
children,  not  just  African-American  children. 


Are  there  other  ways  that  cultural  style  manifests  itself? 


A 


The  tendency  to  fragment  things  whether  it’s  global  or 
elemental.  Europeans  tend  to  take  things  apart  and  ana- 
lyze through  a linear  method.  Africans  tend  to  put  things 
together  and  view  things  in  a wholistic  method.  Afri- 
cans also  tend  to  be  more  person-oriented.  Interpersonal 
aspects  are  not  as  important  to  whites  as  the  features  of 
the  situation.  However,  interpersonal  qualities  are  very 
important  to  Blacks.  It  can  be  seen  in  humor.  A stand-up 
comedian  in  the  traditional  sense  makes  humor  by  a 
play  on  words;  contrast  that  with  Richard  Pryor  who 
bonds  with  the  audience  and  uses  the  feelings  of  the 
audience.  The  words  are  rather  secondary.  If  you  simply 
wrote  down  what  Richard  Pryor  said  in  a book,  the  words 
probably  would  not  be  funny. 


You  have  written  that  school  systems  have  been  oppres- 
sive and  inequitable  to  African-American  children.  How? 


A 


Primarily  due  to  the  culture.  If  you  have  apartheid  in  the 
general  society,  then  there  will  also  be  apartheid  tn  the 
schools.  A recent  survey  conducted  by  the  University  of 
Chicago  and  Johns  Hopkins  University  found  that  over 
50  percent  of  those  interviewed  believe  Blacks  are  inferior 
to  Whites.  If  this  is  also  true  for  the  White  psychologists 
and  White  teachers,  then  this  belief  has  significant  impli- 
cations and  heavily  impacts  the  classroom.  This  belief 
will  manifest  itself  into  negative  behavior  that  would  be 
harmful  to  children.  The  inequity  in  the  general  culture 
manifests  itself  in  the  schools.  If  there  is  a class  system 
outside  of  the  school,  there  will  be  one  in  the  school. 
We  need  more  than  pedagogical  change,  we  also  need 
political  change. 


How  can  schools  become  more  democratic? 


By  creating  an  educational  environment  in  which  elitism 
is  minimized,  an  environment  in  which  children  will 
receive  the  same  services  independent  of  their  income. 
One  where  teachers  are  attuned  to  the  culture  of  the 
students  so  that  students  do  not  feel  alienated.  An 
environment  that  demonstrates  respect  for  the  creative 
and  critical  capacity  of  children.  Race  and  income  are  not 
variables  in  a democratic  environment.  Democratic 
schools  are  equitable.  Equity  is  making  the  opportunity 
to  receive  what  you  need  to  get  an  outcome.  If  a student 
needs  a wheelchair,  you  don’t  need  to  buy  a wheelchair 
for  everyone.  Democratic  schools  value  cultural  democracy 
rather  than  cultural  simulation.  Some  are  fearful  of  the 
ethnic  identity  of  certain  groups,  such  as  the  African- 
Americans  and  Hispanics.  Some  want  to  wipe  out  of  all 
ethnic  groups.  Democratic  schools  do  not  require  that  one 
melts,  but  gives  one  the  choice. 


Do  you  believe  that  today’s  educators  are  culturally 
retarded? 


A 


Yes.  A culturally  retarded  person  is  one  who  sees  no 
differences,  yet  the  differences  are  there.  It  is  a fear  of 
differences  that  makes  one  not  perceive  the  differences. 
The  culturally  retarded  person  does  not  have  the  ability 
to  see  and  detect  differences.  The  differences,  ex  post 
facto,  create  inequity.  Teachers  are  socialized  into  one 
cultural  group.  Therefore  when  they  meet  those  from 
other  cultures,  they  do  not  know  how  to  interact  and 
react.  Minority  groups  are  forced  to  be  skillful  in  maneuver- 
ing two  or  more  cultures.  Educators  need  to  be  become 
culturally  sophisticated  to  be  able  to  deal  skillfully  with 
those  of  different  culture  For  example,  a culturally  sen- 
sitive teacher  would  realize  that  English  is  only  one  variety 
of  language,  it  is  not  language. 


What  is  the  role  of  the  professor  in  preparing  teachers  to 
be  more  culturally  sophisticated? 


Higher  education  professors  must  do  their  homework, 
have  pluralistic  preparation  and  he  able  to  refer  them  to 
literature,  suggest  effective  practices  and  engage  them 
in  dialogue  that  will  assist  them  in  becoming  culturally 
sophisticated.  Higher  education  professors  must  ensure 
that  African-Americans  and  other  minorities  are  not 
excluded  from  their  research  teams  and  that  cross-cultural 
research  is  interpreted  and  used  properly.  Professors  must 
also  be  certain  to  include  cross-cultural  publications  in 
their  syllabi. 
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An  Interview  with  Hilliard  (continued) 


Do  you  favor  or  oppose  the  current  student  testing 
* movement? 

] Oppose.  Tne  testing  movement  is  mostly  useless.  Achieve- 
J ment  tests  have  problems,  but  these  problems  can  be  fixed. 
IQ  tests  have  problems,  and  the  problems  cannot  be 
fixed.  IQ  tests  make  no  contribution  to  improving  edu- 
cational practice  and  generally  tend  to  harm  it.  Therefore, 
IQ  tests  should  be  eliminated.  Achievement  testing  is 
a must  and  it  can  be  improved.  We  can  discuss  whether 
the  test  should  be  essay,  multiple  choice,  observation 
or  portfolio  assessment,  but  I’m  more  interested  in  equity. 
Equity  is  very  important.  My  goal  is  to  help  eliminate 
tests  that  hurt  African-American  students,  and  to  ‘ prove 
the  quality  of  the  achievement  test,  which  is  necessary 
to  determine  academic  growth. 


observe  you  and  relate  that  to  how  good  you  are  in  the 
classroom.  I am  not  going  to  criticize  your  tactics  if  you 
can  demonstrate  that  students  are  learning.  However,  if 
you  perform  in  a way  that  is  considered  to  be  perfect 
pedagogy  but  kids  are  not  learning,  then  your  score  on 
the  teacher  competency  exam  is  of  little  consequence.  It 
has  been  empirically  proven  that  teacher  tests  and  the 
work  of  teachers  in  the  classroom,  are  unrelated. 


When  do  tests  become  hurdles  for  teachers. 


When  the  test  prevents  professionals  from  advancing. 
Also,  when  the  test  used  is  unrelated  to  student  achieve- 
ment or  improvement  of  teacher  preparation. 


In  your  view,  how  valuable  are  teacher  competency  tests. 


What  prerequisites  are  required  for  teachers  to  become 
competent? 


Worthless.  It  is  nor  worthless  to  assess  teachers.  Assess- 
ment is  a part  of  all  education  in  all  sciences.  Teacher 
competency  testing  is  usually  a test  of  basic  skills  and  a 
number  of  other  competencies  unrelated  to  that  which 
has  proven  to  be  successful  in  the  classroom.  If  1 wanted 
to  know  how  good  you  were  as  a teacher,  then  I would 


0The  quality  of  relationship  (personality  attributes  and 
communication)  and  academic  preparation  (content).  I 
am  not  convinced  that  it  is  a skill  issue  that  will  enable 
teachers  to  teach.  It  is  the  attitude  of  the  teacher  that  will 
determine  the  quality  of  the  teaching  that  takes  place  in 
the  classroom  and  the  level  of  student  achievement. 
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Multicultural  Considerations  in  Assessment 

By  Lori  A.  Spadafore,  Ball  State  University 


One  of  the  trademarks  of  American  public  education 
has  been  to  expand  and  change  the  curriculum  in  such  a manner 
that  the  educational  needs  and  differences  of  all  children  are 
met.  It  is  unfortunate,  however,  that  this  expansion  has  failed 
to  recognize  the  sometimes  subtle,  but  always  important,  differ- 
ences  involving  ethnicity  and  culture.  It  is  perhaps  these  differ- 
ences among  children  that  are  accountable  for  the  alarming 
number  of  minority  children  enrolled  in  special  education  pro- 
grams throughout  the  United  States.  In  a recent  report  by  Bowman 
(1988),  researchers  found  that  Blacks  and  Hispanics  were  twice 
as  likely  as  Whites  to  be  referred  for  special  education  assessments. 

Such  findings  suggest  that  minority  children  may  be  over- 
represented in  special  education.  Although  the  assessment  of 
these  students1  abilities  may  be  reliable,  they  may  also  be  influ- 
enced by  cultural  biases  in  testing  and  interpretation.  There  are 
certain  precautions  that  may  be  taken  on  the  part  of  the  school 
psychologist  or  other  professionals  involved  in  evaluation  to 
ensure  that  ethnic  cultural  biases  are  minimized. 

As  with  any  culturally  sensitive  situation,  certain  key 
concepts  must  first  be  understood.  These  concepts  include  culture, 
et/miciry,  minority  group , and  acculturation  (Nuttal,  DeLeon,  &. 
Valle,  1990).  Culture  may  be  understood  as  a way  of  life;  the 
total  of  a groups  way  of  acting,  thinking  and  feeling,  involving 
components  such  as  behaviors  or  customs,  artifacts,  beliefs,  sym- 
bols, and  values  (Birkel,  1991).  The  term  ethnicity  refers  to 
the  patterns  of  values,  social  customs,  perceptions,  behavioral 
roles,  language  usage,  and  social  interaction  shared  by  the  group 
(Rotheram  &.  Phinney,  1980).  A minority  group  may  be  defined 
as  a group  of  people  who  are  singled  out  from  other  groups  of 
society  because  of  differing  physical  and  cultural  characteristics 
(Atkinson,  Morten,  &.  Sue,  1989).  Finally,  when  changes  in  the 
original  culture  meet  with  different  cultures,  adaptation,  rejec- 
tion or  acceptance  may  occur.  This  process  of  adjustment  is  known 
as  acculturation  (Lewis  & Ho,  1983). 

Aside  from  understanding  the  previous  concepts,  profes- 
sionals serving  culturally  different  populations  must  also  develop 
competencies  in  the  areas  regarding  attitudes,  knowledge,  and 
behavior  (Nuttall,  DeLeon,  &.  Valle,  1990).  First  and  foremost, 
it  is  important  that  professionals  be  aware  of  their  own  ethnic 
roots  and  cultural  backgrounds,  and  their  attitudes  toward  chil- 
dren and  families  from  different  ethnic  groups.  If  school  psycholo- 
gists are  to  effectively  serve  children  of  different  ethnic  groups, 
they  should  respect  and  be  comfortable  with  their  dissimilarities. 
Efforts  can  be  made  in  several  ways  to  develop  sensitivity  and 
understanding  in  working  with  minority  children:  learning  the 
language  of  the  particular  group,  taking  courses  in  cross-cultural 
counseling,  visiting  the  home  country'  ot  the  ethnic  group,  or 
reading  about  the  different  ethnic  groups  (Nuttal,  DeLeon,  &. 


Valle,  1990).  In  the  event  a professional  cannot  develop  compe- 
tencies and  adopt  positive  attitudes,  referral  to  another  profes- 
sional would  be  most  ethical. 

Competency  in  the  areas  of  knowledge  and  behavior 
characteristics  of  an  ethnic  group  involves  an  awareness  of  the 
history,  customs,  beliefs  and  values  of  that  group.  In  some  Native 
American  cultures,  for  example,  a child  asked  to  draw  r picture 
of  a person  may  not  draw  the  eyes  open  or  filled.  According  to 
interpretation  standards,  this  may  be  a sign  of  maladjustment, 
indicating  depression  or  dependency.  According  to  the  same 
Native  American  culture,  however,  this  is  a sign  of  respect. 
Familiarity  with  family  and  social  structures,  school  issues,  medical 
practices,  and  religious  holidays  is  also  strongly  recommended.  In 
addition,  learning  styles,  goals  and  expectations,  and  existing 
knowledge  bases  and  schemas  must  be  considered  within  the 
context  of  each  child  and  his  culture.  This  information  should 
then  be  carefully  and  thoroughly  disseminated  to  the  relevant 
educational  and  school  staff. 

Once  it  has  been  determined  that  a professional  is  able 
to  serve  an  ethnically  different  child  effectively  and  competently, 
Nuttall,  DeLeon,  and  Valle  (1990)  offer  several  strategies  that 
may  be  helpful  in  conducting  ethically  and  ethnically  sound 
evaluations  and  practice: 

School  psychologists  should: 

1.  Take  an  active,  flexible,  problem-solving  approach 
when  helping  minority  students; 

2.  Advocate  for  the  rights  of  minority  children; 

3.  Act  as  consultants  and  in-service  training  providers 
for  school  staff  if  they  have  the  special  skills  needed  for  dealing 
with  minority  children; 

4.  Help  minority  parents  to  lcam  about  U.S.  mainstream 
culture  and  school  programs,  especially  those  for  the  handicapped. 

5.  Help  the  community  and  mainstream  parents  to  wel- 
come parents  and  children  from  minority  groups. 

These  strategies  are  not  only  applicable  to  school  psychologists 
and  other  school  personnel,  but  any  professionals  working  with 
children  of  differing  cultural  backgrounds. 

In  summary,  there  are  several  precautions  that  must  be 
taken  while  working  u'ith  children  of  any  ethnicity.  Special  pre- 
cautions also  exist  for  children  of  differing  or  minority  cultural 
backgrounds,  particularly  in  the  realm  of  psychoeducational 
evaluations  and  special  education  placement.  In  general,  aware- 
ness of  cultural  differences  in  attitudes,  behaviors,  values  and 
beliefs,  and  customs  and  practices,  is  a precursor  to  any  com- 
petent evaluation  or  professional  interaction  among  culturally 
differing  persons. 
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MidAVcstcm  EduftinujKiI 

2 01 


26 


Volume  S,  Number  2 • Spring  1^02 


Africati'American  Male  Academies  from  a 
School-Choice  Perspective 

By  Thomas  E.  Midgette,  University  of  Arkansas-Fayetteville 


Abstract 

The  African-American  male  has  been  declared  an  endangered  species  (Gibbs,  1984,  1988).  In  an  attempt  to  reduce  the 
African-Amerian  male  being  at-risk,  some  educators  have  advocated  for  the  development  of  Black  academies  for  males  only  as  a 
method  of  intervention.  This  article  critically  examines  the  African-American  Male  Academy  from  a school-choice  perspective. 
Assessment  and  research  implications  are  also  discussed. 


Many  cities  and  states  have  developed  alternative  schools 
for  adolescents  who  are  unable  to  progress  in  the  regular  school 
system  (Tobias,  1989).  Many  of  those  students  have  dropped  out, 
been  held  back  repeatedly,  have  had  problems  with  the  law,  have 
become  teen  parents,  discouraged  to  learn  and  for  other  reasons 
find  it  difficult  to  fit  into  a traditional  high  school.  The  African- 
American  Male  Academy  could  be  viewed  as  a preventative  and 
choice-alternative  school  for  African-American  males  to  foster 
academic  achievement.  After  all,  in  a final  report  the  National 
Commission  on  Children  (1991)  recommended  that  all  schools 
and  communities  design  creative  initiatives  to  help  children 
with  serious  and  multiple  needs  reach  their  academic  potential. 
The  premise  is  a clear  one,  the  African-American  male  is  at 
extreme  risk  in  regular  schools  not  sensitive  to  his  needs.  These 
students  are  almost  destined  to  fail  given  past  results,  and  thus 
extreme  measures  must  be  taken  to  save  these  endangered  children . 
The  African-American  Male  Academy  is  one  of  many  possible 
strategies  to  restructure  and  improve  schools  and  should  be  under- 
taken only  after  appropriate  planning  and  accountability  mea- 
sures have  been  established  to  teach  these  students  effectively. 

African-American  males  need  early,  consistent  and  com- 
prehensive instruction  to  engage  them  in  learning,  encourage 
them  to  excel  and  help  them  overcome  circumstances  that  jeop- 
ardize their  prospects  for  learning  and  growing  (National  Com- 
mission on  Children,  1991).  These  academies  could  be  a com- 
ponent of  President  Bush’s  "America  2000"  Education  Plan  which 
calls  for  535  “New  American  Schools”  to  be  developed  in  com- 
munities around  the  nation.  Critics  of  this  national  educational 
plan  call  for  policies  that  end  the  savage  inequalities  of  educa- 
tional opportunity  for  the  African-American  youth  (Owens, 
1991;  Watson,  1991).  The  African-American  Male  Academy 
could  serve  to  increase  the  educational  opportunities  for  Atricnn- 
American  male  youth  in  appropriate  school  districts. 

Clearly  the  development  of  African-American  Male 
Academies  is  directly  in  line  with  the  President’s  National  Edu- 
cation Goals.  For  the  first  time  in  federal  legislation  there  is  a 
trend  toward  strengthening  provisions  that  target  resources  tor 
those  most  in  need  (LeTendre,  1991).  In  addition.  Congress  and 
the  Department  of  Education  recognizing  rhnt  schools  are  eon 


trolled  locally  and  need  for  pedagogical  flexibility  have  left  schools 
with  considerable  discretion  in  how  to  best  serve  their  children. 
LeTendre  suggests  that  local  school  districts  can  specify  the  set- 
ting for  services,  length  of  time  for  delivery  of  instruction,  kind 
of  personnel  who  must  provide  it,  content  or  skills  to  be  learned, 
and  instructional  materials  to  be  used.  Schools  can  experiment 
with  varying  pedagogies  and  academic  services  from  school  to 
school  or  from  grade  to  grade.  We  must  place  African-American 
males  in  schools  which  focus  on  their  strengths,  use  more  flexible 
teaching  methods,  and  focus  earlier  on  advanced  skills  and  pro- 
grams/curriculum which  are  culturally  relevant  in  a holistic  sense. 

Historically  in  the  United  States  many  strategies  for 
educating  children  at-risk  have  been  tried;  the  African-American 
Male  Academy  represents  another  valiant  approach.  Social  scien- 
tists, educators,  social  critics  and  politicians  are  constantly  on 
the  lookout  for  new  directions  to  test,  as  the  press  to  educate 
the  disadvantaged  becomes  more  apparent  (Natriello,  McDill  & 
Pallas,  1990).  Three  of  the  most  prominent  approaches  cur- 
rently in  vogue  are:  (a)  school  choice;  (b)  raising  standards  for 
performance;  and  (c)  establishment  of  African-American  Male 
Academies.  The  African-American  Academy  can  be  viewed  as 
a combination  of  school  choice  and  raising  standards  approaches. 
It  represents  a deliberate  thrust  in  facilitating  the  education  of 
inner-city  children  confronted  with  staggering  at-risk  conditions 
in  the  classroom,  at  home,  and  in  their  communities.  As  Presi- 
dent Bush  indicated  to  the  Associated  Press  (Arkansas  Gazette, 
1991)  "if  our  experiences  show  us  that  we  need  to  get  modifica- 
tions to  accommodate  academies  of  that  nature,  we  ought  to  do 
it.”  Our  experiences  have  clearly  indicated  that  too  many  public 
schools  are  not  educating  all  of  our  chidlren— especially  the 
African-American  male  child. 

The  establishment  of  African-American  Male  Academies 
is  a necessary  and  proactive  approach  in  increasing  the  proba- 
bility that  the  young,  African-American  male  will  have  equal 
access  to  educational  opportunities  needed  for  "normal”  citizen- 
ship in  this  country.  The  appearance  of  these  academies  simply 
reflects  an  attempt  at  better  meeting  the  critical  needs  of  a 
segment  of  our  society  the  African-American  male  and  family. 
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African-American  Male  Academies  (continued) 

Some  of  the  identified  advantages  of  the  African-American  male 
academies  include  the  following: 

1.  The  African-American  Male  Academy  advocate  excel- 
lence, have  high  expectations  of  its  pupils  and  promote  the  total 
development  of  the  African-American  male. 

2.  These  schools  exhibit  African-American  leadership 
by  employing  African-American  male  teachers  and  thus  empower- 
ing students  and  communities. 

3.  These  schools  provide  enriching  and  more  relevant 
curricula  for  existence  in  a global  and  multicultural  world. 

4.  These  schools  foster  positive  self-concept  and  esteem 
development  by  offering  a supportive  environment  with  mentors 
and  role  models  who  provide  encouragement  and  inspiration. 

5 . These  schools  foster  parental  involvement  in  programs 
and  overall  involvement  in  school  activities.  They  foster  inno- 
vative and  assertive  strategies  to  intervene  and  stop  the  demise 
of  the  African-American  family. 

6.  These  schools  can  foster  academic  achievement  and 
facilitate  growth  in  mathematics,  computer  science,  language 
arts  and  other  areas  beyond  sports  and  music  (Kunjufu,  1988). 

7.  They  promote  African-American  volunteerism  and 
self-help. 

8.  They  serve  to  expand  the  pool  of  African-American 
male  students  graduating  from  high  school  and  going  to  voca- 
tional schools,  college  and  professional  schools. 

9.  They  can  teach  African-American  males  responsibility, 
self-love,  and  appreciation  of  human  existence  solely  from  an 
African-American  male  perspective. 

The  African-American  Male  Academy  emanates  directly 
from  the  African-American  community  in  an  anguished  expres- 
sion of  collective  caring  for  its  young  (Cuban,  1991).  This  alter- 
native approach  is  not  unlike  some  public  schools,  private  schools, 
churches,  youth  organizations  and  communal  groups-  Community 
activists  say  African-American  boys  can  find  self-esteem  and 
character  to  survive  the  streets  lure  of  fast  money  and  general 
discouragement  in  their  environments.  The  African-American 
Male  Academy  becomes  the  institution  of  last  resort,  where 
peoplehood  and  personal  self-confidence  can  be  built  rung-by- 
rung  into  a ladder  for  each  boy  to  climb  proudly  and  reach  the 


kind  of  success  that  will  bring  pride  to  himself,  his  family  and 
his  race  (Cuban,  1991). 

Dramatizing  the  need  for  community  involvement  by 
African-Americans,  Dr.  Spencer  Holland,  an  educational  psy- 
chologist and  director  of  the  Center  for  Educating  African- 
American  Males  at  Morgan  State  University,  stated,  “What 
we  have  learned  in  the  past  20  years  is  that  White  people  don’t 
care  anything  about  educating  Black  children”  (Holland,  1991, 
p.  20).  He  suggests  that  the  African-American  community  has 
more  of  a stake  in  educating  and  socializing  their  children.  If 
changes  are  to  come  about,  Black  male  role  models  must  be  used 
to  teach  Black  males  from  urban  and  impoverished  neighbor- 
hoods. Some  critics  believe  that  these  schools  will  perpetuate 
segregation  and  sexist  thinking.  Kunjufu  (1991)  counters  by  in- 
forming us  that  Black  boys  already  are  in  classes  by  themselves— 
special  education  classes.  Often  these  same  Black  boys  are  subject 
to  subtle  rejection  by  teachers  because  they  are  perceived  as 
threatening  and  therefore  receive  less  instructional  attention 
(Poussaint,  1987). 

Owens  (1991)  argues  that  the  solution  to  the  minority 
education  crisis  will  not  be  found  until  the  educational  research 
base  is  enhanced.  Therefore  he  calls  for  an  approach  which 
delivers  effective  services  to  the  African-American  males  and 
must  be  based  on  systematic,  empirically  grounded  research 
and  scientifically  evaluated  demonstration  projects. 

“The  race  between  education  and  catastrophe  is  now  upon 
us.  To  fail  to  successfully  educate  yet  another  generation  of 
African-American  males  means  that  we  not  only  continue 
to  foreclose  opportunities  for  individual  lives,  but  we  con- 
tinue to  pay  for  our  failure  over  and  over  again  in  unneces- 
sary' social  costs.  We  cannot  afford  to  lose”  (Owens,  1990, 

p.  10). 

The  African-American  Male  Academy  is  consistent  with 
American  2000  Education  Plan  and  a worthy  choice  strategy  for 
African-American  communities  and  society  at  large.  Ideally  and 
only  as  a tandem  influence,  combined  with  new  strategies  can 
we  make  an  impact  on  the  forgotten  African-American  youth 
(Turning  Points,  1989).  Schools  must  stop  exacerbating  the 
African-American  child’s  problems  and  become  involved  in 
innovative  programs  to  educate  the  young  African-American 
male.  After  four  of  five  years  all  of  these  academies  must  be 
assessed  based  on  outcome  and  process  measures. 
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Does  Direct  Experience 
Change  Education  Students’  Perceptions 
ofLow'Income  Minority  Children 

Martin  Haberman  and  Linda  Post 
University  of  \X  ^consitvMilwaukee 


Abstract 

It  has  become  accepted  practice  in  teacher  education  to  regard  direct  experience  a>  the  ultimate  educative  three.  Whether 
the  goal  is  to  help  students  derive  meaning  from  their  coursework,  practice  theoretic  concepts,  or  change  their  attitudes,  the  practice 
of  placing  future  teachers  in  some  sort  of  direct  experience  with  children  and  youth  is  generally  regarded  as  an  all-purpose  elixir.  Thi" 
study  supports  the  contention  that  such  experiences  simply  reinforce  students’  predispositions. 


Direct  experiences  have  been  elevated  to  the  level  of  an 
accepted  good  and  as  a result  are  studied  much  less  than  should 
be.  We  set  out  to  specifically  examine  the  assumption  that  pro- 
viding undergraduate  preservice  students  with  direct  experience 
would  make  them  more  sensitive  to  minority  cultures  and  low- 
income  children. 

Teacher  race  is  an  issue  because  of  teachers  who  display 
overt  prejudice  toward  children  of  color,  expect  less  of  them  than 
they  do  of  White  children,  or  fail  to  understand  them  (Irvine, 
1991;  Simpson  & Erickson,  1983).  Race  and  class  are  frequently 
used  to  explain  the  culture  gap  between  school  and  community 
(Metz,  1990;  Tewell  & Trubowitz,  1987).  The  solution  proposed 
by  some  is  to  recruit  more  teachers  of  color  (Contreras  & Engel- 
hardt,  1991;  Haberman,  1989;  Justiz  & Kameen,  1988).  But  many 
educators  focus  on  the  pa^cess  of  teacher  education  itself,  pointing 
to  the  need  to  influence  White  teachers’  expectations  of  low- 
income  students  and  students  of  color.  They  advocate  teaching 
future  teachers  strategies  for  multicultural  teaching  (Lee,  1989; 
Liston  &.  Zeichner,  1990;  Shor,  1986).  Many  educators  concep- 
tualize this  task  as  helping  future  teachers  “unlearn”  negative 
attitudes  and  develop  positive  ones  about  race  and  various  ethnic 
groups.  Sleeter  (1992a)  shows  that  the  task  is  more  complex. 
Many  White  women  are  trying  to  work  themselves  up  from  work- 
ing class  origins  and  already  have  considerable  knowledge  about 
social  stratification  in  America.  They  also  tend  to  be  fairly  con- 
servative. Apparently,  they  integrate  information  about  race  pm- 
vided  in  multicultural  teacher  education  programs  into  the  knowl- 
edge they  already  have,  rather  than  reconstruct  that  knowledge. 

“Educating”  White  teachers  in  teacher-education  programs  to 
be  less  racist  and  classist  assumes  that  it  is  essentially  a rational 
phenomenon.  But  many  have  shown  “that  racist  attitudes  are 
very  rarely  rational.  Even  in  those  cases  where  the  attitudes  are 
regarded  as  rational,  they  are  not  considered  to  he  in  the  interests 
of  the  person  expressing  them”  (Wellman.  1977,  p.  14).  In  a two- 
year  study  of  teachers'  social  class  and  gender  perceptions,  par- 


ticipants tit  new  experiences  and  ideas  into  their  existing  con- 
structs (Sleeter,  1992b). 

This  study  sought  to  loam  more  about  the  reasonable- 
ness of  expecting  teacher  education  programs  to  change  future 
teachers’  perceptions  of  low-income  minoritv  children  and 
their  schooling. 

Methods 

The  subjects  were  a group  of  2 ^ white,  female  sophomores 
from  teacher-preparing  institutions  throughout  the  state  of  Wis- 
consin. With  the  exception  of  two  “older”  students,  all  were 
between  the  ages  of  19  and  25.  These  were  self-selected  individuals 
who  volunteered  six  weeks  of  half-day  participation  in  public 
elementary  schools  operated  in  Milwaukee  as  a remedial  summer 
session.  Their  involvement  included  a minimum  of  100  hour* 
of  direct  experience  with  low-income,  minority  children,  and 
afternoon  class  sessions  focused  on  concepts  and  issuer  in  multi- 
cultural education. 

At  the  beginning  of  the  experience  we  asked  the  student' 
to  write  what  they  expected  to  encounter  in  these  urban  Hass 
rooms  under  11  headings:  discipline,  methods,  children's  back- 
grounds,  personal  interaction,  personal  qualities,  dassroom\ 
students’  characteristics,  parents,  neighborhood.  siudentO  he 
haviorT  and  cultural  diversity.  At  the  end  of  the  six-week  period 
we  asked  the  students  to  write  what  they  actually  experienced 
in  terms  of  these  same  11  categories.  We  then  nude  a content 
analysis  of  their  before  and  after  statements. 

The  . tivities  the  students  engaged  in  began  with  a week 
of  observation  and  tutoring  of  individual  children.  The  maiorm 
of  their  subsequent  involvement  was  more  characteristic  of  a 
student-teaching  experience.  While  thev  did  not  write  k"on 
plans,  take  methods  courses,  or  have  supervisory  s mis  thos 
engaged  in  a wide  range  of  instructional  activities  rhar  an*t\pK.il 
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Direct  Experience  ( continued) 


of  the  student-teaching  experience.  These  students  were  treated 
very  informally  and  were  visited  by  supervisors  for  the  primary 
purpose  of  ensuring  that  they  were  interacting  with  children  in 
positive  ways.  Nevertheless,  their  most  common  interaction  with 
children  was  some  form  of  teaching,  including  the  teaching  of 
whole  classes. 

The  afternoon  classes  in  support  of  these  direct  experi- 
ences focused  on  multicultural  curriculum  and  instruction.  The 
format  included  the  use  of  lecture-discussion,  resource  speakers, 
readings,  cooperative  activities,  videos  and  instructional  games. 
There  were  no  individual  conferences  for  the  purpose  of  checking 
or  clarifying  students’  perceptions.  Perceptions,  attitudes  and 
beliefs  related  to  students,  direct  experiences  were  discussed  in 
the  total  group  or  with  smaller  groups.  Students  were  given 
content  on  sexism,  racism,  child  abuse,  poverty,  drug  and  sex 
education,  and  the  teaching  of  those  with  handicapping  condi- 
tions. The  purpose  of  this  supportive  coursework  was  to  build  on 
their  direct  experiences  in  the  mornings  and  to  sensitize  them 
to  the  need  for  equity  and  justice  in  the  teaching  of  all  children. 

Resuits 

Gmiparison  results  of  students’  initial  expectations  before 
beginning  the  experience  and  their  final  evaluations  of  what 
they  actually  saw  (see  Table  1).  These  perceptions  relate  to  chil- 
dren, parents,  neighborhoods,  school  behavior  and  culture. 

Final  interviews  revealed  that  although  the  majority  of 
the  students  made  more  negative  attributions  about  pupils  at 
the  end  of  their  experience  than  at  the  beginning,  they  were 
clearly  very  accepting  of  the  pupils.  It  seemed  as  if  they  gained 
confidence  in  their  ability  to  interact  effectively  with  the  chil- 
dren; they  clearly  gained  in  self-confidence.  As  they  gained  in 
self-confidence,  it  became  easier  for  them  to  discuss  their  own 
negative  qualities  as  well  as  those  of  the  children.  There  is  no 
question  that  these  students  transformed  then  initial  apprehen- 
sions into  experiences  which  provided  them  with  reassurance. 
From  “I’m  still  alive!”  to  “Hey,  they  accept  me!”  to  “I  can  do 
some  actual  teaching!”  to  “I  think  some  of  these  kids  like  me” 
seems  to  have  been  a typical  sequence  culminating  in  several 
students  claiming,  “This  was  a wonderful,  great  experience!” 

This  is  not  to  contend  that  students’  perceptions  of 
children  were  necessarily  changed.  The  major  finding  of  this 
study  supports  the  remarkable  phenomenon  of  students  generally 
using  these  direct  experiences  to  selectively  perceive  and  reinforce 
their  initial  preconceptions.  Students  w'ho  expected  to  find  prob- 
lems did  so.  Those  who  thought  they  could  practice  instructional 
methods  did  so.  Those  who  thought  there  would  be  discipline 
problems  found  them.  The  notable  exception  to  this  pattern  was 
the  lack  of  parental  contact  which  the  students  did  not  foresee 
and  the  generally  positive  acceptance  by  the  children  which,  in 
many  cases,  was  almost  overwhelming.  Since  there  was  limited 
time  to  debrief  and  consult  in-depth  with  students  regarding 
what  they  thought  they  were  actually  observing,  seeing,  and 
hearing,  the  experience  tended  to  reinforce  their  initial  percep- 
tions more  than  to  change  them 
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Table  1 

Sophomore  Education  Students ' Expectations  and  Perceptions 
Before  and  After  a Direct  Experience  with 
Low-Income  Minority  Children. 

Expectations 

Frequency 

Some  will  be  shy  and  quiet, 
others,  loud 

Some  were  disruptive.  Some 
. . . . were  cooperative. 

Neighborhoods  will  be  nice 

. . . . Nice  neigh  bo  rhoods. 

Rundown  neighborhoods 

. . . . Neighborhoods  were  rundov.  n. 

Will  leam  about  different  cultures. 

. . . . Learned  much  about 
different  cultures. 

Parents  will  be  interested  m 
how  well  their  kids  are  doing  . . 

Parents  wanted  to  sec  work 
. . . . and  grades. 

Students  will  be  energetic, 
curious,  troubled 

Wonderful  kids,  some  angry, 
. . . . lacked  confidence. 

More  di%’crsity 

. . . . This  was  much  more  varied 
than  my  rural  experience. 

I’ll  see  behind  scenes  

. . . . Learned  how  teachers 

set  up  and  managed  things. 

More  discipline  problems, 
more  remedial  problems 

Lower  standards. 

Leam  how  to  discipline  

. . . . Learned  some  discipline  strategies. 

1 will  leam  how  children 
are  and  act 

I learned  about  their 
....  characteristics  and  behavior. 

Neighborhoods  will  he  tough 
to  survive  in 

Neighborhoods  were  nice  on  top 
....  but  worse  the  further  down 

you  went. 

I will  see  many  different  personalities  . I learned  about  different  students. 

They  will  be  eager 
and  well-behaved 

They  behaved  very  well. 

I’ll  leam  how  to  handle 
20  to  30  students 

I learned  how  to  manage 
....  a large  group. 

1 expect  it  will  be  hard  to  keep 
them  interested 

....  It  was  long,  hard  and  stressful. 

Kids  won’t  want  to  he  there  . . . 

....  Tough  on  warm  days. 

All  types  of  students 

....  Each  has  srrengths  and  weaknesses 

Like  any  other  classroom  

....  Kids  are  kids. 

I’ll  leam  how  to  handle  disrespect 

....  I gamed  children’s  respect. 

Discussion 

Without  in-depth  conferences,  discussions,  and  debrief- 
ings of  each  student’s  direct  experiences,  his/her  perceptions 
will  he  self-fulfilling.  Positive  predispositions  wall  he  reinforced 
through  selective  perception.  Similarly,  negative  preconceptions 
will  be  supported.  Comparing  each  students  before  and  after 
comments  supports  this  dynamic  as  the  major  finding. 

Concerns  with  student  discipline  remain  constant  and 
high.  There  is  an  increase,  however,  in  confidence  in  dealing 
with  this  issue.  Education  students  shift  from  tentativeness, 
fear,  and  anxiety  about  children  to  a greater  degree  of  confi- 
dence, based  in  largest  part,  on  the  fact  that  pupils  accepted 
and  responded  to  rhem  as  teachers. 
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Education  students  shift  from  focusing  on  children's 
differences  to  an  appreciation  of  the  problems  they  face  and  their 
strengths.  While  students1  describe  pupils  with  more  negative 
descriptors  at  the  end,  they  are  generally  more  negative  about  all 
areas  in  which  they  need  to  grow  as  teachers.  There  was  clearly 
movement  toward  greater  understanding  of  pupils. 

Perceptions  of  classroom  atmosphere  and  physical  space 
changed  from  a fixed  given  to  something  that  teachers  can  control 
through  mom  decoration  and  changing  setups. 

Education  students1  initial  anticipation  of  parental 
contact  was  the  area  of  greatest  change.  At  the  end.  students 
realized  they  would  not  be  able  to  learn  about  parents1  or  pupils’ 
lives  through  these  meetings  since  there  would  be  little  contact 
with  parents,  and  that  when  it  did  occur,  the  meetings  would  focus 
almost  entirely  on  parents’  concern  with  achievement  gains. 

The  positive  feelings  education  students  manifested  at  the 
end  of  the  experience  seems  to  reflect  an  increase  in  self- 
confidence.  They  are,  however,  still  grappling  with  many 
unresolved  issues.  Only  one  student  would  say  she  wanted  to  teach 
in  an  urban  school;  most  were  still  at  the  prior  level  of  seeking 
and  gaining  reassurance  that  they  made  the  right  decision  about 
becoming  teachers.  Another  unresolved  issue  was  their 
understanding  of  cultural  diversity  and  just  how  important  these 
differences  are  in  affecting  learning  and  behavior.  The  belief  that 


"kids  are  kids!’1  and  that  only  individual  differences  rather  than 
cultural  differences  are  of  any  consequence,  was  generally 
reinforced  by  these  experiences.  Hands-on  knowledge  of  how 
cultural  diversity  affects  a classroom  was  not  developed. 

Implications 

Direct  experiences  are  not  necessarily  educative.  Faculty 
and  p re  sen.’ ice  students  frequently  confuse  the  intensity  of  direct 
experiences  with  growth.  It  would  be  naive  to  assume  that  the 
process  of  placing  students  in  low-income,  multicultural  urban 
classrooms  is,  by  itself,  necessarily  positive.  Confirming  invalid 
perceptions  are  just  as  likely  an  outcome  as  greater  sensitivity  and 
awareness. 

Follow-up  studies  need  to  focus  on  treatments  used  by 
teacher  educators  to  intervene  and  directly  influence  students’ 
perceptions.  These  treatments  may  include,  but  not  be  limited 
to,  continuous,  frequent,  in-depth  dialogues  with  students 
regarding  what  they  believe  they  are  observing  and  the  attributions 
they  make  related  to  their  observations.  This  treatment  will 
inevitably  require  a teacher  education  faculty  that  is  more 
multicultural  than  is  currently  typical,  as  well  as  more  than  100 
hours  of"  direct  experience  for  the  students. 
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Book  Review: 

Postmodernism  and  the  New  Politics  of  Education 


Border  Crossings  is  a collection  of 
essays  written  by  Henry  Giroux  over  the  past 
several  years,  portions  of  which  have  been 
published  elsewhere  in  a different  form.  How- 
ever, the  essays  all  are  organized  around  com- 
mon themes  and  share  a common  language, 
so  that  the  book  reads  as  a unified  whole 
rather  than  a collection  of  disparate  essays; 
and  it  is  to  the  book  as  a whole  that  I will 
direct  my  comments.  In  my  view  this  is  one 
of  the  most  important  books  in  critical  edu- 
cational and  cultural  studies  to  be  published 
in  over  a decade,  and  it  deserves  serious  at- 
tention by  all  educational  researchers  and 
scholars.  Its  intent  is  no  less  than  a remapping 
of  the  discursive  terrain  of  pedagogy  and  the 
educational  act,  and  to  do  this  it  calls  into 
question  many  of  the  constructs  and  ideas 
we  have  taken  for  granted  in  conducting  edu- 
cational research,  the  questions  we  have 
chosen  to  raise  in  our  research,  the  boundaries 
we  have  erected  around  constructs  and  cate- 
gories, and  the  power  dynamics  w’ithin  which 
research  is  intextricably  embedded.  Beyond 
this,  Border  Crossings  is  aimed  at  a revitaliza- 
tion of  democratic  and  progressive  discourse 
in  education  and  the  broader  society,  a discourse  that  for  several 
decades  now  has  languished  in  a pessimism  and  determinism  that, 
through  its  failure  to  develop  a politics  of  possibility  and  engag- 
ment,  has  not  seriously  challenged  the  conservative  state  discourse 
on  school  reform  and  the  nature  of  social  problems. 

By  crossing  conceptual  and  paradigmatic  boaiers,  Giroux 
provides  a new  direction  for  critical  educational  research  that 
moves  beyond  the  deterministic  and  functionalistic  tendencies 
of  the  neo-marxist  reproduction  theory  that  dominated  the  field 
during  the  1970s  and  much  of  the  1980s.  To  accomplish  this  he 
draws  heavily  upon  the  new  postmodern  discourses  in  the  social 
sciences,  humanities,  and  the  arts.  At  the  same  time,  Giroux 
remains  committed  to*  the  concerns  that  have  been  central  in 
his  writing  over  the  past  two  decades,  that  is:  social  justice,  the 
democratic  project,  and  the  possibility  of  articulating  a public 
philosophy.  He  also  is  well  aware  of  the  current  role  of  the  public 
schools  in  gen  .'rally  serving  to  reproduce  inequalities  of  class, 
gender,  and  race,  so  that  he  does  not  fall  victim  to  a naive  belief 
that  nothing  fundamentally  stands  in  the  way  of  a reconstruc- 
tion of  curriculum  and  pedagogy  in  public  schools  that  empowers 
marginalized  and  disadvantaged  groups.  Change  in  education, 
he  argues,  cannot  be  treated  separately  from  change  in  the  power 
relations  and  dynamics  that  organize  everyday  life  in  American 


culture,  and  this  implies  that  educators  must 
be  “cultural  workers"  as  well.  He  then  sets  out 
to  characterize  critical  cultural  work  in  terms 
of  a “politics  of  difference”  that  is  based  on 
a radical  rethinking  of  multiculturalism. 

lo  begin  to  talk  about  cultural  workers, 
a politics  of  difference,  and  multiculturalism 
— as  Giroux  characterizes  them— we  must  first 
confront  the  language  and  worldview  of  post- 
modernism, which  provides  a deep  structure 
for  this  text.  Postmodernism  is  among  the 
most  illusive  of  contemporary  theoretical 
movements,  but  among  other  things  it  im- 
plies: a shift  to  a post-industrial  and  infor- 
mation processing  age,  the  rise  in  influence 
of  the  mass  media  in  identity  construction, 
the  rejection  of  “grand  narratives”  and  forms 
of  rationality  that  hold  out  the  promise  of 
providing  totalizing  or  complete  answers, 
and  a recognition  that  power,  knowledge, 
and  desire  are  inextricably  interconnected. 
Giroux's  point  is  that  we  may  be  moving 
into  a postmodern  age,  one  characterized 
by  an  “unsettling”  of  what  appeared  socially 
and  theoretically  settled.  The  network  of 
interlocking  “settlements”  or  “accords”  that 
characterized  the  post  World  War  II  era— from  the  labor-business 
accord  forged  during  the  depression  and  represented  in  collective 
bargaining,  to  the  Civil  Rights  accord  forged  between  1954  and 
1964,  to  the  gender  accord  organized  around  the  patriarchal 
nuclear  family,  to  the  social  science  accord  that  has  privileged 
positivist  research  methodologies  borrowed  from  the  natural 
sciences.  These  settlements  have  always  been  contested  to  at 
least  some  degree,  but  in  the  1990s  they  show  signs  of  breaking 
apart,  producing  economic,  social,  and  political  crisis.  This  sug- 
gests that  the  1990s  may  be  much  more  like  the  1960s  than  the 
1980s.  Postmodernism  is  a manifestation  of  this  growing  discord 
and  dissensus  in  Western  culture,  and  it  has  slowly  begun  to 
open  tip  important  space  for  oppositional  discourse  in  education 
and  other  disciplines. 

Postmodernism  in  the  academy  also  is  a manifestation 
of  a growing  dissensus  and  dissatisfaction  over  the  dominant 
modernist  form  of  scientific  rationality  that  decontcxtualizes 
the  analysis  of  the  social  world,  bow  it  gets  constructed,  and 
whose  interests  it  serves.  This  has  been  and  still  is  the  positivist 
century— the  century  that  sought  to  “manage”  society  and  indi- 
viduals based  on  the  findings  of  social  science  and  psychological 
research,  and  in  public  education  that  sought  to  identify  the 
attributes  of  “effective”  reaching,  instructional  organization. 
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and  school  management  and  identity  and  remediate  the  cultural 
and  functional  literacy  “deficits”  of  targeted  student  groups. 
Scientism  and  technical  rationality  have  been  used  to  legitimate 
this  professional  discorse  on  the  proper  management  of  educa- 
tional “problems,”  and  Giroux  reveals  that  it  is  a discourse  that 
has  been  disastrous  educationally,  at  least  for  those  marginalized 
and  disadvantaged  in  the  schooling  process.  It  is  not  coincidental 
that  the  Reagan-Bush  agendas  in  education  rely  heavily  upon 
the  positivist  research  of  the  “effective  schools”  tradition,  since 
this  tradition  so  effectively  decontextualizes  the  crisis  in  the 
schools  by  treating  it  as  the  result  of  mismanagement,  and  hence 
as  something  to  be  overcome  through  public  schools  with  stronger 
principals  and  and  clear  basic  skill  instructional  goals,  or  through 
privatized  schools  run  directly  by  business.  The  crisis  in  Ameri- 
can education  and  American  culture  runs  much  deeper,  and  it  is 
critics  and  theorists  such  as  Giroux  who  remind  us  of  this,  and 
also  that  we  may  choose  to  take  up  an  alternative  discourse,  one 
that  grounds  research  and  theory  within  the  struggles  that  organize 
American  culture  and  within  the  context  of  democratic  projects 
of  social  justice  and  empowerment. 

Giroux  is  wise  in  differentiating  between  the  oppressive 
and  controlling  manifestations  of  modernism  that  are  typically 
found  in  much  mainstream  professional  educational  discourse, 
and  that  modernist  discourse  that  is  associated  with  the  realiza- 
tion of  democratic  commitments  and  values.  Historically,  a liberal 
form  of  modernism  has  been  associated  with  the  Enlightenment 
project  of  increasing  human  freedom  and  dignity,  decreasing 
human  suffering  and  ;njustice,  and  maximizing  democratic  deci- 
sion making  within  a society  that  respects  difference.  Giroux 
argues  that  these  modernist  themes  still  have  relevance  in  the 
postmodern  world,  but  that  their  meaning  can  no  longer  he 
understood  in  some  abstract,  essential ist,  decontextualized  sense. 
Now  when  we  speak  of  the  Enlightenment  project  and  values  of 
freedom,  democracy,  community,  and  equality,  we  must  recognize 
that  we  give  them  meaning  within  historical  contexts  through 
the  development  of  democratic  social  movements  and  agendas 
that  challenge  injustice  and  inequity.  The  struggle  for  democracy 
and  equity,  consequently,  must  be  given  new  meaning  in  each 
historical  era;  we  cannot  rely  merely  on  what  the  “founding 
fathers”  had  in  mind  when  they  framed  the  Declaration  of  Inde- 
pendence and  Constitution,  for  we  live  in  a new  time  and  age. 
How  then  do  we  proceed  in  deciding  what  students  need  to  know 
and  how  to  teach  them? 

This  is  where  the  notion  of  “border  crossings”  serves  an 
important  role  in  defining  postmodern  curriculum  and  pedagogy. 
In  a general  sense,  the  notion  implies  that  we  tend  to  construct 
our  identities  and  interpret  social  interaction  in  terms  of  rigidly- 
hounded  or  bordered  categories  that  do  not  allow  for  new  forms 
of  interaction  or  knowledge.  For  example,  implicit  in  the  process 
of  constructing  a “masculine"  identity  in  this  culture  is  the  pro- 
cess of  constructing  conceptual  borders  that  separate  the  self 
from  anything  presumed  to  he  “feminine”  including  expressive- 


ness, caring,  etc.  The  same  sort  of  process  typically  operates  in 
constructing  racial  barriers  that  define  “whiteness”  and  “black- 
ness” in  oppositional  terms.  Our  self-definitions  are  thus  relational 
and  always  imply  some  positioning  of  ourselves  as  different  than 
or  in  opposition  to  “others”  While  postmodernists  argue  that 
this  is  a more-or-less  “natural”  tendency  within  language,  it  may 
be  taken  for  granted  or  deliberately  countered  through  critical 
self-reflection.  Within  the  discourse  of  the  educational  encounter, 
Giroux  argues,  “students  should  engage  knowledge  as  border- 
crossers,  as  people  moving  in  and  out  of  borders  constructed 
around  coordinates  of  difference  and  power."  Giroux  defines 
border  pedagogy  as  a form  of  cultural  work  that  involves  “chal- 
lenging existing  boundaries  of  knowledge  and  creating  new  ones" 
(p.  29).  Border  crossing  is  in  these  ways  similar  to  what  Jean 
France  is  Lyotard  calls  “paralogy1— the  constant  search  for  new 
ideas  arid  constructs  to  rupture  culture  and  introduce  dissensus 
into  consensus  (Fritzman,  1990).  It  also  implies  an  examination 
by  students  of  various  cultural  codes-  the  code  of  competition, 
rugged  individualism,  domesticity,  and  privilege,  this,  of  course, 
is  where  curricular  and  pedagogical  issues  become  unavoidably 
political.  A democratic  society  committed  to  multiculturalism 
and  diversity,  Giroux  argues,  must  help  young  people  cross  con- 
ceptual borders  that  separate  them  from  various  “others —those 
of  a different  class,  race,  gender,  sexual  orientation,  age,  etc. 
Rather  than  take  for  granted  an  essential  ist  treatment  of  these 
cultural  categories,  Giroux  argues  that  teachers  need  to  help 
students  see  these  categories  as  socially  and  historically  con- 
structed, and  as  deeply  implicated  in  structuring  power  relations 
and  dynamics. 

Although  Giroux  continues  to  he  primarily  concerned 
with  pedagogical  practice  within  educational  sites,  he  has  now 
broadened  that  category  substantially  to  include  all  those  involved 
in  “cultural  work.”  To  Giroux,  cultural  workers  include  teachers, 
artists,  writers,  lawyers,  social  workers,  doctors,  theologians,  and 
others  who  are  concerned  with  “the  analysis  of  textual,  aural,  and 
visual  representations  and  how  such  representations  are  organized 
and  regulated  within  particular  institutional  arrangements.”  The 
common  objective  of  all  cultural  workers  in  this  sense  is  to  mobi- 
lize knowledge,  desire,  and  power  to  create  new  public  spheres 
“in  which  the  principles  of  equality,  liberty,  and  justice  become 
the  primary  organizing  principles  for  structuring  relationships 
between  the  self  and  others”  (p.  5).  The  role  of  cultural  workers 
is  to  “resurrect  traditions  and  social  memories  that  provide  a 
new  way  of  reading  history’  and  reclaiming  power  and  identity. 
Within  this  view  of  memory,  history,  and  identity,  the  concept 
of  academic  disciplinary  borders  breaks  down. . " (p.  242). 

In  a democratic,  postmodern  society,  Giroux  argues  that 
this  requires  support  for  a politics  of  difference  and  diversity  (a 
form  of  radical  pluralism)  rather  than  a policy  of  homogenization 
and  conformity  to  a standardized  norm.  In  curriculum,  this  implies 
that  multiculturalism  is  moved  from  the  margins  to  the  center  of 
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concern  and  that  its  subject  matter  is  reconceptualized.  The 
modernist  project  has  been  to  “normalize”  and  socialize  the 
individual  to  fit  an  ideal  norm,  and  those  who  have  not  been 
able  or  willing  to  fit  the  norm— because  of  their  class,  gender, 
race,  sexual  orientation,  etc.,  have  been  made  the  subject  of  a 
normalizing  discourse.  Giroux  observes  that,  “Multiculturalism 
is  generally  about  Otherness,  but  is  written  in  ways  in  which 
the . . .oppositional  potential  of  difference  as  a site  of  struggle  is 
muted”  (p.  117).  Rather  than  view  differences  in  this  way,  in 
terms  of  a cultural  standard  in  which  some  students  are  treated 
as  “deficient,”  Giroux  suggests  that  we  need  to  celebrate  the 
differences  students  bring  to  the  learning  process,  and  teach 
students  to  respect  differences. 

Any  discussion  of  this  book  would  be  incomplete  without 
noting  that  it  is  likely  to  be  controversial  and  be  criticized  by 
scholars  across  the  political  spectrum  who  feel  uncomfortable 
venturing  beyond  their  existing  conceptual  paradigms.  Giroux’s 
view  on  multiculturalism  and  the  role  of  the  teacher  as  cultural 
worker  will,  no  doubt,  be  viewed  as  threatening  or  too  extreme 
by  some;  and  those  educators  who  view  themselves  as  pragmatists 
and  who  are  suspicious  of  theory  will  no  doubt  be  displeased 
because  there  is  not  more  “hard”  empirical  data  in  this  book. 
We  need  to  accept  Giroux  for  what  he  is— a major  theoretician 
of  curriculum  and  pedagogy  who  is  able  to  rethink  educational 
issues  and  refocus  our  attention  on  important  new  ways  of  per- 
ceiving and  organizing  educational  practice. 

There  always  has  been  a deep  suspicion  of  theory  among 
many  university-based  educators  engaged  in  the  “real  world” 
of  preparing  future  teachers  and  administrators.  They  tend  to 
view  theorizing  as  an  “ivory  tower”  activity,  too  idealistic  and 


utopian  to  be  of  practical  value  in  helping  teachers  and  adminis- 
trators respond  to  the  everyday  demands  placed  upon  them.  This 
attitude  towards  theory  is  what  Cleo  Cherryholmes  (1988)  calls 
“vulgar  pragmatism”  an  unreflective  orientation  toward  the 
immediate  task  at  hand  that  prevents  one  from  seeing  the  broader 
context  within  which  discourse  and  practice  takes  on  meaning. 
Of  course,  theory  needs  to  be  practical,  and  Border  Crossings  is 
precisely  about  the  inseparability  of  theory  and  practice  in  educa- 
tion. However,  Giroux  insists  that  our  practice  not  be  vulgar,  that 
we  reflectively  locate  and  position  our  practice  within  struggles 
over  power  and  knowledge.  Concrete,  empirical  research  in 
schools  and  other  educational  sites  is  needed,  and  this  book 
should  provide  a fertile  theoretical  grounding  for  qualitative 
research  in  schools  that  focuses  on  student  identity  construction, 
the  role  of  the  teacher  as  a transformative  intellectual,  the  borders 
that  are  erected  and  crossed  in  schools  and  classrooms,  and  the 
struggles  over  class,  gender,  race,  and  sexuality  that  permeate 
and  shape  the  schooling  process. 
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Many  of  us  who  prepare  young  adults 
for  the  teaching  profession  were  one-time 
social  activists.  Perhaps  we  did  not  possess  a 
social  consciousness  when  we  entered  college 
in  the  sixties,  but  that  soon  surfaced  as  we 
were  introduced  to  some  of  our  required  read- 
ings: The  Other  America  (1962),  Assimilation  in 
American  Life  (1964),  Culture  and  Poverty 
(1968),  Crisis  in  the  Classroom  (1970),  Racial 
Oppression  in  America  (1972).  We  committed 
ourselves  to  addressing  the  plight  of  minorities 
and  the  poor  and  vowed  to  transform  society 
by  changing  public  education;  we  graduated 
from  college  and  entered  public  schools  deter- 
mined to  provide  inner-city  and  rural  youth 
with  the  same  quality  of  educational  experi- 
ences accorded  to  suburban  youth.  Unfor- 
tunately, while  some  of  us  may  be  able  to  re- 
count individual  triumphs,  the  bittersweet 
truth,  according  to  Jonathan  Kozol  in  Savage 
Inequalities , is  that  we  failed  in  our 
mission: 
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“Nothing  has  changed”  (P.  114).  inequalities,  incv 

Is  Kozol’s  assessment  of  urban  educa-  Reviewed  by:  Jcsu: 
tion  correct?  Haven’t  the  billions  of  federal,  Indiana  Univcr 
state,  and  local  monies  allocated  to  schools 
over  the  past  three  decades  enhanced  the  educational  opportunities 
of  inner-city  and  rural  youth?  What  of  the  numerous  projects  cited 
in  the  literature  shown  to  have  been  successful  in  increasing  the 
educational  opportunities  of  inner-city  and  rural  vouth?  Perhaps 
we  can  show  that  some  progress  has  occurred  it  we  compare  Korol's 
findings  with  those  of  Harrington  and  Silherman,  two  of  the  most 
influential  writers  in  the  sixties  and  seventies  who  wrote  about  the 
poor  and  their  experiences  in  public  schools. 

In  the  early  thirties,  as  a result  of  the  Depression,  many 
Americans  experienced  poverty  firsthand.  Soon  after  WW  11 
economic  prosperity  returned  and  most  Americans  assumed  that 
poverty  was  no  longer  a social  malady.  However,  in  the  early  sixties 
we  were  once  again  made  aware  that  poverty  had  not  been  eradi- 
cated, but  that  mainstream  Americans  had  simply  refused  to  recog- 
nize this  disease  in  inner-cities  and  rural  areas,  Michael  Harringtons 
The  Other  America  boldly  confronted  Americans  with  the  honors 
of  poverty  and  carefully  described  how  this  cancer  is  inextricably 
tied  to  the  country s economic  and  political  climates  and  the  moral 
tenor  of  those  who  control  the  quality  of  education  in  the  public 
schools.  Segregation,  Harrington  maintained,  is  strongly  tied  to 
racial  poverty,  ‘As  long  as  Negroes  and  other  minorities  arc  segre- 
gated into  neighborhoods,  the  impact  of  all  civil  rights  legislation 
is  softened”  (p.  79).  “|l]t  is  possible  for  a city  like  New  York  to  have  a 
public  policy  in  favor  of  integration,  and  yet  maintain  a system  of 
effect  i ve  segregation  ’ (p.  77).  Harrington  a ho  questioned  America’" 
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Reviewed  by:  Jesus  Garcia. 

Indiana  University. 


commitment  to  its  less  fortunate:  “ . . . America 
: / ; U; 4 ■ at  the  beginning  of  the  sixties  does  not  seem 

prepared  to  devote  the  resou ices  to  the  problem 

HI  /v  J,  i that  are  required  if  it  (integration  of  neighbor- 

f / i ■ hood  and  schools]  is  to  he  solved”  (p.  80). 

| A decade  later  Charles  Silherman,  in 

’ - Crists  in  the  Classroom,  wrote  a scathing  des- 

cription  of  public  education,  particularly  the 
* fik  quality  of  education  provided  to  minorities. 

rfT  1 “Tire  schools  have  changed  substantially  in 

the  postwar  period;  on  almost  any  measure 
^ they  are  doing  a better  job  of  educating  minor- 

j ity-group  and  lower-class  children  than  a gen- 

j -p  1 oration  ago.  But  not  enough  better;  on  almost 
J | j ZZ*  any  measure,  the  schools  are  still  failing  to 
provide  the  kind  of  education  Negroes,  In- 
dians, Puerto  Ricans,  Mexican-Americans, 
schools  Appalachian  whites— need  and  deserve”  (p. 

62).  And,  hke  Harrington,  he  questioned 
whether  society  is  committed  to  the  principle 
of  equity,  “it  is  nor  unreasonable,  however, 
591).  Savagt  jn  a society  that  prizes  (or  claims  to  prize) 

: Crown.  equality  of  opportunity,  to  expect  the  schools 

ia.  to  be  a significant  influence— to  expect  them 

to  make  the  opportunities  open  to  its  stu- 
dents less  dependent  on  their  social  origins.  And  that  means 
making  it  possible  for  students  from  every  social  class  and  even- 
ethnic  group  to  acquire  the  necessary  skills”  (p.  62). 

Two  decades  later,  Korol  describes  schools  in  metropolitan 
areas  serving  the  poor  and  the  more  affluent  by  examining  the 
issue  of  binding  for  public  education.  He  provides  us  a tour  of  metro- 
politan centers  in  Illinois,  New  York,  New  Jersey,  Washington, 
D.C.,  and  Texas  to  underscore  the  stark  realities  of  “equity”  in  the 
funding  for  urban  education.  Tragically,  whether  in  East  St.  Louis, 
Chicago,  New  York  City,  Camden,  Washington,  D.C.,  or  San 
Antonio,  quality  education  is  tied  to  the  ability  of  peoples  to  tax 
themselves  at  a rate  that  provides  their  children  with  a quality 
education  and  to  state  funding  formulas  aimed  at  ensuring  “equity.” 
In  both  instances  minorities  and  the  poor  are  at  a decided  disad- 
vantage when  competing  with  the  more  affluent:  (1)  since  property 
is  worth  less  in  poor  communities  than  in  affluent  ones,  the  poor 
an'  unable  to  raise  the  revenues  necessary  to  operate  a school 
district  at  the  same  rate  as  the  richest  districts;  and  (2)  state  for- 
mulas used  to  fund  public  education  favor  the  middle  class  by 
adopting  a minimum  foundation  guaranteeing  “that  every  child 
has  ‘an  equal  minimum’  hut  not  that  every  child  has  the  same. 
Stated  in  a slightly  different  way,  it  guarantees  that  every  child  has 
a building  called  a school’  but  not  that  what  is  found  within  one 
school  will  hear  much  similarity,  if  any,  to  what  is  found  within 
another”  (p.  209). 
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Book  Review:  Nothing  Has  Changed  (continued) 


Not  surprisingly,  most  inner  city  schools  share  common 
problems.  “The  science  labs  in  East  St.  Louis  High  are  30  to  50 
years  outdated . . . the  six  iab  stations  in  the  room  have  empty  holes 
where  pipes  were  once  attached”  (p.  27).  In  Chicago  the  magnet 
schools,  intended  to  provide  greater  educational  opportunities  for 
all  children,  are  skimming  the  talent  pool  and  leaving  the  tradi- 
tional  schools  with  the  less  fortunate  children.  In  North  Lawndale, 
characterized  as  Chicago’s  industrial  slum  area  without  any  industry, 
an  elementary  principal  complains  of  having  to  accept  as  per- 
manent substitutes  tenured  secondary  teachers  who  have  lost  their 
high  school  jobs  as  a result  of  low  enrollment.  In  New  York  City 
schools  are  overcrowded;  the  capacity  of  Public  School  261  in 
District  10  is  “900  but  there  are  1 ,300  children  in  the  school”  (p. 
85).  Regardless  of  the  city  the  problems  seem  insurmountable: 
segregation,  teacher  apathy  and  burnout,  lack  of  basic  textbooks, 
outdated  materials,  inadequate  student  counseling,  incompetent 
teachers,  high  teacher  and  student  absenteeism,  lack  of  competi- 
tive teacher  salaries,  and  crumbling  buildings. 

Suburbanites,  just  outside  of  Americas  inner  cities,  offer 
children  and  young  adults  a strikingly  different  educational 
environment.  New'  Trier  High  School,  located  in  a Chicago 
suburb,  is  situated  on  27  acres  of  prime  real  estate.  “One  wing  of 
the  school,  a physical  education  center  includes  three  separate 
gyms,  also  contains  a fencing  room,  a wrestling  room,  and  studios 
for  dance  instruction.  In  all,  the  school  has  seven  gyms  as  well 
as  an  Olympic  pool”  (p.  65).  The  curriculum  is  also  of  Olympic 
dimensions,  “courses  in  music,  art,  and  drama  are  so  varied  and 
abundant  that  students  can  virtually  major  in  these  subjects  in 
addition  to  their  academic  programs.  The  modem  and  classical 
language  departments  offer  Latin  and  six  other  foreign  languages 
...in  a senior  English  class,  students  are  reading  Nietzsche, 
Darwin,  Plato,  Freud,  and  Goethe . . . the  average  class  size  is  24; 
classes  for  slower  learners  hold  15”  (pp.  65-66). 

While  Harrington  and  Silberman  did  not  intend  to  com- 
pare the  inner-city  with  suburbia,  their  descriptions  of  the  poor 


and  inner-city  schools  seem  similar,  if  not  identical,  to  Kozol’s. 
“Nothing  has  changed.” 

While  Kozol  may  find  some  hope  in  more  effective  ways 
of  distributing  state  financial  resources,  the  evidence  suggests 
otherwise.  As  Harrington  and  Silberman  suggested,  the  real 
problem  is  the  lack  of  commitment  from  the  more  affluent  to 
assist  the  less  fortunate.  The  more  affluent  are  interested  in 
“equity”  but  not  at  the  expense  of  their  children;  they  believe 
their  responsibility  is  to  provide  their  children  with  every  oppor- 
tunity to  maintain  their  economic  and  educational  advantages 
over  others;  they  are  not  interested  in  sharing  their  wealth  with 
poorer  districts.  Moreover,  they  do  not  feel  a strong  responsibility 
tor  the  poor.  [“By  a nine-to-one  ratio,  according  to  a recent  survey, 
suburban  residents  resist  all  efforts  to  provide  more  money  to 
Chicago’s  schools,”  (p.  67).) 

There  is  even  more  bad  news.  According  to  Wilson  in 
The  Tndy  Disadvantaged  (1987),  the  gap  between  the  rich  and 
poor  has  widened  in  recent  years  not  only  across  racial  and  ethnic 
groups  but  within  these  groups.  Kozol  is  incorrect,  things  have 
changed.  Today,  the  poor  are  trapped  in  prisons  we  call  inner- 
cities  with  little  or  no  hope  of  freedom.  What  is  the  next  step? 
Upgrading  and  reinforcing  minimum  state  standards  to  ensure 
that  inner-city  youth  are  not  forced  to  attend  schools  like  those 
that  Kozol  describes?  What  constituencies  at  the  state  level  will 
lobby  for  guidelines  that  will  direct  the  more  affluent  to  share 
their  resources  with  the  less  fortunate?  The  state  and  federal 
funding  of  the  sixties  and  seventies  and  the  results  from  those 
efforts  are  evidence  to  many  that  allocating  more  money  to  schools 
is  not  the  answer. 

So  where  does  this  leave  us?  If  as  Kozol  states,  nothing 
has  changed,  what  do  I,  a teacher-educator  committed  to  equity, 
tell  a young  African-American  living  in  Camden  when  he 
asks,  “How  come  them  white  folks  in  Cherry  Hills  have  a better 
school  than  l do?  Is  it  because  you  all  think  I’m  just  a poor  nigger 
and  don’t  count?” 
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The  Mid-Western  Educational  Rcst\nvhcr  welcomes  opposing 
views  on  this  and  all  topics. 


Voices  in  Education 


The  Midwestern  Educational  Researcher  asked  leaders  in 
education  to  respcnd  to  the  question: 

Do  you  support  the  development  of  a national 
curriculum  for  public  schools? 

Yes,  through  the  fourth  or  fifth  grade.  That's  all  we  can 
get  a national  consensus  on. 

—David  Berliner,  Arizona  State  University 

I really  think  that  we  have  had  a national  curriculum- 
based  on  textbooks  and  on  standardized  tests.  It  is  not  explicitly 
stated  nor  acknowledged,  but  the  content  and  the  form  of  the 
most  widely  used  textbooks  are  quire  similar.  Since  they  are  used 
in  about  90  percent  of  classrooms,  students  tend  to  get  a cur- 
riculum that  is  quite  similar  to  that  of  others  nationally.  Also, 
the  standardized  tests,  including  the  SAT,  tend  to  set  standards 
and  goals  for  the  nation.  —Jeanne  Chall,  Harvard  University 

No.  Recent  events  in  the  USSR  have  reminded  me  how 
genuinely  multicultural  the  United  States  is  as  well.  A least 
common  denominator  national  curriculum,  no  matter  how  art- 
fully crafted,  is  a threat  to  the  good  side  of  local  diversity. 

—Christopher  Clark , Michigan  State  University 

Yes  and  no.  I believe  there  is  some  value  to  defining  a 
“core”  knowledge  base  for  students  at  different  grade  levels  na- 
tionally. This  would  allow  better  (more  fair)  comparisons  with 
other  nations.  These  comparisons  are  going  on  anyway,  and  cur- 
rently make  little  s*  .•  tse.  I do  not  favor  a comprehensive  national 
curriculum  as  I believe  that  we  ought  to  preserve  a significant 
amount  of  local  autonomy  in  setting  educational  objectives. 

— Lyn  Como,  Teachers  College  Columbia  University 

No.  A national  curriculum  would  serve  to  demotivate 
teachers  by  taking  away  even  more  of  their  autonomy  and  sense 
of  personal  responsibility  for  educating  their  students. 

— Edward  Deci , University  of  Rochester 

No.  My  reason  is  not  opposition  to  the  idea  that  every- 
one should  be  exposed  to  all  of  the  major  domains  of  knowledge 
and  knowing,  but  my  objection  to  the  degree  to  which  this 
concept  is  corrupted  by  curricular  specifics  not  worth  universal 
attention.  In  other  words,  the  state  of  the  art  and  science  of 
curriculum  making  is  such  that  it  cannot  yet  produce  a first- 
rate  national  curriculum.  _j0^n  Goodlad,  University  of  Washington 

No,  I believe  in  diversity,  attentiveness  to  multiplicity, 
even  as  we  work  for  a shared  commitment  to  democratic  principles 
and  ideals  (equality,  freedom,  human  rights). 

—Maxine  Greene,  Teachers  College  Columbia  University 

I support  the  development  of  a relatively  small  core  set 
of  expectations  (purposes  of  instruction)  as  a means  to  ensure 


some  common  understandings  among  people.  I do  not  support 
national  curricula  that  specify  technologies,  instructional  means, 
text,  and  so  forth.  It’s  a fairly  safe  bet,  though,  that  school  cur- 
ricula will  continue  to  be  more  of  a sameness  than  different— as 
has  been  true  for  decades.  _Gar>.  Gri$n,  University  of  Arizona 

There  is  nothing  intrinsically  reprehensible  about  a na- 
tional curriculum  for  public  schools.  If  adroitly  fashioned,  so 
that  the  curriculum’s  focus  is  on  educational  enhancement  rather 
than  state-by-state  or  district-by-district  comparisons,  a national 
curriculum  could  benefit  students.  A national  curriculum’s  par- 
ticulars, therefore,  will  determine  whether  it  is  a boon  or  bust. 

—James  Popham,  l OX  Assessment  Associates 

I would  certainly  prefer  a national  curriculum  before 
having  a high  stakes  national  test,  as  some  are  talking  about. 
Still,  that  national  curriculum  would  have  to  promise  important 
and  worthwhile  content  for  all  students,  if  I were  to  be  supportive. 
This  would  require  major  change  from  current  practice,  which 
makes  me  worry  that  a national  curriculum  might  settle  for  less. 

—Andrew  Porter,  University  of  Wisconsin-Madison 

I believe  we  should  have  national  educational  goals,  and 
national  examinations,  but  have  a diversity  of  curricula  to  reach 
those  goals  and  standards.  On  the  other  hand,  if  citizens  want  a 
different  type  of  education  for  their  children,  they  should  not 
be  forced  to  have  their  children  go  through  such  curriculum. 
We  should  be  debating  and  clarifying  goals,  but  at  the  same 
time  encouraging  diversity  and  choice. 

—Kevin  Ryan,  Boston  University 

No.  The  need  for  a personalized  curriculum  that  meets 
the  academic  needs  of  all  students  per  school  district  is  most 
important.  Allowing  the  flexibility  for  each  school  to  design 
the  appropriate  curriculum  for  their  area  is  critical.  No  school 
district  is  the  same— nor  are  the  children. 

—Jane  Stallings,  Texas  A&M  University 

All  public  schools  in  America  should  have  the  common 
purpose  of  helping  students  to  learn  to  be  informed  and  respon- 
sible citizens  in  a democratic  society,  but  the  particulars  of  the 
curriculum  should  vary  with  the  needs  of  the  particular  student 
and  the  resources  of  the  particular  school  and  community. 

—Ralph  Tyler,  Center  for  A Ivanced 
Study  in  Behavioral  Sciences 

Yes.  A national  curriculum  and  goals  will  concentrate 
efforts  on  essential  goals;  permit  greater  efficiency  in  textbooks, 
tests  and  other  instructional  media;  allow  teachers  and  other  local 
educators  to  focus  on  instruction  instead  of  “cottage-industry” 
curriculum  making,  allow  districts  to  reassign  middle  managers 
to  serve  children  directly,  and  to  avoid  present  achievement  set- 
backs of  students  that  move  from  one  district  or  state  to  another. 

— Herbert  Walberg,  University  of  lllinois-Chicago 
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The  Mid-Western  Educational  Research 
Association  (MWERA)  is  a nonprofit  organi- 
zation of  professional  educational  researchers 
primarily  from  states  and  provinces  located  in 
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Referenced  in  ERIC  and  housed  in  the  Library  of  Congress,  the  Mid-Western  Educational  Researcher  is  gain' 
ing  a reputation  as  a valuable  source  of  educational  research  and  information.  The  M id-Westem  Educational  Researcher 
attempts  to  represent  the  diversity  of  topics  and  interests  of  the  Mid-Western  Educational  Research  Association 
membership.  In  our  last  issue  we  dealt  with  the  topic  of  multicultural  issues  in  education;  this  issue  has  more  of 
a measurement  theme.  As  many  of  you  prepare  your  manuscripts  for  October’s  annual  MWERA  meeting,  please 
keep  the  Mid-Westem  Educational  Researcher  in  mind  as  a publication  option.  The  quality  and  diversity  of  the 
journal  is  determined  by  the  manuscripts  submitted. 

You  can  facilitate  the  use  of  the  journal  in  a couple  of  ways.  Although  library  budgets  are  tight  and  periodi- 
cals are  often  difficult  to  get  approved,  the  $18  annual  membership  fee  is  a very  economical  way  of  adding  a periodical 
to  the  library  shelves.  Please  feel  free  to  duplicate  articles  and  share  them  with  students,  colleagues,  and  school 
officials.  We  were  pleased  to  learn  that  Akron  Public  School  District  officials,  impressed  with  the  multicultural 
education  issue  of  the  M id-Westem  Educational  Researcher,  are  using  it  as  the  basis  for  upcoming  inservice  programs. 
Whenever  possible,  cite  articles  appearing  in  the  journal  in  your  own  work. 

As  a final  note  in  this  election  year,  please  encourage  others  outside  of  education  to  consider  education 
issues  when  deciding  how  to  cast  their  vote  in  November.  As  suggested  in  the  article  by  Jack  Snowman  in  this  issue, 
education  policy  often  seems  to  exist  in  isolation  from  the  results  of  educational  research.  Too  often  those  involved 
in  legislation  and  policies  concerning  the  education  of  our  children  make  judgments  solely  on  politics  and  per- 
ceived popular  opinion  without  regard  for  what  researchers  and  practitioners  have  found.  As  advocates  in  educa  - 
tion, we  have  a responsibility  to  educate  policymakers  and  inform  the  public 
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and  research  centers. 

The  College  of  Education  plays  an  important  role  within  the  broad  sphere  of  education  at  The  Ohio  State  University.  Recognized 
as  a leader  in  educational  research  and  scholarship,  The  Ohio  State  University  College  of  Education  has  historically  been  respected 
as  among  the  best  in  the  nation;  and  in  the  most  recent  ranking  placed  second  only  to  Stanford.  Its  peers  in  that  group  have  included 
such  private  institutions  as  Harvard,  Stanford,  Chicago,  and  Columbia’s  Teachers  College,  as  well  as  major  research  universities  such  as 
Michigan  State,  UCLA,  Wisconsin,  and  Illinois. 

With  an  annual  graduate  enrollment  of  2,500  and  a graduate  faculty  of  190,  the  College  of  Education,  through  its  four  depart- 
ments  and  one  school,  offers  more  than  40  areas  of  graduate  specialization,  each  of  which  can  be  individually  designed  to  meet  the  needs 
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Use  of  Norni'Referenced 
Achievement  Tests  in  Evaluation: 

Some  Concerns,  Cautions,  and  Guidelines  * 

By  R.  Tony  Eichelberger,  University  of  Pittsburgh 


There  are  numerous  reasons  why  norm-referenced  testing 
has  become  so  widely  accepted  and  broadly  implemented  in 
U.S.  schools.  Resnick  (1982)  indicates  that  public  support  for 
testing  was  to  keep  our  schools  accountable  for  their  costs  and 
their  educational  quality.  Their  present  uses  by  administrators, 
school  board  members,  and  politicians  demonstrates  this  contin- 
uing process.  For  those  interested  in  these  types  of  concerns, 
Resnick’s  references  provides  a long  list  of  initial  sources  that  are 
quite  comprehensive. 

The  focus  of  this  paper  is  on  the  more  limited  concern 
of  possible  weaknesses  of  norm-referenced  tests  as  measures  of 
outcomes  of  educational  programs  in  evaluation  settings.  This 
will  be  done  by  delineating  the  purposes  for  which  the  tests  arc 
developed,  important  steps  in  the  test  development  process,  and 
characteristics  of  the  tests  and  the  scores  derived  from  them  that 
affect  their  utility  for  decision  making.  The  characteristics  are  related 
to  the  information  needs  of  those  responsible  for  making  decisions 
that  evaluations  are  to  inform,  and  some  common  beliefs 
about  the  tests.  Finally,  guidelines  are  proposed  for  determining 
the  utility  of  standardized  test  scores  in  specific  evaluations. 


Characteristics  of  Norm-Referenced 
Achievement  Tests 

Norm-referenced  achievement  tests  were  developed  to 
assess  student  achievement  on  important  educational  objectives 
that  are  commonly  taught  in  U.S.  schools.  (A  common  criterion 
used  by  test  developers  is  to  cover  curricular  materials  studied  by 
80  percent  or  more  of  the  students  in  the  United  States.  This 
criterion  is  often  applied  within  each  of  the  most  populous  states 
in  order  to  maximize  potential  sales.)  Because  of  the  limited 
time  that  schools  have  available  for  testing  and  other  constraints, 
a limited  number  of  test  items  can  be  used  in  each  subject  area, 
and  each  level  of  the  test  is  used  across  two  or  three  grade  levels. 
As  a result,  each  level  of  a test  includes  items  that  address  edu- 
cational objectives  taught  in  three  or  more  grade  levels.  In  addi- 
tion, the  tests  must  be  machine  scorahlc,  which  limits  the  types 
of  test  items  that  can  he  used.  In  fact,  most  standardized  test 
items  arc  in  a multiple  choice  format. 

In  this  article  practical  and  technical  bases  used  to  develop 
tests  that  school  districts  would  find  useful  arc  emphasized.  The 
results  of  these  decisions  on  the  c harac 1 eristics  of  the  tests  and 


the  scores  they  produce  are  presented  and  discussed  within  the 
following  categories: 

1.  Purposes  for  constructing  norm-referenced  achieve- 
ment tests. 

2.  Content  coverage  of  norm-referenced  tests. 

3.  Psychometric  screening  of  test  items. 

4.  Form  of  the  measurement. 

5.  Summary  scores. 

6.  Sensitivity  of  norm-referenced  test  to  education. 

7.  Construct  validity  of  norm-referenced  achievement  tests. 

Much  of  my  thinking  about  these  issues  and  how  the 
evidence  can  be  organized  to  address  considerations  of  test  use 
has  been  influenced  greatly  by  the  work  of  George  Madaus  and 
his  colleagues,  particularly  in  their  book,  Sc/ioo/  Effectiveness: 
A Reassessment  of  the  Evidence  (Madaus,  Airasian,  <5c  Kcllaghan, 
1980).  Their  results  have  been  very  consistent  with  my  experi- 
ences with  test  use  in  the  Dallas  (TX)  Independent  School  Dis- 
trict, Pittsburgh  Public  Schools,  Learning  Research  and  Develop- 
ment Center,  and  other  education  evaluation  settings. 

Purposes  for  Constructing  Norm-Referenced  Achieve- 
ment Tests.  Given  the  pluralistic  nature  of  this  society,  the  fact 
that  education  is  the  responsibility  of  the  states,  and  that  the  states 
have  given  the  responsibility  to  local  school  boards;  adminis- 
trators, teachers,  school  board  members,  parents,  and  other  citi- 
zens have  needed  a way  to  determine  how  the  students  in  their 
school  district  are  doing  academically.  With  the  wide  variety  of 
ways  that  schools  choose  to  educate  their  students,  there  is  no 
single  method  for  comparing  the  achievement  of  students  from 
different  communities  or  states  that  shows  how  well  that  educa- 
tional process  is  working,  cither  for  the  individual  child  or  for 
the  system.  Norm-referei».  . 1 achievement  tests  were  developed 
to  assess  the  major  subject  areas  (i.e.,  reading,  math,  social  studies, 
science,  spelling,  vocabulary,  etc.)  so  that,  at  least,  knowledge 
and  skills  of  students  in  the  basic  content  areas  could  be  moni- 
tored. Educators  and  parents  would  know  how  well  students  were 
learning  basic  academic  skills.  For  example,  the  mother  of  an 
inner  city  minority  student,  in  response  to  a report  of  how  the 
achievement  of  her  child’s  schml  compared  with  other  urban 
schools,  said:  "I  don’t  care  about  that,  1 want  to  know  how  my 
ihild  is  doing  compared  to  the  best  students  in  the  country, 
because  that’s  who  she  will  have  to  compete  against” 
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Norirt'Referen ced  Achievement  Tests  (continued) 


In  order  to  provide  information  that  maximizes  student 
comparisons,  tests  were  developed  that  would  distribute  students’ 
scores  as  widely  as  possible  across  the  score  scale.  This  approach 
maximizes  reliability  of  a set  of  test  scores,  and  is  consistent  with 
the  view  that  students  varied  greatly  in  their  intellectual  capacity. 
In  order  for  tests  to  be  “fair”  and  comparable  across  school  dis- 
tricts, they  had  to  focus  on  educational  objectives  that  were 
common  to  the  various  curricula  used.  The  limitations  on  the 
number  of  items  that  could  be  included  on  a test  and  the  form 
rhe  test  items  could  take  to  be  machine  scorable  meant  that 
only  selected  aspects  of  the  content  in  a subject  area  taught  in 
a particular  class  at  a specific  grade  level  could  be  included  on 
a test.  What  has  been  learned  about  content  coverage  of  nornv 
referenced  tests  and  their  resulting  scores  have  implications  for 
their  use  in  evaluation  settings. 

Content  Coverage  of  Norm-Referenced  Tests.  Most  standard- 
ized  tests  at  the  elementary  and  secondary  grade  levels  include 
between  45  and  70  items.  Subtests,  such  as  reading  comprehen- 
sion, vocabulary,  and  math  computations,  may  include  as  few 
as  10,  but  typically  range  between  30  and  50  items.  Tests  are 
developed  from  the  objectives  covered  by  the  10-12  textbooks 
most  commonly  used  in  the  United  States  (Madaus  et  al.,  1980), 
particularly  those  in  large  cities  and  more  populous  states.  After 
test  items  arc  developed  they  are  tried  out  in  developmental 
forms  of  standardized  tests.  Final  forms  of  the  tests  arc  based  on 
the  item,  characteristics  obtained  from  the  tryout  phase.  Test 
items  that  nearly  everyone  answers  correctly,  as  well  as  those 
thnt  few  get  correct,  are  systematically  eliminated  from  the  final 
edition  of  the  test,  because  they  do  not  contribute  to  variation 
in  the  scores.  How  this  affects  the  final  content  coverage  of  a 
test  has  never  been  reported,  but  it  seems  likely  that  some  of 
the  most  important  concepts  that  everyone  in  the  tryout  popula- 
tion tended  to  learn  would  be  eliminated. 

Two  types  of  studies  in  a variety  of  settings  that  provide 
much  information  on  content  coverage  of  standardized  tests  are: 
(1)  overlap  between  test  items  and  content  taught  in  a specific 
evaluation  setting,  and  (2)  identification  of  the  grade  level  in  a 
particular  school  district  where  that  specific  content  assessed  bv 
the  norm-referenced  test  is  taught.  The  most  comprehensive 
study  that  reports  overlap  between  tests  administered  at  specific 
grade  levels  and  the  content  the  students’  actually  studied  that 
year  was  the  Instructional  Dimensions  Study  (Cooley  <Sc  Lcin- 
hardt,  1978).  In  400  first  and  third-grade  classrooms,  the  mean 
percentage  of  educational  objectives  addressed  by  a norm-refer- 
enced test  that  students  in  that  classroom  spent  time  studying 
that  year  (across  all  classrooms)  ranged  from  15  percent  to  56 
percent.  Cooley  and  Leinhardt  report  that  in  those  dassnx'uns 
with  the  highest  percentage  of  overlap,  more  than  one-third  of 
the  items  on  the  standardized  test  administered  to  the  students 
covered  material  that  the  students  had  not  studied  that  year.  In 
a similar  type  of  study,  results  arc  reported  in  mathematics  bv 


LeMahieu  (198.3)  at  grades  2,  5,  and  8 of  a iarge  urban  district. 
He  compared  items  on  a norm-referenced  test  used  m the  dis- 
trict with  test  items  on  their  locally  developed  te*t*  that  are 
tied  to  the  curriculum  at  each  grade  level.  Most  of  the  norm- 
referenced  test  items  assessed  knowledge  that  had  not  been  taught 
at  that  grade  level.  The  overlap  became  less  at  higher  grade  levels, 
with  more  of  the  norm- referenced  test  items  not  matching  items 
on  the  local  tests  at  any  grade  level  (see  Tible  1). 
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Several  studies  of  the  overlap  between  the  v*  mtent  te*ied 
by  the  norm-reference*  1 test  administered  at  a particular  enle 
level  and  the  content  covered  bv  the  lurruuluni  u*ed  .it  that 
grade  level  have  been  done  in  different  wav*  lor  different  purpoM> 
in  several  school  district*.  In  general,  they  foutul  that  approxi- 
mately half  of  the  items  on  their  standardized  u**t  .i**c**cd  i on- 
tent  that  was  not  taught  at  that  urade  level. 

These  result*  may  not  be  particularly  troubling  tor  man\ 
school  districts  thnt  use  rhe  te*t  re*ulr*  to  *ee  how  the  ediKn 
tional  system,  a*  a whole,  is  doing,  or  to  monitor  the  pmgre** 
of  individual  student*  nil  the  ufyiifni'  i /w  di*  rru  li  i- 
a problem  when  the  norm  reteremed  lost  i*  u*ed  to  a**t**  the 
effects  of  an  innovation  that  ha*  been  implemented  at  a *(msi1i* 
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grade  level,  particularly  if  the  program  has  operated  for  only  one 
or  two  years.  Each  summary  score,  whether  for  a subtest  or  the 
entire  battery,  will  be  greatly  affected  by  the  quality  of  previous 
educational  experiences,  as  reflected  by  students’  scores  on  the 
test  items  addressing  material  taught  at  those  levels  (and  not 
studied  during  the  year  of  the  evaluation  in  program  participation). 

The  problem  becomes  even  greater  when  attempting  to 
evaluate  exceptional  groups,  such  as  in  special  education,  reme- 
dial,  and  gifted  programs.  In  the  evaluation  of  a remedial  reading 
program  for  sixth  grade  students  using  DISTAR,  there  was  ZERO 
overlap  between  the  norm-referenced  test  and  the  curriculum 
(Eichclbcrgcr,  Southworth,  <Sc  Solter,  1980).  That  means  that 
not  a single  item  on  the  test  administered  to  these  students  as- 
sessed an  objective  or  skill  that  these  students  had  studied  during 
an  entire  year.  Every  item  on  the  test  assessed  content  that  these 
.students  had  not  studied  in  the  remedial  program  being  evaluated. 

The  norm-referenced  test  was  not  valid  as  a measure  of 
what  was  taught  or  what  was  learned,  because  there  were  no 
items  that  addressed  that  content.  The  norm-referenced  test  was 
still  a valid  measure  of  what  the  students  knew  in  terms  of  the 
knowledge  and  skills  assessed  by  the  test,  which  a district  can 
use  to  monitor  how  well  their  students  are  doing  on  these  objec- 
tives (as  assessed  by  these  items).  It  provides  NO  information 
about  what  the  students  learned  in  terms  of  the  content  that 
thev  spent  rhe  year  studying. 

Other  content  that  norm-referenced  tests  do  not  assess  is 
that  which  is  idiosyncratic  to  a particular  school  district,  or  class- 
room within  a school  district.  The  process  used  to  select  educa- 
tional objectives  to  be  included  on  a norm-referenced  test  is 
based  on  a relatively  homogeneous  view  of  the  structure  of  knowl- 
edge and  how  it  is  taught  across  grade  levels.  When  an  innovative 
curriculum  is  developed  that  changes  the  order  m which  content 
ss  taught,  or  requires  more  in-depth  understanding  of  subject 
matter  at  an  earlier  grade  level,  available  norm-referenced  tests 
are  often  invalid  measures  of  the  academic  effects  of  those  inno- 
vations. For  example,  Champagne  and  Klopfer  had  problems 
with  the  norm -referenced  tests  available  for  science  at  the  ele- 
mentary and  middle  school  levels.  Their  new  curriculum  required 
a more  sophisticated  understanding  of  science  than  usually  oc- 
curred at  these  grade  levels.  Their  elementary  and  middle  school 
students’  knowledge  of  science  was  different  than  that  of  other 
students  in  the  same  grade.  As  a result,  their  students  did  poorly 
on  norm-referenced  scrence  tests  because,  on  some  items,  the 
answer  keyed  as  correct  (for  students  who  had  studied  the  typical 
sviem  e curricula),  v as  not  the  only  “right”  answer  for  those  who 
knew  the  science  concepts  at  a more  in-depth  level. 

This  example  is  not  meant  to  bo  typical  of  innovative  cur- 
ricula and  associated  standardized  tests,  but  is  to  illustrate  the  fact 
that  norm-referenced  tests  arc  developed  to  precisely  assess  the 
knowledge  that  is  taught  in  the  most  commonly  used  curricula. 
If  the  educational  program  being  evaluated  differs  from  them,  it 
is  likely  that  the  norm  referenced  test  will  produce  inaccurate,  if 


not  bizarre  results.  In  many  cases  it  may  not  even  be  a good  measure 
of  how  well  students  know  the  content  that  the  test  covers,  and 
cannot  serve  the  type  of  monitoring  function  that  most  users  of 
norm-referenced  test  results  normally  expect. 

Psychometric  Screening  of  Test  Items.  As  indicated  earlier, 
a primary  concern  of  test  developers  is  to  maximize  the  reliability 
of  the  test  scores.  This  increases  the  ability  to  differentiate  stu- 
dents on  their  knowledge  of  the  content  covered  by  the  test. 
Test  items  in  the  mid-range  of  difficulty  (where  approximately 
40  percent  to  60  percent  of  the  students  answer  the  item  cor- 
rectly) are  needed  to  maximize  reliability.  Madaus  et  al.  (1980) 
state  that  “In  practice,  test  constructors  seek  to  attain  a test 
that  contains  items  with  a modal  difficulty  of  about  .625.”  They 
go  on  to  indicate  that  those  items  at  either  end  of  the  difficulty 
range  (where  nearly  all  of  the  students  answer  the  item  correctly 
or  incorrectly)  contribute  little  or  nothing  to  distributing  stu- 
dents’ scores  across  the  score  scale.  The  fewer  the  number  of 
items  on  a test,  or  subtest,  the  more  important  it  is  to  have  items 
in  the  mid-range  of  difficulty. 

How  this  concern  affects  the  selection  of  content  covered 
on  the  test  is  not  clear,  although  researchers  have  indicated  their 
concern  that  important  objectives  which  have  been  mastered  by 
most  students  would  not  be  tested.  For  educators  who  are  con- 
cerned with  mastery  models  of  learning  (where  students  are  re- 
quired to  master  the  knowledge  and  skills  covered  by  the  curric- 
ulum before  moving  to  the  next  topic),  tests  must  cover  the  most 
important  educational  objectives  for  students  wherever  they  may 
be  studying  in  the  curriculum.  It  is  likely  that  the  criteria  for 
screening  items  to  maximize  reliability,  will  result  in  a some- 
what random  selection  of  the  content  to  be  tested,  rather  than 
including  those  objectives  (or  knowledge  and  skills)  viewed  as 
most  important  by  educators. 

The  screening  of  items  for  psychometric  characteristics  may 
systematically  eliminate  those  items  viewed  by  educators  as 
being  most  important,  as  those  arc  the  objectives  that  teachers 
will  work  the  hardest  to  sec  that  students  learn.  The  groups  of 
students  who  take  the  tests  arc  more  likely  to  score  well  on  the 
items  that  arc  most  important  to  educators,  meaning  that  they 
are  underrepresented  on  the  standardized  tests  administered  to 
students  in  the  schools.  It  also  means  that  the  tests  provide  no 
information  on  the  knowledge  and  skills  that  arc  not  directly 
assessed  by  the  test. 

Form  of  the  Measurement,  A number  of  studies  have  shown 
that  the  form  of  the  test  items,  the  wording  of  the  items,  and 
other  characteristics  of  the  test  and  conditions  of  administration 
have  an  effect  on  studenrs’  scores.  For  example,  Glass  (1977) 
rcjxirtcd  that  in  a New  Jersey  state  assessment  students  averaged 
86  percent  correct  on  vertical  addition  problems  and  46  percent 
on  similar  horizontal  problems.  Rice  (1897)  found  that  the 
teacher’s  pronunciation  of  the  words  affected  students’  scores. 
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Differences  between  the  ways  in  which  specific  content 
is  learned  and  how  it  is  tested  has  long  been  a concern  of  edu- 
cators. The  limitations  of  the  multiple-choice  format  for  most 
norm-referenced  achievement  test  items  are  not  clear.  But  several 
researchers  have  calculated  correlations  between  norm-referenced 
test  scores  and  more  direct  measures  of  student  achievement 
(Bloom,  1976;  Foley,  1971;  Stake,  1972).  Few  of  the  correlations 
are  high.  Madaus  et  al.  (1980)  indicate  that  the  tests  appear  to 
measure  different  things,  general  ability  vs.  specific  skills. 

In  evaluating  the  effects  of  the  Primary  Education  Pro- 
gram (PEP)  and  Individually  Prescribed  Instruction  (IPI)  at  the 
Learning  Research  and  Development  Center,  we  were  able  to 
document  that  students’  achievement  test  scores  increased  dra- 
matically after  only  two  or  three  weeks  in  the  program.  The 
national  evaluation  of  the  Follow  Through  Program  (where  these 
programs  were  operating)  gave  pretests  at  the  beginning  of  kinder- 
garten, or  first  grade  if  there  was  no  kindergarten.  Comparison 
students  were  identified  in  the  same  school  district.  These  stu- 
dents were  similar  to  the  Follow  Through  students  on  a number 
of  socio-economic  variables,  which  would  predict  similar  levels 
of  pretest  scores  on  the  standardized  test.  In  fact,  the  Follow 
Through  students  had  significantly  higher  pretest  scores  (almost 
a half  year  mean  difference  in  grade  equivalents)  after  only  three 
weeks  of  instruction.  Both  the  PEP  and  IPI  curricula  involved 
curriculum  imbedded  tests  that  were  very  similar  to  the  types 
of  test  items  on  the  Metropolitan  Readiness  and  Achievement 
Tests  that  were  used  as  pretests.  The  IPI  curriculum  also  had  an 
initial  placement  test  to  place  each  student  at  the  appropriate 
location  in  the  hierarchical  curriculum.  Students  quickly  learned 
how  to  take  these  tests,  thus  improving  their  scores.  Others  have 
found  similar  impacts  with  naive  students  (Eichelbergcr,  1973; 
Eichelberger  <St  Boston,  1976). 

Summary  Scores.  There  are  a number  of  characteristics  of  norm- 
referenced  summary  scores  that  affect  their  use  in  evaluation. 
Many  different  types  of  problems  can  occur,  some  unique  to  a 
specific  situation.  Most  of  the  problems  arise  from:  the  charac- 
teristics of  the  group  being  tested,  when  the  tests  were  adminis- 
tered, the  use  of  group  (rather  than  individual)  scores,  the  use  of 
subtest  or  battery  scores  to  represent  achievement  levels,  and 
the  use  of  normal  curve  equivalent  scores  (NCEs)  to  compare 
achievement  across  norm-referenced  tests. 

When  a group  that  is  tested  with  a norm -referenced  test 
is  not  similar  to  the  group  for  which  the  test  was  developed  and 
on  which  it  was  normed,  the  meaning  of  the  psychometric  char- 
acteristics of  the  test  (such  as  reliability)  and  of  the  standard 
scores  is  not  dear.  A norm-referenced  test  with  a reliability  of 
.90  across  the  entire  U.S.  elementary  school  population  may 
haw  a .60  or  .75  reliability  with  remedial  or  special  education 
students.  An  evaluator  (or  recarcher)  cannot  assume  that  reli- 
ability of  the  test  stays  the  same  for  different  groups.  In  fact, 
Maduas  ct  al.  (1980)  report  that  less  than  5 pereent  of  norm- 
referenced  rest  items  are  at  a difficult v level  that  remedial  stu- 


dents could  answer  correctly.  At  the  extremes  of  the  achieve- 
ment distribution,  such  as  in  remedial  or  gifted  programs,  norm- 
referenced  tests  do  not  provide  reliable  measures  of  student 
achievement. 

The  second  problem  with  using  a norm-referenced  test  with 
a group  that  is  not  similar  to  the  norming  sample  is  that 
the  norms  are  not  meaningful.  The  purpose  of  norms,  or  any 
transformed  score,  is  to  indicate  where  this  score  falls  within 
some  defined  group.  If  the  score  comes  from  a person  who  was 
not  represented  in  the  norming  population  (such  as  a special 
education  or  hearing-impaired  student,  or  an  adult),  the  only 
basis  for  interpreting  the  meaning  of  the  score  is  that  the  raw 
score  obtained  by  this  person  is  like  that  of  a person  who  falls 
at  a specific  place  in  the  distribution  (such  as  at  the  3.4  grade 
equivalent,  the  4th  percentile,  or  the  33rd  standard  score).  Unless 
the  educational  program  that  students  experienced  was  like  that 
assumed  by  the  tesr,  the  interpretation  of  their  test  scores  is  not 
meaningful  in  most  evaluation  contexts. 

The  time  of  year  that  a norm-referenced  test  is  adminis- 
tered affects  the  meaning,  and  use,  of  standard  scores,  because 
test  norms  arc  developed  for  only  one  or  two  testing  periods 
(usually  fail  and  spring).  Transforming  raw  to  standard  scores  is 
based  on  the  average  (median)  number  of  items  a norm  group 
answered  correctly  at  a specific  time  in  their  academic  life,  such 
as  the  second  month  of  the  third  grade  (3.2).  Most  tests  are 
normed  for  the  beginning  and  end  of  the  school  year.  If  they  are 
administered  at  any  other  time,  there  is  no  comparable  data  from 
the  norming  population  on  which  to  base  a standard  score. 

As  indicated  above,  norm-referenced  tests  were  developed 
to  measure  the  achievement  of  individual  students  in  the  basic 
skills  areas  of  U.S.  educational  content.  They  are  based  on 
the  psychology  of  individual  differences,  which  requires  that 
the  instruments  distribute  student  scores  as  broadly  as  possible  in 
order  to  maximize  distinctions  between  students.  Much  is  known 
about  the  psychometric  characteristics  of  individual  scores  from 
norm-referenced  tests,  but  little  is  known  about  group  scores,  such 
as  means.  Cronbach  and  his  colleagues  (Ross  <Sc  Cronbach,  1976) 
indicate  that  the  use  of  such  scores,  and  associated  tests  of  sig- 
nificance, are  difficult  to  interpret.  If  group  scores  are  more  reliable 
than  individual  scores,  then  small  differences  between  groups 
may  represent  consistent  and  meaningful  differences  between 
groups  who  had  different  experiences  than  the  classical  statis- 
tical treatment  of  such  data  indicate  (Ross  <Sc  Cronbach,  1976). 

Reporting  mean  scores  for  a group  who  had  experienced 
a specific  program,  which  is  usually  done  in  evaluation  reports, 
usually  misrepresents  the  outcomes  of  a particular  innovation. 
Given  the  lack  of  a total  overlap  between  what  is  taught  in  a 
specific  educational  program  and  what  is  tested  by  the  norm- 
referenced  test  administered  to  program  participants,  mean  scores 
do  not  provide  adequate  information  about  the  program’s  effects 
in  the  subject  represented  by  the  score  (such  as  Total  Reading, 
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Vocabulary  Spelling,  Problem  Solving,  or  Civics).  If  two  programs 
are  being  compared,  the  total  scores  will  mask  school  or  program 
differences  at  the  test  item  or  objective  level.  This  is  one  of  the 
reasons  for  “no  significant  difference”  findings  that  are  so  com- 
mon in  evaluations  using  traditional  statistical  techniques  with 
average  scores  (usually  means).  In  most  comparisons  between 
two  or  more  programs,  each  program  has  particular  strengths  and 
weaknesses.  Even  though  norm-referenced  tests  are  not  developed 
to  measure  such  strengths  and  weaknesses,  differences  on  specific 
test  items  will  be  far  more  informative  than  the  mean  or  other 
total  score.  Although  there  are  many  problems  with  interpreting 
results  of  selected  items  from  any  norm-referenced  test. 

Madaus  and  other  researchers  have  shown  that  different 
groups  of  test  items  within  the  same  test,  or  subtest,  differen- 
tiated academic  achievement  from  different  programs  in  opposite 
directions.  That  is,  some  items  on  a test,  or  subtest,  showed  pro- 
gram A to  be  superior,  while  other  items  on  that  same  test,  or 
subtest,  showed  Program  B to  be  superior.  In  my  experience, 
that  is  what  occurs  in  nearly  all  education  evaluation  compari- 
sons; each  program  has  particular  strengths  and  weaknesses,  so 
that  decisions  depend  on  how  decision  makers  valued  which 
strengths  (or  weaknesses).  When  mean  scores  are  produced,  even 
when  there  are  significant  differences  between  groups,  there  are 
a number  of  things  that  the  “inferior”  program  does  better  than 
the  “superior”  program.  As  Averch  et  al.  (1972)  and  others  have 
found,  using  a single  number  to  represent  the  cost-effectiveness  of 
an  educational  program  tends  to  hide  more  than  inform.  Simi- 
larly, total  scores,  means,  and  other  summary  scores  tend  to  mis- 
represent the  achievement  of  students  in  a particular  program, 
often  in  ways  that  arc  important  to  decision  making. 

Another  type  of  summary  score  has  been  developed  by 
the  federal  government  to  assess  remedial  programs  they  fund 
that  use  different  norm-referenced  tests,  the  normal  curve  equiva- 
lent (NCE)  score.  The  NCE  is  a normalized  standard  score,  which 
is  calculated  using  the  following  formula: 

NCE  = 21.06z  + 50  (Nitko,  1983). 

To  use  it  across  norm-referenced  achievement  tests  requires  the 
assumption  that  the  same  scores  on  different  tests  represent  the 
same  thing.  It  is  probably  the  best  indicator  that  the  federal 
government  can  use  to  monitor  Chapter  I remedial  programs 
(Tallmadge  <Sc  Wood,  1976),  but  it  is  not  very  informative  in  spe- 
cific evaluation  settings.  First,  NCEs  have  the  same  problems 
that  exist  for  standard  scores.  In  addition,  they  use  the  standard 
scores  from  different  tests,  which  in  most  cases  means  that  they 
are  based  on  different  knowledge  and  skills  (or  objectives). 

Tvo  of  the  criticisms  that  this  paper  addresses  are  the 
insensitivity  to  education  (or  learning),  and  the  fact  that  they 
arc  affected  by  a persons  socio-economic  or  ability  levels  (which 
is  discussed  under  Construct  Validity).  The  insensitivity  of  norm- 
referenced  multiple  choice  type  items  was  best  illustrated  to  me 
in  1984,  while  evaluating  a five  week  summer  school  for  about 


60  of  the  top  achieving  students  in  the  Commonwealth  of  Penn- 
sylvania. Multiple  choice  items  were  taken  from  a variety  of 
standardized  tests  developed  for  high  school  or  college  students 
that  covered,  generally,  the  international  studies  topics  that  the 
school  would  cover.  The  mean  scores  on  the  items  went  from 
38.4  on  the  pretest  to  38.5  on  the  posttest  (Wood,  White,  Sc 
Eichelberger,  1985).  This  was  shocking  to  participating  teachers 
and  administrators,  because  the  school  had  been  very  demanding 
and  both  the  students  and  instructors  knew  that  the  students 
had  gained  a great  deal  of  knowledge  on  the  topics  tested.  When 
the  teachers  looked  at  the  items,  they  indicated  that,  in  most 
cases,  the  topic  had  been  covered,  but  the  specific  objective 
that  the  test  item  assessed  was  not  pointed  out  in  any  way.  In 
following  years  the  instructors  and  evaluators  developed  test 
items  that  were  addressed  by  each  class,  which  did  document 
the  knowledge  and  skills  gained  by  the  students. 

Brickell  (1976),  in  evaluating  career  education  programs 
in  Ohio,  found  that  tests  based  on  objectives  stated  in  the  various 
curricula  guides  did  not  differentiate  such  programs  on  student 
achievement.  Only  after  they  developed  tests  that  reflected  the 
educational  activities  that  the  students  experienced  were  the  tests 
'able  to  differentiate  the  achievement  gains  of  students  in  the 
various  programs. 

Construct  Validity  of  Norm-Referenced  Achievement  Tests. 
There  is  a good  deal  of  information  which  indicates  that  norm- 
referenced  achievement  tests  are  essentially  ability  tests.  Cooley 
and  Lohnes  (1976)  found  that  educators  and  researchers  were 
unable  to  identify  achievement  test  items  from  a list  of  test  items 
taken  from  both  ability  and  achievement  tests.  They  interpreted 
this  to  mean  that  there  are  no  fundamental  differences  between 
the  two  types  of  tests.  Either  achievement  tests  were,  essentially, 
ability  tests;  or  ability  tests  were  actually  achievement  tests. 

Madaus  and  his  colleagues  (1980)  report  that  the  types 
of  item  analysis  techniques  used  to  develop  norm- referenced 
achievement  tests  for  use  across  a variety  of  curricula  “tend  to 
purge  the  test  of  a specific-knowfledgc  items  and  to  select  items 
which  measure  a general  underlying  trait”  (p.  147).  Evidence 
from  a variety  of  sources  indicates  that  the  skills  tapped  by  norm- 
referenced  achievement  tests  are  essentially  the  same  as  those 
assessed  by  ability  tests,  neither  of  which  measure  school-specific 
learning.  These  include  the  findings  that  intelligence  tests  cor- 
relate about  the  s me  with  norm-referenced  achievement  tests 
as  they  do  writh  other  intelligence  measures  (Anastasi,  1968; 
Bloom,  1976;  Coleman  et  al.,  1966);  factor  analyses  of  norm- 
referenced  achievement  and  ability  measures  commonly  used  in 
schools  show  that  both  arc  highly  dependent  on  a general  intel- 
lectual development  factor  (Cooley  &.  Lohnes,  1976);  and  that 
verbal  ability  greatly  influences  achievement  test  scores  (Bloom, 
1964;  1976). 

These  and  other  studies  indicate  that  achievement  test 
scores  are  affected  by  a number  of  non  school  variables,  such  as 
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general  intelligence,  verbal  ability,  drawing  inferences,  etc.,  many 
of  which  arc  more  home-based,  rather  than  school-based  factors. 
Present  norm-referenced  achievement  tests  have  been  defined 
more  at  the  general  construct  level  than  at  the  knowledge  or 
skill  level,  where  schools  focus  their  educational  energies. 

These  characteristics  are  greater  at  the  elementary  school 
level  than  at  junior  or  senior  high  school  levels.  As  tests  become 
more  content  specific,  such  as  in  German,  American  history,  civics, 
and  chemistry,  the  tests  focus  on  more  school-specific  variables. 
These  tests  are  less  like  general  ability  tests,  and  have  more  validity 
as  achievement  tests  (Bloom,  1976). 

Guidelines  for  Use  of 
Norm-Referenced  Tests  in  Evaluation 

Given  these  characteristics,  what  guidelines  do  these  pro- 
vide for  evaluators  (and  researchers)  who  either  want  to  use  norm- 
referenced  tests  to  measure  effects  of  educational  programs,  or  who 
need  to  document  the  effects  of  educational  programs  and  are 
concerned  about  the  appropriate  use  of  norm-referenced  tests. 
Some  questions  that  relate  to  this  issue  are  organized  within  four 
categories:  Program  Outcomes  and  Associated  Measures,  Test 
Characteristics,  Student  Characteristics,  and  Test  Administration: 

A.  Program  Outcomes  and  Associated  Measures. 

1.  Are  the  primary  goals  and  objectives  of  the  educational 
program  focused  on  topics  that  the  norm-referenced 
test  assesses? 

2.  Is  the  educational  curriculum  based  on  the  same  set  of 
objectives,  beliefs  about  the  structure  of  knowledge,  and 
the  order  in  which  the  objectives  are  taught  as  those 
10-12  curricula  on  which  the  test  was  developed? 

3.  Is  the  knowledge  taught  in  a way,  including  format,  that 
is  consistent  with  how  it  is  tested  on  the  norm-refer- 
enced test? 

4.  Is  the  norm-referenced  test  likely  to  be  sensitive  to  the 
effects  of  the  program,  if  such  effects  occur? 

5.  Are  the  subtesr  or  total  scores  likely  to  be  meaningful  in 
this  setting,  or  should  specific  test  items  be  analyzed? 

6.  Are  there  other  measures,  or  indicators,  of  academic 
achievement  (such  as  reports,  papers,  tests  or  grades) 
already  being  collected  that  would  more  accurately  assess 
important  educational  outcomes  or  effects? 

7.  Should  additional  measures,  or  indicators,  of  academic 
achievement  be  identified  or  developed? 

B.  Student  Characteristics 

1.  Is  the  group  of  students  similar  to  those  on  whom  the  lest 
was  normed?  If  not,  will  the  lest  provide  scores  that  accur- 
ately represent  the  knowledge  and  skills  of  these  students? 

7.  Are  other  tests  that  arc  appropriate  for  the  unique  stu- 
dents in  this  particular  program  being  administered? 


3.  Should  additional  measures,  or  indicators,  be  identified 
or  developed  for  these  students? 

C.  Norm  Referenced  Test  Characteristics 

1.  What  is  the  overlap  between  the  objectives  that  are 
taught  (studied)  in  this  program  and  the  items  on  the  test? 

a.  Are  the  most  important  objectives  of  the  program 
measured  by  the  test? 

b.  What  is  measured  by  the  test  that  is  not  covered  by 
students  in  the  program? 

2.  Has  this  test  (or  any  other  norm-referenced  test)  been 
used  in  the  past  to  assess  the  effects  of  this  program,  or 
to  assess  these  students  when  they  used  other  curricula? 
a.  Have  students  evidenced  academic  growth  that  was 

expected  by  the  teachers  or  other  educators? 
h.  Was  student’s  academic  achievement  meaningfully 
different  on  this  norm-referenced  test  in  comparison 
to  other  tests? 

c.  Arc  students’  scores  higher  when  this  test  is  used 
to  assess  the  academic  outcomes  of  this  program 
than  when  other  norm-referenced  achievement  tests 
were  used? 

D.  Test  Administration 

1.  Is  the  test  administered  during  the  same  month  that  test 
publishers  had  developed  norms  for  the  test? 

2.  Is  the  test  kept  under  secure  conditions  so  that  no  one 
can  teach  the  specific  test  items? 

3.  Do  some  teachers  or  schools  provide  test-taking  practice 
that  would  invalidate  the  test  norms? 

4.  Is  the  test  administered  precisely  as  described  by  the 
test  publisher? 

5.  Do  teachers  or  principals  do  anything  unusual  to  prepare 
students  for  the  test,  or  allow  any  way  for  a particular 
teacher  to  modify  students’  responses  in  any  way? 

6.  If  a norm-referenced  test  is  used  in  an  evaluation,  is  any 
particular  group  of  students  absent  from  the  tc.o  adminis- 
tration, or  tested  in  a way  that  would  affect  their  scores? 

*This  research  was  supported  through  a grant  from  the  Lilly 
Enduurnent , Inc.,  Indianapolis , IN.  The  news  expressed  do  not  ncccs- 
sarily  reflect  the  position  of  the  Lilly  Endowment,  Inc.  Dolores  Weaver 
provided  valuable  assistance  in  the  initial  compilation  of  materials. 
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The  Use  of  Kindergarten  Screening  Scores 
to  Identify  the  Need  for  Reading  Intervention 

By  John  W.  Fraas  and  Jayn  Crail,  Ashland  University 


Abstract 

The  purpose  of  this  study  was  to  examine  the  possibility  of  using  the  kindergarten  screening  scores  to  predict  whether  a stu- 
dent would  qualify  for  a reading  intervention  program  in  first  grade.  If  the  kindergarten  screening  scores  could  be  used  for  early  iden- 
tification, the  administration  would  consider  implementing  an  intervention  program  prior  to  when  the  students  entered  first  grade. 
A sample  of  243  students  was  selected  from  the  seven  elementary  schools  in  an  Ohio  city.  The  scores  of  121  students  were  subjected 
to  logit  regression  analysis.  The  remaining  122  students  were  used  as  a holdout  group  for  the  purpose  of  cross-validating  the  logit 
regression  model’s  ability  to  correctly  discriminate  among  students  who  did  or  did  not  qualify  for  the  current  reading  intervention 
program.  Since  the  model  produced  few  false-positive  classifications,  the  school  administration  could  use  the  model  to  identify  stu- 
dents for  its  new  intervention  program. 


Children  who  do  not  learn  to  read  by  the  end  of  first  grade 
will  fail  to  achieve  in  almost  all  other  areas  of  the  curriculum 
(Boehnlein,  1987).  For  many  children,  regular  classroom  instruc- 
tion is  all  that  is  needed,  but  experience  in  regular  classrooms 
alone  is  not  sufficient  for  some  students.  Thus,  in  response  to  this 
need,  many  public  school  systems  have  developed  reading  inter- 
vention programs.  One  element  of  these  intervention  programs 
is  early  identification  of  students  who  need  reading  assistance. 

In  current  literature,  a debate  has  continued  on  the  use 
of  kindergarten  screening  instruments.  Titles  such  as:  “Not 
Ready!  Don’t  Rush  Me!”  (Hammond,  1986);  “Uses  and  Abuses 
of  Developmental  Screening  and  School  Readiness  Testing” 
(Meisels,  1987);  and  “How  Best  to  Protect  Children  From  Inap- 
propriate School  Expectations,  Practices,  and  Policies”  (Brede- 
kamp  <$c  Shepard,  1989),  point  out  the  controversy  surrounding 
the  current  uses  of  kindergarten  screening  procedures.  The  very 
practice  of  testing  groups  of  young  children  is  questioned  in 
various  articles  (Charlesworth,  1989;  Wodtke,  Harper,  Schommer, 
<Sc  Brunelli,  1989).  The  reliability  and  validity  of  screening  instru- 
ments are  major  concerns  that  have  been  noted  by  several  re- 
searchers (Bredekamp  <Sc  Shepard,  1989;  Meisels,  1987;  Wodtke, 
Harper,  Schommer  <Sc  Brunelli,  1989). 

Meisels  (1985)  notes  that  kindergarten  screening  is  a brief 
assessment  procedure  designed  to  identify  those  children  who  need 
a more  intensive  level  of  diagnostic  assessment.  It  is  the 
first  step  in  evaluation,  prevention,  and  intervention. 

Various  books  and  articles  discuss  the  importance  of  early 
intervention  in  preventing  reading  problems  (Clay,  1985;  Felncr 
(Sc  Felncr,  1989;  Hawkins,  1985;  Kilby,  1984).  Badian  (1982) 
examined  the  possibility  of  predicting  reading  levels  before  kinder- 
garten. Her  data  supported  the  view  that  “...early  identifica- 
tion (before  kindergarten,  if  possible),  followed  by  early  special 
help  in  reading  readiness  and  reading  skills,  has  a beneficial 
effect  in  reducing  the  incidence  of  reading  disability”  (Badian, 
1982,  p.  31?). 


This  study  was  undertaken  because  a school  administrator 
in  a public  school  in  Ohio  wanted  to  know  whether  the  kinder- 
garten screening  scores  of  his  students  could  be  used  to  deter- 
mine which  students  would  qualify  for  a reading  intervention 
program  in  first  grade.  If  such  predictions  could  accurately  be 
made,  the  school  administrator  wanted  to  develop  a new  inter- 
vention program  that  could  be  implemented  before  the  students 
reached  first  grade. 

This  study  used  logit  regression  analysis  to  determine  if 
the  students’  kindergarten  screening  scores  could  be  used  to  ac- 
curately predict  who  would  qualify'  for  reading  intervention  in 
first  grade. 

Methods 

Setting  and  Subjects 

The  students  used  in  this  study  were  enrolled  in  a public 
school  system  located  in  a city  of  22,000  people.  The  city  has 
a diverse  economic  base  consisting  of  agriculture  and  small  in- 
dustry, and  it  is  a university  community  as  well  as  the  county 
seat.  The  school  system  enrolls  4,167  students  in  grades  kin- 
dergarten through  twelve.  There  are  seven  elementary  schools 
(K-6),  one  junior  high  school  (7-8),  and  one  high  school  (9-12). 
More  than  nine  percent  of  the  students  receive  assistance  from 
the  Aid  to  Dependent  Children  program  (ADC)  and  22  percent 
of  the  students  are  eligible  for  free  or  reduced  priced  lunches 
(Cox,  1989). 

A sample  of  243  students  was  selected  from  the  seven 
elementary  schools  in  the  city.  These  students  consisted  of  113 
males  and  130  females.  All  243  students  had  completed  the 
school  system’s  kindergarten  screening  test;  and  they  had  been 
identified  by  the  beginning  of  first  grade  as  needing  reading  inter- 
vention or  not  needing  reading  intervention. 


Kindergarten  Screening  Scores  (ccmrinucd) 
Variables 


Criterion  variables.  The  criterion  variable  in  this  study  was  a 
dichotomous  variable  that  indicated  whether  each  student  did  or 
did  not  qualify  for  the  first-grade  reading  intervention  pro- 
grain.  A student  qualified  for  the  program  by  scoring  below  the 
36th  percentile  on  the  standardized  Iowa  Test  of  Basic  Skills 
(Hieronymus,  A.,  Hoover,  H.,  Sc  Lindquist,  E.,  1986)  given  in 
kindergarten,  or  through  teacher  recommendation  and  scoring 
below  the  36th  percentile  on  the  Gates-MacGinitie  Reading 
Test  (MacGinitie,  \V.  Sc  MacGinitie,  1989)  in  first  grade.  A value 
of  1 was  assessed  to  those  students  who  qualified  for  the  reading 
intervention  program;  and  a value  of  0 was  given  to  the  students 
who  did  not  qualify'. 

Predictor  variables.  The  predictor  variables  consisted  of  four 
kindergarten  screening  subtest  scores:  (a)  gross  motor  scores,  (b) 
perceptual  scores,  (c)  fine  motor  scores,  and  (d)  ABC  Inventory 
scores.  The  four  subtests  were  scored  on  a scale  ranging  from  l to 
3,  with  the  value  of  l representing  a lower  level  of  per  forma  nee. 

The  gross  motor  subtest  was  designed  to  measure  the 
child’s  ability'  to  identify'  body  parts  and  the  child’s  degree  of  large 
muscle  coordination.  The  measurement  was  obtained  by  volun- 
teers from  a local  university.  A child’s  perceptual  score  was  ob- 
tained through  the  administration  of  the  Visual-Motor  Integra- 
tion Developmental  Test  (Beery  <Sc  Buktenica,  1967).  This  test 
was  given  by  the  school  psychologist.  The  fine  motor  subtest 
assessed  the  child’s  ability  to  handle  writing  materials  and  nm- 
nipulatives.  The  observations  of  the  children  were  made  bv  school 
guidance  counselors  in  groups  of  two  to  four  students.  Each 
child  was  evaluated  wirh  the  ABC  Inventory  (Adair  <Sc  Blcsch, 
1965).  The  kindergarten  teacher  conducted  this  general  knowl- 
edge assessment. 

Procedure 

The  purpose  of  this  studv  was  to  determine  if  the  kinder- 
garten screening  subtest  scores  could  be  used  to  predict  which 
students  would  qualify  for  the  first-grade  reading  intervention 
program.  Since  the  criterion  variable  consisted  of  two  categories, 
the  data  were  analyzed  with  a logit  regression  model  (Hosmer  <Sc 
Lemeshow,  1989;  Judge,  Griffiths,  Hill,  Lutkepohl,  <Sc  Lee,  1985; 
Pindyck  & Rubinfeld,  1991). 

The  sample  of  243  students  was  randomly  divided  into 
two  groups.  One  group  that  consisted  of  121  students  was  ana- 
lyzed with  the  logit  regression  model  (see  Table  1 for  descriptive 
statistics).  Tine  remaining  122  students  formed  a holdout  group 
that  was  used  to  cross-validate  the  logit  regression  model.  The 
mean  values  of  the  predictor  variables  lor  the  two  groups— the 
group  being  analyzed  and  the  group  that  served  as  the  holdout 
group  did  not  differ  at  the  .05  level  of  significance. 


Table  1 

Descriptive  Statistics  (or  the 
Group  Analysed  b\  the  Logit  Regression  Mode/ 


Variable 

Mean 

Standard  Deviation 

Group  Membership 

.37* 



Gross  Motor  Score 

2.44 

.sQ 

Perception  Score 

1.94 

.67 

Fine  Motor  Score 

2.03 

.55 

ARC  Inventory  Score 

2.26 

.71 

Note.  ^Indicates  thm  '7  percent  of  the  students  qualified  for  the  proenmv 
n - 121. 


Five  steps  were  used  to  evaluate  how  well  the  logit  regres- 
sion model  was  able  to  classify'  students.  First,  a chi-square  value 
was  used  to  test  the  difference  between  the  quantities  of  -2 
times  the  observed  likelihood  of  the  model  that  contained  only 
the  constant  term  and  -2  times  the  observed  likelihood  of  the 
model  that  contained  the  constant  term  and  the  four  predictor 
variables.  This  chi-square  value  was  used  to  determine  whether 
the  null  hypothesis,  which  states  that  all  of  the  coefficients  of 
the  predictor  variables  were  equal  to  0,  should  he  rejected.  The 
alpha  level  was  set  at  .05  for  this  test. 

Second,  the  Wald  test,  which  is  the  square  of  the  ratio 
of  the  coefficient  to  the  standard  error,  was  used  to  test  whether 
each  coefficient  differed  from  zero.  The  alpha  level  used  for  the 
test  of  each  coefficient  was  .0125,  which  was  equal  to  .05  divided 
hv  the  number  of  coefficients  tested  (4). 

Third,  the  maximum  chance  criterion  of  correctly  clas- 
sifying students  was  used.  This  criterion  requires  that  the  pro- 
portion of  students  correctly  classified  by  the  model  must  be  greater 
than  the  proportion  of  students  in  the  largest  group.  We 
required  the  percent  of  students  correctlv  classified  by  the  model 
to  he  25  percent  greater  than  the  maximum  chance  criterion 
value  (Hair,  Anderson,  Tatham,  1987). 

Fourth,  the  proportional  chance  criterion  of  correctlv 
classifying  students  was  also  applied  to  the  model.  In  the  pro- 
portional chance  criterion  the  proportion  of  students  correctly 
classified  by  the  model  must  be  greater  than  the  sum  of  the 
square  of  the  proportion  of  students  in  the  two  groups.  Again, 
we  required  the  percent  of  students  correctly  classified  bv  the 
model  to  he  25  percent  greater  than  the  proportional  chance 
criterion  value. 

Finally,  since  the  new  program  could  accommodate  a 
limited  number  of  students  it  was  important  for  the  model  to  pro- 
duce lew  fabe-jx^itiw  classifications  That  is-the  model  should 
classify  lew  students  as  qualifying  for  the  first-grade  program 
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Kindergarten  Screening  Scores  ( continued. ) 


when  they  would  not  qualify-  Thus,  it  was  decided  that  for  prac- 
tical significance  the  model  should  produce  no  more  than  10 
percent  false-positive  classifications. 


Results 

Evaluating  the  model 

The  analyses  of  the  logistic  regression  model  are  contained 
in  Table  2.  The  chi-square  value  used  to  test  the  null  hypothesis 
that  all  of  the  four  coefficients  of  the  predictor  variables  were 
equal  to  0 was  27.054  {p  < .001).  Since  the  probability  value  was 
less  than  the  .05  alpha  level,  the  null  hypothesis  was  rejected. 


Table  2 

Logit  Regression  Model 

Variable 

Coefficient 

S.E 

Wald  DF 

Sig 

Gross  Motor 

- .405 

.379 

1.145  1 

.285 

Perception 

- .279 

.381 

.537  1 

.464 

Fine  Motor 

- .421 

.4  37 

.926  I 

.336 

ABC  Inventory 

-1.139 

.357 

10.188  1 

.001 

Constant 

4.321 

1.218 

12.605  1 

.0004 

Note:  The  -2  log  likelihood  value  for  the  full  model 

is  1 32.65(\ 

The  -2  log  likelihood 

value  for  model  u 

ith  onlv  the  constant  term  i» 

150.710. 

The  model  chi-square 

- 27.054.  dl  = -1. 

f)  < .001. 

An  examination  of  the  Wald  test  used  to  test  the  four 
coefficient  values  indicated  that  one  null  hypothesis  could  be 
rejected.  Only  the  Wald  test  for  the  ABC  Inventory  scores  was 
statistically  significant  (p  < .0125).  Therefore,  the  ABC  Inven- 
tory scores  had  a statistically  significant  impact  on  the  classifi- 
cation of  the  students. 

Table  3,  which  contains  the  information  regarding  the 
model’s  ability  to  accurately  classify  the  students  in  the  holdout 
group,  indicated  that  60  of  the  6?  students  (89.6%)  who  did 
not  qualify  for  the  reading  intervention  program  were  correctly 
identified.  Thus,  the  model  produced  seven  (10.4%)  false-posi- 
tive classifications. 

Twenty-five  of  the  55  students  (45.4%)  who  did  qualify 
for  the  program  were  accurately  classified  hv  the  logit  model. 
Thus,  the  use  of  the  model  resulted  in  30  (54.6%)  false-negative 
classifications.  In  the  aggregate,  the  model  was  able  to  correctly 
classify  85  of  the  total  of  122  students  (69.7%). 

The  maximum  chance  criterion,  which  is  equal  to  the 
proportion  of  students  in  the  holdout  group  who  did  not  qualify 
for  the  program,  was  .550.  The  proportion  of  students  who 
were  correctly  classified  hv  the  model  (.697)  was  slight lv  in 


excess  of  the  figure  that  is  25  percent  higher  than  the  .550 
criterion  (.688). 


Table  3 

Correct  Classification  for  (he  Holdout  Group 
with  the  Logit  Regression  Model 

Predicted  Group  Membership 

Actual  Group 

Did  Not  Did 

Membership 

Qualify  Qualify  Total 

% 

DiJ  not  qualify 

60  7 67 

89.6 

Did  qualify 

30  25  55 

45.4 

Toud 

>2  122 

69.7 

The  proportional  chance  criterion  value  was  .505.  Again, 
the  proportion  of  students  accurately  classified  (.697)  by  the 
model  exceeded  the  figure  that  is  25  percent  more  than  the 
.505  proportional  criterion  (.631).  As  indicated  by  the  percent 
of  students  classified  correctly  for  each  group,  the  model  was 
much  better  at  identifying  students  who  did  not  qualify  for 
the  program  (89.6%)  than  the  students  u'ho  did  qualify  (45.4%). 
The  model  incorrectly  classified  slightly  more  than  10  per- 
cent of  the  students  who  did  not  qualify  for  the  first-grade 
program.  Thus,  the  model  came  close  to  meeting  the  practical 
significance  criterion  of  not  producing  more  than  10  percent  false- 
positive classifications. 

Discussion 

The  school  administrators  could  use  the  model  even 
though  the  model  was  able  to  correctly  identify  only  approxi- 
mately one  half  of  the  students  w’ho  would  eventually  qualify 
for  the  reading  intervention  program.  Those  students  who  were 
identified  as  needing  assistance  by  the  model  could  be  placed 
in  the  new  intervention  program.  Since  the  model  produces  a 
low  percentage  of  false-positive  classifications,  few-  students  who 
do  not  need  assistance  would  be  placed  in  the  new'  program. 

The  identification  of  the  students  who  would  eventually 
qualify  for  the  program  could  be  made  by  multiplying  each  of 
the  four  scores  of  a given  student  by  each  of  its  respective  coeffi- 
cients in  the  model  and  adding  the  constant  to  the  sum  of  those 
products.  Dividing  the  natural  log  of  this  value  by  one  plus  the 
natural  log  of  the  value  would  give  the  predicted  probability 
that  the  student  would  qualify  for  the  first-grade  reading  inter- 
vention program  (Pindyck  Ruhinfcld,  1991).  If  this  probability 
exceeds  .50,  the  student  would  be  identified  a^  needing  read- 
ing intervention. 

To  illustrate,  assume  n student  received  a score  of  2 on 
each  of  the  subtesiv  The  student’s  predicted  value  would  he 
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calculated  as  follows  using  the  coefficient  values  listed  in  Table  3: 

Y = 4.323  -.405(2)  -.279(2)  -.421(2)  -1.139(2) 

Y = -.165 

The  probability  that  the  student  would  qualify  for  the  first-grade 
reading  intervention  program  would  be  calculated  as  follows, 
where  e indicates  natural  log: 

p = = .46 

1 + c'-"'5' 

Since  the  probability  is  less  than  .50,  the  student  would 
not  be  classified  as  one  who  would  eventually  qualify  for  the 
first-grade  reading  program. 

Conclusions 

This  study  examined  the  ability  of  four  kindergarten 
screening  subtests  to  identify  which  students  would  qualify  for 


the  first-grade  reading  intervention  program.  The  scores  were 
analyzed  with  a logit  regression  model.  The  results  of  the  analysis 
indicated  that  the  four  subtest  scores  correctly  identified  69.7 
percent  of  the  students  in  the  holdout  group.  Nearly  90  percent 
of  the  students  in  the  holdout  group  who  did  not  qualify  for  the 
reading  intervention  program  were  correctly  classified  by  the 
model.  Less  than  one  half  (45.4%)  of  the  students  who  qualified 
for  the  program,  however,  were  correctly  classified  by  the  model. 

Due  to  the  low  number  of  false-positive  classifications, 
the  logit  regression  model  presented  in  this  study  could  be  used 
by  the  school  system.  This  could  be  done  in  spite  of  the  fact  that 
the  model  was  able  to  accurately  identify  less  than  one-half  of 
the  students  who  qualify'  for  the  first-grade  reading  intervention 
program.  If  a lower  number  of  false-negative  classifications  was 
deemed  necessary,  one  might  investigate  the  inclusion  of  infor- 
mation obtained  by  the  kindergarten  teacher  during  the  first 
half  of  the  year.  This  avenue  of  investigation  is  worthy  of  further 
study  since  placing  students  in  the  optimum  learning  environ- 
ment is  an  important  educational  goal. 
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Tips  for  Publishing 
and  Professional  Writing 

By  Joel  R.  Levin,  University  of  Wisconsin,  Madison 


The  “tips1'  provided  here  are  culled  from  a number  of 
sources,  including:  (a)  a mini-session  on  publishing  in  profes- 
sional journals,  held  at  the  1991  annual  meeting  of  the  Ameri- 
can Educational  Research  Association;  (b)  a recently  discovered 
article  by  Symonds  (1956)  that  contains  more  than  130  useful 
research-and-writing  suggestions  for  doctoral  students  in  edu- 
cational psychology;  (c)  the  would-be  publishers  Bible,  the  pub- 
lication manual  of  the  American  Psychological  Association 
(1983);  (d)  an  amusing,  yet  informative,  article  by  Holbrook  (1986), 
a professor  of  marketing;  (e)  Calfee  and  Valencia’s  (1987)  guide- 
lines for  prospective  submitters  of  manuscripts  to  the  Journal 
of  Educational  Psychology;  (f)  Sternberg’s  (1988)  very  readable 
book  on  research  and  publishing  in  psychology,  which  includes 
26  “rules”  for  writing  more  effectively;  and  (g)  lessons  learned 
from  my  own  professional  experiences  as  a researcher  and  journal 
editor  (most  recently,  as  Editor  of  the  Journal  of  Educational 
Psychology ).  What  I have  to  say  pertains  more  to  publishing 
primary  empirically  based  research  than  to  theoretical  pieces 
or  literature  syntheses. 

1 will  consider  four  general  aspects  of  publishing  schol- 
arly empirical  research:  superstitious,  cognitive,  meracognifive, 
and  affective . 

Superstitious  Aspects 

The  superstitious  aspect  incorporates  several  misconcep- 
tions that  are  commonly  held  about  the  “road  to  publication 
success,”  as,  for  example: 

• manuscript  length 

• margin  widths,  including  the  number  of  lines  per  page 

• printer  and  font  quality 

• numerous  other  surface— as  opposed  to  substantive- 
characteristics  of  a manuscript 

In  addition,  one  must  he  mindful  of  the  following  humorous 
old  spouses’  tales: 

• Manuscripts  that  contain  a colon  in  their  title  (to  rep- 
resent a subtitle)  have  a greater  probability  of  being  pub- 
lished than  those  that  don't  (Dillon,  1981). 

• “The  longer  the  title,  the  poorer  the  article”  (Bearman, 
Loewenson,  (Sc  Gullen,  1974). 

Cognitive  Aspects 

Cognitive  as|x.xts  of  the  rescan  h publication  process  arc 
represented  in  “selling”  niv  seven  “Cs”  ol  publishing  sir  cess: 


1.  Conceptually  sound  (with  respect  to  the  theory,  model,  or  issue 
being  investigated)— In  short,  does  the  research  “make  sense” 
in  terms  of  its  conceptual  rationale  and  operationalization? 

2.  Complete  package — Does  the  research  “tell  a story?”  A useful 
positive  criterion  for  an  editor  is  an  affirmative  response  to  the 
question,  “Is  the  study  interesting  and  memorable  enough  for 
me  to  summarize  its  essence  to  a friend  the  dav  after  reading 
it?”  Multiple-experiment  studies  often  help  to  provide  a more 
complete  package— even  though  it  is  not  always  easy  to  sell 
this  notion  to  young  (untenured)  researchers.  At  the  same 
time,  researchers  need  to  be  aware  of  current  professional  con- 
cerns about,  and  proscriptions  against,  “piecemeal”  and  “dupli- 
cate” publication  (e.g.,  Publication  manual  of  the  American 
Psychological  Association , 1983,  pp.  167-168). 

.3.  Creative— Is  the  research  clever?  Does  it  have  an  innovative 
twist?  Does  it  take  a novel  perspective  (e.g.,  looking  at  an  old 
problem  in  a new  way)?  In  conceptualizing  the  research,  did 
the  author— in  Sternberg’s  (1991)  words— take  risks?” 

4.  Coherently  presented  ideas— The  first  five  items  discussed  are 
quoted  directly  from  the  writing  adages  of  Holbrook  (1986, 
pp.  106-107): 

• “Do  not  hesitate  to  make  your  paper  interesting.” 

• “Remember  that  brevity  is  the  soul  of  wit.” 

• “Adjust  the  overall  length  of  your  paper  to  the  magnitude 
of  its  contribution.” 

• “Don’t  carve  your  work  too  thin  and  thereby  sell  your- 
self short.” 

• “[Write]  clearly.” 

1 have  added  three  suggestions  to  the  list: 

• Learn— indeed,  master— APA  style. 

• Be  able  to  read  your  manuscript  from  a critic’s— or  even  a 
skeptic’s— perspective,  both  while  you  are  writing  it  and 
after  a delay  of  several  days.  Seeking  colleague  feedback 
about  the  quality  of  your  writing  and  ideas  is  both  accept- 
able and  desirable.  (It  is  appropriate  to  acknowledge  such 
feedback  formally  in  a footnote.) 

• Make  sure  that  anv  uncited  words  and  propositions  arc  your 
own,  and  neither  verbatim  restatements  (plagiarism)  nor 
parallel  paraphrases  of  them  (what  I have  previously  referred 
to  as  “paraphragiarism”). 

r Clean  methodologically  (confoundlcss;  contaminant- 

free)  Are  the  mm  history  justified  on  the  basis  ol  what 
was  done? 
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Tips  for  Publishing  (continued) 


6.  Computationally  correct— Several  true-to-life  horror  stories 
can  be  related  to  support  the  claim  that  data-analvsis  errors 
and  other  numerical  mistakes  are  pervasive  in  the  published 
literature  (see,  for  example,  Levin,  N85).  You,  as  author— and 
not  the  person  who  you  paid  to  transcribe  the  data,  perform 
the  analyses  (he  hand  or  by  computer)  or  tvpe  the  manuscript- 
are  the  one  who  is  responsible  for  the  information  presented 
in  a journal  article.  Neither  can  the  computer  program  you 
used  to  analyze  the  data  be  held  accountable! 

7.  Connected  to  educational  practice— If  your  study  is  to  be 
reported  in  an  cducaiiona /-research  journal,  it  is  not  unreason- 
able  for  vou  to  spell  out  the  implications  of  vour  findings  for 
a particular  educational  problem  or  practice. 

Metacognitive  Aspects 

Metacognitive  aspects  of  research  and  writing  include 
what  may  be  referred  to  as  munuscri^t-moniroring  skills.  The  super- 
ordinate  skill  is  one  of  acquiring  a realistic  perspective  of  the 
research/puhlication  process.  In  particular,  naive  beliefs  about 
the  simplicity  of  publishing  in  professional  journals  (i.e.,  select 
a topic,  conduct  a study,  and  publish  the  findings  in  the  Journal 
of  Educational  Psychology)  must  be  replaced  by  more  informed 
notions  about  the  multi-stage  (multi-obstacle)  nature  of  the  pro- 
cess. Specific  manuscript-monitoring  skills  are  reflected  in  the 
following  questions  and  associated  evaluation  skills: 

1.  What  topic  should  I select.7  (a  problem-e  valuation  skill) 

2.  Is  the  studv  worth  doing?  (a  r^scurch-eutlucJiion  skill)— Not 
every  idea  vou  have  is  worth  researching.  In  addition,  when 
designing  a study,  trv  to  create  multiple  opportunities  for 
something  interesting  to  happen  (e.g.,  ‘‘If  the  results  come 
out  this  way,  1 could  talk  about  them  from  perspective  X;  if 
rhev  come  out  that  wav, ! could  talk  about  them  from  perspec- 
tive Y")  rather  than  putting  all  vour  eggs  in  one  basket” 
(e.g.,  “If  the  results  come  out  this  wav.  I’ll  have  lots  to  write 
about;  if  thev  come  out  that  wav,  I’ll  have  nothing  to  write 
about”)  This  does  not  imply,  however,  that  vou  should  look 
for  “everything  under  the  sun,”  seeking  spurious  significance 
in  a hvpothesis-free  environment. 

L Arc  the  findings  worth  publishing?  (an  ourcomc-ciulutif/on 
skill)— Oikc  the  data  have  been  collected,  it  mav  be  useful  to 
engage  in  a cost-benefit  analysis  of  manuscript  preparation. 
Know  when  to  go  and  when  to  just  say  “no,”  as  well  as  how 
to  assess  when  a iollow-up  study  should  be  conducted  and 
included  as  part  of  the  “package.”  Tin’s  point  encompasses 
Holbrook V (1%S)  comments  about  manuscript  length.  You 
also  should  be  aware  of  the  well-documented  biases  against 
publishing  nonsignificant  ivstilts  (e.g.,  Greenwald,  U7M,  as 
well  as  of  the  <. o cheque rk ev  of  not  attempting  to  publish  them 


— or  what  has  been  referred  to  as  the  “file  drawer  problem” 
(Rosenthal,  1979). 

4.  Where  should  the  findings  be  published?  (a  jottmaheta/iwtion 
skill)— This  helps  you  to  establish  the  tone  and  flavor  of  the 
manuscript.  Knowing  your  audience  also  enables  you  to  develop 
a distinguishing  “hook”  or  punchline  for  your  report  of  the 
study.  Know  your  journals  (in  terms  of  their  perceived 
reputational  quality).  Be  discriminating;  not  every  study  you 
conduct  will  be  of  Nobel  quality.  Use  good  judgment  in  de- 
ciding about  the  match  between  the  quality  of  the  research 
and  the  quality  of  the  journal  to  u’hich  it  is  submitted.  On  the 
other  hand,  some  researchers  adopt  an  alternative  strategy, 
wherein  they  submit  a less-than-superb  manuscript  to  an  elite 
journal  with  tu'O  expectations:  (a)  that  the  manuscript  will  he 
rejected;  and  (h)  that  they  will  receive  “free”  high-quality 
editorial  advice  that  can  be  incorporated  when  rewriting  the 
manuscript  to  submit  to  a lesser-quality  journal. 

5.  When  should  I stop  writing?  (a  manuscript-evaluation  skill)— 
Most  of  us  have  the  opposite  problem,  namely  “How  do  I 
start  writing?”  At  some  point,  accept  that  the  manuscript  is 
“good  enough.”  Not  every  thought  must  be  a plum;  not  every 
word,  a peach.  Consider  this  article,  for  example:  It’s  not 
perfect,  but  it  will  do.  Among  the  numerous  individuals  that 
I have  observed  over  the  years,  I have  found  that  “perfectionist” 
= “incompletionist.”  In  short,  “know  when  to  keep  it  so.” 

Affective  Aspects 

The  final— and  little-discussed— aspect  of  the  publication 
process  tests  the  affcctive/emotional  character  of  the  researcher, 
through  what  1 have  called  remf><.Tumcnf-mtmctgcmcnt  skills.  As  a 
prospective  publisher,  strive  to  develop: 

• realistic  expectations— The  probability  is  near  zero  that  an 
initial  submission  will  be  accepted  “as  is”;  you  should  submit  a 
manuscript  to  a journal  with  the  expectation  (if  not  the  hope)  of 
revising  it. 

• emotional  conrrol— Responding  positively  and  conscien- 
tiously to  constructive  criticism  (if  such  is  given)  is  a desirable  quality 
to  acquire:  “Accept  the  reviewers’  criticism  gracefully 
and  behave  as  if  every  word  of  their  comments  offered  a pearl  of 
wisdom”  (Holbrook,  1^86,  p.  107).  Add  to  this  Lena's  Lmt  of 
“processing  reviewer  feedback”:  The  perceived  amount  of  negativity 
and/or  requested  revision  by  the  reviewers  decreases  over  time. 
Coro/J(tr\:  So  does  the  amount  of  “sheer  stupidity”  that  you  will 
detect  in  the  reviews.  It  therefore  stands  to  reason  that  you  should 
allow  yourself  at  least  a two-day  “cool  off’  period  before  deciding 
whether  or  how  to  tackle  a revision. 

a i»nf (»)?«,/  < i*i  }Ktei  \-ti 


<)  Q 


1 ) 


Tips  for  Publishing  (continued) 


• persererance—This  is  a virtue  that  is  often  rewarded.  It 
is  permissible,  for  example,  to  resubmit  a thoroughly  rewritten 
manuscript  that  was  previously  rejected,  as  long  as  you  provide 
the  editor  with  a convincing  rationale  for  doing  so.  Amicable  nego- 
tiation  with  an  editor  about  “required”  and  “suggested”  editorial 
changes  is  also  acceptable. 

• respons k ’eness—  Write  a polite  letter— as  long  as,  but  no 
longer  than,  necessary— in  which  you  explain,  point  by  point, 
how  you  have  responded  to  every  one  of  each  reviewer’s  helpful 
criticisms”  (Holbrook,  1986,  p.  107).  Alternatively,  you  may  wish 
to  refer  to  an  article  by  Baumeister  (1990)  for  a modest  example 
of  an  alternative  letter  that  could  be  considered  in  one  of  your 
weaker  moments,  lo  quote  an  opening  excenn: 


Enclosed  is  our  latest  version  of  Ms  -85-02-22-RRRRR, 
that  is,  the  re- re-re-revised  revision  of  our  paper.  Choke 
on  it.  We  have  again  rewritten  the  entire  manuscript 
from  start  to  finish.  We  even  changed  the  [expletive  de- 
leted] running  head!  Hopefully  we  have  suffered  enough 
by  now  to  satisfy  even  you  and  your  bloodthirsty  re- 
viewers. (Baumeister,  1990). 

Publication  Equation 

Cognitive  + Metacognitive  + Affective  = Effective 
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MW  ERA  Communication  and  Update 


MWERA  Election  Results 

Thomas  Andre,  Iowa  State  University,  was  elected  Vice- 
President  (to  become  President-Elect).  Ralph  Mueller,  University  of 
Toledo,  was  elected  Secretary.  The  balloting  called  for  seven  mem- 
bers to  he  elected  to  the  Association  Council,  however,  the  eight 
receiving  the  highest  number  of  votes  were  elected  because  an  extra 
Council  member  was  needed  to  replace  Tom  Andre  who  was  on 
the  Council,  but  will  now  be  serving  as  Vice-President.  The  new 
Association  Council  members  arc:  Linda  Bakken,  Wichita  State 
University;  Robert  Barcikowaski,  Ohio  University;  Steven  Benton, 
Kansas  State  University;  Paula  Dupuy,  University  of  Toledo;  Carol 
Anne  Kardash,  University  of  Missouri-Columbia;  Tom  Knapp,  The 
Ohio  State  University;  Tom  Midgette,  University  of  Arkansas;  and 
Rose  Mary  Scott,  Mankato  State  University.  The  two  proposals 
on  the  ballot  were  both  accepted:  that  the  Life  Membership  dues 
be  established  at  10  times  the  annual  regular  membership  dues, 
and  that  MWERA  develop  an  application  to  the  Internal  Revenue 
Service  for  status  as  a charitable  organization  (501, V*). 

MWEResearcher  Review  Process 

When  a manuscript  is  received  for  publication  considera- 
tion in  the  Mitl-WLsrcrn  EduccitiomT  Researcher,  a note  acknowl- 
edging receipt  of  the  manuscript  is  sent  to  the  author.  At  the  same 
time  two  of  the  copies  received  are  sent  to  be  reviewed.  The  re- 
viewers are  professionals  with  experience  in  the  topic  or  method- 
ology of  the  manuscript.  The  editors  choose  reviewers  from  the 
editorial  board,  MWERA  membership,  and  known  experts  in  the 
field.  A review  sheet  is  sent  with  the  manuscript.  Only  the  title 
of  paper  and  a manuscript  number  are  provided  on  the  sheet  (the 
title  page  of  the  manuscript  is  removed).  The  review  sheet  request 
reviewers  to  evaluate  the  manuscript  as  unacceptable,  inadequate, 
adequate,  good,  or  exceptional  in  the  following  qualities: 

Introduction 

Establishes  the  nature  of  the  study 

Quality  and  quantity  of  citations 

Methods 

Quantity,  nature,  and  description  of  subjects 

Approach,  research  design,  statistical  procedures 

Results 

Complete,  concise,  clear,  understandable 

Discussion/Conclusions 

Explains  importance,  relevance,  and  limitations  of  study 

Overall 

Quality  oi  writing  (style,  grammar,  etc.) 

Article  flows  in  a logical  fashion 

Appropriateness  for  MWERA  membership 

Contribution  to  the  field 

Overall  impression  of  the  article 


The  reviewers  then  choose  to  “definitely  accept,”  “accept 
with  revisions,”  “encourage  resubmission  with  revisions,”  or  “do 
not  accept”  There  is  room  for  reviewer  comments  under  each 
section  of  the  review  sheet,  and  many  reviewers  make  notes  on 
the  manuscripts. 

The  editors  then  look  for  a concensus  between  the  two 
reviewers  and  inform  the  author  of  the  decision.  If  the  reviewers 
deem  the  manuscript  acceptable,  minor  editing  may  be  done  to 
the  manuscript  for  publication  or  the  manuscript  is  returned  to 
the  author  for  revision.  If  the  manuscript  is  deemed  unacceptable 
or  requires  major  revisions  the  author  may  be:  encouraged  to  submit 
the  manuscript  elsewhere.  If  there  is  no  general  concensus  con- 
cerning the  quality  of  the  manuscript,  it  is  sent  to  a third  reviewer. 
The  review  process  usually  takes  about  two  to  three  months. 

Many  Thanks 

As  we  approach  the  end  of  our  second  year,  we  would  like 
to  express  our  appreciation  to  the  Editorial  Board,  the  Executive 
Council,  and  the  Association  for  their  assistance  and  support.  We 
especially  thank  the  following  professionals  for  their  timely  and 
knowledgeable  review  of  manuscripts  submitted  for  publication 
consideration: 

M.  Kay  Alderman,  The  University  of  Akron 

Linda  Annis,  Bail  State  University 

Laura  Barnes,  Oklahoma  State  University 

Carolyn  Benz,  University  of  Dayton 

Sally  Glenn  Bilski,  Governors  State  University 

Norman  Bow’ers,  Northwestern  University 

Lirrv  Bradley,  The  University  of  Akron 

Donald  Cruickshank,  The  Ohio  State  University 

Raymond  Dean,  Ball  State  University 

Malu  Gonzalez,  New  Mexico  State  University 

Betty  Gridlcv,  Ball  State  University 

Judd  Han:  on,  Wisconsin  Dept,  of  Public  Instruction 

Mark  Kiselica,  Ball  State  University 

Tom  Laslcy,  University  of  Dayton 

Joy  McCullough,  The  Ohio  State  University 

Keith  McNeil,  New  Mexico  State  University 

Ralph  Mueller,  University  of  Toledo 

Carol  Muskin,  National-Louis  University 

Carole  Newman,  The  University  of  Akron 

Dwayne  Olsen,  University  of  Wisconsin-Pnrkside 

Charles  Payne,  Ball  State  University 

John  Pohlmann,  Southern  Illinois  Llniversitv 

Jay  Price,  University  of  Wisconsin-Stevens  Point 

Ulrick  Rcitzug,  Ball  State  LJniversity 

Ltrrv  Sherman,  Miami  University 

Jack  Snowman,  Southern  Illinois  University 

Joan  Timm,  University  of  Wisconsin-Oshkosh 

(continued  on  /xuy  Jo* 
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MWERA  Communication  & Update  (continued) 


MWERA  in  San  Francisco 

Greg  Marchant  and  Isadore  Newman  hosted  a social 
sponsored  by  MWERA  at  the  San  Francisco  Hilton  during  the 
AERA  annual  meeting.  Approximately  80  researchers  and  inter- 
ested others  passed  through  their  hotel  room.  Adria  Karle-Weiss, 
Sue  Tracz,  and  Sharon  McNeely  helped  make  the  event  a success. 

ERIC  Parent  Guide  Available 

An  updated  version  of  A Parent's  Guide  to  the  ERIC  Data* 
base:  Where  to  Turn  with  Your  Questions  about  Schooling  has  recently 
been  published.  The  82-page  guide  is  available  for  $10  (postage 
paid)  from  the  ERIC  Clearinghouse  on  Rural  Education  and 
Small  Schools,  Appalachia  Educational  Laboratory,  RO.  Box 
1348,  Charleston,  WV  25325. 


Ayres  D’Costa,  Richard  Pugh,  and  John  Kennedy  at  MWERA 
reception  at  AERA  in  San  Francisco. 


Norm-Referenced  Achievement  Tests  (References  continued  from  page  7) 
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Teacher  Preparation,  Social  Reconstruction, 
and  Research  on  Teacher  Education: 

An  Interview  with  Ken  Zeichner 


By  Jav  Price 

University*  of  WWonsin-Sieyens  Point 

What  this  interview  is 
meant  to  convey  to  MW  HR 
readers  is  a sense  of  your 
past;  where  you’ve  been  in- 
tellectually, epistemologi- 
cally,  where  you  are  now, 
and  where  you’re  going. 
Why  don’t  we  start  with 
your  connections  with 
your  past. 


now  and  where  I've  come  from, 
and  1 find  myself  constantly 
going  back  to  things  that  1 was 
invoked  in  many,  manv  years 
ago,  such  as  action  research;  1 
never  seem  to  he  able  to  leave 
mv  past.  1 guess  one  thing  about 
my  past  that  is  evident  in  the 
kind  of  work  1 do  now  and  the 
kinds  of  issues  that  l raise,  has 
to  do  with  where  I went  to 


Ken  Zeichner  is  a professor  of  education  at  the  L’nirersm 
of  Wiscon sin- \1  adison.  His  current  research  interests 
include  the  education  of  teachers  for  culturally  diverse 
environments  as  well  as  the  development  of  social  respon 
nihility  in  moral  and  ethical  terms.  He  is  engaged  also  m 
iltisyroinn  action  research  uith  both  pre-sertice  and  tn 
service  teachers  and  has  recently  cnuuthnrcd  Teacher  Edu- 
cation and  the  Social  Conditions  of  Schooling  and 
Educating  Teachers  for  Cultural  Diversity. 


equity  h<uo"  into  iiuount  and 
vondder  the  moral,  ethuul, 
and  political  unp'iK utioiv*  o» 
what  we  re  doing,  and  not  jim 
the  educational  ones  or  tc\h 
nical  ones 

So,  mv  present  interest*, 
vomeout  oi  this  m niggle  U*th 
as  a student  and  as  a leather. 

I taught  elementary  m hool;  it 
was  not  easy,  its  not  easy  am 
where,  but  1 think  it’s  partic- 
ularly tough  in  low-nuome 
inner-city  schools  hoc  .him*  ot 
all  the  intmennei  ted  prob- 
lems m addition  to  the  edu- 
cational ones  that  kids  Lome 
to  school  with.  So  thar's  one 
connection. 


How  about  any  other  con- 
nections with  your  past? 


1 ako  tind  my  self  in  sympathy 
with  the  grass  roots  school 
reform  movement  that  talk- 


school  and  where  l taught,  which  is  in  urban  school 
districts.  1 went  to  public  schcxils  in  Philadelphia.  In  my 
high  school  probably  less  than  10  percent  of  the  people 
went  on  to  higher  education.  It  was  an  urban  high  school 
that  didn’t  offer  a lot  academically.  1 almost  didn’t  make 
it  through  my  first  vear  of  Temple  University.  College 
was  a big  transition  for  me  and  during  my  first  year  1 
was  enrolled  in  several  remedial  classes. 

In  many  respects  I’ve  come  out  of  the  same  kind  of 
environment  that  l taught  in.  I did  all  mv  teaching  in 
inner  city  schools  that  had  the  lowest  test  scores  in  the 
district.  Mv  whole  career  has  been  committed  to  raising 
issues  that  deal  with  inequities  between  what  goes  on  in 
schools  for  the  wealthy  and  middle  class  and  in  schools 
in  poverty  areas.  I think  in  mv  current  work  there  is  a 
great  deal  of  emphasis  on  what  I call  social  reconstruction 
as  opposed  to  just  teacher  education.  This  broader  per- 
spective raises  issues  that  have  to  Jo  with  equity  and  social 
justic  e along  with  other  kinds  of  issues.  We  need  to  take 


about  decentralizing  power,  giving  more  authority  to 
teachers,  although  1 do  not  like  terms  like  teacher  em- 
powerment. These  terms  Hither  me  because  they're 
slogans  that  in  a number  of  cases  can  he  used  to  mask 
more  subtle  forms  of  control. 

My  career  as  a teacher  took  place  tn  an  environ- 
ment where  I had  a great  deal  of  control  as  a teacher. 
The  school  was  managed  bv  a school  council,  though 
they  didn’t  call  it  that  in  those  davs.  We  were  also  in- 
volved with  such  things  ns  action  research—  teac hers, 
other  practitioners  producing  knowledge  about  their 
work,  which  now  is  just  beginning  to  explode  all  over 
North  America.  In  a sense  I’ve  never  been  able  to  leave 
mv  past;  it’s  always  been  with  me. 

jp  What  was  your  graduate  school  experience  and 
how  does  this  fit  with  what  you’re  doing  now? 

loniinucil  on  (s iv,  I ''l 
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An  Interview  with  Zeichner  ( continued ) 


I began  to  take  classes  at  Syracuse  University  with  Vrthur 
Blumberg  w ho  used  to  come  to  our  school  and  meet  with 
our  school  council  which  I was  on  as  a team  leader.  I 
became  really  interested  in  organizational  change  and 
entered  Syracuse  University  in  a doctoral  program  in 
school  organizational  behavior  and  change,  organizational 
theory,  social  psychology  of  organizations,  and  change 
theory;  so  that’s  mv  intellectual  background. 

To  finance  mv  graduate  school  1 worked  in  the 
teacher  education  department  and  worked  with  the 
Syracuse  Teacher  Corps  Project  as  a team  leader  and 
teacher  center  director.  So,  all  of  my  practical  work  was 
in  teacher  education,  although  none  of  my  coursework 
really  was. 

When  I came  to  Madison  in  1976, 1 really  entered 
the  scholarly  field  of  teacher  education  for  the  first  time. 
Mv  task  here  was  to  work  with  others  in  studying  our 
elementary  teacher  education  program  and  engaging  in 
program  development.  In  fact,  when  1 came,  the  faculty 
in  elementary  education  had  made  a commitment  to 
allocate  some  resources  to  sponsoring  studies  and  to  use 
elementary  teacher  education  as  a laboratory  for  the  study 
of  teacher  education.  Bob  Tabachnick  and  I worked 
together  during  these  first  years  and  that’s  how  I began 
writing  about  teacher  education. 


jjp]  What  experiences  have  you  had  in  building  educa- 
tion  programs — are  your  current  programs  an 
outgrowth  of  your  past  experiences? 

[kzI  During  mv  last  semester  at  Syracuse  University,  I he- 
uime  the  director  of  a new  urban  teaching  center  coordi- 
nating prcservicc  and  inservice  offerings  in  six  elementary 
schools.  I’ve  always  wanted  to  stay  in  a school  system.  I 
wanted  to  be  a principal,  to  take  a school  and  sec  what 
1 could  do  with  it.  But  this  position  at  Madison  was  an 
unusual  opportunity  because  it  was  a job  in  higher  educa- 
tion that  offered  a lot  of  work  with  schtxds.  My  responsi- 
bilities involved  coordinating  student  teaching,  and  I’m 
still  doing  that  15  years  later.  I’ve  had  opportunities  to 
got  out  of  it,  hut  I want  to  do  it. 

Another  part  of  my  work  is  program  development 
and  research,  and  with  that  is  the  teaching  of  supervi- 
sion courses  and  graduate  courses  in  the  study  of  teacher 
education.  I needed  to  he,  and  still  feel  the  need  to  he, 
action  oriented.  I need  to  he  involved  implementing 
programs  and  involved  with  schixds.  So  in  that  sense, 
there  is  a clear  connection  between  my  current  work 
and  my  past. 


Your  master’s  degree,  the  MAT  in  Urban  Educa- 
tion,  that’s  an  expression  and  a continuation  of  this 
theme,  right? 


YjL  Right,  It  was  a program  at  Syracuse  University  designed 

specifically  to  prepare  teachers  for  urban  schools  and 

they  placed  most  of  us  in  the  core  inner  city  schools. 
It  was  a real  intensive  program,  two  summers  and  an 
academic  year. 

JP  And  your  new  MAT  at  Madison,  that’s  also  in 
teacher  preparation  for  urban  schools? 

YjL  Yes,  we’re  designing  a program  similar  in  many  ways  to 

the  one  I was  in  as  a student.  I really  feel  that  teacher 

education  generally  does  not  pay  enough  attention  to 
preparing  people  for  urban  schools.  I know  that  a lot  of 
teacher  education  students  nationally  don’t  want  to  go 
into  these  schools,  they  don’t  want  to  work  with  students 
who  arc  different  from  themselves,  so  we’re  trying  in  a 
number  of  ways  to  address  that  problem  here. 


JP  Let  me  ask  about  the  present.  What  are  your 
thoughts  about  teacher  preparation,  maybe  the 
way  it  ought  to  be  done,  the  way  you’re  trying 
to  do  it. 


Over  rhe  last  10  years  Carl  Grant  and  1 have  been  working 
very  hard  on  our  student  teaching  program  to  try  to  make 
it  more  the  way  we’d  like  it  in  terms  of  preparing  more 
reflective  teachers  who  have  a clear  sense  of  what  they 
are  trying  to  accomplish  as  teachers  and  arc  able  to  artic- 
ulate it.  We’ve  been  writing  about  rhe  use  of  “reflective 
teaching”  to  describe  the  thoughtfulness  and  purposeful- 
ness that  wc  want  to  help  our  students  develop.  And  for 
the  last  few  years  we’ve  been  trying  to  develop  a more 
coherent  elementary  program,  rather  than  just  focus- 
ing our  efforts  on  student  teaching.  The  preparation  of 
thoughtful  teachers  who  take  responsibility  for  their  own 
professional  development  is  one  critical  area.  Another 
that  I mentioned  earlier,  is  the  preparation  of  teachers 
who  are  willing  and  able  to  teach  everybody’s  children 
and  not  just  children  like  themselves. 

I think  we’ve  had  a lot  of  success  in  building  some 
of  these  themes  throughout  the  whole  program.  Right 
now  we  are  working  on  some  of  the  limitations  in  our 
current  program,  such  as  the  lack  of  a community  com- 
ponent in  the  student  teaching  program.  I see  our  stu- 
dents as  still  too  isolated  from  the  communities  and 
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An  Interview  with  Zeichner  (continued) 


parents.  Even  putting  them  in  schools  with  a lot  of  cul- 
tural diversity  doesn’t  really  help  them  get  in  touch  with 
what  life  is  like  for  the  kids  who  are  different  from  them- 
selves because  they  don’t  live  in  those  neighborhoods 
and  have  very  little  contact  with  parents.  They  come  in 
during  teaching,  and  they  leave  at  night,  often  with  very 
little  contact  with  the  community.  So,  we’re  trying  to 
design  a component  where  students  do  some  work  in  the 
community.  Its  purpose  is  also  to  get  at  the  development 
of  social  responsibility  which  I think  we  do  a very  poor 
job  of  in  teacher  education  programs.  The  research  I 
think  is  pretty  clear  that  teacher  education  is  such  a 
minor  intervention  in  teachers’  lives  that  it’s  very  dis- 
couraging sometimes;  so  we’re  really  trying  to,  in  a lot  of 
ways,  increase  the  power  of  our  influence  on  students. 
One  of  the  ways  to  do  that  is  to  help  students  confront 
some  of  the  problems  of  our  society  firsthand  and  to 
interact  with  people  who  have  very  different  backgrounds 
and  life  experiences  from  themselves. 


Two  parts  of  your  past  and  your  present  as  well  that 
you’ve  referred  to  are  reflection  and  also  action  re- 
search. Would  you  explain  why  both  are  important 
to  you  personally  and  in  teacher  preparation  as  well? 


KZ 


It’s  always  been  important  to  me  that  the  people  who  are 
responsible  for  implementing  changes  play  a large  role  in 
designing  and  conceptualizing  changes.  I’ve  always  been 
resistant  to  the  idea  of  somebody  coming  in  and  handing 
down  educational  reform,  somebody  coming  in  with  the 
latest  package.  I can  think  back  when  I was  beginning 
in  Teacher  Corps  as  a team  leader,  being  “trained”  in 
certain  supervision  methods  and  rebelling.  In  fact,  we 
got  in  trouble  several  times.  A group  of  us  went  off  to 
Harlem  one  day  and  disappeared  from  this  Teacher  Corps 
workshop,  and  we  were  reported  to  the  National  Teacher 
Corps  Office  in  Washington.  We  left  the  training  because 
it  was  a prepackaged,  pretest/posttest  kind  of  thing.  The 
program  didn’t  value  any  knowledge  that  any  of  us  brought 
to  the  situation.  So  I’ve  always  been  of  the  belief  that 
the  people  involved  in  reforms  need  to  play  a large  role 
in  conceptualizing  them  and  implementing  them  and 
that  "experts”  need  to  be  at  their  service. 

The  action  research  idea  of  reform,  I think,  values 
the  knowledge  that  practitioners  have  and  that’s  very 
important.  It  enables  them  to  be  reflective  about  their 
teaching,  about  their  schools.  There's  a lot  of  evidence  in 
the  literature  about  the  failure  of  people  coming  in  and 
trying  to  design  or  dictate  reforms  from  above.  And  as  a 
teacher  educator,  I try  to  do  the  kinds  of  things  that  we 
want  our  student  teachers  to  do;  we’re  all  studying  our 


program  and  we’re  always  having  supervisors  doing  action 
research  on  their  supervision  so  that  the  whole  program 
has  to  operate  in  that  way.  You  can’t  take  reflective  teaching 
or  action  research  and  deliver  it  to  someone  as  a final 
product  as  some  have  tried  to  do. 


Continuing  the  idea  of  reform  of  teacher  prepara- 
tion what  is  your  reaction  to  state  level  reforms 
and  where  they  are  headed  and  their  potential  for 
positive  change? 


KZ 


1 think  that  the  state  level  is  the  most  significant  level 
right  now.  I see  signs  nationally  that  are  promising,  calls 
for  the  deregulation  of  teacher  education  and  for  allow- 
ing teacher  education  programs  to  have  some  flexibility 
in  figuring  out  ways  to  accomplish  broader  goals  rather 
than  the  specification  of  discrete,  very  specific  standards. 
There  are  many  problems  with  these  specific  standards 
such  as  the  ones  we  have  in  Wisconsin,  The  main  one  is 
that  the  specification  of  so  many  credits  restricts  the  pro- 
grams and  their  ability  to  design  some  innovative  ap- 
proaches. The  main  effect  of  more  requirements  is  to 
further  stifle  creativity  in  teacher  education. 

Probably  the  biggest  problem  in  teacher  education 
right  now  is  the  growing  gap  between  who  the  teachers 
are  and  who  the  students  are.  My  recent  search  of  the 
literature  on  preparing  teachers  for  diversity  shows  some 
things  going  on,  but  not  a whole  lot  when  you  consider 
the  enormity  of  the  problem.  So  that’s  clearly  an  area 
where  some  incentives  need  to  be  provided  for  some 
creative  work.  I think  that’s  what  federal  policy  should 
do,  as  was  done  in  the  past,  to  encourage  people  to  move 
in  certain  directions.  States  really  need  to  back  off  from 
detailed  prescriptions  and  provide  incentives  for  insti- 
tutions to  develop  creative  ways  for  tackling  some  of 
our  most  pressing  problems  such  as  preparing  teachers 
to  teach  children  who  have  different  backgrounds  from 
their  teachers. 


You  mentioned  the  return  to  action  research. 
Would  you  expand  on  the  relevance  of  action  re- 
search and  how  it  meets  your  program  needs? 


For  my  doctoral  qualifying  exam  l had  to  do  an  action 
research  project.  Along  with  the  written  portion  of  the 
exam  l went  into  a school  and  worked  with  several  teach- 
ing teams  that  were  in  conflict  with  each  other.  I designed 
a program  to  help  them  begin  to  work  out  some  of  these 
differences.  A lot  of  the  classes  that  I took  in  my  grad- 
uate program  were  based  on  an  action  research  model, 

(cvnunued  on  fKifie  20) 
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An  Interview  with  Zeichner  (continued) 


with  a strong  experience  base,  and  l think  a lot  of  the 
teaching  I do  now  uses  that  approach.  I do  a lot  of  en- 
gaging  people  in  experiences  and  the  analysis  of  those 
experiences.  I see  a real  parallel  between  the  way  that  I 
teach  now  and  the  way  I was  taught  in  graduate  school. 

Action  research  involves  a rejection  of  the  hege- 
mony of  the  university,  empirical-analytic  model  of 
research— and  a commitment  to  the  idea  that  knowledge 
can  be  generated  by  practitioners,  that  there’s  theory 
embedded  in  practice.  It’s  not  merely  transferring  a theory 
of  the  university  to  the  practice  of  the  schools. 

I think  it  really  has  been  a problem  for  me  all  along, 
this  idea  of  staff  development  being  conducted 
as  if  teachers  didn’t  know  anything  and  nobody  ever 
trying  to  find  out  what  they  do  know.  You  get  some 
dynamic  speaker  who  can  get  people  all  excited  and  that’s 
considered  good  staff  development.  And  nothing  ever 
changes/and  we  keep  seeing  over  and  over  again  the 
pattern  of  one  program  after  another  with  little  lasting 
change.  1 did  a lot  of  work  as  a graduate  student  trying 
to  understand  why  organizations  change,  and  it  certainly 
is  not  by  those  dominant  models  of  staff  development 
that  are  still  unfortunately  with  us  today. 


A part  of  my  question  asking  you  to  talk  about 
action  research  is  perhaps  to  lend  your  perspective 
on  the  issue  of  where  qualitative  and  quantitative 
distinctions  might  be  made* 


KZl 


I don’t  think  it’s  so  much  a matter  of  quantitative  versus 
qualitative.  In  fact,  I use  quantitative  approaches  myself 
when  its  appropriate.  I think  that  distinction  is  misplacing 
the  debate.  The  issue  is  that  there  is  a tremendous  amount 
of  expertise  at  the  school  level,  at  the  classroom  level, 
that  if  we’re  going  to  deal  with  some  of  the  problems  we 
have,  we  have  to  tap  into  that  expertise. 

Teachers  feel  the  lack  of  respect  by  people,  say  at 
the  central  office  level,  for  what  they  know  and  what  they 
can  do.  There’s  a real  wealth  of  expertise  that  you  have  to 
tap  into  if  you’re  going  to  deal  with  any  of  these  problems 
that  we  have.  That’s  part  of  the  power  of  action  research. 

I think  action  research  can  be  dangerous  though 
because  it  can  become  too  self-contained.  We  might  reject 
anything  from  the  outside  or  anything  anybody’s  ever 
learned  before.  We  have  to  be  careful  about  that.  I think 
the  recent  research  that  teachers  are  doing  is  more  quali- 
tative than  quantitative.  The  emergence  of  narrative 
inquiry  and  autobiographical  research  met  beds  in  educa- 
tion are  two  recent  developments.  But  you  can  still  use 
qualitative  research  methods  and  still  not  have  action 
research.  I’ve  seen  the  use  of  qualitative  tesean  h that  still 


shows  a lot  of  disrespect  for  teachers,  knowledge.  1 think 
you  can  get  at  a lot  of  things  through  qualitative  research 
that  you  can’t  get  at  through  quantitative.  But  quantita- 
tive research  can  also  be  very  powerful.  So,  one  of  the 
central  issues  for  me  is  the  respect  for  the  knowledge 
that  teachers  and  other  practitioners  hold  in  the  re- 
search we  do. 

When  we  talk  about  the  “knowledge  base’’  for 
teacher  education,  there’s  no  reference  to  anything  that 
teachers  have  ever  written.  There’s  been  a huge  explo- 
sion of  teacher  research  ns  well  as  the  official  “knowledge 
base”  of  AACTE  and  the  two  don’t  intersect  anywhere. 
I think  that’s  a major  problem  for  the  field  right  now; 
to  begin  to  recognize  that  there  are  different  sources  for 
the  “knowledge  base”  and  to  acknowledge  the  practitioner 
contributions  to  this  “knowledge  base.”  Action  research 
legitimates  the  idea  that  people  who  work  in  school  set- 
tings can  produce  knowledge,  can  learn  some  things 
that  others  can  benefit  from,  and  can  generate  theory 
from  practice. 


One  of  the  charges  about  teacher  preparation  that’s 
been  levied  in  the  not  too  distant  past  has  been 
that  it’s  basically  atheoretical.  From  your  perspec- 
tive, are  those  days  over?  Do  we  have  a multiple 
theoretic  perspective  of  teacher  preparation? 


Kzj 


First  of  all,  we  have  to  be  suspicious  of  most  of  the  claims 
about  what  teacher  education  is  like  because  very  few 
people  have  actually  looked  at  what  goes  on  in  teacher 
education  programs.  Several  of  us  from  the  National 
Center  for  Research  on  Teacher  Education  conducted 
case  studies  of  11  programs  around  the  country.  Before 
we  began  our  research  we  tried  to  look  at  the  work  of 
other  people  who  had  gone  into  programs  and  actually 
sat  in  on  classes  and  interviewed  faculty  members.  There 
wasn’t  that  much  that  had  been  done.  I studied  teacher 
education  at  the  University  of  Florida  for  three  and  a 
half  years,  and  I’m  still  cautious  about  what  l say  about 
it,  because  it  changes  all  the  time.  Sc'),  1 think  that’s  a 
problem  with  characterizations  of  teacher  education. 
Most  of  what  is  said  about  teacher  education  programs 
in  the  literature  is  not  based  on  the  experience  of  ac- 
tuallv  studying  programs. 

More  and  more  people  are  trying  to  develop  more 
coherent  programs,  to  pick  some  theme  such  as  reflective 
teaching,  in  part,  because  NCATE’s  pushing  people  to 
do  that  with  their  new  standards.  So,  on  the  surface  there 
appears  to  be  more  of  a theoretical  grounding  for  teacher 
edia  at  ion  program'*. 
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An  Interview  with  Zeichner  ( continued ) 


However,  I don't  really  think  that’s  the  case  under- 
neath the  surface.  A term  like  “reflective  teaching”  means 
nothing  to  me  anymore,  absolutely  nothing  given  the 
work  that  I’ve  done  over  the  last  two  years  in  looking 
at  different  conceptions  of  reflective  practice  that  exist 
in  teacher  education  programs.  You  can  find  the  whole 
range  of  beliefs  about  teaching,  learning,  schooling,  and 
social  order  represented  by  people  using  the  language  of 
reflective  teaching,  action  research,  inquiry  and  similar 
term>.  So,  I don’t  know  if  there’s  the  coherence  under- 
neath the  surface  that  there  appears  to  be. 

My  thinking  right  now  is  that  there  are  various 
traditions  of  reform,  or  traditions  of  practice,  that  are 
reflected  in  teacher  education  programs,  and  my  position 
is  that  individual  programs  reflect  a certain  pattern  of 
resonance  with  those  traditions.  There’s  no  program  that's 
a pure  x or  v,  hut  the  different  traditions;  academic,  social 
reconstructionists,  developmcntalists,  and  social  effi- 
ciency; represent  different  aspects  of  teaching  expertise. 

I think  our  tendency  has  been  to  segment  people 
and  programs  into  little  boxes.  I think  there  are  some 
issues  that  are  prioritized  and  that  are  focused  in  all  these 
traditions,  so  I don’t  see  any  sort  of  single  theory  or  single 
approach  dominating  programs  because  there  am  very  few 
programs  that  have  one  person  or  theme  that  can  domi- 
nate them.  Anytime  you  have  a group  of  people,  you 
have  a variety  of  things  going  on,  and  you  always  have 
to  deal  with  different  aspects  of  teaching  expertise.  You 
can’t  just  pay  attention  to  issues  of  social  justice  and 
inequities  as  people  sometimes  portray  me  as  doing.  That’s 
just  not  true.  It’s  just  that  I also  raise  those  issues.  I 
may  raise  them  fairly  loudly  because  they  tend  to  get 
marginalized. 

So  we  need  to  start  talking  across  these  bounda- 
ries, that  we  have  set  up  in  our  field.  I see  the  boundaries 
as  a real  problem.  It  was  amazing.  I was  on  this  session  at 
AERA  last  year  with  people  from  a number  of  programs, 
and  this  is  where  l did  this  paper  on  the  development  of 
social  responsibility  in  teacher  education.  When  1 talked 
about  teacher  education  programs  in  terms  of  all  four 
traditions,  it  was  amazing  how  we  began  to  see  the  com- 
monalities across  the  programs  represented  in  our  sym- 
posium. The  image  was,  for  example,  that  at  Berkeley 
they’re  developmcntalists  and  at  Wisconsin  they’re  critical 
theorists.  We  began  to  see  a strong  developmentalist  strand 
in  both  programs  and  how  the  teacher  educators  at  Ber- 
keley are  beginning  to  pay  more  attention  to  issues  of 
diversity.  So,  l don’t  think  that  you  can  segment  programs 
into  mutually  exclusive  categories.  To  get  hack  to  the 
original  question  about  teacher  preparation  being  theory- 
less,  1 think  it’s  again  more  of  a reflection  of  biases  of 
those  outside  the  field  than  those  that  work  in  the  field. 


Once  you  actually  get  closer  to  programs,  you  can  see 
a variety  of  theoretical  and  political  commitments  em- 
bedded in  them. 


Let  me  move  to  my  next  question  and  that’s  about 
the  future.  What  lies  ahead  in  terms  of  research 
strategies  and  knowledge  production? 


KZ 


I think  there  have  been  things  that  we*vc  learned  through 
the  so-called  official  knowledge  base  that  AACTE  and 
others  talk  about.  But  the  future;  there  arc  so  many 
teachers  right  now'  getting  involved  in  some  form  of 
research  on  their  practice,  whether  it’s  autobiographical, 
narrative,  or  case  study.  There’s  going  to  have  to  be  a 
greater  place  for  this  work  when  we  talk  about  knowledge 
base  for  teacher  education.  We  can’t  just  keep  going  on 
pretending  that  universities  alone  will  somehow,  through 
better  research  methods  and  more  funding,  produce  better 
teacher  preparation  and  schooling. 

If  you  talk  to  any  group  of  teachers  about  educa- 
tional research  as  we  know'  it,  it  is  not  seen  as  very  influ- 
ential. However,  once  you  get  them  engaged  in  researching 
their  own  practice,  you  can’t  stop  them.  It’s  a very  power- 
ful sort  of  experience.  I think  that’s  where  the  future  is— 
in  a knowledge  base  for  teaching  that  includes  practi- 
tioner-generated know-ledge. 

I also  see  a further  broadening  of  methodological 
inquiry  in  the  future— w-e’re  seeing  narratives  and  auto- 
biographical and  life  history  methods  being  used  a lot 
now.  This  is  broadening  what’s  viewed  as  acceptable  edu- 
cational research.  I can  see  it  going  on  here  at  Wisconsin 
w'ith  some  new'  people  on  our  faculty  whose  area  of  exper- 
tise is  in  narrative  inquiry  and  they  write  stories.  A 
number  of  my  colleagues  arc  struggling  with  whether 
this  is  real  research  or  not,  and  1 can  see  this  broadening 
of  what  people  are  willing  to  accept  continuing. 

The  rejection  of  quantitative  research  l think  is  a 
dangerous  mistake.  We  have  people  on  our  faculty  here 
who  argue  very  persuasively  about  the  kinds  of  sophisti- 
cated things  you  can  do  with  quantitative  methodologies 
to  gain  understanding  in  w'ays  that  you  can’t  with  certain 
qualitative  ways.  So,  I’m  not  saying,  I want  research  to 
he  just  qualitative,  just  storytelling,  hut  more  of  an  accep- 
tance of  different  methodologies  I’d  rather  focus  on  the 
problems  that  people  are  doing  research  on  and  whether 
they’re  worth  researching  or  not. 


One  final  question — what  issues  in  teacher  educa- 
tion research  concern  you? 

fronfiniwd  on  /Miy  2^) 
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Dropout  Rates: 

Current  Estimates  are  Too  High 

By  Geotge  H.  Olson,  Appalachian  State  University 

Abstract 

Large  school  districts  typically  report  dropout  rates  in  the  neighborhood  of  15  to  20  percent,  when  computed  annually,  and 
as  high  as  40  to  50  percent,  when  computed  for  cohorts  over  several  years.  It  is  argued  here  that  these  rates  are  spuriously  high;  that 
they  stem  from  problems  in  the  way  dropouts  are  operationally  defined,  and  problems  in  the  pupil  accounting  procedures  employed 
in  counting  dropouts.  When  considerable  extra  effort  was  extended  to  more  accurately  account  for  the  whereabouts  of  students  offi- 
cially classified  as  dropouts,  one  school  district  found  that  large  percentages  of  their  dropouts  could  be  reclassified  as  matriculating 
somewhere  else.  The  new  accounting  procedure  changed  the  annual  dropout  rate  from  16  percent  to  4.3  percent. 


Media  headlines  in  recent  years  have  insinuated  a drop- 
out crisis  with  reports  that  our  nation’s  youth  are  quitting  school 
in  record  numbers.  It  is  not  unusual  to  see  headlines  proclaiming 
that  as  many  as  25  percent,  40  percent,  even  50  percent  or  more 
of  our  students  are  leaving  school  prior  to  graduation.  Such 
statistics  have  not  been  the  invention  of  the  media.  In  1985, 
Samual  Peng  authored  a paper  for  the  Business  Advisory  Com- 
mittee of  the  Education  Commission  of  the  States  in  which  he 
estimated  the  national  dropout  rate  at  25  percent.  Within  the 
nations  urban  school  districts  the  rate  was  put  at  50  percent. 
Virtually  identical  statistics  were  reported  in  a study  conducted  by 
the  Government  Accounting  Office  (GAO,  1986).  At  about  the 
same  time,  Hess  and  Lauber  (1985)  reported  the  dropout  rate 
among  inner-city  Chicago  schools  to  be  more  than  50  percent. 
These  three  studies  (and  a few  others)  received  considerable  cover- 
age in  secondary  reviews.  Additional  support  for  high  estimates  of 
dropout  rates  has  come  also  from  research  reports  issued  by  large 
school  districts  (e.g.,  Horst  6c  Donahue,  1988;  Olson,  1988a). 

Reports  published  in  recent  years  have  demonstrated, 
adequately,  that  dropout  rates  arc  highly  suspectable  to  vagaries 
in  the  ingredients  going  into  their  computation  (Horst  6c  Dona- 
hue, 1989;  Ligon,  Stewart,  6c  Wilkenson,  1990).  These  and 
other  studies  have  shown  that  dropout  rates  can  vary,  often 
markedly,  as  a function  of  such  factors  as  the  time  frame  em- 
ployed (annual,  cr  longitudinal);  the  range  of  grade  levels  in- 
cluded (grades  9-12,  7-12,  K-12);  the  type  of  student  accounting 
procedure  used  (average  daily  membership,  average  daily  atten- 
dance, or  all  students  ever  enrolled);  and  the  point  in  time  when 
the  count  is  concluded  (early  in  the  fall  semester  vs.  the  end 
of  the  spring  semester). 

Rates  based  on  longitudinal  (cohort)  analyses  will  always 
yield  larger  rates  than  those  based  upon  annual  counts  (Stephen- 
son, 1985).  Because  the  likelihood  of  dropping  out  increases 
with  age,  high  school  rates  (grades  9-12)  will  nearly  always  be 
higher  than  secondary  rates  (grades  7-12)  which  in  turn  will  be 
higher  than  district  rates  (grades  K-12)  (Olson,  1988b).  The  stu- 
dent accounting  procedure  employed  is  particularly  influential 
because  ir  determines  the  number  of  students  composing  the 


denominator  of  the  rate  being  tallied  (Ligon,  Stewart,  6c  Wilken- 
son, 1990).  Using  average  daily  attendance  (ADA)  will  generally 
yield  a smaller  count,  hence  a larger  rate,  than  will  average  daily 
membership  (ADM).  Still  lower  dropout  rates  will  be  obtained 
by  including  in  the  denominator  all  students  ever  enrolled  within 
the  time  frame  analyzed. 

Other  factors  that  can  dramatically  affect  the  computa- 
tion of  dropout  rates  include  the  choice  of  definition  of  dropout 
(Ligon,  Stewart,  6c  Wilkinson  (1990);  Olson,  1988b)  and  poor 
record  keeping  (LeCompte  6c  Goebel,  1987).  Still  other,  more 
subtle,  factors  have  been  identified  by  Horst  and  Donahue  (1989). 

To  be  fair  it  should  be  pointed  out  that  nearly  all  the 
sources  of  high  (40  percent  or  more)  dropout  statistics  mentioned 
above  included  conscientious  discussion  of  many  of  the  problems 
involved  in  estimating  dropout  rates.  In  virtually  every  study 
cited  it  was  pointed  out  that  the  high  rates  resulted  from  a cohort 
analysis  spanning  four  or  more  years.  Readers  were  cautioned  that 
such  rates  arc  usually  confounded  with  attrition  rates.  Further- 
more, most  of  the  studies  reported  annual  dropout  rates  that 
were  much  lower  than  the  cohort  rates,  as  expected. 

Yet  the  general  perception  persists  that  dropout  rates  are 
soaring.  When  the  nation’s  press  reports  the  results  of  dropout 
studies  it  tends  to  report  only  the  highest  figures  available  without 
concomitant  explanation  concerning  how  the  statistics  were  com- 
puted or  what  they  actually  mean  (Horst  6c  Donahue,  1989).  Thus 
the  public  (politicians  included)  is  informed  simply  that  this  or 
that  district’s  dropout  rate  is  in  the  neighborhood  of  50  percent,  a 
figure  that  in  turn  ends  up  being  interpreted  as  an  annual  rate- 
half  the  students  are  dropping  out  each  year  (Tugend,  1985). 

The  objective  of  this  paper  is  to  help  quell  the  mispercep- 
tion that  one-fourth  to  one-half  of  our  high  school  students  are 
quitting  school  prior  to  graduation.  The  premise  is  that  much  of 
the  confusion  is  due  to  difficulties  in  student  accounting  and 
record  keeping.  This  paper  reports  the  results  of  two  studies,  recent- 
ly cond'  ' ted  in  Dallas,  that  give  credence  to  this  thesis.  Before 
reporting  the  results  of  those  studies,  however,  the  reader  may  find 
it  interesting  to  see  the  effect  on  dropout  rates  iff  a rather  simple 
improvement  in  student  accounting  procedures. 
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Dropout  Rates  (continued} 


The  Effect  of  Improved  Student  Accounting 
Procedures  on  Dropout  Rates 

In  1987  the  Texas  legislature  enacted  into  law  new  require- 
ments  for  reporting  dropout  statistics  beginning  with  the  1987-88 
school  year.  In  particular,  a dropout  was  defined  as  any  student: 

1.  who  docs  not  have  a high  school  diploma, 

2.  who  is  absent  for  30  or  more  consecutive  days,  and 

3.  whose  attendance  at  another  public,  private,  or  paroch- 
ial school  within  the  30-day  time  period  cannot  be  established. 

An  additional  requirement  was  that  students  who  failed  to  re- 
turn to  school  in  the  fall  when  expected  were  to  be  counted  as 
dropouts  from  the  school  they  had  attended  the  previous  spring. 

At  the  beginning  of  the  1987-88  school  year,  the  Dallas 
school  district  had  no  formal  procedure  in  place  for  centrally 
collecting  requests  for  transcripts  to  establish  attendance  at 
another  school.  Consequently,  the  district  was  unable  to  exclude 
these  students  from  dropout  counts  until  the  following  year, 
19S8-89,  when  procedures  for  collecting  such  information  at  the 
school  level  and  for  coding  the  information  on  the  districts 
centrally  located  computer  database  were  developed  and  imple- 
mented. In  all  other  respects,  the  district's  accounting  procedures 
agreed  closely  with  those  newly  mandated  by  the  state.  Once 
the  new  procedures  were  installed,  however,  the  result  was  striking. 
For  several  years  prior  to  1988-89  the  district’s  official  annual 
high  school  dropout  rate  had  hovered  in  the  neighborhood  of 
19  to  21  percent.  For  J 988-89  the  rate  dropped  five  percentage 
points  to  16  percent.  Virtually  all  the  improvement  could  be 
attributed  to  the  new  accounting  procedures.  Before  these  pro- 
cedures were  used,  students  who  transferred  to  other  school 
districts  without  having  first  informed  their  old  school  of  their 
intentions  were  coded  as  withdrawn  “for  reasons  unknown.”  Since 
the  district  had  no  (collected)  evidence  of  their  matriculation 
elsewhere  these  students  had  to  be  counted  as  dropouts.  The  new 
system  for  recording  incidences  of  requests  for  transcripts  netted 
nearly  a 24  percent  reduction  in  the  official  dropout  rate  the 
district  was  required  to  report  to  the  state  education  agency.  In 
the  next  section  we  will  see  that,  given  enough  resources,  addi- 
tional improvements  in  accounting  for  withdrawn  students’ 
whereabouts  can  net  much  greater  reductions  in  dropout  rates. 

Two  Studies  to  Determine  the  Actual  Status 
of  Students  Officially  Classified  as  Dropouts 

In  1988  the  Dallas  school  district  initiated  two  projects 
aimed  at  returning  dropouts  to  school.  The  first  effort,  known 
locally  as  the  No-Show  Recovery  Project,  targeted  students 
who  did  not  return  to  school  as  expected  in  fall  1988  following 
summer  vacation.  The  second  effort,  generally  called  the  Fall 
Dropout  Recovery  Project,  was  aimed  at  students  who  left  the  dis- 


trict during  the  fall  1988  and  for  whom  no  evidence  was  available 
that  suggested  they  had  not  dropped  out.  While  the  primary 
focus  of  these  two  efforts  was  to  reenroll  dropouts,  the  studies 
afforded  an  excellent  opportunity  to  obtain  typically  unavailable 
data  on  the  whereabouts  of  students  classified  as  dropouts. 

Target  Populations 

For  the  No-Show  Project,  7,105  secondary  school  no- 
shows  were  identified  by  scanning  the  district’s  computer  database 
at  the  end  of  the  second  week  in  September  1988  for  secondary- 
school  students  listed  as  having  not  yet  returned  to  school.  Ex- 
cluded from  this  group  were  students  for  whom  withdrawal  codes 
indicated  they  had  not  dropped  out  of  school  hut  were  either 
attending  school  somewhere  else  or  were  not  returning  for 
reasons  of  health. 

Students  targeted  for  the  Fall  Recovery  Project  were  those 
identified  on  the  district’s  database  as  having  been  enrolled  in  a 
district  school  hy  the  end  of  the  second  week  in  October  (six 
weeks  following  the  beginning  of  the  school  year)  and  as  no 
longer  attending  school  by  the  middle  of  Fcb\.;.ry  1989  (three 
weeks  into  the  spring  semester)  for  a withdrawal  reason  that 
could  not  exclude  them  from  being  classified  as  a potential  drop- 
out. This  resulted  in  3,400  students  being  identified  as  dropouts. 

Procedures 

Although  the  district’s  primary  objective  in  mounting 
the  effort  described  in  this  paper  was  to  locate  students  who 
had  dropped  out  of  school  and  to  encourage  them  to  return,  the 
focus  of  this  paper  is  to  illustrate  the  effect  an  extraordinary 
effort  in  pupil  accounting  had  on  a school  district’s  dropout 
index.  For  this  reason,  detail  on  the  procedures  the  ficldworkcrs 
used  to  encourage  the  return  of  dropouts  are  not  provided.  In- 
stead, because  they  arc  relevant  to  this  paper,  only  the  procedures 
used  to  collect  and  analyze  data  are  described  below.  The  pro- 
cedures were  essentially  the  same  for  the  two  projects. 

Data  Collection  Instrument.  The  district’s  computer 
was  used  to  generate  rosters  of  no-shows  and  dropouts  by  school. 
These  rosters  were  designed  to  serve  also  as  an  instrument  for 
data  collection.  Thus,  in  addition  to  providing  target  students’ 
names,  addresses,  and  other  demographic  information,  the  rosters 
provided  a response  protocol  for  data  collectors  on  the  search 
teams  (see  below)  to  record  the  current  dropout  status  of  those 
students  they  were  able  to  locate.  Thus,  for  each  student  iden- 
tified as  a member  of  a target  population,  a ficldworkcr  was  to 
assign  the  student  to  one  of  the  10  categories  given  in  ‘Table  1 
(see  page  24).  The  rosters  also  included  a space  for  data  collectors 
to  record  comments  and  observations. 

Search  Teams  and  Data  Collection.  In  both  studies 
secondary  schwl  principals  were  instructed  to  utilize  their  local 
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Table  1 

Cafegon'es  Used  (or  Assigning  No-shows  and  Fall  Dropouts 


1.  Not  Located  (NocLoc):  Used  only  when  all  attempts  to  locate  the 
snjdenr  were  unsuccessful. 

2.  Pm  tile  School  (Pr\'Sch):  Assigned  when  it  was  learned  that  a 
student  was  currently  attending  a private  school.’ 

3.  A/rerrwme  Schwl  (AltSch):  Used  for  students  known  to  be 
attending  an  alternative  educational  program  other  than  a recog- 
nized public  or  private  school. 

4.  Public  School  (PubSch):  Assigned  when  a student  was  known  to 
be  attending  a non-distnct  public  school. 

5.  Moved  Out  (MovOut):  Used  for  students  no  longer  living  in  the 
area  served  hv  the  district  when  it  was  not  known  whether  the 
students  were  still  attending  school. 

6.  Dropped  Out  (DrpOut):  Used  only  when  it  was  learned  that  a 
student,  voluntarily,  was  no  longer  attending  school  and  had 
not  graduated. 

7.  Fushouc  (PshOut):  Assigned  for  students  who  were  suspended, 
expelled,  incarcerated,  institutionalized  or  otherwise  involuntarily 
forced  out  of  the  educational  system. 

8.  Health- Death  (HthDthk  Used  when  it  was  learned  that  a student 
was  no  longer  attending  school  due  to  illness,  or  because  he  or 
she  had  died. 

9.  Disrncr  (DSTRCT):  Assigned  when  a studenr  was  found  to  he 
attending  school  elsewhere  in  the  district. 

10.  Other  (OTHER!:  This  final  category  was  u^ed  as  a catchall  when 
none  of  the  other  categories  applied. 


staffs  in  making  an  initial  attempt  at  classifying  the  students 
identified  on  their  schools'  rosters.  These  individuals  were  to 
use  whatever  means  of  obtaining  information  they  had  at  their 
disposal  including  telephone  inquiries  and  personal  contacts.  It 
was  expected  that  the  bulk  of  the  work  of  accounting  for  students' 
whereabouts  would  he  accomplished  at  this  stage.  Additionally, 
personnel  from  several  central  offices  were  made  available  for 
more  extensive  field  efforts  in  locating  students  not  accounted 
for  in  the  school's  initial  attempts. 

Preparation  and  Training.  Special  meetings  were  held 
for  principals  to  explain  the  purpose  of  the  data  collection  and 
recovery  efforts  and  to  stress  the  importance  of  the  project.  Prim 
cipals  were  shown  examples  of  the  data  collection  instrument 
(i.eM  the  rosters)  and  provided  an  explanation  of  the  categories. 
Also,  principals  were  asked  to  utilize  their  own  staffs  in  attempting 
an  initial  determination  of  their  target  students’  current  classifi- 
cations. Finally,  principals  were  told  that  additional  personnel 
would  be  contacting  them  to  help  in  classifying  those  students 
that  remained  unclassified. 

Additional  training  meetings  were  held  for  the  extra- 
school  personnel  recruited  from  various  central  oil  ices.  The  pur 
poses  of  these  meetings  included  orientation,  instruction  on 
filling  out  the  response  instrument,  procedures  to  he  followed 
when  making  house  uills,  and  school  assignment. 


Follow-up  Database  Searches.  The  district’s  student 
database  was  searched  several  times  following  the  initial  searches 
in  which  the  target  populations  were  identified.  The  primary 
purpose  of  these  additional  searches  was  to  monitor  the  effec- 
tiveness of  the  recovery  efforts.  The  follow-up  database  searches 
also  afforded  the  opportunity  to  correct  some  errors  in  coding 
that  might  otherwise  have  gone  undetected.  For  instance,  fol- 
lowing the  data  collection  periods,  several  of  the  students  in  the 
target  populations  remain  not  classified.  However,  on  subsequent 
searches  of  the  district’s  database  many  of  these  students  were 
found  in  attendance  at  other  district  schools.  On  the  basis  of 
these  searches  these  students  were  assigned  to  the  category, 
DSTRCT,  an  indication  that  the  students  had  returned  to  school. 
In  other  instances,  students  assigned  to  one  of  the  other  cate- 
gories were  later  also  found  to  be  in  attendance  at  a district 
school.  These  students  were  similarly  reclassified  as  belonging 
to  the  DSTRCT  category.  Thus,  wherever  possible,  the  responses 
recorded  by  the  data  collectors  were  corrected  on  the  basis  of 
follow-up  database  searches. 

Results 

The  efforts  to  locate,  document,  and  recover  no-shows 
and  dropouts  were  mounted  on  a large  scale.  In  addition  to  the 
numerous  local  school  staffs  that  worked  on  the  projects,  approxi- 
mately 100  central-office  personnel  were  involved  in  collecting 
data  out  in  the  community.  Most  of  results  from  the  two  projects 
have  been  summarized  in  Table  2. 


Table  2 

Sitmnuin  of  the  Results  of  Attempts  to  Recover  AssiRmnjc 
N’o-vhmi.s  (iiul  Fa//  Dropouts  from  the  Full  Semester 
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Dropout  Rates  (dmtinued) 

No-show  Recovery  Project 

Of  the  7,105  summer  no-shows  originally  identified,  only 
300  of  them,  or  4.2  percent,  remained  unclassified  at  the  end  of 
the  no-show  recovery  period,  while  548  of  those  who  were  classi- 
fied were  found  to  he  in  attendance  at  a school  different  from 
the  one  to  which  they  had  been  assigned.  The  fieldworkers  as- 
signed these  students  to  the  DSTRCT  category.  Additionally, 
1,481,  or  20.8  percent  of  the  no-shows  originally  assigned  to 
various  other  categories,  by  the  data  collectors  were  later  reas- 
signed and  added  to  the  DSTRCT  category  on  the  basis  of  fol- 
low-up database  searches.  Most  of  these  reassignments  (89. IT 
however,  were  tor  students  originally  assigned  to  the  categories 
NotLoc,  MovOut,  and  OTHER.  Thus  the  follow-up  database 
searches  were  effective  in  locating  or  correctly  categorizing  a 
large  portion  of  the  no-shows  whose  whereabouts  had  gone  un- 
determined by  the  search  teams. 

Recovery  Efforts 

As  mentioned  earlier,  the  major  thrust  of  the  two  projects 
was  to  recover  dropouts.  From  the  top  part  of  Table  2 it  appears 
that  these  efforts  were  at  least  moderately  successful.  By  the  end 
of  their  respective  recovery  periods  25.7  percent  of  the  no-shows, 
and  18.5  percent  of  the  fall  dropouts,  had  returned  to  school. 
However,  comparative  data  from  the  previous  year  suggested 
that  these  results  were  not  as  strong  as  they  first  appeared.  On 
October  4,  1988  (when  the  no-show  recovery  project  was  con- 
cluded), the  no-shows  remaining  comprised  9.1  percent  of  the 
district's  unexpected  secondary  school  enrollment.  By  compari- 
son, one  year  earlier  the  number  of  no-shows  comprised  9.8  per- 
cent of  the  expected  enrollment.  Thus,  while  the  difference  was 
statistically  significant  {z  = 3.97,  />  < .0001),  it  can  be  concluded 
that  the  no-show  recovery  effort  resulted  in  only  minor  practical 
improvement  in  the  rate  of  returning  students  over  that  observed 
a year  earlier  when  no  special  effort  was  attempted. 

The  results  of  the  effort  to  recover  dropouts  appeared  more 
encouraging.  By  the  first  week  in  May  1989,  630  (18.5%)  of  the 
dropouts  identified  in  the  fall  project  had  returned  to  schtxT 
Rv  comparison,  of  4,100  first  semester  dropouts  identified  a 
year  earlier,  only  350  (8.5%)  had  returned  to  school  by  the  first 
week  in  May. 

Classification  of  No-shows  and  dropouts.  Apart 
from  the  district’s  primary  interest  in  recovering  dropouts,  these 
studies  provided  valuable  information  concerning  the  actual  clas- 
sification of  students  otherwise  officially  classified  as  dropouts. 

In  spite  of  their  extraordinary  eifort,  the  data  collectors 
were  still  unable  to  account  for  the  whereabouts  of  nearly  two- 
thirds  of  the  no-shows  and  about  one-third  of  the  fall  dropouts. 
Even  so,  although  not  actually  located,  appreciable  numbers  of 
these  students  were  determined  to  have  mewed  awnv  from  the 
district's  jurisdii  lion  (17.3%  of  the  no  shows  and  18.4%  of  the 
potential  dropouts  were  classified  MovOut).  Nearly  28  percent 


of  the  no-shows  and  more  than  30  percent  of  the  fall  dropouts 
were  determined  to  he  attending  a non-district  school  (PrvSch, 
AltSch,  or  PubSch).  Only  8.6  percent  of  the  no-shows,  hut  more 
than  30  percent  of  the  potential  dropouts,  were  categorically 
classified  as  having  damped  out  of  school  (i.c.,  classified  DrpOut). 

The  fact  that  the  whereabouts  of  such  a large  portion 
of  students  (i.c.,  those  assigned  to  the  MovOut,  NotLoc,  and 
OTHER  categories)  was  not  satisfactorily  determined  was  cause 
(or  concern.  However,  without  additional  information  on  the 
matriculation  status  of  these  students,  it  may  be  reasonable  to 
assume  that  they  were  attending/ not  attending  school  in  propor- 
tions similar  to  those  for  whom  this  information  was  available. 
In  other  words  it  mav  be  reasonable  to  assume  that  these  students 
were  distributed  proportionately  to  those  classified  into  the  re- 
maining categories.  Applying  this  assumption,  more  than  70  per- 
cent of  the  no-shows,  and  more  than  44  percent  of  the  fall  drop- 
outs, were  estimated  to  he  attending  school  somewhere  else  (sec 
Table  3).  As  for  the  students  reclassified  as  having  actually  dropped 
out  (DrpOut),  the  rate  among  summer  no-shows  was  estimated 
at  22.5  percent,  and  among  fall  dropouts  at  46.9  percent. 


Table  3 

Classification  oj  Student*  fallouing  Redistribution  of 
Those  Students  Whose  Whereuhouts  Rciruuncd  [Jndetermmcd 
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Revised  estimates  of  the  district  dropout  rate.  This 
redistribution  can  be  used  to  derive  a new  estimate  of  the  dist  rict’s 
1988-89  actual  dropout  rate.  On  October  4,  1 988,  earlv  into  the 
(all  semester,  the  district’s  ex  pet  ted  secondary  school  enrollment, 
including  the  no-shows,  was  58,182  students.  A conservative 
estimate  of  the  number  of  actual  dropouts  was  1,301  students 
(45(>  no-shows  plus  845  fall  dropouts),  or  a rate  of  2.24  percent. 
This  estimate  was  conservative  in  that  it  can  he  assumed  that 
some  of  the  students  in  the  undetermined  categories  (MovOut, 
Noth*,  and  OTHER)  had  also  dropped  out.  A more  liberal 
estimate  uin  be  derived  hv  assuming  proportional  distributions 
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in  the  undetermined  categories.  There  the  total  number  of  actual 
dropouts  would  be  estimated  at  2,488  students  (1,189  no-shows 
and  1,299  fall  dropouts)  yielding  an  estimated  1988-89  dropout 
rate  of  4.28  percent.  These  two  estimates,  2.24  percent  and  4.28 
percent,  can  be  compared  with  the  officially  reported  rate  of 
16  percent. 

Discussion 

The  results  presented  above  need  to  be  considered  from 
several  perspectives.  On  the  one  hand,  they  are  in  obvious  contra- 
diction with  the  results  of  several  other  studies  that  have  appeared 
over  the  last  several  years.  At  a minimum  the  results  call  into 
question  the  very  high  estimates  of  dropout  rates  that  are  often 
cited.  Additionally,  the  results  raise  questions  concerning  the 
feasibility  of  including  summer  no-shows  in  counts  of  dropouts. 

Should  No-shows  be  Counted  as  Dropouts?  In  their 
guidelines  for  reporting  dropout  statistics,  the  Texas  Education 
Agency  has  stipulated  that  no-shows  (i.c.,  students  who  fail  to 
enroll  during  the  fall  semester  as  expected,  and  whose  where- 
abouts cannot  otherwise  be  determined)  are  to  be  counted  as 
dropouts.  For  large  school  districts  with  large  numbers  of  no- 
shows,  high  rates  of  student  mobility,  and  complicated  procedures 
for  tracking  students,  this  stipulation  may  be  unfair.  As  the  studies 
reported  here  have  clearly  shown,  many  if  not  most  students 
listed  as  no-shows  can  reasonably  be  assumed  to  be  attending 
school  elsewhere.  Another  large  percentage  of  those  students 
listed  as  no-shows  during  the  first  few  weeks  of  school  eventually 
are  found  in  attendance.  The  sheer  numbers  of  no-shows  at  the 
start  of  an  academic  year  places  a considerable  burden  on  record- 
keeping mechanisms.  It  may  be  impossible  for  large  school  dis- 
tricts, without  adopting  the  extraordinary  effort  expended  here, 
to  adequately  account  for  all  its  no-shows.  The  penalty  is  a 
spuriously  high  dropout  rate. 

Should  students  who  move  out  of  the  area  be 
counted  as  dropouts?  Beyond  the  problem  of  counting  ma- 
triculating students  as  dropouts  is  the  problem  of  jurisdiction. 
Should  districts  be  held  accountable  for  students  who  move  out 
of  their  service  areas?  Apparently  under  Texas  regulations  they  are. 
Thus,  in  Dallas,  under  a conservative  estimate,  as  many  as  17 
percent  of  the  no-shows  and  18  percent  of  the  potential  dropouts 
were  counted  as  official  dropouts  simply  because  their  families 
choose  to  move  away  from  the  district’s  jurisdiction  over  the 
summer  without  notifying  their  children’s  schools. 

In  a recent  district  report  citing  dropout  indices,  Bahu 
(1989)  rej'Kirled  several  statistic  s,  all  of  which  were  components  of 
the  official  secondary  school  dropout  rate  required  in  state 
reporting  guidelines  for  1987-88.  The  overall  dropout  rate  given 
there  was  22.2  percent  of  which  no-shows  accounted  for  a little 
more  than  a third  (3(?°o).  If  the  liberal  estimate  (or  the  true 
dropout  rate  among  no-shows  (i.c.,  2.04%)  were  applied  to  tin- 


computation  in  that  official  report,  the  dropout  rate  reported 
there  would  have  been  attenuated  to  16  percent.  If,  in  addition, 
the  liberal  estimate  of  the  dropout  rate  among  potential  dropouts 
(i.e.,  2.23%)  were  employed,  the  official  rate  would  have  been 
reduced  further  to  only  8 percent. 

What  is  the  District's  True  Dropout  Rate?  Readers 
familiar  with  the  high  dropout  rates  reported  elsewhere  may  be 
troubled  by  the  relatively  low  estimates  obtained  here.  Those 
readers  may  question  the  procedure  adopted  here  of  allocating 
only  a proportional  share  of  those  students  originally  classified 
as  NotLoc,  MovOut,  or  OTHER  to  the  DrpOut  category.  For  one 
reason  or  another,  they  may  feel  that  more  students  should  have 
been  allocated  to  this  category.  Additional  data  from  the  studies, 
however,  tended  to  support,  or  at  least  not  refute,  this  manipu- 
lation of  the  data. 

As  mentioned  earlier,  the  data-collection  instruments 
contained  a space  for  the  data  collectors  to  record  comments  and 
observations.  In  their  training  meetings,  they  were  encouraged 
to  make  generous  use  of  this  space.  Accordingly,  most  of  the 
responses  were  accompanied  by  comments.  A perusal  of  the 
comments  recorded  for  those  students  classified  as  NotLoc  re- 
vealed thar  in  the  two-thirds  of  the  cases  where  comments  were 
made,  the  most  frequent  comment  was  “moved.”  Less  frequent, 
but  still  common,  were  the  comments,  “vacant  house”  and  “no 
answer”  Among  the  variety  of  other  comments  few  were  given 
that  would  implv,  directly,  thar  the  student  had  dropped  out  of 
school.  Indeed,  the  overall  impression  obtained  from  the  com- 
ments accompanying  students  classified  as  NotLoc  was  that  most 
of  these  students,  along  with  their  families,  had  moved,  leaving 
no  readily  available  forwarding  address. 

In  contrast,  nearly  all  the  responses  for  students  classified 
MovOut  were  accompanied  by  comments  indicating  that  these 
students,  again  along  with  their  families,  had  moved  out  of  the 
district’s  attendance  area.  In  no  case  did  the  comments  suggest 
that  a student  had  dropped  out  of  school.  On  the  other  hand, 
nearh  all  those  assigned  to  the  OTHER  category  had  comments 
that  erroneously  placed  them  in  other  district  schools  (the  fob 
iow-up  database  searches  established  that  they  were,  in  fact,  not 
attending  district  schools). 

It  must  he  noted  that  assignment  to  these  categories 
was  based  upon  whatever  information,  direct  or  indirect,  could 
be  gleaned  from  a variety  of  sources  including  fieldwork  in  the 
community.  In  most  cases  it  appeared  that  the  only  thing  that 
made  a difference  as  to  whether  a student  was  assigned  to  NotLoc 
or  to  MovOut  was  that  in  the  latter  case  the  data  collector  was 
told,  or  otherwise  was  able  to  determine,  that  the  student’s 
family  had  moved  to  another  l ity.  It  seems  reasonable  to  assume, 
therefore,  that  the  students  assigned  to  these  two  categories, 
NotLoc  and  MovOut,  were  similar.  Thev  were  students  who  had 
moved  away  and  were  probably  attending  schools  (or  not  attend- 
ing any  stTw'ol)  in  prnjxirtiiins  equivalent  to  those  whose  rcsi- 
dcnie  remained  within  the  district's  boundaries. 
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There  may  he  a less  solid  basis  for  treating  as  similar  those 
students  assigned  to  the  OTHER  category.  The  majority  of  these 
students  were  (erroneously)  placed  in  other  district  schools  by 
the  data  collectors.  Yet  they  were  not  found  in  subsequent  data' 
base  searches.  Thus,  in  effect,  they  remained  no-shows  and  poten- 
tial dropouts  who  could  not  he  located.  These  students  were 
included  in  the  pool  that  was  redistributed  because:  it  could 
not  be  verified  that  they  belonged  in  any  other  category,  and 
it  seemed  reasonable  to  assume  that  they  would  be  distributed, 
at  least  approximately,  like  those  in  the  NotLoc  and  MovOut 
categories. 

Summary 

In  recent  years  the  nations  media  have  reported  alarmingly 
high  dropout  rates  on  the  order  of  40  to  SO  percent.  Such  headlines 


have  been  fueled  by  a few  serious  studies  which  have  reported 
high  longitudinal  rates  along  with  lower  annual  rates  cn  the 
order  of  20  to  25  percent.  But  even  rates  of  this  latter  magnitude 
may  be  too  high,  as  the  studies  reported  here  suggest. 

A relatively  simple  change  in  accounting  procedures, 
keeping  a record  of  requests  for  student  transcripts,  can  yield  a 
remarkable  decrease  in  a school  district’s  annual  dropout  rate. 
Additionally,  if  a district  is  willing  to  expend  the  time  and 
energy  required  to  obtain  more  detailed  information  on  the 
whereabouts  of  students  who  withdraw  or  fail  to  return  to  school 
following  summer  vacation,  they  are  apt  to  find  that  many  of 
those  presumed  to  have  dropped  out  are  most  likely  attending 
school  elsewhere.  At  the  very  least,  they  will  find  that  many 
of  the  presumed  dropouts  have  moved  away  from  the  district’s 
service  area. 
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The  Role  of  Knowledge  Versus  Beliefs  in 
Improving  Educational  Practice 

By  Jack  Snowman,  Southern  Illinois  University 


Teaching  education  and  psychology  courses  to  under- 
graduate  and  graduate  students  is,  as  many  of  you  know,  a chal- 
lenging task.  The  behaviors  that  arc  the  focus  of  these  courses 
are  complex  and  are  influenced  by  a variety  of  factors.  To  help 
students  better  understand  the  complexity  of  human  behavior, 
particularly  as  it  occurs  in  educational  settings,  we  encourage 
(and  require)  them  to  become  familiar  with  the  research  litera- 
ture.  But  this  usually  creates  another  problem  since  the  research 
literature  on  many  topics  contains  inconsistent,  if  not  contra- 
dictory, findings.  How,  students  ask,  can  progress  he  made  in 
improving  classroom  learning  when  researcher  A finds  a strong 
positive  effect  for  a particular  treatment  (mastery  learning,  for 
example),  researcher  B finds  a weak  positive  effect,  and  researcher 
C finds  a moderate  negative  effect?  Although  I am  as  uncom- 
fortable as  they  are  with  the  “messiness”  such  findings  produce,  1 
point  out  that  inconsistent  results  are  the  norm  in  educational 
and  psychological  research  because  of  the  complexity  of  the 
topics  we  study.  This  complexity  leads  researchers  to  examine 
the  effects  of  different  variables  and  combinations  of  variables, 
to  measure  these  variables  in  different  ways,  and  to  conduct 
experiments  under  different  conditions.  As  a result,  one  develops 
a tolerance  for  ambiguity  and  a penchant  for  drawing  tentative 
conclusions  or  else  one  finds  a new  line  of  work. 

Imagine  my  excitement,  then,  when  I can  introduce  a 
topic  and  state  that  the  research  findings  arc  in  such  close  agree- 
ment that  the  implications  for  practice  are  particularly  clear  and 
compelling.  While  this  docs  not  occur  often,  it  seems  to  be  true 
for  the  practice  of  grade  retention  (requiring  a student  to  repeat 
a grade  the  following  year  for  unsatisfactory  academic  perfor- 
mance). Virtually  all  of  the  research  that  I have  seen  on  this 
practice  indicates  that  low-achieving  children  who  are  promoted 
learn  more  the  following  year,  have  a stronger  self-concept,  and 
are  better  adjusted  emotionally  than  similar  children  who  are 
retained.  Now  imagine  my  disappointment  when  I find  that 
grade  retention  is  still  a fairly  common  practice.  Why  educators 
engage  in  a practice  that  is  clearly  not  supported  by  the  evidence 
and  what  might  be  done  to  bring  educational  practices  more  in 
line  with  research  findings  arc  two  issues  that  1 would  like  to 
briefly  explore  in  this  article. 

Grade  retention  has  long  been  used  as  a wav  of  dealing 
with  individual  differences  in  learning  rate,  emotional  develop- 
ment, and  socialization  skills  and  is  still  fairly  prevalent.  In  the 
October  1987  issue  of  Phi  Delia  Kappan,  Mary  Lee  Smith  and 
Lorrie  Shepard  estimate  that  15  to  19  percent  of  all  schoolchil- 
dren in  the  United  States  am  retained  in  any  given  year.  Similar 
retention  rates  can  be  found  in  Haiti  and  Sierra  Leone.  Bv  con- 


trast, the  Japanese  educational  system  has  a retention  rate  of  less 
than  one  percent.  Tom  Schultz  reported  in  the  October  1989 
issue  of  Phi  Delia  Kappan  that  district-level  retention  rates  in 
California  elementary  schools  ranged  from  zero  to  50  percent. 

According  to  Smith  and  Shepard,  this  practice  persists 
because  many  educators  subscribe  to  one  or  more  of  the  follow- 
ing mistaken  beliefs: 

1.  Retention  allows  students  to  excel  academically  the 
following  year,  thereby  preventing  retention  later  on,  and  is  free 
of  cost  and  risk.  These  beliefs  are  typically  based  on  personal 
experiences  with  a small  number  of  children,  limited  follow-up, 
and  no  knowledge  of  the  fate  of  similar  children  who  were  pro- 
moted. Controlled  studies  with  large  representative  samples  of 
retained  and  nonretained  children  dearly  show  that  the  effects 
of  retention  are  seldom  positive. 

2.  Certain  children  have  not  developed  sufficiently  intel- 
lectually, socially,  and  emotionally  to  profit  from  normal  class- 
room instruction.  In  addition,  they  believe  that  changes  in  the 
curriculum  or  in  the  teacher’s  instructional  methods  are  not 
likely  to  be  of  much  help.  The  child  simply  needs  time  to  mature. 
Research  on  peer  tutoring,  cross-age  tutoring,  and  computer- 
assisted  instruction  suggest  otherwise. 

3.  Children  should  learn  more  and  learn  it  sooner.  Ac- 
cording to  this  view,  the  purpose  of  kindergarten  is  to  master 
basic  literacy  and  numeracy  skills  in  preparation  for  more  ad- 
vanced work.  Children  who  cannot  keep  up  become  candidates 
for  retention  (instead  of  the  curriculum  becoming  a candidate 
for  change).  Research  on  cognitive  development  casts  doubt  on 
the  benefits  of  pushing  five-  and  six-year-olds  to  master  too  many 
aspects  of  reading,  writing,  and  arithmetic. 

4.  Instruction  is  more  efficient  and  effective  when  class- 
rooms are  made  up  of  children  who  are  more  alike  than  they 
are  different.  Retention  is  viewed  as  one  way  of  producing  more 
homogeneous  classes.  Research  findings  on  the  effects  of  this 
type  of  ability  grouping  (often  referred  to  as  between-class  ability 
grouping)  are  largely  negative. 

Beliefs  about  retention  are,  of  course,  modifiable.  Just 
how  modifiable  was  a question  that  Roy  P.  Doyle  addressed  in 
the  November  1989  issue  of  Phi  Delta  Kappan.  Doyle  asked  ele- 
mentary school  teachers,  community  leaders  (parents  holding 
leadership  positions  in  the  local  parent/teacher  organization 
and  members  of  the  local  Rotary  Club),  and  undergraduate  edu- 
cation majors  in  a small  Arizona  town  to  indicate  on  a five- 
point  scale  how  strongly  they  subscribed  to  the  following  reten- 
tion-related beliefs  (the  lower  the  rating,  the  stronger  the  belief): 
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The  Role  of  Knowledge  (continued) 


1.  Retention  produces  more  learning  the  following  year 
than  nonretention. 

2.  Retention  in  lower  grades  produces  more  homogeneous 
classes  in  upper  grades. 

3.  The  prospect  of  retention  motivates  students  to  higher 
levels  of  achievement  than  they  would  attain  if  promotion  were 
based  solely  on  a student’s  age. 

4.  The  use  of  “social  promotion”  is  a major  factor  contrib- 
uting to  low  achievement  in  Arizona’s  public  elementary  schools. 

5.  An  eighth-grade  diploma  should  certify  that  some 
minimum  level  of  achievement  has  been  attained. 

6.  Promotion  to  the  next  grade  is  a reward  for  accom- 
plishment and  should  be  earned. 

Dovle  then  made  a presentation  to  each  group  in  which 
he  used  several  lines  of  research  evidence  to  argue  against  the 
practice  of  retention.  Specifically,  he  pointed  out  that  retained 
students  are  more  likely  to  subsequently  drop  out  of  school  than 
nonretained  students,  that  the  normal  range  of  learning  ability 
in  a typical  classroom  is  so  wide  that  retention  in  early  grades 
does  not  produce  significantly  more  homogeneous  classes  in 
later  vears,  that  nonpromoted  students  generally  learn  less  than 
comparable  low-achieving  students  who  arc  promoted,  and  that 
children  whose  academic  weaknesses  produce  a low  expectation 
of  success  are  not  likely  to  be  motivated  by  the  threat  of  reten- 
tion. Doyle  also  included  information  on  the  frequency  of  reten- 
tion in  Arizona  public  schools  and  the  degree  of  variability  in 
achievement  test  scores  among  fifth-  and  sixth-graders  in  Arizona 
public  schools.  Immediately  after  his  presentation,  Dovle  reas- 
sessed the  strength  of  each  group’s  beliefs. 


Doyle’s  findings  were  an  interesting  mix  of  the  expected 
and  the  unexpected.  The  strength  of  each  group’s  retention 
beliefs  prior  to  the  presentation  would  probably  surprise  no  one. 
The  community  leaders  were  most  strongly  in  favor  of  retention 
(average  rating  of  2.27)  followed  by  the  education  majors  (average 
rating  of  2.49)  and  the  local  teachers  (average  rating  of  2.64). 
The  overall  post-presentation  ratings  were  also  predictable.  The 
education  major  showed  the  greatest  shift  and  were  now  least 
inclined  to  believe  in  the  efficacy  of  retention  (average  rating 
of  3.27).  The  local  teachers  did  not  change  their  beliefs  as  much 
as  the  education  majors  and  ranked  just  below  them  (average 
rating  of  3.07).  Although  the  community  leaders  were  less  in 
favor  of  retention  after  Doyle’s  presentation,  as  a group  they  still 
held  the  strongest  pro-retention  beliefs  (average  rating  of  2.84). 

The  finding  that  Doyle  did  not  expect  was  that  the  post- 
presentation  responses  to  the  first  three  statements  were  quite 
different  from  the  responses  to  the  last  three  statements.  For 
all  three  groups  there  was  less  of  a change  in  the  beliefs  asso- 
ciated with  the  notions  of  upholding  standards  (number  4), 
maintaining  the  integrity  of  a diploma  (number  5),  and  earning 
rewards  for  accomplishments  (number  6)  than  in  the  beliefs  asso- 
ciated with  the  actual  effects  of  retention.  The  somewhat  depres- 
sing inference  that  Doyle  draws  from  this  logical  inconsistency 
is  that  it  will  probably  be  easier  to  convince  people  that  reten- 
tion is  harmful  than  it  will  be  to  persuade  them  to  abandon  the 
practice.  In  light  of  these  findings,  we  as  professional  educators 
need  to  make  our  students,  colleagues,  and  parents  aware  that 
thev  may  subscribe  to  beliefs  that  perpetuate  flawed  educational 
practices  and  urge  them  to  modify  such  beliefs  when  the  weight 
of  scientific  evidence  suggests  it  is  necessary  to  do  so. 


An  Interview  with  Zeichner  (amtmued  fnnu  page  21) 

One  thing  that  concerns  me  is  the  fact  that  much  of  this 
knowledge  about  teacher  education  is  being  produced  hv 
people  who  have  little  involvement  in  teacher  education. 
We  have  the  same  problem  in  teacher  education  that  we 
have  in  teaching  where  a professional  corps  of  researchers 
work  full  time  and  don't  experience  the  dnilv  grind  of 
teacher  education.  As  a teacher  educator,  someone  who 
is  still  involved  in  the  student  teaching  program,  I resent 
that  a lot. 

And  now  we  have  a whole  new  group  of  people 
coming  in  and  doing  teacher  education  research  with 
minimal  teacher  educatton  experience.  It’s  very  well 
documented  that  teacher  education  faculty  are  mostly 
tone  lung.  Their  workloads  are  not  comparable  to  faculty 
in  other  areas  and  in  mcM  places  that  do  teat  her  educa- 


tion, faculty  don’t  have  time  and  access  to  resources  to 
do  writing  and  research  on  teacher  education.  I feel  I 
have  to  stay  involved  and  remain  in  student  teaching 
and  that  once  I go  away  from  it  I have  no  right  to  speak 
to  people  in  the  field  about  what  they  ought  to  he  doing. 
As  a practitioner,  I feel  that  I can  at  least  voice  my  opinion. 
The  separation  of  research  and  practice  in  teacher  educa- 
tion is  a real  problem  and  meetings  like  AERA  arc  places 
where  this  problem  becomes  real  visible.  You  really  have 
to  have  some  direct  involvement  with  teacher  education 
programs  to  be  able  to  speak  intelligently  about  them. 
The  people  who  spend  all  of  their  time  traveling  around 
the  country  telling  others  what  they  should  be  doing, 
but  aren’t  doing  anything  themselves,  are  not  really  help- 
ing things  very  mm  h. 


Membership  Expresses  Opinions 

By  Sharon  McNeely,  At-Laige  Member  of  the  MWERA  Executive  Council 


In  the  spring  of  1992,  a mail  survey  of  our  membership 
was  conducted.  By  early  May,  205  responses  had  been  received, 
a little  over  one-third  of  our  membership.  Those  of  you  who  have 
not  yet  returned  your  forms  may  still  do  so.  I welcome  knowing 
how  everyone  feels  about  key  issues  and  hope  that  the  discussion 
will  lead  to  changes  to  better  meet  our  members’  needs. 

The  breakdown  of  those 
who  responded  to  the  question-  | 

naires  was:  43  percent  females  ^ 

and  56  percent  males.  Of  these, 

62  percent  had  Ph.D.s,  23  per-  Supported  and  Rcj 

cent  had  Ed.D.s,  11  percent  had 

master’s  degrees,  and  2 percent- 

had  bachelor’s  degrees.  Twenty-  item 

nine  percent  were  degreed  in  edu-  " ’ 

cational  psychology,  while  20  Impicmcnt  student  paper  a«.inl  . . 

percent  were  in  educational  ad-  IJcnlifv  scssion  tv^‘ in  thc  ^rnpram 

ministration.  Sixty-eight  percent  Makc  thc  Friciav  ,unch  °Pnonal  ■ - ■ 

reported  that  college  teaching  Have  roundtnnle  sessions . .. 

was  their  primary  or  secondary  Havc  r<'stcr  SC5*,ons  

job.  Thirty-two  percent  were  em-  Sock  ‘iponsor‘>  fnr  our 

ployed  by  colleges  to  do  research.  HaVL‘  J,v,s,onal  mcc‘t,n£ r,mc 

Ninety-two  percent  reported  Send  rac.pts  for  advance  r^tn.t.on 
being  of  Caucasian  descent.  1 do  Continue  the  cmckcr  barrel  social  . 

not  know  if  these  respondents  Add  Sundae  morning  workshops  . . 

overall  were  representative  of  our  Add  Saturdny  afternoon  'vorkshot" 

organization,  as  this  is  the  first  Add  Sa,urdav  af,ernwn  wv,ons 

time  that  we  have  Collected  H.ne  fewer  invited  speaker. 

demographic  information  on  

our  membership. 

Much  of  the  questionnaire'  was  devoted  to  getting  opinions 
about  the  annual  meeting.  Forty-three  percent  of  our  member- 
ship reported  always  attending  the  annual  meeting,  and  another 
41  percent  indicated  they  sometimes  attend.  Eighty- five  percent 
of  the  respondents  agreed  that  mid-October  was  a good  time  for 
the  annual  meeting.  However,  of  the  57  percent  who  do  no’ 
always  attend  our  meetings,  25  percent  indicated  that  they  were 
unable  to  attend  our  annual  meeting  because  of  schedule  con- 
flicts and  other  demands  on  them  during  mid-October.  There 
was  no  predominant  other  time  of  the  year  that  members  pre- 
ferred to  meet. 

On  the  open-ended  question  soliciting  changes  in  the 
meeting,  there  were  no  suggestions  that  occurred  among  more 
than  3 percent  of  the  respondents.  However,  when  given  choices 
for  possible  meeting  and  programmatic  changes,  support  was 
shown  for  some  changes,  while  other  possible  changes  were 
rejected  (see  Table  1). 


Table  1 

Supported  and  Rejected  Program  Changes 


When  given  choices  on  how  w^e  might  help  future  con- 
ferences’ expenses  match  income,  59  percent  of  the  respondents 
indicated  that  wfe  ought  to  separately  charge  for  the  Friday  lun- 
cheon. Fifty-four  percent  said  we  should  limit  the  invited  speakers 
expenses,  and  53  percent  supported  raising  late  registration  fees. 
Close  to  half  of  the  respondents  (46  percent)  supported  raising 

thc  regular  members  conference 
1 registration  fees,  and  41  percent 
1 supported  raising  workshop  fees. 

It  should  be  noted  that  35  per- 
Program  Changes  cent  Qf  the  respondents  reported 

attending  our  workshops,  w'ith 

st:  izztr:  ^ °f  *«endeef 

*ec  changed  not  see  changed  supporting  raising  those  fees.  Ad- 

— ditionally,  21  percent  indicated 

" ' 1 that  they  would  like  help  in  net- 

**  working  for  roomsharing  to  cut 

^ LH  their  personal  costs. 

w 10  There  were  a wide  range 

^ of  open-ended  responses  as  to 

^ 3 1 the  type  of  workshops  members 

^ ^ wrould  attend.  Sixteen  percent  rc- 

' quested  quantitative,  statis- 

tical, and  research  method  work- 
shops. Another  six  percent  sup- 
3‘  ks  ported  assessment-related  work- 

^ * shops  (instrumentation,  updating 

on  test  options,  microcomputer- 

I based  assessments).  The  rest  of 

the  responses  were  spread  among 
many  options.  The  yet-asked  question  is  if  wre  would  increase 
workshop  attendance  if  we  offered  workshops  at  other  times 
during  the  meeting. 

Onc-half  of  the  respondents  reported  using  the  printed 
abstracts  from  the  meeting,  and  61  percent  would  pav  extra 
($2)  for  the  abstracts.  Only  36  percent  reported  they  would 
use  the  abstracts  on  disk  and  would  pay  extra  for  thc  disk.  Three 
out  of  four  respondents  said  they  use  the  guides  and  other  hand- 
outs at  the  meeting.  Some  computer-literate  respondents  sug- 
gested we  have  a few  computers  at  thc  meeting  for  members 
to  copy  abstracts,  disks  of  presenters’  papers,  get  citv  informa- 
tion, post  job  listings,  allow  members  to  get  information  to 
network  w’ith  others  with  similar  interests,  etc.  I will  look  into 
costs  involved  for  bringing  two  computers  in  and  insuring  them 
during  the  conference. 
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Membership  Expresses  Opinions  (continued) 


Seventy-three  percent  of  the  membership  would  like 
major  research  interests  included  in  the  membership  listings.  Also 
supported  was  including  E-mail  and  FAX  addresses  (both  61  per- 
cent) in  the  membership  listings. 

Eighty-two  percent  of  the  respondents  indicated  that  they 
would  distribute  additional  programs  to  the  schools  and  others. 
Many  of  those  who  were  unwilling  to  do  so  indicated  that  they 
did  not  work  with  the  schools  and  had  no  personal  contacts. 
Handing  out  programs  might  be  an  effective  way  to  increase 
membership  and  increase  conference  attendance. 

However,  a significant  raise  in  conference  attendance 
would  he  problematic  for  MWERA  in  the  short-run,  because  of 
our  contract  with  the  Bismarck  Hotel.  As  we  have  many  new 
members,  it  is  important  for  them  to  know  the  current  benefits 
MWERA  derives  from  its  ongoing  relationship  with  the  Bismarck. 
MWERA  has  used  this  hotel  for  a number  of  vears.  In  addition 


to  low  room  rates  for  members,  thev  provide  ih  tree  meeting 
moms  (very  difficult  to  obtain  anywhere),  and  a variety  ol  other 
amenities.  In  many  hotels  we  would  have  no  choke  but  to  rent 
overhead  projectors,  etc.  The  Bism;m  k has  been  kind  enough 
to  let  us  bring  in  ernes  we  obtain  rent-free  from  Chicago  1\iHk 
Schools.  Only  four  percent  of  the  respondents  indicated  we 
should  look  elsewhere  for  hotel  facilities. 

Speaking  of  getting  new  members,  when  asked  how  they 
became  members,  62  percent  said  that  their  mentor  or  .1  u>!- 
league  told  them  about  MWERA.  Fifty-two  percent  said  thev 
joined  for  the  professional  networking  of  giving  and  receiving 
information.  Another  20  percent  reported  that  thev  joined 
MWERA  because  of  the  friendliness  and  udlegialitv  at  meetings. 
Some  members  responded  that  we  have  a nuuh  better  meeting 
than  /VERA.  W hen  was  the  last  time  you  told  someone  about 
MWERA?  Do  it  today!  We  are  still  the  best  deal  around! 
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Isidore  Newman,  The  UmverMiv  of  Akron 


MWERA  DIVISIONS 

A:  Administration 

R.  Curriculum  Studio 
C Learning  and  Insmunon 
P.  Measurement  and  Research  Meihodologv 
K Counseling,  Human  Development  and 
Special  Education 

T History  J»nd  Philosophy  of  Education 
Cj.  Soc  ul  Context  of  Education 
and  Motivation 

H.  School  and  Program  Evaluation 

I.  Professional  and  Medical  Professions 

J PoMM*condarv  Education 

h-  Teac  hinn  and  Teacher  Education 


MWERA  ASSOCIATION  COUNCIL 
(1990-92) 

Orpha  K.  Duel!.  Wichita  State  Univcmrv 
E Jean  Harper,  Wright  State  University 
Nam  v J r .dune,  Albion  College 
C iregorv  , Marchant,  Ball  S:arc  University 
Ralph  O.  Mueller.  University  of  Toledo 
Ru  iiard  C.  Pugh,  Indiana  University 
Robert  A.  Koscmicr,  Northern  Illinois  Univ. 
Joan  S.  Timm,  Univ.  of  Wisconsin-Oshkosh 

1991-93 

Thomas  Andre,  Iowa  State  UnivcrMls 
Sonva  L.  IMixt,  Kent  State  University 
Alu  e ] C orkili,  l Vuvcrsirv  of  West  Ontario 
Marc  Ann  Rowers,  University  ol  Toledo 
Sarah  E Peterson,  Northern  Illinois  l ’niversitv 
l.'hn  T Pohlman,  Suithern  Illinois  University 
I.  Jane  W illiams,  Columbia  Public  Si  hoob 
lane  Ann  /ah.»nas,  Cleveland  State  University 


The  Mid-Western  Educational  Research  Association  (MWERA)  is  a nonprofit 
organization  of  professional  educational  researchers  primarily  from  states  and  provinces 
located  in  the  mid-western  region  of  the  United  States  and  Canada.  Membership  is  open 
to  faculty,  students,  and  administrators  from  any  university,  college,  and  school.  College 
students  engaged  in  educational  research  are  especially  encouraged  to  join  as  members. 
Also  any  educational  researchers  in  business  and  industry,  as  well  as  those  in  national, 
state,  local  and  private  agencies  and  organizations  are  welcome. 

The  Association  promotes  and  disseminates  educational  research  through  its  publi- 
cations, its  scholarship  program,  and  its  Annual  Meeting. 

The  Mid-Western  Educational  Researcher  is  the  official  publication  of  the  Association. 
The  four  issues  published  annually  are  mailed  to  all  members.  These  issues  include  articles, 
features,  a report  on  the  Annual  Meeting,  some  of  the  major  presentations,  the  Call  for 
Proposals,  and  the  Program  for  the  Annual  Meeting. 

The  Annual  Meeting  of  the  Association  is  held  in  the  third  week  of  October  begin- 
ning with  presessions  starting  on  Wednesday  at  noon.  The  meeting  is  comprised  of  papers, 
symposia,  and  invited  addresses  concerning  a variety  of  topics  from  the  various  MWERA 
Divisions.  The  1992  Annual  Meeting  will  be  held  at  the  Bismarck  Hotel,  Chicago,  Illinois, 
October  14  through  17.  Contact  the  Program  Chair  for  more  information  about  the  Annual 
Meeting:  Richard  C.  Pugh,  (812)  855-4053,  School  of  Education,  Indiana  University, 
Bloomington,  IN  47405. 

.The  annual  dues  of  $18  (Regular  Member)  or  $10  (Student)  include  a subscription 
to  the  Mid-Western  Educational  Researcher  and  a reduced  registration  fee  for  the  Annual 
Meeting.Address  membership  correspondence  to:  Charles  C.  Anderson,  Jr.,  (708)  564-4796, 
MWERA  Executive  Officer,  1332  Southwind  Drive,  Northbrook,  1L  60062. 


Name  (first,  mid.  initial 

MWERA  Membership  Application 

. last) 

Mailing  address 

City 

State  Zip 

Home  phone  ( 

) Office  phone  ( ) 

Highest  degree 

Area  of  specialization 

Institution/employer 

Wi  X'ERA  division  preferences  (Indicate  choice): 

□ A.  Administration  □ B.  Curriculum  Studies  Li  C.  Learning  and  Instruction 

□ D.  Measurement  &.  Research  Methodology  □ E.  Counseling,  Human  Dev.,  <Sc  Special  Ed. 

□ F.  History  Philosophy  of  Education  □ G,  Social  Context  of  Education  <5*.  Motivation 
L)  H.  School  <Sc  Program  Evaluation  □ I.  Professional  &.  Medical  Professions 

□ J.  Postsecondary  Education  [ J K.  Teaching  Teacher  Education 
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Voices  in  Education 


The  MidWestem  Educational  Researcher  asked  leaders  in 
education  to  respond  to  the  question: 

How  can  research  be  made  more  accessible  to  teachers? 


I think  we  must  first  differentiate  between  research  as  a 
verb  (i.e.,  disciplined  inquiry)  and  research  as  a noun  (i.e.,  facts 
or  principles  to  be  learned  and  applied).  I believe  it  is  only  through 
conceptualizing  research  as  a verb  that  we  can  make  research 
more  accessible  to  teachers. 

— Larin  Anderson,  University  of  South  Carolina 


Study  groups  working  independently  of  administration, 
but  supported  by  them.  —David  Berliner,  Arizona  State  University 


(1)  Conduct  collaborative  research  with  teachers;  (2)  Make 
(research)  presentations  at  meetings  attended  by  teachers  and 
administrators,  not  just  researchers;  and  (3)  Develop  more  network 
systems,  such  as  NEA’s  Mastery  in  Learning. 

—Hilda  Borko,  University  of  Colorado 


By  pursuing  questions  and  research  agendas  that  originate 
in  real  persisting  problems  of  practice,  and  by  widening  the  circle 
of  participation  in  the  process  of  research  to  include  more  and 

more  teachers.  — Christopher  Clark,  Michigan  State  University 


Train  teachers  in  doing  it  themselves— get  them  to  be 
“teacher  researchers”  (such  as  Michigan  State  University  is 
doing  with  Debbie  Ball).  These  are  the  folks  who  will  make 
other  teachers  catch  the  bug. 

— Lyn  Como,  Teachers  College , Columbia  University 


Teachers  must  be  seen  as  people  who  can  have  oppor- 
tunities in  the  context  of  the  workplace  to  formulate  and  study 
their  own  problems.  “From  big  mug  to  little  jug”  has  been  the 
metaphor  used  to  convey  research  findings  to  teachers.  Teachers 
are  not  little  j ugs  and  professors  of  education  are  not  big  mugs.  We 
have  as  much  to  learn  from  teachers  as  they  have  to  leam  from  us. 

—Elliot  Eisner,  Stanford  University 


The. demands  of  teaching  are  so  great  that  few  teachers 
can  afford  the  luxury  of  reflection  on  a regular  basis.  Extended 
opportunities  for  staff  development,  based  on  current  and  relevant 
research,  must  be  provided  on  a regular  and  ongoing  basis. 

—Thomas  Guskey,  University  of  Kentucky 


Deliberately  supply  translation  pieces  that  put  the  find- 
ings in  teacher  palatable  language. 

— James  Popham , ICfX  Assessment  Associates 


(Conduct)  research  that  is  relevant  and  useful  to  teachers. 

—Kevin  Ryan,  Boston  College 


We  need  to  meet  regularly  with  teachers  and  adminis- 
trators to  be  responsive  to  their  needs  for  knowledge  and  to  work 
with  them  to  solve  the  problems  they  identify. 

—Jane  A.  Stallings,  Texas  A&M  University 


Involve  teachers  in  studies  of  their  own  problems. 
—Ralph  Tyler,  Center  for  Advanced  Study  in  Behavioral  Sciences 

Clear,  concise,  prose.  Actionable  recommendations. 

—Herbert  Walberg , University  of  Illinois -Chicago 


Primarily  through  sophisticated  training  programs;  how- 
ever, they  won’t  work  if  the  school  systems  do  not  support  the 
messages  contained  in  the  training. 

—Edward  Deci,  University  of  Rochester 


They  should  not  just  be  consumers  of  research  produced 
by  university  academicians,  but  active  producers  of  research. 

—Kenneth  Zeichner,  University  of  Wisconsin 
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• Official  Publication  of  the  Mid  Western  Educational  Research  Association  • 


Special  Program  Issue 

October  14-17,  1992 


o r a 


ON  THE  COVER 


The  Bismarck  Hotel.  In  1894  the  first  Bismarck  Hotel  was  established  in  a 40-foot  building  on 
Randolph  Street  in  Chicago.  Since  then  it  has  grown  and  expanded  to  provide  excellence  in  accommodations, 
dining,  and  entertainment.  With  550  rooms  and  banquet  and  meeting  facilities,  the  Bismarck  offers  the 
Mid-Western  Educational  Research  Association  a quality  affordable  site  for  its  annual  meeting. 


Information  for  Contributors  to  the  Mid-Western  Educational  Researcher 

The  Midwestern  Educational  Researcher  accepts  research-based  manuscripts  that  would  appeal  to  a 
wide  range  of  readers.  All  materials  submitted  for  publication  must  conform  to  the  language,  style,  and  format  of  the 
Publication  Manual  of  the  American  Psychological  Association , 3rd  ed.,  1983  (available  from  Order  Department, 
American  Psychological  Association,  P.O.  Box  2710,  Hyattsville,  MD  20784). 

Three  copies  of  the  manuscript  should  be  submitted  typed  double  space  (including  quotations  and  references)  on 
8Vixll  paper.  Only  words  to  be  italicized  should  be  underlined.  Abbreviations  and  acronyms  should  be  spelled  out  for 
the  first  mention.  Pages  should  be  numbered  consecutively,  beginning  with  the  page  after  the  title  page. 
Manuscripts  should  be  less  than  20  pages  long.  An  abstract  of  less  than  100  words  should  accompany  the  manuscript. 

The  manuscript  will  receive  blind  review  from  at  ieast  two  professionals  with  expertise  in  the  area  of  the  manuscript. 
The  author’s  name,  affiliation,  etc.,  should  appear  on  the  title  page  only.  Efforts  will  be  made  to  keep  the  review  process 
to  less  than  two  months.  The  editors  reserve  the  right  to  make  minor  editorial  changes  in  order  to  facilitate  a 
concise  clear  article.  The  author  will  be  consulted  if  any  major  changes  are  necessary. 

Manuscripts  should  be  sent  with  a cover  letter  to: 

Gregory  ].  Marchant  Isadora  Newman 

Educational  Psychology  Office  of  Educational  Research 

Teachers  College  or  College  of  Education 

Ball  State  University  The  University  of  Akron 

Muncie,  IN  47306-0595  Akron,  OH  44325*4205 


The  MidWestem  Educational  Researcher  (ISSN  1056-3997)  is  published  quarterly  by  the  Mid-Westcm  Educational  Research  Association  through 
The  University  of  Akron.  The  fall  issue  serves  as  the  annual  meeting  program.  Second-class  postage  paid  at  Akron,  Ohio,  and  additional 
mailing  offices.  POSTMASTER:  Send  address  changes  to  Charles  Anderson,  1332  Southwind  Drive,  Northbrook,  IL  60062. 


October  14-17,  1992 


Fourteenth  Annual  Meeting 


Program  Orientation 

Greetings!  Welcome  to  the  1992  MWERA  Program.  This  year’s  agenda  incorporates  the  new  with  the  old. 

You’ll  find  many  traditional  events  that  make  our  conference  so  special,  and  you’ll  discover  some  exciting 
new  offerings  too.  So  mark  your  calendars  to  join  us  October  14-17  at  the  historic  Bismarck  Hotel  in  Chicago. 
Here  is  what  you  have  to  look  forward  to  this  year. 


Conference  Beginning 

Following  the  preconference  training  workshops 
on  Wednesday  afternoon,  the  conference  begins  with  an 
Invited  Presentation  Wednesday  evening.  Thomas 
Good,  University  of  Missouri-Columbia,  will  present 
Small  Group  Learning : Problems  and  Potential  from 
7:30-8:30  p.m.  This  presentation  is  co-sponsored  by 
the  Illinois  Association  for  Educational  Research  and 
Evaluation  (ARE).  A Wine  and  Cheese  Reception  for 
MWERA  and  ARE  members,  sponsored  by  ARE,  will 
be  held  immediately  following  the  address. 

invited  Speakers 

In  addition  to  his  Wednesday  evening  address, 
Thomas  Good  will  deliver  the  traditional  Keynote 
Address  on  Thursday  morning  at  9:45  a.m.  His  topic 
is  Research  on  New  Directions  in  Teacher  and  Student 
Expectations. 

The  President’s  Address  has  returned. 

MWERA  President  Barbara  Plake,  University  of 
Nebraska,  will  address  conference  attendees  on  Friday 
morning  at  10:00  a.m.  Her  topic  is  Teachers’ 
Assessment  Literacy. 

At  the  Friday  luncheon,  Tony  Riccio,  Ohio 
State  University,  will  address  us  on  the  topic  of  Making 
the  Big  Decisions. 

In  addition,  we  are  pleased  to  welcome  the 
following  Division-sponsored  invited  speakers: 

Division  F:  Thursday,  11:00  a.m.-12:20  p.m. 

Henry  Hixson,  Ohio  Northern  University 

History  of  Development  and  Financial  Support 

in  Higher  Education  and  Future  Implications 


Division  C:  Thursday,  1:30-2:50  p.m. 

Mary  McCaslin,  University  of 

Missouri-Columbia 

Student  Affect:  Measurement  Problems  and 

Possibilities 

Division  D:  Friday,  4:40-6:00  p.m. 

James  Stevens,  University  of  Cincinnati 

Issues  in  Multivariate  Analysis 

Professional  Development 

The  following  events  are  specifically  included 
to  facilitate  professional  growth.  Workshops  are 
scheduled  for  Wednesday  from  12:00  noon  to  6:30 
p.m.  On  Friday,  conference  registrants  can  visit  the 
Exhibits  in  the  Lincoln  Room  from  10:00  a.m.  to  4:00 
p.m.  Exhibitors,  more  than  ever  before,  will  display 
books  and  other  educational  materials  and  will  be 
present  to  discuss  ideas  with  MWERAers  throughout 
the  day. 

Special  Activities 

We  are  especially  pleased  to  have  offerings  for 
Graduate  Students  this  year.  MWERA  encourages 
students  to  present  their  research.  Incentive  awards 
will  be  presented  to  students  who  author/co-author  and 
present  a research  paper  and  attend  the  General 
Business  Meeting  scheduled  for  Friday,  11:00-11:50 
a.m.  Additionally,  there  are  two  special  programs  on 
Saturday  especially  planned  for  graduate  students.  The 
topic  of  the  first  special  session,  scheduled  from  9:00 
a.m.  to  10:30  a.m.,  is  Mentoring  as  a Component  of 
the  Professional  Development  of  Graduate  Students. 
This  symposium  is  presented  by  faculty  from  the 
University  of  Nebraska-Lincoln.  A second  session, 
scheduled  from  10:40  a.m.  to  12:00  noon,  is  a 
workshop  on  Obtaining  and  Surviving  the  First  Faculty 
Position  organized  by  Kim  K.  Metcalf,  Indiana 
University. 
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Social  Opportunities 


The  1992  program  has  several  social  activities 
planned.  A New  Member  Welcome  Thursday  at  9:00 
a.m.  has  been  organized  by  Deborah  L.  Bainer,  Ohio 
State  University-Mansfield.  It  will  be  hosted  by  the 
Executive  Committee.  First-time  conference  attendees 
will  be  introduced  to  the  MWERA  organization  and  to 
the  conference  proceedings. 

Midwest  Hospitality  greets  all  conference 
participants  Thursday  from  8:30  a.m.  to  9:45  a.m.  and 
on  Friday  and  Saturday  from  8:00  a.m.  to  9:30  a.m. 
Meet  old  and  new  friends  alike  and  enjoy  coffee  and 
rolls. 


The  traditional  Cracker  Barrel  Social  is  on 
Thursday  evening  from  6:00  p.m.  to  8:00  p.m. 

Friday  night  is  the  President’s  Reception 
beginning  at  9:00  p.m.  in  the  Regency  Suite. 

The  President’s  reception  will  be  followed  by 
an  early  morning  roll  call  for  the  second  annual  Fun 
Run/Walk/Crawl  Along  the  Lake  Shore.  This  light 
exercise  route  is  approximately  2 miles  long  near  the 
Chicago  Yacht  Club.  President-Elect  Kenneth  A. 
Kiewra,  University  of  Nebraska,  is  again  the  organizer 
and  exuberant  guide  for  the  event. 


Chronological  Summary  of  Events 


Wednesday,  October  14 

© 12:00-6:30  p.m. 

Preconference  Training  Workshops 

© 8:00-9:30  p.m. 

Invited  Address,  Thomas  Good 

© 9:00-10:00  p.m. 

Wine  and  Cheese  Reception 


Thursday,  October  15 

© 8:30-9:45  a.m. 

Midwest  Hospitality 

© 9:00-9:45  a.m. 

New  Member  Welcome 

© 9:45-10:45  a.m. 

Keynote  Address,  Thomas  Good 

© 11:00  a.m.-12:20  p.m. 
Concurrent  Sessions 

© 12:30-1:20  p.m. 

Division  Meetings 

© 1:30-5:50  p.m. 

Concurrent  Sessions 

© 6:00-8:00  p.m. 

Cracker  Barrel  Social 


Friday,  October  16 

© 8:00-9:30  a.m. 
Midwest  Hospitality 


© 8:30-9:50  a.m. 

Concurrent  Sessions 

© 10:00  a.m.-4:00  p.m. 

Exhibits 

© 10:00-10:50  a.m. 

President’s  Address,  Barbara  Plake 

© 11:00-1 1:50  a.m. 

General  Business  Meeting/Graduate  Student 
Awards 

© 12:00-1:50  p.m. 

Luncheon:  Invited  Address,  Tony  Riccio 

© 2:00-6:00  p.m. 

Concurrent  Sessions 

© 9:00  p.m.-???? 

President’s  Reception 


Saturday,  October  17 

© 7:00  a.m. 

Fun  Run/Walk/Crawl  Along  the  Lake  Shore 

© 8:00-9:30  a.m. 

Midwest  Hospitality 

© 9:00-12:00  noon 
Concurrent  Sessions 

© 9:00-10:30  a.m. 

Graduate  Students:  Symposium  on 
Mentoring 

© 10:40-12:00  noon 

Graduate  Students:  Workshop  on  First 
Faculty  Job 
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1992  Program  Committee 

Many  people  helped  plan  the  1992  conference.  A special  thanks  to  the  following: 


Program  Chair 

Richard  C.  Pugh,  Indiana  University 
Program  Assistant 

Kelly  A.  McDonnell,  Indiana  University 
Division  Co-Chairs 

A.  William  L.  Sharp,  Southern  Illinois  University 
Wenifort  C.  Washington,  University  of 

Akron 

B.  Sarah  E.  Peterson,  Northern  Illinois 

University 

Rose  Mary  Scott,  University  of 
Wisconsin-Parkside 

C.  Gregg  Schraw,  University  of  Nebraska 
CarolAnne  Kardash,  University  of  Missouri 

D.  Ralph  O.  Mueller,  University  of  Toledo 
Robert  S.  Barcikowski,  Ohio  University 

E.  Thomas  E.  Midgette,  University  of  Arkansas 
Darrell  A.  Luzzo,  Johnson  County  Commur'ty 

College 

F.  Fred  W.  Buddy,  Spelman  College 
Donald  R.  Castle,  Ashland  University 

G.  Mary  R.  Sudzina,  University  of  Dayton 
Joan  S.  Timm,  University  of 

Wisconsin-Oshkosh 

H.  Gary  Shank,  Northern  Illinois  University 
Daniel  Mueller,  Indiana  University 

I.  Gene  A.  Kramer,  American  Dental 

Association 

Chang  Y.  Miao,  American  Dental  Association 


J.  William  E.  Loadman,  Ohio  State  University 
Kim  K.  Metcalf,  Indiana  University 

K.  Donald  L.  Haefele,  Ohio  State  University 
Josue  Cruz,  Ohio  State  University 

Workshop  Coordinators 

Stephen  Benton,  Kansas  State  University 
John  J.  Kennedy,  Ohio  State  Univesity 

Local  Coordinators  and  Exhibits 
Coordinators 

Sharon  McNeely,  Northeastern  Illinois 
University 

Chang  Y.  Miao,  American  Dental  Association 

New  Member  Welcome  Coordinator 

Deborah  L.  Bainer,  Ohio  State 
University-Mansfield 

Registration  Coordinators 

Rose  McCoy,  Indiana  University 
Roberta  VanPelt,  Indiana  University 

Midwest  Hospitality  Coordinator 

Charles  Anderson,  ETS  (Ret.)  and 
MWERA,  Executive  Officer 

Social  Coordinator 

Adria  Karle-Weiss,  University  of  South 
Florida 

Graphic  Designer 


Rose  McCoy,  Indiana  University 

A special  thank  you  to  all  who  reviewed  proposals,  to  Charles  Anderson  (Executive  Officer)  and  to 
Executive  Committee  Members  D’Costa,  Plake,  Kiewra,  Price,  McNeely,  Anderson,  Marchant,  and 
Newman. 
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Association  Business 


Association  Executive  Committee 

Immediate  Past  President 
Ayres  G.  D’Costa,  Ohio  State  University 

President 

Barbara  Flake,  University  of  Nebraska 
President-Elect 

Kenneth  A.  Kiewra,  University  of  Nebraska 
Vice-President 

Richard  C.  Pugh,  Indiana  University 
Secretary 

Jay  R.  Price,  University  of  Wisconsin-Stevens 
Point 

Member-at-Large 

Sharon  McNeely,  Northeastern  Illinois  University 

Executive  Officer  (ex  officio) 

Charles  Anderson,  ETS  (Ret.) 

Co-editors  Mid-Western  Educational 
Researcher  (ex  officio) 

Gregory  J.  Marchant,  Ball  State  University 
Isadore  Newman,  University  of  Akron 

Association  Council 

Thomas  Andre,  Iowa  State  University 
Sonya  Blixt,  Kent  State  University 
Alice  J.  Corkill,  University  of  Nevada-Las  Vegas 
Orpha  K.  Duell,  Wichita  State  University 
Mary  Ann  Flowers,  Cleveland  State  University 
E.  Jean  Harper,  Wright  State  University 
Nancy  J.  Kadunc,  Albion  College 
Gregory  J.  Marchant,  Ball  State  University 
Ralph  O.  Mueller,  University  of  Toledo 
Sarah  E.  Peterson,  Northern  Illinois  University 
John  T.  Pohlmann,  Southern  Illinois  University 
Robert  Rosemier,  Northern  Illinois  University 
Joan  S.  Timm,  University  of  Wisconsin-Oshkosh 
E.  Jane  Williams,  Columbus  Public  Schools 
Jane  Zaharias,  Cleveland  State  University 


Election  Results 

Issue  #1:  Life  Membership  dues  will  be 

established  at  ten  times  the  annual, 
regular  membership  dues. 

Issue  #2:  MWERA  will  develop  an  application  to 
the  Internal  Revenue  Service  for  status 
as  a charitable  organization  (501,3c). 

New  Officers 

Vice  President:  Thomas  Andre,  Iowa  State 
University 

Secretary:  Ralph  O.  Mueller,  University  of 
Toledo 

Association  Council  (1992-94): 

Linda  Bakken,  Wichita  State  University 
Robert  S.  Barcikowski,  Ohio  University 
Steven  Benton,  Kansas  State  University 
Paula  J.  Dupuy,  University  of  Toledo 
CarolAnne  Kardash,  University  of  Missouri 
Thomas  Knapp,  Ohio  State  University 
Thomas  E.  Midgette,  University  of  Arkansas 
Rose  Mary  Scott,  University  of 
Wisconsin-Parkside 


Business  Meetings 

R.5.1-11  MWERA  Division  Meetings 
Thursday,  October  15 
12:30-1:20  p.m. 

R. 8.8  MWERA  Association  Council  and 
Executive  Committee 

Thursday,  October  15 
4:30-5:50  p.m.  Maximilian 

F.5.1  MWERA  General  Business  Meeting 
Friday,  October  16 
11:00-11:50  a.m.,  Medill 

S. 3.7  MWERA  1992  Program  Committee  and 

1993  Program  Chair 
Saturday,  October  17 
9:00-1030  a.m.,  Lincoln 

S.5.1  MWERA  Executive  Committee 
Saturday,  October  17 
1:00-3:00  p.m.,  Regency  Suite 
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Fourteenth  Annual  Meeting 


How  to  Get  to  the  Conference 

When  coming  into  Chicago,  attendees  have  a variety  of  transportation  options.  See  options  below. 

O'Hare  Airport  to  the  Bismarck  Hotel  (3  options) 

1)  Take  a CTA  train  to  downtown  for  about  $2.00.  Catch  the  train  in  the  basement  of  Terminal  3.  Take  an  A or  B 
line.  Get  off  at  Lake  Transfer.  This  is  in  the  basement  of  the  State  of  Illinois  Building.  Climb  the  stairs  and 
proceed  to  the  Bismarck,  one  block.  This  is  the  fastest  way  during  rush  hours,  and  the  cheapest. 

2)  Take  the  Continental  Bus  for  $12.50  one-way  or  $22.00  round  trip.  No  reservations  are  required  from  the  airport. 
See  the  agent  at  the  booth  in  the  lower  level  baggage  claim  area. 

3)  Take  a cab  for  around  $20.00.  Wait  in  the  cab  stand  area.  In  off-hours  a ride  takes  about  30  minutes.  Inrush 
hours  (7-10  a.m.,  3-7  p.in.),  the  ride  could  take  an  hour  or  more.  Tips  average  fifteen  percent. 

Midway  Airport  to  the  Bismarck  Hotel  (3  options) 

1)  Take  a CTA  bus  and  train  to  downtown  for  about  $2.00.  Catch  the  Cicero  Bus  54B  (headed  North)  on  Cicero 
Avenue,  across  from  the  airport.  Ask  for  a transfer  for  the  train  when  you  board.  Get  off  at  22nd  and  Cicero. 
Catch  the  Douglas-O’Hare  line  train  going  East  (to  the  Loop).  Get  off  at  the  Lake  Transfer  station.  This  is  the 
basement  of  the  State  of  Illinois  Building.  Climb  the  stairs  and  proceed  to  the  Bismarck,  one  block. 

2)  Take  a Continental  Airport  Bus  for  $9.50  one-way  or  $16.75  round  trip.  No  reservations  are  required.  See  the 
agent  at  the  booth  for  tickets. 

3)  Take  a cab  for  around  $18.00.  See  O’ Hare  information  above  regarding  time. 

Driving  But  NOT  Parking  Downtown  (3  options) 

From  the  North  or  West 

1)  Park  near  a Metra  station  and  take  a Metra  Train  downtown.  From  the  Metra  station  you  will  need  to  take  a cab 
to  the  hotel.  Depending  on  where  you  board  the  train,  your  ride  can  be  inexpensive.  For  details  call  (312)  836- 
7000.  Be  certain  to  find  out  about  return  trips,  especially  on  weekends. 

2)  Park  at  O’Hare  remote  (follow  highway  signs  to  O’Hare),  take  a shuttle  into  O’Hare  and  follow  any  of  the  O’Hare 
options.  Remote  parking  is  inexpensive. 

3)  Park  at  Kiss  and  Ride  at  either  the  Cumberland  or  the  Harlem  Avenue  exits  off  of  1-94  (the  Kennedy).  Take  the 
CTA  train  (See  O’Hare  option  1).  Parking  is  inexpensive. 

From  the  South  or  East 

I)  Park  near  a Metra  Station  and  take  a Metra  Train.  See  1 above. 

Driving  And  Parking  Downtown  (4  options) 

• Listen  to  the  Radio  (670  or  780  am)  for  traffic  reports. 

• Remember,  rush  hours  are  7-10  a.m.  and  3-7  p.m.  in  both  directions.  Travel  in  the  city  takes  time.  There  is  a lot 
of  construction.  Plan  at  least  two  hours  from  the  near  suburbs  to  downtown.  Plan  one-half  hour  (minimum)  in 
downtown  traffic. 

1)  Coming  in  on  1-94  from  the  North:  1-94  junctions  with  the  Kennedy  at  Irving  Park  Road.  Continue  downtown. 

If  traffic  is  good,  it  should  take  40  minutes  from  the  junction  as  the  Kennedy  is  under  construction.  Beyond  the 
Ohio  Street  exit,  get  in  the  righthand  lane.  Exit  at  Washington  Street  going  East.  At  LaSalle,  make  a left,  go  one 
block  and  make  a left  on  Randolph  to  the  hotel.  After  you  drop  off  your  baggage,  you  can  park  your  car  in  a self- 
park (about  $15.00  per  day)  or  have  the  hotel  park  it.  There  is  NO  street  parking. 

2)  Coming  in  on  1-90  from  the  Northwest:  Follow  1-90  downtown.  This  becomes  the  Kennedy.  Follow  directions 
of  1 above  for  exits  and  parking. 

3)  Coming  in  on  I-90/I-94  from  the  Southeast:  Take  the  1-90  (Skyway)  in.  The  toll  will  be  about  $2.00,  but  it  will 
save  you  a lot  of  time.  Get  in  the  Express  Lanes  to  downtown.  When  you  approach  the  LOOP  follow  the  signs 
saying  1-94,  Kennedy  and  Wisconsin.  Exit  at  Monroe  Street  and  head  east.  At  LaSalle  take  a left,  then  a left  on 
Randolph  to  the  hotel.  After  you  drop  off  your  baggage,  you  can  park  your  car  in  a self-park  (about  $15.00  per 
day)  or  have  the  hotel  park  it. 

4)  Coming  in  from  the  South  or  Southwest:  Take  the  1-57  in.  This  junctions  with  1-94  and  1-90.  Read  3 above. 

If  you  are  arriving  some  other  way,  or  have  any  questions,  please  call  Sharon  McNeely  at  (312)  794-2788  before  your 

trip.  She  will  be  happy  to  help. 
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Conference  Registration  Information 

Genera ! Information 


1.  The  Conference  sessions  begin  Wednesday,  October  14,  1992  and  end  Saturday,  October 
17,  1992.  Please  make  travel  arrangements  accordingly. 

2.  Pre-register  for  the  conference  using  the  following  registration  materials.  Be  certain  to 
register  for  the  conference,  make  hotel  reservations,  and  if  interested,  register  for  one  or 
two  conference  training  workshops.  Workshop  descriptions  are  on  pages  10-11. 

3.  All  conference  participants  must  be  members  of  MWERA.  Please  pay  1992  dues  if  you 
have  not  already  done  so.  Now  is  an  excellent  time  to  pay  1993  dues  as  well. 
Membership  in  MWERA  includes  a subscription  to  the  Midwestern  Educational 

Researcher. 

4.  On-site  registration  and  packet  pickup  are  in  the  lobby  of  the  Bismarck  Hotel  at  the 
following  times: 

Wednesday,  October  14,  1992  11:00  a.m.  - 4:00  p.m. 

Thursday,  October  15,  1992  8:00  a.m.  - 4:00  p.m. 

Friday,  October  16,  1992  8:00  a.m.  - 4:00  p.m. 

Saturday,  October  17,  1992  8:00  a.m.  - 10:00  a.m. 

5.  Please  bring  this  program  with  you  to  the  conference.  A replacement  copy  will  cost 
$3.00. 

6.  Please  share  your  conference  program  and  registration  materials  with  co-authors, 
colleagues,  and  students  and  invite  them  to  attend. 
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Mid-Western  Educational  Research  Association 
Annual  Meeting  Registration  Form 

Please  print  or  type  all  information 

Name 

Institution 

Complete  Mailing  Address 


Is  this  your  first  MWERA  conference?  yes no 

ANNUAL  MEEHNG  REGISTRATION  FEE.  Check  your  membership  status  below: 

Graduate  Student  (pre-registration  fee  $30,  on-site  $35) 

Regular  Professional  (pre-registration  fee  $45,  on-site  $55) 

Non-member  (pre-registration  fee  $50,  on-site  $60) 


1992  MEMBERSHIP  DUES.  $18  Regular  Member;  $10  Graduate  Students  $ 

1993  MEMBERSHIP  DUES.  $18  Regular  Member;  $10  Graduate  Students  $ 

CONFERENCE  WORKSHOP^).  Indicate  your  choice(s)  below: 

Wednesday,  12:00  noon,  $15.00  fee 

Workshop  A or  Workshop  B $ 

Wednesday,  3:30  p.m.,  $15.00  fee 

Workshop  C or  Workshop  D $ 

Saturday,  10:40  a.m.,  $15.00  fee  (no  cost  to  graduate  students) 

Workshop  E $ 

TOTAL  AMOUNT  DUE:  $ 


Registrants  requiring  special  dietary  needs  for  the  Friday  Luncheon 
should  describe  those  needs  and  enclose  with  this  registration  form. 

Please  make  your  check  payable  to: 

Mid-Western  Educational  Research  Association  (MWERA) 

Mail  this  completed  registration  form  and  your  check  by  October  6 to: 

Charles  Anderson 
1332  Southwind  Drive 
Northbrook,  Illinois  60062 


Hotel  Reservation  Form 

Mid-Western  Educational  Research  Association  Conference 
October  14-October  17,  1992 
Bismarck  Hotel  (312)  236-0123 
171  West  Randolph  Street 
Chicago,  Illinois  60601 

Please  reserve: 

Single  Room(s):  $50.00 

Double  Room(s)  (Double  Bed  or  Twin  Beds):  $60.00 

• Date  and  Time  Arriving:  (a.m.)(p.m.) 

• Date  and  Time  Departing: (a.m.)(p.m.) 

Name(s) 

Affiliation 

Address 

This  Hotel  Reservation  must  be  mailed  to  the  Bismarck  Hotel  by  October  6,  1992 


Amount 
$ 


Required  of  New  Members  Only: 

Highest  Degree: 

MWERA  Division  Preference:  _ 
(See  Page  9) 

Major  Area  of  Specialization: 

Telephone:  Office  ( ) 

Home!  ) 
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Mid-Western  Educational  Research  Association 

Membership  Application 

1.  NAME:  (First  Name,  Last  Name) 
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3.  HOME  PHONE  NUMBER: 

4.  OFFICE  PI 

HONE  NUMBER: 
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5.  INSTITUTION/EMPLOYER: 

6.  POSITION: 7.  DEGREE: 

8.  MWERA  DIVISIONS  OF  PRIMARY  INTEREST: AERA  MEMBER? 

9.  NEW  MEMBERSHIP  REQUEST: RENEWAL: 

10.  Dues  for  the  calendar  year  (January  thru  December)  are  $18.00  (Regular  Member),  $10.00  (Grad  Student)  & 
$180  (Life  Membership).  Make  your  check  payable  to:  Mid-Westem  Educational  Research  Association 
(MWERA).  Send  completed  application  and  check  to: 


Charles  Anderson 
MWERA  Executive  Officer 
1332  Southwind  Drive 
Northbrook,  IL  60062 
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MWERA  Divisions 

A.  Administration 

B.  Curriculum  Studies 

C.  Learning  and  Instruction 

D.  Measurement  and  Research  Methodology 

E.  Counseling,  Human  Development  and  Special  Education 

F.  History  and  Philosophy  of  Education 

G.  Social  Context  of  Education  and  Motivation 

H.  School  and  Program  Evaluation 

I.  Professional  and  Medical  Professions 

J.  Postsecondary  Education 

K.  Teaching  and  Teacher  Education 


Lincoln  Room 
100 


Maximilian 
Room  150 


BEST  COPY  \IL\BU 
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MWERA  Conference  Training  Workshops 

MWERA  is  sponsoring  five  training  Workshops  in  conjunction  with  the  1992  Annual  Meeting.  The 
Workshops  have  been  peer-reviewed  and  selected  to  offer  a range  of  topics.  Workshops  will  begin  at  12:00  noon  and 
3:30  p.m.  on  Wednesday,  October  14  and  at  10:40  a.m.  on  Saturday,  October  17.  A separate  registration  fee  of 
$15.00  per  Workshop  will  be  charged  each  participant.  However,  the  Workshop  scheduled  for  Saturday,  Obtaining 
and  Surviving  the  First  Faculty  Position,  will  be  free  to  graduate  students.  The  number  of  participants  permitted  in 
each  Workshop  is  limited;  hence,  applications  will  be  honored  on  a "first-come,  first-serve"  basis.  To  apply,  indicate 
choice  of  Workshop(s)  on  the  Conference  Registration  Form  and  include  the  fee  in  the  total  amount  enclosed.  Only 
applications  and  fees  received  by  October  6,  1992  can  be  guaranteed. 


W.1.1  Workshop  A 
12:00-3:20  p.m.  — Parlor  A 

Sample  Size  Selection  Shoplifted 

Program:  Computer  simulations  and  free  software 

Organizer:  Robert  S.  Bardkowski,  Ohio  University 

Presenters: 

George  Johanson,  Gordon  P.  Brooks,  Karen 
Cicmanec,  Jody  Simmons,  Ohio  University 

The  primary  objective  of  this  workshop  will  be 
to  provide  attendants  with  knowledge  of  how  to  find 
sample  size  for  the  following  statistical  analyses:  a) 
survey  research,  b)  regression  analyses,  c)  analysis  of 
variance  (univariate  and  multivariate),  and  d)  repeated 
measures  analyses.  A secondary  objective  will  be  to 
inform  participants  of  the  software  that  is  available  to 
assist  them  in  finding  an  appropriate  sample  size.  The 
presentations  will  be  made  at  a "user  friendly"  level, 
but  will  be  supported  by  references  with  more  details. 
Therefore,  to  follow  the  lectures,  participants  should 
have  an  elementary  background  in  statistical  methods. 
The  workshop  will  consist  of  five  sections.  Each 
section  will  contain  one  example  ffom  survey  literature 
research,  one  example  of  a grant  application,  and  one 
or  more  examples  from  educational  settings.  The  last 
thirty  minutes  will  allow  for  one-on-one  questions  and 
for  interested  participants  to  try  the  sample  size 
selection  software.  All  examples,  overheads,  and 
references  will  be  available  in  a notebook  provided  by 
Ohio  University’s  School  of  Applied  Behavioral 
Sciences  and  Educational  Leadership.  Free  sample  size 
selection  software  will  be  made  available  for 
participants  to  copy. 

W.1J2  Workshop  B 

12:00  noon-3:20  p.m.  — Parlor  C 

Soft  Modeling:  Structural  Equation  Modeling  with 
Partial  Least  Squares  Estimation 
Program:  Practical  experience  in  using  computer 

programs 

Organizer:  Isadore  Newman,  University  of  Akron 

Presenters:  R.  Frank  Falk,  Nancy  B.  Miller, 
University  of  Akron 


Latent  variable  modeling  with  partial  least  squares 
(LVPLS)  or  "soft"  modeling  is  a conceptual  approach 
to  data  analysis.  It  provides  researchers  with  a useful 
tool  for  organizing  and  analyzing  the  complex 
relationships  inherent  in  social  science  research  today. 
LVPLS,  the  computer  program,  is  a powerful,  yet 
extremely  flexible  technique,  for  path  modeling  that 
involves  a components’  analysis  of  multiple  indicators 
for  theoretical  constructs.  Because  LVPLS  does  not 
impose  measurement  level  nor  distributional 
assumptions,  it  can  be  used  as  a general  analytic  tool 
when  maximum  likelihood  estimates  are  not 
appropriate.  Through  presentation,  discussion,  and 
hands-on  experience,  workshop  participants  will  be 
introduced  to  this  new  approach  to  data  analysis. 
Distinctions  will  be  made  between  the  theoretical, 
practical,  and  data  requirements  for  "soft"  modeling 
and  those  of  "hard"  modeling  or  structural  equation 
modeling  with  maximum  likelihood  estimation.  Path 
diagrams  will  be  used  to  configure  research  questions. 
Following  induction  in  preparing  the  data  and 
constructing  a LVPLS  computer  run,  participants  will 
gain  practical  experience  in  using  the  computer 
programs  and  will  be  able  to  give  interpretations  to  the 
program  results.  Participants’  questions  as  to  how 
LVPLS  can  handle  their  own  data  analysis  problems  are 
welcome. 

W.2.1  Workshop  C 
3:30-6:30  p.m.  — Parlor  A 

Teaching  with  Cases:  Strategies  and  Applications  for 
Teacher  Education 

Program:  Demonstration  and  examples;  small  group 
simulation  and  discussion 

Presenter:  Mary  R.  Sudzina,  University  of  Dayton 

This  workshop  will  focus  on  (1)  the  rationale  for  the 
use  of  cases  in  teacher  education,  (2)  research  on  the 
outcomes  of  using  case  studies,  (3)  strategies  for 
effectively  managing  the  case  study  process,  and  (4) 
simulation  and  analysis  of  a selected  case.  Applications 
and  implementation  will  be  discussed  by  content  area. 
Emphasis  will  be  on  the  active  involvement  of 
participants.  Each  participant  will  receive  an  annotated 
bibliography  of  selected  case  stud)'  research. 
Participants  will  also  have  the  opportunity  to  preview 
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several  current  case  study  texts  that  can  be  applied  to 
teacher  education. 

W.2.2  Workshop  D 
3:30-6:30  p.m.  — Parlor  C 

Computer-assisted  Data  Entry  for  SPSS  and  SAS  Users : 
Utilizing  Questionnaire  Programming  Language 
in  Survey  Research 

Presenters: 

Jane  Zaharias,  Cleveland  State  University 
Carol  Ann  Stevens,  Buffalo  State  College 

The  purpose  of  this  workshop  will  be  to 
demonstrate  use  of  microcomputers  in  gathering  and 
coding  survey  data.  Questionnaire  Programming 
Language  (QPL),  a computer-assisted  data  gathering 
program,  will  be  featured.  QPL  allows  for  the 
collection  of  data  by  direct  computer  entry,  rather  than 
code  sheet  transfer.  Originally  designed  for  conducting 
structured  interviews  and  telephone  surveys,  this 
program  can  also  be  used  to  expedite  the  coding  and 
computer  entry  of  data  resulting  from  self-report 
questionnaires.  QPL  provides  for  the  production  of 
survey  instruments;  automatic  branching;  the  entry  of 
both  string  and  numeric  data;  the  formatting  of  data 
into  files  that  can  be  read  directly  by  SPSS-X,SPSS-PC, 
SAS,  and  SAS-PC;  and  the  automatic  generation  of 
SPSS  or  SAS  definition  commands,  including  all 
required  variable  and  value  labels.  Direct  data  entry 
using  QPL  will  be  demonstrated  as  will  the  preparation 
of  QPL  programs  and  their  conversion  to  SPSS  or  SAS 
files.  Working  familiarity  with  microcomputers  and 
word  processing  programs  like  WordPerfect  is 
presumed. 


Please  note  the  following  workshop  is  scheduled  for 
SATURDAY. 

S.4.4  Workshop  E 

Saturday  10:40-12:00,  Lincoln  (Free  admission  to 
graduate  students) 

Obtaining  and  Surviving  the  First  Faculty  Position 
Program : Graduate  students,  those  interested  in  job- 
seeking  and  hiring  processes,  and  others  are 
encouraged  to  attend 

Organizer:  Kim  K.  Metcalf,  Indiana  University 

Presenters:  Kim  K.  Metcalf,  Indiana  University 
Martha  A.  Wilson,  Capital  University 
Andrew  T.  Lumpe,  University  of  Toledo 

Discussant: 

Judy  L.  Genshaft,  Dean,  College  of 
Education,  SUNY  Albany 

A panel  consisting  of  a current  university 
administrator  and  three  recent  graduates  who  presently 
occupy  faculty  positions  will  briefly  overview  their 
experiences  in  seeking  and  maintaining  their  first 
faculty  position.  Specifically,  each  panel  member  will 
relate:  (a)  what  the  application  and  interview  processes 
were/are  like;  (b)  suggestions  for  preparing  for  and 
engaging  in  the  job  search  and  interview  process;  and 
(c)  expectations,  difficulties,  and  suggestions  for 
successfully  completing  the  first  year  as  a university 
faculty  member. 


Conference  Program 


W.3.1  INVITED  ADDRESS 

Small  Group  Learning:  Problems 
and  Potential 

8:00-9:00  p.m  — MAXIMILIAN 

Presenter:  Thomas  Good,  University  of 
Missouri-Columbia 

Co-sponsor:  Illinois  Association  for  Educational 
Research  and  Evaluation  (ARE) 


W.4.1  WINE  and  CHEESE  RECEPTION  for 
ARE  members  who  attend  Dr. 
Good's  address  and  for  all 
MWERA  members 

9:00-10:00  p.m.  — Maximilian 

Sponsor:  Illinois  Association  for  Educational  Research 
and  Evaluation  (ARE) 

Arrangements:  Barbara  K.  Townsend,  Loyola 
University  Chicago  and  Executive 
Director,  ARE 
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Session  Overview  Schedule  for  Thursday 


Division 

Time 

A 

B 

C 

D 

E 

F 

L G 

H 

mm 

— 

K 1 

8:30-9:45 

Midwest  Hosptiality 

9:00-9:45 

NewMeffiberWelcd 

9:45-10:45 

Keynote  Address  2 thoitii 

0fS'€bod-7.it^-: 

11:00-12:20 

✓ 

mm 

✓ 

/ 

✓ 

mm 

12:30-1:20 

Division  Meetings  | 

1:30-2:50 

✓ 

mm 

mm 

✓ 

✓ 

i 

✓ 

. 

✓ 

3:00-4:20 

mm 

n 

✓ 

✓ 

✓ 

4:40-6:00 

/ 

✓ 

B3 

/ 

✓ 

✓✓ 

6:00-8:00 

■ 'GracfcafSar^ 

R.1.1  Midwest  Hospitality  Coffee  and 
Friends 

8:30-9:45  — Maximilian 

Organizer:  Charles  Anderson,  ETS  (Ret.)  and 
MWERA,  Executive  Officer 


R.2.1  New  Member  Welcome 

9:00-9:45  — Lincoln 
Host:  Executive  Committee 

Organizer:  Deborah  L.  Bainer,  Ohio  State 
University-Mansfield 

First-time  conference  attendees  are  invited  to  sip  a cup 
of  coffee  while  being  introduced  to  the  organization, 
the  officers,  and  the  conference.  Special  Badges  will 
identify  new  members  and  first-time  attendees. 


^ R.3.1  KEYISI OTE  ADDRESS  'ifjf- 

Research  on  New:  Directions  in  : 
Tea  chef  and  Student  Expectations 

Welcome:  i ;•  :Tu'-=:  »>■’ 

President,  MWERA  ;.!!  ):■  . 

'v;;;y!L  v : l^niyerstty  of^ebraska.::;: 

Introduction;  Ridiard  Ci. jPugh  ' ; D:; .... 

: ftogr^  Chair, 

Indiana  University 

Keynote:  Thomas  Good  ; 

University  of  Missouri-Columbia 


Suggestions  To  Presenters 

To  make  conference  sessions  as  helpful  and  enjoyable  as  possible,  the  Executive  Committee  asks  presenters  to  please 
follow  these  guidelines. 

1.  Send  a completed  copy  of  your  paper  to  the  Session  Discussant  so  that  it  is  received  no  later  than  September  30, 
1992.  Discussants  are  not  obligated  to  discuss  papers  received  after  this  date. 

2.  Bring  at  least  40  copies  of  your  paper  to  the  conference.  People  interested  in  your  paper  should  receive  a copy  at 
the  conference. 

3.  Make  overheads  and  handouts  that  are  attractive  and  readable. 

4.  Plan  to  present,  rather  than  read,  your  paper  in  the  time  allotted. 

5.  Because  of  purchase  costs,  storage  space,  and  maintenance  issues,  equipment  other  than  overheads  will  not  be 
provided. 
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R.4.1  Individual  Differences  in  Learning, 
Cognition,  and  Belief  Systems 

1 1:00- 12:20  - MEDILL 
Division  C Paper  Session 

Chair:  Gregg  Schraw,  University  of  Nebraska 

Predictors  of  Epistemological  Beliefs:  Comparing 
Adults  With  Only  a Secondary  Education  to  Adults  With 
Post-Secondary  Education 
Marlene  Schommer,  Wichita  State  University 

Individual  Differences  in  Verbal  and  Non-Verbal 
Thinking  Habits  of  Grade  6 Students 
Jacqueline  A.  Specht,  University  of  Western  Ontario 
Jack  Martin,  Simon  Fraser  University 

Impact  of  Level  of  Metacognitive  Awareness  on 
Calibration  of  Performance 
Alice  J.  Corkill,  University  of  Nevada-Las  Vegas 
Dale  T.  Koshida,  University  of  Toronto 

Self-Efficacy  Beliefs  and  Writing  Performance:  The 

Effect  of  a Writing  Intensive  Class 

Julie  L.  Remington,  Karen  D.  Multon,  University  of 

Missouri-Columbia 

Discussant:  Gregg  Schraw,  University  of  Nebraska 

R.4.2  Leadership  and  Style 

1 1:00- 12:20  — Parlor  A 
Division  A Paper  Session 

Chair:  Pearlmarie  W.  Goddard,  University  of  Akron 

Administrative  Role  and  Functions  of  Intellectual  Style 
Rich  Hofmann,  Miami  University 
Lon  Stettler,  Hamilton  City  Schools 
G.  Ronald  Bickert,  Belpre  City  Schools 

Effect  of  Administrative  Leadership  Style  and 
Personality  on  Leader  and  Staff  Work  Satisfaction 

Scherie  £.  Lampe,  Patricia  E.  Robertson,  Patricia  J. 
Koll,  David  M.  Hegedus,  University  of 
Wisconsin-Oshkosh 

School  Spending:  Can  Administrators  Defend  Spending 
for  Achievement? 

William  L.  Sharp,  Southern  Illinois 
University-Carbondale 

Discussant:  A.  William  Place,  Ball  State  University 


R.4.3  Investigations  of  College  Student 
Behavior 

1 1:00- 12:20  — Parlor  B 
Division  J Paper  Session 

Chair:  Kim  K.  Metcalf,  Indiana  University 

Academically  Able  University  Students’  Responses  to 
Attractions  and  Deterrents  to  a Career  in  Teaching 
Sonja  J.  Smith,  Mount  Vernon  Nazarene  College 

MINORITY  ACHIEVERS  PROGRAM:  An  investigative 
study  of  the  achievement  and  persistence  of 
academically  able  minority  students  in  a predominantly 
white  university 

HingKwan  Luk,  Lucy  C.  Jacobs,  Indiana  University 

Effects  ofTraditkmal  and  Content  Area  Reading 
Courses  at  the  College  Freshman  Level  on  Reading 
Achievement 

Kathleen  Gianaris,  Harper  Community  College 
Marvin  Willerman,  Northeastern  Illinois  University 

Discussant:  Kim  K.  Metcalf,  Indiana  University 

R.4.4  Division  F Invited  Speaker 

. 1 1:0P-rT2:2Cf^^R^ 


Chair:  Donald  R.  Castle,:  Ashlarui  University; : 


Henry  Hixson,  Vice  President  for  Development,  Ohio 
Northern  University 

R.4.5  Statistical  Distributions:  Some 
Problems 

1 1:00-12:20  — Parlor  D 
Division  D Paper  Session 

Chair:  E.  Jane  Williams,  Columbus  Public  Schools 
(Ohio) 

The  Rise  and  Fall  and  Rise  of  Multiple  Regression 
Tianqi  Han,  Dennis  W.  Leitner,  Southern  Illinois 
U niversity-Carbondal  e 

A Distribution-Free  Maximum  Test  of  Location 
R.  Clifford  Blair,  University  of  South  Florida 
Shlomo  S.  Sawilowsky,  Wayne  State  University 
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A Monte  Carlo  Evaluation  of  Two  Test  Statistics  For 
the  Test  of  a Single  Population  Proportion 

Timothy  H.  Husband,  Ralph  O.  Mueller, 
University  of  Toledo 

Discussant:  Isadore  Newman,  University  of  Akron 


R.4.6  Topics  in  Educational  Evaluation 

1 1:00- 12:20  — Parlor  E 

Division  H Paper  Session 

Chair:  Daniel  Mueller,  Indiana  University 

Survey:  Computer  Use  in  Kansas  Elementary  Schools 
Billy  C.  Yates,  Emporia  State  University 

Report  of  a Pilot  Project  for  Rural-Gifted  Adolescents 
Albert  M.  Bugaj,  University  of  Wisconsin-Marinette 
Sandy  Walejko,  lov/a-Grant  School  District 
(Wisconsin) 

Art  Student  Evaluation:  Perils  and  Pitfalls 
John  W.  Zimmer,  Adeline  Wong,  University  of 
Toledo 

David  Guip,  Toledo  Museum  of  Art 
Dennis  Hocevar,  University  of  Southern  California 
Gwendolyn  Boylan,  Jo  Ann  Jennings,  Defiance 
Schools,  Ohio 

An  Approach  to  Analyzing  Afrocentric  Instruction 
Jeannie  L.  Hudson,  Mankato  State  University 


R.4.7  Teacher  Traits  and  Characteristics 

1 1:00- 12:20  — PARLOR  F 
Division  K Paper  Session 

Chair:  Carmen  R.  Giebelhaus,  Ohio  State  University 

A Study  of  Teacher  Empathy  By  Two  Teacher  Groups: 
Vocational  and  Academic 

Lewis  P.  Burrell,  Debra  L.  Derbyshire,  Kent  State 
University 

FOCUS:  An  Explanation  of  the  Human  Behavioral 
System 

Gary  F.  Russell,  Janet  Severino,  Ashland  University 

The  Reflective  Expert  Paradox 

Gregory  J.  Marchant,  Ball  State  University 


Differences  in  Attitudes  and  Intentions  to  Use 
Computers  in  a Group  of  Pre-Service  Teachers 
Kris  L.  Bosworth,  Santiago  Cueto,  Indiana  University 


R.4.8  Preservice  Education 

1 1:00-12:20  — Lincoln 

Division  K Paper  Session 

Chair:  Ronald  N.  Marso,  Bowling  Green  State 
University 

What  Do  We  Expect  in  1992 from  Elementary  Student 
Teachers?  A National  Analysis  of  Rating  Forms 
Frederick  C.  Isele,  Indiana  State  University 

Preparing  Teachers  for  Their  Multiple  Roles  in  a New 

Educational  System 

In-Sook  Lee,  Indiana  University 

The  Personality  Profiles  of  Prospective  Educators  Who 
Have  Chosen  to  Complete  and  Have  Chosen  Not  to 
Complete  Their  Preparation  to  Become  Teachers 
Susan  Sears,  John  J.  Kennedy,  Ohio  State  University 
Gail  L.  Kaye,  Ross  Laboratories  (Ohio) 

The  Effect  of  Instruction  Delivery  Systems  on  Preservice 
Teacher  Content  Knowledge  and  Learner  Attitudes 
Toward  Computer-Based  Instruction 
Beth  A.  Wiegmann,  Thomas  E.  Thompson,  Northern 
Illinois  University 

Discussant:  Fred  L.  Pigge,  Bowling  Green  State 
University 


R.4.9  Multicultural-A 

1 1:00-12:20  — Maximilian 
Division  K Paper  Session 

Chair:  Betsy  Feldkamp,  Ohio  State  University 

The  Pedagogy  of  Enrichment:  Successful  Lessons  of 
Exemplary  Urban  Teachers 

Susan  M.  Brookhart,  Timothy  G.  Rusnak,  Duquesne 
University 

You're  Not  in  Kansas  Anymore  Toto:  Comparing 
Preservice  Teachers’  Perceptions  of  Lower  Income 
Minority  Students  in  an  Urban  Setting  with  Middle  and 
Upper  Middle  Income  Students  in  a Suburban  Setting 
Rosemary  F.  Schiavi,  University  of  Evansville 
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An  Examination  of  Attitudes  and  Perceptions  of  Primary 
Students  Towards  Children  From  Different  Racial  and 
Socio-Economic  Backgrounds:  A Collaborative 
Research  Project 

Jeffrey  S.  Winter,  National-Louis  University 
Daniel  Ryan,  Hubbard  Woods  School 

Intervention  Strategies  in  Multicultural  Education : A 
Comparison  of  Pre-Service  Models 

William  G.  Sparks  HI,  M.  Elizabeth  Verner,  Elinois 
State  University 

Gender  Equity  in  the  Teaching  Force 

Susan  M.  Tracz,  Nancy  G.  Lee,  Barbara  Burch, 
Robert  Monke,  California  State  University-Fresno 

DIVISION  MEETINGS 

R.5'1  Division  A (Administration) 

12:30-1:20  — Parlor  A 
Co-Chairs: 

William  L.  Sharp,  Southern  Illinois  University 
Wenifort  C.  Washington,  University  of  Akron 

R.5.2  Division  B (Curriculum  Studies) 

12:30-1:20  — PARLOR  B 
Co-Chairs: 

Sarah  E.  Peterson,  Northern  Illinois  University 
Rose  Mary  Scott,  University  of  Wisconsin-Parkside 

R.5.3  Division  C (Learning  and 
Instruction) 

12:30- 1:20  — Parlor  C 
Co-Chairs: 

Gregg  Schraw,  University  of  Nebraska 
CarolAnne  M.  Kardash,  University  of  Missouri 

R.5.4  Division  D (Measurement  and 
Research  Methodology) 

12:30-1:20  — Parlor  D 
Co-Chairs: 

Ralph  O.  Mueller,  University  of  Toledo 
Robert  S.  Barcikowski,  Ohio  University 

R.5.5  Division  E (Counseling,  Human 
Dev.  & Special  Fduc.) 

12:30-1:20  — Parlor  E 
Co-Chairs: 

Thomas  E.  Midgette,  University  of  Arkansas 
Darrell  A.  Luzzo,  Johnson  County  Community  College 


R.5.6  Division  F (History  and  Philosophy 
of  Education) 

12:30-1:20  - Parlor  F 

Co-Chairs: 

Fred  W.  Buddy,  Spelman  College 
Donald  R.  Castle,  Ashland  University 

R.5.7  Division  G (Social  Context  of 
Educ.  & Motivation) 

12:30-1:20  — Maximilian 
Co-Chairs: 

Mary  R.  Sudzina,  University  of  Dayton 
Joan  S.  Timm,  University  of  Wisconsin-Oshkosh 

R.5.8  Division  H (School  and  Program 
Evaluation) 

12:30-1:20  — Blackhawk 
Co-Chairs: 

Gary  Shank,  Northern  Illinois  University 
Daniel  Mueller,  Indiana  University 

R.5.9  Division  I (Professional  and 
Medical  Professions) 

12:30-1:20  — Maximilian 
Co-Chairs: 

Gene  A.  Kramer,  American  Dental  Association 
Chang  Y.  Miao,  American  Dental  Association 

R.5.10  Division  J (Postsecondary 
Education) 

12:30-1:20  — Lincoln 
Co-Chairs: 

William  E.  Loadman,  Ohio  State  University 
Kim  K.  Metcalf,  Indiana  University 

R.5.11  Division  K (Teaching  and  Teacher 
Education) 

12:30-1:20  — Medill 
Co-Chairs: 

Donald  L.  Haefele,  Ohio  State  University 
Josue  Cruz,  Ohio  State  University 
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ifR.&i'l;;:-.  Division  C Invited  Speaker 

^3102:50^ 

r Chair  s;Carol  Anne  M.  Kardash,  University  of 
: : Mis^uri-Col^  ;• ■ 

MeasuremenriProblenft  and  f' 

ffiosfipiiMes- 1*7.  ^ 

; Mary  McCasUn,  University  Of  Miissburi-Columbia 

R.6.2  Leadership  for  Today's  Schools 

1:30-2:50  — PARLOR  A 
Division  A Paper  Session 

Chair:  Reene  A.  Alley,  University  of  Akron 

Leadership  in  the  1 990 ’s— Probing  the  Fifth  Dimension 
David  S.  Hurst,  Wichita  State  University 

Tne  Effects  of  Applicant  Age  and  Academic  Achievement 
in  Screening  Decisions  for  the  Employment  of 
Secondary  Teachers 

A.  William  Place,  Theodore  J.  Kowalski,  Ball  State 
University 

I.  Philip  Young,  Ohio  State  University 

Humor  in  Leadership:  State  of  the  Art 
Gordon  P.  Brooks,  Ohio  University 

Discussant:  Charles  E.  Kline,  Purdue  University 


R.6.3  Viewing  Curriculum  from  Multiple 
Perspectives 

1:30-2:50  — Parlor  B 

Division  B Paper  Session 

Chair:  Donald  Reyes,  Northern  Illinois  University 

Operationalizing  the  Curriculum:  Teachers’ 

Perceptions  of  Which  Learning  Tasks  Are  Most 
Important  for  Students  ’ Academic  Success 
Sheryl  W.  Piercy,  Illinois  State  University 
Joan  Feld  McGuire,  LaSalle  School  District 

Domains  in  Curriculum:  An  Empirical  Knowledge  Base 
Linda  S.  Behar,  Loyola  University 

Novice  Teachers’  Curricular  Conceptions  and  Processes 
Eva  Weisz,  DePauw  University 


Discussant:  Donald  Reyes,  Northern  Illinois 
University 


R.6.4  Contemporary  Research  Topics  in 
Counseling  and  Development 

1:30-2:50  - PARLOR  C 
Division  E Paper  Session 

Chair:  Nudie  E.  Williams,  University  of  Arkansas 

A Study  of  the  Preparation  of  Vocational  Teachers  for 
Teaching  Mainstreamed  At-Risk  Special  Needs  Students 
Lewis  P.  Burrell,  Kent  State  University 

Educational  Planning  and  Academic  Achievement  of 
Eighth  Grade  Students:  A Racial/Ethnic  Comparison 
Wei-Cheng  Mau,  Dianne  M.  Held,  Wichita  State 
University 

Current  Developments  Related  To  Measuring 
Forgiveness 

Michael  J.  Subkoviak,  Robert  D.  Enright,  Ching-Ru 
Wu,  University  of  Wisconsin-Madison 

Dialogic  Approaches  to  Ethnographic  Data  Collection, 
Analysis  and  Reporting  Formats 
Cindy  Snyder,  Indiana  University 
Frank  Snyder,  Midwest  Action  Methods  Training 
Center  (Indiana) 

Discussant:  Darrell  A.  Luzzo,  Johnson  County 

Community  College  (Kansas) 


R.6.5  Interpreting  Statistical  Models 

1:30-2:50  — Parlor  D 

Division  D Paper  Session 

Chair:  Elizabeth  Randolph,  Ohio  University 

Building  and  Interpreting  Causal  Models 

Ralph  O.  Mueller,  Paula  J.  Dupuy,  University  of 
Toledo 

Feathering:  An  Iterative  Procedure  for  Modifying 
Hypothesized  Factor  Structures 
Rich  Hofmann,  Miami  University 
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Some  Nonstandard.  Applications  of  the  Analysis  of 
Covariance  Model 

John  T.  Pohlmann,  Southern  Illinois 
University-Carbondale 

Discussant:  Thomas  Knapp,  Ohio  State  University 


R.6.6  Gender  end  Cultural  Issues 
1:30-2:50  — Parlor  E 

Division  G Paper  Session 

Chair:  Joan  S.  Timm,  University  of 
Wisconsin-Oshkosh 

The  relationship  between  achievement  goal  orientation, 
gender  and  beliefs  about  sport:  A developmental 
perspective 

Darren  C.  Treasure,  Glyn  C.  Roberts,  University  of 
Illinois  at  Urbana-Champaign 

Differential  Effects  of  Culture  and  Sex  on  Anxiety 

Naim  C.  Gupta,  Betty  E.  Gridley,  Ball  State 
University 

Differential  Effects  of  Culture  and  Sex  on  Self-Concept 
Naim  C.  Gupta,  Betty  E.  Gridley,  Ball  State 
University 

R.6.7  Learning  and  Training  in  the 
Professions 

1:30-2:50  — Parlor  F 

Division  I Paper  Session 

Chair:  Chang  Y.  Miao,  American  Dental  Association 

The  Effect  of  Fatigue  on  Resident  and  Medical  Student 
Learning 

Timothy  J.  Van  Susteren,  Deborah  E.  Simpson, 
Robert  E.  Condon,  Basil  C.  Salaymeh,  Barry  B. 
Browne,  Medical  College  of  Wisconsin 

Back  to  Basics:  A Description  of  a Research  Program 
for  Enhancing  Learning  in  Training  and  Human 
Resource  Development 

Ronald  R.  Morgan,  Edward  E.  Gordon,  Loyola 
University  of  Chicago 

Judith  A.  Ponticell,  University  of  Illinois  at  Chicago 


The  Personality  and  Motivation  of  the  Combined 
Degree  Student:  What  Do  Written  Measures  Tell  Us? 
James  M.  Schuerger,  Cleveland  State  University 
Bonnie  J.  Jones,  Northeastern  Ohio  Universities 
College  of  Medicine 
Isadore  Newman,  University  of  Akron 
Robert  E.  Seeman,  Northeastern  Ohio  Universities 
College  of  Medicine 

Discussant:  Mary  E.  Lunz,  American  Society  of 

Clinical  Pathologists 


R.6.8  Preparation  and  Education  of 
Teachers 

1:30-2:50  — Maximilian 
Division  K Paper  Session 

Chair:  Carmen  R.  Giebelhaus,  Ohio  State  University 

The  Effect  of  Teacher  Preparation  Programs  on  Student 
Views  of  Learning 

Linda  H.  Chiang,  Anderson  University 
Larry  W.  Henriksen,  Ball  State  University 

Critical  Components  of  On-Campus  Qinical  Laboratory 
Experiences:  Preservice  Teachers  ’ Perceptions 
Kim  K.  Metcalf,  Indiana  University 

Novice  Teachers  ’ Ratings  of  Job  Entry  Expectations 
Prior  to  and  Following  Teaching:  Evidence  of 
Idealistic  Expectations  and  Transition  Shock 

Ronald  N.  Marso,  Fred  L.  Pigge,  Bowling  Green 
State  University 

Some  Predictors  of  Pre-Service  Elementary  Teachers  ’ 
Grade  Level  Preferences:  Fear  and  Loathing  in 
Teacher  Education 

Karl  A.  Matz,  Mankato  State  University 

R.7.1  Text  Processing  Strategies  and 
Textual  Manipulations: 

Differences  Between  Good  and 
Poor  Readers 

3:00-4:20  — Medill 

Division  C Paper  Session 

Chair:  Marlene  Schommer,  Wichita  State  University 

Differences  in  the  Everyday  Reading  Practices  of  Gifted 
and  Non-Gifted  Adolescents:  Report  from  a Pilot  Study' 
M.  Cecil  Smith,  Northern  Illinois  University 
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The  Upstream  Role  of  Phonological  Information: 
Differences  between  Good  and  Poor  Readers 
Daniel  H.  Robinson,  University  of  Nebraska 

The  Effects  of  Headings,  Structural  Importance,  and 
Ability  on  Reading  Patterns  and  Test  Performance 
John  R.  Surber,  University  of  Wisconsin-Milwaukee 

The  Generation  of  Inferences  from  Different  Verbal 
Representations 

Richard  K.  Staley,  Nelson  F.  Du  Bois,  SUNY 
Oneonta 

Discussant:  Marlene  Schommer,  Wichita  State 

University 

R.7.2  Special  Education  and  Mentorship 

3:00-4:20  — Parlor  A 
Division  A Paper  Session 

Chair:  Sally  Childs,  Akron  Public  Schools 

Perception  of  Presence  ofMentor(s)  in  Masters, 
Doctoral  Degree,  and/or  Certification  Endeavor  As 
Well  As  Current  Professional  Assignment 

Hazel  H.  Loucks,  Hazel  B.  Andros,  Hongru  Yun, 
Southern  Illinois  University-Carbondale 

Planning  and  Managing  in  Special  Education 
Cooperatives 

Linda  G.  DuncanMalone,  Ball  State  University 
William  D.  Mclnerney,  Purdue  University 

Effects  of  Therapist  Structure  and  Patient  Expectations 
on  Perceptions  of  Therapist  Effectiveness 
Moshe  Torem,  Akron  General  Medical  Center 
Isadore  Newman,  Patricia  Pallota,  University  of 
Akron 

Dawn  D.  Lord,  Supervising  Psychologist,  Akron 

Discussant:  Patricia  O’Connell,  Illinois  State 
University 


R.7.3  Human  Development  and 
Parenting  Research 

3:00-4:20  — Parlor  C 

Division  E Paper  Session 

Chair:  Darrell  A.  Luzzo,  Johnson  Community  College 
(Kansas) 


The  Interactive  Effects  of  Affection  and  Control  on 
Punishment : Parents  ’ Responses 

Elmer  A.  Lemke,  Andrea  L.  Seivaggio,  James  J. 
Johnson,  Illinois  State  University 

Education  of  the  Homeless  Children  in  South  Africa 
Zodwa  M.  Dlamini,  University  of  Iowa 

Perceived  Actions  of  Parents  and  Attitudes  of  Youth 
Thomas  S.  Parish,  Kansas  State  University 
James  R.  Necessary,  Ball  State  University 

Is  There  a Parenting  Style  for  Single  Parents  Who  Want 
Their  Children  to  Attend  College? 

James  J.  Johnson,  Elmer  A.  Lemke,  Illinois  State 
University 

Discussant:  Isaiah  Sessoms,  Clarion  University  of  PA 


R.7.4  Measurement:  Construct  Validity 

3:00-4:20  — PARLOR  D 
Division  D Paper  Session 

Chair:  Donald  L Haefele,  Ohio  State  University 

Can  the  KDI  Test  Be  Used  to  Identify  Children  Who 
Will  Qualify  for  a Reeding  Intervention  Program? 

John  W.  Fraas,  Ashland  University 

Cynthia  Frick,  Richland  County  (Ohio)  Office  of 

Education 

An  Examination  of  the  Construct  Validity  of  the 

Hutchins  Behavioral  Inventory 

Debra  Buchman,  Ralph  O.  Mueller,  University  of 

Toledo 

Construct  Validity  of  the  DCAT 

Ritu  K.  Khanna,  Janet  K.  Sheehan,  John  T. 

Mouw,  Southern  Illinois  University-Carbondale. 

An  Assessment  of  GPA  Prediction:  DCAT  as  a Possible 
Solution 

Ritu  K.  Khanna,  Dennis  W.  Leitner,  Southern 
Illinois  University-Carbondale 

Discussant:  George  Johanson,  Ohio  University 
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R.7.5  Survivors  of  Social  Oppression 
Speak  Out! 

3:00-4:20  - Parlor  E 

Division  H Symposium 

Co-Chairs:  Carolyn  Bohlen,  Jacqueline  Rickman, 
Northern  Illinois  University 

Topic:  Survivors  of  social  oppression  speak  out!: 

Ethnographic  interviews  with  African  Americans 
and  persons  with  disabilities  give  directives  to 
educational  restructure 

Participants: 

Carolyn  Bohlen,  Northern  Illinois  University 
Jacqueline  Rickman,  Northern  Illinois 
University 

Pamela  Barnett,  Northern  Illinois  University 
Shirley  Carter,  Northern  Illinois  University 
Leon  Liddell,  Northern  Illinois  University 
Sandee  Stroncak,  Northern  Illinois  University 


R.7.6  Academic  and  Demographic 
Profiles  of  Teacher  Educators 

3:00-4:20  — PARLOR  F 
Division  K Paper  Session 

Chair:  Josue  Cruz,  Ohio  State  University 

Demographic  and  Biographic  Characteristics  of 

Prospective  Teacher  Educators 

Joy  D„  McCullough,  Trinity  Western  University 

Academic  Indicators  of  the  Research  Productivity  of 

Prospective  Teacher  Educators 

Joy  D.  McCullough,  Trinity  Western  University 

John  J.  Kennedy,  Hak  Ping  Tam,  Ohio  State 

University 

The  Professional  Activities  of  Teacher  Educators  in 

Liberal  Arts  Institutions 

Linda  E.  Morrow,  Muskingum  College 

Similes  for  Teaching  and  Classroom  Teaching 
Orientations 

Gregory  J.  Marchant,  Thomas  S.  Schroeder,  Ball 
State  University 


R'7.7  Reading  and  Research 

3:00-4:20  — Lincoln 

Divison  K Paper  Session 

Chair:  Susan  R.  Cramer,  University  of  Wisconsin 

The  Importance  of  Reading,  Writing  and  Talking  in 
Learning  to  Teach:  How  Experience  Influences 
Conceptual  Outage  for  Pre-Service  Teachers 
Nancy  J.  Fellows,  Northeastern  Illinois  University 

Exploring  Emergent  Writing  in  Kindergarten:  A Study 
in  Six  Qassrooms 

Lois  Zamzow,  Winneconne  Elementary  School, 
Oshkosh 

Judy  C.  Lambert,  University  of  Wisconsin-Oshkosh 

Reading  Tutors  ’ Comments  About  Students  ’ Responses 
to  Instruction 

Susan  M.  Tancock,  Ball  State  University 

The  Relationship  Between  Undergraduate  Training  and 
Beliefs  About  Reading  Instruction:  A Follow-Up  Study 
After  the  First  Year  of  Teaching 
Mary  Ann  Wham,  Northern  Illinois  University 


R.7.8  Collaboration 

3:00-4:20  — Maximilian 
Division  K Paper  Session 

Chair:  Sue  Sears,  Ohio  State  Universuy 

Induction  Programs  as  Staff  Development  for  Novice 

and  Mentor  Teachers 

Eva  Weisz,  DePauw  University 

The  Center  for  Collaborative  Research:  Looking  at  the 
First  Year 

Ruth  Ravid,  Marianne  Handler,  National-Louis 
University 

School/University  Collaboration  for  the  Induction  of 
Beginning  Teachers 

Ruth  A.  Koskela,  Patricia  J.  Koll,  University  of 
Wisconsin-Oshkosh 

The  Satellite  Program:  A Collaboration  for  Clinical 
Experiences  in  Teacher  Education 
Linda  F.  Tusin,  Elmhurst  College 
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R.8.1  Elaboration  and  Problem-Solving 
Strategies:  Different  Research 
Approaches 

4:30-5:50  — Parlor  F 

Division  C Symposium 

Chair:  Beverly  Dretzke,  University  of  Wisconsin-Eau 
Claire 

Spontaneous  Analogical  Transfer:  A Problem-Oriented 
Approach 

Douglas  R.  Needham,  Wilfrid  Laurier  University 

Evaluating  the  Impact  of  Elaboration  Strategies 
Between  Above-Average  and  Average  Learners 
Eileen  Wood,  Wilfrid  Laurier  University 
Jodi  Mason,  University  of  Waterloo 

The  Effectiveness  of  Elaboration  Strategies  for  Low 
Achieving  Grade  Five  Students 
Teena  Willoughby,  Anne  Bolger,  University  of 
Waterloo 

Social  Interaction  Strategies  in  an  Activity  Environment 
Lilly  E.  Both,  Wilfrid  Laurier  University 

Discussant:  Beverly  Dretzke,  University  of 
Wisconsin-Eau  Claire 

R.8.2  Exploring  Transformational 

Leadership  and  the  Open  Systems 
Model  as  Curricular  Threads  in 
Doctoral  Administrative  Programs 

4:30-5:50  — PARLOR  A 
Division  A Symposium 

Organizer:  Martin  H.  Jason,  Roosevelt  University 

Chair:  Charles  D.  Almo,  Roosevelt  University 

Rationale  for  Including  Tranformational  Leadership  and 
the  Open  Systems  Model  as  Curricular  Threads  in 
Doctoral  Administrative  Programs 
Charles  D.  Almo,  Roosevelt  University 

Theoretical  Perspectives  of  Transformational 
Leadership  and  the  Open  Systems  Model  and  Research 
Implications  on  Doctoral  Dissertations 
Martin  H.  Jason,  Roosevelt  University 


Application  of  Transformational  Leadership  and  the 
Open  Systems  Model  to  the  Doctoral  Internship  in 
Educational  Administration 
Tom  Van  Dam,  Roosevelt  University 

Application  of  Transformational  Leadership  and  the 
Open  Systems  Model  to  Doctoral  Courses  in 
Educational  Administration 
Yiping  Wan,  Roosevelt  University 

Discussant:  Richard  Smith,  Martin  Luther  King  High 
School 


R.8.3  Current  Issues  in  Science  and 
Mathematics  Education 

4:30-5:50  — Parlor  B 

Division  B Paper  Session 

Chair:  M.  Cedi  Smith,  Northern  Illinois  University 

Evaluating  a Geology  Curriculum  for  Non-Majors 
William  J.  Boone,  Indiana  University 

The  Nature  of  Nature:  Ideas  of  Nature  in  Curriculum 
for  Environmental  Studies 

Henry  St.  Maurice,  University  of  Wisco  ns  in-Stevens 
Point 

Assessment  in  Elementary  Science  (K-8):  A Curriculum 
Model  for  Training  Teachers 

Cory  Cummings,  Belinda  Wholeben,  Northern  Illinois 
University 

Van  Hiele  Levels  and  Logo  Based  Instruction 
Mian  M.  Yusuf,  University  of  Wisconsin-Parkside 

Teaching  Minuends  0-9;  Is  the  Concrete  Through 
Abstract  Teaching  Sequence  Necessary? 

Karen  Sealander,  Northern  Illinois  University 

Discussant:  Rene  T.  Stofflett,  Northern  Illinois 
University 


R.8.4  Multicultural  Counseling  Research 

4:30-5:50  — Parlor  C 
Division  E Paper  Session 

Chair:  Robbie  Steward,  Michigan  State  University 
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Effects  of  Training  Counselors  in  Gay,  Lesbian,  and 
Bisexual  Issues 

Susan  B.  Young,  Lorraine  J.  Guth,  Indiana 
University 

Examination  of  An  Ethno-Cultural  Sensitive  Approach 

in  Counseling  African-American  Students 

Carolyn  M.  Dejoie,  University  of  Wisconsin-Madison 

A Comparative  Examimtion  of  Ethnic  Background  and 
Its  Differential  Impact  Upon  a Subjects’  Responses  to 
Projective  Tests 

Doris  N.  Cooper,  Ronald  R.  Morgan,  Loyola 
University  of  Chicago 

Sex  Role  Identity  and  Work  Salience  of  Males  and 
Females  in  Banking 

Diane  Kjos,  Governors  State  University 
Beney  McCue,  First  of  America  Bank-Kankakee 

Discussant:  Paula  J.  Dupuy,  University  of  Toledo 

R.8.5  Self-Concept 

4:30-5:50  - Parlor  D 

Division  G Paper  Session 

Chair:  Jupian  J.  Leung,  University  of 
Wisconsin-Oshkosh 

Measuring  Self-Concept  Development  in  Preschool 
Children 

Barbara  J.  Leys,  Ruth  Ravid,  National-Louis 
University 

Content  Specificity  as  it  Relates  to  Academic  Self 
Concept  and  Academic  Achievement:  A Cross  Cultural 
Comparison 

Victoria  Manion,  Indiana  University 

An  Attempt  to  Enhance  Children’s  Self-Concepts:  A 
Follow-Up  Report 

Thomas  S.  Parish,  Kansas  State  University 
James  R.  Necessary,  Ball  State  University 

Factors  Which  Significantly  Affect  the  Self  Esteem  of 

Suburban  Elementary  Students 

Georgia  J.  Kosmoski,  Matteson  Elementary  School 

District 

Dennis  R.  Pollack,  Pollack  and  Associates  Clinical 
Psychologists 


R.8.6  Teacher  Behavior  and 
Characteristics 

4:30-5:50  — PARLOR  E 
Division  K Paper  Session 

Chair:  Jeff  Peck,  Ohio  State  University 

A Comparison  of  Interactions  Between  Degreed  and 
Non-degreed  Early  Childhood  Teachers  and  Their  Four- 
Year-Old  Children 

Kimberly  A.  White,  Ball  State  University 

Selected  Elements  of  Effective  Teaching:  Testing  Their 
Practical  Value  with  Ohio’s  Principals 
Judith  M.  Hudgins,  Kent  State  University 

Selected  Elements  of  Effective  Teaching:  Testing  Their 
Practicality  as  Differentially  Perceived  by  Ohio ’s 
Elementary  Teachers 

Cynthia  J.  McMillin-Temesi,  Santa  Clara  University 

Selected  Elements  of  Effective  Teaching:  Testing  Their 
Practical  Value  with  Teachers  in  a Large  Urban  School 
District 

Carol  L.  Baird,  Youngstown  City  Schools 

R.8.7  Biography  and  Potpourri 

4:30-5:50  — LINCOLN 
Division  K Paper  Session 

Chair:  Peter  Rillero,  Ohio  State  University 

Components  of  Job  Satisfaction  and  Dissatisfaction 
Among  School  Psychologists 
Alex  Thomas,  Miami  University 

Talking  with  Masterful  Teachers 

Rozanne  Sparks,  Richard  P.  Lipka,  Pittsburg  State 

University 

Five  Instructors— A Study  of  Instructional  Preference  of 

Preservice  Teachers 

Charles  E.  Skipper,  Miami  University 

Dimensions  of  Literacy  Learning 

Lucy  Ann  Dahlberg,  Nancy  Seifert-Kessell,  Cleveland 

State  University 
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R.8.8  Association  Council  Meeting  R.9.1  Cracker  Barrel  Social 

4:30-5:50  — Med/ll  6:00-8:00  — Maximilian 

All  current  and  elected  association  council  members  and 

officers  Arrangements:  Adria  Karle-Weiss,  University  of 

South  Florida 
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Session  Overview  for  Friday 


Division 


Time 


B 

c 

B 

E 

F 

G 

H 

1 

j 

K 

Inter-Division 

Midwest  Hospitality 

B 

B 

B 

B 

✓ 

mm 

8:00-9:30 


8:30-9:50 


10:00-4:00 


Exhibits 


10:00-10:50 


President's  Address  - Barbara  Piake 


11:00-11:50 


General  Business  Meeting/Graduate  Student  Awards 


12:00-1:50 


Luncheon  - Tony  Riccio,  invited  Speaker 


2:00-3:00 


✓ ✓✓ 


3:10-4:30 


4:40-6:00 


✓ ✓ 


9:00-???? 


President's  Reception 


F.1.1  Midwest  Hospitality  Coffee  and 
Friends 

8:00-9:30  — LINCOLN 
Organizer:  Charles  Anderson,  ETS  (Ret.)  and 
MWERA,  Executive  Officer 

F.2. 1 How  Abstract  Representations 
Facilitate  a Variety  of  Learning 
Outcomes 

8:30-9:50  — Medill 
Division  C Symposium 

Organizer:  Kenneth  A.  Kiewra,  University  of 
Nebraska 

Chair:  Judith  G.  Lambiotte,  Texas  Christian 
University 

Participants: 

Joel  R.  Levin,  University  of  Wisconsin 
Nelson  F.  Du  Bois,  SUNY  Oneonta 
Kenneth  A.  Kiewra,  University  of  Nebraska 
Daniel  H.  Robinson,  University  of  Nebraska 

Discussant:  Judith  G.  Lambiotte,  Texas  Christian 
University 


F.2.2  Reform  and  Restructuring  Schools 

8:30-9:50  — 7 ARLOR  A 
Division  A Paper  Session 

Chair:  Linda  Hayes,  University  of  Akron 

The  Reform  Movement:  A Fifty-State  Summary  of  State 

Actions  for  Personnel  Evaluation 

Carol  B.  Furtwengler,  Wichita  State  University 

T he  Impact  of  an  Educational  Accountability 
Mechanism  on  an  Ohio  School  District’s  Policy  and 
Practices : A Case  Study 
Reene  A.  Alley,  University  of  Akron 

A Conceptual  Model  for  Systemic  School  Restructuring: 
Intersection  of  Systemic,  Historical,  and  Futurological 
Perspectives 

In-Slook  Lee,  Indiana  University 

Discussant:  Robert  Estabrook,  Indiana  State 

University 
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F.2.3  Multicultural  and  Global 

Perspectives  of  Curricular  Issues 

8:30-9:50  — PARLOR  B 
Division  B Paper  Session 

Chair:  Rose  Mary  Scott,  University 
Wisconsin-Parkside 

Multicultural  Education  K-12:  District  Level  Initiatives 

Linking  School  and  Community 

Gloria  T.  Alter,  Northern  Illinois  University 

Jack  Barshinger,  DeKalb  Public  Schools 

The  Effect  of  Socioeconomic  levels  and  Similar 
Instruction  on  Scholastic  Aptitude  Test  Scores  of  Asian, 
Black,  Hispanic,  and  White  Students 
Rex  W.  Bolinger,  Ball  State  University 

Global  Perspectives:  Identifying  Existing  Attitudes  as  a 
Prerequisite  to  Curriculum  Development 
Barbara  G.  Ludwig,  Ohio  State  University 

Discussant:  Rose  Mary  Scott,  University  of 
Wisconsin-Parkside 


F.2.4  African  American  Male  Academies: 
Definitive  Questions  and  Answers 

8:30-9:50  — PARLOR  C 
Division  E Invited  Symposium 

Chair  & Organizer:  Thomas  E.  Midgette,  University 
of  Arkansas 

Presenters: 

Nudie  E.  Williams,  University  of  Arkansas 
Mary  Ann  Flowers,  Cleveland  State  University 
Robbie  Steward,  Michigan  State  University 
Isaiah  Sessoms,  Clarion  University  of  PA 
Lloyd  Leake,  Gonzaga  University 

F.2.5  Parental  Involvement  and 
Environmental  Issues 

8:30-9:50  — PARLOR  E 
Division  G Paper  Session 

Chair:  Charles  C.  Wilson,  University  of 
W isconsin-Oshkosh 


Low  Level  Electromagnetic  Fields:  A Possible  Vexation 
for  Effective  Learning 

Roger  N.  Carlsen,  Cheryl  L.  Bogen,  University  of 
Dayton 

’Honey,  go  get  your  computer  for  these  people.  A 
qualitative  study  of  low  income  families  with  good 
readers 

Carolyn  F.  Chryst,  Nolan  J.  Weil,  David  F.  Lancy, 
University  of  Toledo 

Causes  Underlying  Minimal  Parent  Involvement  in  the 

Education  of  their  Children 

David  J.  Dwyer,  Jeffrey  B.  Hecht,  Illinois  State 

University 

Teaching  AIDS  Prevention  Through  Classroom 
Instrument  Development  and  Research 
Bobbie  M.  Anthony,  Chicago  State  University 


F.2.6  Research  in  the  Professions:  Scope 
and  Content 

8:30-9:50  — Parlor  F 

Division  I Paper  Session 

Chair:  Ayres  G.  D’Costa,  Ohio  State  University 

Attitudes  of  Medical  Practitioners  Toward  Peer  Review 

Bruce  G.  Rogers,  P.  J.  Porter,  Gerald  Bisbey, 
University  of  Northern  Iowa 

Personality  and  Success  Among  Stockbrokers 

Jaime  M.  Dodd,  Karen  D.  Multon,  University  of 
Missouri-Columbia 

Interjudge  Reliability  and/or  Decision  Reproducibility 
Mary  E.  Lunz,  John  Stahl,  American  Society  of 
Clinical  Pathologists 

Validity  of  the  Restructured  Part  II  National  Board 
Dental  Examination 

Gene  A.  Kramer,  David  R.  DeMarais,  American 
Dental  Association 

Discussant:  Bonnie  J.  Jones,  Northeastern  Ohio 
Universities  College  of  Medicine 
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F.2.7  Influences,  Traits,  and  Politics  in 
Higher  Education 

8:30-9:50  - PARLOR  D 
Division  J Paper  Session 

Chair:  Sonja  J.  Smith,  Mount  Vernon  Nazarene 
College 

Charismatic  Traits  of  Future  Educational  Leaders 
Ana  Gil-Serafin,  Western  Michigan  University 

Disciplinary  Influences  on  Faculty  Perceptions  of  the 
Chair’s  Role  in  Facilitating  Tenure 
Fran  Daly,  Loyola  University  of  Chicago 

Discussant:  Sonja  J.  Smith,  Mount  Vernon  Nazarene 

College 


F.3.1  EXHIBITS 

10:00-4:00  — Lincoln 

The  MWERA  exhibits  are  unlike  other  convention 
exhibits.  This  is  a chance  to  meet  area  publishers  and 
their  editors  personally.  Not  only  can  you  find  out 
what  is  currently  published,  but  talk  about  your 
publication  plans,  and  resources  you  need.  Previous 
exhibitors  have  thanked  us  for  the  opportunity  to  talk 
with  our  members  and  get  valuable  ideas.  Exhibits 
only  run  for  one  day,  so  plan  your  day  to  give  yourself 
time  to  see  the  books  and  materials,  and  meet  the 
publishers. 

F.4.1  PRESIDENT'S  ADDRESS  Teachers' 
; ; Assessment  Literacy 

10:00^10:50  -^Maximilian 

Introduction:  Richard  C.  Pugh 

Indiana  University 

Address:  Barbara  Flake 

University  of  Nebraska 

F.5.1  General  Business  Meeting-All 
MWERA  Members 

1 1:00- 11:50  — MAXIMILIAN 


award.  The  awards  will  be  drawn  at  the  Business 
Meeting  through  a random  process  and  the  student  must 
be  present  to  win.  The  award  will  provide  MWERA 
membership  for  the  following  year,  a fee  waiver  for  the 
next  conference,  and  a certificate  of  recognition.  No 
more  than  three  awards  will  be  drawn.  This  is  a 
Graduate  Student  Research  Incentive  Program 
supported  jointly  by  MWERA  and  the  Wisconsin 
Education  Research  Association.  The  awards  will  be 
presented  by  Ayres  G.  D’Costa,  Immediate  Past 
President  MWERA. 

F^6.>  1~. 

1 3:00—  ifSO^-L  WALNUT  Room 

Introduction:  John  J.  Kennedy,  |i:: 

: fffH Ohio  State  University  L : 

Speaker::  Tony  Riccio,  Ohio.  State  University  ; 

Titlef  M^hg^Big  Decisions!  f-f:  ■■■■!} . 

All  registrants  are  invited  to  attend; ; : 

Badge controls adriusskhrll  Arrahgef  fof  pickup;  through 
pre-regisfration:  Badges jdso  j^epat 

F.7.1  Supervision 

2:00-3:00  — Medill 
Division  K Paper  Session 

Chair:  John  Laut,  Ohio  State  University 

Supervision  of  the  Early  Field  Experiences  of  Preservice 
Teachers— Exploring  Alternative  Models 

Frank  Kline,  Dennis  E.  Potthoff,  Wichita  State 
University 

The  Qinical  Supervision  Cycle:  A Component  of  Staff 
Development  Programs 

Susan  R.  Cramer,  Ruth  A.  Koskela,  University  of 
Wisconsin-Oshkosh 

The  Third  Ear  Mechanical  Device:  A Pilot  Study 
Carmen  R.  Giebelhaus,  Josue  Cruz,  Ohio  State 
University 


Graduate  Student  Awards.  Any  graduate  student 
registered  for  the  conference  as  a graduate  student,  and 
presenting  at  the  conference,  will  be  eligible  for  an 
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F.7.2  Assessment 

2:00-3:00  — Parlor  A 

Division  K Paper  Session 

Chair:  Dan  Keller,  Ohio  State  University 

An  Evaluation  of  Elementary  Inservice  Training  for 
Holistic  Assessment 

Deborah  L.  Bainer,  Frances  D.  Porter,  Ohio  State 
University-Mansfield 

Teacher  Concerns  with  the  Implementation  of  Holistic 
Scoring 

Frances  D.  Porter,  Deborah  L.  Bainer,  Ohio  State 
U niversity-Mansfield 

Three  Factors  Affecting  Students’  Disruptive  Behavior 
in  a Middle  School  Classroom 

Jeanne  M.  Brown,  Claudia  M.  Keller,  Sylvia  A. 
Legg,  Christine  R.  Lentz,  Linda  Bakken,  Wichita 
State  University 

F.7.3  What  is  the  Value  of  Vignettes  and 
Cases  in  Professional  Educator 
Preparation  Programs? 

2:00-3:00  — Parlor  B 

Inter-Division  Symposium 

Organizer  and  Chair:  Dennis  C.  Zuelke,  Jacksonville 

State  University 

Presenters: 

Dennis  C.  Zuelke,  Jacksonville  State 
University 

William  Taglia,  Chicago  Public  Schools 

Discussant:  Marvin  Willerman,  Northeastern  Illinois 
University 


F.7.4  Classroom  Strategies 
2:00-3:00  — Parlor  D 

Division  H Paper  Session 

Chair:  Albert  M.  Bugaj,  University  of  Wisconsin 
Center-Marinette  County 

The  Effect  of  Time  in  Integrated  Learning  Systems  (ILS) 
as  a Ratio  Scale  of  Measurement  on  Algebra 
Achievement 

Robert  West,  Dearborn  Public  Schools,  Michigan 
Donald  Marcotte,  Wayne  State  University 


Student  Outcomes  Under  Incentive  Pay  Plans:  Teacher 
Perceptions 

Nancy  DeFrates-Densch,  Cory  Cummings,  Thomas 
O.  Schrader,  Northern  Illinois  University 

Applying  Qualitative  Methods  to  Multicultural 
Education : An  Example 

Carolyn  Bohlen,  Leon  Liddell,  Northern  Illinois 
University 


F.7.5  Substance  Abuse 

2:00-3:00  — Parlor  E 

Division  G Paper  Session 

Chair:  Roger  N.  Carlsen,  University  of  Dayton 

A Two  Year  Study  of  Substance  Use  Among  Secondary 
Students:  Analysis  of  Employment  /4s  a Variable 
Jay  C.  Thompson,  Jr.,  C.  Van  Nelson,  Ball  State 
University 

Van  E.  Cooley,  Westfield  Washington  Schools 

A profile  of  students  engaged  in  substance  abuse 

C.  Van  Nelson,  Jay  C.  Thompson,  Jr.,  Ball  State 
University 

Van  E.  Cooley,  Westfield  Washington  Schools 

A Study  to  Determine  the  Effect  of  Extracurricular 
Participation  on  Student  Alcohol  and  Drug  Use  in 
Secondary  Schools 

Van  E.  Cooley,  Westfield  Washington  Schools 
C.  Van  Nelson,  Jay  C.  Thompson,  Jr.,  Ball  State 
University 


F.7.6  American  Schools  and  the 
Educational  Community 

2:00-3:00  - Parlor  F 

Division  F Paper  Session 

Chair:  Nelson  Strobert,  Gettysburg  Lutheran 
Seminary 

The  Advancement  of  Museums  into  the  Educational 
Community:  A Historical  Perspective 
Betsy  Feldkamp,  Ohio  State  University 

Science  in  American  School  Readers  of  the  Nineteenth 
Century 

Peter  Rillero,  Ohio  State  University 
Discussant:  Fred  W.  Buddy,  Spelman  College 
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F.7.7  Post-Secondary  Instructional 
Strategies 

2:00-3:00  — Maximilian 
Division  K Paper  Session 

Chair:  Kim  K.  Metcalf,  Indiana  University 

Does  Extending  Wait-Time  Increase  Learning  by 
College  Students 

Orpha  K.  Duel!,  Wichita  State  University 

The  Effects  of  Changing  the  Criteria  for  STAD  Team 
Awards  at  Midterm:  Two  Parallel  Experiments 
William  J.  Gnagey,  Kimberly  Ostrowski,  Illinois 
State  University 

A Construct  Validation  of  tlx  Motivated  Strategies  for 
Learning  Questionnaire  (MSLQ) 

Ronald  C.  McClendon,  Isadore  Newman,  University 
of  Akron 


F.8.1  Issues  in  Professional  Development 
and  Restructuring 

3:10-4:30  — Med  ill 
Division  H Paper  Session 

Chair:  Gary  Shank,  Northern  Illinois  University 

A Study  of  the  Perceptions  of  Collaborative  Partners  in 
a Professional  Development  School  Project 
Janice  L.  Hall,  Indiana  State  University 

Evaluation  of  a State  Educational  Reform  Summer 
School  Program 

Theresa  Strand,  Educational  Testing  Service 

Performance-Based-Pay : What  Do  Teachers  and 
Administrators  Think? 

Thomas  O.  Schrader,  Cory  Cummings,  Nancy 
DeFrates-Densch , Northern  Illinois  University 

University-School  Collaboration  for  Formative 
Evaluation  of  a Restructuring  Process:  What  Does  This 
Mean  for  All  of  Us? 

In-Sook  Lee,  Indiana  University 


F.8.2  Students  in  Our  Schools 

3:10-4:30  — PARLOR  A 
Division  A Paper  Session 

Chair:  Hazel  H.  Loucks,  Southern  Illinois 
University-Carbondale 

A Qinical  Observation  Instrument  for  Cooperative 
Learning  Classrooms 

Carol  B.  Furtwengler,  Wichita  State  University 

High  School  Students  Who  Lead:  Congressional 
Futures  Forum 

Pearlmarie  W.  Goddard,  University  of  Akron 

Administering  a Parent  Involvement  Program:  Effect 
Upon  Fourth  Grade  Student  Achievement 
Charles  E.  Kline,  Purdue  University 
Albert  L.  Long,  Western  Boone  County  Community 
School  Cooperation 

Discussant:  Jane  W.  Andringa,  Governor’s  State 
University 


F.8.3  Methods  of  Inquiry  in  Higher 
Education 

3:10-4:30  — Parlor  B 
Division  J Paper  Session 

Chair:  Craig  Deville,  Ohio  State  University 

A Multimethod  Approach  to  Student  Feedback  of 
Instruction 

Neil  E.  Prokosch,  National-Louis  University 

The  Factor  Structure  of  the  Rosenberg  Self-Esteem 
Scale  and  the  Mooney  Problem  Checklist 
Peggy  Woodard,  David  E.  Suddick,  Governors  State 
University 

Anthony  White,  Georgia  State  University 

Perry ’s  Scheme  of  Intellectual  and  Ethical 
Development:  Its  Implications  and  Correlates  in  a 
Vocationally  Undecided  Population 

Hedy  J.  Jones,  Isadore  Newman,  John  R.  Cochran, 
William  E.  Nemec,  University  of  Akron 


Discussant:  Craig  Deville,  Ohio  State  University 
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F.8.4  AIDS  Prevention  for  Women:  An 
Overview  of  the  Preliminary  Results 
from  an  NIMH  Research  Project 
with  Emphasis  on  Multicultural  and 
Social  Influences 
3:10-4:30  — Parlor  C 

Division  E Symposium 

Organizer:  Paula  J.  Britton,  Kent  State  University 

Chair:  Anita  P.  Jackson,  Kent  State  University 

Presentation  of  Preliminary  Statistical  Findings 
Paula  J.  Britton,  Kent  State  University 

Strategies  for  Empowering  Women  in  the  Prevention  of 
HIV/AIDS 

Anita  P.  Jackson,  Kent  State  University 

African-American  Women  and  AIDS 
Tammy  James,  Kent  State  University 

Hispanos  F AIDS 

Evelyn  Orozco,  Kent  State  University 

Women  in  Various  Roles  and  AIDS 

Colleen  D.  Character-Gibbons,  Kent  State  University 


F.8.5  Measurement:  Predicted  Validity 

3:10-4:30  — Parlor  D 
Division  D Paper  Session 

Chair:  Ayres  G.  D’Costa,  Ohio  State  University 

Age  and  Gender  as  Factors  Influencing  Student 
Perceptions  of  Instructor  Effectiveness 

Elizabeth  L.  Harris,  Stephanie  L.  Brand,  Elmer  A. 
Lemke,  Illinois  State  University 

Psychometric  Adaptations  of  Cognitive  Tests: 
Applications  to  Assessment  of  Dementia 
Evelyn  Z.  Becker,  Ayres  G.  D’Costa,  Ohio  State 
University 

The  Predictive  Validity  of  Paper-folding  Spatial-ability 
Items 

Gene  A.  Kramer,  Chang  Y.  Miao,  American  Dental 
Association 

Discussant:  Patricia  Elmore,  Southern  Illinois  State 
University 


F.8.6  Contextual  and  Educational  Issues: 
Cooperative  Learning,  Grading,  and 
Cases 

3: 1 0-4:30  — Parlor  E 

Division  G Paper  Session 

Chair:  Barbara  J.  Leys,  National-Louis  University 

Illuminating  Educational  Contexts:  Preservice 
Preferences  for  Visual  Case  Studies 
Mary  R.  Sudzina,  University  of  Dayton 

Guidelines  for  Determining  Language  Arts  Grades  for 

Students  with  Learning  Disabilities 

Linda  M.  Lakin,  Roger  N.  Carlsen,  University  of 

Dayton 

Cooperative  Learning  and  Preservice  Education 
Christine  L.  Channer-Dugan,  Utica  College  of 
Syracuse  University 

Cooperation  Learning:  We  Need  to  Model  the  Model  in 

Preservice  Teacher  Education 

M.  Jean  Bouas,  Northwest  Missouri  State  University 


F.8.7  Historical  Influences  and  the  Normal 
School 

3:10-4:30  —PARLOR  F 
Division  F Paper  Session 

Chair:  Donald  R.  Castle,  Ashland  University 

The  Cleveland  Normal  School,  1874-1936 
Melinda  Kline,  Brunswick  City  School  District,  Ohio 
Charles  M.  Dye,  University  of  Akron 

Rockefeller  and  General  Education  Board  Influences  on 
Vocationaiism  in  Education,  1880-1925 
Louise  E.  Fleming,  Ashland  University 
Rita  S.  Saslaw,  University  of  Akron 

Discussant:  Fred  W.  Buddy,  Spelman  College 


F.8.8  Research  Studies:  Topical  Potpourri 

3:10-4:30  — Maximilian 

Inter-Division  Paper  Session 

Chair  & Discussant:  William  J.  Boone,  Indiana 
University 
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Social  Justice  and  the  Valued  Concepts  of  Right  and 

Wrong  in  Strong  Social  Groups 

Eddie  Frecker,  Unaffiliated 

Presenting  for  the  Author:  Lynne  M.  Hudson, 

University  of  Toledo 

Educational  Administrators  ’ and  Teachers  ’ Knowledge 
of  Assessment  Practices 

James  C.  Intpara,  Barbara  Plake,  Jennifer  J.  Fager, 
University  of  Nebraska 

Protecting  Children  at  Play:  A Study  of  Alarmed  Toys 

William  E.  Loadman,  Micheline  B.  Chalhoub,  Ohio 
State  University 


F.9.1  Multicultural-B 

4:40-6:00  — Medill 
Division  K Paper  Session 

Chair:  Linda  Morrow,  Ohio  State  University 

A Multicultural  Undergraduate  Teacher  Preparation 
Experience 

Kathleen  Maury,  Mankota  State  University 
Rose  Mary  Scott,  University  of  Wisconsin-Parkside 

Preservice  Teachers  ’ Perceptions  and  Sensitivities  to 
Multicultural  Classroom  Concerns:  A Self-Inventory 
Mary  Ann  Flowers,  Cleveland  State  University 

Preservice  Education’s  Need  for  and  Developmental 
Approach  to  a Multicultural  Educational  Perspective  for 
Today’s  Pluralistic  Society 
Marsha  M.  Hutchins,  Ohio  State  University 

A Descriptive  Study  of  Successful  African  American 
Students  Who  Persisted  to  Graduation  in  a Teacher 
Education  Program 

Carol  P.  Felder,  Joyce  E.  Killian,  Southern  Illinois 
University-Carbondale 


F.9.2  Science 

4:40-6:00  — Parlor  A 
Division  K Paper  Session 

Chair:  Dan  Keller,  Ohio  State  University 

An  Abstract  Content  Analysis  of  Journals  for  Science 
Teachers 

Peter  Rillero,  Kim  Roempler,  Ohio  State  University 


A Review  of  the  Literature  of  College  Level  Science 
Courses  for  Preservice  Teachers 
Betsy  Feldkamp,  Ohio  State  University 

Knowledge  of  Elementary  Science  Pedagogy  at  the 
Preservice  Level 

Beth  A.  Wiegmann,  Rene  T.  Stofflett,  Northern 
Illinois  University 

Evaluating  and  Improving  a Science  Methods  Course 
for  Elementary  Teachers  in  Training 
William  J.  Boone,  Indiana  University 


F.9.3  Cultural  and  Moral  Attitudes  and 
Education 

4:40-6:00  — PARLOR  B 
Division  G Paper  Session 

Chair:  Ruth  Ravid,  National-Louis  University 

A Descriptive  Study  of  Community-Based  Programs  of 
Values  Education  Emerging  from  State-Sponsored 
Guidelines 

Santiago  Cueto,  Daniel  Mueller,  Indiana  University 

The  Hmong  and  American  Education:  Promise  and 
Problems 

Joan  S.  Timm,  University  of  Wisconsin-Oshkosh 

Caucasian-American  and  Chinese-Ameri  can  Children 's 
Attitudes  Toward  Schoolwork  and  Learning 
Jupian  J.  Leung,  Daniel  O.  Lynch,  J.  Gordon 
Nelson,  University  of  Wisconsin-Oshkosh 


F.9.4  Learning  and  Cognition 

4:40-6:00  — Parlor  C 
Division  C Paper  Session 

Chair:  John  R.  Surber,  University  of 
Wisconsin-Mil  waukee 

Do  Students  Who  Prefer  To  Learn  Alone  Achieve  Better 
Than  Students  Who  Prefer  To  Learn  With  Peers? 

James  Wallace,  Manhattan  College 

Schematic  Influences  on  the  Comprehension  of  AIDS 
Education  Materials 

Kathryn  J.  Quick,  Thomas  Andre,  Iowa  State 
University 
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Assessing  Understanding  in  School-aged  Children 
Lori  C.  McKinney,  Buford  E.  Wilson,  Governors 
State  University 

Logo  Meta-analytic  Review  of  Elementary  Level  Effect 
Size  Research 

Dwight  A.  Morrison,  Duluth  Public  Schools  & 
University  of  Minnesota-Duluth 

Discussant:  John  R.  Surber,  University  of 

Wiscons  in-Milwaukee 

F.9.5  Innovative  Approaches  in 
Counseling  Practice  and 
Assessment 

4:40-6:00  — PARLOR  E 
Division  E Paper  Session 

Chair:  Paula  J.  Dupuy,  University  of  Toledo 

Personality  Characteristics  of  Practitioner  versus 
Scientist-Practitioner  Oriented  Psychology  Graduate 
Students 

Karen  D.  Multon,  Christine  Pupo,  University  of 
Missouri-Columbia 

Research  Study  on  Perspectives  of  Pennsylvania  First 
Year  University  ACT  101  Students  and  their  High 
School  Teachers 

Isaiah  Sessoms,  Charles  Dukes,  Clarion  University  of 
PA 

Using  Student  Self-Assessment  in  an  Interdisciplinary 
Training  Program 

Judith  M.  Hudgins,  Kent  State  University 

Assessing  the  Impact  of  an  Academic  Counselor 
Training  Program:  The  Development  of  Faculty  One 
Step  Beyond  the  Role  of  Advisor 
Edward  D.  Kapraun,  University  of  Arkansas 
Doris  W.  Coldren,  Pennsylvania  State 
University-Fayette  Campus 

Discussant:  E.  Jean  Harper,  Dayton  Public  Schools 


F.9.6  The  Corporate  Model  and  Education 
in  America 

4:40-6:00  — Parlor  F 
Division  F Session 

Chair:  Nelson  Strobert,  Gettysburg  Lutheran 
Seminary 

The  Influence  of  the  Corporate  Model  on  American 
Education  During  the  Twentieth  Century 
Donald  R.  Castle,  Ashland  University 

An  Historical  Overview 

Charles  M.  Dye,  The  University  of  Akron 

Discussant:  Nelson  Strobert,  Gettysburg  Lutheran 

Seminary 

F.9.7  Division  D Invited  Speaker 

4:40-6:00  — Maximilian:  ; 

Chair:  Robert  S.  Barcikowski,  Ohio  University 

Issues  in  Multivariate  Analysis 
James  Stevens,  University  of  Cincinnati 

F.10.1  President's  Reception:  Wine  and 
Cheese 

9:00-????  — Regency  Suite 

Hosted  by:  Barbara  Plake 

President  MWERA 
University  of  Nebraska 

Arrangements:  Adria  Karle-Weiss,  University  of 
South  Florida 

All  registrants  are  invited  to  attend 
Please,  no  smoking 
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Session  Overview  for  Saturday 


Division 

Time 

D 

B 

c 

D 

E 

F 

G 

H 

■ 

n 

K 

Special  Graudate  Student 
Sessions 

7:00-8:00 

Fun  Run/Walk/Craw!  ;; 

8:00-9:30 

Midwest;  Hospitality  ; - 

9:00-10:30 

n 

n 

a 

MM 

n 

a 

✓ 

10:40-12:00 

n 

■ 

■ 

D 

n 

✓ 

1:00-3:00 

Executive  Committee  Meeting 

S.1.1  FUN  RUN-2  Miles 

7:00  a.m.  — Chicago  Yacht  Club,  Monroe 
Street  and  Lake  Shore  drive 

Run  Director:  Kenneth  A.  Kiewra,  University  of 
Nebraska 


S.2.1  Midwest  Hospitality  Coffee  and 
Friends 

8:00-9:30  — Maximilian 

Organizer:  Charles  Anderson,  ETS  (Ret.)  and 
MWERA,  Executive  Officer 


S.3.1  Politics  in  Higher  Education:  A 
Cross-Issue  Analysis 

9:00-10:30  — PARLOR  A 
Division  J Paper  Session 

Chair:  Edward  R.  Hines,  Illinois  State  University 

Political  Maneuvering  of  a Board  of  Trustees 
Patricia  Kay  Adkins,  Moraine  Valley  Community 
College 

The  Governance  of  Adult  Education 

Philip  Bobich,  Moraine  Valley  Community  College 

The  Third  Airport  and  Higher  Education 
Charles  I.  Jenrich,  Prairie  State  College 

To  Join  or  Not  To  Join:  Beecher's  Political  Dilemma 
Joan  M.  Simon,  Prairie  State  College 


Discussant:  Edward  R.  Hines,  Illinois  State 
University 

5.3.2  An  Evaluation  of  the  Perceived 
Effectiveness  of  Local  School 
Councils 

9:00-10:30  — Parlor  B 

Division  H Symposium 

Chair:  Crystal  Hawkins,  Northern  Illinois  University 

Participants: 

Crystal  Hawkins,  Northern  Illinois  University 
-Karen  D.  Bar  bee- Dixon,  Northern  Illinois 
University 

Jocelyn  Nichols,  Northern  Illinois  University 
Christopher  Shaw,  Northern  Illinois  University 

5.3.3  Effects  of  Text  Organization  and 
Representation  on  Learning  and 
Recall 

9:00-10:30  — Parlor  C 

Division  C Paper  Session 

Chair:  Alice  J.  Corkill,  University  of  Nevada-Las 
Vegas 

How  Prose  Goes:  Varying  the  Topical  and  Structural 

Organization  of  Prose 

Daniel  H.  Robinson,  Kenneth  A.  Kiewra,  University 

of  Nebraska 
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Application  and  Transfer  of  a Mnemonic  Strategy 
Beverly  Dretzke,  University  of  Wisconsin-Eau  Claire 
Joel  R.  Levin,  University  of  Wisconsin-Madison 

Using  Supplemental  Representations  to  Learn  Operant 
Concepts 

Jeffrey  L.  Bayer,  Kenneth  A.  Kiewra,  University  of 
Nebraska 

Effects  of  Whole  Versus  Stacked  Maps  as  Study  Aids 
Judith  G.  Lambiotte,  Texas  Christian  University 

Discussant:  Alice  J.  Corkill,  University  of 

Nevada-Las  Vegas 


5.3.4  Monte  Carlo  Methods  in 
Educational  Statistics  and 
Measurement 

9:00-10:30  — Parlor  D 
Division  D Symposium 

Chair:  Elizabeth  Randolph,  Ohio  University 

Presenters: 

Elizabeth  Randolph,  Ohio  University 
George  Johanson,  Ohio  University 
Shu-Yuan  Chang,  Ohio  State  University 
Ronald  Elliott,  Ohio  University-Chillicothe 

5.3.5  Topics  in  Special  Education 

9:00-10:30  — Parlor  E 
Division  E Paper  Session 

Chair:  Mary  Ann  Flowers,  Cleveland  State  University 

A Comparative  Investigation  of  the  Differential  Effects 
of  American  Sign  Language  and  Total  Communication 
on  Story  Comprehension  and  Memory  in  Deaf  Children 

James  Altenbach,  Ronald  R.  Morgan,  Loyola 
University  of  Chicago 

Paraprofessionals  in  Special  Education:  Trends  and 
Issues 

David  E.  Suddick,  Jane  W.  Andringa,  Governors 
State  University 

Anthony  J.  White,  Georgia  State  University 


Sequt  nee  of  Rendering  Assistance  to  Three  Groupings 
of  Stwlents  Identified  as  Eligible  for  Special  Education 
and  Parental  Satisfaction  with  Services  Rendered 
Jane  W.  Andringa,  David  E.  Suddick,  Governors 
State  University 

Discussant:  Carolyn  M.  Dejoie,  University  of 
Wisconsin-Madison 

S.3.6  ^Mentoring  as  a Component  of  the 
:;:;jiftrofesslon^[  Developiment  i of  : 

;;  v:Gralduate;:^^dents: 

' :3:OQ-1pi3O0^^ 

Inter-Division  Symposium 
Organizer  and  Chair: 

: : i^i  J>  Nebelsick-GuHett,  University  of  •; 
•Nebraska 

Faculty  Perceptions -of  thefAferfforihg  Process)  f. 

Rayne  Sperling  Dennisrm,  University  of  Nebraska 

Mentoring  iff  Graduate  Education  in  Psychology  [ff 
Mark  Larking  Uriiversi^  of  Missburi-Columbia  j f : 

Fitriikg  the  balance  in  Mentoring:  A Stiident *s ; .« 
Perspective ;•'•:••  •••"••4" 

Wendy  Naumann-Sandoval,  University  of  Nebraska 

The  Mentoring  Relationship  in  Academia:  What  It  is 
and  Who  It  Benefits  \ • 

TYacy  Thorrtdike^Christ,  University  of  Nebraska;  ; 

Discussants: ; 

Leslie  Eastman  Lukin,  University  of 
Missouri-Coluiribia 
Dennis  W.  Leitner,  Southern  Illinois 
University-Carbondale 


S.3.7  1992  Program  Committee  and 
1993  Program  Chair 

9:00-10:30  — Lincoln 

Organizer:  Richard  C.  Pugh,  Indiana  University 
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5.4.1  Conceptual  Change,  Problem 
Solving,  and  Expertise 

10:40-12:00  — Medill 
Division  C Paper  Session 

Chair:  CarolAnne  M.  Kardash,  University  of 
Missouri-Columbia 

Transforming  Knowledge:  Six  Case  Studies  of 
Conceptual  Change  in  a Sixth  Grade  Matter  and 
Molecules  Unit 

Nancy  J.  Fellows,  Northeastern  Illinois  University 

Learning  from  Scientific  Text:  Conceptual  Change  vs. 
Didactic  Approaches 

Sharon  K.  Chambers,  Thomas  Andre,  Iowa  State 
University 

The  Development  of  Probabilistic  Reasoning  in 
Children 

Janet  K.  Sheehan,  John  T.  M'ouw,  Southern  Illinois 
University-Carbondale 

An  Examination  of  Expertise  in  Teaching:  A Definition 
of  Expertise  and  the  Comparison  of  Differences  in 
Solving  Qassroom  Management  Problems 
Jennifer  J.  Fager,  Gregg  Schraw,  University  of 
Nebraska 

Alice  J.  Corkill,  University  of  Nevada-Las  Vegas 

Discussant:  CarolAnne  M.  Kardash,  University  of 

Missouri-Columbia 

5.4.2  Evaluation  of  the  Drug  Free 
Schools  and  Communities  Act: 
School  and  Community 
Perspectives— Summary 

10:40-12:00  — Parlor  A 
Division  H Symposium 

Organizer:  Cecelia  A.  McFadden,  University  of 
Chicago 

Chair:  Geraldine  L.  Oberman,  Chicago  Public 
Schools 

Presenters: 

Cecelia  A.  McFadden,  University  of  Chicago 
Rosanne  A.  Paschal,  Northern  Illinois 
University 

John  W.  Payton,  University  of  Chicago 
Patricia  Zaror-Feller,  Chicago  Public  Schools 


Discussants: 

Bernadette  Strykowski,  University  of  Illinois 
at  Chicago 

Lawrence  Whitman,  Midwest  Center  for 
Drug-Free  Schools  & Communities 

S.4.3  Teaching  and  School  Effects 

10:40- 12:00  — PARLOR  F 
Division  K Paper  Session 

Chair:  Deborah  L.  Bainer,  Ohio  State 
University-Mansfield 

Teacher  Motivation  and  Work  Performance 
Donald  L.  Haefele,  Craig  A.  Mertler,  Ohio  State 
University 

The  Practitioner’s  View  of  Goodlad’s  Postulates 
David  E.  Suddick,  Leon  J.  Zalewski,  Governors  State 
University 

Critical  Abilities  of  Teaching  Within  the  Preservice 
Teacher  Curriculum  - What  Do  We  Know  and  What 
Should  We  Know  to  Enhance  Classroom  Teaching? 

Dan  Keller,  John  Laut,  Ohio  State  University 

S.4A  ySPECIAL  WORKSHOP 

: Obtaining  and  Surviving  the  First 
: ; i i;:  Faculty  Position  *(No  cost  for  graduate 
students)  :\f\. 

10:40-1 2:00  riopfi  •—  Lincoln 

. Workshop E h :.H ■' :v  '■%  ;}f  ' ■ : 

Presenters:  :\v  •••;;.• 

• Kim  K.  Metcalf,  Indiana  University 
Martha  A.  Wilson,  Capital  University 
■f:  Andrew^ ^-ILim^j  .-^iuvemity'  of  Toledo 

Discussant:  Judy  L.  Genshaft,  Dean,  College  of 
Education,  SUNY  Albany 


S.5.1  Executive  Committee  Meeting 

1:00-3:00  — Regency  Suite 
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Abstracts  and  Papers 

Abstracts  of  papers  presented  at  the  1992  Annual  Meeting  are  published  separately  and  will  be  available  to  all 
Conference  Participants  (at  no  cost)  at  the  Registration  Desk  at  the  Bismarck  Hotel  Lobby  during  Registration  hours. 
Additional  copies  may  be  ordered  from  the  Executive  Officer,  Charles  Anderson,  at  a cost  of  $3.00  to  cover  prepaid 
postage  and  handling. 

Papers  presented  at  the  1992  Annual  Meeting  are  eligible  for  inclusion  in  the  ERIC  System.  A form  with 
instructions  is  available  at  the  Registration  Desk.  Participants  are  encouraged  to  use  this  opportunity  to  achieve 
greater  exposure  for  their  research. 


m 


1933  Annual  Meeting 

Next  year’s  Annual  Meeting  will  be  held  at  the  Bismarck 
Hotel  in  Chicago  from  Wednesday,  October  13  through 
Saturday,  October  16. 

Program  chairs  are  needed  as  are  volunteers  to  help  with 
other  aspects  of  conference  planning.  Interested  individuals  are 
encouraged  to  contact  the  1993  program  chair. 

Thomas  Andre 
Department  of  Psychology 
W112  Lagomarcino 
Iowa  State  University 
Ames,  IA  50011 

Suggestions,  ideas  and  comments  related  to  the  1993  program 
are  also  welcome. 


Plan  now  to  attend! 
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As  we  begin  our  final  year  as  editors,  we  encourage  the  continued  involvement  by  the  membership  in  “your'’ 
journal.  We  have  seen  an  increase  in  the  quantity  and  quality  of  manuscripts  submitted  and  hope  that  this  trend 
will  continue.  This  issue  includes  some  letters  to  the  editors  as  well  as  a review  of  the  Spring  1992  special  multi- 
cultural education  issue  of  the  Mid-Western  Educational  Researcher.  Both  were  unsolicited,  but  welcomed.  Please 
continue  to  communicate  your  ideas  and  concerns  to  us. 

We  encourage  the  reproduction  of  articles  in  the  MichVfeem  Educational  Researcher  for  instructional 
use.  However,  please  contact  one  of  the  editors  before  doing  so.  Commercial  reproduction  of  any  article  requires 
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Confidential  and  Privileged 
Communications:  Legal  and  Ethical 
Concepts  in  Research 

By  Costas  J.  Douvanis,  Auburn  University,  and  John  A.  Brown,  The  Citadel 


The  educational  researcher  is  faced  with  numerous  legal 
and  ethical  problems  when  attempting  to  conduct  a study  involv- 
ing human  subjects.  The  necessity  of  balancing  the  researchers 
desire  to  publish  full  and  complete  data  while  preserving  the  con- 
fidentiality of  the  research  subject  or  subjects  is  a major  problem 
that  must  be  addressed.  Human  subject  researchers  are  aware  that 
many  of  their  studies  require  full  disclosure  of  information  sup- 
plied by  their  subjects,  and  this  information  is  dependent  largely 
upon  the  researchers’  guarantee  of  subject  anonymity.  The  issue 
of  anonymity  and  confidentiality  becomes  increasingly  sensitive 
and  important  when  dealing  with  under-age  subjects.  One  need 
only  scan  professional  journals  in  the  field  of  education  to  see 
the  increasing  interest  and  research  being  done  in  areas  such  as 
AIDS  and  sexually-transmitted  diseases  among  school-age  children, 
dropouts  and  at-risk  students,  special  populations,  and  drug  and 
alcohol  abuse.  All  of  these  topics  require  full  and  complete  cooper- 
ation and  trust  between  researcher  and  subject.  It  can  be  argued 
that  this  trust  and  cooperation  is  possible  only  when  confiden- 
tiality can  be  assured. 

Confidentiality  is  a broad  term  for  that  ethical  principle 
which  determines  the  manner  in  which  information  received  by 
a researcher  is  recorded  and  disseminated.  The  concept  of  privilege 
is  frequently  included  as  a subset  of  confidentiality,  and  although 
all  privileged  communications  are  confidential,  not  all  confiden- 
tial communications  are  privileged.  A second  subset  of  this  trium- 
virate is  privacy.  Privacy  combines  both  ethical  and  legal  concepts, 
as  well  as  the  constitutional  protections  of  the  Fourth  Amendment. 
However,  this  inquiry  will  focus  primarily  on  the  nature  and  pre- 
sent legal  status  of  both  confidential  and  privileged  communica- 
tions. Specific  application  of  this  inquiry  to  educational  research 
will  also  be  addressed. 

Confidentiality  and  Privilege 

For  purposes  of  categorization,  confidentiality  is  an  ethical 
concept  while  privileged  communication  is  a legal  concept.  This 
generalization  works  well  for  this  inquiry,  although  there  is  a body 
of  case  law  which  defines  the  legal  parameters  of  confidentiality 
as  well  as  delineating  the  legal  boundaries  of  privileged  communi- 
cation. In  general,  however,  confidentiality  is  controlled  by  cus- 
tom within  the  specific  profession:  written  codes  of  ethics  and 
agreements  (written  or  oral)  hetween  the  researcher  and  the 
human  subjects  used  in  the  research  sludv.  Privileged  communi- 
cation is  strictly  defined  by  statute  and  ca*e  law.  Breaches  mnv  be 
punished  by  legal  rather  than  private  sanctions. 


Those  researchers  who  are  in  receipt  of  confidential  infor- 
mation may,  under  certain  circumstances,  be  compelled  to  reveal 
the  source  and  nature  of  that  communication.  For  example,  a 
judge  might  order  a researcher  to  reveal  information  in  the  re- 
search studies  of  minors  or  student  drug  use.  However,  recipients 
of  privileged  communications  are  not  required  to  reveal  any  aspect 
of  that  communication.  In  fact,  those  persons  breaching  privi- 
leged communications  may  be  subject  to  severe  sanctions. 

Privileged  communication  has  been  defined  by  various 
courts  and  includes  the  following  three  elements  with  court  refer- 
ences. First  of  all,  the  communication  reveals  confidential  infor- 
mation to  a person  who  has  legal  privilege  to  receive  such  com- 
munication. Specifically,  it  is  communications  w'hich  . . have  an 
element  of  confidentiality  between  the  person  holding  privilege 
and  the  person  to  whom  the  communication  is  being  made...,” 
Dan.  Secondly,  the  communication  is  one  which  under  normal 
circumstances  would,  if  revealed,  be  defamatory  or  incriminating 
(Skinner).  The  final  element  involves  the  proper  motivation  and 
circumstances  of  such  privileged  communications.  It  is  communi- 
cations which  are  . . made  upon  a proper  occasion,  from  a proper 
motive,  in  a proper  manner  and  based  on  reasonable  and  proper 
cause”  Baird. 


The  Importance  of  Confidentiality 
and  Privilege 

The  involvement  of  human  research  subjects  produces  a 
conflict  between  the  researcher’s  absolute  search  for  knowledge 
and  the  individual’s  right  to  privacy.  The  researcher’s  quest  is  to 
obtain  information  which  is  given  freclv  and  unrestrained,  while 
protecting  and  preserving  the  privacy  rights  of  the  individual. 
Candor  and  truthfulness  arc  important  statistical  considerations. 
Wigmorc  argued  that  the  purpose  of  confidentiality  in  the  law  is 
to  “...secure  freedom  from  apprehension  in  the  mind  of  the  one 
desiring  to  communicate”  (Wigmorc,  §2340,  at  670).  It  is  this  frcc^ 
dom  that  educational  researchers  must  obtain  and  encourage  to 
engage  in  meaningful  and  valid  research. 

However,  we  live  in  a litigous  society.  People  are  more  likely 
to  pursue  legal  remedies  for  alleged  wrongs  than  in  years  past. 
Although  presently,  educational  researchers  are  not  prime  targets 
for  this  litigation,  the  overall  expansion  of  legal  problems  in  many 
other  areas  and  professions  necessitate  a closer  examination  oi  the 
topic  of  “confidential  and  privileged  communications” 
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Confidential  and  Privileged  Communications  (cor  tinned) 


Methodology 

The  purpose  of  this  study  was  to  ascertain  the  status  of 
confidential  and  privileged  communications  in  educational  re- 
search and  to  determine  whether  or  not  there  exists  a common 
standard  that  would  guide  and  legally  protect  researchers  who 
use  human  subjects. 

A ( Psych  Lit ) review  of  current  social  sciences  literature 
revealed  that  researchers  in  the  disciplines  of  health  care,  psy- 
chology and  psychotherapy  have  clear,  codified  standards  and 
guidelines  regarding  the  nature  of  confidential  and  privileged  com- 
munications. Although  it  was  assumed  that  there  existed  a similar 
formalized  code  or  guidelines  for  educational  research,  a search  con- 
ducted through  ERIC,  the  Current  Index  of  Journals  in  Education , 
and  Wibons  produced  only  seven  articles  dealing  with  privilege  and 
confidentiality  in  educational  research.  These  articles  were  either 
of  such  limited  scope  (e.g.,  the  use  of  deceit  as  a research  method) 
or  dealt  with  psychological  research  as  opposed  to  educational 
research,  and  were  determined  to  be  of  no  value  for  the  topic  of 
this  study.  A review  of  the  Current  Index  of  Legal  Joumab  indicated 
a wealth  of  articles  dealing  with  the  privileged  communications  but 
only  as  related  to  the  medical  and  legal  professions  and  the  clergy. 

The  lack  of  specific  guidance  for  educational  researchers  was 
verified  by  a telephone  call  to  the  American  Education  Research 
Association  (1991),  which  indicated  that  the  AERA  had  no  such 
uniform  code.  However,  AERA  plans  to  present  a code  for  discus- 
sion at  various  meetings  held  in  1992. 

This  article  explores  relevant  case  law  regarding  the  nature 
of  confidentiality  and  privilege  in  educational  research.  When 
conducting  legal  research,  the  best  initial  strategy  may  be  to  try 
to  understand  the  basic  nature  of  the  concept  rather  than  merely 
ascertain  the  current  status  of  the  law.  A review  of  several  legal 
encyclopedias  revealed  distinct  meanings  for  each  of  the  terms 
“confidential,”  “privilege,”  and  “privacy”  when  referring  to  com- 
munications. Black's  Law  Dictionary  provided  a good  working 
definition  of  the  three  terms. 

Privileged  communications:  Those  statements  made  by  cer- 
tain persons  with  a protected  relatioaship  such  as  husband- 
wife,  attorney-client,  confessor-penitent  and  the  like  which 
the  law  protects  from  forced  disclosure  on  the  witness 
stand  at  the  option  of  the  witness  client,  spouse,  penitent. 

The  extent  of  the  privilege  is  governed  by  state  statute. 

Confidentiality:  State  or  quality  of  being  confidential; 
treated  as  private  and  not  for  publication.  Confidential 
communication  is  statement  made  under  circumstances 
showing  that  speaker  intended  statement  only  for  (he 
ears  of  the  person  addressed. 

Pmuvv,  ngfil  of:  The  right  to  he  left  alone;  the  right  ol  a 
person  to  be  free  from  unwarranted  publicity. 

A case  law  definition  of  privileged  communication  R 
rhat  it  is  a communication”.. .which,  except  for  the  circumstances 


under  which  it  is  made,  may  be  defamatory  and  actionable” 
Skinner  v.  Pistoria. 


The  Distinction  Between 
Confidentiality  and  Privilege 

C onfidentiality  is  the  type  of  protection  which  educational 
researchers  are  most  likely  to  offer  their  subjects  as  a condition 
for  participating  in  their  research.  In  any  profession  or  discipline, 
confidentiality  is  an  ethical  standard  wherein  the  researcher  agrees 
not  to  divulge  any  information  provided  by  the  subject  except 
under  those  mutually  agreed  upon  conditions.  If  the  subject  is  a 
minor,  the  researcher  has  an  additional  duty  to  inform  the  sub- 
jects’ parents  of  the  request. 

The  concept  with  which  most  educational  researchers  are 
familiar  is  confidentiality,  which  is  defined  as  . . that  which  is  ori- 
ginated or  maintained  in  strict  secrecy  or  privacy”  (Black's).  For 
purposes  of  illustration,  the  following  scenario  will  be  examined: 

“My  name  is  Doctor  Anyone.  I am  conducting  a research 
study  on  the  effects  of  testing  students  at  your  school.  I 
would  like  to  interview  you  concerning  your  experiences 
and  feelings  concerning  this  study.  It  is  important  to  my 
study  that  your  responses  be  truthful  and  candid.  As 
such,  when  I reduce  my  research  to  writing,  I promise 
you  that  everything  you  tell  me  will  be  held  in  the  strictest 
confidence.” 

The  basic  problem  in  this  scenario  is  that  the  researcher 
has  no  authority  to  make  such  a blanket  guarantee  of  confiden- 
tiality. Additionally,  the  blanket  guarantee  of  confidentiality  tenders 
the  data  of  absolutely  no  value  to  the  researcher.  Data  that  cannot 
be  revealed  is  useless  to  the  collector.  Furthermore,  the  researcher 
may  be  compelled  by  court  order  to  reveal  both  the  source  and 
nature  of  confidential  information,  if  the  court  deems  it  necessary 
in  order  to  prevent  harm  or  for  other  valid  legal  reasons. 

This  raises  the  possibility  that  the  researcher  may  be  con- 
fronted with  the  dilemma  of  refusing  the  court  order  and  being 
held  in  contempt  of  court,  which  can  result  in  civil  penalties,  or 
in  the  extreme,  incarceration.  The  other  alternative  is  to  comply 
with  the  court  order  and  face  exposure  to  litigation  by  the  person 
whose  confidentiality  has  been  breached.  The  cause  of  action  upon 
which  the  case  would  stand  wouid  be  the  theory  of  breach  of 
implied  contract.  A contract  can  he  argued  to  exist  because  an 
offer  has  been  made  (i.e.,  give  me  information  and  I will  keep  it 
confidential);  an  acceptance  is  tendered  (i.c\,  the  giving  of  the 
information);  and  there  is  onsidcration  (the  subject  is  doing 
something  he  or  she  has  no  duty  to  do).  Ergo  a contract  exists 
and  divulging  the  information  b\  the  researcher  constitutes  a 
breach  creating  a cause  of  action  at  law. 

The  distinction  between  confidentiality  and  privilege  is 
complicated  by  the  fact  that  the  terms  are  often  used  interchange- 
ably. Privileged  communications  are  protected  by  statute  or 
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Confidential  and  Privileged  Communications  (continued) 


t law.  The  information  given  to  an  individual  who  is  in  a pri- 
\ilcgcd  capacity  mav  not  he  disclosed  in  court  proceedings  or  in 
nnv  other  manner  unless  specifically  waived  by  the  person  to 
u hom  the  protection  of  privilege  ensures. 

Educational  researchers  are  not  protected  hy  cither  statute 
< >r  professional  code  and  when  they  breach  confidential  commuiv 
k nitons  thev  can  be  subjected  to  basically  ethical  sanctions  or  to 
i he  threat  of  i ivil  action,  in  contrast,  those  who  receive  privileged 
communications  are  subject  to  more  severe  professional  sanctions. 

1 he  c nnfidential  nature  of  attorney-client  privilege  must  he  main- 
rained  even  when  the  attorney  has  knowledge  which  conflicts 
with  his  sworn  oath  of  allegiance  to  the  court.  For  example,  a 
defendant  m a criminal  trial  communcicated  to  his  attorney  an 
intention  to  offer  perjured  testimony  in  an  attempt  to  obtain  his 
.Rquitml.  The  attorney  withdrew  from  the  case  and  informed 
the  judge  of  such  perjured  testimony.  The  client  appealed  his  con- 
viction because  the  breach  of  privilege  denied  him  his  right  to 
effective  counsel  and  was  a breach  of  the  attorney’s  ethical  code. 
An  appellate  court  agreed  with  the  client  (defendant)  and  said 
that  . .counsel  owes  the  client  a duty  of  loyalty. . . ."  Furthermore, 
the  lawyer  was  censured  for  unethical  conduct  hy  his  state  bar 
aquation  (Slum  \Chitc<ide). 

A Rationale  for  Privilege  in 
Educational  Research 

Privilege  for  educational  researchers  has  not  been  con- 
ferred bv  statute  or  by  case  law  although  claims  of  privilege  have 
Ixvn  made  hy  academicians  in  order  to  protect  the  identity  of 
their  subjects.  Educational  researchers  in  certain  areas  of  inquiry 
mav  have  relevant  and  legitimate  need  to  protect  the  identity  of 
rheir  suhjet  ts  and/or  the  scope  of  their  research.  Research  studies 
in  areas  such  as  “at  risk  youth”  and  “students  with  AIDS”  often 
provide  great  practical  and  societal  value.  For  example,  researchers 
of  “at  risk"  youth  have  a legitimate  need  to  protect  the  identity 
of  their  subjects,  who  are  also  likely  to  be  minors.  If  “privilege”  is 
unavailable,  the  cost  to  society  may  he  substantial  if  participants 
are  unwilling  to  subject  themselves  to  possible  public  scrutiny. 
Premature  public  disclosure  of  the  research  findings  could  also 
compromise  the  entire  project. 

It  is  difficult  to  balance  the  benefit  to  society  against  the  pos- 
sible value  to  an  individual  litigant  seeking  the  identity  of  a sub- 
ject  or  subjects.  In  the  oast  20  years,  we  have  observed  a moderate 
erosion  of  privilege  hy  tu  * enactment  of  statutes  that  provide  for 
mandatory  reporting  of  suspected  child  abuse  and  client  com- 
munications in  which  the  attorney  (ABA  Code)  or  psychotherapist 
K'lieves  that  serious  bodily  harm  to  a third  party  is  imminent 
(TtiruMtfi  t.  Board  u f Regents).  These  exceptions  to  privilege  are 
log:ui!  and  serve  the  public  interest,  unlike  other  claims  for  pro- 
lix non  of  the  work  product.  In  the  TarasotT case,  a psychotherapist 
was  found  to  be  civilly  liable  to  a third  party  for  money  damages 
because  he  did  not  notify  the  authorities  or  the  third  partv  of 
threats  of  violence  made  by  his  client  against  the  third  party  which 
he  rciPonai'h  Mined  to  he  true. 


It  is  interesting  to  note  that  the  media,  which  is  a sub- 
stantially commercial  rather  than  an  educational  enterprise,  has 
claimed,  with  some  success,  a media  source  privilege.  Proponents 
of  this  privilege,  which  holds  that  the  media  should  not  be  required 
to  disclose  the  identities  of  their  confidential  sources  of  informa- 
tion, argue  that  in  addition  to  First  Amendment  considerations, 
to  require  such  disclosure  would  result  in  the  inability  to  gather 
important  information.  Commutvcants,  knowing  that  their  iden- 
tities would  be  made  public  would  be  unlikely  to  come  forward. 
Numerous  state  legislatures  have  enacted  laws  to  protect  journa- 
lists from  being  compelled  to  reveal  the  identities  of  confidential 
sources  (26,  including  Alabama.  Ala.  Code  §12-21-142),  as  well  as 
notes  and  records  (Jn  re  Taylor,  and  Cal.  Evid.  Code  §1070(c)).  In  the 
case  of  Briin^bwTR  r.  Hayes,  a dissent  hy  Justices  Stewart,  Brennan, 
and  Marshall  opined  that  the  First  Amendment  implied  a right  of 
confidentiality  between  a reporter  and  his  source.  Justice  Douglas 
went  further  and  stated  that  the  First  Amendment  prevented 
such  a disclosure.  The  majority,  however,  held  that  the  First 
Amendment  does  not  relieve  a journalist  of  the  obligation  to 
respond  \o  a grand  jury  subpoena  and  to  answer  questions  rele- 
vant to  a criminal  investigation.  Nonetheless,  the  dissent  has  been 
seized  upon  hy  the  lower  courts  to  extend  the  media  privilege 
in  non-grand-jury-type  situations. 

In  this  context,  there  arc  two  valid  arguments  for  extending 
the  media  source  privilege  to  educational  research.  These  are  that 
the  ultimate  objective  of  academic  research  is  to  publish  the  results 
of  ones  research  and  thereby  benefit  society  through  its  findings 
and  implications  (United  State*  of  America  r.  Doc),  and  that  re- 
search can  Ixst  he  done  with  a guarantee  of  confidentiality  in 
order  to  protect  the  subject’s  identity  when  sufficient  reason  for 
such  protection  has  been  shown  (Richards  oj  Rockford  r.  Pacific 
Gas  and  Electric  Co.).  The  state  of  Delaware  includes  “scholars” 
and  “educators”  among  those  who  have  the  right  to  claim  media 
source  privilege  without  the  necessity  of  publication.  Other  states 
have  extended  this  protection  to  psychologists  who  are  licensed 
and  who  hold  a doctorate  (Arizona).  Still  other  states  allow  ihe 
courts  to  weigh  the  conflicting  interests  of  the  parties  in  deter- 
mining whether  priv  ilege  attach.es. 

Another  argument  for  the  extension  of  a limited  privilege 
of  confidentiality  to  educational  researchers  is  that  of  academic 
freedom.  The  implication  of  such  freedom  carries  with  it  the  right 
to  do  research  with  the  knowledge  that  their  data  and  the  iden- 
tity of  their  sources  are  protected  hy  the  First  Amendment.  Two 
Supreme  Court  cases  endorse  the  constitutional  protection  of  the 
First  Amendment  to  academic  freedom  (Kerishum  e.  Board  of 
Regents)  and  indicate  that  unregulated  research  is  an  essential 
component  of  such  academic  freedom  (Succ^rc  i . Wu1  Htnnp* 
dure).  By  implication,  the  words  “unregulated  research”  would 
reasonably  protect  the  confidential  identity  and  sources  of  data 
received  by  the  researcher. 

At  least  one  court  has  addressed  the  idea  of  a “scholar’s 
privilege”  but  did  not  kx>k  with  favor  on  such  a concept.  The 
United  States  Court  of  Appeals  for  the  Second  Cin  uii,  held  that 
“...a  scholar’s  privilege,  if  it  exists,  requires  a threshold 
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showing  of  a detailed  description  of  the  nature  and  serious- 
ness  of  the  scholarly  study  in  question,  of  the  methodology 
employed,  of  the  need  for  assurances  of  confidentiality  to 
various  sources  to  conduct  the  study,  and  the  fact  that 
the  disclosure  requested  by  the  subpoena  will  seriously 
impinge  on  that  confidentiality.”  In  re  Grand  Jury  Subpoena 
DT D J an  nary  4,  1984. 

In  this  case  a Ph.D.  candidate  was  subpoenaed  to  produce 
information  he  had  been  gathering  for  his  dissertation.  The  infor- 
mation had  been  obtained  with  a promise  of  confidentiality.  The 
lower  court  quashed  the  subpoena  citing  a scholar’s  privilege,  but 
the  appellate  court  reversed  stating  that  there  was  . . insufficient 
record  whether  a scholar’s  privilege  exists,  much  less  to  provide 
grounds  for  applying  it...”  in  this  case.  The  lower  court,  in  an 
opinion  by  Chief  Judge  Jack  Weinstein,  had  “. . .quashed  the  sub- 
poena on  the  basis  of  a limited  federal  scholar’s  privilege  analogous 
to  the  limited  news  reporter’s  privilege  recognized  in  Branzburg'.' 

The  appellate  court  acknowledged  that  the  Federal  Rules 
of  Evidence  “...set  forth  a general  rule  covering  all  recognized 
common-law  privileges  and  empowers  federal  courts  to  fashion 
testimonial  privileges,  guided  by  the  'principles  of  the  common 
law  as...  inter  preted...  in  the  light  of  reason  and  experience*” 
Fcd.R.Evid.  501.  The  court  also  noted  that  the  Senate  Report 
enacting  Fcd.R.Evid,  501  stated  that  “judicial  recognition  of  a 
privilege  based  on  a confidential  relationship.,  .should  be  deter- 
mined on  a case-to-case  basis.”  The  court  found  no  such  basis 
in  this  instance,  but  the  Rule  may  hold  hope  for  the  development 
of  a “scholar’s  privilege”  under  the  right  circumstances. 

Wigmorc,  in  his  treatise  on  the  rules  of  evidence,  stated 
that  there  are  four  conditions  which  must  occur  for  a privilege 
to  exist.  These  arc: 

The  communications  must  originate  in  a confidence  that 
they  will  not  be  disclosed. 

The  element  of  confidentiality  must  be  essential  to  the  full 
and  satisfactory  maintenance  of  the  relation  of  the  parties. 

The  relation  must  be  one  which  in  the  opinion  of  the 
community  ought  to  be  sedulously  fostered. 

The  injury  that  would  inure  to  the  relation  by  the  dis- 
closure of  the  communications  must  he  greater  than  benefit 
thereby  gained  for  the  correct  disposal  of  litigation  (Wig- 
more.  ss22S5,  1%1). 

It  can  be  argued  that  scholarly  research  meets  all  oi  these 
criteria,  and  therefore  is  entitled  to  protection  ot  the  law. 

Confidentiality  and 
Privilege  in  Educational  Research 

Legislative  hodies  have  not  completely  ignored  the  realities 
of  research  in  sensitive  subject  areas.  For  example,  there  is  federal 
protection  for  drug  and  mental  health  research  (2i  LLS.C.  ss  872(c); 


42  U.S.C.  §242  a (a))  and  states  such  as  California  (Cal.  Health  and 
Safety  Code  ss  11603),  Texas  (Tex.Rev.Civ.Stat.Ann.  art.  4476-15, 
§. 02(c) ) and  New  York  (N.Y.  Pub.  Health  Law  ss  3371)  have  similar 
statutes  for  drug  research.  It  is  important  to  note  that  subject  iden- 
tities and  research  records,  except  in  compelling  cases  of  public 
interest,  are  protected.  However,  these  federal  and  state  protec- 
tions are  restricted  in  their  scope  and  fail  to  address  other  social 
problems  of  interest  to  educational  researchers.  In  the  absence  of 
specific  statutory  protections,  courts  are  generally  unwilling  to 
extend  privilege  to  academic  researchers  as  noted  in  In  re  Grand 
Jury  Subpoena. 

There  has  not  been  a rash  of  litigation  involving  cases 
where  confidentiality  between  researcher  and  subject  has  been 
breached,  either  inadvertently,  negligently,  or  by  court  order,  al- 
though there  have  been  some  reported  cases  of  litigation  involving 
academic  researchers  in  the  capacity  of  an  expert  witness  (Wright 
i\  Jeep  Corporation)  or  as  a third  party  witness  to  an  event  (Doe). 
Academic/educational  researchers  have  claimed  that  the  work 
product  of  their  research  is  privileged  and  immune  from  forced 
disclosure.  However,  the  courts  have  not  honored  such  claims  for 
protection.  For  example,  the  researcher  of  In  re  Grand  Jury,  who 
was  researching  the  activities  of  a business  was  called  before  a 
grand  jury  which  was  investigating  a suspicious  fire  at  said  busi- 
ness. The  researcher  was  forced  to  testify  over  his  objections  when 
the  court  refused  to  find  any  type  of  privilege  which  could  be 
asserted.  In  United  States  v.  Doe,  a historian  was  compelled  to 
testify  as  to  his  access  to  the  Pentagon  Papers,  although  he  claimed 
that  the  documents  had  been  provided  to  him  by  a confidential 
source  to  whom  he  had  promised  anonymity.  In  a third  case,  an 
independent  researcher  was  subpoenaed  by  a litigant  in  a products 
liability  case  who  was  seeking  such  research  in  order  to  use  it  as 
“expert”  testimony  in  a civil  action  for  damages.  The  researcher 
claimed  that  his  work  product  was  privileged  information  and 
claimed  protection  for  both  confidential  and  non-confident ial 
communication.  The  court  held  that  no  privilege  attached  and 
ruled  that  the  research  could  he  compelled  to  reveal  the  nature 
and  source  of  his  data  (Wright). 

Societal  and  educational  justifications  support  the  claim 
for  an  academic/education  assertion  of  privilege  based  on  publi- 
cation of  the  information.  In  research  (and  subsequent  publica- 
tion) dealing  with  sensitive  subjects  and  important  societal  areas 
such  as  sexual  behavior  or  drug  use,  one  can  at^guc  for  privilege 
for  those  scholars  conducting  such  studies.  The  argument  for  such 
privilege  asserts  potential  lack  of  information  if  subjects  fear  that 
such  information  may  be  made  public. 

Research  leading  to  publication  should  be  given  the  same 
protection  which  is  afforded  to  the  media  (Zcrelli  i.  Stnith).  Some 
courts  have  extended  this  privilege  to  academic  researchers  to  a 
limited  extent,  notably  the  First  Circuit  (Doc)  and  the  California 
federal  district  for  the  Northern  District  (Richards),  but  they  remain 
in  a distinct  minority.  Delaware  is  the  only  state  to  specifically 
protect  “educators”  under  the  umbrella  media  protection  standaai 
(Del.  Code  Ann.  Tit,  10  ss4 120).  Federal  Rule  of  Evidence  501 
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certainly  provides  a starting  point  for  the  development  of  a federal 
research  privilege  if  the  proper  case  arises. 

When  research  is  not  published  (or  not  intended  to  be 
published),  no  media  privilege  would  apply.  In  this  situation,  the 
academic  researcher  must  rely  upon  the  concept  of  academic  free- 
dom.  In  Sueeo',  Kt^ishicm,  and  EEOC  r.  Notre  Dame  du  Lac , the 
courts  have  endorsed  the  concept  of  academic  freedom  as  a special 
concern  of  the  First  Amendment  and  that  research  is  an  impor- 
tant concern  of  academic  freedom.  From  these  cases,  it  can  be 
logically  argued  that  lack  of  privilege  serves  to  restrict  the  freedom 
to  conduct  educational  research.  Thus,  it  can  be  argued  that  edu- 
cators should  be  afforded  the  same  protections  as  doctors,  lawyers, 
and  the  clergy  in  order  to  properly  and  optimally  do  their  work. 

Conclusions 

This  article  presents  valid  arguments  for  extending  a limited 
privilege  of  confidentiality  to  educational  researchers.  It  is  opined 
that  educators  should  be  afforded  the  same  protections  as  doctors, 
lawyers,  and  the  clergy  in  order  to  properly  and  optimally  do  their 
work.  However,  educational  researchers  need  a clear  set  of  guide- 
lines with  regard  to  the  nature  and  extent  of  confidentiality  in  their 
work.  At  present,  there  exists  a hodge-podge  of  codes  which  guide 
individual  researchers  depending  upon  their  discipline,  their  state 
of  residence,  or  faculty  handbook.  A proposed  code  for  educational 
researchers  would  include  the  following  six  provisions: 

1.  All  research  regarding  minors  would  be  strictly  privileged 
except  to  their  parents  (at  least  until  the  child  reaches  age  eighteen) 
and  in  accordance  with  applicable  child-abuse  reporting  laws. 

2.  Researchers  would  be  required  to  advise  subjects  of  the 
nature  of  the  study;  the  plans  for  publication  and  dissemination; 
and  a promise  of  confidentiality  to  the  extent  that  it  can  be  met 
in  accordance  with  the  law. 

3.  The  confidentiality  of  public  and  educational  research  be 
given  greater  protection  than  that  of  private  or  commercial  research. 

4.  The  privilege  be  extended  to  civil  actions  but  that  the 
legal  exceptions  to  criminal  actions  shall  apply. 

5.  A privilege  analogous  to  the  media  source  privilege  be 
included  in  this  code. 

6.  If  an  educational  researcher  is  legally  compelled  to  breach 
a promise  of  confidentiality,  then  the  researcher  shall  be  given 
civil  immunity  from  litigadon,  similar  to  the  various  child  abuse 
reporting  laws. 

Educational  research  is  an  integral  and  essential  aspect  of 
the  educational  process.  Educators  must  be  free  to  pursue  knowl- 
edge without  fear  that  the  product  of  their  research  can  be  made 
public  without  the  mutual  consent  of  their  subjects  or  the  researcher. 
Since  research  is  an  integral  part  of  academic  freedom,  there  are 
strong  societal  reasons  for  the  extension  of  privileged  and  confi- 
dential communications  to  academic  researchers.  The  societal  value 
generated  by  educational  research  and  the  importance  of  such 
information  argue  convincingly  the  need  for  statutory  protection 
for  educational  researchers. 


As  in  other  professions,  the  concept  of  privilege  should 
not  be  an  absolute.  The  American  Bar  Association  Code  of  Ethics 
states  that  the  privilege  does  not  extend  in  the  case  of  imminent 
danger  to  a third  person.  A similar  limitation  exists  in  psychiatry 
(Tarasoff).  This  code  is  sufficiently  delimiting  as  a model  code  for 
educational  research. 
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New  Direction  in  Research  on  Teacher 
and  Student  Expectations 

By  Thomas  L.  Good,  University  of  Missouri-Columbia 


In  this  article  I discuss  a few  new  ways  in  which  perfor- 
mance expectations  might  be  communicated  in  the  classroom. 
However,  I should  say  that  expectations  can  be  expressed  in  various 
ways  and  that  expectations  can  be  too  high  or  too  low  and  that 
the  same  behavior  can  be  interpreted  in  fundamentally  different 
ways  by  different  types  of  students.  In  general  most  extant  research 
has  focused  on  how  teachers  communicate  different  expectations 
to  students  believed  to  be  more  and  less  capable  (see  Good  6c 
Brophy,  1991).  This  research  on  teacher  expectations  has  focused 
on  dyadic  interaction  (teacher-individual  student  interaction)  in 
educational  as  well  as  social  psychology  experiment  (see  Jussim, 
1990).  Further,  there  has  been  some  inquiry  as  to  how  teachers 
communicate  differential  expectations  to  groups  of  students  (e.g., 
the  high  and  low  reading  group)  and  there  has  been  research 
on  ways  teachers  react  to  different  classes  (e.g.,  general  math  vs. 
algebra;  English  vs.  honors  English). 

In  this  article  I discuss  new  and  important  areas  where 
expectancy  effects  can  be  explored.  Specifically,  I outline  six  impor- 
tant areas  of  expectations  that  would  merit  programmatic  re- 
search. These  areas  are  (1)  teachers’  knowledge  of  subject  matter; 
(2)  teachers’  decision  making  about  content  to  present,  and  how 
fast  to  go  through  the  curriculum;  (3)  teachers  use  of  the  man- 
agement system;  (4)  variations  ir  teachers’  expectations  over 
time;  (5)  classroom  task  variables;  and  (6)  students’  conceptions 
of  teachers. 

Selection  of  Curriculum  Content 

Many  educators  have  contended  that  textbooks  define  the 
curriculum,  although  recent  research  challenges  this  simplistic 
view  and  suggests  that  teachers  act  as  decision  makers,  modifying 
the  curriculum  in  relation  to  factors  such  as  teachers’  beliefs  about 
students’  aptitude,  their  instructional  intentions,  and  their  subject- 
matte*'  knowledge.  If  teachers  influence  the  curriculum,  then  their 
decisions  about  curriculum  help  to  determine  performance  expec- 
tations for  students,  as  do  teacher  behaviors  and  activity  structures. 

According  to  Freeman  and  Porter  (1989),  teachers  make 
many  decisions  that  influence  how  much  content  students  receive. 
For  example,  teachers  decide  how  much  time  to  spend  on 
mathematics  on  a certain  day,  what  topics  should  be  taught,  how 
much  time  should  be  allocated  for  each  topic,  whether  all  students 
are  taught  the  same  topics,  and  in  what  order  topics  should 
be  presented. 

Freeman  and  Porter  (1989)  conducted  detailed  case  studies 
oi  how  four  fourth-grade  teachers  used  textbooks  to  make  deci- 
sions about  what  mathematics  content  to  teach.  One  particularly 
interesting  comparison  oi  two  teachers  who  used  the  same  text- 
book showed  that  thev  presented  substantially  different  content 


to  students.  One  teacher  (A)  taught  mathematics  about  four  weeks 
longer  than  did  the  other  teacher  (B)  over  a school  year.  Teacher 
A utilized  her  7,764  minutes  in  the  following  ways:  concepts— 1,806 
(23.3  percent);  skills — 4,588  (59.1  percent);  and  applications— 1,370 
(17.6  percent).  In  contrast,  teacher  B allocated  mathematics  time 
in  the  following  way:  concepts— 1,151  (17.0  percent);  skills— 4,765 
(70.2  percent),  and  applications— 869  (12.8  percent).  Thus,  students 
in  class  A received  13  additional  lessons  on  concepts  and  10  addi- 
tional lessons  on  applications. 

Freeman  and  Porter  also  contrasted  time  allocation  in  class 
A (7,764  minutes)  with  thac  in  teacher  C’s  class,  which  was  divided 
into  two  instructional  groups.  Teacher  C provided  only  5,830 
minutes  of  instruction  for  the  low  group.  Using  50  minutes  as  a 
class  unit,  the  low  group  in  class  C received  7l/2  fewer  weeks  of 
instruction  than  did  students  in  class  A.  The  time  spent  on  instruc- 
tion and  the  focus  of  instruction  seem  prime  ways  in  which  expec- 
tations might  be  communicated.  Subsequent  research  could  pro- 
fitably attempt  to  integrate  teachers’  decision  about  how  much 
and  what  type  of  content  to  present  with  teachers’  expectations 
for  students  (how  much  students  are  likely  to  learn,  etc.). 


Teachers’  Subject-Matter  Knowledge 

Teachers’  subject-matter  knowledge  is  likely  an  important 
factor  affecting  the  performance  expectations  communicated  to 
students.  Because  teachers  know  more  about  come  subjects  or 
concepts  than  others,  teachers’  beliefs  about  subject  matter  and 
how  to  present  it  to  students  would  probably  affect  whether  or 
not  they  set  appropriate  performance  expectations  for  students 
(what  students  should  learn  and  in  what  way). 

Carlsen  (1991)  documented  the  effects  of  four  beginning 
biology  teachers’  subject-matter  knowledge  on  discourse  in  their 
classrooms  as  they  taught  eight  science  lessons.  Teachers  taught 
an  equal  number  of  lessons  on  topics  about  which  they  had  cither 
high  or  low  knowledge.  Beginning  teachers  were  more  likely  to 
use  lectures  and  relatively  open-ended  laboratory  activities  to  teach 
high-knowledge  topics  than  to  teach  low-knowledge  topics.  Teachers 
were  more  likely  to  use  seat  work  assignments  and  non-lal.  oratory 
group  projects  for  topics  about  which  they  had  low  knowledge. 

The  findings  imply  that  choice  of  instructional  activity 
affects  students’  participation  in  classroom  discussion.  Teachers 
used  lectures  and  laboratory  activities,  which  are  characterized  by 
high  rates  of  student  questioning,  with  topics  they  were  knowl- 
edgeable about.  They  Tended  to  use  classroom  activities  that  in- 
voked few  Mudent  questions  when  they  were  unfamiliar  with  the 
subject  matter.  Furthermore,  because  students  have  tea  depend  on 
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their  private  knowledge  of  science  when  learning  topics  about 
which  teachers  have  low  knowledge,  it  is  unlikely  that  teachers 
will  recognize  and  correct  students1  misconceptions  about  these 
topics.  During  seat  work  or  cooperative  learning  activities  on  these 
topics,  students  will  likely  compound  one  another’s  misconcep- 
tions, errors,  etc. 

Carlsen’s  results  are  especially  intriguing  in  that  they  illus- 
trate that  because  all  teachers,  and  especially  beginning  teachers, 
have  inadequate  knowledge  in  some  areas,  teachers  must  develop 
strategies  for  teaching  content  that  they  are  still  learning  them- 
selves. These  strategies  might  include  using  additional  sources  (to 
the  textbook),  bringing  in  guest  teachers  who  are  more  knowledge- 
able, telling  students  that  this  is  an  area  about  which  they  are  still 
learning,  and  presenting  to  students  the  questions  that  the  teachers 
are  using  to  structure  the  unit  (and  their  own  learning). 

Research  that  examines  teachers’  performance  expectations 
for  individual  students  along  with  teachers’  subject-matter  knowl- 
edge would  be  profitable.  When  teachers  instruct  students  in  topics 
about  which  teachers  have  little  knowledge,  they  may  exaggerate 
differential  treatment  (i.e.,  avoid  unpredictable  questions  by  low 
achievers,  or  overly  depend  on  students  believed  to  be  more 
capable).  Furthermore,  accountability  systems  and  task  structures 
teachers  select  may  be  a function  of  their  subject-matter  knowledge. 

Teachers  Use  of  Classroom  Management 

There  is  considerable  consensus  in  the  field  that  classroom 
management,  as  discussed  by  Kounin  (1970),  is  desirable,  effective 
teaching.  Basically,  the  Kounin  approach  to  management  argues 
that  teachers  need  to  be  proactive  (not  reactive)  and  that  good 
managers  are  defined  by  their  ability  to  prevent  misbehavior  rather 
than  by  skills  for  dealing  with  misbehavior  per  .se.  Elsewhere  it 
has  been  argued  that  over- reliance  on  teacher  controlled  variables 
(alerting,  accountability)  can  suppress  students  ability  for  self- 
regulation.  McCaslin  and  Good  (1992)  have  argued  the  case  this 
way  “As  long  as  the  teacher  controls  the  management  system  (e.g., 
does  the  alerting  and  maintains  the  accountability),  students  can- 
not learn  self-regulation,  problem-solving  and  self-control”  (p.  13). 
McCaslin  and  Good  see  classroom  teacher  management  as  an 
instructional  scaffold  that  needs  to  be  reduced  over  time. 

In  terms  of  expectancy  variables  it  would  be  informative 
to  determine  through  clinical  interviews  how  students  vary  in 
their  reactions  to  teachers  who  notably  differ  in  their  use  of  pre- 
ventive management  behaviors  (e.g.,  high  alerting— low  account- 
ability; low  alerting— high  accountability;  high  alerting— high 
accountability;  etc). 

Individual  student  analysis  of  management  behavior  would 
also  be  instructive.  In  a low  alerting  teacher’s  classroom  there  is  a 
significant  message  for  students  who  receive  a disproportionate 
share  of  alerting  (you  can’t  be  trusted,  you  need  help).  Although 
most  accounts  of  preventive  management  discuss  how  the  teacher 
should  treat  the  class,  what  might  be  equally  instructive  is  the 
distribution  of  such  behaviors  that  individual  students  receive. 


Good’s  Passivity  Model 

Some  students  receive  low  expectations  so  consistently 
that  they  appear  to  internalize  these  expectations.  Studies  of  ex- 
pectations have  increasingly  emphasized  how  students  internalize 
teachers’  expectations,  and  models  have  been  developed  for  ex- 
ploring mediation  effects  (e.g.,  Cooper,  1985;  Darley  Sc  Fazio,  1980; 
Jussim,  1986).  Good’s  (1981)  passivity  model  suggested  that  certain 
forms  of  teacher  treatment  induce  passivity  in  low-achieving  stu- 
dents. Over  time,  differences  in  the  ways  teachers  treat  low  achievers 
may  reduce  their  efforts  and  contribute  to  a passive  learning  style 
(for  example,  in  the  third  grade  a student  is  praised  or  finds  teacher 
acceptance  for  virtually  any  verbalization,  but  in  the  fourth  grade 
the  student  is  seldom  praised  and  is  criticized  frequently).  Other 
teacher  behaviors  may  compound  this  problem.  Low-achieving 
students  who  are  called  on  frequently  one  year  (the  teacher  believes 
they  need  to  participate  if  they  are  to  learn)  but  infrequently  the 
following  year  (the  teacher  does  not  want  to  embarrass  them)  may 
find  it  confusing  to  adjust  to  different  role  definitions.  Ironically, 
those  students  who  have  the  least  capacity  to  adapt  may  be  asked 
to  make  the  most  adjustments  as  they  move  from  classroom  to 
classroom.  The  greater  variation  among  teachers  in  interaction 
with  low  achievers  (in  contrast  to  the  more  similar  patterns  of 
behavior  that  high-achieving  students  experience  from  different 
teachers)  may  occur  because  teachers  agree  less  about  how  to  res- 
pond to  students  who  do  not  learn  readily.  Teachers  may  treat 
low-achieving  students  inconsistently  over  the  course  of  the  school 
year  as  they  try  one  approach  after  another  (having  given  up  pre- 
maturely) in  an  attempt  to  find  something  that  works. 

Even  within  a given  year,  low  achievers  arc  asked  to  adjust 
to  more  varied  expectations.  This  may  be  true  in  part  because 
many  low  achievers  have  several  teachers  (in  addition  to  the  regular 
teacher,  they  may  have  a remedial  mathematics,  reading,  or  speech 
teacher).  The  chance  for  different  expectations  is  thus  enhanced. 

When  teachers  provide  fewer  chances  for  lower  achievers 
to  participate  in  public  discussion,  wait  less  time  for  them  to  respond 
when  they  are  called  on  (even  though  these  students  may  need 
more  time  to  think  and  form  an  answer),  or  criticize  lows  more 
per  incorrect  answer  and  praise  them  less  per  correct  answer,  impli- 
cations arc  similar.  It  seems  that  a good  strategy  for  students  who 
face  such  conditions  would  be  not  to  volunteer  or  not  to  respond 
when  called  on.  Students  are  discouraged  from  taking  risks  under 
such  an  instructional  system  (Good,  1981).  To  the  extent  that 
students  are  motivated  to  reduce  risk  and  ambiguity— and  many 
argue  that  students  arc  strongly  motivated  to  do  so  (Doyle,  1983) — 
students  would  likely  become  more  passive  in  order  to  reduce  the 
risk  of  critical  teacher  feedback. 

Good,  Slavings,  Harel,  and  Emerson  (1987)  found  that  low 
achievers  were  just  as  likely  to  ask  questions  as  other  students  in 
kindergarten  classes,  but  asked  significantly  fewer  questions  than 
their  classmates  in  upper-elementary  and  secondary  classes.  Simi- 
larly, in  a study  involving  grades  2, 4,  and  6,  Newman  and  Goldin 
(1990)  found  that  among  sixth  graders,  the  lowest  achievers  had 
both  the  greatest  perceived  need  for  help  and  the  greatest  resistance 


New  Direction  on  Research  (continued) 


to  asking  for  help.  Students’  ambivalence  about  asking  questions 
or  getting  help  from  teachers  becomes  especially  acute  at  adoles- 
cence, when  they  are  both  more  concerned  about  how  they  arc 
perceived  by  peers  and  more  sensitive  to  the  costs  as  well  as  the 
benefits  of  help-seeking. 

Teachers’  Expectations  Over  Time 

Good’s  passivity  model  asserts  that  sharp  differences  in 
teacher  expectations  may  undermine  student  performance.  Rela- 
tively  little  research  has  focused  on  students’  classroom  experience 
over  consecutive  years,  and  no  study  has  examined  students’  reac- 
tions  to  differential  teacher  expectations  over  consecutive  years 
prior  to  the  work  of  Midgley,  Feldlaufer,  and  Eccles  (1989). 

Midgley  ct  al.  (1989)  conducted  a longitudinal  study  of 
1,329  elementary  and  junior  high  students’  self-  and  task-related 
beliefs  in  mathematics  as  a function  of  teachers’  efficacy  beliefs. 
They  found  that,  within  the  school  year,  the  rate  of  change  of 
students’  expectancies,  perceived  performance,  and  perceived  task 
difficulty  in  math  differed  at  years  l and  2 of  the  study,  depending 
on  their  teachers’  efficacy  beliefs  before  and  after  students  moved 
from  elementary  school  to  junior  high.  Students  u’ho  moved  from 
high - to  lou'-efficacy  math  teachers  during  the  transition  ended  the 
junior  high  year  with  the  lowesr  expectancies  in  perceived  perfor- 
mance (even  lower  than  students  who  had  low-efficacy  teachers 
both  years)  and  the  highest  perceptions  of  task  difficulty.  The 
differences  in  pre-  and  post-transitional  teachers’  views  of  their 
efficacy  had  more  of  an  effect  on  low-achieving  than  on  high- 
achieving  students’  beliefs  about  mathematics.  In  the  spring  of 
both  years,  students  with  more  efficacious  teachers  had  higher 
expectancies  for  and  perceptions  of  their  performance  in  math 
than  did  students  with  less  efficacious  teachers.  Furthermore,  in 
the  spring  of  their  seventh-grade  year,  students  with  more  effica- 
cious teachers  rated  math  as  less  difficult  than  did  students  with 
less  efficacious  teachers. 

There  is  growing  evidence  that  students’  views  of  their 
potential  to  understand  subject  matter  and  perform  in  classrooms 
arc  not  simply  a product  of  the  current  classroom  environment 
but  are  also  influenced  by  previous  school  experiences.  Fetterman 
(1990)  found  that  fifth-grade  teachers  were  unable  to  implement 
a process  approach  (teaching  students  to  understand  content, 
explain  solution  paths)  in  part  because  fourth-grade  teachers  had 
encouraged  a product  approach  (quick  right  answers)  and  also 
because  of  students'  expectations  about  what  would  happen  in 
the  sixth  grade  at  the  middle  school. 

Classroom  Task  Variables 

Researchers  haw  emphasized  that  how  teachers  structure 
the  classroom  and  select  academic  work  tasks  influences  the  per 
fomiaiue  expectations  that  students  will  develop.  Thus  just  as 
teachers  communicate  expectations  to  student'*  so  dtx*s  the  wnv 
in  which  i lassnxmi  ncti\  ities  are  structured.  According  to  Bosscrt 


(1977),  teachers  use  various  activity  structures  such  as  teacher-led 
recitations,  class  tasks  (assigned  to  the  whole  class),  and  multi-tasks 
(done  independently  or  in  small  groups).  He  notes  that  activity 
structures  affect  tasks  and  social  relationships.  For  example,  heavy 
reliance  on  recitation  structures  requires  teachers  to  exercise  their 
formal  authority  frequently  and  publicly;  hence,  in  such  settings 
teachers  are  more  likely  to  communicate  differential  performance 
expectations  more  explicitly. 

Doyle  (1982)  argues  that  students  generally  take  seriously 
only  work  for  which  they  are  held  accountable.  Students’  expec- 
tations are  tied  to  the  work  that  teachers  check  and  to  work  they 
believe  they  will  be  tested.  Teachers  must  realize  the  importance 
of  accountability  and  explore  w>ays  to  use  it  creatively  and  con- 
structively. For  example,  ways  in  which  teachers  test  and  assign 
grades  communicate  expectations— perhaps  more  directly  than 
face-to-face  interactions.  If  teachers  routinely  assign  memory  work, 
students  will  spend  their  time  memorizing  isolated  facts.  In  con- 
trast, if  teachers  require  students  to  integrate  and  organize  infor- 
mation in  order  to  understand  concepts  and  complete  tasks,  quite 
different  performance  expectations  are  communicated.  Despite  the 
potential  for  integrating  expectation  research  with  the  study  of 
activity  structures  and  work  tasks,  there  has  been  little  work 
in  this  area. 

As  an  example  of  research  in  this  area,  Blumenfeld  and 
Mcece  (1968)  observed  middle  school  science  lessons  and  cate- 
gorized them  in  terms  of  eontent  difficulty,  social  organization,  and 
procedural  complexity.  These  lesson  types  wore  then  examined  in 
terms  of  the  extent  to  w'hich  they  increased  or  decreased  cognitive 
engagement  as  reported  by  191  students  (investigators  used  both 
questionnaires  and  interview’s).  Students  reported  more  high-level 
strategy  use  with  cognitively  demanding  tasks  and  tasks  that  did 
not  involve  materials  manipulation.  Qualitative  examinations 
and  comparisons  betw’een  task  dimensions  and  teacher  behaviors 
showed  that  teacher  behaviors  can  modify  cognitive  task  objec- 
tives or  complement  them  to  influence  students’  engagement. 

Mcece,  Blumenfeld,  and  Hoyle  (1988)  assessed  the  extent 
to  w’hich  students’  goal  orientations  mediated  their  cognitive 
engagement  in  science  activities.  Two  hundred  and  seventy-five 
fifth-  and  sixth-grade  students  from  10  classrooms  responded  to 
questionnaires  that  assessed  their  goal  orientation  and  use  of  high- 
level  or  effort-minimizing  learning  strategies  while  completing  six 
science  activities.  Students  who  stressed  task-mastery  goals  reported 
more  active  task  engagement.  Students  who  emphasized  pleasing 
the  teacher,  avoiding  work,  or  gaining  social  recognition  reported 
lower  cognitive  engagement.  The  study  indicated  the  important 
effects  that  smdents’  needs,  interests,  beliefs,  and  self-perceptions 
have  on  their  rcsjxmses  to  classroom  tasks. 

Since  these  data  arc  correlational,  they  should  he  inter- 
preted with  caution.  For  example,  students  wTio  value  work  may 
develop  appropriate  value  structures  and  an  interest  in  task  com- 
pletion because  they  have  completed  tasks  successfully  in  the  past. 
Whether  the  value  structures  precede  or  follow  task  involvement 
merits  research. 

(com  muni  an  [kige  10) 
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Students'  Conceptions  of  Teachers 

Students  often  hold  misconceptions  about  task  require- 
ments.  King  (1989)  and  Mulryan  (1989)  found  that  some  students 
are  passive  during  small-group  work  because  they  do  not  under- 
stand task  requirements.  It  is  also  possible  that  students'  percep- 
tions and  expectations  of  teachers  may  also  influence  learning 
outcomes.  Jamieson,  Lydon,  Stewart,  and  Zanna  (1987)  conducted 
a field  experiment  to  see  if  students'  induced  expectations  for 
teachers  would  enhance  students’  perceptions  and  performance. 
Data  were  collected  in  four  high  school  classes  at  the  end  of  a 
three-week  teaching  unit.  Students  in  two  classrooms  had  been 
given  initial  positive  expectations  about  their  new  teacher’s  ability 
and  motivation;  students  in  the  two  control  classrooms  received 
no  expectation  information  about  the  teacher.  The  same  teacher 
taught  all  four  classes  in  a three-week  unit  on  oral  and  written 
English  skills.  Students  in  the  two  experimental  classrooms  en- 
gaged in  more  appropriate  and  less  inappropriate  nonverbal  be- 
havior and  received  higher  final  grades  on  the  unit. 

The  authors  acknowledged  that  they  do  not  know  how 
the  treatment  affected  performance.  That  is,  students  in  experi- 
mental classes  may  have  been  more  attentive  to  the  teacher,  who 
then  may  have  assumed  that  the  students  were  more  able.  An 
alternate  explanation  is  that  because  students  believed  they  were 
working  with  a talented  teacher,  they  assumed  they  would  learn 
more  and  applied  themselves  more  diligently.  At  any  rate,  the 
positive  expectations  that  were  communicated  to  students  about 
their  teacher  influenced  both  their  behavior  and  academic  per- 
formance in  the  class.  The  study  highlights  the  reciprocal  effects 
of  classroom  behavior— students  and  teachers  influence  one  another 
in  similar  ways. 


Summary 

The  construct  of  performance  expectations  provides  a use- 
ful way  to  organize  knowledge  about  classroom  instruction  and  - 
learning.  Beliefs  about  ability  and  appropriate  instructional  goals 
may  well  affect  how  classroom  participants  attend  to  and  inter- 
pret various  aspects  of  classroom  life. 

It  has  been  argued  that  teachers  form  and  communicate 
performance  expectations  to  individual  students,  groups  of  stu- 
dents, and  entire  classes  of  students.  Groups  of  teachers  (e.g.,  fifth-, 
sixth-,  and  seventh-grade  mathematics  teachers),  or  all  the  teachers, 
in  a school  can  create  performance  expectations  for  students  over 
consecutive  years.  Few  studies  have  examined  the  transmission 
of  teachers’  expectations  across  consecutive  years. 

Research  has  focused  on  how  teachers  communicate  expec- 
tations during  classroom  interactions.  However,  this  article  has  also 
made  it  clear  that  teachers  communicate  performance  expectations 
through  selection  of  academic  content  to  be  studied,  task  and  con- 
tent assignments,  grouping  patterns,  and  accountability  systems. 

Teachers’  beliefs  about  subject  matter  and  their  subject- 
matter  knowledge  may  also  affect  teachers’  and  students’  perfor- 
mance expectations.  In  some  cases  teachers’  lack  of  subject-matter 
knowledge  may  limit  instruction  and  influence  the  communica- 
tion of  low  expectations  more  than  do  teachers’  beliefs  about  stu- 
dents’ abilities.  In  combination,  these  two  sets  of  variables  might 
cause  students  to  internalize  low  performance  expectations. 

Students  perceive  and  interpret  classroom  behavior,  tasks, 
and  content  assignments.  Although  there  has  been  less  research 
on  students  than  on  teachers,  there  is  evidence  that  students  per- 
ceive differential  teacher  behavior  toward  students  and  are  aware 
of  the  meaning  of  such  behavior.  Less  is  known  about  how  stu- 
dents react  to  tasks  and  form  subject-matter  beliefs.  Integrative 
work  that  focuses  on  instructional  behavior  and  beliefs,  curriculum 
tasks,  and  student  perceptions  is  needed. 
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Both  Sides  Now:  Interpreting  Beta  Weights 

Introducing  the  Debate 

Isadore  Newman,  Co-Editor 

There  has  been  an  ongoing  debate  surrounding  the  use  and  interpretability  of  beta  weights.  At  the  end  of  each  debate  there 
seems  to  be  apparent  agreement  between  debators  on  each  other’s  major  points,  but  the  final  conclusion  restates  their  disagreement 
about  whether  or  not  beta  weights  should  be  interpreted.  The  two  viewpoints  being  expressed  below  are  representative  of  this  contro- 
versy. It  appears  that  the  disagreement  is  not  whether  beta  weights  are  interpretable,  but  rather,  under  what  conditions  they  should 
be  interpreted.  Harris’  position  is  that  beta  weights  should  be  interpreted  and  that  they  have  very  clear  mathematical  meaning,  while 
cautioning  that  beta  weights  can  be  inappropriately  used  as  a good  indice  of  “overall  importance”  of  individual  predictors.  McNeil 
presents  three  examples  and  cautions  how  beta  weights  have  been  and  can  be  easily  misinterpreted.  However,  both  agree  that  while 
beta  weights  are  often  misinterpreted,  they  do  have  very  useful  and  clear  interpretations  under  appropriate  conditions.  These  positions 
provide  the  applied  researchers  with  excellent  guidelines  for  the  use  and  interpretation  of  the  controversial  beta  weight. 


“Beta”  Weights  Should  Be  Used  to 
Interpret  Regression  Variates  and  to  Assess 
In-Context  Variable  Importance 

Richard  j.  Harris,  University  of  New  Mexico 

Of  course  “beta”  weights  (which  I will  henceforth  refer  to 
as  c-score  regression  coefficients,  or  h?s)L  are  interpretable!  They 
are,  in  fact,  much,  better  than  zero-order  correlations  (rivs)  or  struc- 
ture coefficients  ()•- s,  also  known  as  the  loadings  of  the  X;s  on  y) 
as  bases  for  interpreting  regression  variates;  and  they  constitute 
one  of  the  two  logical  indices  of  the  importance  of  individual  pre- 
dictors within  the  context  of  the  entire  set  of  predictors.  On  the 
other  hand,  b.s  should  not  be  interpreted  as  indices  of  the  relative 
merits  of  individual  predictors  that  are  to  be  used  singly  (for  which 
zero-order  correlations  or  the  structure  coefficients  to  which  they 
are  directly  proportional  are  the  indices  of  choice),  nor  as  especially 
gixxJ  indices  of  the  "overall  importance”  of  individual  predictors. 

Interpreting  Regression  Variates* 

First,  some  basics:  The  process  of  interpreting  a regression 
variate  is  essentially  one  of  concept  identification,  with  the  test 
of  whether  we’ve  got  the  concept  “right”  being  whether  the  linear 
combination  of  measures  implied  by  our  interpretation  rank  orders 
the  individual  cases  (more  precisely,  positions  them  along  the  real- 
number  line)  in  the  same  way  as  does  the  regression  variate  itself. 
An  excellent  measure  of  the  match  between  the  two  orderings  of 
the  cases  (hv  the  actual  regression  variate  versus  by  the  linear 
combination  of  the  measures  implied  by  our  interpretation)  is,  of 
course,  the  correlation  between  the  regression  variate,  V,  and 
E utXr  Suite  by  definition  ~ E an  interpretation  based 
on  “beta”  weight"  v.  ill  vield  a value  of  this  correlation  that  i"  dose 
to  1.0,  while  one  based  on  the  the  strut  tun.*  t.t\‘fFu  ients  (load- 
ings), or  any  other  set  of  combining  weights  will  do  less  well- 
sometinics  dnimatuallv  so.  Another  test  of  adequacy  of  our  inter- 
pretation of  the  regression  variate  t"  whether  it  prov  ides  ncark  the 
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Cautions  and  Conditions 
for  Interpreting 
Weighting  Coefficients 

Keith  McNeil,  New  Mexico  State  University 

To  discuss  the  cautions  and  conditions  for  interpreting 
beta  weights,  three  cases  are  provided  in  regression  formation:  (a) 
the  treatment-control  design,  (b)  single  predictor  design,  and  (c)  the 
multiple  predictor  design. 

Treatment-Control  Design 

If  a treatment  and  control  group  arc  compared  on  a cri- 
terion Y,  then  the  following  regression  model  can  be  used: 

Case  !:  Y = ^U  + bT  + Et 

The  raw  score  weight,  h,  is  the  criterion  difference  between 
the  control  group  and  the  treatment  group.  If  another  group  of 
persons  from  the  same  population  was  given  the  same  treatment 
and  control,  then  we  would  expect  approximately  the  same  amount 
of  difference  in  the  outcome  Y.  The  lower  the  R;  value,  the  less  the 
difference  between  means  is,  relative  to  the  within  variability,  and 
this  within  variability  depends  on  other  variables  not  in  the  model. 
Therefore,  we  cannot  predict  accurately  the  effect  for  any  one  sub- 
ject, just  for  the  group.  Indeed,  we  can  only  snv  that  the  treatment 
caused  the  h-unit  difference  between  control  and  treatment. 

Single  Predictor  Design 

If  a single  predictor  variable,  X,  is  measured  and  a criterion 
variable  Y I**  measured,  we  have  a t orrclaiional  design,  and  the 
following  regression  nuxlel  van  he  used: 

( a*e  2:  Y - a0U  hX  i H, 

The  raw  m ore  weight,  l\  is  the  dojxv  of  the  line  and  is  the 
v hange  in  Y lor  evet  v unit  change  in  X.  The  Mriu  lute  of  Case  1 
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Cautions  and  Conditions  (continued) 


same  level  of  predictability  of  Y that  the  regression  variate  itself 
delivers  up,  which  is  of  course  indexed  by  the  squared  correlation 
between  Y and  £ aiXi.  Since  the  bz s are  explicitlv  derived  so  as 
to  maximize  this  squared  correlation,  a fa-based  interpretation  will 
yield  a squared  correlation  closer  to  R2  than  will  a loadings-based 
interpretation— with  this  difference  sometimes  being  quite  dra- 
matic. (Harris,  1989,  reports  hypothetical  data  in  which  inter- 
preting the  regression  weights  yields  a correlation  of  1.0  both  with 
the  regression  variate  and  with  Y,  while  the  loadings-based  inter- 
pretation yields  squared  correlations  of  .20  with  Y and  Y.) 

A number  of  properties  follow  from  this  concept-identifi- 
cation perspective.  As  has  been  amply  demonstrated  elsewhere 
(Harris,  1985,  Examples  6.4  and  6.5;  Harris,  1989,  1992). 

(1)  When  there  is  a consistent  relationship  lxrtween  a given 
set  of  variables  and  our  outcome  measure,  that  relationship  will 
be  uncovered  by  the  regression  coefficients,  regardless  of  what 
other  variables  are  included  in  our  set  of  predictors;  interpreta- 
tions based  on  rivs,  however,  will  he  strongly  affected  hy  irrelevant 
variations  in  context. 

(2)  When  situations  involving  identical  riy s hut  varying 
greatly  in  the  correlations  among  the  predictors  and  thus  in  the 
linear  combinations  of  measures  that  best  predict  Y are  compared, 
our  regress ion-coeffici on t-hased  interpretation  will  vary  appro- 
priately across  these  situations  so  as  to  reflect  the  differences  in 
regression  variates,  while  the  loadings-based  interpretation  will 
inappropriately  remain  the  same,  thus  failing  to  reflect  the  differ- 
ences in  the  optimal  way  to  predict  Y 

0)  Relying  on  the  obfuscation  to  interpret  our  regres- 
sion variate  or  discriminant  function  leads  to  the  interpretation 
of  a given  variable  depending  (strongly  and  inappropriately)  on 
whether  it  is  measured  directly  ns  an  original  variable  or  is  in- 
stead uncovered  in  exploratory  fashion  as  a linear  combination 
of  the  original  variables. 

(4)  Generalizing  the  principle  underlying  obfuscation-based 
interpretations— namely,  that  we  should  approximate  our  regres- 
sion variate  as  £ riyXif  rather  than  as  £ to  path  analysis 

would  thereby  forfeit  any  ability  to  uncover  such  phenomena  as 
spurious  correlation,  indirect  causation,  and  mediation. 

Finally,  I should  point  out  the  folly  of  the  “schizophrenic 
approach”  to  interpretation  of  regression  variates.  A number  of 
researchers  (e.g.,  Hubcrty  (Sc  Wi  sen  baker,  1992)  recommend  that 
we  describe  how  scores  on  the  regression  variate  or  discriminant 
functions  are  generated  via  the  regression  coefficients,  hut  use  the 
rlvs  or  (equivalently)  the  loadings  ro  tell  us  what  underlying  “con- 
struct” the  regression  variate  represents.  If  vou  find  beguiling  this 
treatment  of  what  a variable  “really  is”  ns  unrelated  to  how  it 
rank  orders  individual  cases,  I urge  you  to  rend  the  “Canonical 
Cautionary"  (Harris,  1989)  for  an  example  of  ethologists  running 
around  measuring  Ivuk  length  but  calling  it  total  skull  length. 

Assessing  Relative  Importance  of  Predictors 

As  Darlington  (b}(>8)  pointed  out  a couple  of  decade^  ago, 
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and  Case  2 model  is  exactly  the  same,  the  only  difference  is  that 
the  predictor  variablc  hi  Case  1 has  been  manipulated.  Since  cor- 
relational data  is  usiudly  not  manipulated , one  must  he  cautious, 
indeed  avoid,  the  kind  of  causal  interpretation  made  in  Case  1. 
The  subjects  in  Case  2 were  not  manipulated  and  therefore  we 
do  not  know  what  the  effects  would  he  of  making  someone  one 
unit  higher  on  X,  say  one  unit  higher  on  “orneriness.”  How  do 
people  react  to  being  made  more  (or  less)  ornery?  And  how  docs 
the  change  effect  Y?  Wc  have  not  looked  at  those  questions  in 
Case  2.  If  we  would  have  experimentally  manipulated  orneriness, 
then  we  would  be  back  to  Case  1. 

Some  statistics  books  indicate  that  “b”  in  Case  2 gives 
one  an  approximation  of  what  would  be  the  effect,  hut  I know  of 
no  area  of  research  that  supports  that  notion.  As  my  good  friend 
Jack  Kelly  would  say,  “The  proof  is  in  the  pudding,"  and  here 
pudding  is  experimental  manipulation. 


Multiple  Predictor  Design 

Now  we  are  into  the  General  Linear  Model  situation,  the 
focus  of  this  paper.  Suppose  one  is  interested  in  predicting  grade  8 
Math  Achievement  (MA)  and  uses  beginning  of  grade  8 variables 
of  Math  IQ(MIQ),  Math  Anxiety  (MANX),  Gender,  and  Verbal 
IQ  (VIQ),  obtaining: 

M A = 6 + 3 M1Q  - 5 MANX  + 3 GENDER  - 2 VIQ 
with  an  R2  of  .90  and  individual  correlations  (r)  with  the  criterion  of 


correlations 


MIQ  = .7 
MANX  = .4 
GENDER  = .20 
VIQ  = .00 


correlations  squared 

.49 

.16 

.04 

.00 

.69 


Note  that  the  sum  of  the  bivariate  correlations  squared 
less  than  the  R2  of  .90. 

Also  note  that  VIQ  while  uncorrelated  in  the  bivariate 
world  with  MA,  is  useful  in  the  multivariate  world.  (Some  would 
call  VIQ  here  a “suppressor  variable”;  hut  1 think  that  the  data 
is  telling  us  that  the  variable  is  just  a good  variable  to  have  in 
the  model). 

Because  of  the  issues  in  the  above  three  paragraphs,  one 
would  not  want  to  interpret  the  resulting  weights  of  the  bivariate 
correlations.  As  Harris  (1992)  suggests,  “Multivariate  statistical 
procedures  have  the  darndest  habit  of  doing  what  they  arc  designed 
to  do  (considering  context  in  finding  optimal  linear  combinations), 
rather  than  simply  confirming  what  we  think  we  know  from 
examining  univariate  statistics  taken  out  of  context,  one  variable 
at  a time.”  (p.  11)  I would  go  one  step  farther  and  snv  that  if  one 
takes  the  multivariate  stance  hy  including  multiple  variables  in  a 
regression  model,  then  one  should  not  focus  on  one  of  the  vari- 
ables in  the  interpretation  state,  as  will  he  discussed  in  the  fol- 
lowing set  t ion. 
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“Beta”  Weights  Should  Be  Used  (continued) 

what  measure  to  select  as  an  index  of  the  importance  of  an  indi- 
vidual predictor  depends  on  which  of  at  least  three  meanings  of 
“importance”  you  have  in  mind. 

(1)  If  by  Xj’s  importance  you  mean  “how  well  Xi  can  pre- 
dict V if  used  as  the  only  predictor”  then  either  riv  or  rfy  is  the 
appropriate  index  of  X*s  importance  in  this  sense  of  the  term. 

If,  on  the  other  hand,  by  X- s importance  you  mean  “how 
important  a contribution  docs  X(  make  to  the  prediction  of  Y 
u tthrn  the  context  of  the  full  set  of  m predictors”  there  are  at  least 
two  interpretations  of  “importance  of  contribution  in  the  con- 
text of  all  the  predictors”: 

(2)  You  might  mean  “how  much  of  a difference  in  subject 

k’s  predicted  score  on  Y does  his  or  her  score  on  X;  make?”  In 
this  case,  X,’s  c-score  regression  weight  (hzi)  is  the  appropriate 
index.  First,  a predictor  whose  h is  close  to  zero  clearlv  has  very 
little  to  do  with  prediction  of  Y from  the  full  equation,  since  even 
very  large  differences  in  scores  on  X;  will  have  verv  little  impact 
on  subjects’  predicted  saxes  on  Y Second,  and  more  precisely, 
if  we  could  find  a pair  of  subjects  whose  scores  on  all  predictors 
c.uvpt  Xj  were  identical,  but  who  differed  bv  one  standard-devia- 
tion unit  in  their  scores  on  X;,  the  resultant  difference  in  these 
two  subjects’  predicted  scores  tin  ^ would  be  exactly  bzi  is  a mea- 
sure of  the  rate  of  change  in  per  standard-deviation-unit  change 

in  X,,  all  other  predictors  held  constant. 

0)  Or  you  might  mean  “how  much  loss  in  predictability 
of  Y would  dropping  Xj  from  the  regression  equation  cost  us?”  It 
is  readily  shown  (Harris,  1985,  derivation  C2.6)  that  the  drop  in 
Rz  when  X,  (and  only  X,)  is  dropped  from  the  regression  equals 
h:.j(l  - R2.^),  where  R2I()lh  is  the  squared  multiple  R between  X( 
and  the  remaining  m-1  predictors.  Titus  if  each  of  the  predictors 
shares  about  the  same  proportion  of  its  variance  with  the  other 
predictors  (has  the  same  “communality”),  the  square  or  absolute 
value  of  />.,  will  rank  order  the  predictors  correctly  in  terms  of 
how  much  dropping  that  predictor  from  the  equation  would 
lower  R2.  If,  on  the  other  hand,  there  are  substantial  differences 
among  the  predictors  in  R2MJlh,  a better  index  is  the  For  r for  the 
statistical  significance  of  since  this  F equals  (drop  in  R2) 
MSrr„  where  MSW  = (1  - R2)/(\  - m - 1)  is  a constant  in- 
dependent of  which  predi<.  tor  we’re  looking  at.  (These  Fs  or  ts  for 
statistical  significance  of  individual  regression  coefficients  are 
routinely  provided  by  MRA  computer  programs. ) 

It  is  unfortunately  quite  common  for  the  measure  of  “im- 
portance” selected  bv  a given  researcher  to  match  the  sense  in 
which  “importance”  is  meant  rather  |\iorly.  Thus,  for  instance, 
one  still  sees  articles  in  which  an  author  uses  h2,s  to  select  the  host 
single  predictor  of  Y (for  which  r’(v  or  the  equivalent  though 
more  complex  is  t lie  correct  criterion),  or  in  which  the  impor- 
tance of  X/s  contribution  to  the  rc\nc^um  equation  is  purportedly 
measured  by  the  loading  of  that  predictor  on  Y (which  is  simply 
a constant  time*'  its  zero-order  correlation  with  Y and  thus  has 
nothing  to  do  with  its  mle  m the  regression  equation). 
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Cautions  and  Conditions  ( continued ) 

One  alternative  to  interpreting  the  correlation  between 
the  predictor  and  the  criterion,  the  “structure  coefficients,”  is  to 
interpret  the  beta  weights,  or  standardized  regression  weights. 
There  are  three  lines  of  thought  here:  (a)  interpret  individual 
weights,  (b)  interpret  all  weights  simultaneously,  and  (c)  make 
no  interpretation. 

Interpretation  of  Individual  Weights 

Some  statistics  books,  such  as  Hinkle,  Wiersma,  and  Jurs 
(1988),  and  therefore  some  researchers,  try  to  identify'  the  “most 
important  predictor  variable.”  As  identified  above,  this  violates 
the  multivariate  stance  they  initially  took.  Furthermore,  the  weight 
(and  therefore  “importance”)  will  fluctuate  depending  upon  what 
other  variables  are  in  the  model. 

Finally,  if  these  variables  were  not  manipulated,  then  one 
cannot  make  any  causative  conclusions  about  the  “importance” 
of  a variable.  In  the  case  3 example,  Gender  cannot  be  manipu- 
lated. Although  Gender  has  a weight  of  3,  those  who  would  plan 
to  manipulate  Gender  should  not  expect  a 3-unit  change  on  the 
criterion!  Those  who  would  manipulate  Math  Anxiety  may  find 

(a)  no  change  on  the  criterion  because  of  resistance  to  change, 

(b)  less  than  expected  change  on  the  criterion  due  to  unexpected 
side  effects,  or  (c)  more  change  on  the  criterion  because  of  a sudden 
aha  experiences.  Obviously  there  are  a myriad  of  possibilities. 
You  just  don’t  know  what  the  effect  will  be  on  the  criterion  until 
you  manipulate! 

Interpretation  of  all  Weights  Simultaneously 

Harris  (1992)  presents  some  interesting  examples  and  some- 
what convincing  arguments  for  interpreting  all  beta  weights  simul- 
taneously. There  are,  though,  several  weaknesses  in  his  examples 
and  conclusions: 

1.  all  the  examples  arc  with  R2  = 1.00,  hut  the  logic  is 
not  applicable  with  an  R2  less  than  1.00. 

2.  None  of  the  examples  arc  with  results  that  have  been 
replicated,  though  the  examples  with  physical  measurements  may 
he  assumed  to  he  replicable. 

Y The  interpretation  is  descriptive,  and  while  he  doesn't  im- 
ply causality,  neither  does  he  caution  against  causal  interpretations. 

Make  No  Interpretations 

McNeil  (1991,  1992)  has  argued  for  making  no  interpreta- 
tion of  beta  weights  until  the  following  conditions  are  met.  First, 
the  R2  should  he  very  close  to  1.00.  Second,  the  results  (including 
magnitude  of  beta  weights)  should  have  been  replicated.  Third, 
manipulation  of  manipularablc  variables  should  have  occurred. 

Summary 

In  order  lur  a c. ius.il  interpretation  to  he  made,  the  pnxlictor 
variables  must  he  experimentally  manipulated.  Without  manipu- 
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“Beta”  Weights  Should  Be  Used  (continued) 

Refrain 

To  repeat:  of  course  one  should  interpret  “beta”  weights. 
They  are  the  appropriate  basis  for  coming  up  with  an  interpreta- 
tion of  the  regression  variate,  and  if  you’re  not  interested  in  the 
regression  variate  (i.e.,  in  the  optimal  combination  of  the  predic- 
tors) vou  shouldn’t  be  conducting  an  MRA  in  the  first  place.  (If 
you're  interested  only  in  how  well  each  predictor  performs  along, 
just  compute  the  rlNs  and  test  their  statistical  significance  against 
a Bonferroni-adjusted  critical  value.)  The  bz s also  provide  the  best 
index  of  importance  of  contribution  to  the  regression  equation, 
when  hy  this  is  meant  how  much  impact  differences  in  scores  on 
Xj  have  on  predicted  scores  on  V,  and  they  are  one  of  the  two 
components  (the  other  being  what  proportion  of  X/s  variance  is 
shared  with  the  other  predictors)  in  the  most  appropriate  index  of 
importance  of  contribution  to  the  regression  equation,  when  by 
this  is  meant  how  much  it  would  cost  us  (in  terms  oi  a decrease 
in  R2)  to  drop  Xj  from  the  equation. 
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Notes 

1.  Them  is  a strong  convention  in  statistics  that  Greek  letters 
are  used  to  represent  population  parameters,  rather  than  sample 
statistics.  This  conflicts  with  the  convention  that  has  developed 
among  computer  programmers— presumably  because  of  the  difficulty 
of  printing  subscripts— of  labeling  columns  of  c-score  regression  coef- 
ficients as  BETAs.  I and  many  other  users  of  regression  analysis 
prefer  not  to  risk  misleading  readers  into  thinking  of  br s as  known 
population  values. 

2.  As  is  well  known  (e.g.,  Harris,  section  3.6),  two-group 
discriminant  analysis  and  MRA  are  logically  and  algebraically 
equivalent,  with  the  raw-score  discriminant-function  coefficients 
from  a discriminant  analysis  equaling  the  raw-score  regression  co- 
efficients for  predicting  a die  hotomousgmup-membership  variable 
from  scores  on  the  dependent  variables  and  with  the  F for  the  sta- 
tistkal  significance  oi  Hotelling’s  T:  being  identical  to  the  F lor 
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Cautions  and  Conditions  (continued) 

lation,  we  will  never  know  how  subjects  will  react.  While  predic- 
tion is  important,  once  we  have  that  predictive  capacity,  wc  want 
to  use  the  model  to  “upset  the  prediction,”  to  “control”  our  sub- 
jects. We  don't  want  to  be  satisfied,  say  in  case  3,  with  predicting 
that  John  Smith  will  score  low  on  Math  Achievement.  Knowing 
that,  and  feeling  certain  in  that  prediction,  we  should  attempt 
to  upset  that  prediction,  such  that  John  Smith  obtains,  higher 
Math  Achievement  than  predicted.  But  upsetting  the  prediction 
means  pushing  the  right  buttons  with  the  right  amount  of  pres- 
sure for  the  right  amount  of  time,  ideas  that  are  unfortunately  a 
long  way  down  the  behavioral  sciences  pathway.  Making  incor- 
rect causal  interpretations  and  pushing  buttons  prematurely  only 
serves  to  obfuscate  the  picture.  Wc  need  researchers  with  R2  of 
1.00  in  one  hack  pocket,  and  stable  weights  in  the  other,  with  the 
inclination  and  patience  to  manipulate  those  variables  such  that 
the  field  can  have  some  overdue  revelations. 
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"Beta”  Weights  Should  Be  Used  (continued) 

the  statistical  significance  of  R2  from  the  dichotomous-outcomc- 
variable  MRA.  All  the  points  made  here  about  the  interpretation 
of  h7s  in  MRA  thus  generalize  straightforwardly  to  the  interpreta- 
tion of  z -score  discriminant-function  coefficients  in  two-group 
discriminant  analysis.  And  the  conclusion  of  the  present  paper 
that  h.s  are  the  criteria  for  interpreting  one’s  regression  variate  is 
a special  case  ot  the  more  general  argument  (Harris,  1985,  sec- 
tion 5.4.3;  examples  6.4,  6.5;  section  7.6)  that  interpretation  of 
an  emergent  variable  (regression  variate,  discriminant  function, 
canonical  variate,  or  factor)  should  be  on  the  basis  of  the  weights 
used  in  compute  or  estimate  stores  on  that  emergent  variable, 
rather  than  on  the  basis  of  the  zero-order  correlations  between 
the  emergent  variable  and  single  original  variables. 
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1992  Annual  Meeting  Shows  Growth 

As  a reflection  of  the  past  successful  conferences  and 
MWERA’s  growing  membership,  the  1992  annual  meeting  of  the 
Mid-Western  Educational  Research  Association  demonstrated 
increases  in  almost  every  area.  The  1992  Program  contained  77 
sessions,  a 17  percent  increase  over  1991.  There  wree  233  presen- 
tations (a  20  percent  increase)  and  533  participants  (a  37  percent 
increase).  The  growth  was  very  broad,  involving  most  divisions.  As 
was  true  in  1991,  the  most  sessions,  most  presentations,  and  the 
most  participants  were  scheduled  by  Division  K,  Teacher  Educa- 
tion. The  conference  featured  a Wednesday  evening  presentation 
and  keynote  address  (included  in  this  issue)  by  Thomas  Good, 
Univcrsitv  of  Missouri-Columbia.  The  President’s  Address  (in- 
cluded in  this  issue)  and  Division  Meetings  were  reinstituted  in 
1992  after  a one-year  absence.  A report  from  the  Membcr-at- 
Large  will  appear  in  the  next  issue  of  the  Mid -Western  Educational 
Researcher.  (information  taken  from  Riduird  Pugh's  W Report) 

New  Editorial  Board  Members  Appointed 

The  Editors  wish  to  express  their  tanks  to  Laura  L.  B. 
Barnes,  Oklahoma  State  University;  Robert  L.  Brennan,  American 
College  Testing  Program;  Ayers  G.  D’Costa,  Ohio  State  University; 
Judson  A.  Harmon,  Wisconsin  Department  of  Public  Instruction; 
and  Jay  R.  Price,  University  of  Wisconsin- Stevens  Point  for  their 
service  on  the  Editorial  Board  of  the  Mid-Western  Educational 
Researcher . Their  time  in  reviewing  manuscripts,  efforts  in  providing 
direction,  and  professional  status  that  they  contributed  to  the 
publication  was  greatly  appreciated.  Replacing  Avrcs  D'Costa  will 
lx*  Immediate  Past  President  Barbara  Plake.  New  Editorial  Board 
members  include  Carolyn  Benz  and  Mary  Sudzina,  University  of 
Dayton,  and  Orpha  Ducll,  Wichita  State  University. 


Two  New  Publications  from  ERIC 

In  Our  Oun  Words:  Community  Story  Traditions  to  Prevent 
and  Heal  Substance  Abuse  by  Michael  Tierney  and  Managing 
Smallness:  Promising  Fiscal  Practices  for  Rural  School  District  Ad - 
ministrators  bv  Deborah  Inman  Freitas  have  recently  been  pub- 
lished by  the  ERIC  Clearinghouse  on  Rural  Education  and  Small 
Schools.  They  are  available  for  $10  each  from  ERIC/CRESS, 
P.O.  Box  1348,  Charleston,  WV  25325. 

Two  More  Ways  to  Be  Involved  at  AERA 

A special  interactive  session,  “Perspectives  on  Scholarship 
in  Teacher  Education,”  is  going  to  be  held  at  the  AERA  annual 
meeting  to  be  in  Atlanta.  Research  on  faculty  roles  defined  by 
policy  statements,  and  expressed  by  education  students,  faculty, 
deans,  and  the  general  public  will  be  presented.  A summary  of 
each  study  will  be  sent  by  U.S.  mail  or  e-mail  before  the  confer- 
ence. It  is  hoped  that  those  attending  will  have  read  the  summaries 
and  will  be  able  to  actively  participate  by  providing  their  perspec- 
tive and/or  the  policies  and  procedures  of  their  institution. 

As  part  of  a research  study,  “Home  Schoolers  On-Line,” 
to  be  presented  at  AERA,  your  questions  are  being  solicited.  Please 
send  one  to  three  questions  that  you  have  for  home  schooling 
parents.  The  questions  will  be  posted  on  a computer  bulletin 
board  used  extensively  by  home  schooling  parents.  The  responses 
will  be  reported  at  AERA. 

To  participate  in  cither  of  the  above  projects  please  contact 
Greg  Marchant,  Educational  Psychology,  Ball  State  University, 
Muncie,  IN  47306  or  e-mail  00GJ MARCH ANT@BSU VAX  1. 


Letters  to  the  uResearcher}} 


1 am  writing  to  express  my  disappointment  in  the  presen- 
tation made  bv  the  luncheon  speaker  at  the  1992  MWERA  annual 
meeting.  I want  to  begin  by  saying  that  1 am  in  no  way  being 
critical  of  Richard  Pugh  who  arranged  to  have  the  speaker.  It  is 
mv  understanding  that  he  identified  the  luncheon  speaker  based 
on  advice  by  several  MWERA  members  who  strongly  recom- 
mended the  presenter. 

1 also  want  to  say  that  l fullv  recognize  that  finding  a good 
luncheon  speaker  (and  delivering  a luncheon  address)  h not  an 
easy  task.  There  is  the  tension  between  entertaining  the  audience, 
on  the  one  hand,  and  making  a meaningful  contribution  to  the 
conference  on  the  other... all  of  this  over  banking  forks  and 
hushed  conversations. 

I low  ever,  it  is  ex.u  tlv  on  the  above  twoi  ritcria  (entertain- 


ing the  audience  and  making  a meaningful  contribution  to  the 
conference)  that  I found  the  1992  luncheon  speaker  unacceptable. 
First,  with  regard  to  entertainment  value,  there  were  parts  of  the 
presentation  that  were  quite  humorous.  I especially  liked  the  times 
when  he  made  me  laugh  at  mvself  or  gave  me  suggestions  (perhaps 
not  useful,  hut  entertaining  nonetheless)  on  ways  to  handle  un- 
pleasant people  (like  hanging  up  in  the  phone  conversation  when 
I am  doing  the  talking).  There  were  also  parts  of  the  speech, 
probably  intended  to  be  humorous,  that  were  simply  offensive. 
He  took  the  opportunity  to  make  direct  or  indirect  slurs  at  dis- 
advantaged groups  in  a tasteless  manner.  I was  especially  offended 
bv  the  dichotomy  of  “Bright”  people  and  “Poor”  people;  as  if  to 
infer  that  bright  people  are  rich  and  less  intelligent  people 
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Letters  to  the  Editor  (continued) 

are  poor.  Another  point  that  was  extremely  offensive  to  me  was 
the  comment  about  foreign  students;  both  his  self-admitted  in- 
ability to  distinguish  among  them  and  therefore  using  a degrading 
numbering  svstem  and  his  statement  about  sending  foreign  stu- 
dents to  work  with  colleagues  as  revenge.  Therefore,  I feel  that  the 
presentation  was  too  offensive  to  be  entertaining. 

The  second  evaluative  criterion,  the  one  of  meaningful 
contribution,  was  also  not  met.  1 could  see  no  thoughtful  organi- 
zation to  the  presentation;  it  was  merely  joke-telling  and  meander- 
ings.  If  there  was  a scholarly  message  in  the  content  of  the  pre- 
sentation, I missed  it! 

MWERA  is  a wonderful,  supportive  organization  that 
purports  to  support  educational  professionals.  The  conference 
had  manv  strong  components.  However,  I believe  that  the  organi- 
zation has  the  right  to  expect  more  from  its  featured  speakers. 
We  missed  the  opportunitv  to  grow  through  scholarly  input.  More 
importantly,  under  the  auspices  of  MWERA,  the  speaker  made 
rude  and  inappropriate  comments  that  were  offensive  to  many 
of  our  members. 

I am  seriously  disappointed  that  the  organization  spon- 
sored a presentation  that  was  offensive  and  provided  no  substantial 
contribution  to  the  conference.  I hope  the  people  who  felt  offended 
will  understand  that  the  actions  and  behaviors  of  the  presenter 
were  not  representative  of  the  concerns  and  philosophy  of  the 
organization. 

Barbara  S.  Flake,  Ph.D. 

Immediate  Past  President 


The  annual  meeting  of  the  Mid-Western  Educational 
Research  Association  almost  always  includes  presentations  bv 
invited  speakers.  The  Fourteenth  Annual  Meeting  held  Octo- 
ber H-17, 1992,  was  no  exception.  The  Program  followed  the  usual 
pattern  and  scheduled  invited  speakers  for  an  Invited  Address  on 
Wednesday  evening,  a Keynote  Address  on  Thursday  morning, 
and  a Luncheon  Address  on  Friday. 

Because  of  reactions  from  many  of  those  in  attendance  at 
the  Luncheon  Address  on  Friday,  the  Executive  Committee  wishes 
to  respond  to  the  expressions  of  dismay  from  some  of  those  in 
attendance.  The  views  and  opinions  expressed  by  the  speaker 
during  the  Luncheon  Address  offended  a substantial  number  of 
individuals  present,  including  members  of  the  Executive  Com- 
mittee. Some  of  those  in  attendance  stated  their  object ioa<  directly 
to  the  speaker  following  the  address.  The  Executive  Committee 
wishes  to  express  its  concern  to  the  membership.  The  Executive 
Committee  was  displeased  bv  the  insensitivity  of  some  of  the 
speaker’s  remarks,  and  dccplv  regrers  nnv  offense  provoked  by 
the  remarks. 

— Rk  hard  Pugh  and 
the  MWERA  Executive  Committee 


In  Response  to  the 

“Mid-Western  Educational  Researcher’s ” 
Special  Multicultural  Education  Issue 

Brant  Abrahamson, 

Riverside-Brookfield  High  School 

Thank  vou  for  the  Spring  1992  issue  of  the  Mid -Western 
Eduoirtondi  Researcher.  I have  been  trying  to  keep  up  with  various 
multicultural  arguments  and  positions.  In  this  material  I found  the 
views  of  Asa  Hilliard  to  be  the  most  interesting.  Most  of  my  com- 
ments relate  to  his  interview  with  some  notes  on  other  authors. 

Hilliard  says  that  peoples’  way  of  acting  “does  not  have 
anything  to  do  with  biology,"  but  it  seems  to  me  that  the  thrust 
of  his  argument  is  to  equate  or  grossly  overlap  the  two.  Why  else 
would  he  use  the  term  “race,”  which  has  overwhelming  biologi- 
cal connotations.’ 

Sure,  students  differ  in  learning  styles,  and  to  a degree  a 
particular  style  can  be  sociologically  correlated  with  such  factors 
as  skin  color,  gender,  language,  ethnic  background,  left-handedness, 
regionalism,  aptitude,  family  solidarity  and  probably  many  other 
student  categories.  These  differences  tell  me  that  as  a teacher  I 
should  strive  to  use  a variety  of  teaching  methods  to  accommodate  ■ 
as  many  learning  styles  as  possible.  However,  I do  not  believe 
that  it  is  helpful  to  try  to  pigeonhole  students  so  that  each  tiny 
group  can  be  taught  in  a way  that  adheres  to  some  social  scien- 
tist’s statistical  correlations.  This  is  guilt  by  association,  and  these 
classes  may  even  accentuate  the  differences  that  they  were  de- 
signed to  counteract. 

Given  the  recent  data  on  the  reduced  life-spans  of  left- 
handers, I could  make  a strong  argument  that  the  right-handed 
people  have  victimized  me  because  I am  left-handed.  I can  further 
argue  that  a special  class  for  left-handers  should  be  established— 
a class  that  focuses  upon  the  learning  difficulties  of  the  10  to  20 
percent  of  our  students  who  are  left-handed.  In  addition,  I could 
probably  argue  that  1 am  uniquely  qualified  to  teach  such  a class 
because  1 am  left-handed  and  know  from  “authentic”  experience 
what  it’s  like  to  he  a lefthander  in  a right-handed  world. 

Are  such  lines  of  reasoning  helpful?  Educators  probably 
should,  at  times,  select  out  for  special  attention  students  who 
have  extreme  physical  or  learning  difficulties — or  exceptional  talents. 
But,  one  must  he  very  careful  even  with  this  kind  of  pigeonholing. 
It  is  verv  easy  to  get  to  process  reversed.  I could,  for  instance 
notice  a student’s  left- handedness  and  assume,  therefore,  that  he 
or  she  is  dyslexic,  a relatively  common  problem  of  left-handers. 
Similarly  it  is  verv  easy  for  so-called  “g..ud  and  talented”  programs 
to  be  abused.  Mv  general  impression  is  that  methodologies  touted 
as  appropriate  for  gifted  children  are  desirable  for  most  children 
if  they  could  be  in  classes  as  small  as  those  typically  associated 
with  giftedness. 

If  Hilliard’s  ideas  on  the  distinctive  Afro-American  learn- 
ing styles  are  interpreted  to  mean  that  separate  curricula  or  class- 
rooms or  should  be  established,  I disagree  for  the  reasons  mentioned 
earlier.  Separation  will  increase  the  differences  that  exist  in  our 
society,  and  our  problems  as  a nation  will  multiply.  I don’t  agree' 
with  Hilliard’s  statement  that  the  problem  revolve*  around  “some 
liberal  types  [who]  refuse  to  acknowledge  differences.” 
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In  Response  to  “MWER”  (continued) 


1 ha\'c  no  basic  objections  to  his  answer  to  the  question, 
“How  can  schools  become  more  democratic?”  (p.  24)  unless  he 
is  arguing  that  it  is  the  duty  of  the  schools  to  preserve  students 
particular  ethnic  identities.  Educators  should  not  impose  upon 
students  some  “duty”  to  maintain  their  separatist  ethnic  roots.  If 
they  wish  to  do  so,  fine.  When  relevant,  classroom  projects  should 
allow  them  to  plug  into  their  traditions  as  with  other  aspects  of 
their  lives  outside  of  the  classroom.  If  they  want  to  disregard  their 
ethnicity  and  identify  with  the  larger  American  society,  that  option 
should  also  be  available  to  them. 

In  educational  research  I think  that  it  is  a good  idea  to 
include  a researcher  from  the  group  being  studied,  as  Hilliard 
suggested.  A large  scale  study  on  left-handedness  would  benefit 
from  having  the  individual  perspectives  of  a left-handed  social 
scientist  when  discussing  formative  aspects  of  the  research  de- 
sign. I consider  this  to  be  an  important  guideline,  but  only  one 
among  many  others.  James  Bover  in  his  article  makes  the  same 
point,  but  I am  very  troubled  by  his  suggestion  that  no  research 
is  “authentic”  unless  a member  of  the  studied  group  is  on  the 
research  team  (p.  7 and  8).  He  has  restricted  the  term  “authentic 
research”  to  those  studies  where  target  group  people  arc  also 
the  researchers.  This  use  of  the  word,  “authentic”  is  non-standard, 
propagandistic  and  results  in  confusion.  No  animal  research 
can  be  “authentic.”  According  to  Boyer,  none  of  the  R-B  school 
committees  are  doing  “authentic  research”  because  students  are 
not  fundamentally  involved  in  the  committee  organization  or 
decision-making. 

From  a practical  standpoint  I think  that  focus  group  in- 
volvement in  research  designs  is  very  desirable.  I think  that  stu- 
dents should  be  involved  in  R-B’s  committees.  When  I worked 
with  the  Earthwatch  folks  on  Aboriginal  rock  art  in  northern 
Australia,  the  Wardaman  people  participated  in  organizing  the 
research.  If  any  one  of  them  said,  “No!”  that  was  it.  Overall  I think 
that  the  research  was  improved  as  a result.  Although  more  time- 
consuming  and  expensive,  the  Wardaman  became  research  allies, 
not  opponents.  They  contributed  their  oral  understandings  of  the 
shelter  art  that  vve  were  studying,  and  our  leaders  learned  much 
that  would  not  have  become  known  otherwise. 

Nonetheless,  I hope  we  do  not  get  to  the  point  where 
social  scientific  investigators  think  that  research  should  be  cate- 
gorized in  some  fundamental  way  as  “authentic”  or  “basic”  depend- 
ing upon  researchers’  various  ascribed  groupings.  This  dccon- 
structionist  viewpoint  is  cxtremelv  dangerous  in  my  view,  and 
1 reject  it. 

My  comments  and  criticisms  of  the  other  articles  come 
from  the  same  perspectives.  Africa n-Amer it  an  male  academies 
make  me  very  nervous.  I do  nor  share  Midgettes  enthusiasm. 
The  advantages  that  he  claims  for  such  schtxds  can  be  found  in 
any  well-managed  school.  I see  no  reason  to  believe  that  these 
sex  and  race  segregated  schools  will  be  intrinsically  superior  in 
the  long  run — after  the  euphoria  of  newness  has  evaporated.  1 
believe  that  the  bulk  of  the  research  over  the  years  has  pointed 
m an  opposite  direction.  Have  we  already  forgorten  about  Brown 
\s.  the  Board  of  Education  of  "Topeka,  Kansas,  data? 


“Does  Direct  Experience  Change  Education  Students’ 
Perceptions  of  LowHncomc  Minority  Students?”  Haberman  and 
Post’s  findings  are  not  so  revolutionary,  hut  their  reactions  to  their 
findings  are  quite  interesting. 

The  major  finding  of  this  study  supports  the  remarkable 
phenomenon  of  students  generally  using  their  direct 
experiences  to  selectively  perceive  and  reinforce  their 
initial  preconceptions.  Students  who  expected  to  find 
problems  did  so.  Those  who  thought  they  could  practice 
instructional  methods  did  so.  Those  w'ho  though  there 
would  be  discipline  problems  found  them.  (p.  30) 

A “remarkable  phenomenon”?  Selective  perception  is  a 
durable  and  standard  sociological  concept  that  \vc  use  frequently 
in  class.  Their  research  does  however,  point  up  the  difficulties  of 
permanently  changing  student  out-group  attitudes.  Apparently 
even  problems  which  include  extended  cultural  interaction  have 
only  limited  effects. 

1 believe  schools  need  to  use  both  intellectual  and  affec- 
tive approaches  to  prejudice  reduction.  Documented  interview 
or  papcr/pencil  attitudinal  change  probably  will  not  be  very 
durable  unless  school  efforts  are  supported  and  reinforced  by 
media  producers  and  many  parents  as  well  as  local  and  national 
leaders.  As  long  as  cultural  opinion  formulators  play  their  various 
“race  cards,”  I am  not  confident  that  w*e  will  become  much  more 
united  as  a society  regardless  of  what  is  done  in  the  schools. 


New;  Direction  in  Research  References 
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Reflections  on 

“ The  Unschooled  Mind”: 

An  Interview  with  Howard  Gardner 


Jacqueline  Anglin,  Bcrrv  College 

q In  your  most  recent  book 
J The  Unschooled  Mind,  you 
have  been  credited  for  “untangling 
the  mysteries  of  learning  and  the 
current  state  of  cognitive  research.” 

From  your  point  of  view,  what  is  the 
current  state  of  cognitive  research? 

□ Ot  course,  cognitive  research  is  a 

gigantic  topic.  I'm  interested  in 

childrens  cognition  and  students'  cog- 
nition. What  1 particularly  focused  on  in 
the  hook  wa^  a surprising  discovery 
made  over  the  past  20  years. 

In  school  students  are  often  con- 

sidered  to  have  a gixxi  understanding  of 

the  material  if  thev  can  perform  well  on 

tots.  And  yet  when  you  actually  remove 

those  same  students  from  the  testing  u , _ f 

, , , ilou’dra  Gardner  is  a f 

nx>m  context,  you  can  see  whether  they  /n  . 

. . . , .11  i director  of  Project  tero  at 

Imvc  ,mlv  mastcraJ  «>nccpts,  skills,  and  o/  FJuca[il/n<  a Tcscarc 

facts  ai id  so  on.  If  you  can  place  stu-  Veterans  Administration 

dents  in  a situation  where  those  con-  professor  of  neurology  at 

tepts,  facts,  and  skills  are  relevant,  stu-  of  Medicine.  His  most  n 

dents  typically  fail  to  draw  on  their  Mind”  ie as  the  focus  of 

knowledge.  Even  our  best  students  in 

the  best  schools  don't  get  it.  For  instance,  they  don't  know  how  to 
use  Newton’s  laws  to  explain  what  happens  when  you’re  throwing 
a frishee;  they  just  haven’t  been  able  to  make  a connection.  So 
even  though  you  give  the  students  degrees  and  call  them  educated, 
the  research  shows  that  most  people  do  not  think  about  the  phys- 
ic al  world,  the  social  world,  and  their  own  world  very  differently 
from  the  wav  that  they  did  when  they  were  five  years  of  age. 

Mv  book  is  called  The  Ur  schooled  Mind  because  I’m  try- 
ing to  describe  what  the  five-year-old  mind  is  like.  Most  of  us 
walk  around  thinking  like  five-year-olds,  except  in  areas  wheie 
we’re  experts.  Usually  individual , arc  only  experts  in  one  or  two 
areas,  areas  where  thcv've  worked  for  about  10  years.  When  you’re 
an  expert,  vou  rcallv  do  think  differently  about  the  world.  Most 
of  us  in  education  am  expert  readers,  in  the  sense  that  \vc  read 
very  quickly.  We  forget  what  it  was  like  to  sound  things  out  or 
dedm  e meanings  from  illustrations.  But  most  of  us  arc  not  experts 
in  understanding  the  physical  world,  the  biological  world  or  the 
psychologic  al  world.  Yet  if  we  go  to  school,  we  may  think  we  arc 
e\| vits  until  somcknJv  c nines  around  and  shows  that  we  can’t 
rcalh  uh’  that  knowledge. 


Howard  Gardner  is  a professor  of  education  and  co- 
director of  Project  Zero  at  the  Harvard  Graduate  School 
of  Education , a research  psychologist  at  the  Boston 
Veterans  Medical  Center  and  an  adjunct 

professor  of  neurology  at  the  Boston  University  School 
of  Medicine.  His  most  recent  book,  ‘ ‘ The  Unschooled 
Mind”  teas  the  focus  of  this  interview. 


q The  research  teams  that  you 
— direct  at  Project  Zero  are  in- 
terdiscipl inary  and  focus  on  alter- 
native assessments.  What  research 
methodologies  have  served  Project 
Zero  particularly  well? 

^ Project  Zero  has  been  in  exist- 

cncc  for  about  25  years.  Over  the 

course  of  that  time  we  have  used  most 
of  the  traditional  research  methodolo- 
gies. There  have  been  hundreds  of  ex- 
periments with  control  groups,  statistical 
analyses,  and  that  kind  of  thing.  We’ve 
done  many  case  studies  of  individuals, 
classes,  teachers,  and  curricula.  We’ve 
done  a lot  of  observational  and  descrip- 
tive research  where  we  work  with  stu- 
dents. For  example,  we  observe  what  it’s 
like  when  they’re  learning  a new  kind 

z j t of  curriculum.  We  try  to  figure  out 

or  oj  education  and  co-  ( 

award  Graduate  School  what  s g°in§  on  nnd  cr';ate  appropriate 
thologist  at  the  Boston  storing  systems,  and  the  like. 
ul  Center  and  an  adjunct  So  I would  say  that  we're  conv 

osfon  University  School  mitted  to  being  eclectic.  There  is  a peren- 

look,  “The  Unschooled  nial  tension  in  the  educational  research 

lterrieic.  world  between  quantitative  and  quali- 

tative research.  Wc  take  the  position 
that  the  problems  should  dictate  what  sorts  of  methods  you  use 
rather  than  simply  embracing  one  kind  of  method  or  another. 

Quality  research  can  use  a variety  of  methods.  If  you’re 
trying  to  test  a hypothesis,  usually  descriptive  or  qualitative  methods 
are  not  very  successful.  On  the  other  hand,  if  you  are  trying  to 
understand  what  it’s  like  to  learn  about  something  new,  the  experi- 
mental method  is  usually  pretty  impoverished.  At  present,  a lot 
of  the  work  that  we’re  doing  really  involves  action  research.  We 
go  in  as  researchers  with  our  own  conceptions  and  expectations, 
but  we’re  not  simply  observing  teachers  and  students,  we’re  ac- 
tually involved  in  formulating  the  lessons  and  bringing  out  the 
criteria  that  will  he  used  for  assessment.  Sometimes,  even  in  co- 
teaching, we  arc  coaching  the  teachers. 

When  you  get  involved  in  action  research,  you  realize 
there  are  certain  limitations  on  the  kind  of  conclusions  you  can 
draw  because,  in  a sense,  you  arc  part  of  the  treatment.  But  if  you 
arc  trying  to  conduct  educational  innovation,  it’s  just  imjwsihle 
to  give  somekxiv  a book  and  say  “do  it”;  it  dcxsnt  work  that 
way.  You  have  to  roll  up  your  sleeves,  help  and  coach,  learn  irotn 
mistakes,  discuss,  use  feedback  and  so  on.  So  vou ’re  a little  bit 
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An  Interview  with  Howard  Gardner  (continued) 


more  like  nn  anthropologist,  actually  living  in  the  hush  along 
with  other  people;  you  have  to  tolerate  that  degree  of  ambiguity 
or  mossiness  in  order  to  he  able  to  do  the  studies  at  all. 


I q ] Could  you  elaborate  on  one  of  the  projects  in  process 
' ' at  Project  Zero?  Perhaps  Spectrum.  Could  you  des- 

cribe a trail  the  research  has  taken? 


^ Spectrum  is  actually  an  interesting  example  in  that  regard. 

The  ideas  for  Spectrum  were  developed  by  David  Feldman 

and  myself  right  after  Frames  of  Mind  was  published  in  1983.  In 
Frames  of  Wind  I argued  that  people  have  different  kinds  of  intelli- 
gences, and  that  different  people  don't  have  the  same  profile  of 
intelligences.  So  the  question  arose— even  when  kids  are  as  young 
as  at  three,  four,  or  five  years  of  age,  do  they  already  have  different 
profiles  of  strengths  and  weaknesses?  If  you’d  asked  me  10  years 
ago  what  1 was  going  to  do,  I probably  would  have  said  “Develop 
seven  tests,  one  for  each  intelligence.”  I was  still  a victim  of  the 
notion  that  tests  arc  something  that  people  take  at  a certain  his- 
torical moment.  You  examine  them  for  an  hour  or  so  and  then 
you  give  them  a score.  But  I’ve  had  increasing  misgivings  about 
that  whole  psychometric  approach. 

What  ultimately  happened  with  Spectrum  was  this:  we 
created  an  environment,  the  Spectrum  classroom  which  is  sort 
of  like  a children’s  museum.  It’s  very  richly  endowed  with  all  sorts 
of  materials  that  kids  find  interesting:  we  don’t  include  any  materials 
unless  we  know  that  kids  like  them.  We  watch  the  kids  over  the 
course  of  the  year,  both  in  free  play  and  in  more  structured  tasks 
that  we  devised.  At  the  end  of  the  year,  we  write  a so-called  Spec- 
trum report.  That  report  is  a prose  account  of  a child’s  particular 
intellectual  profile  at  that  moment  in  his  or  her  life,  along  with 
some  suggestions  or  recommendations  of  what  ought  to  be  done 
with  that  child  if  you  want  to  build  on  strength  as  opposed  to 
areas  of  weakness. 

Now  that’s  how  Spectrum  ought  to  be  used  in  a regular 
classroom  where  the  school  has  some  interest  in  children  but  isn’t 
really  primarily  oriented  toward  research.  Any  teacher  who  has 
had  some  exposure  to  thinking  in  terms  of  multiple  intelligences 
categories,  some  exposure  to  the  kids  interacting  with  the  materials 
that  we’ve  devised,  ought  to  be  able  to  get  at  least  a rough-and- 
ready  description.  For  example,  one  might  conclude  that  a given 
child  is  very  strong  in  music,  and  strong  in  certain  aspectsof  spatial 
but  is  insensitive  to  interpersonal  issues.  I don’t  think  any  teacher 
should  want  to  do  more  than  that  with  a four-  or  five-year-old; 
it  would  not  he  an  optimal  use  of  time. 

On  the  other  hand,  we  have  some  quite  specific  research 
questions  we’re  interested  in.  For  example,  how  stable  am  children’s 
intelligences  over  time?  How  docs  performance  in  a Spectrum 
environment  compare  to  performance  on  an  l.Q.  test?  For  such 
purposes,  it’s  important  that  we  adopt  a more  structured  approach. 
So  we  familiarize  kids  with  the  materials  in  a Spectrum  classroom 
and  then  we  introduce  some  tasks  which  the  kids  haven’t  seen 
before.  That  wav,  we  can  get  a sc  ore  which  reflects  the  child’s 
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developmental  level:  Is  this  child  a novice  or  journeyman  or  begin- 
ning to  master  this  particular  Spectrum  domain?  That  kind  of 
approach  is  necessary  if  you  want  to  answer  questions  of  a scien- 
tific nature,  hut  it’s  not  something  that  is  necessary  for  most 
teachers.  I think  it  would  be  burdening  to  have  teachers  administer 
every  task  with  every  kid  and  it  wouldn’t  be  necessary.  On  the 
other  hand,  if  you  want  to  test  hypotheses,  then  you  need  to  have 
more  control  over  what  is  happening.  Spectrum  is  now  used  in 
several  other  sites  around  the  country.  Sometimes  it’s  used  for 
research  purposes.  Sometimes  it’s  used  as  an  effective  classroom 
approach,  which  one  nourishes  a lot  of  students’  intelligences, 
and  helps  them  to  become  engaged  in  a subject,  and  provides  new 
challenges  as  kids  master  the  material  that  they  have  been  given. 


One  term  that  you  continue  to  use  is  “teacher  as  cur- 
riculum broker.”  Could  you  elaborate  on  that  concept? 


^ You  could  take  the  position  that  every  person  ought  to  be 

1 taught  the  same  thing  in  the  same  way,  and  indeed  school 

would  he  very  easy  to  do  if  wc  could  assume  that  one  curriculum 
taught  in  one  way,  is  the  best  for  everybody.  But  we  have  a few 
thousand  years  of  exper  iCP.CC  i ’hat  suggests  that  that’s  not  true. 
The  conclusion  you  could  draw  is  that,  well,  some  kids  arc  so 
stupid  that  they’re  not  going  to  learn  and  so  we’ll  focus  on  those 
who  do  learn  and  understand  the  curriculum  in  the  same  way. 
However,  you  can  take  the  position  that  curricula  ought  to  offer 
some  choice,  and  even  when  there  is  a mandated  curriculum, 
lessons  don’t  have  to  he  presented  in  the  same  way  to  each  child. 
Everybody  should  learn  geometry  or  history,  I have  no  objection 
to  that,  hut  it’s  hardly  necessary  for  everybody  to  learn  geometry 
and  history  in  exactly  the  same  way. 

When  I talk  about  teachers  as  being  curriculum  brokers, 

1 mean  two  things.  First,  that  to  the  extent  you  have  electives, 
the  teacher’s  job  ought  to  be  to  help  the  students  locate  the  kinds 
of  things  that  they  might  find  interesting  and  be  good.  But  even 
in  those  areas  where  the  curriculum  is  mandated,  the  teacher’s 
job  is  to  be  very  sensitive  to  the  learning  styles,  and  intellectual 
strengths  of  the  kids  in  the  class.  To  the  extent  possible,  the  teacher 
should  provide  the  materials— hardware,  software,  and  peer  inter- 
actions and  the  like— which  would  help  that  particular  child  do 
the  best  that  he  or  she  can. 

Often  we  talk  about  treating  kids  equally  by  giving  them 
all  the  same  treatment.  I think  that’s  actually  a way  of  treating 
kids  very  unequally.  In  that  case  you’re  consciously  biased  toward 
the  kids  who  happen  to  find  that  particular  treatment  congenial. 
So  wc  might  say  that  kids  arc  really  treated  equal,  when  each 
kid  is  getting  the  optimal  chance  to  learn;  and  if  the  teacher  isn’t 
going  to  he  the  broker,  I don’r  know  who  could  he. 


j q j You  often  speak  about  the  reform  movements  as 
1 ! trying  to  make  schools  uniform,  using  one-dimen- 

sional metrics  in  assessment.  Could  you  discuss  current 
reform  efforts?  (continued  on  jniRC  .?()) 


An  Inter*-'  v with  Hoivard  Gardner  (continued) 


j ^ I As  l said,  it  is  actually  easier  to  run  a school  if  it's  uniform. 

People  teach  the  same  stuff,  in  the  same  way,  people  wear 

uniforms  and  so  on.  Kids  are  pretty  resourceful,  so  some  of  them 
do  manage  to  survive  in  such  an  environment  even  though  it’s 
not  tailor  made  for  them.  But,  the  notion  that  we  can  place  a 
child  with  reference  to  every  other  child  as  if  there  was  a single 
scholastic  hierarchy,  is  a tremendous  arrogance.  The  I.Q.  test, 
which  was  developed  for  one  purpose,  ended  up  being  the  major 
way  in  which  we  think  about  school  in  general— the  smart  kids 
and  the  dummies.  The  smart  kids  are  born  smart;  we  know  they 
should  be  pushed  ahead  as  far.  as  possible  and  too  bad  for  the 
rest.  And  so  you  needed  to  have  a more  fine-grained  analysis  of 
intelligence.  There  is  something  like  scholastic  smarts  and  maybe 
it’s  helpful  if  you  have  that  kind  of  smarts  to  do  well  in  school. 
But  life  is  a lot  more  complicated  than  school,  and  there’s  a lot 
of  ways  “to  do”  school. 

Most  of  us  have  a notion  that  school  has  to  be  the  way 
we  remember  it,  and  that’s  just  rubbish.  The  school  can  be  thou- 
sands of  different  ways.  Since  we  have  thousands  of  different 
kinds  of  kids,  probably  school  should  be  done  a thousand  dif- 
ferent kinds  of  wavs. 


to  show  the  kinds  of  things  that  they’re  supposed  to  show. 

Even  if  you  have  good  curriculum  and  assessment,  if 
teachers  don’t  like  them,  believe  in  them,  buy  them,  embody 
them,  or  don’t  want  to  use  them,  again  they’re  worth  very  little. 
There  are  many  interesting  curricula  and  assessment  materials 
developed  in  the  sixties  which  arc  not  used  today  because  teachers 
never  bought  into  them.  1 think  that’s  partly  the  teachers’  fault, 
but  it’s  also  partly  the  fault  of  the  makers  of  these  materials  who 
didn’t  think  enough  about  where  the  teachers  buy  into  the  stuff 
and  want  to  use  it,  the  community  may  not  want  it.  The  com- 
munity may  want  everything  done  with  the  Abracadabra  "lest 
of  Basic  Skills  or  the  SAT  or  with  a monotone  curriculum,  based 
on  a monotone  textbook.  In  such  a case,  the  best  motives  on  the 
part  of  the  school  folks  aren’t  going  to  amount  to  anything.  I 
don’t  spend  my  time  trying  to  educate  the  community,  but  some- 
body needs  to  do  this.  Alas,  the  tone  of  political  rhetoric  about 
education  in  this  country  is  an  embarrassment. 

j q What  questions  would  you  have  like  me  to  ask? 


q You  mention  that  successful  school  reform  will  de- 

’ pend  equally  on  assessment,  curriculum,  teacher 

education,  and  community  support.  You  refer  to  these  as 
the  “four  nodes”  of  school  reform.  Can  you  talk  about  how 
your  work  is  addressing  any  or  all  of  these  contexts? 

In  truth,  that  formula  is  more  of  a sign  of  my  own  learning 

1 ' than  it  is  an  original  discovery.  Ten  years  ago  when  l got 

into  the  business  of  school  reform,  I figured  that  if  we  would  just 
change  assessment,  everything  else  would  take  care  of  itself.  But 
the  truth  is  that  you  can  have  very  good  assessments  but  they’re 
worthless  if  teachers  don’t  have  the  curricula  which  demonstrates 
student  learning.  Many  people  say,  “Oh,  send  us  the  alternative 
assessment  kit  or  send  us  the  portfolio  kit”  but  they  don’t  change 
their  practices  and  so  you  end  up  with  demonstrating  no  student 
learning  at  all.  So  assessment  needs  a curriculum  that’s  good 
enough  for  it;  to  put  it  another  way,  if  you  have  a good  curricu- 
lum, you  need  to  have  an  assessment  which  shows  that  the  cur- 
riculum is  working.  Alas,  a lot  of  people  now  embrace  interesting 
curricula  but  use  the  same  stupid  old  tests  that  don’t  even  begin 


A As  researchers,  we’re  developing  lots  .T  new  ideas  about 

1 * curriculum,  assessment,  and  about  research  methodology'. 

People  who  are  involved  in  teacher  education  and  educational 
research,  I believe,  have  an  obligation  to  apply  these  ideas  to  our- 
selves. We  shouldn’t  just  think  of  other  folks  as  the  problem  or 
as  the  enemy.  We  have  to  look  at  our  own  teaching.  Arc  we  teach- 
ing effectively?  Can  we  demonstrate  what  our  students  are  learn- 
ing? Are  we  making  use  of  research  findings?  Arc  our  curricula 
as  good  as  they  can  be?  Are  they  as  up-to-date  as  they  can  he? 
Arc  our  assessments  worthy  of  what  we’re  telling  other  people  to 
do?  I’m  sure  I’m  not  alone  in  saying  that  many  of  us  have  not 
been  physicians  healing  ourselves.  We  instead  assume  everything 
is  fine  with  us,  that  problems  lie  elsewhere.  And  so,  l would  en- 
courage people  interested  seriously  in  reform  to  look  at  their  own 
practice,  at  the  findings  of  their  own  research,  and  at  their  own 
training  of  future  teachers.  Those  of  us  who  train  teachers  are  in 
a very  powerful  position  because  we  model  what  we  think  good 
teaching  is.  If  we  do  nothing  hut  lecture  and  give  short  answer 
tests,  we  can  hardly  expect  our  students  to  go  out  and  to  become 
innovative  teachers.  That’s  a big  job,  it  reminds  us  that  it’s  not 
easy  to  change  the  rest  of  American  education  either. 
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Teacher  Assessment  Literacy: 
Teachers’  Competencies  in 
the  Educational  Assessment  of  Students 

By  Barbara  S.  Plake,  University  of  Nebraska-Lined n 


Abstract 

It  has  been  estimated  that  teachers  are  involved  in  assessment- related  activities  up  to  50  percent  of  the  time.  However,  teacher 
training  programs  frequently  do  not  contain  specific  training  in  educational  assessment  or  testing.  In  order  to  identify  assessment  com- 
petencies for  development  of  training  materials  in  educational  assessment  for  inservice  teachers,  a national  survey  was  undertaken  to 
measure  teacher  knowledge  in  assessment  and  testing.  The  instrument  was  designed  to  assess  the  competencies  identified  in  1990  by  a 
joint  committee  of  the  National  Educational  Association,  the  American  Federation  of  Teachers,  and  the  National  Council  on  Measure- 
ment in  Education,  Staiulards  for  Teacher  Competence  in  the  Educational  Assessment  of  Stiulcnts.  Of  the  seven  competency  areas  articulated 
in  these  Standards,  teachers  showed  their  best  performance  in  the  area  of  “administering,  scoring  and  interpreting  test  results”  and  poorest 
performance  in  “communicating  test  results.”  Based  on  the  survey  results,  a joint  committee  of  NEA,  AFT,  and  NCME  is  planning 
the  development  of  a training  prototype  for  delivering  inservice  programs  to  increase  teacher  competency  in  educational  assessment. 


Stiggins  (1991)  estimates  that  some  teachers  spend  up  to 
50  percent  of  their  time  in  assessment-related  activities.  These 
activities  include  formal  classroom  assessments,  such  as  quizzes 
and  unit  tests,  informal  class  room  assessments  involving  daily 
observations  of  student  achievement  and  behaviors,  plus  district 
and  state  standardized  assessments.  Just  as  the  types  of  assessments 
teachers  use  arc  varied,  so  also  are  the  purposes  of  these  assess- 
ments. For  example,  student  assessment  data  arc  relevant  for 
purposes  such  as: 

1.  aiding  in  curriculum/instructional  planning, 

2.  providing  individual  diagnostic  instructional  programs, 

3.  determining  individual  status  on  specific  instructional 
objectives, 

4.  ascertaining  whether  class  goals  for  instruction  have 
been  achieved, 

5.  evaluating  comprehensive  student  achievement  for 
end-of-unit  grades, 

6.  providing  necessary  outcome  data  for  federal  programs, 
such  as  Chapter  1,  and 

7.  informing  decisions  at  the  administrative  level  on  stu- 
dent grouping  or  program  implementation. 

Teachers  report  that  they  arc  ill-prepared  in  the  area  of 
student  assessment  (Schafer  6i  Lissitz,  1987).  Wise,  Lukin  and 
Roos  (1990)  reported  that  about  half  of  the  teachers  they  surveyed 
felt  their  measurement  training  was  inadequate.  One  reason  for 
this  lack  of  confidence  by  teachers  about  their  competencies  in 
assessment  is  that  teacher  preservice  training  programs  often  pro- 
vide only  limited  exposure  to  courscwork  or  experiences  in  testing 
and  educational  measurement.  O’Sullivan  and  Chalnick  (1991) 
found  in  their  survey  of  state  departments  of  education  that  few 
states  require  course  work  in  measurement  or  testing  for  initial 
certification;  Hills  (1991)  reported  that  onlv  four  states  have  a legal 
requirement  for  an  assessment  course  for  prospective  teachers. 


This  is  not  a new  problem.  National  surveys  of  training  program 
requirements  as  early  as  1955  (Noll,  1955)  have  documented  that 
teacher  preparatory  programs  did  not  contain  sufficient  course- 
work  in  educational  measurement.  In  fact,  recent  surveys  (Schafer 
6c  Lissitz,  1987)  indicate  little  change  in  the  proportion  of  teacher 
education  programs  requiring  an  assessment  course. 

The  National  Council  on  Measurement  in  Education 
(NCME),  the  National  Education  Association  (NEA),  and  the 
American  Federation  of  Teachers  (AFT)  have  been  working  to- 
gether to  address  the  problem  of  inadequate  assessment  training 
for  teachers.  The  goals  of  this  collaboration  arc: 

1.  to  articulate  the  assessment  competency  needs  for 
teachers  in  the  area  of  student  assessment;  and 

2.  to  develop  training  materials  for  use  in  helping  teachers 
become  proficient  in  these  assessment  competency  areas. 

The  purpose  of  this  article  is  to  describe  the  activities  of 
these  three  organizations  in  meeting  the  goals  of  improving  the 
assessment  literacy  levels  of  teachers. 

Goal  1: 

Articulation  of  the  Assessment  Competency  Needs 
for  Teachers  in  the  Area  of  Student  Assessment 

Through  a collaborative  effort  with  the  American  Asso- 
ciation of  Colleges  for  Teachers  in  Education,  AFT,  NCME,  and 
NEA  published  the  Standards  for  Teacher  Competence  in  the  Eciu- 
cational  Assessment  of  Students  in  1990.  The  Standards  were  de- 
veloped through  a study  of  teacher  assessment  practices.  A copy 
of  the  Standards  has  been  edited  and  is  the  Appendix. 

The  Standards  address  seven  broad  skill  areas  in  educa- 
tional assessment.  These  skill  areas  are: 

(continued  on  page  22) 
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1.  choosing  assessment  methods  appropriate  for  instruc- 
tional decisions; 

2.  developing  assessment  methods  appropriate  for  instruc- 
tional decisions; 

3.  administering,  scoring  and  interpreting  the  results  of  both 
externally  produced  and  teacher  produced  assessment  methods; 

4.  using  assessment  results  when  making  decisions  about 
individual  students,  planning  teaching,  developing  curriculum, 
and  improving  schools; 

5.  developing  valid  pupil  grading  procedures; 

6.  communicating  assessment  results  to  students,  parents, 
other  lay  audiences,  and  other  educators;  and 

7.  recognizing  unethical,  illegal,  and  other  inappropriate 
methods  and  uses  of  assessment  information. 


Goal  Two: 

Developing  Training  Materials  for  Use 
in  Helping  Teachers  Become  Proficient  in  the 
Assessment  Competency  Areas 

Subsequent  to  the  publication  of  the  Standards  for  Teacher 
Competence  in  the  Educational  Assessment  of  Students , NCME  em- 
barked on  a Kellogg  Foundation  funded  project  to  work  with 
representatives  from  NEA  and  AFT  to  develop  training  materials 
for  teachers  to  help  them  become  competent  in  the  competency 
areas  articulated  in  the  Standards.  In  order  to  make  informed  deci- 
sions about  the  development  of  training  materials,  the  first  task 
of  the  project  was  to  conduct  a national  survey  of  teachers  to 
ascertain  their  current  levels  of  proficiency  in  the  competencies 
addressed  in  the  Standards . Next,  the  project  staff  was  to  use  this 
information  in  targeting  a competency  area  for  the  development 
of  a training  prototype.  Finally,  a training  module  was  to  be  de- 
signed for  delivery  through  existing  training  networks  under  the 
auspices  of  NEA  and  AFT. 

Current  Level  of  Teacher  Competencies 
in  the  Educational  Assessment  of  Students. 

A national  survey  of  teachers  to  determine  their  levels  of 
achievement  in  the  competency  areas  identified  in  the  Standards 
was  undertaken  in  fall  1991.  This  project  entailed  developing  an 
instrument  that  used  the  Standards  for  Teacher  Competence  in  the 
Educational  Assessment  of  Students  as  the  test  blueprint,  obtaining  a 
nationally  representative  sample  of  teachers  to  take  the  test,  and 
analyzing  their  responses  to  ascertain  their  achievement  status  in 
the  area  of  educational  assessment  of  students. 

Instrument  Development 

In  order  to  determine  the  level  of  proficiency  of  teachers 
in  the  competency  areas  addressed  in  the  Standards,  first  a test  needed 
to  be  developed  that  measured  the  seven  broad  skill  areas.  The 
final  instrument  consisted  of  two  parts:  Fart  One  was  designed  to 


measure  the  seven  competency  areas  while  Part  Two  asked  ques- 
tions about  teachers’  perception  of  test  utility,  their  confidence  in 
test  interpretation,  their  previous  access  to  measurement  training, 
their  preference  for  training  delivery  options,  and  descriptive  infor- 
mation about  their  careers  in  educational  settings. 

Fart  One  consisted  of  a 35-item  multiple  choice  instrument; 
five  items  designed  to  assess  each  of  the  seven  competency  areas. 
One  goal  of  item  development  was  to  prepare  application  questions 
that  were  realistic  and  meaningful  to  teachers’  assessment  practices. 
Members  of  NCME  were  asked  to  serve  on  a content  validity  review 
panel  and  their  responses  gave  confirming  evidence  that  the  items 
in  the  instrument  matched  well  the  competency  standard  area  they 
were  designed  to  assess.  In  addition  a pilot  study  was  achieved  on 
a draft  version  of  the  instrument.  Further,  practicing  teachers  and 
administrators  were  asked  to  review  the  test  items  and  give  feed- 
back on  the  appropriateness  of  the  items  for  classroom  teachers’ 
measurement  practices. 

Sample 

Once  the  test  was  deemed  to  be  in  final  form,  the  instru- 
ment was  sent  to  a national  sample  of  teachers.  This  sample  of 
teachers  was  identified  by  first  selecting  six  districts  per  state.  Then 
the  spate’s  assessment  director  was  asked  to  verify  the  existence  of 
the  selected  districts  and  to  provide  a contact  person  (testing  coor- 
dinator or  equivalent)  within  each  district.  Four  of  these  districts 
■formed  the  primary  sample;  the  remaining  two  were  identified  for 
use  in  case  one  of  the  districts  in  the  primary  sample  did  not  respond 
or  were  unable  to  participate.  The  testing  coordinator  (or  equiva- 
lent) w'ithin  each  of  these  districts  was  contacted  and  asked  to 
cooperate  by  identifying  teachers  for  the  national  study.  The  testing 
coordinators  were  informed  about  the  purpose,  importance  of  the 
study,  and  that  their  state  assessment  director  had  endorsed  the 
project.  If  the  testing  coordinator  in  the  district  agreed  to  partici- 
pate, he  or  she  was  sent  a packed  of  materials  to  distribute  randomly 
to  18  teachers  within  the  district  (6  at  elementary,  6 at  middle/ 
junior  high,  and  6 at  high  school  levels).  All  states  but  5 were 
able  to  participate;  a total  of  98  districts  in  45  states  made  up  the 
final  sample. 

Administration 

The  instrument  was  mailed  to  the  testing  coordinators  in 
the  fall  1991.  A total  of  555  (48  percent)  of  the  teachers  returned 
their  instruments  came  in  from  a widespread  representation  of  the 
United  States  and  contained  large  and  small  sell  ml  distiicts  in 
rural,  suburban  and  urban  geographic  regions.  Figure  1 on  page 
23  show's  the  representation  of  the  sample. 

Results 

Outcomes  from  the  two  parts  of  the  instrument  will  he 
presented  separately.  First,  the  results  from  Fart  One  (achievement 
of  the  competency  areas)  will  lx  shown.  Next,  Fart  2 (teacher  per- 
ceptions and  background)  will  he  documented.  Finally,  some  cross- 
breaks  showing  results  on  the  achievement  test  as  a function  ol 
teacher  perceptions  and  background  will  be  considered. 
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Figure  1 . - 

Return  Rates  by  State  Table  1 


Part  One:  Teacher  achievement  on  the  competency  areas. 
Overall  test  results  are  shown  in  Table  1.  On  average,  teachers 
answered  slightly  over  23  of  the  total  35  items  correctly.  Out  of 
the  seven  competency  areas,  the  highest  overall  performance  for 
teachers  was  found  in  the  competency  area  “Administering,  Scoring 
and  Interpreting  Test  Results”  (Mean  = 3.96;  maximum  possible 
score  = 5).  Teachers  showed  their  lowest  achievement  in  the  com- 
petency  area  “Communicating  Test  Results”;  average  score  for  the 
teachers  in  this  competency  area  was  2.70  out  of  the  possible 
five  items. 

On  10  of  the  35  items,  90  percent  or  more  of  the  teachers 
answered  the  item  correctly.  These  items  document  areas  of  demon- 
strated  strength  for  the  teachers.  Two  of  these  items  address  issues 
in  making  assessment  selection  decisions:  one  asks  for  a decision 
regarding  the  most  important  consideration  in  choosing  a method 
for  assessing  student  achievement  and  another  focuses  on  the 
choice  of  an  assessment  strategy  for  the  purpose  of  measuring 
student  understanding  of  an  instructional  unit  in  problem  solving. 
Other  strength  areas  are  found  in  teacher  knowledge  of  acceptable 
test  taking  behavior  for  rimed  test  administration  of  a standardized 
test;  explanation  of  the  basis  for  a child’s  grade  to  a parent,  and 
recognition  of  unethical  practices  in  standardized  test  administration. 

On  the  other  hand,  there  were  a few  items  that  were  very 
difficult  for  the  teachers.  On  five  items  less  than  30  percent  of  the 
teachers  answered  correctly.  Two  of  these  items  came  from  the 
“using  assessments  in  grading”  standard.  One  item  asked  teachers 
to  choose  a reliable  source  of  student  performance  information 
and  another  focused  on  assigning  equal  weights  to  components 
of  a grade.  Another  difficult  item  focused  on  steps  likely  to  increase 
reliability  of  test  score;  only  13  percent  of  the  teachers  answered 
this  item  correctly.  Most  of  the  teachers  chose  an  option  that 
might  arguably  enhance  the  test’s  validity  (adding  on  essay  com- 
ponent), but  not  likely  the  choice  for  augmenting  reliability  (in- 
creasing test  length).  Two  other  items  with  less  then  30  percent 
of  the  teachers  answering  correctly  were  from  the  “recognizing 
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Scores 

X 

SD 

Total  Score 

23.20 

3.33 

Subscales 

Choosing 

3.46 

0.93 

Developing 

3.22 

0.80 

Administering 

3.96 

0.90 

Instruction 

3.40 

1.1 1 

Grading 

3.19 

0.78 

Communicating 

2.70 

1.21 

Ethics 

3.26 

0.78 

Note:  N = 555 


unethical  practices  standard.”  One  focused  on  knowledge  of  truth 
in  testing  legislation  and  the  other  on  recognizing  unethical  test 
administration  practices. 

Part  Two:  Teacher  perceptions  and  background.  The  ma- 
jority of  teachers  in  the  study  had  between  6 and  12  years  of 
teaching  experience.  Relatively  few  teachers  in  rhe  sample  had 
less  than  five  years  of  experience  or  more  than  15.  The  teachers 
were  far  more  positive  about  the  utility  of  teacher  made  tests  for 
instructional  decisions  (over  85  percent  were  supportive  of  this 
use)  than  they  were  about  the  utility  of  standardized  tests  for  the 
same  purpose  (only  34  percent  were  positive  about  using  stand- 
ardized tests  in  this  way).  Further,  over  half  of  the  teachers  in  the 
sample  were  less  than  comfortable  with  their  ability  to  interpret 
standardized  test  results. 

Over  70  percent  of  the  teachers  in  the  study  reported 
prior  exposure  to  tests  and  measurement  content,  either  through 
a course  or  other  training  opportunity  (such  as  inservice).  How- 
ever, that  training  was  quite  dated  for  the  majority  of  the  teachers 
in  the  survey  as  most  of  the  teachers  (54  percent)  reported  it  had 
been  more  than  six  years  since  their  exposure  to  measurement 
training.  When  asked  how  they  would  prefer  to  receive  additional 
training  in  assessment,  the  overwhelming  majority  (85  percent) 
were  supportive  of  an  inservice  mode  of  delivery. 

Achievement  performance  by  teacher  perceptions  and 
attitudes.  Teachers  who  reported  they  were  uncomfortable  with 
interpreting  standardized  test  results  did  in  fact  score  significantly 
lower  on  the  achievement  test  than  did  teachers  who  reported 
feeling  comfortable  with  such  interpretations.  However,  the  actual 
average  score  difference  between  these  two  groups  was  quite  small 
(Mean  for  those  indicating  comfort  in  interpreting  standardized 
test  results  was  23.91;  mean  for  teacher  stating  they  were  uncom- 
fortable was  22. 34).  Likewise,  even  though  the  teachers  who  had 
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previous  coursework/training  in  measurement  scored  significantly 
higher  on  the  achievement  test  than  those  who  had  not,  the  dif- 
ference  in  overall  performance  for  the  two  groups  was  less  than 
one  point  (Mean  for  those  who  had  a course  was  23.41;  mean 
for  those  who  did  not  have  the  a course  was  22.72).  Therefore, 
while  some  score  differences  were  noted  in  achievement  test  per- 
formance, these  did  not  appear  to  be  important  for  decisions 
regarding  teacher  assessment  training. 

Development  of  Training  Materials 

Based  on  the  results  of  the  national  survey  of  teacher  pro- 
ficiencies in  the  competency  areas  addressed  in  the  Standards  for 
Teacher  Competence  in  the  Educational  Assessment  of  Students , and 
on  other  relevant  information,  it  was  decided  that  the  content 
area  “Communicating  and  Interpreting  Test  Results”  be  selected 
as  the  one  to  design  the  initial  training  program. 

The  training  materials  will  be  standardized  across  assess- 
ment topics.  The  basic  structure  will  be  to  present  teachers  with  a 
context  in  which  an  assessment  issue  is  relevant.  For  that  assess- 
ment issue  within  a particular  situation,  a training  module  will  be 
developed  so  that  the  teachers: 

1.  are  provided  with  knowledge  of  the  assessment  concept; 

2.  see  an  illustration  of  the  concept  in  a variety  of  settings; 

3.  are  presented  with  a description  of  the  utility  of  the 
concept  in  a variety  of  settings  with  a focus  on  implications  of 
the  concept  to  different  contexts;  and 

4.  are  shown  how  the  concept  might  be  communicated 
in  a variety  of  settings  and  contexts. 

The  training  modules  will  consist  of  several  two-hour  com- 
ponents designed  to  be  used  in  a two-day  workshop  for  inservice 
teachers;  however,  individual  components  can  be  selected  for  use. 


This  will  allow  for  individualization  and  specialization  of  the 
materials  for  different  purposes  and  audiences. 

Summary  and  Conclusions 

Assessment  competencies  are  critical  to  the  teaching  pro- 
fession. Teachers  use  assessment  information,  either  formally  or 
informally  to  make  instructional  and  evaluative  decisions  about 
their  students.  These  activities  occupy  a dominant  proportion 
of  their  professional  activity. 

Teachers  are  not  adequately  prepared  to  function  at  a pro- 
fessional level  in  educational  assessment.  They  do  not  receive 
sufficient  training  in  their  preservice  programs  and  they  report 
feeling  uncomfortable  making  assessment-related  decisions. 

Through  the  specification  of  competency  standards  for 
teachers  in  the  educational  assessment  of  students,  NCME,  NEA 
and  AFT  have  made  a clear  statement  about  the  skills  teachers 
should  be  expected  to  have  in  order  to  be  considered  proficient 
in  this  critical  area  of  their  professional  practice.  Further,  through 
the  use  of  a test  designed  to  measure  teachers’  levels  of  competency 
in  these  assessment  standards,  competency  areas  in  greater  need 
of  skill  remediation  have  been  identified.  Using  this  information, 
a plan  is  in  place  to  develop  a prototype  for  inservice  training 
programs  designed  to  enable  teachers  to  achieve  necessary  com- 
petency levels  in  student  assessment. 
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Appendix  A 


STANDARDS 


Standards  for  Teacher  Competence  in  Educational  Assessment  of  Students 


Developed  b\  the  American  Federation  of  Teachers,  Natioml  Council  on  Mecuiuvmciu  in  Education,  Platimial  Education  Association 


The  professional  education  associations  began  working  in  1937 
to  develop  standards  for  teacher  competence  in  student  assessment  out  of 
concern  that  the  potential  educational  benefits  of  student  assessments  be 
fully  realized.  The  Committee*  appointed  to  this  project  completed  its  work 
in  1990,  following  reviews  of  earlier  drafts  by  members  of  the  measurement, 
teaching,  and  teacher  preparation  and  certification  communities.  Parallel 
committees  of  affected  associations  arc  encouraged  to  develop  similar 
statements  of  qualifications  for  school  administrators,  counselors,  testing 
directors,  supervisors,  and  other  educators  in  the  near  future.  These 
statements  are  intended  to  guide  the  preservice  and  inservice  preparation 
of  educators,  rhe  accreditation  of  preparation  programs,  and  the  future 
certification  of  all  educators. 

A standard  is  defined  here  as  a principle  generally  accepted  by 
the  professional  associations  responsible  for  this  document.  Assessment 
is  defined  as  the  process  of  obtaining  information  that  is  used  to  make 
educational  decisions  about  students,  to  give  feedback  to  the  student 
about  his  or  her  progress,  strengths,  and  weaknesses,  to  judge  instruc- 
tional  effectiveness  and  curricular  adequacy,  and  to  inform  policy.  The 
various  assessment  techniques  include,  but  are  not  limited  to,  formal 
and  informal  observation,  qualitative  analysis  of  pupil  performance  and 
products,  paper-and-pencil  tests,  oral  questioning,  and  analysis  of  stu- 
dent records.  The  assessment  competencies  included  here  are  the  knowl- 
edge and  skills  critical  to  a teacher's  role  as  educator.  It  is  understood 
that  there  are  many  competencies  beyond  assessment  competencies  which 
teachers  must  possess. 

By  establishing  standards  for  teacher  competence  in  student 
assessment,  the  associations  subscribe  to  the  view  that  student  assessment 
is  an  essential  part  of  teaching  and  that  good  teaching  cannot  exist  without 
good  student  assessment.  Iraining  to  develop  the  competencies  covered 
in  the  standards  should  be  an  integral  part  of  prescrvicc  preparation. 
Further,  such  assessment  training  should  be  widely  available  to  practicing 
teachers  through  staff  development  programs  at  the  district  and  build- 
ing levels. 

The  standards  are  intended  for  use  as:  a guide  for  teacher  edu- 
cators as  they  design  and  approve  programs  for  teacher  preparation;  a 
self-assessment  guide  for  teachers  in  identifying  their  needs  for  profes- 
sional development  in  student  assessment;  a guide  for  workshop  instructors 
as  they  design  professional  development  experiences  for  in-service  teachers; 
and  an  impetus  for  educational  measurement  specialists  and  teacher 
trainers  to  conceptualize  student  assessment  and  teacher  training  in  stu- 
dent assessment  more  broadly  than  has  been  the  case  in  the  past.  The 
standards  should  he  incorporated  into  future  teacher  training  and  cer- 
tification programs.  Teachers  who  have  not  had  the  preparation  these 
standards  imply  should  have  the  opportunity  and  support  to  develop 
these  competencies  before  the  standards  enter  into  the  evaluation  of 
these  teachers. 

The  Approach  Used  to  Develop  the  Standards 

The  members  ol  the  assex unions  that  supported  this  work  are 
professional  edui  ators  involved  in  teat  lung,  (cue her  education,  and  stu 
dent  assessment.  Members  ol  thoe  associations  are  concerned  nlxiul  the 
inadequate  with  which  teacher-  are-  prepared  for  assessing  the  educa- 


tional progress  of  their  students,  and  thus  sought  to  address  this  concern 
effectively.  A committee  named  by  the  associations  first  met  in  September 
1937  and  affirmed  its  commitment  to  defining  standards  for  teacher  prepa- 
ration in  student  assessment.  The  committee  then  undertook  a review  of 
the  research  literature  to  identify  needs  in  student  assessment,  current 
levels  of  teacher  training  in  student  assessment,  areas  of  teacher  activities 
requiring  competence  in  using  assessments,  and  current  levels  of  teacher 
competence  in  student  assessment. 

The  members  of  the  committee  used  their  collective  experience 
and  expertise  to  formulate  and  then  revise  statements  of  important  assess- 
ment competencies.  Drafts  of  these  competencies  went  through  several 
revisions  by  the  Committee  before  the  standards  were  released  for  public 
review.  Comments  by  reviewers  from  each  of  rhe  associations  were  then 
used  to  prepare  a final  statement. 

The  Scope  of  a Teacher’s  Professional 

Role  and  Responsibilities  for  Student  Assessment 

There  arc  seven  standards  in  this  document.  In  recognizing  the 
critical  need  to  revitalize  classroom  assessment,  some  standards  focus  on 
classroom-based  competencies.  Because  of  teacher’s  growing  roles  in  educa- 
tion and  policy  decisions  beyond  the  classroom,  other  standards  address 
assessment  competencies  underlying  teacher  participation  in  decisions 
related  to  assessment  at  the  school,  district,  state,  and  national  levels. 

The  scope  of  a teacher’s  professional  role  and  responsibilities  for 
student  assessment  may  he  described  in  terms  of  the  following  activities. 
These  activities  imply  that  teachers  need  competence  in  student  assessment 
and  sufficient  time  and  resources  to  complete  them  in  a professional  manner. 

Art « -if ics  Occurring  Prior  to  Instruction 

(a)  Understanding  students’  cultural  backgrounds,  interests,  skills, 
and  abilities  as  they  apply  across  a range  of  learning  domains  and/or  sub- 
ject areas;  (h)  understanding  students’  motivations  and  their  interests  in 
specific  class  content;  (c)  clarifying  and  articulating  the  performance  out- 
comes expected  of  pupils;  and  (d)  planning  instruction  for  individuals 
or  groups  of  students. 

Activities  Occurring  During  fiiimurrion 

(a)  Monitoring  pupil  progress  toward  instructional  goals  (b);  iden- 
tifying gains  and  difficulties  pupils  arc  experiencing  in  learning  and  per- 
forming; (c)  adjusting  instruction;  (d)  giving  contingent,  specific,  and 
credible  praise  and  feedback;  (e)  motivating  students  to  learn;  and  (0 
judging  the  extent  of  pupil  attainment  of  instructional  outcomes. 

Activities  Occurring  After  :lu  Appropriate  Instructional  Segment 
fo.g.  lesvm,  cliiss,  semester,  guide) 

(a)  Describing  the  extent  to  which  each  pupil  has  attained  both 
•Tort-  and  long-term  instructional  goals  lh)  communicating  strengths  and 
weaknesses  based  on  assessment  results  to  students,  and  parents  or  guar- 
dians; ft)  recording  and  reporting  assessment  results  for  school-level 
analysts,  evaluation,  and  decision  making,  (d)  analyzing  assessment  infer- 

(awtinued  on  page  J6) 
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mation  gathered  before  and  during  instruction  to  understand  each 
students’  progress  to  date  and  to  inform  future  instructional  planning; 
(e)  evaluating  the  effectiveness  of  instruction;  and  (0  evaluating  the 
effectiveness  of  the  curriculum  and  materials  in  use. 

Activities  Associated  ui(h  a Teacher’s  Imohement 
in  School  Building  and  School  District  Decision* Making 

(a)  Serving  on  a school  or  district  committee  examining  the 
school’s  and  district’s  strengths  and  weaknesses  in  the  development  of 
its  students;  (b)  working  on  the  development  or  selection  of  assessment 
methods  for  school  building  or  school  district  use;  (c)  evaluating 
school  district  curriculum;  and  (d)  other  related  activities. 

Activities  Associated  uith  a Teacher’s  /mo/iement 
in  a Wider  Community  of  Educators 

(a)  Serving  on  a state  committee  asked  to  develop  learning 
goals  and  associated  assessment  methods;  (b)  participating  in  reviews 
of  the  appropriateness  of  district,  state,  or  national  student  goals  and 
associated  assessment  methods;  and  (c)  interpreting  the  results  of  state 
and  national  student  assessment  programs. 

Each  standard  that  follows  is  an  expectation  for  assessment  knowledge 
or  skill  that  a teacher  should  possess  in  order  to  perform  well  in  the 
five  areas  just  described.  As  a set,  the  standards  call  on  teachers  to 
demonstrate  skill  at  selecting,  developing,  applying,  using,  communi- 
cating, and  evaluating  student  assessment  information  and  student 
assessment  practices.  A brief  rationale  and  illustrative  behaviors 
follow  each  standard. 

The  standards  represent  a conceptual  framework  or  scaffolding 
from  which  specific  skills  can  be  derived.  Work  to  make  these  standards 
operational  will  be  needed  even  after  they  have  been  published.  It 
is  also  expected  that  experience  in  the  application  of  these  standards 
should  lead  to  their  improvement  and  further  development. 

1.  Teachers  should  be  skilled  in  choosing  assessment  methods 
appropriate  for  instructional  decisions. 

Skills  in  choosing  appropriate,  useful,  administratively  con- 
venient, technically  adequate,  and  fair  assessment  methods  are  pre- 
requisite to  good  use  of  information  to  support  instructional  decisions. 
Teachers  need  to  be  well-acquainted  with  the  kinds  of  information 
provided  hv  a broad  range  of  assessment  alternatives  and  their  strengths 
and  weaknesses.  In  particular,  thev  should  he  familiar  with  criteria 
for  evaluating  and  selecting  assessment  methods  in  light  of  instruc- 
tional plans. 

Teru  hers  who  meet  this  standard  will  have  the  conceptual  and 
application  skills  that  follow.  They  will  he  able  to  use  the  concepts 
of  assessment  error  and  validity  when  developing  or  selecting  their 
approaches  to  classroom  assessment  of  students.  Thev  will  under- 
stand how  valid  assessment  data  can  support  instructional  activities 
such  as  providing  appropriate  feedback  to  students,  diagnosing  group 
and  individual  learning  needs,  planning  for  individualized  educu 
tiotial  programs,  motivating  students,  and  evaluating  instructional 
procedures.  Thev  will  understand  how  invalid  information  can  affect 
instructional  decisions  about  ^indents,  "i  iuv  will  also  be  able  to  use 
and  evaluate*  assessment  options  available  to  them,  considering  among 
other  things,  the  c ullural,  six  ml,  nonomic , a nil  language  ha*,  k ground' 
<>t  studeiiis  Tin  \ will  lx  aware  that  jlitfcu  lit  asce«*»meni  approach*' 


can  be  incompatible  with  certain  instructional  goals  and  may  impact 
quite  differently  on  their  teaching. 

Teachers  will  know,  for  each  assessment  approach  they  use, 
its  appropriateness  for  making  decisions  about  their  pupils.  Moreover, 
teachers  will  know  where  to  find  information  about  and/or  reviews 
of  various  assessment  methods.  Assessment  options  arc  diverse  and 
include  text-  and  curriculum-embedded  questions  and  tests,  standardizd 
criterion-referenced  and  norm-referenced  tests,  oral  questioning,  spon- 
taneous and  structured  performance  assessments,  portfolios,  exhibi- 
tions, demonstrations,  rating  scales,  writing  samples,  paper-and-pencil 
tests,  seatwork  and  homework,  peer-  and  self-assessments,  student 
records,  observations,  questionnaires,  interviews,  projects,  products, 
and  others’  opinions. 

2.  Teachers  should  be  skilled  in  developing  assessment 
methods  appropriate  for  instructional  decisions. 

While  teachers  often  use  published  or  other  external  assess- 
ment tools,  the  bulk  of  the  assessment  information  they  use  for  deci- 
sion-making comes  from  approaches  they  create  and  implement.  Indeed, 
the  assessment  demands  of  the  classroom  go  well  beyond  readily  avail- 
able instruments. 

Teachers  who  meet  this  standard  will  have  the  conceptual 
anJ  application  skills  that  follow.  Teachers  will  he  skilled  in  planning 
the  collection  of  information  that  facilitates  the  decisions  they  will 
make.  They  will  know  and  follow  appropriate  principles  for  developing 
and  using  assessment  methods  in  their  teaching,  avoiding  common 
pitfalls  in  student  assessment.  Such  techniques  may  include  several 
of  the  options  listed  at  the  end  of  the  first  standard.  The  teacher 
will  select  the  techniques  which  are  appropriate  to  the  intent  of  the 
teacher’s  instruction. 

Teachers  meeting  this  standard  will  also  he  skilleJ  in  using 
student  data  to  analyze  the  quality  of  each  assessment  technique  they 
use.  Since  most  teachers  do  not  have  access  to  assessment  specialists, 
they  must  be  prepared  to  Jo  these  analyses  themselves. 

3.  The  teacher  should  be  skilled  in  administering,  scoring 
and  interpreting  the  results  of  both  externally-produced 
and  teacher-produced  assessment  methods. 

It  is  not  enough  that  teachers  are  able  to  select  and  develop 
gooj  assessment  methods;  thev  must  also  he  able  to  apply  them 
properly.  Teachers  should  be  skilled  in  administering,  scoring,  nnJ 
interpreting  results  from  diverse  assessment  methods. 

Teachers  who  meet  this  standard  w ill  have  the  conceptual  and 
application  skills  that  follow.  They  will  be  skilled  in  interpreting  in- 
formal anJ  formal  teacher-produced  assessment  results,  including 
pupils’  performances  in  class  and  on  homework  assignments.  Teachers 
will  be  able  to  use  guides  for  scoring  essay  questions  and  projects 
stencib  for  scoring  response-choice  questions,  and  scales  lor  rating 
per  lor  manic  assessments.  Thev  will  be  able  to  use  these  in  wavs  tli.it 
produce  consistent  results. 

Ten*,  hers  vs  ill  be  able*  io  administer  standardized  achievement 
tests  and  be  able  to  interpret  the  commonly  reported  scores;  pen  entile 
ranks,  pen  entile  band  m oro,  standard  score*,  and  grade  eqimalcnis. 
They  will  h.w  e a c one  eptual  understanding  of  the  Mimm.iiv  indexes 
e 'Mumonlv  reported  with  assessment  results;  measures  of  central  ten 
d<  n*  disjx  rsion,  n lationslups,  n liability,  and  errors. *1  rn<  astin  ment. 
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Teachers  will  he  able  to  apply  these  concepts  of  score  and 
summary  indices  in  ways  that  enhance  their  use  of  the  assessments 
that  they  develop.  They  will  be  able  to  analyze  assessment  results  to 
identify  pupils’  strengths  and  errors.  If  they  get  inconsistent  results, 
they  will  seek  other  explanations  for  the  discrepancy  or  other  data  to 
attempt  to  resolve  the  uncertainty  before  arriving  at  a decision.  They 
will  be  able  to  use  assessment  methods  in  wavs  that  encourage  students’ 
educational  development  and  that  do  not  inappropriately  increase 
students’  anxiety  levels. 

4.  Teachers  should  be  skilled  in  using  assessment  results  when 
making  decisions  about  individual  students,  planning 
teaching,  developing  curriculum,  and  school  improvement. 

Assessment  results  arc  used  to  make  educational  decisions  at 
several  levels:  in  the  classroom  about  students,  in  the  community  about 
a school  and  a school  district,  and  in  society,  generally,  about  the 
purposes  and  outcomes  of  the  educational  enterprise.  Teachers  plav 
a vital  role  when  participating  in  decision-making  at  each  of  these 
levels  and  must  be  able  to  use  assessment  results  effectively. 

Teachers  who  meet  this  standard  will  have  the  conceptual 
and  application  skills  that  follow.  They  will  be  able  to  use  accumu- 
lated assessment  information  to  organize  a sound  instructional  plan 
for  facilitating  students*  educational  development.  When  using  assess- 
ment results  to  plan  and/or  evaluate  instruction  and  curriculum, 
teachers  will  interpret  the  results  correctly  and  avoid  common  misinter- 
pretations, such  as  basing  decisions  on  scores  that  lack  curriculum 
validity.  They  will  be  informed  about  the  results  of  local,  regional, 
state,  and  national  assessments  and  about  their  appropriate  use  for 
pupil,  classroom,  school,  district,  state,  and  national  educational 
improvement. 

5.  Teachers  should  be  skilled  in  developing  valid  pupil  grading 
procedures  which  use  pupil  assessments. 

Grading  students  is  an  important  part  of  professional  practice 
for  teachers.  Grading  is  defined  as  indicating  both  a student's  level 
of  performance  and  a teacher’s  valuing  of  that  performance.  The  prin- 
ciples for  using  assessments  to  obtain  valid  grades  arc  known  and 
teachers  should  employ  them. 

Teachers  who  meet  this  standard  will  have  the  conceptual  and 
applications  skills  that  follow.  They  will  be  able  to  devise,  implement, 
and  explain  a procedure  for  developing  grades  composed  of  marks  from 
various  assignments,  projects,  in-class  activities,  quizzes,  tests,  and/or 
other  assessments  that  they  mav  use.  Teachers  will  understand  he  able 
to  articulate  whv  the  grades  they  assign  arc  rational,  justified,  and 
fair,  acknowledging  that  such  grades  reflect  their  preferences  and 
judgments.  Teachers  will  be  able  to  recognize  and  to  avoid  fnultv 
grading  procedures  such  as  using  grades  as  punishment.  They  will  be 
able  to  evaluate  and  to  modify  their  grading  procedures  in  order  to 
improve  the  validity  of  the  interpretations  made  from  them  about 
students’  attainment*-. 

6.  Teachers  should  be  skilled  in  communicating  assessment 
results  to  students,  parents,  other  lay  audiences,  and 
other  educators. 

Teacher"  must  routinely  report  assessment  results  to  students 
and  to  parents  or  guardians,  hi  addition,  thev  are  frequently  asked  ro 
report  or  to  di^iuss  assessment  resulls  with  other  educators  and  with 
diverse  lav  audience*.  If  the  results  are  not  communicated  effectively, 
tlu\  mav  he  misused  «>r  not  mod.  To  lommunicate  effectively  with 
others  iin  matters  ol  Mudcm  assessment,  teacheis  must  be  able  to  u>e 


assessment  terminology  appropriately  and  must  be  able  to  articulate 
the  meaning,  limitations,  and  implications  of  assessment  results. 
Furthermore,  teachers  will  sometimes  be  in  a position  that  will  require 
them  to  defend  their  own  assessment  procedures  and  their  interpreta- 
tions of  them.  At  other  times,  teachers  may  need  to  help  the  public 
to  interpret  assessment  results  appropriately. 

Teachers  who  meet  this  standard  will  have  the  conceptual  and 
application  skills  that  follow.  Teachers  will  understand  and  be  able  to 
give  appropriate  explanations  of  how  the  interpretation  of  student 
assessments  must  be  moderated  by  the  student’s  socio-economic, 
cultural,  language,  and  other  background  factors.  Teachers  will  be  able 
to  explain  that  assessment  results  do  not  imply  that  such  background 
factors  limit  a student’s  ultimate  educational  development.  They  will 
be  able  to  communicate  to  students  and  to  their  parents  or  guardians 
how  they  may  assess  the  student’s  educational  progress.  Teachers  will 
understand  and  he  able  to  explain  the  importance  of  raking  measure- 
ment errors  into  account  when  using  assessments  to  make  decisions 
about  individual  students,  leachers  will  be  able  to  explain  the  limita- 
tions of  different  informal  and  formal  assessment  methods.  They  will 
be  able  to  explain  printed  reports  of  the  results  of  pupil  assessments 
at  the  classroom,  school  district,  state,  and  national  levels. 

7.  Teachers  should  be  skilled  in  recognizing  unethical,  illegal, 
and  otherwise  inappropriate  assessment  methods  and  uses 
of  assessment  information. 

Fairness,  the  rights  of  all  concerned,  and  professional  ethical 
behavior  must  undergird  all  student  assessment  activities,  from  the 
initial  planning  for  and  gathering  of  information  to  the  interpreta- 
tion, use,  and  communication  of  the  results.  Teachers  must  be  well- 
versed  in  their  own  ethical  and  legal  responsibilities  in  assessment. 
In  addition,  they  should  also  attempt  to  have  the  inappropriate  assess- 
ment practices  of  others  discontinued  whenever  they  are  encou  ntered. 
Teachers  should  also  participate  with  the  wider  educational  community 
in  defining  the  limits  of  appropriate  professional  behavior  in  assessment. 

Teachers  who  meet  this  standard  will  have  the  conceptual  and 
application  skills  that  follow.  They  will  know  those  laws  and  case  deci- 
sions which  affect  their  classroom,  school  district,  and  state  assessment 
practices.  Teachers  will  be  aware  that  various  assessment  procedures 
can  be  misused  or  overused  resulting  in  harmful  consequences  such 
as  embarrassing  students,  violating  a student’s  right  to  confidentiality, 
and  inappropriately  using  students’  standardized  achievement  test 
scores  to  measure  teaching  effectiveness. 

Invitation  to  Users 

The  associations  invite  comments  from  users  that  may  he 
used  for  improvement  of  this  document.  Comments  may  be  sent  to: 
• Teacher  Standards  in  Studcuit  Assessment,  American  Federation  of 
Teachers,  555  New  Jersey  Avenue  NW,  Washington,  DC  20001;  • 
Teacher  Standards  in  Student  Assessment,  National  Council  on 
Measurement  in  Ediu  aiion,  12 10 Seventeenth  Street  NW,  Washington, 
DC  20016;  or  • Teacher  Standards  in  Student  Assessment,  Instruction 
and  Professional  Development,  National  Education  Association,  1201 
Sixteenth  Street  NW,  Washington,  DC  200 M\ 
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Portfolio  Assessment  in  Our  Schools: 
Implementation,  Advantages,  and  Concerns 

By  Carole  Newman  and  Lynn  Smolen,  The  University  of  Akron 


The  use  of  portfolios  as  an  alternative  assessment  tool  is 
being  widely  investigated  and  adopted  by  a growing  number  of 
school  districts  across  the  United  States  (Vavrus,  1990;  Hansen, 
1992).  While  frequently  implemented  to  assess  literacy  develop' 
ment,  research  has  also  led  to  their  use  as  an  “authentic"’  assess- 
ment measure  of  student  academic  growth  in  the  social  studies, 
math,  and  science  curricular  areas  (Collins,  1990).  Portfolios  have 
been  identified  by  the  Association  for  Supervision  and  Curriculum 
Development  as  one  of  the  three  current  major  trends  in  curricu- 
lum development,  and  in  Vermont,  extensive  field  research  has 
been  conducted  which  is  expected  to  culminate  in  the  statewide 
adoption  of  portfolios,  for  use  in  conjunction  with  standardized 
tests,  to  assess  writing  and  math  skills  (Mills,  1989). 

Adopted  in  both  inner-  and  outer-city  schools,  teachers 
from  kindergarten  through  college  have  conducted  research  leading 
to  the  successful  use  of  student  portfolios  to  provide  a process 
assessment,  demonstrating  each  student’s  individual  progress,  as 
well  as  a product  assessment  in  which  student  work  can  be  judged 
against  a pre-established  and  mutually  agreed  upon  standard 
of  excellence. 

The  purpose  of  this  review  is  to  make  available  to  the 
practitioner  a summary  of  considerations  regarding  portfolios. 
The  advantages  of  portfolios  for  students,  teachers,  parents,  and 
administrators  are  presented,  along  with  some  of  the  problems  of 
implementation.  Suggestions  on  how  to  start  a portfolio  program 
as  well  as  possible  portfolio  contents  and  evaluation  concerns 
are  also  addressed. 

Portfolios  contain  a carefully  selected  sample  of  student 
work  which  demonstrates  both  the  goals  of  instruction  and  the 
student’s  progress  toward  those  goals.  How  much  and  what  to 
include  should  be  a joint  decision  between  student  and  teacher. 
The  selection  should  provide  an  adequate  sample  of  student  work 
which  will  enable  the  various  audiences  (students,  teachers,  parents, 
and  administrators)  to  develop  an  adequate  perspective  of  the 
student's  goal  attainment. 

Advantages  of  Portfolio  Development 

In  addition  to  the  obvious  advantage  of  improving  avos- 
ment  by  providing  ongoing  evaluation  of  student  progress,  rescan  h 
on  portfolios  describes  many  other  positive  outcomes  from  using 
the  portfolio  pnx  ess  (Hanson,  1992;  Werner,  1902;  Paulson,  Paulson, 
Meyer,  199f;  Tierney,  Carter,  vk  Desii.  I°91;  Yavnis,  1°90).  By 
tarefully  determining  which  sample  of  student  work  host  repre- 
sents the  educational  focus  and  hv  establishing  criteria,  students 
and  teachers,  as  well  as  parents  and  administrators,  are  belter 
able  to  determine  the  intended  outcomes  of  the  instructional 


process  and  to  gauge  how  successfully  those  outcomes  are  being 
achieved.  The  door  is  also  opened  for  dialogue  among  these  key 
stakeholders  as  they  discuss  the  contents  produced  by  the  students, 
and  there  is  opportunity  for  improved  understanding  between 
home  and  school. 

The  following  are  some  of  the  other  advantages  for  stu- 
dents, teachers,  parents,  and  administrators  that  are  an  outgrowth 
of  portfolio  assessment  plans. 

Advantages  for  Students 

Perhaps  one  of  the  most  important  aspects  of  the  port- 
folio process  is  that  it  empowers  students  to  make  decisions  about 
their  learning  by  actively  involving  them  in  setting  goals,  in  develop- 
ing criteria,  and  in  self-evaluating.  Because  the  focus  of  portfolio 
assessment  is  on  accurately  reflecting  each  student’s  strengths  and 
needs  based  upon  his  or  her  authentic  classroom  work,  students 
are  drawn  into  the  process  of  deciding  which  pieces  of  work  repre- 
sent their  skill  attainment  and/or  represent  their  development 
toward  attaining  their  educational  goals. 

By  working  collaboratively  with  the  teacher  and  class- 
mates, standards  of  excellence  are  established  which  provide  a 
framework  for  learning  (Graves,  1992).  Students  play  an  integral 
part  in  determining  the  criteria  by  which  their  work  will  be  judged, 
and,  therefore,  have  a sense  of  ownership  of  the  evaluation  process 
and  a clearer  understanding  of  the  assessment  plan.  The  sense  of 
ownership  also  promotes  the  feeling  among  students  that  they 
arc  working  toward  self-enhancement  rather  than  performing 
for  the  teacher.  The  evaluation  criteria  can  provide  them  with 
benchmarks  so  they  can  monitor  their  own  growth  and  gain  con- 
fidence  in  their  ability  to  progress  in  their  learning.  Through  this 
self-evaluation  students  develop  a sense  of  personal  history  and 
become  more  aware  of  their  own  effect ivc  learning  experiences. 
By  having  a good  sense  of  their  past,  they  can  better  plan  for  their 
future  learning  and  engage  in  effective  goal  setting  behaviors 
(Tierney  ct  ah,  1991;  Graves,  1992).  Growth  is  also  supported  by 
sharing  portfolio  contents  with  classmates  to  encourage  an  ex- 
change of  ideas  and  get  feedback  as  each  student  sees  how  his 
or  her  work  fits  into  the  range  of  academic  efforts  (Levi,  1990; 
Seidel,  1989). 

As  part  of  the  self-assessment  process,  students  are  taught 
how  to  thoughtfully  reflect  upon  the  work  included  in  their  port- 
folia  As  children  grow  in  their  ability  to  make  reflective  state- 
ments, they  go  from  first  naming  an  item  and  saying  they  like  it, 
to  more  sophisticated  statements  in  which  they  compare  and  con- 
trast earlier  efforts  with  their  current  work.  Through  reflective 
statements,  each  student  learns  to  evaluate  his  or  her  academic 
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performance  by  explaining  what  is  important  about  the  evidence 
that  is  included  and  what  is  says  about  him  or  her  as  a learner. 
A student  might  choose  a paper  to  represent  his  or  her  attain- 
ment  of  reading  or  arithmetic  skills,  or  to  show  growth  in  editing 
and  revising  writing  samples.  Reflective  statements  may  also  reveal 
changes  in  attitudes,  feelings  children  have  about  their  ability  to 
succeed  in  an  academic  environment,  or  goals  for  future  develop- 
ment. Through  these  attempts  to  explain  how  their  selections 
demonstrate  their  progress  and  to  identify  areas  to  improve  upon, 
students  become  more  self-motivated,  self-confident,  independent, 
and  responsible  as  learners  and  have  opportunities  to  develop 
skills  in  self-evaluation  which  will  have  life-long  benefits. 

Mark  Carter  (1992),  while  speaking  at  the  International 
Reading  Association  Convention,  pointed  out  that  portfolios 
seem  to  be  especiallv  beneficial  for  lower-achieving  students.  These 
students  have  more  opportunity  to  show  their  strengths  in  a port- 
folio than  thev  do  on  a standardized  test.  The  test  is  a sample  of 
performance  at  one  point  in  time,  while  portfolios  provide  them 
with  multiple  assignments  in  which  they  can  demonstrate  the  un- 
folding of  their  skills  over  an  extended  period.  This  yields  a more 
complete  picture  of  the  students’  performance  in  the  classroom. 

Advantages  for  Teachers 

As  a natural  outgrowth  of  daily  classroom  activity,  port- 
folio evidence  allows  teachers  to  use  student  products  to  measure 
growth  more  effectively  than  it  can  be  measured  by  the  limited 
sampling  of  traditional  assessment  practices  (Wi  nograd,  Paris, 
Bridge,  1991).  Class  time  is  also  put  to  better  use  by  concentrating 
student  efforts  on  authentic  activities  rather  than  preparing  for 
tests  which  yield  a limited  profile  of  student  needs  and  accom- 
plishments (Clay,  1990;  Tierney  et  al,  1991). 

One  of  the  assessment  strategies  frequently  used  in  port- 
folio classrooms  is  conferencing.  During  the  conference  teacher 
and  child  collaborate  on  important  decisions  about  what  to  include, 
and  nnalvze  contents  to  assess  progress,  instructional  needs,  and 
set  goals  (Levi,  1990;  Vavrus,  1990).  These  conferences  help  the 
teacher  make  informed  decisions  about  what  and  how  to  teach 
to  meet  individual  needs  and  provide  insights  that  allow  teachers 
to  tailor  instruction  for  more  appropriate  and  meaningful  learning 
experiences.  The  conferences  also  tend  to  promote  a dimate  of 
mutual  respect  and  trust  and  engender  more  positive  teacher  atti- 
tudes about  stsudents  (Wolf,  1990). 

Since  portfolio  contents  represent  the  goals  of  classroom 
learning,  teachers  must  make  professional  decisions  regarding  the 
focus  of  their  instruction.  While  the  making  of  educational  deci- 
sions is  inherent  in  the  role  of  the  teacher,  this  responsibility  is 
i (xi  often  neglected  hv  educators  who  are  forced  to  judge  student 
success,  and  their  own  success  as  a teacher,  hv  standardized  tests 
that  Ixsir  little  or  no  relationship  io  normal  classroom  activity. 
I Ring  portfolios  as  a primary  assessment  tool  requires  the  teacher 
to  again  make  the  professional  choices  that  will  allow  student** 
maximum  growth.  These  goals  ol  education  then  serve  as  the 


driving  force  behind  classroom  instruction  and  enable  the  teacher 
to  decide  on  appropriate  curriculum  and  instructional  practices, 
and  to  have  a means  of  assessment  that  is  congruent  with  the 
instructional  program. 

Portfolios  also  allow*  several  teachers  to  share  infer  mo- 
tion about  students  they  have  in  common.  This  can  help  in 
defining  strengths  and  problem  areas  so  that  consistent  interven- 
tion strategies  can  be  developed.  In  addition,  the  sharing  of  stu- 
dent portfolios  provides  an  excellent  forum  in  which  teachers 
can  w-ork  cooperatively  as  they  exchange  ideas  and  get  feedback 
from  each  other. 

Advantages  for  Parents 

One  of  the  difficult  tasks  of  parenting  is  being  able  to 
monitor  the  academic  progress  of  one  s child  by  looking  at  a letter 
grade  on  a report  card  or  a number  on  a standardized  test.  While 
these  symbols  provide  some  information  regarding  each  child’s 
relative  position  within  a given  population,  they  do  little  to  help 
parents  form  accurate  perceptions  about  their  own  child’s  strengths 
or  academic  needs  or  the  type  of  instruction  they  arc  receiving. 
Portfolios,  on  the  other  hand,  allow'  parents  to  examine  actual 
classroom  products  that  have  been  selected  and  organized  in  a 
meaningful  way.  They  provide  a vehicle  for  commu Plication  be- 
tween parent  and  teacher  which  can  help  parents  better  under- 
stand the  focus  of  instruction,  identify  their  child’s  needs  and 
work  together  w'ith  the  teacher  to  develop  strategies  to  support 
learning  (Flood  <Sc  Lapp,  1989). 

The  sharing  of  portfolio  contents  between  parent  and  child 
also  offers  opportunities  for  open  communication  about  school. 
By  discussing  the  reflective  statements  that  accompany  each 
sample,  parents  are  better  able  to  assess  their  child’s  feelings  about 
his  or  her  progress  and  competencies  as  a learner.  Examples  of 
work  in  progress  that  represent  the  process  of  skill  development 
help  parents  to  form  a clearer  picture  of  the  unfolding  of  academic 
growth  and  may  also  better  prepare  them  to  offer  encouragement 
and  emotional  support.  This  improved  communication  is  likely 
to  strengthen  the  important  cooperative  link  between  home 
and  school. 

Advantages  for  Administrators 

Administrative  responsibilities  at  the  building  level  include 
evaluating  the  effectiveness  of  classroom  teachers.  To  varying 
degrees  this  will  involve  judging  teachers  based  upon  their  stu- 
dents’ performance  on  standardized  tests  which  mav  have  little 
relevance  to  actual  classroom  instruction. 

In  evaluating  teachers  who  have  implemented  portfolios 
as  an  alternative  student  assessment  tool,  the  principal  can  better 
determine  the  focus  of  classnx^m  instruction  through  the  review 
ol  items  selected  tor  inclusion.  While  this  may  not  present  the 
whole  picture,  it  dix*s  represent  aspects  of  the  educational  pro- 
gram that  are  valued  by  both  the  teacher  and  students. 
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The  teacher’s  abilities  to  successfully  guide  students  as 
they  progress  toward  achieving  the  desired  learning  outcomes  can 
also  be  assessed  by  examining  included  samples  of  student  work, 
and  the  reflective  statements  can  provide  valuable  information 
about  the  emotional  climate  in  the  classroom. 

Administrators  can  also  use  portfolios  to  help  ensure  that 
classroom  instructional  goals  are  congruent  with  the  goals  of  the 
district  (Winograd  et  al.t  1991)  and  any  discrepancies  in  goals  can 
be  addressed  and  monitored  by  periodic  portfolio  review.  The 
information  about  classroom  activities  will  also  prepare  principals 
to  more  effectively  respond  to  parental  concerns  and  will  enable 
them  to  provide  examples  of  the  focus  of  the  instructional  program. 

While  the  above  examples  of  the  advantages  of  portfolio 
assessment  are  not  intended  to  be  exhaustive,  the  authors  hope 
they  will  identify  several  areas  worthy  of  further  consideration. 


Concerns  of  Portfolio  Implementation 

Despite  some  clear  advantages  for  the  use  of  portfolios, 
there  are  some  areas  of  concern.  First,  portfolio  assessment  can 
be  time-consuming  and  demanding  for  teachers.  Organizing  and 
managing  the  collection  of  multiple  measures  on  30  students  in  an 
elementary  classroom  or  150  students  at  the  secondary  level  is  not 
a simple  task  and  procedures  must  be  carefully  established  to  do 
so  Secondly,  teachers  need  to  become  sophisticated  in  a wide 
variety  of  assessment  techniques.  They  need  to  know  how  and 
when  to  record  student  behaviors  and  what  types  of  tools  are 
best  to  use.  They  also  need  to  be  knowledgeable  and  experienced 
in  the  analysis  and  interpretation  of  student  work  so  they  will  be 
able  to  use  this  information  effectively  for  planning  instruction. 

Russavage  (1992)  reports  that  the  teachers  she  studied  who 
were  involved  in  portfolio  development  and  evaluation  have  ex- 
pressed a need  for  more  training  and  practice  in  scoring  and 
evaluating  portfolios.  Her  research  also  indicates  that  teachers 
with  more  years  of  experience  and  with  experience  at  various 
grade  levels  have  a better  concept  of  appropriate  student  perfor- 
mance. They  arc  better  able  to  judge  student  progress  when  look- 
ing at  portfolios  than  are  teachers  with  less  experience.  She  also 
cautions  that  portfolio  implementation  can  be  overwhelming  for 
beginning  teachers.  Russavage’s  findings  are  supported  by  Harlin 
and  Lipa’s  (1992)  study  of  teacher  trainees  at  the  undergraduate 
and  graduate  levels.  The  researchers  found  that  the  trainees  inter- 
preted portfolio  data  differentially  depending  upon  their  training. 
Those  with  more  experience  in  collecting  and  analyzing  data  on 
students’  reading  and  writing  behaviors  were  better  at  interpreting 
the  data  in  portfolios.  These  researchers  concluded  that  training 
in  both  formal  and  informal  evaluation  and  assessment  procedures 
is  essential  if  teachers  are  going  to  use  portfolios  as  a means  of 
evaluating  students.  It  seems  likely  that  through  increased  teacher 
collaboration,  training,  and  administrative  support,  appropriate 
decisions  regarding  expectations  of  student  performance  can  he 
made  in  the  planning  stages  of  portfolio  implementation. 

If  portfolios  are  to  be  used  on  a large  scale  as  a means  of 
measuring  achievement,  as  in  Vermont  and  Kentucky,  many  other 
management  issues  need  to  he  resolved.  In  Vermont,  for  example, 


officials  found  that  42  percent  of  the  eighth  grade  math  portfolios 
in  1991  were  “unscorable”  because  they  had  inappropriate  or 
insufficient  materials  (Wagner,  1992).  This  problem  can  be  avoided 
by  carefully  establishing  and  training  teachers  in  procedures  before 
widespread  use. 

While  these  problems  are  not  insurmountable,  they  do 
require  attention  and  the  allocation  of  resources.  However,  once 
recognized  and  dealt  with,  the  advantages  of  portfolios  seem  to 
far  outweigh  the  management  issues. 


Getting  Started  with  Portfolios 

Tierney  et  al.  (1991)  emphasize  the  need  for  teachers  to 
help  students  develop  a greater  sense  of  responsibility  for  their 
own  work  and  their  own  learning.  From  the  very  beginning 
teachers  should  discuss  the  portfolio  process  with  students,  and 
show  examples  that  point  out  the  benefits  they  will  gain  by  keep- 
ing a portfolio.  In  this  way,  students  become  supporters  of  the 
process  and  collaborators  with  teachers  in  their  learning  and 
assessment. 

In  planning  for  the  implementation  of  portfolios,  teachers 
need  to  decide: 

• which  instructional  goals  should  be  reflected  in  the 
portfolios. 

• which  kinds  of  evidence  will  show  progress  toward  the 
goals  they  have  identified. 

• if  the  portfolios  will  only  include  evidence  of  student 
growth  that  test  scores  do  not  capture. 

• if  the  portfolios  will  corroborate  information  revealed 
by  test  scores  (Vavrus,  1990). 

An  important  first  step  that  teachers  can  take  to  get  stu- 
dents started  with  portfolios  is  to  help  them  save  a wide  variety 
of  examples  of  their  work  in  a folder.  From  this  broad  collection, 
students  can  draw  samples  throughout  the  school  year  to  show- 
case their  best  efforts. 

Teachers  should  also  help  students  learn  to  write  reflections 
and  self-evaluation  of  their  materials.  This  can  be  done  by  asking 
students  to  focus  their  attention  on  one  piece  or  several  pieces 
and  to  respond  to  certain  guided  questions.  For  example,  Vavrus 
(1990,  p.  52)  suggests  the  following  questions  for  a writing  piece: 

• What  do  I like  most  about  this  work? 

• What  was  important  to  me  when  1 wrote  it? 

• If  I revised  this,  what  wuuld  I change? 

• How-  has  my  writing  changed  since  I wrote  this? 

• Is  it  my  best  sample? 

Students’  responses  to  these  types  of  questions  can  become  an 
important  part  of  the  portfolio,  yielding  information  about  self- 
perceptions  of  the  learners,  their  value  system,  and  motivation. 
Teachers  may  also  include  their  own  anecdotal  records  from  con- 
ferences and  observations  regarding  progress  toward  instructional 
goals.  These  can  lx  especially  valuable  in  assessing  student  growth 
(Vavrus,  1990). 
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Periodically  throughout  the  school  year,  teachers  should 
help  students  update  their  portfolio  hy  teaching  them  how  to 
select  their  best  work  and  eliminate  other  materials  that  are  no 
longer  representative  of  their  level  of  learning.  Students  can  be 
taught  to  select  items  that  show  their  strengths,  interests,  versa* 
tility,  and  growth  over  time  (Tierney  et  al.,  1991). 

When  teachers  value  student  opinions,  choices,  and  self* 
reflections,  the  students  are  more  likelv  to  develop  a sense  of  pride 
and  greater  responsibility  for  their  own  learning. 

It  is  important  for  teachers  to  involve  parents  in  the  port- 
folio process.  This  can  be  done  by  periodically  sending  home 
newsletters  and  by  making  portfolios  available  for  review  at  a 
scheduled  open  house.  Some  teachers  also  have  students  bring 
their  portfolios  home  to  share  with  their  parents  so  that  they 
may  become  better  informed  about  assessment  procedures  and 
have  the  opportunity  to  offer  their  own  comments,  thus  becoming 
partners  in  the  evaluation. 

Another  important  aspect  of  portfolio  implementation  is 
the  student-teacher  conference,  which  has  been  previously  dis- 
cussed. Valencia  and  Pearson  (1987)  consider  this  is  to  be  a critical 
feature  of  the  assessment  and  recommend  that  teachen.  plan  con- 
ferences periodically  with  students  to  help  them  analyze,  compare, 
and  contrast'  their  pieces  so  that  they  both  can  discover  needs 
and  strengths  by  working  together. 

The  sharing  of  portfolios  with  classmates  can  provide  stu- 
dents with  ample  opportunities  to  discuss  their  portfolios  with 
each  other  so  that  they  can  learn  not  only  from  their  own  efforts 
but  also  from  the  examples  provided  by  others.  Learning  hy 
example  can  be  further  enhanced  by  the  teacher  preparing  his 
or  her  own  portfolio  which  can  be  shared  with  students.  This 
can  improve  student-teacher  rapport  by  giving  students  new  in- 
sights about  their  teacher  and  it  can  serve  as  a model  of  reflec- 
tive behavior  (Kearns,  1992). 


Materials  to  Include  in  Portfolios 

Because  portfolio  assessment  can  be  quite  time-consuming, 
it  is  best  if  teachers  start  by  focusing  on  one  or  possibly  two  sub- 
jects. For  example,  students  could  develop  a reading-writing  port- 
folio, or  they  could  develop  a portfolio  for  math  or  science.  The 
materials  selected  for  a portfolio  should  be  authentic  and  represent 
real  learning  activities  occurring  in  the  classroom.  For  a reading- 
writing portfolio,  the  following  items  might  be  selected:  written 
responses  to  literature;  literature  extensions  such  as  webs,  charts, 
and  timelines;  excerpts  from  student  journals;  lists  of  books  read 
by  the  student;  final  draft  of  writing  attached  to  initial  drafts; 
audio  tapes  of  oral  reading;  written  reports  from  various  content 
areas;  student  reading 'writing  interviews;  and  an  informal  reading 
inventor  (Vavrus,  N9Q;  Tierney  et  al.,  1991);  Russavage,  1992). 

A science  portfolio  might  include  photos  of  experiments, 
questions  related  to  the  science  textbook,  reports  on  experiments, 
diagrams,  and  journal  entries  reflecting  concepts  students  have 
developed.  In  math,  a student  might  document  growth  with 
examples  of  story  problems  he  or  she  w rote  to  demonstrate  math 
procedures  explanations  of  whv  a certain  mathematical  process 


works,  samples  of  computations,  and  books  read  with  a math 
theme.  Math  journal  entries  might  also  be  included  along  with 
questions  students  have  about  concepts  they  do  not  fully  under- 
stand. At  a later  time,  students  can  write  answers  to  their  ques- 
tions demonstrating  their  development  of  a higher  level  of  mathe- 
matical functioning. 

Once  procedures  for  portfolio  use  are  well  established  in 
a particular  subject  area,  teachers  may  wish  to  expand  their  use 
into  other  areas  of  the  curriculum.  A decision  to  do  so  should 
include  consideration  of  the  students'  readiness  to  assume  in- 
creased responsibility  in  evaluating  their  progress,  review  of  the 
necessary  time-management  concerns,  and  an  evaluation  of  the 
support  systems  available  to  the  teacher.  It  is  much  more  effective 
to  begin  with  a small,  manageable  portfolio  plan  and  to  expand  as 
experience  and  resources  allow  than  it  is  to  undertake  an  untested 
system  that  requires  more  time  and  skill  than  a teacher  may 
currently  possess. 

Concerns  with  Evaluating  Portfolios 

One  issue  that  must  be  clarified  from  the  onset  is  how  to 
evaluate  student  portfolios.  Decisions  must  be  made  to  determine 
if  student  performance  will  be  judged  solely  by  portfolio  evidence 
or  in  conjunction  with  other,  more  traditional  measures.  Teachers 
and  administrators  must  be  concerned  with  reliability  and  con- 
sistency among  judges  and  with  ensuring  that  students  are  in  fact 
performing  within  grade  level  expectations.  This  can  be  accom- 
plished by  consultation  among  teachers  to  clarify  these  expectations 
and  to  establish  standards  for  determining  if  a student's  portfolio 
demonstrates  excellent,  adequate,  or  inadequate  performance. 
Judgments  also  need  to  be  made  in  terms  of  the  type  and  amount 
of  materials  to  include.  This  does  not  mean  that  every  portfolio 
should  have  exactly  the  same  contents,  but  by  developing  general 
categories  of  materials  for  inclusion,  schools  will  be  better  able  to 
assess  students  in  a manner  that  is  consistent  and  reliable  across 
individual  classrooms  within  a building,  district,  or  state. 

Current  literature  offers  a variety  of  suggestions  for  develop- 
ing procedures  to  evaluate  portfolios.  Vavrus  (1990)  suggests  port- 
folios reflect  established  instructional  goals  and  that  they  be  eval- 
uated in  terms  of  the  students1  demonstrated  growths  toward 
these  goals  or  established  standards  of  excellence.  Tierney  et  al. 
(1991)  suggest  that  students  should  be  involved  in  criteria  selection. 
Their  preference  is  for  using  narrative,  which  focuses  on  students’ 
strengths  and  needs  rather  than  graded  evaluations  of  portfolios. 
They  also  suggest  that  if  grades  arc  to  be  assigned,  multiple  grades 
be  used.  For  instance,  separate  grades  can  be  given  for  assessing 
such  components  as  a student’s  improvement,  effort,  range  of  pro- 
jects, and  student  established  future  goals. 

Another  suggestion  made  by  Wolf,  LcMahicu,  and  Eresh 
(1992)  is  that  teachers  within  buildings  and  districts  engage  in 
periodic  cross-reading.  This  entails  selecting  a sample  of  portfolios 
reflecting  excellent,  average,  and  inadequate  student  growth  to  be 
read  and  scored  by  another  teacher.  Through  this  process  teachers 
can  come  to  consensus  regarding  grade  level  standards.  It  also 
provides  them  with  a view  of  teaching  and  learning  in  other  class- 

(onMmitt’tJ  on  /xi.cc  d2) 


Portfolio  Assessment  in  Our  Schools  (continual) 


rooms  and  ir  offers  the  opportunity  ro  share  and  get  feedback  from 
colleagues  (Newman,  Leathers,  Smolen,  Newman,  6c  Butcher,  1992). 

Decisions  regarding  how  portfolios  will  be  evaluated  must 
be  made  by  each  school,  district,  or  state  in  which  they  arc  adopted  ‘ 
There  is  no  one  method  that  will  be  appropriate  for  all  situations. 
However,  by  reviewing  the  plethora  of  literature  that  is  currently 
available  on  portfolios,  professionals  can  be  guided  in  determining 
what  is  most  appropriate  for  their  students. 

As  educators  move  toward  more  performance-based  assess- 
ment, the  potential  advantages  offered  by  portfolios  must  be 


considered.  Growing  out  of  authentic  classroom  practices,  port- 
folios provide  a wholistic  view  of  student  performance.  They 
allow  for  the  alignment  of  instruction  and  assessment  and  pro- 
vide the  opportunity  for  students  to  be  more  closely  involved 
in  reflecting  upon  and  assessing  their  own  growth.  They  also 
offer  a vehicle  for  increased  communication  among  teachers  and 
between  home  and  school.  Although  the  implementation  of  port- 
folios is  labor-intensive  and  time  consuming,  the  gains  in  terms 
of  improved  education  seem  to  warrant  their  consideration  as 
part  of  the  assessment  process  (Smolen  6c  Newman,  1992). 
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Voices  in  Education 


The  Mid-Western  Educational  Researcher  asked  leaders  in 
education  to  respond  to  the  question: 

What  advice  would  you  give  to  doctoral  students? 

Pick  topics  to  do  research  on  that  have  policy  implica- 
tions, however  faint.  Don’t  work  on  issues  merely  to  be  published. 

—David  Berliner,  Arizona  State  University 

The  student  should  love  scholarship,  love  his/her  area 
of  study,  and  should  love  to  study  and  write. 

— Jeanne  Chall,  Harvard  University 

I would  not  give  generic  advice— each  particular  doctoral 
student  calls  forth  different  forms  of  support.  1 guess  1 would 
say,  “Welcome  to  the  finest  work  on  earth.” 

—Christopher  Clark,  Michigan  State  University 

Prepare  a version  of  your  dissertation  for  publication  im- 
mediately  after  completing  it.  Write  a proposal  for  funded  research 
the  minute  you  begin  your  academic  career.  Don’t  write  a book 
too  soon.  — Lyn  Como,  Teachers  College  Columbia  University 

To  succeed  as  an  academic,  you  have  to  either  love  teaching 
or  love  research  (or  both).  If  you  do,  go  to  the  type  of  institution 
that  values  what  interests  you.  If  you  don’t,  find  a different  career. 

—Edward  Deci,  University  of  Rochester 

In  regard  to  your  doctoral  program,  seek  out  an  insti- 
tution  where  there  is  at  least  one  professor  who  has  attracted 
your  admiration  for  both  leadership  in  the  field  of  education 
and  concern  for  mentoring  graduate  students  very  carefully. 

—John  Goodlad,  University  of  UJfafimgton 

Try  to  develop  an  interdisciplinary  understanding  (qualita- 
tive and  quantitative)  of  what  is  demanded  by  “academia”  today. 

— Maxine  Greene,  Teachers  College  Columbia  University 


Work  on  the  integration  (intellectual,  methodological, 
conceptual)  of  your  teaching,  research,  and  service.  See  that  one 
informs  the  others  and  that  questions  raised  in  teaching  and  ser- 
vice are  attended  to  in  your  research.  I also  give  them  my  own 
“unbiased,  totally  objective”  view  of  the  politics  of  academia  and 
how  to  maneuver  through  them  during  the  first  few  years  in 


the  professorate. 


- Gary  Gri//in,  University  of  Arizona 


Strive  to  find  out  who  the  most  competent  professors  are 
in  your  university,  then  take  graduate  coursework  with  them  ir- 
respective of  their  areas  of  specialization.  In  general,  the  best  students 
are  prepared  by  the  best  professors. 

—W.  James  Popham,  IOX  Assessment  Associates 


1 advise  my  doctoral  students  headed  for  academia  to 
establish  a program  of  research  that  they  intend  to  pursue  over  time 
and  that  will  be  cumulative  in  nature.  I advise  them  to  focus  their 
work  on  important  questions,  specifically,  and  generally  to  hold 
high  standards  for  their  own  work. 

—Andrew  Porter , University  of  Wisconsin-Madison 


Do  a first  class  dissertation  in  an  area  that  promises  to  be 
of  long  term  interest  and  give  serious  attention  to  becoming  a 

good  teacher.  —Kevin  Rvan,  Boston  University 


1 advise  doctorate  students  to  have  a clear  focus  of  their 
career  goals.  If  they  know  what  they  want  to  do  with  their  degree, 
then  their  studies  become  focused  and  research  experiences  can  be 
designed  to  reinforce  their  studies  and  interests. 

—Jane  Stallings , Texas  A6^M  University 


Keep  up  an  effort  to  understand  the  problems  and  prac- 
tices of  education  in  the  field.  Help  educators  in  the  schools  to 
understand  more  fully  their  problems  and  the  resources  of  parents 
and  others  in  the  community  who  can  help  solve  these  problems. 

—Ralph  Tyler , Center  for  Advanced 
Study  in  Behavioral  Sciences 


New  Direction  in  Research  (continued  from  page  27) 

Midgley,  C.,  Feldlaufer,  H.,  & Ecclcs,  J.  (1989).  Change  in  teacher 
efficacy  and  students’  self-  and  task-related  beliefs  in  mathematics 
during  the  transition  to  junior  high  school.  Journal  of  Educational 
Psychology,  81,  245-258. 

Mulryan,  C.  (1989).  A study  of  intermediate-grade  students'  involve- 
ment and  participation  in  cooperative  small  groups  in  mathematics . 
Unpublished  doctoral  dissertation,  University  of  Missouri, 
Columbia,  MQ 

Newman,  R..  & Goldin,  L (1990).  Children’s  reluctance  to  seek  help 
with  school  work.  Journal  of  Educatioml  Psychology,  82,  92-100. 


This  paper  was  presented  as  the  keynote  address  at  the  Mid-Western 
Educational  Research  Assosciation  meeting  Chicago , October  14-/6,  7992. 

Portions  of  this  paper  will  appear  in  Good , T (In  press).  Teacher 
expectations.  In  L.  Anderson  (Ed.),  “ Encyclopedia  of  educational  research ” 
(6th  ed.).  New  York:  Macmillan. 

The  author  also  wishes  to  thank  Mary  McCaslin  and  Gail  Hinkel 
for  their  thoughtful  comments;  acknowledge  the  support  of  the  Center  for 
Research  in  Social  Behavior  at  the  University  of  Missouri-Columbia;  and 
thank  Lisa  Tharp  for  typing  this  manuscript. 
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The  Mid-Western  Educational  Research 
Association  (MWERA)  is  a nonprofit  organi- 
zation of  professional  educational  researchers 
primarily  from  states  and  provinces  located  in 
the  midwestern  region  of  the  United  States 
and  Canada.  Membership  is  open  to  faculty, 
students,  and  administrators  from  any  uni- 
versity, college,  and  school.  College  students 
engaged  in  educational  research  arc  especially 
encouraged  to  join  as  members.  Also  any 
educational  researchers  in  business  and  in- 
dustry, as  well  as  those  in  national,  state, 
local,  and  private  agencies  and  organizations 
are  welcome.  The  Association  promotes  and 
disseminates  educational  research  through 
its  publications,  its  scholarship  program,  and 
its  Annual  Meeting. 
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The  1993  dues  of  $10  for  students  and  $18  for 
professional  membership  include  a subscrip- 
tion to  the  Mid-Western  Educational  Researcher 
and  a reduced  registration  fee  for  the  Annual 
Meeting.  Address  membership  correspondence  to: 
Charles  C Anderson,  Jr.,  MWERA  Executive 
Officer,  1332  Southwind  Drive,  Northbrook, 
IL  60062;  phone  (708)  564-4796. 
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A little  over  three  years  ago  Isadore  Newman  approached  me  with  the  prospect  of  editing  the  publication 
of  the  Mid-Western  Educational  Research  Association.  At  the  time  the  newsletter  format  mostly  included  Associa- 
tion activities  and  selected  presentations  made  at  the  annual  meeting.  In  accepting  the  position  as  co-editors  we 
also  accepted  the  challenge  of  expanding  the  format  to  that  of  a journal.  We  quickly  began  establishing  an  editorial 
board  and  sought  their  advice  concerning  everything  from  the  title  of  the  journal  to  its  general  format.  Self-imposed 
deadlines  causing  time  constraints  and  an  unsteady  flow  of  manuscript  submissions,  paired  with  a desire  to  establish 
quality  through  the  recommendations  of  reviewers,  led  to  some  stress  and  frustration.  However,  the  project  has 
been  a very  rewarding  one.  Educational  leaders  across  the  country  have  spoken  very  positively  about  the  Association 
and  its  journal,  and  a recent  survey  indicated  that  the  membership  also  is  pleased  with  their  journal. 

I am  taking  this  opportunity  to  personally  thank  those  who  have  helped  to  make  the  Mid-Western  Educa- 
tional Researcher , a success:  First  I want  to  thank  Isadore  Newman  who  gave  a young  faculty  member  a chance  to 
work  on  an  exciting  project  with  a quality  colleague;  I thank  Dennis  Leitner  who  appointed  us;  Ayres  D’Costa, 
Barbara  Flake,  Ken  Kiewra  and  the  Executive  Committee  who  have  provided  us  with  unwavering  support;  the  authors 
of  manuscripts  that  were  accepted  as  well  as  those  that  were  not,  you  have  helped  to  define  the  publication;  the 
Editorial  Board  and  numerous  other  reviewers  whose  judgments  have  helped  to  establish  a quality  publication;  the 
membership  of  MWERA  who  make  the  Association  something  very  special;  the  Department  of  Educational  Psy- 
chology at  Ball  State  University;  and  lastly  1 thank  my  family  and  especially  my  wife  who  goes  to  bed  alone  too 
many  nights  so  that  her  husband  can  work  on  one  more  project.  M archant 
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is  designed  to  prepare  students  for  teaching  in  preschool,  elementary,  junior  high,  and  senior  high  schools.  Teachers  College  offers 
doctoral,  specialist,  and  master’s  degree  programs  in  a variety  of  subjects.  The  Department  of  Counseling  Psychology  and  Guidance 
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Information  for  Contributors  to  the  Mid-Western  Educational  Researcher 

The  Mid-Wfestem  Educational  Researcher  accepts  research-based  manuscripts  that  would  appeal  to  a 
wide  range  of  readers.  All  materials  submitted  for  publication  must  conform  to  the  language,  style,  and  format  of  the 
Publication  Manual  of  the  American  Psychological  Association,  3rd  ed.,  1983  (available  from  Order  Department, 
American  Psychological  Association,  P.O.  Box  2710,  Hyattsville,  MD  20784). 

Three  copies  of  the  manuscript  should  be  submitted  typed  double  space  (including  quotations  and  references)  on 
8^x11  paper.  Only  words  to  be  italicized  should  be  underlined.  Abbreviations  and  acronyms  should  be  spelled  out  for 
the  first  mention.  Pages  should  be  numbered  consecutively,  beginning  with  the  page  after  the  title  page. 
Manuscripts  should  be  less  than  20  pages  long.  An  abstract  of  less  than  100  words  should  accompany  the  manuscript. 

The  manuscript  will  receive  blind  review  from  at  least  two  professionals  with  expertise  in  the  area  of  the  manuscript. 
The  author’s  name,  affiliation,  etc,  should  appear  on  the  title  page  only.  Efforts  will  be  made  to  keep  the  review  process 
to  less  than  two  months.  The  editors  reserve  the  right  to  make  minor  editorial  changes  in  older  to  facilitate  a 
concise  clear  article.  The  author  will  be  consulted  if  any  major  changes  are  necessary. 

Manuscripts  should  be  sent  with  a cover  letter  to: 


Gregory  J.  Marchant 
Educational  Psychology 
Teachers  College 
Ball  State  University 
Muncic,  IN  47306-0595 


Isadore  Newman 

Educational  Foundations  and  Leadership 
College  of  Education 
The  University  of  Akron 
Akron,  OH  44325-4205 


The  Mid  Western  Educational  Researcher  (ISSN  1056-  3997)  is  published  quarterly  by  the  Mid-Western  Educational  Research  Association  through 
The  University  of  Akron.  The  fall  issue  serves  as  the  annual  meeting  program.  Second-class  postage  paid  ar  Altron,  Ohio,  and  additional 
mailing  offices.  POSTMASTER:  Send  address  changes  to  Charles  Anderson.  1332  Southwind  Drive,  Northbrook,  IL  60062. 
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Chaos  Modeling:  An  Introduction  and 
Research  Application 

By  Isndore  Newman  and  Carol  Wessinger,  The  University  of  Akron, 
and  Ron  Bobner,  Akron  Child  Guidance  Center 


Abstract 

The  purpose  of  this  article  is  to  introduce  chaos  theory  and  chaos  modeling  at  a basic  conceptual  level.  The  article  is  intended 
to  be  a primer  for  the  more  comprehensive  works  of  Gleick,  Peterson,  and  Briggs  <Sl  Peat.  The  intended  audience  is  professionals  in 
the  behavioral  sciences;  therefore,  the  article  relates  chaos  theory  to  more  traditional  methodologies.  There  has  been  an  overwhelming 
amount  of  popular  literature  espousing  chaos  theory  as  a panacea  for  understanding  human  behavior.  This  article  questions  the  appro- 
priateness of  such  a position  while  supporting  the  potential  value  of  chaos  theory  for  the  behavioral  sciences. 


Chaos  theory  is  being  used  as  a tool  to  study  a wide  variety 
of  phenomenon.  In  recent  years,  subjects  as  diverse  as  quantum 
mechanics  (Pool,  1989d),  astronomy  (Pool,  1989ft,  population 
dynamics  (Pool,  1989b),  turbulent  flows  (Gleick,  1987),  disease 
(Babloyantz  Destexhe,  1986),  economics  (Pool,  1989f),  epidemi- 
ology (Pool,  1989a),  weather  (Pool,  1989c),  and  geology  (Gleick, 
1987)  have  been  analyzed  in  this  context.  The  results  have  been 
startling,  exciting  and  challenging.  Not  only  are  these  applications 
of  the  theory  providing  the  scientific  community  with  new  infor- 
mation, they  are  also  providing  the  grist  for  a reanalysis  of  what 
it  means  to  “do  science,”  The  basic  tenets  of  the  positivistic  reduc- 
tionist approach  to  scientific  inquiry  so  prevalent  in  Western 
society  are  being  challenged. 

The  purpose  of  this  anicle  is  to  explain  chaos  theory,  to 
relate  it  to  traditional  research  methodologies,  and  to  discuss  its 
practical  application  to  behavioral  research.  The  philosophical 
implications  of  chaos  theory  will  be  discussed,  especially  as  they 
relate  to  quantitative  and  qualitative  methodologies. 

It  should  be  noted  from  the  outset  that  the  application  of 
chaos  theory  involves  a fair  amount  of  sophisticated  mathematics 
(Schuster,  1988)  by  someone  who  is  comfortable  working  with 
nonlinear  dynamics.  For  the  purposes  of  this  anicle,  an  intimate 
knowledge  of  advanced  mathematics  is  not  required  to  under- 
stand chaos  theory,  what  it  explains,  and  why  it  is  creating  so 
much  excitement  in  the  scientific  community. 

Chaos  theory  is  a philosophical  and  empirical  approach 
built  on  the  basic  assumption  that  there  is  a discoverable  dynamic 
hidden  within  behavior  that  appears  to  be  random  and  chaotic. 
Pool  (1989ft  labeled  it  “deterministic  randomness.”  Chaos,  in  the 
context  of  chaos  theory,  can  be  defined  as  nonrandom  behavior 
that  cannot  be  accurately  predicted.  Chaotic  systems  are  complex 
and  display  behavior  that  appears  to  be  random.  Further  study 
using  the  analytical  tools  of  chaos  theory  reveals  an  underlying 
determinism  which  helps  explain  the  systems  behavior.  Though 
the  behavior  of  chaotic  systems  may  have  defined  parameters, 
exact  prediction  is  not  possible. 

One  way  to  demonstrate  this  “deterministic  randomness” 
is  to  play  the  chaos  game  (Novo,  1989).  Suppose  that  three  points 


arc  placed  on  a piece  of  paper  in  a pattern  that  forms  an  equilateral 
triangle.  The  first  point  is  labeled  1 and  2,  the  second,  3 and  4 
and  the  third,  5 and  6.  One  of  these  points  is  chosen  at  random 
as  the  starting  point. 

The  game  is  played  by  rolling  a die,  moving  halfway  from 
the  current  position  to  the  point  whose  number  came  up,  and 
placing  a new  point  at  this  position.  Since  each  roll  of  the  die  is 
a random  event,  it  is  logical  to  assume  that  the  distribution  of 
points  on  the  paper  is  also  random.  However,  if  the  game  is  played 
long  enough,  a triangle-with in-triangle  pattern  emerges  (Figure  1). 
A very  orderly  pattern  arises  as  the  result  of  a supposedly  ran- 
dom process. 


Chaotic  systems  am  characterized  by  three  important  con- 
cepts: (1)  sensitivity  to  initial  conditions,  (2)  sensitivity  to  influx, 
and  (3)  self-similarity  or  nesting  (fractals).  Sensitivity  to  initial 
conditions  means  that  small  changes  in  the  initial  values  of  vari- 
ables in  a system  can  greatly  affect  the  systems  behavior.  This 
dependence,  also  called  the  “butterfly  effect,”  was  first  described 
by  Edward  Lorenz  in  his  study  of  weather  forecasting.  It  implies 
that  a butterfly  flapping  its  wings  in  Beijing  can  affect  global 
weather  conditions.  Lorenz  set  up  nonlinear  equations  that  dcs- 
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Chaos  Modeling  (continued) 


cribed  atmospheric  conditions  and  programmed  them  into  a com- 
puter to  project  future  outcomes.  Two  projections  using  the  same 
starting  values  to  three  decimal  places  while  the  other  had  started 
with  the  same  values  but  to  six  decimal  places.  A slight  change  in 
initial  values  of  the  variables  drastically  affected  the  projected 
results.  Lorenz  concluded  that  long  range  weather  forecaasts  were 
not  possible  because  initial  conditions  can  never  be  known  with 
enough  accuracy. 

Even  if  researchers  could  identify'  initial  conditions  with 
complete  accuracy,  another  characteristic  of  chaotic  systems  would 
prevent  accurate  prediction.  This  feature,  sensitivity  to  influx, 
refers  to  the  fact  that  in  chaotic  systems,  small  changes  occurring 
during  the  system’s  operation  can  drastically  alter  the  systems 
behavior  on  both  a short-  and  long-term  basis.  These  changes  can 
be  a value  change  for  a parameter  in  the  system  or  the  introduc- 
tion of  a new  parameter.  When  a system  encounters  such  a change, 
its  behavior  begins  to  oscillate,  tending  toward  multiple  outcomes. 
These  branchings,  or  bifurcations,  are  a breakdown  in  the  linear 
behavior  of  the  system.  A series  of  bifurcations  causes  the  system 
to  fragment  itself  into  a chaotic  state.  When  researchers  plot  the 
behavior  of  such  a system,  they  find  periods  of  stability  between 
the  chaotic  states.  Period  doubling  refers  to  the  amount  of  time  it 
takes  a system  to  return  to  stability  after  a period  of  chaos.  Mitchell 
Feigenbaum  discovered  a mathematical  constant  that  could  be  used 
to  predict  these  period  doublings,  enabling  researchers  to  predict 
when  a system  would  become  chaotic. 

Chaotic  systems  return  not  only  to  stability  but  to  a pre- 
vious pattern  of  behavior.  This  quality,  called  self-similarity  or 
nesting,  is  defined  as  symmetry  or  consistency  across  scale.  Self- 
similarity  can  be  represented  by  the  fractal,  a geometric  shape 
conceived  by  Benoit  Mandelbrot.  A fractal  is  characterized  by 
replication  of  a larger  shape  on  smaller  and  smaller  scales.  The 
replications  contain  the  same  proportions  as  the  original  shape. 
Fractals  abound  in  nature— frost  crystals,  a head  of  broccoli,  the 
branching  of  a tree. 

Fractals  can  also  be  created  on  paper.  Imagine  an  equi- 
lateral triangle.  On  each  side  of  the  triangle  draw  another  equi- 
lateial  triangle  one  third  the  size  of  the  original  and  center  it  on 
the  middle  of  each  side.  Continue  this  process  indefinitely.  It  is 
not  hard  to  imagine  that  the  perimeter  of  the  figure  increases  to 
infinity.  This  figure  (Figure  2)  is  known  as  the  “Koch  Island”  and 
was  introduced  to  mathematicians  by  Helge  von  Koch  in  1904 
(Peterson,  1988). 


Figure  2 

The  first  four  stages  in  constructing  a Koch  snou- flake. 
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Fractals  however  represent  more  than  patterns  within  pat- 
terns. They  illustrate  the  concept  of  partial  dimensions,  called 
fractals  dimensions.  One  way  of  visualizing  a dimension  between 
one  (line)  and  two  (plane)  is  to  create  a Peano  curve.  This  curve 
was  conceived  by  Giuseppe  Peano  in  1890  (Briggs  &.  Peat,  1989). 
The  curve  is  created  by  starting  out  with  a straight  line  which  is 
successively  folded.  It  can  be  shown  that  the  line  can  touch  every 
point  in  the  plane  without  ever  crossing  itself.  In  the  beginning, 
the  line  touches  every  point  in  the  plane,  representing  two 
dimensions.  WTien  the  line  takes  up  only  a percentage  of  the 
points  in  the  plane,  it  can  be  thought  of  as  having  a dimension 
greater  than  one  and  less  than  two.  Fractal  dimensions  describe 
the  complexity  of  a shape;  the  greater  the  fractal  dimension,  the 
greater  the  complexity.  The  coastline  of  Great  Britain  has  a fractal 
dimension  of  1.26,  while  the  fractal  dimension  of  the  human  brain 
is  2.73  to  2.79  (Briggs  Peat,  1989). 

A specific  type  of  fractal,  the  “strange  attractor”  is  used  to 
represent  the  behavior  of  chaotic  systems.  In  classical  (linear) 
dynamics,  “attraction”  is  the  concept  that  systems  tend  toward 
an  end  behavior.  The  attractor  is  a shape  that  represents  this  end 
behavior  and  it  is  determined  by  plotting  the  movement  of  the 
system  through  time.  A trajectory  is  formed  by  a series  of  points 
that  represent  the  values  of  system  variables  at  a given  moment  in 
time.  These  plottings  are  called  phase  space  diagrams.  In  linear, 
nonchaotic  systems,  the  attractor  may  be  a point  of  spiral.  For 
chaotic  systems,  the  attractor  is  complex,  displaying  ever-changing 
trajectories,  hence  the  name  “strange.”  Though  the  points  and 
resulting  trajectories  in  a strange  attractor  appear  random,  over 
time  a pattern  emerges.  This  pattern  has  definable  parameters  and 
an  overall  shape  that  is  bounded  and  delimited.  Once  the  attrac- 
tor for  a chaotic  systems  is  plotted,  researchers  have  identified 
the  basic  parameters  of  the  system  and  can  make  predictions 
within  those  parameters. 

Calculating  the  fractal  dimension  of  the  strange  attractor 
gives  an  idea  of  the  complexity  of  the  system,  (ui  the  degree  to 
which  the  trajectory  folds  back  on  itself  in  self-similar  patterns). 
The  higher  the  fractal  dimension,  the  more  complex  the  behavior 
of  the  system.  Researchers  have  constructed  phase  space  diagrams 
from  EEG  data  and  have  calculated  the  fractal  dimensions  of  the 
resulting  attractors  (Rapp,  1985).  For  subjects  resting  with  their 
eyes  closed,  EEG  attractors  showed  a fractal  dimension  of  2.3. 
Babloyantz  and  Destexhe  (1986)  found  that  for  patients  under- 
going epileptic  seizures,  the  fractal  dimension  of  EEG  attractors 
was  about  2. 

Methodology  and  Paradigms 

Chaos  theory  provides  a method  for  describing  and  explain- 
ing the  behavior  of  nonlinear  systems.  It  tends  to  be  different  from 
traditional  scientific  theory  in  that  it  focuses  on  interrelationships 
rather  than  individual  elements.  It  views  interactions  in  their  en- 
tirety. It  uses  a systems  approach  rather  than  a reductionist  approach. 

(continued  on  jxigc  4) 
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A qualitative  vs.  quantitative  approach  is  useful  in  com' 
paring  chaos  theory  to  traditional  educational  research  method' 
ologies.  Quantitative  research  involves  assigning  numbers  to 
objects  and  using  this  data  in  predictions,  if  enough  information 
is  available.  Emphasis  is  placed  on  reliability  and  validity.  Theories 
are  conceived  and  analyses  are  conducted  to  test  these  theories 
to  see  if  observed  data  fit  the  theory.  Qualitative  research,  on  the 
other  hand,  looks  at  the  data  and  derives  its  theory  from  the  data. 
Interpretation,  explanation  and  insight  emerge  from  the  data.  Every 
situation  is  unique  and  emphasis  is  placed  on  describing  a situa- 
for  its  own  sake.  While  these  definitions  are  oversimplifications, 
they  serve  to  illustrate  the  point  that  qualitative  and  quantitative 
methodologies  have  sometimes  been  viewed  as  mutually  exclusive 
(Cook  <Sc  Reichardt,  1979).  More  recent  discussions  have  suggested 
that  this  is  a false  dichotomy,  that  these  methods  arc  part  of  an 
interactive  continuum  (Newman  & Benz,  in  press). 

How  one  deals  with  the  “deterministic  randomness’1  of 
chaos  depends  on  one’s  philosophical  perspective.  Quantitative 
researchers  would  say  that  the  behavior  is  not  truly  random.  They 
would  strive  to  adequately  quantify  all  of  the  system’s  variables 
so  that  accurate  prediction  would  be  possible.  Quantitative  re- 
searchers work  to  explain  and  eliminate  randomness.  Qualitative 
researchers,  however,  would  consider  the  “randomness”  of  the 
system  as  part  of  the  data,  a manifestation  of  the  system  that  should 
be  worked  into  theory  rather  than  eliminated.  These  two  per- 
spectives  can  be  illustrated  by  how  they  treat  outliers.  From  a 
quantitative  perspective,  the  outlier  is  considered  a meaningful 
part  of  the  data  and  is  retained  in  the  analysis. 

Chaos  theory  follows  a qualitative  approach  in  its  method- 
ologies.  Chaos  researchers  study  a system  in  order  to  see  what 
emerges  from  it,  using  a strange  attractor  to  describe  the  behavior 
of  the  system.  The  process  that  produces  the  strange  attractor 
involves  the  plotting  of  a great  many  data  points.  These  data 
points  create  a pattern  that  is  not  apparent  when  only  a few  points 
are  plotted.  Points  that  at  first  may  seem  to  represent  extreme 
behaviors  often  become  pan  of  the  strange  attractor  as  it  emerges. 
In  describing  human  behavior,  an  extreme  score  may  thus  become 
pan  of  a pattern  of  behavior  which  may  not  be  apparent  until 
many  data  points  are  plotted. 

Other  parallels  exist  between  chaos  theory  and  traditional 
research  methodologies.  The  strange  attractor  can  be  thought  of 
as  representing  an  underlying  construct  or  principle  of  a system 
and  can  be  equated  conceptually  with  a factor  in  a factor-analytic 
sense.  Factor  analysis  is  done  to  produce  factors  which  arc  assumed 
to  measure  or  represent  underlying  constructs  in  the  behavior 
being  studied.  Factors  are  derived  by  running  a series  of  correla- 
tion*. to  determine  the  structure  of  the  data.  Likewise,  a strange 
attnetor  is  produced  by  plotting  what  could  be  considered  a series 
of  correlation  points,  or  the  relationships  between  variables  at  a 
given  moment  in  time.  The  shape  that  results  is  one  that  can  he 
replicated  in  further  studies  of  the  same  system.  The  phase  space 
diagram  of  a strange  attractor  can  be  compared  to  a linear  rcgrcs- 


sion  scatterplot.  The  latter  is  an  approximation  of  the  relationship 
between  variables  as  defined  by  the  scatterplot.  The  strange  attractor 
shows  the  interrelationships  in  a nonlinear,  dynamic  system. 
Another  feature  of  chaotic  systems,  the  bifurcation,  can  be  com- 
pared to  a trend  line  that  splits,  going  in  two  directions.  Accurate 
prediction  is  possible  until  the  systems  behavior  branches  into 
alternative  outcomes. 

As  the  complexity  of  a system  increases,  so  does  the  num- 
ber of  variables  needed  to  describe  its  behavior.  The  attractor 
will  have  as  many  dimensions  as  there  are  variables  being  measured. 
The  behavior  of  a simple  system  may  be  represented  by  two  or 
three  dimensions,  while  a more  complicated  system  will  require 
many  more  dimensions.  Obviously,  an  attractor  of  four  or  more 
dimensions  is  hard  to  visualize.  This  is  somewhat  analogous  to 
the  factor  analysis  of  a complex  system  in  that  a complex  system 
will  produce  more  factors  and  would  be  considered  multidimen- 
sionally  complex.  When  researchers  name  factors,  they  are  inter- 
preting the  data.  At  this  point  in  time  it  does  not  appear  that 
this  conceptualization  has  been  applied  to  strange  attractors. 

Chaos  theory  and  education 

Human  behavior  is  multidimensionally  complex,  and  the 
application  of  chaos  theory  to  this  area  of  study  needs  to  be  care- 
fully conceptualized  Perhaps  the  most  immediate  application  of 
chaos  research  in  education  is  the  study  of  individual  brain  func- 
tion. The  research  previously  cited  focused  primarily  on  the  nervous 
systems’s  transition  to  abnormal  conditions.  There  is  also  research 
being  conducted  which  attempts  to  understand  the  brain  as  it 
functions  under  normal  conditions. 

Christine  Skarda  (Ecole  Polytechnique  in  Paris)  and  Walter 
Freeman  (UCLA)  have  studied  phase  space  diagrams  of  EEG 
activity  from  the  olfactory  bulbs  of  rabbits  in  order  to  understand 
learning  and  memory.  They  found  that  the  normal,  alert  state  of 
the  brain  was  chaotic.  After  initial  introduction  to  a particular 
odor,  subsequent  reintroduction  would  momentarily  decrease  the 
chaos.  They  were  also  able  to  identify  unique  patterns  for  each 
type  of  odor.  These  patterns  changed  from  rabbit  to  rabbit,  but 
remained  consistent  within  rabbit  (Skarda  Freeman,  1987). 
Freeman  and  Bob  van  Dijk  subsequently  reported  similar  results 
in  EEG-based  phase  space  diagrams  from  the  visual  cortex  of 
monkeys  (cited  in  Pool,  1989c).  Paul  Rapp  at  the  Medical  College 
of  Pennsylvania  has  focused  on  categorizing  the  fractal  dimensions 
of  the  human  brain  while  his  subjects  completed  various  mental 
tasks.  He  found  that  mental  activity  increases  the  amount  of  chaos 
present  (Rapp,  1987). 

As  research  in  this  area  progresses,  it  is  highly  probable 
that  it  will  produce  information  about  how  people  learn.  While 
many  educational  researchers  may  not  have  the  resources  to  carry 
out  these  types  of  studies,  there  is  little  doubt  that  an  under- 
standing of  the  physiology  of  learning  has  heuristic  potential 
for  education. 


Chaos  Modeling  (continued) 

Practical  uses  of  chaos  theory 
in  behavioral  research 

Chaos  theory  has  fascinating  philosophical  and  methodo- 
logical implications.  However,  the  pragmatic  aspects  of  chaos 
rheorv  related  to  psychological  or  educational  research  need  to 
be  carefully  considered.  Some  psychologists  believe  that  chaos 
theory  can  be  used  to  explain  and  predict  personality  (DeAngclis, 
1993).  Arnold  Mandell  of  the  University  of  California  believes 
that  he  might  be  closing  in  on  a strange  attractor  which  repre- 
sents the  "personality”  of  an  individual.  He  believes  that  data 
from  the  firing  rate  of  dopamine  receptors,  serotonin  receptors, 
and  single  cells  in  EEG  activity  will  show  the  same  strange  attractor 
for  anv  given  individual  (cited  in  Briggs  <Sc  Peat,  1989).  The  con- 
ceptual leap  from  the  firing  rates  of  ncurotransmitters  to  specific 
human  behavior  is  a large  one. 

Chaos  theory  has  also  been  used  to  generate  models  of 
brain  functioning.  Matte  Bergstrom  of  the  University  of  Helsinki, 
Finland  refers  to  his  model  as  a ‘‘bipolar  generator11  and  divides 
the  brain  into  an  information  end  and  a random  or  chaos  end. 
He  believed  that  the  interaction  of  these  ends  produces  thought 
and  behavior  (cited  in  Briggs  & Peat,  1989). 

Though  chaos  theory  presents  useful  concepts  for  under- 
standing human  behavior,  operationalizing  these  concepts  is  not 
easy.  Explanation  and  prediction  of  complex,  chaotic  systems  are 
derived  from  the  plotting  of  that  system’s  behavior.  Our  previous 
discussion  explained  the  complexity  of  plotting  systems  with  3 or 
4 variables.  Plots  of  fairly  simple  psychological  variables  are  multi- 
dimensional. The  strange  attractor  of  an  EEG  for  a person  in  deep 
sleep  has  a fractal  dimension  of  almost  4 and  requires  5 dimen- 
sions in  phase  space  to  be  plotted  accurately  (Pool,  1989c). 

Accurate  measurement  seems  to  be  a problem  as  shown 
by  the  seeming  inconsistencies  in  research  reporting  on  the  fractal 
dimensions  of  EEG’s.  EEG  dimensions  vary  depending  on  the 
activity  or  state  of  the  person  being  measured.  Values  have  been 


reported  ranging  from  2 to  4 fractal  dimensions  for  such  activities 
or  states  as  deep  sleep,  mental  arithmatic,  and  epileptic  attacks. 
One  researcher  was  unable  to  calculate  the  EEG  dimension  for  a 
person  awake  because  of  its  complexity,  yet  another  researcher 
calculated  values  of  2.3  to  2.9  for  waking  EEG  activity.  Whether 
due  to  measurement  errors  or  inconsistent  methodologies,  these 
problems  reveal  the  difficulties  in  plotting  and  interpreting 
chaotic  behavior. 

Plotting  personality  would  be  even  more  complex.  If  one 
accepts  that  the  minimum  number  of  factors  needed  to  describe 
personality'  is  16  (Cattell,  1965),  then  one  would  need  17  dimen- 
sions to  plot  it.  The  plotting  of  personality  in  phase  space  may  be 
possible,  but  interpretation  would  be  extremely  difficult  if  not 
impossible.  Additional  family  system  and  ecological  variables  would 
be  necessary  to  go  beyond  personality  to  families  and  other  social 
svstems.  Plotting  all  these  variables  using  chaotic  methodology  is 
virtually  impossible  to  comprehend.  Yet  people  talk  about  using 
chaos  theory  in  clinical  pyschology  as  a means  to  understand  a 
person’s  mental  state  and  to  suggest  appropriate  intervention. 
The  philosophical  implications  of  chaos  theory  have  been  mis- 
applied in  practical  terms.  If  this  practice  continues,  we  may  have 
a powerful  technique  that  will  lose  credibility  because  of  its 
misapplication. 

As  professionals,  we  should  be  committed  to  supporting  the 
investigation  or  our  subject  matter  with  the  most  appropriate 
scientific  tools.  Current  research  methods  may  oversimplify  our 
complex  content  area.  Chaos  theory  presents  an  approach  that 
may  be  more  appropriate  in  theoretical  terms,  yet  its  practical 
application  is  difficult.  We  have  an  obligation  to  our  profession 
to  investigate  the  potential  applicability  and  usefulness  of  chaos 
theory  for  understanding  human  behavior.  It  is  hoped  that  such 
endeavors  will  serve  our  professional  growth  and  add  to  the  knowl- 
edge base  of  our  profession  while  facilitating  our  ability  to  more 
effectively  serve  our  students  and  clients. 
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The  Relationship  of  Test  Anxiety  and 
Self  Concept  to  Patterns  of 
High  School  Students’  Achievement 

By  Janice  E.  Williams,  Oklahoma  State  University 


Abstract 

The  present  study  assessed  the  influence  of  test  anxiety  and  self-concept,  both  independently  and  in  combination,  upon  student 
test  performance  across  four  different  subject  matter  areas.  Public  high  school  students  (N=217)  were  administered  an  ACT  assessment, 
a test  anxiety  inventory,  and  a self-concept  measure.  The  results  indicated  that  test  anxiety  and  self-concept  contributed  independently 
and  approximately  equally  to  student  academic  achievement.  In  addition,  student  performance  was  uniformly  affected  by  test  anxiety 
and  selfconcept  across  all  four  content  sub-areas.  The  results  of  this  study  strongly  suggested  the  desirability  of  reducing  anxiety  and 
improving  selfconcept,  since  they  accounted  for  unique  variance  in  predicting  achievement. 


Test  anxiety  and  self-concept  have  been  identified  as 
major  variables  impacting  academic  achievement  (see  Tryon,  1098; 
Byrne,  1986).  Hembree  (1988)  has  indicated  that  test  anxiety,  which 
interferes  with  performance,  is  inversely  related  to  self-esteem. 
Two  major  issues,  however,  remain  unresolved.  The  first  of  these 
issues  involves  whether  or  not  these  two  affective  variables  are 
related  or  independent  in  their  influence  upon  student  achieve- 
ment. The  second  issue  involves  whether  or  not  test  anxiety  and 
self-concept  differentially  influence  achievement  in  various  sub- 
areas of  student  study  (c.g.,  English,  science). 

Although  the  literature  generally  supports  the  association 
between  self-concept  and  achievement,  and  test  anxiety  and 
achievement,  research  focusing  upon  the  relative  influence  of 
self-concept  and  test  anxiety  upon  achievement  has  produced 
indeterminant  findings.  Several  investigations  have  indicated  that 
self-concept  and  test  anxiety  may  influence  achievement  in  con- 
junction. For  example,  Deffenbacher  (1978)  and  Sarason  and  Stoops 
(1978)  have  indicated  that  negative  self-statements  (i.e.,  low  self- 
concept)  may  be  as  critical  as  anxiety  in  influencing  school  achieve- 
ment. High  anxious  students  have  been  reported  to  produce  more 
negative  self-statements,  which  in  turn  influences  academic  achieve- 
ment (Hammermaster,  1989). 

On  the  other  hand.  Galassi,  Frierson  and  Sharer  (1981) 
found  that  there  was  no  correlation  between  the  negative  self-state- 
ments for  cither  high  or  low  anxious  persons  and  their  test  per- 
formance. It  has  been  suggested  that  rhe  negative  thoughts  of  high 
anxious  students  tend  to  focus  upon  the  testing  situation  itself 
rather  than  upon  themselves,  (sec  Wine,  1980).  Others  (e.g.,  Bruch, 
Juster  & Kaflowitz,  1983)  have  indicated  that  neither  the  focus  of 
students’  self-statements  nor  their  anxiety  reactions  contributed 
to  test  performance.  Mort*  recently,  Williams  (1991)  has  indicated 
that  although  test  anxiety  and  self-concept  are  correlated  with 
adolescent  achievement,  their  contributions  were  independent. 

A second  area  of  controversy  in  linking  self-concept  and 
test  anxictv  concerns  whether  or  not  test  anxiety  and  self-concept 
contribute  in  the  same  manner  to  different  areas  of  student  achieve 


ment.  Establishing  such  patterns  of  achievement  requires  the 
measurement  of  achievement  across  different  subject  or  content 
areas.  Review  articles  indicate  that  most  of  the  past  research 
relating  test  anxiety  to  achievement  (see  Hembree,  1988)  and 
self-concept  to  achievement  (see  West,  Fish  & Stevens,  1980)  has 
typically  either  used  a single,  global  measure  of  achievement  or 
multiple  measures  of  achievement  analyzed  separately.  Many  of 
the  studies  that  have  compared  achievement  across  subject  areas 
with  differences  in  test  anxiety  have  yielded  mixed  results.  For 
example,  Crocker,  Schmitt  and  Tang  (1988)  studied  the  association 
between  test  anxiety  and  academic  performance  across  five  different 
subject  areas.  They  reported  similar  negative  anxiety— achieve- 
ment relationships  across  all  five  content  areas.  Betz  (1978),  on  the 
other  hand,  has  cited  differences  between  the  impact  of  student 
anxiety  levels  upon  student  verbal  and  quantitative  performance. 

Many  investigators  have  focused  upon  the  anxiety  levels 
associated  with  the  quantitative  subject  areas.  Test  anxiety  and 
mathematics  anxiety  have  been  reported  to  be  functionally  related 
(see  Hendel  <St  Davis,  1978;  Rounds  <Sc  Hendel,  1980),  and  related 
in  terms  of  similarity  of  components  (see  Wigfield  Meece,  1988). 
Thus  if  mathematics  anxiety  is  one  component  of  test  anxiety, 
test  anxiety  might  differentially  impact  student  performance  de- 
pending upon  the  area  of  achievement  that  is  assessed. 

Similarly,  different  components  of  self-concept  might  also 
differentially  impact  student  achievement.  Byrne  (1988)  has  indi- 
cated that  the  relationship  between  adolescent  achievement  and 
self-concept  is  clearly  dependent  upon  the  particular  self-concept 
facet  in  question.  Current  measures  of  self-concept  have  focused 
upon  the  measurement  of  specific  components  (see  Byrne  St 
Shavclson,  1986).  In  the  popular  Shavelson  et.  al  (1976)  model, 
self-concept  is  hcirarchically  ordered,  with  general  self-concept  at 
the  apex,  moving  to  self-concept  in  academic  and  nonacademic 
areas,  leading  to  specific  sub-areas  of  self-concept  (c.g.  English, 
mathematics,  science,  physical  appearance,  peers),  and  finally  to 
perceptions  of  behavior  at  the  base.  Although  Noble  and  McNabb 
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Patterns  of  Student  Achievement  (continued) 

(1988)  have  reported  that  motivational  and  other  affective  variables 
have  been  significantly  related  to  student  achievement  scores, 
researchers  seeking  to  uncover  patterns  of  student  achievement 
across  different  self-concept  levels  have  typically  used  the  academic 
self-concept  sub-areas.  For  example,  mathematics  achievement 
has  been  reported  to  be  highly  correlated  with  mathematics  self- 
concept,  and  less  correlated  with  self-concept  in  other  academic 
areas  (see  Marsh,  Relich  & Smith,  1983).  More  recently,  Marsh 
(1990)  has  stated  that  mathematics  and  English  self-concepts  were 
uncorrelated,  despite  a significant  correlation  between  achieve- 
ment in  these  two  areas. 

If  self-concept  becomes  increasingly  multifaceted  from  in- 
fancy on  (Marsh  Shavelson,  1985),  with  the  facets  increasingly 
interdependent  (Marsh  O’Neil  and  Marsh  et  al.,  1984),  then 
corresponding  studies  into  the  relatively  unexplored  components 
of  nonacademic  self-concept  appear  to  be  warranted. 

Purpose  of  the  Study 

The  purpose  of  this  study  was  to  answer  the  following 
research  questions: 

(1)  Does  test  anxiety  and  self-concept  account  for  a sig- 
nificant amount  of  unique  variance  in  high  school  students’ 
academic  achievement? 

(2)  Do  differences  in  test  anxiety  and  self-concept  result  in 
different  achievement  patterns  across  four  separate  content  areas? 

(3)  Is  there  an  interaction  effect  of  test  anxiety  and  self- 
concept  upon  student  academic  achievement? 

The  secondary  goals  of  the  study  were  to  determine 
whether  differences  in  self-concept,  test  anxiety,  and  achievement 
existed  for  different  student  groups  (i.e.,  gender  and  class  level). 


Method 

Sample 

Participants  in  this  study  (N  = 217)  were  high  school  stu- 
dents attending  public  schools  in  northern  Oklahoma.  Approxi- 
mately 38  percent  of  the  sample  were  seniors,  44  percent  juniors, 
and  18  percent  “other”  (e.g.  freshmen,  sophomores,  exchange  stu- 
dents, high  school  graduates,  college  students).  Students  came 
from  urban,  suburban,  and  rural  backgrounds,  and  were  primarily 
middle-class  and  white.  About  62  percent  of  the  sample  was  female 
(64  juniors,  46  seniors,  24  “other”),  with  38  percent  male  (32  juniors, 
37  seniors,  14  “other”). 

Procedure 

Student  data  in  this  study  were  collected  during  nine  ACT 
Preparation  Workshops  sponsored  by  the  Education  Extension 
Office  of  Oklahoma  State  University',  Student  participation  was 


voluntary,  with  most  students  referred  by  school  counselors  and/ 
or  parents.  The  workshops,  conducted  both  on-campus  and  at 
several  off-campus  locations  around  the  state,  consisted  of  a one- 
day  program  of  activities  to  prepare  students  to  take  the  ACT 
Assessment  examination.  During  each  workshop,  students  com- 
’ leted  three  self-administered  questionnaires  assisting  their  test 
anxiety,  self-concept,  and  achievement  level.  Administration  of 
the  instruments  was  interspersed  throughout  each  workshop. 

It  should  be  noted  that  the  data  in  this  study  cannot  be 
claimed  to  duplicate  the  results  that  would  have  been  obtained 
if  data  from  all  high  school  student  were  collected. 

Instrumentation 

Achievement  Measures.  The  ACT  Assessment  is  a com- 
prehensive evaluative,  guidance,  and  placement  program  used  by 
over  a million  students  each  year.  The  current  study  utilized  an 
ACT  Assessment  practice  test  (American  College  Testing  Program, 
1989)  to  measure  student  academic  achievement  in  four  major 
curricular  areas:  English  (23  items),  mathematics  (20  items),  reading 
(20  items),  and  science  (18  items).  Higher  student  subtest  scores 
indicated  a higher  measure  of  overall  educational  development. 

Aiken  (1985)  has  reported  adequate  internal  consistency 
reliability  coefficients  for  each  subsection,  [English  (.92),  mathe- 
matics (.91),  reading  (.88)  and  science  (.85)].  He  has  also  stated 
that  a comparison  of  item  content  with  item  specifications  for 
the  four  subtests  has  yielded  a substantial  degree  of  content  validity. 

Test  Anxiety  Measure.  The  majority  of  current  test  anxiety 
scales  have  been  designed  to  assess  the  two  major  facets  uncovered 
by  test  anxiety  researchers:  worry  (the  cognitive  concerns  of  test- 
ing) and  emotionality  (physiological  reactions  to  the  testing  situa- 
tion). Review  articles  (e.g.,  Wine,  1980)  have  indicated  that  “worry” 
has  been  repeatedly  shown  to  be  the  most  important  of  the  two 
anxiety  components.  While  “emotionality”  has  been  consistently 
reported  to  be  unrelated  to  achievement,  there  has  been  abundant 
research  supporting  the  negative  effect  of  “worry”  on  achievement 
(see  Tryon,  1980).  Thus,  for  the  current  study,  the  “worry”  com- 
ponent of  the  widely-used  Test  Anxiety  Inventory  (TAI)  [Spielberger, 
1980]  provided  a measure  of  student  test  anxiety. 

“Worry”  was  measured  with  eight  items  scored  along  a 
Likert-type  scale  with  four  answer  choices:  (1)  almost  never,  (2) 
sometimes,  ( ^ often,  and  (4)  almost  always.  Sample  items  included, 
“I  freeze  up  on  important  exams”  and  “I  seem  to  defeat  myself 
while  working  on  important  tests.”  The  minimum  possible  student 
score  on  this  subscale  was  8,  with  a maximum  obtainable  score  of  32. 
Higher  student  scores  indicated  a greater  amount  of  test  anxiety. 

Spielbeiger  (1980)  has  presented  both  reliability  and  validity 
information  for  this  scale.  Internal  consistency  reliability  coeffi- 
cients of  .88  have  been  reported,  as  well  as  test-retest  reliabilities 
of  .81  and  .62  over  two  weeks  and  six  months  respectively.  Cor- 
relations of  the  "worry”  scale  with  six  coefficients  which  have 
ranged  from  .44  to  .79. 

Self-Concept  Measure.  Self-concept  was  measured  with  The 
Multidimensional  Test  of  Self-Concept  (MTS)  [Lathrop,  1988],  This 
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instrument  was  specifically  designed  to  assess  nonacademic  self 
concept,  in  contrast  to  most  self-concept  measures  which  stress 
global  or  academic  self-concept.  The  MTS  taps  student  self-concept 
in  each  of  three  areas  identified  as  directly  relevant  in  applied  set- 
tings: sociability,  competence,  and  dependability.  Due  to  empirical 
considerations,  the  current  study  utilized  only  the  “competence” 
subscale.  Hudson  (1988)  has  cited  “competence”  as  the  most  influ- 
ential variable  in  a detailed  study  of  student  nonacademic  self- 
concept.  Williams  (1991)  determined  that  “competence”  was  the 
most  important  self-concept  predictor  of  global  student  academic 
achievement. 

Self-concept  was  measured  with  six  items  which  assessed 
student  perception  of  current  competence,  (e.g.,  “Alert— Unalert” 
“Inexpert— Expert,”  “Informed— Uniformed”)  was  scaled  along  a 
seven-point  graphic  rating  scale,  with  half  of  the  items  reverse- 
scored.  The  possible  range  of  student  scores  on  this  instrument 
was  from  6 to  42,  with  higher  scores  indicating  higher  nonaca- 
demic self-concept. 

Lathrop  (1987;  1988)  has  provided  support  for  both  the 
reliability  and  validity  of  this  nonacademic  self-concept  subscale. 
Reliability  was  assessed  three  different  ways:  generalizability  coeffi- 
cients (.78),  alpha  coefficients  (.73),  and  test-retest  stability  coeffi- 
cients with  a three-month  delay  (.71).  Confirmatory'  factor  analyses 
and  correlational  analyses  with  other  established  self-concept 
measures  have  been  cited  in  support  of  the  construct  validity  of 
this  subscale. 

Results 

Initial  Analyses.  Descriptive  statistics  were  generated  across 
all  six  variables  of  interest:  achievement  (English,  mathematics, 
reading,  science),  self-concept  and  test  anxiety.  These  descriptive 
statistics  are  presented  in  Table  1.  As  noted  there,  although  the 
standard  deviations  across  the  four  achievement  measures  were 
fairly  consistent  (a  range  from  3.23  to  4.47)  the  mean  scores  varied 
somewhat.  As  one  might  expect,  both  mathematics  and  science 
scores  were  lowest  for  this  sample  (about  10  points  each),  with 
reading  (about  13)  and  English  (about  18)  the  highest. 

Table  1 

Descriptive  Statistics  for  Total  Student  Sample  CN-217) 


Variable  Mean  Standard  Deviation  Range 

English 17.76  4.13  4-23 

Mathematics  ....  10.35  4. 47  1-20 

Reading 12.65  3.64  3-20 

Science 9.80  3.23  3-18 

Self-Concept  ..  . . 33.15  3.95  17-41 

Tc-it  Anxiety 14.47  4.36  8-20 


Group  Differences.  Analyses  of  variance  were  conducted 
to  test  for  possible  test  anxiety,  self-concept,  and  achievement 
differences  based  upon  gender  and  class  level  student  groupings. 
These  analyses  were  conducted  to  determine  whether  the  sample 
used  in  the  current  study  exhibited  the  pattern  of  results  typically 
reported  by  other  researchers.  For  example,  research  has  indicated 
that  test  anxiety  has  remained  fairly  consistent  through  high 
school,  with  higher  levels  of  test  anxiety  associated  with  female 
students  (see  Hembree,  1988).  Studies  focusing  on  adolescent  gender 
differences  in  academic  self-concept  have  also  generally  reported 
consistent  findings.  Males  have  typically  exhibited  higher  quanti- 
tative self-concept  while  females  have  exhibited  higher  verbal  self- 
concept.  At  the  high  school  level,  females  have  tended  to  have 
higher  performance  levels  than  do  males  (Byrne  Shavelson, 
1987).  In  addition,  due  to  additional  instruction,  seniors  might  be 
expected  to  outperform  juniors  on  achievement  tests. 

A 2x3 -factorial  analysis  of  variance  was  conducted  to  test 
for  possible  student  differences  in  test  anxiety.  Test  anxiety  scores 
served  as  the  dependent  variable,  with  scudents  nested  in  both 
gender  group  (male  or  female),  and  class  level  (junior,  senior,  or 
“other”).  The  second  analysis  was  conducted  in  a similar  manner 
(i.e.,  the  same  grouping  variables),  with  student  self-concept  scores 
serving  as  the  dependent  variable.  No  statistically  significant  dif- 
ferences were  detected  in  either  analysis. 

A third  ANOVA  was  performed  with  students  nested  in 
both  gender  and  class  level,  with  the  four  student  achievement 
subscales  used  as  repeated  measures.  This  analysis  resulted  in  a 
statistically  significant  main  effect  for  “Class  level,”  and  a signifi- 
cant interaction  between  “Gender”  and  “achievement.”  However, 
omega-squared  values  of  only  .01  were  computed  for  both  effects, 
indicating  only  minor  practical  differences.  As  a consequence, 
the  student  data  were  collapsed  across  gender  and  class  groups, 
and  the  remainder  of  the  analyses  which  addressed  the  major 
research  questions  central  to  this  study  were  conducted  on  the 
full  student  sample. 

Interaction  Analyses.  The  analyses  to  answer  the  major 
research  questions  of  this  study  proceeded  from  the  specific  to  the 
general.  Therefore,  the  issue  of  interaction  between  test  anxiety 
and  self-concept  upon  student  achievement  scores  was  addressed 
first.  Four  sets  of  model  comparisons  were  conducted  to  answer 
the  interaction  question.  The  format  of  these  analyses  for  the 
c polish  subtest  Achievement  variable  was: 

Eq.  1 English  = f (Test  Anxiety  + Self-Concept) 

Eq.  2 English  = f (Test  Anxiety  $ Self-Concept  + 

Test  Anxiety  x Self-Concept) 

Similar  analyses  were  conducted  for  the  remaining  three  Achieve- 
ment subscalcs.  The  incremental  R-squared  values  (e.g.,  R2  equa- 
tion 2 minus  R2  equation  1)  for  the  interaction  terms  are  shown 
in  Table  2.  The  associated  values  of  W (Pedhazur,  1982;  pp.  618-620) 
arc  also  shown  in  Table  2.  These  W values  test  the  significance 
of  the  difference  between  the  two  prediction  equations  for  each 
achievement  variable.  As  noted  there,  the  p-valucs  associated  with 

(continued  on  page  10) 
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Table  2 

Incremental  R 2 Values  Associated 
with  the  Text  Anxiety  X Self  Concept  Interaction 


Significance  test  for 


Dependent 

Variable 

R-Squarcd 

Goodness  of  fit 
W 

English  

.0005S 

.056  (p  = .80) 

Mathematics 

.00684 

•7l6.(p  = .40) 

Reading  ... 

.00062 

.066  (p  * .80) 

Science 

.00137 

.141  (P  = .70) 

i he  interaction  term  across  the  four  content  subareas  ranged  from 
AO  to  .SO.  This  indicated  the  absence  of  any  significant  interaction 
effect  between  re  a:  anxiety  and  self-concept  across  all  content  areas. 

Content  Area  Analyses . The  second  research  question 
addressed  in  this  study,  the  issue  of  pattern  differences,  was  simpli- 
fied Mine  the  interaction  terms  were  non-significant  in  each  of  the 
tour  cases  (see  equation  [l|  page  9).  The  four  sets  of  beta  weights 
tor  both  affective  variables  were  examined. 

In  this  sample  self-concept  was  weighed  more  heavily  in 
predicting  math  and  science,  while  holding  anxiety  constant.  Test 
anxietv  was  weighed  more  heavily  in  predicting  English  and  read- 
ing while  holding  self-concept  constant.  All  possible  pair-wise 
differences  between  the  Test  Anxiety  beta-weights  were  tested. 
Adjusting  for  multiple  post -hoc  comparisons  (see  Keppel,  198 T; 
15  hi  57),  none  of  these  differences  were  statistically  significant. 
Similar  analyses  were  conducted  between  the  four  heta-weights 
for  Self-Concept.  Again,  none  of  these  differences  reached  a level 
of  statistical  significance. 

Principal  Component  Analysis.  Principal  component  scores 
were  generated  to  yield  a single  accurate  index  of  “student  achieve- 
ment." The  achievement  score  was  derived  from  the  first  factor 
from  a principal  component  - .alvsis.  This  analysis  indicated  that 
the  first  eigenvalue  accounted  for  the  majority  (65.4  percent)  of 
the  variance  of  the  entire  set  of  scores.  Relatively  small  and  equal 
variance  (about  12  percent)  were  detected  in  the  remaining  three 
<.  omponents.  The  equation  for  the  first  principal  component 

Achievement  = .833  English  + .783  Mathematics  + 

.805  Reading  + .813  Science 

It  appeared,  from  this  equation,  that  each  of  the  content  areas 
lontTibuted  about  equally  to  the  final  achievement  score  earned 
bv  each  student. 

This  achievement  score  was  then  regressed  upon  the  stu- 
dent test  anxiety  and  self-concept  scores.  The  results  of  this 
analysis  yielded  the  following  standardized  prediction  equation: 

*•  /V hicvemenr  ” *■  ta  + ‘•sc 


The  multiple  R value  for  this  analysis  was  .382,  with  an  associated 
F-value  (d.f.  = 2,  214)  of  18.28;  p < .001.  The  t-values  (d.f.  = 
214)  associated  with  the  beta  weights  for  both  test  anxiety  and 
self-concept  were  also  statistically  significant  (p  < .001).  It  was 
apparent  that  these  two  affective  variables  accounted  for  a sig- 
nificant amount  of  unique  variance  in  the  prediction  of  student 
academic  achievement. 

Discussion 

As  anticipated,  the  results  of  the  currern  study  indicated 
that  students  who  reported  higher  self-concept  and  lower  test 
anxiety  also  had  higher  achievement  scores  across  all  four  content 
sub-areas.  This  finding  was  consistent  with  D week's  (1986)  con- 
clusion that  test  anxiety  and  negative  self-concept  had  profound 
effects  on  cognitive  performance.  It  should  be  noted,  however, 
that  students  in  the  current  study  anticipated  being  college-bound 
or  participated  in  the  workshops  at  the  urging  of  their  parents 
and/or  school  counselors.  In  addition,  the  students  may  not  have 
taken  the  “practice”  achievement  test  seriously,  and  therefore  their 
scores  may  not  be  reflective  of  their  “true”  ability.  Thus,  the 
current  findings  may  not  be  totally  gcneralizable  to  the  actual 
performance  level  af  all  high  school  students. 

The  finding  of  no  significant  curricular  area  pattern  dif- 
ferences related  to  either  test  anxiety  or  sclf-conecpt  was  surpris- 
ing. Researchers  assessing  both  mathematics  and  test  anxiety  have 
reported  moderate  correlations  between  the  two  constructs  (see 
Betz,  1978),  and  have  indicated  that  it  is  often  difficult  to  distin- 
guish between  the  two  (see  Wigfield  & Mcecc,  1988).  If  these 
findings  could  be  generalized  to  the  current  study,  one  would 
have  expected  a greater  impact  of  test  anxiety  on  the  sub-areas  of 
mathematics  and  science  than  upon  English  and  reading.  Addi- 
tional research  relating  mathematics  anxiety  and  its  components 
to  test  anxiety  appears  to  be  warranted. 

The  finding  of  non-significant  pattern  differences  is  also  in 
direct  contrast  to  the  conclusions  of  Byrne  and  Shavelson  (1986), 
and  Marsh  and  Shavelson  (19S5).  They  related  curricular  area 
achievement  to  specific  corresponding  sub-areas  of  academic  self- 
concept.  However,  given  the  Self-Perception  model  of  personality 
developed  by  Bern  and  Allen  (1974),  one  may  question  whether 
or  not  “self-concept”  was  actually  being  measured  in  their  studies. 
A question  such  as  “How  good  arc  you  in  math?”  would  appear 
to  he  simply  a veridical  report  based  upon  ample  prior  evidence 
(i.e.,  the  scores  previously  obtained  on  mathematics  tests). 

Finally,  the  current  results  have  indicated  that  test  anxiety 
and  self-concept  appeared  to  have  a ubiquitous,  non-intcractive 
effect  upon  all  four  areas  of  student  performance  assessed.  The 
impact  of  such  a conclusion  upon  programs  for  academic  inter- 
vention is  striking.  The  present  study  suggested  that  successful 
intervention  programs  should  be  oriented  towards  reducing  feelings 
of  test  anxiety  and  improving  perceived  self-concept.  For  example, 
Wilson  and  Rotter  (1986)  studied  the  effects  of  five  different  treat- 
ment intervention  conditions  upon  both  test  anxiety  reduction 
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and  self-esteem  enhancement.  They  have  indicated  that  a coun- 
seling approach  to  test  anxiety,  with  ego-strengthening  suggestion 
and  study-skills  development,  produced  the  greatest  long-term 
effect  upon  changing  both  test  anxiety  and  self-esteem.  It  should 
be  noted,  however,  that  their  study  involved  only  individuals 
classified  as  “high  test  anxious.”  The  present  study  would  appear 


to  extend  their  conclusion,  in  that  student  test  anxiety  and  self- 
concept  scores  were  not  artifical!  / categorized  but  were  permitted 
to  vary  across  all  values  from  low  to  high.  Additional  follow-up 
studies  testing  paradigms  such  as  that  proposed  by  Wilson  and 
Rotter  should  be  conducted  using  all  the  information  provided 
by  continuously-scaled  affective  measures. 
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MWERA  Communication  & Update 


MWERA  Needs  Your  Help 

Session  chairs,  discussants,  and  reviewers  are  needed  to 
make  the  conference  a success.  Many  of  you  may  have  an  interest 
in  serving  MWERA  in  this  way  and  the  organization  welcomes 
the  widest  diversity  of  involvement  possible.  Let  me  encourage 
you  to  submit  your  name  to  the  appropriate  division  chair  listed 
in  the  Call  for  Proposab  or  directly  to  me.  In  submitting  your  name, 
let  the  division  chair  or  me  know:  (1)  Your  name,  (2)  institution, 
(3)  title,  (4)  address,  (5)  day  and  evening  phone  numbers,  (6)  fax 
number,  (7)  EMAIL  address,  and  (8)  your  area  of  expertise,  (9) 
the  division  you  most  align  yourself  with,  and  (10)  what  you 
would  prefer  to  do  to  serve  MWERA.  Sec  you  in  October! 

—Thomas  Andre,  1993  Program  Chair 

New  Editorial  Board  Member 

The  Mid-Western  Educational  Researcher  welcomes  Steven 
Jurs  to  its  Editorial  Advisory  Board  and  appreciates  the  expertise 
and  direction  he  will  be  providing  to  the  journal. 

MWERA  History 

The  Mid-Western  Educational  Research  Association  is 
considering  the  development  of  a written  history  of  the  organi- 


zation. If  you  are  interested  in  working  on  this  project,  then  con- 
tact President  Ken  Kiewra,  University  of  Nebraska,  1307  Seaton 
Hall,  Lincoln,  NE  68588-0641,  (402)  472-3233. 


MATEP  Call  for  Papers 

The  annual  meeting  of  the  Midwest  Association  of  Teachers 
of  Educational  Psychology  (MATEP)  will  be  held  October  1 and  2 
at  Anderson  University  irt  Anderson,  Indiana  (30  miles  northeast 
of  Indianapolis).  This  year’s  theme  is  “Quality  in  Education:  The 
Roles  and  Methods  of  Teachers  of  Educational  Psychology.”  Those 
wishing  to  participate  should  send  four  (4)  copies  of  a one-page 
single-spaced  proposal  relating  to  topics  on  instruction,  learning, 
and  applied  practice.  Two  copies  of  the  proposal  should  contain 
the  presenter’s  name  and  affiliation;  the  other  two  should  not. 
A cover  letter  should  accompany  the  proposal  describing  the  pre- 
ferred format  (most  presentations  will  be  paper  sessions,  however, 
a few  roundtables/poster  sessions  may  be  scheduled).  Alternative 
formats  such  as  panels,  symposia,  or  workshops  are  welcome.  In 
addition,  please  note  your  willingness  to  serve  as  a session  chair. 
Those  who  are  willing  to  serve  as  a session  chair,  but  are  not  pre- 
senting, should  contact  one  of  the  co-chairs,  Greg  Marchant  or 
Linda  Chiang.  Proposals  should  be  sent  by  June  15  to:  Greg 
Marchant,  MATEP  Proposal,  Educational  Psychology,  Ball  State 
University,  Muncie,  IN  47306. 
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Member-AuLarge  Report  to  the  Membership: 
The  1992  Annual  Meeting 

By  Sharon  McNeely,  Northeastern  Illinois  University 


The  Member-at-Large  to  the  Executive  Committee  is 
charged  with  membership  recruitment  and  with  evaluating  the 
annual  conference.  This  year  we  have  seen  a small  growth  in  new 
memberships,  but  a decrease  in  renewals  of  memberships,  with 
the  end  result  being  that  at  the  start  of  1993,  we  have  less  paid 
members  than  in  1992.  While  the  Association  Council  and  I are 
charged  with  building  membership,  this  is  a task  which  really 
falls  into  the  hands  of  all  members.  If  you  like  being  a member  of 
MWERA,  one  of  your  colleagues,  students,  teachers,  etc.,  may 
like  it  also.  Please  pass  along  membership  information  to  them. 

Attendance  at  the  1992  Annual  Meeting  was  about  the 
same  at  it  has  been  for  the  past  two  years.  We  can  easily  increase 
the  attendance  and  not  outgrow  the  Bismarck.  I hope  you  will 
think  about  encouraging  your  colleagues  to  attend  in  1993. 

Most  of  the  1992  Annual  Meeting’s  sessions  were  evaluated 
this  year.  The  evaluations  provided  valuable  data  for  planning 
next  year’s  conference  and  for  generally  improving  our  meetings. 
The  number  one  concern  across  the  sessions  was  to  have  screens 
for  the  overheads.  This  next  year  we  will  attempt  to  do  so.  Cun 
rently,  we  are  very  fortunate  that  the  Bismarck  lets  us  bring  in 
equipment.  Most  hotels  require  that  you  rent  it  from  them.  We 
save  several  hundred  dollars  per  day  by  bringing  in  overhead  pro- 
jectors,  etc.,  in  addition  to  what  we  save  because  we  do  not  pay 
room  rental.  While  those  of  us  who  work  on  the  convention  prepa- 
ration will  try  to  meet  presenters’  needs,  we  also  want  to  encour- 
age you  to  chink  about  bringing  needed  materials  with  you,  and 
planning  your  presentations  accordingly. 

There  were  also  a number  of  evaluations  which  commented 
that  presenters  did  not  have  prepared  papers  for  distribution  to 
the  audience.  Some  presenters  did  not  get  their  papers  to  the 
discussants  prior  to  the  program.  As  you  prepare  your  proposals 
for  the  May  15,  1993,  deadline,  please  keep  in  mind  that  if  you 
present,  you  will  need  to  have  copies  of  your  complete  paper  avail- 
able to  your  audience. 

The  evaluation  results  also  showed  concern  for  the  poor 
attendance  at  some  sessions.  The  program  chairs  always  need  to 
try  to  balance  the  number  of  sessions,  acceptance  of  papers,  and 
attendance.  From  the  session  evaluations,  it  seems  that  some  of 
the  workshops,  and  some  of  the  sessions,  especially  those  sched- 
uled for  early  Thursday,  late  Friday,  and  Saturday  morning  may 
have  been  lacking  audiences.  If  you  have  any  ideas  for  increasing 
audience  size,  let  me  know.  In  the  meantime,  please  consider  how 
important  it  is  for  you  to  have  an  audience  when  you  present, 
and  make  it  a point  to  be  an  audience  member  for  others. 


Our  organization  and  our  annual  meeting  have  seen  a 
huge  growth  in  the  few  years  we  have  been  organized.  As  a re- 
sult, we  are  experiencing  some  of  the  problems  that  come  with 
growth.  The  session  evaluations  brought  up  some  ethical  concerns 
which  we  all  need  to  consider.  For  instance,  presenters,  chairs,  and 
discussants  all  have  responsibilities.  If  they  are  absent  from  their 
sessions,  they  need  to  make  arrangements  with  the  Program  Chair 
regarding  appropriate  coverage.  Also,  sessions  are  for  the  presen- 
tation of  educational  research.  The  selling  of  products,  presenta- 
tion of  political  platforms,  and  other  such  items  is  inappropriate. 
All  of  us  who  have  been  involved  in  MWERA,  AERA,  etc., 
need  to  help  mentor  newcomers  as  to  what  is  expected  of  their 
participation. 

Richard  Pugh  did  a fantastic  job  as  the  1992  Program 
Chair.  The  Invited  Speakers  presentations  by  Thomas  Good  and 
Mary  McCaslin,  and  the  Presidential  Address  by  Barbara  Plake 
were  rated  very  highly.  It  seems  like  our  return  to  a Presidential 
Address  was  successful. 

The  1993  Program  Chair  is  Thomas  Andre.  He  is  already 
hard  at  work,  and  has  made  some  decisions  regarding  the  meeting. 
Logistically,  we  have  agreed  to  again  furnish  overhead  projectors, 
and  to  try  to  furnish  screens.  We  will  use  Blackhawk  Room  as  a 
“social  and  convention  related”  room,  where  local  attendees  can 
keep  their  coats,  those  who  typically  gather  in  the  hallway  after  a 
session  can  continue  their  talk  without  disturbing  other  presenta- 
tions, presenters  can  practice,  etc.  Also,  we  will  again  have  an 
Exhibits  Area  for  one  day.  This  year  it  will  be  staffed  full-time 
to  hopefully  avoid  the  unfortunate  situation  we  had  last  year  when 
a display  book  was  taken.  As  Exhibits  Chair,  I want  to  thank 
the  membership  for  their  cooperation  regarding  this  incident. 
1 also  hope  you  will  let  me  know  any  particular  publishers  you 
would  like  to  see  at  this  year’s  convention. 

In  addition  to  the  program  logistics,  the  1993  program 
will  experiment  with  alternative  session  formats,  such  as  posters, 
roundtable  discussions,  etc.  This  will  give  us  a chance  to  develop 
other  formats  and  to  explore  more  topics  than  we  can  cover  in 
regular  sessions.  I hope  that  when  you  pass  along  copies  of  the  call 
for  proposals  to  colleagues  you  let  them  know  that  the  program 
will  not  be  limited  to  the  standard  presentation  format. 

If  there  is  anything  else  I can  help  you  with  regarding  your 
membership  in  MWERA,  please  let  me  know'.  I will  look  forward 
to  seeing  you  at  the  annual  meeting. 
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Please  consider  this  Call  for  Proposals  a personal  invitation  to  participate  in  the  1993  Annual  Meeting  of  MWERA.  To  encourage  you  to 
submit  a proposal,  let  me  tell  you  about  some  of  the  exciting  events  that  will  occur  at  the  convention.  Dr.  John  Brans  ford,  will  present  an  MWERA 
Invited  Address  on  Macro-contexts  for  Problem-Based  Learning:  Design  Principles  for  Enhancing  Learning  and  Transfer,  on  Wednesday 
Oct.  13,  1993.  Dr.  Bransford  also  will  present  the  MWERA  Key-note  Address,  Research  on  Macrocontexts  for  probleni-Based  Learning,  on 
Thursday  Oct.  14.  On  Friday,.  Oct.  15,  1993,  Dr.  Jere  Brophy,  Michigan  State  University,  will  present  the  MWERA  Luncheon  Address , Trends 
on  Research  on  Teacliing,  and  Dr.  Ken  KJewra.  University  of  Nebraska,  will  present  the  Presidential  Address.  On  Friday  afternoon.  Dr.  Frank 
Baker,  University  of  Wisconsin,  will  give  a Division  D Invited  Address  on  Equating  Tests  Under  Item  Response  Theory. 

The  conference  will  include  paper  sessions,  symposia,  and  workshops.  A highlight  this  year  is  the  emphasis  on  alternative  sessions  and  the  use  of 
poster  sessions.  A graduate  student  workshop  on  finding  and  surviving  the  first  position  will  be  held  on  Friday.  Exhibits  will  be  available  for  your 
perusal  on  Friday  as  well. 

The  MWERA  meeting  is  for  You!  Your  fellow  members  want  to  know  about  your  research  and  your  insights  into  the  process  of  education. 
Collectively,  wc  need  your  help  to  make  this  conference  a success.  Please  develop  a proposal  and  encourage  your  colleagues  to  do  so.  Encourage 
your  graduate  students  to  attend  and  participate.  You  are  the  best  form  of  advertising  that  MWERA  has!  Wc  need  you  to  pass  the  word  about 
how  wonderful  the  MWERA  conference  is.  With  your  participation,  we  can  make  the  1993  Conference  as  big  a success  as  previous  meetings  have 
been. 

Thomas  Andre,  1993  Program  Chair 


Call  for  Proposals  --  Due  May  15, 1993 


Conference  Highlights 

Wednesday , October  13 

• Training  Workshops 

• Featured  Presentation  8-9  PM 

• Speaker:  John  Bransford 

• Topic:  Macro-contexts  for  Problem-Based  Learning:  Design 
Principles  for  Enhancing  Learning  and  Transfer 

Thursday,  October  14 

• Keynote  Address 

• Speaker:  John  Bransford 

• Topic:  Research  on  Macrocontexts  for  Problem-Based 
Learning 

• Division  Discussion  Meetings 

• Evening  Social,  6-8  PM 

Friday,  October  1 5 

Presidential  Address 

•Speaker:  Ken  KJewra 

• Business  Meeting 

• Luncheon 

• Luncheon  Address 

• Speaker:  Jere  Brophy 

• Topic:  Trends  hi  Research  In  Teaching 

• Exhibits 

• President's  Reception,  Bismarck  Regency  Suite.  9 PM 

Saturday,  October  16 

• Fun  Run 

• Paper  and  Symposium  Sessions  Scheduled  until  noon. 

General  Information 

A.  Proposals  may  be  in  the  form  of  alternative  sessions,  symposia, 
scholarly  papers/poslers.  Participants  are  encouraged  to  develop 
proposals  that  best  communicate  their  research  and  theoretical  ideas 
and/or  provide  for  scholarly  debate  about  research  and  theoretical 
issues.  MWERA  sessions  arc  designed  to  promote  communication 
about  education  and  educational  research.  It  is  contrary  to  MWERA 
policy  to  present  sessions  that  promote  a commercially  available 
product  or  service  (except  for  Exhibits)  or  that  go  beyond  the  limits  of 
appropriate  scholarly/scientific  communication.  Individuals  interested 
in  displaying  educationally  related  products  or  services  should  contact 
Sharon  McNccly,  PO.  Box*  34421,  Chicago,  IL  60634.  312-794-2788. 


Deadline:  All  proposals  must  be  postmarked  no  later  than  May 
15, 1993.  All  proposals  will  be  peer  reviewed. 

B.  Any  educational  researcher,  whether  MWERA  member  or  not,  may 
submit  a proposal.  NON  MEMBERS  WHOSE  PROPOSALS  ARE 
ACCEPTED  MUST  JOIN  MWERA  UPON  NOTIFICATION  OF 
AN  ACCEPTED  PROPOSAL. 

C.  MWERA  reserves  the  right  to  reproduce  and  distribute  summaries 
and  abstracts  of  all  accepted  proposals.  Unless  expressly  prohibited  in 
writing,  by  the  authors),  summaries  may  also  be  made  available  to  tlie 
press  or  other  interested  parties  upon  request.  Such  limited  distribution 
docs  not,  of  course,  preclude  subsequent  publication  of  a summary'  or 
complete  paper  by  the  authors).  Authors  are  encouraged  to  consider 
publication  in  the  Mid-Western  Educational  Researcher. 

D.  All  persons  attending  the  Annual  Meeting,  Including 
participants,  are  required  to  register  for  tlus  meeting  and  to  be 
members  of  MWERA.  /Ml  sessions  listed  in  the  program  will  be  open 
to  anyone  registered  for  the  meeting.  A fee  will  be  charged  and 
enrollment  may  be  limited  for  Workshops.  Materials  for  registering  for 
the  Annual  Meeting  will  be  published  in  the  Mid-Western  Educational 
Researcher. 

E.  Participants  in  paper  sessions,  symposia,  and  alternative  sessions 
must  distribute  handouts  to  attendees  at  their  sessions.  This 
handout  should  include  as  complete  a copy  of  the  paper  or  a summary 
of  the  symposium  talk  or  alternative  presentation  as  possible. 

F.  Participants  arc  responsible  for  submitting  their  written  paper 
or  summary  to  the  Session  Chair,  Discussant,  Divisional  Program 
Chair  and  Program  Chair  one  month  prior  to  the  Conference 
(Sep.  13,  1993).  Failure  to  do  so  may  lead  to  elimination  of  the  paper 
from  the  program. 

G.  Papers  may  also  be  submitted  to  ERIC  for  distribution  to  the 
profession.  This  does  not  preclude  publication  in  a journal.  ERIC 
forms  will  be  available  at  the  Conference  Registration  Desk. 

II.  Some  papers  will  be  accepted  as  poster  sessions.  Proposers  will  have 
the  opportunity  to  indicate  a preference  for  poster  sessions  or  traditional 
paper  sessions,  but  the  program  committee  will  make  the  final  decision. 
Proposers  whose  papers  are  accepted  for  paper  sessions  will  be 
responsible  for  producing  appropriate  poster  materials 
I.  Wc  attempt  have  overhead  pi  ejectors  available  in  every  meeting  room 
for  use  by  presenters.  No  other  AV  equipment  will  be  provided  by 
MWERA.  If  special  AV  equipment  Is  needed,  participants  are 
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responsible  for  providing  such  equipment  at  the  participant's 
expense. 

J.  Submission  of  a proposal  entails  an  ethical  responsibility  on  the 
part  of  the  proposer  to  present  the  paper,  symposium,  or 
alternative  session  if  it  is  accepted,  if  a proposer  becomes  unable  to 
present  an  accepted  proposal,  it  is  the  responsibility  of  the  proposer  to 
arrange  for  some  alternative  means  of  distributing  the  paper  and  to 
notify  the  Program  Chair  in  advance. 

Guidelines  for  Alternative  Session  Proposals 

A,  General  Information  about  Alternative  Session  Proposals 
Alternative  session  proposals  are  designed  to  explore  alternative  ways 
of  presenting  and  communicating  scientific  information.  They  arc 
limited  only  by  your  creativity  and  the  requirements  to  fit  writhin  the 
time  guidelines  for  MWERA  sessions  and  to  not  entail  any  additional 
expense  to  MWERA  As  suggested  by  AERA  experimental  formats 
do  not  necessarily  have  to  be  radical.  A single  paper  presented  with 
several  discussants  whose  function  it  is  to  lead  small  group  discussions 
would  be  considered  experimental.  A Panel  Discussion  format  in 
which  four  or  five  scholars  each  give  a short  (e.g.  5 minute)  position 
statement  on  a noteworthy  or  controversial  issue  and  then  a discussion 
between  the  panelists  and  audience  ensues  would  also  be  considered 
experimental.  A debate  between  proponents  of  alternative  views  on  a 
controversial  issue  might  provide  another  example.  A media-driven 
session  would  be  another  example.  Let  your  creativity  be  free! 

B.  Material  to  Submit  with  an  Alternative  Session  Proposal 

1.  Alternative  Session  Froposal  Cover  Sheet,  (see  enclosed).  Six 
copies  with  all  applicable  items  completed. 

2.  Summary.  Six  copies  of  a 2-3  page  single  spaced  summary-  for  use  in 
judging  the  merits  of  the  session.  Three  copies  of  the  summary  should 
include  the  name(s)  and  institutional  affiliations  of  the  organizer, 
session  chair,  participants  or  authors,  and  discussants  (or  other 
individuals  who  may  participate  in  the  alternative  session).  Three 
copies  should  omit  that  information  unless  the  identity  of  the 
participants  is  a critical  component  in  evaluating  the  value  of  the 
proposal.  Panel  Discussions  and  other  proposals  in  which  the  names 
and  reputations  of  the  participants  are  part  of  the  value  of  the  proposal 
should  include  the  names  on  all  six  copies.  Proposals  that  use  an 
alternative  format  to  describe  the  results  of  an  empirical  investigation 
should  provide  for  blind  review.  Proposers  should  use  their  best 
judgment  in  this  regard.  Describe  the  nature  and  format  of  the 
alternative  session.  If  there  are  invited  participants,  indicate  who  they 
are  and  what  their  roles  and  contributions  will  be.  Summarize  the 
content  to  be  presented  or  discussed  in  the  session.  Make  clear  the 
scientific/scholarly  value  of  the  session  and  the  theoretical  and 
empirical  issues  addressed.  Make  clear  how  the  session  represents  an 
alternative  to  traditional  papcr/posler  and  symposium  sessions. 
Examine  the  guidelines  for  paper  & symposium  proposals  and 
describe  as  many  of  the  types  of  information  presented  there  as  are 
relevant  and  applicable  to  your  proposal.  Remember  the  reviewers 
must  evaluate  both  the  worth  of  the  content  and  the  format.  Make  sure 
you  communicate  these  clearly! 

3.  Abstract  (6  copies:  as  appropriate,  3 with  the  name(s)  and 

institutional  affiliation(s)  of  the  author(s)/participant(s),  three  without 
the  name(s)  and  institutional  affilialion(s).  A 100-150  word  narrative 
abstract  should  be  prepared  for  publication  in  the  Annual  Meeting 
Abstracts.  The  Abstract  should  contain,  in  abbreviated  form, 
information  listed  in  the  Summary  guidelines.  Use  clear,  precise 
language  and  no  abbreviations  confusing  to  readers  unfamiliar  with 
the  discipline.  Ai  abstract  longer  than  150  words  will  not  be 
published.  Include  a word  count  at  the  end  of  the  abstract.  On  the 
copies  including  the  namc(s)  include  the  following  information  typed 
at  the  top  left  margin  of  the  page:  Title  of  Paper,  Authors), 

Institutional  atfiliation(s). 

4.  Envelopes.  Five  stamped  self  addressed  business-sized  envelopes  for 
(1)  acknowledgment  of  the  receipt  of  the  proposal,  (2)  notification  of 
the  decision  of  the  program  committee,  (3)  notification  of  the 
scheduled  session  time,  (4)  o reminder  to  submit  the  paper  to  the 
discussant,  session  chair,  divisional  program  chair,  annual  meeting 
program  chair,  and  (5)  notification  of  receipt  of  the  paper. 


5.  Index  Cards,  (three,  3x5  index  cards).  These  should  contain:  Title  of 
Alternative  Session.  Name  of  Organizer/Proposer , Institutional 
Affiliation,  Complete  Address  with  ZIP  Code.  Business  Telephone 
Number  with  Area  Code.  Evening  Telephone  Number  with  Area 
Code.  FAX  Telephone  Number,  EMAIL  Address 

6.  List  Three  copies  (8.5xlt)  of  a list  of  all  author(s)/participanl(s), 
including  names,  institutional  affi!iations(s),  complete  address(cs),  day 
and  evening  telephone  numbers).  FAX  numbers),  EMAIL  address(s). 

B.  Guidelines  for  Paper  Proposal 

A.  General  Information  About  Paper  Proposals 

1.  Only  papers  not  previously  presented  or  published  are  eligible. 

2.  Papers  may  be  presented  as  oral  communications  describing  empirical 
research  or  as  poster  sessions.  The  proposer  may  indicate  a preference 
for  a poster  or  oral  communication  session.  The  Program  Committee 
reserves  the  right  to  place  papers  into  either  poster  or  oral 
communication  sessions  in  order  to  best  meet  the  needs  of  the 
program. 

3.  The  Program  Committee  will  group  papers  into  sessions  organized  by 
topics  of  interest  to  the  conference.  The  Program  Committee  may,  at 
its  discretion,  include  a discussant  to  critique  the  papers  in  any 
particular  paper  session.  Those  presenters  assigned  a discussant  are  to 
provide  a copy  of  the  paper  to  the  discussant  one  month  prior  to  the 
meeting. 

4.  Generally,  papers  will  be  allotted  no  more  than  1 5 minutes  per 
presentation.  It  will  be  the  responsibility  of  the  Session  Chair  to 
consult  with  the  presenters,  allocate  time  and  ensure  that  the  agreed 
schedule  is  followed. 

5.  It  is  the  responsibility  of  the  authors  of  an  accepted  proposal  to  appear 
at  the  Amual  Meeting  to  present  the  paper.  If  unforeseen 
circumstances  arise  that  prevent  an  author  from  presenting  a paper,  it 
is  his/her  responsibility  to  arrange  for  a suitable  substitute  to  make  the 
presentation,  discuss  the  arrangements  with  the  Session  Chair,  and 
inform  the  Divisional  Chair  and  Annual  Meeting  Program  Chair. 

B.  Material  to  be  Submitted  with  a Paper  Proposal 

1.  Paper  Proposal  Cover  Sheet  (6  copies).  See  attached  form. 

2.  Summary  (6  copies  of  a 2-3  page  summary  typed  single  spaced  on 
8.5X1 1 paper  with  one  inch  margins  in  no  smaller  than  10  point  type.) 
It  should  contain  as  many  of  the  following  sections  as  applicable, 
lliree  copies  of  the  summary  should  include  the  name(s)  and 
institutional  affiliations  of  the  authors).  Three  copies  should  omit 
that  information. 

a.  Title  of  Paper. 

b.  Names  of  Author (s)-on  3 copies  only. 

c Institutional  Affiliation  of  Author  (s)~  on  3 copies  only. 

d Unjectives. 

e Perspectives  or  theoretical  framework  (brief  literature  review). 

f Methods:  instruments,  techniques,  procedures. 

g.  Data  Source. 

h.  Results,  conclusions,  or  point  of  view. 

i Educational' scientific  importance  of  the  study. 

3.  Abstract  (6  copies:  3 with  the  namc(s)  and  institutional  affilialion(s) 
of  the  author(s),  tltrec  without  the  namc(s)  and  institutional 
afiiliation(s).)  A 100-150  word  narrative  abstract  should  be  prepared 
for  publication  in  the  Annual  Meeting  Abstracts.  The  Abstract  should 
contain,  in  abbreviated  form,  information  listed  in  the  Summary' 
guidelines.  Use  clear,  precise  language  and  no  abbreviations 
confusing  to  readers  unfamiliar  with  the  discipline.  An  abstract  longer 
than  1 50  words  will  not  be  published.  Include  a word  count  at  the  end 
of  the  abstract.  On  the  tliree  copies  including  the  name(s)  include  the 
following  information  typed  at  the  top  left  margin  of  the  page:  Title  of 
Paper.  Author(s),  Institutional  affiliation(s). 

4.  Envelopes  (5  self-addressed,  stamped,  business-sized  envelopes). 
These  w ill  be  used  to  inform  you  of  ( 1 ) the  receipt  of  the  proposal,  (2) 
the  reviewer's  decisions,  (3")  the  scheduled  session  time,  (4)  a reminder 
to  forward  the  paper  to  the  Session  Chair,  Discussant,  Divisional 
Chair,  and  Ainual  Meeting  Program  Chair,  (5)  the  receipt  of  the 
complete  paper. 

5.  Index  Cards  (three,  3x5  index  cards)  These  should  contain.  Title  of 
Paper,  Name  of  Presenting  Author,  Institutional  Affiliation.  Complete 
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Address  with  ZIP  Code,  Business  Telephone  Number  with  Area  Code, 
Evening  Telephone  Number  with  Area  Code,  FAX  Telephone 
Number,  EMAIL  Address. 

6.  List  Three  copies  (8.5x1 1)  of  a list  of  all  authors),  including  names, 
institutional  affiliations(s),  complete  address(es),  day  and  evening 
telephone  numberfs),  FAX  numbers),  EMAIL  address(s). 

Guidelines  for  Symposium  Proposals 

A-  General  Information  About  Symposium  Proposals.  A 
symposium  is  intended  to  provide  an  opportunity  for  examination  of  a 
specific  problem  or  topic  from  a variety  of  perspectives.  A symposium 
should  provide  for  the  presentation  of  alternative  solutions  or 
interpretations  either  of  a common  problem  or  in  relation  to  a 
complementary  theme.  This  purpose  is  best  served  when  individuals 
with  diverse  or  conflicting  views  are  allowed  to  interact  on  a topic  of 
sufficient  scope  and  importance.  It  should  be  noted  that  a symposium 
should  not  be  merely  a presentation  of  a set  of  related  papers. 
Although  such  complementary  papers  arc  clearly  worthwhile,  they 
should  be  submitted  as  individual  papers  with  an  indication  of 
suggested  grouping  on  the  Cover  Sheet  Symposia  should  allow  time 
for  discussion  between  the  presenters  and  the  audience.  It  is 
recommended  that  there  be  no  more  than  4 presenters  at  a symposium. 

B.  Responsibility  of  Organizers  of  Symposium.  !t  is  the 
responsibility  of  the  Organizer  to  select  the  topic  and  to  solicit 
speakers  and  discussants.  Organizers  of  symposia  must  have  the 
consent  of  all  participants  before  submitting  the  proposal.  Organizers 
not  wishing  to  chair  Uic  session  must  invite  chairpersons.  The 
organizer  of  a symposium  is  responsible  for  asceitaining  that  each 
person  named  as  a participant  will  be  present  at  the  meeting  if  the 
session  is  accepted.  Should  unforeseen  circumstances  prevent  a 
participant  from  attending,  it  is  the  responsibility  of  the  organizer  to 
find  a suitable  replacement  and  notify  all  other  participants  in  the 
session  as  well  as  the  Divisional  Chair  and  Annual  Meeting  Program 
Chair.  Participants  In  a Symposium  must  submit  a summary  of 
their  remarks  to  the  discussant(s),  the  other  participants,  the 
Symposium  Chair,  the  Divisional  Chair,  and  the  Annual  Meeting 
Program  Chair  one  month  prior  to  the  convention  (Sep.  13, 
1993).  Only  Uie  organizer  will  be  notified  of  the  acceptance  of  a 
symposium;  he/she  is  responsible  for  notifying  the  other  participants  in 
the  Symposium. 

C.  Materials  to  be  submitted  with  a Symposium  Proposal. 

1.  Symposium  Proposal  Cover  Sheet  (6  copies).  See  attached  form. 

2.  Summary  (6  copies  of  a summary  typed  single  spaced  on  8.5x1 1 
paper  with  one  inch  margins  in  no  smaller  than  10  point  type.) 

a.  Title  of  Symposium. 

b.  Names  of  Organizers 
Institutional  Affiliation  of  Organizer. 

Name  of  Chair 

e.  Institutional  Affiliation  of  Chair 

f.  Names  of  Participants 

g.  Institutional  Affiliation  of  Participants 

h.  Summary  of  Symposium  including:  (1)  Overview.  An  300  word 
overview  of  the  symposium  including:  topic,  objectives,  approaches, 
planned  format,  (2)  300  word  summaries  of  each  of  the  symposium 
presenters  presentations  including  titles. 

3.  Abstract  6 copies  with  the  namc(s)  and  institutional  affiliation(s)  of 
the  authorfs).  A 300-400  word  narrative  abstract  should  be  prepared 
for  publication  in  the  Annual  Meeting  Ahstracts.  The  Abstract  should 
contain,  in  abbreviated  form,  information  listed  in  the  Summary 
guidelines.  Use  clear,  precise  language  and  no  abbreviations 
confusing  to  readers  unfamiliar  with  the  discipline.  An  abstract  longer 
than  400  words  will  not  be  published,  include  a word  count  at  the  end 
of  the  abstract  Include  the  following  information  typed  at  the  top  left, 
margin  of  the  page:  Title  of  Symposium,  Organizer,  Chair.  Presenters, 
Discussants,  Institutional  affiliation(s)  of  each. 

4.  Envelopes  (5  self-addressed,  stamped,  business-sized  envelopes). 
These  will  be  used  to  inform  you  of  (l)  the  receipt  of  the  proposal.  (2) 
the  reviewer's  decisions,  (?)  the  scheduled  session  time,  (4)  a reminder 
to  forward  the  Symposium  to  the  Session  Chair,  Discussant, 


Divisional  Chair,  and  Annual  Meeting  Program  Chair,  (5)  the  receipt 
of  the  complete  Symposium  papers. 

5.  Index  Cards  (three,  3x5  index  cards).  These  should  contain:  Title  of 
Symposium,  Name  of  Organizer ; Institutional  Affiliation,  Complete 
Address  with  ZIP  Code.  Business  Telephone  Number  with  Area 
Code.  Evening  Telephone  Number  with  Area  Code.  FAX  Telephone 
Number,  EMAIL  Address 

6.  List.  Three  copies  (8.5x1 1 ) of  a list  of  organizer,  chair,  all  presenters, 
including  names,  institutional  affiliations(s),  complete  address(es),  day 
and  evening  telephone  numbers),  FAX  numbers),  EMAIL  address(s). 

Guidelines  for  Workshop  Proposals 

A General  Information  About  Workshop  Proposals.  Workshop 
topics  should  be  of  interest  and  use  to  a number  of  M WERA  members. 
Presenters  will  receive  an  honorarium  based  on  the  number  of 
participants  attending  the  workshop.  All  persons  listed  as  presenters 
are  required  to  appear  at  the  conference  and  present  the  workshop  at 
the  designated  time.  All  workshops  will  be  on  Wednesday,  October 
13,  1993,  either  starting  at  noon  or  3:30  p.m.  Some  workshops  may  be 
offered  twice. 

B.  Materials  to  be  submitted  with  a Training  Workshop  Proposal 

1.  Cover  Sheet  (Use  Symposium  Proposal  Cover  Sheet.  See  attached 
form.)  Send  two  copies  with  all  items  complete.  Strike  out  the  word 
"Symposium"  and  write  in  "Workshop.”  Indicate  the  total  amount  of 
time  you  believe  will  be  needed.  Please  note  that  in  special 
circumstances  a workshop  may  be  allocated  more  than  three  hours. 

2.  Summary  (3  copies  of  a 2-3  page  summary  typed  singic-spaccd  on 
8V:  x 1 1 paper).  This  will  be  used  to  judge  the  proposal.  The  summary' 
should  include  information  such  as  the  following. 

a.  Objectives  (knowledge,  skills  for  participants) 

b.  Suggested  entry-level  skills  for  participants 
Educational  or  scientific  importance  of  the  topic 

d.  Perspectives,  orientations,  or  theoretical  framework 

e.  Methods  or  techniques  of  instruction 

f.  Description  of  presenter’s  relevant  experience 

3.  Abstract  (3  copies).  A 100-200  word,  narrative  Abstract  should  be 
prepared  for  publication  in  Uie  Annual  Meeting  Abstracts.  This  should 
briefly  describe  the  objectives,  content,  and  methods  of  the  workshop. 
Use  clear,  precise  language  and  no  abbreviations  confusing  to  readers 
unfamiliar  with  the  discipline.  Abstracts  should  he  typed  single-spaced 
on  81/*  x 1 1 paper.  An  abstract  longer  than  200  words  will  not  be 
published.  For  all  copies  of  the  abstract,  the  title  of  the  workshop,  the 
presenters),  and  their  institutional  affiliation(s)  should  be  typed  at  the 
top  left  margin,  in  Uie  format  below: 

4.  Title  of  Workshop 

5.  Presenters,  Institutional  affiliation 

6.  Envelopes  (3  self-addressed,  stamped,  business-size  envelopes). 
These  will  be  used  to  inform  you  of  (l)reccipt  of  the  proposal,  (2)  the 
reviewers’  decision,  and  (3)  Uie  scheduled  session  time. 

7.  Index  Cards  (Uirec,  3x5  index  cards).  These  should  be  prepared  as 
follows: 

a.  Title  of  Workshop 

b.  Name(s)  of  Workshop  presenters  (last  name  first),  identify  contact 

person 

r.  Institutional  affiliation 

d.  Complete  address  ( with  zip  code)  of  contact  person . 

e.  Telephone  number  (with  area  code)  of  contact  person 

6.  Mail  Workshop  Proposal  to  1993  Workshop  Training 
Coordinator:  Dr.  Gary  D.  Phyc,  Department  of  Psychology  W1 12 
I Agomarciuo  Hall,  Iowa  State  University,  Ames,  I A 50011-3180, 
515-294-1962,  FAX:  515-294-6424,  B1TNET: 

Sl.GDPtflJISUMVS.BlTNET.  Proposals  must  be  postmarked  first- 
class  by  May  15,  1993. 

MWERA  Student  Research  Incentive  Awards 

All  graduate  students  who  author  or  co-author  an  accepted 
proposal  will  receive  a certificate  of  achievement.  Up  to  3 graduate 
students  will  he  randomly  selected  from  Uic  group  of  graduate  students 
who  author  or  co-author  a proposal  to  each  receive  a Research  Incentive 
Award  to  be  presented  during  Uic  MWFRA  Business  Meeting  on 


October  16.  Any  graduate  student  who  has  authored/co-authorcd  a 
research  paper,  is  pre-registered  for  the  1993  Annual  Meeting,  and  is 
present  at  the  MWERA  Business  Meeting  will  qualify  for  an  award. 
The  Research  Incentive  Award  will  consist  of  a free  membership  in 
MWERA  for  the  coming  year  and  free  registration  at  the  next  annual 
convention. 

Where  to  Submit  Proposals. 

Proposals  should  be  submitted  to  the  Division  Program  Chair 
listed  below  whose  division  best  fits  the  content  of  the  proposal. 
Proposals  may  be  submitted  to  only  one  division.  (However,  a proposer 
may  proposed  a cross-division  alternative  session.  In  that  case,  the 
proposer  must  contact  the  chairs  of  the  respective  divisions  and  discuss 
the  proposal  with  them  prior  to  submitting  it.  If  the  Division  Chairs 
believe  that  such  a cross-divisional  proposal  is  the  best  way  to  submitted 
the  proposal,  it  should  then  be  submitted  to  both  divisions,  with  an 
explanatory  letter.  Such  proposals  will  be  reviewed  by  both  divisions.] 
If  a proposal  does  not  fit  any  of  the  indicated  divisions,  it  should  be 
submitted  to  the  Annual  Meeting  Program  Chair,  Thomas  Andre, 
Department  of  Psychology,  Iowa  State  University,  Ames,  IA,  50011- 
3180.  Phone:  515-294-1754,  FAX:  515-294-6424,  EMAIL: 

s 1 .txa@isumvs.bilnet. 

Proposals  must  be  submitted  in  hard  copy  form  and  must  be 
postmarked  no  later  than  May  15,  1993.  Voice  Phone,  FAX,  and 
EMAIL  addresses  are  provided  to  give  presenters  alternative  ways  of 
asking  questions  of  the  Program  Chairs. 

DIVISION  A:  ADMINISTRATION 

Concerned  wjth  research,  theory,  development,  and  improvement  of  practice  in  the 
organization  and  administration  of  education 
William  L.  Sharp 

Dept  cf  Ed.  Admin.  & Higher  Ed. 

Southern  Illinois  University 
Carbondale,  IL  6290 1 -460 6 

Phone:  618-536-4434 

DIVISION  B:  CURRICULUM  AND  STUDIES 

Concerned  with  curriculum  and  instructional  practice,  theory,  and  research 

Rose  Mary  Scott 

Teacher  Education  Department 

University  of  Wisconsin-Parkside 

900  Wood  Rd.  Box  2000 

Kenosha,  WI  53141-2000 

414-595-2180 

DIVISION  C:  LEARNING  AND  COGNITION 

Concerned  with  theory  and  research  on  human  abilities,  learning  styles,  individual 
differences,  problem  solving,  and  other  cognitive  factors 
Jennifer  Fager 

South  Dakota  State  University 
Wcnona  Hall,  Box  507 
Brookings.  SD  57007-0095 

605-688-4362 

DIVISION  D:  MEASUREMENT  AND  RESEARCH 
METHODOLOGY 

Concerned  with  measurement,  statistical  methods,  and  research  design  applied  to 

educational  research 

Robert  S,  Barcikowski 

3 14C  McCracken  Hall 

Ohio  University 

Athens,  OH  45701 

614-593-4476 

EMAIL:  edrc^ouaccvmh 

DIVISION  E:  COUNSELING,  HUMAN 

DEVELOPMENT  AND  SPECIAL  EDUCATION 

Concerned  with  the  understanding  of  human  development,  special  education,  and 
the  application  and  improvement  of  counseling  theories,  techniques,  and  uaining 
strategies 

Thomas  E.  Mldgctte 

136  Graduate  Education  Bldg 

University  of  Arkansas 

Fayetteville,  AR  72701 

501-575-3509 

FAX:  501-575-4681 


DIVISION  F:  HISTORY  AND  PHILOSOPHY  OF 
EDUCATION  

Concerned  with  the  findings  and  methodologies  of  historical  research  in  education 

Don  R.  Castle 

384  N.  Townview  Circle 

Mansfield,  OH  44907 

419-289-5^31 

DIVISION  G:  SOCIAL  CONTEXT  OF 

EDUCATION  AND  MOTIVATION 

Concerned  with  theory',  practice,  and  research  on  social,  moral,  affective,  and 
motivational  characteristics  and  development 
Joan  S.  Timm 

College  of  Education  and  Human  Serv  ices 
University  of  Wisconsin-Othkosh 
Oshkosh,  WI  54901 

414-424-7420 

DIVISION  SCHOOL  AND  PROGRAM  j 

EVALUATION 

Concerned  with  research  and  evaluation  to  improve  school  practice,  including 

program  planning  and  implementation 

Daniel  Mueller 

Indiana  University 

140  Smith  Research  Center 

2805  E.  10th  St, 

Bloomington,  IN  47408 
812-335-0278 
FAX:  812-856-8440 

KMAJL:  mueHcrffiucs.ind.cuu 

DIVISION  I:  PROFESSIONAL  AND  MEDICAL 
EDUCATION 

Concerned  with  educational  practice,  research,  and  evaluation  in  the  professions 
(e  g , medicine,  nursing  public  health,  business,  law.  and  engineering) 

Richard  M.  Smith 

1 5426  Plantation  Oaks  Drive,  Apt.  1 1 
Tampa,  FL  33647 
Evening:  813-978-8812 
Day:  813-974-3220 

FAX:  813-974-3826 

1 DIVISION  J:  POSTSECONDARY  EDUCATION 

Concerned  with  a hroad  range  of  issues  related  to  two-year,  five-year,  and  graduate 

education 

Kim  K.  Metcalf 

Teacher  Education  Laboratory 

W.  W.  Wright  Education  Bldg. 

Bloomington,  LN  47405- 1 006 

812-856-8159 

FAX:  812-856-8440 

EMAIL:  kmetcalfffi-iubacs.bitnct 

or  knu  tcalfvrucs.indiana.edu 

DIVISION  K:  TEACHING  AND  TEACHER 

EDUCATION 

Concerned  with  research  on  teaching,  conditions  of  teaching,  the  teaching 
profession,  and  the  preparation  and  development  of  teachers 
Josuc’  Cruz,  Jr. 

2037  Nurthtowne  Cl 
Columbus,  OH  43229 
612-292-8030 
FAX:  612-292-7695 


BEST  ropy  AVAILABLE 
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Special  Notice:  --  MWERA  Hospitality  Party  at  AERA! 

MWERA  will  host  a hospitality  party  for  its  members  on  Tuesday,  April,  IS  1993  from  7-9  vm  in  the  Lancaster  E Room  of  the 
Hyatt  Hotel  - Atlanta!  Hot  and  cold  nmnchies  will  be  provided  and  a cash  bar  will  be  available. 

Come  and  join  your  Midwestern  Colleagues  for  an  evening  of  gaity,  conversation,  and  fun.  Ken  Kiewra  may  do  his  impression 
of  a long  distance  runner;  Tom  Andre  may  show  up  and  pretend  to  be  an  organized  person.  He  offers  to  buy  a drink  to  the  person 
suggesting  the  most  alternative  proposal  Authentic  entertainment,  imbibing,  and  the  opportunity  for  participant-observation  eating  await 
Izzy  Newman  may  even  fin-l  a way  to  regress!  Come  and  have  funl 


Executive  Committee 
Immediate  Past  President 
Barbara  S.  Plate,  University 
of  Nebraska-Lincoln 
President. 

Kenneth  A.  Kiewra, 
University  of  Nebraska  - 
Lincoln 
President-Elect 
Richard  C.  Pugh,  Indiana 
Univcristy 
Vice-President 
Thomas  Andre,  Iowa  Slate 
University 
Secretary’ 

Ralph  O.  Mueller,  'Die 
University  of  Toledo 
Member-at-Large 
Sharon  L.  McNeely, 
Northeastern  Illinois 
University 
Executive  Officer 
Charles  C.  Anderson,  Jr. 
Educational  Testing  Service 
(Ret.) 

Co-Editors,  Researcher 
(exofficio) 

Gregory  J.  M archant.  Ball 
Stale  University, 

Isadore  Newman,  University 
of  Akron 

Association  Council 
1991-1993 

Sonya  L.  Blixt,  Kent  State 
University 

Alice  J.  Corkill,  Univ.  of 
Nevada-Las  Vegas 
Mary  Ann  Flowers.  Cleveland 
State  Univcrisyl 
Sarah  E.  Peterson,  Northern 
Illinois  University 
John  T.  Pohlmann.  Southern 
Illinois  University 
E.  Jane  Williams.  Columbus 
Public  Schools 

Jane  Ann  Zah arias,  Cleveland 
Stale  University 


Mid-Western  Educational  Research  Association 

The  Mid-Western  Educational  Research  Association  (MWERA)  is  a nonprofit  organization  of 
professional  educational  researchers  primarily  from  stales  and  provinces  located  in  the  mid-westem  region 
of  the  United  States  and  Canada.  Membership  is  open  to  faculty,  students,  and  administrators  from  any 
setting  , including  university,  college,  and  school  personnel,  educational  researchers  in  business  and 
industry,  and  those  in  national,  stale,  local  and  private  agencies  and  organizations.  College  students 
engaged  in  educational  research  are  especially  encouraged  to  join  as  members. 

The  Association  promotes  and  disseminates  educational  research  tlirough  its  publications,  its 
scholarship  program,  and  its  Annual  Meeting. 

The  Mid-Western  Educational  Researcher  is  the  official  publication  of  the  Association.  The  four 
issues  published  annually  are  mailed  to  all  members.  These  issues  include  articles,  features,  a report  on  the 
Annual  Meeting,  some  of  the  major  presentations,  the  Call  for  Proposals,  and  the  Program  for  the  Annual 
Meeting. 

The  Annual  Meeting  of  the  Association  is  held  in  the  third  week  of  October  beginning  with 
presessions  starting  on  Wcdnes*day  at  noon.  The  meeting  is  comprised  of  papers,  symposia,  and  invited 
addresses  concerning  a variety  of  topics  from  the  various  MWERA  Divisions.  The  1993  Annual  Meeting 
will  be  held  at  the  Bismarck  Hotel,  Chicago,  Illinois,  October  13  through  16.  Contact  the  Program  Chair 
for  more  information  about  the  Annual  Meeting.  Thomas  Andre,  (812)  855*4053,  School  of  Education, 
Indiana  University,  Bloomington,  IN  47405. 

The  annual  dues  of  Si 8 (Regular  Member)  or  $10  (Student)  include  a subscription  to  the 
M»d- Western  Educational  Researcher  and  a reduced  registration  fee  for  the  Annual  Meeting.  Address 
membership  correspondence  to:  Charles  C.  Anderson,  Jr.,  (708)  564-4796,  MWERA  Executive  Officer, 
1332  Southwind  Dr.,  Northbrook.  IL  60062. 


MWERA  Membership  Application 


Name  (first.  m.LIasl) 
Mailing  address  - 


Slate  - Zip 

Office  phone  ( _ 

Area  of  specialization  _ _ 


Home  phone  ( ) Office  phone  ( 

Highest  degree Area  of  specialization 

Insiitution/cmployer 

Mwcra  Divisional  Preferences.  Check  all  dis  isions  you  wish  to  join 


A. 

Administration 

..  G 

Social  Context  of  Education  & 
Motivation 

B: 

Curriculum  Studies 

II: 

School  & Program  Evaluation 

C: 

Learning  & Instruction 

_ I: 

Professional  & Medical 
Professions 

D: 

Measurement  & Research 
Methodology 

J: 

Post  Secondary*  Education 

E: 

F: 

Counseling.  Human  Dev. 

& Special  Ed 

History  & Philosophy  of  Education 

K: 

Teaching  & Teacher  Education 

Please  print  or  type 

1.  Title 


2.  Presenting  Author 

LAST  NAME  FIRST  NAME  MI 

3.  Affiliation Telephone( ) 

4.  FAX:  ( ) EMAIL 

5.  Complete  address 


6.  Authors.  Please  check  here  if  there  is  more  than  one  author  for  the  paper.  □ 

Please  attach  a separate  sheet  listing  name,  institutional  affiliation,  complete  address,  d and  evening  telephone 
numbers,  FAX  number,  and  EMAIL  address  for  each  author.  Include  and  identify  the  presenting  author.  (Please  print  or 
type  this  information.) 

7.  If  you  wish  to  have  this  paper  grouped  in  the  same  session  with  other  papers  submitted  to  the  Annual  Meeting,  please 

CHECK  HERE  and  attach  a separate  sheet  listing  paper  titles,  presenting  authors,  and  institutional  affiliations, 
complete  addresses,  day  and  evening  telephone  numbers,  FAX  numbers,  and  EMAIL  addresses..  

8.  Are  you  a member  of  M WE RA?  Yes  No 

9.  Session  Type  Preference  Oral  Presentation  __  Poster 

Please  note  that  ail  presenters  must  be  current  members  of  MWERA  at  time  of  presentation  and  must  pay 
registration  for  the  Annual  Meeting. 

I hereby  certify  that,  if  this  paper  is  accepted  and  placed  on  the  program,  I will  join  MWERA  if  necessary',  register 
for  the  Annual  Meeting,  appear,  and  deliver  the  paper. 


SIGNATURE  DA1E 

Be  certain  all  of  the  following  arc  enclosed: 

SIX  SETS  OF  MATERIALS.  STAPLED  TOGETHER.  EACH  COWAMKG  OX! i OF  EACH  OF  THE  FOLLOWING: 

• Paper  proposal  cover  sheet 

* Separate  sheet  listing  all  authors  (See  No.  3 above) 

* 2-3  page  Summary 

• 1 00-200  word  Abstract  (to  appear  in  the  Meeting  Abstracts) 

* Self-addressed  stamped  envelope 

• 3x5  index  card  with  title  of  presentation,  name  of  presenting  author,  institutional  affiliation,  complete  address,  and  day 
telephone  number,  evening  telphonc  number,  FAX  number,  EMAIL  Address 

THIS  INFORMATION  MUST  BE  POSTMARKED  FIRST-CLASS  BY  MAY  15,  1993. 


A A A 


SESSION  TYPE:  Alt.  Format Workshop Symposium 

Please  print  or  type 

1.  Title 

2.  Affiliation Telephone  ( ) 

3.  Complete  address 


4.  FAX: EMAIL: 

5.  Organizer/Proposcr 

LAST  NAME  FIRST  NAME  Ml 

6.  Chair 

(if different  from  Organizer)  LAST  NAME  FIRST  NAME  Ml 

7.  Participants,  Please  attach  a separate  sheet  listing  name,  institutional  affiliation,  complete  address,  day  and  evening 
telephone  numbers  FAX  numbers,  EMAIL  addresses,  and  title  of  presentation  for  each  participant.  Include  and  identify 
the  chair,  discussant(s),  and  presenters.  (Please  print  or  type  this  information.) 

8.  Time  requested:  (for  symposium)  1 hour  1 ‘/2  hour  2 hours 

(for  workshop)  2 hours  3 hours  4 hours  Other 

9.  Are  you  a member  of  MWERA?  Yes  No 

Please  note  that  all  presenters  must  be  current  members  of  MWERA  nt  time  of  presentation  and  must  pay  registration 
for  the  Annual  Meeting. 

I hereby  certify  that,  if  this  symposium  is  accepted  and  placed  on  the  program,  all  presenters  of  this  symposium  will 
register  for  the  Annual  Meeting,  and  be  responsible  for  its  presentation.  I hereby  declare  that  I have  assurances  from  the 
other  participants  that  they  will  register  and  make  their  respective  presentations. 


SIGNATURE  DATE 

Be  certain  all  of  the  following  are  enclosed: 

SIX  SETS  OF  MATERIALS,  STAPLED  TOGETHER , EACH  CONTAINING  ONE  OF  EACH  OF  THE  FOLLOWING: 

• SymposiuinAvorkshop  proposal  cover  sheet 

• Separate  sheet  listing  all  participants  (See  No  4 above) 

3-5  page  Summary  of  the  symposium 

300-400  word  Abstract  (to  appear  in  the  Meeting  Abstracts) 

••  Self-addressed  stamped  envelope 

•*  3x5  index  card  with  symposium  title,  and  the  name,  institutional  affiliation,  complete  address,  and  day  & evening 
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Twin  Towers  of  Educational  Leadership 
at  Stanford  University: 

Interviews  with  Elliot  Eisner  and  Lee  Shulman 


Stanford  University  is  recognized  as  having  one  of  the  nation  s most  respected  graduate  education  programs.  Contributing  to 
this  reputation  is  a codre  of  quality  faculty  members  whose  research  sets  the  pace  in  many  areas  of  educational  research.  Two  of  Stan- 
ford’s distinguished  professors  granted  interviews  to  the  M idWestem  Educational  Researcher  for  this  issue.  They  both  share  some  midwestern 
roots  and  shared  some  thoughts  about  education  and  educational  reform. 


Elliot  W,  Eisner  is  a Professor  of  Education  and  Art  at  Stan- 
ford  University.  He  was  trained  as  a painter  at  the  Art  Insti- 
tute of  Chicago,  studied  design  at  the  Illinois  Institute  of  Tech - 
nology's  Institute  of  Design , and  received  his  doctorate  from  the 
University  of  Chicago . He  has  also  received  three  honorary 
doctorates.  Professor  Eisner's  research  interests  focus  on  the 
development  of  aesthetic  intelligence  and  on  the  use  of  critical 
methods  from  the  arts  for  stud\in£  and  improving  educational 
practice.  He  has  published  15  books , including  his  most  recent, 
"The  Enlightened  Eye:  Qualitative  Inquiry  and  the  Enhance - 
ment  of  Educational  Practice."  Professor  Eisner  served  as  the 
President  of  the  X^tion^xZ  Art  Education  Association , President 
of  the  International  Society  of  Education  through  Art , and  is 
currently  President  of  the  American  Educational  Research 

Association.  , , ^ -> .. 

(continued  on  page  2i) 


Lee  S.  Shulman  was  a faculty  member  at  Michigan  State 
University  prior  to  his  appointment  as  the  Charles  E. 
Ducommun  Professor  of  Education  and  a Professor  of  Psychology 
at  Stanford  University.  He  studied  philosophy  as  an  under- 
graduate, and  received  his  master's  and  doctoral  degrees  in 
educational  psychology , all  from  the  University  of  Chicago. 
With  the  support  of  the  Spencer  Foundation  he  has  studied 
content  specific  pedagogy  and  how  new  teachers  learn  to  teach. 
He  is  completing  a four-year  Carnegie  Corporation  research 
program  designing  and  field-testing  neu*  strategies  for  the 
assessment  of  teaching.  Dr.  Shulman  served  as  the  President  of 
the  American  Educational  Research  Association  and  is  currently 
the  President  of  the  National  Academy  of  Education. 

(continued  on  page  27) 
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User  Friendly,  Intellectually  Deep: 
An  Interview  with  Elliot  Eisner 


By  Greg  Marchant,  Ball  State  University 


q J As  an  advocate  of  discipline-based  art  education, 

* — 1 how  do  you  define  “art”? 

j ^ Art  is  a form  of  human  experience  that  has  emotional 

quality,  organizational  coherence,  a beginning,  middle,  and 

end.  In  a sense  art  separates  one  piece  of  life  from  what  normally 
occurs  during  the  course  of  one’s  life.  The  reason  I find  such  a 
conception  useful  is  that  it  extends  the  possibilities  of  art  as  a 
special  form  of  experience  to  any  situation  in  which  humans  have 
intercourse  with  the  world,  including  science.  Scientific  inquiry 
as  well  as  artistic  inquiry  can  provide  artistic  experience,  and 
anything  that  provides  artistic  experience  is  a result  of  an  artistic 
form  of  inquiry  or  interaction. 

Different  definitions  of  art,  and  there  have  been  dozens, 
have  different  virtues.  Rather  than  looking  for  the  one  true  defini- 
tion it’s  more  useful  to  recognize  that  different  conceptions  empha- 
size  a different  point,  have  a different  thrust,  and  therefore  enable 
you  to  see  the  world  in  ways  that  are  unique.  Leo  Tolstoy,  for 
example,  defined  art  as  the  communication  of  emotion.  Com- 
munication, not  the  expression,  but  the  communication  of  emo- 
tion. It  wasn't  enough  for  the  artist  to  display  emotion,  the  artist 
had  to  generate  that  emotion  in  the  recipient,  the  participant, 
the  reader,  or  whoever. 


How  much  of  this  definition  of  art  is  knowledge 
versus  creativity? 


^ All  experience  whether  in  the  discovery  mode  or  the  expres- 

1 1 sion  mode  is  rooted  in  prior  knowledge,  but  in  qualitative 

forms.  These  forms  enable  us  to  discover  new  possibilities.  Dis- 
covery favors  the  informed  mind,  it  does  not  favor  the  ignorant 
or  the  uninformed  mind.  This  all  operates  in  the  act  of  percep- 
tion, in  the  act  of  shaping,  forming,  and  creating.  Creativity 
seldom  emerges  in  a vacuum.  Therefore  knowledge  is  not  anti- 
thetical to  creative  thinking. 


q Do  you  see  discipline-based  art  education  as  a merger 
' — of  this  discovery  and  expression  mode,  as  opposed 
to  the  more  traditional  “doing”  of  art? 


^ Discipline-based  art  education  represents  a conception  of 

the  teaching  of  art  that  can  be  applied  t > the  teaching  of 

musk  or  even  to  the  teaching  of  science.  The  most  fundamental 
feature  of  discipline-based  education  is  that  it  argues  that  four 
areas  must  be  addressed  in  building  a curriculum.  These  four 
arras  can  be  integrated,  thev  can  be  handled  independently,  but 


they  ought  to  be  addressed.  First,  curricula  ought  to  make  it  pos- 
sible for  kids  to  create  images,  to  work  with  media,  to  make  things. 
Artists  do  that,  and  there  is  a “discipline”  in  making  that  happen 
well.  Second,  children  should  have  an  opportunity  to  learn  how 
to  see  the  world.  Seeing  the  world  in  the  context  of  art  is  not 
the  same  as  seeing  the  world  in  the  context  of  practical  activity. 
In  practical  activity  you  see  the  world  in  order  to  do  something; 
the  object  is  only  an  object  that  serves  you  in  some  way.  To  see 
the  world  aesthetically,  to  see  the  world  artistically,  you  have  to 
address  that  world  of  objects  as  a source  of  aesthetic  experience. 
People  need  to  know  how  to  address  the  world  in  that  way.  It  is 
a special  way  of  regarding  the  world.  Third,  art  has  had  a history, 
it  exists  in  a culture,  it’s  a part  of  the  human  condition,  and 
understanding  that  culture,  that  history,  and  the  connection 
between  that  culture  and  the  work  of  art  is  important  because 
it  informs  you  in  special  ways.  So  the  historical  and  cultural  side 
also  needs  to  be  part  of  a curriculum  for  students.  Finally,  a solid 
curriculum  in  art  would  engage  youngsters,  when  they  are  old 
enough  intellectually,  in  discussions  about  the  meaning  of  art 
itself.  What  is  it?  What  makes  it  valuable?  Do  you  learn  anything 
from  it?  Is  good  art  a matter  of  taste?  Is  it  only  science  that  in- 
forms us?  If  art  does  inform  us,  how?  How  do  you  make  judgments 
about  the  quality  of  art?  TTiese  kinds  of  questions  are  basically 
aspects  of  philosophical  aesthetics.  You  can  take  that  same  model 
and  apply  it  to  any  subject,  such  as  science:  Learning  how  to 
read  scientific  material  critically,  understanding  the  place  of  science 
in  a culture,  understanding  how  it  evolved  culturally,  and  under- 
standing scientific  epistemology.  Those  would  be  the  analogues 
in  the  teaching  of  science. 


How  well  do  the  schools  represent  the  culture  and 
community  of  our  children? 


As  we  all  know,  school  is  a very  special  place,  and  one  of 
the  problems  that  exists  is  that  it  is  so  often  separated  from 
the  out-of-school  culture.  What  youngsters  learn  in  school  is  often 
hard  for  them  to  employ  outside  of  school.  There  is  a large  gap 
between  what  they  study,  what  they  learn,  what  they  do  in  school 
itself,  and  the  life  they  lead  outside  of  school.  The  transfer  problem 
is  large.  Researchers  have  tried  to  get  at  that  issue  by  talking  about 
situated  knowledge  and  by  trying  to  create  conditions  inside  the 
schools  that  are  likely  to  be  more  consistent  with  the  context  that 
youngsters  live  in  outside  of  the  school,  or  by  trying  to  create 
conditions  inside  the  school  that  increase  the  chances  that  the 
knowledge  students  acquire  will  be  useful  or  meaningful.  But 
there  is  a gap— there  has  to  be  some  gap.  It’s  inherent  in  the  way 
in  which  schools  function.  There  is  an  inherent  difference  between 


An  Interview  with  Elliot  Eisner  (continued) 


outside  and  inside.  But  when  the  gap  is  so  large  that  it  makes 
it  difficult  for  transfer  to  take  place,  then  you  have  two  differ- 
ent worlds. 


| q I Might  this  separation  sometimes  be  a good  thing? 
1 — ' In  circumstances  where  a child  may  feel  locked  into 
an  urban  world  of  poverty  and  violence  or  with  the  iso- 
lated rural  child;  might  we  v’ant  the  schools  to  create 
an  alternate  culture  that  can  help  shape  and  change  the 
child’s  world  and  understanding? 


A 


That’s  right.  There  are  some  cultures  that  we  wouldn’t 
want  reflected  in  the  school.  They  may  be  dangerous  or 
almost  devilishly  anti-intellectual.  That  would  be  a problem,  and 
in  many  cases  that’s  what  we  have.  We  have  kids  coming  from 
cultures  that  are  so  remote  from  school  and  that  are  antagonistic 
toward  schools  that  it  makes  it  difficult  for  them  to  succeed  in 
school.  Whereas  you  can  come  from  another  culture  which  is 
different  than  the  school,  but  that  culture  supports  the  aims  of 
the  school.  There  are  some  immigrant  populations  for  example 
that  are  very  different,  but  the  values  of  school  are  supported  and 
youngsters  are  more  likely  to  do  well. 


Where  does  the  responsibility  of  public  schools  to 
create  a better  more  productive  fruitful  culture  end? 
Does  it  end  at  the  school  door  or  does  it  extend  into 
the  community? 


A Our  clients  are  not  limited  to  the  children,  our  clients  in- 

' elude  the  community  the  school  serves.  In  doing  that  job 

there  are  different  tasks.  Even  in  upper-middle  class  schools  for 
upper-middle  class  communities  the  values  within  the  community 
may  be  supportive  of  the  schools,  but  in  a very  limited  sense. 
A professional  staff  may  come  to  the  conclusion  the  kind  of  intel- 
lectual values  that  they  want  to  foster  are  really  not  well  under- 
stood by  the  community.  They  may  not  be  able  to  foster  those 
values  in  the  school  unless  the  community  supports  them,  and 
that  means  they  have  to  try  to  help  the  community  understand 
what  intellectual  life  is  about  and  why  it  is  important.  I don’t 
believe  that  it  is  the  responsibility  of  professional  educators  simply 
to  be  technicians  who  do  anything  that  the  community  requires 
them  to  do.  We  have  a moral  responsibility  to  make  judgments 
about  expectations,  and  we  have  a professional  obligation  to  think 
of  our  purposes  as  educators. 


j q j What  might  be  done  to  improve  the  schools? 


A One  of  the  first  things  that  we  need  to  do  is  to  try  to  make 

it  possible  for  teachers,  who  are  major  stake  holders,  to  have 

the  opportunity  to  really  become  collectively  reflective  about  the 
institution.  We  try  to  bring  about  change  from  the  top  down  by 


mandating  changes  that  come  from  Washington,  D.C.,  Sacra- 
mento California,  or  some  state  capital.  1 think  that  teachers, 
along  with  administrators,  need  to  have  a major  hand  in  thinking 
about  their  school.  The  connections  that  need  to  be  paid  atten- 
tion to  are  multiple.  We  try  very  often  to  get  single  “solution,” 
and  then  implement  that  single  solution  as  if  it’s  going  to  make  a 
big  change  or  improve  the  institution.  I think  that  we  need  to 
think  much  more  systemically,  more  ecologically,  about  educa- 
tional improvement.  That  means  thinking  about  school  structure, 
it  means  thinking  about  curricular  matters,  it  means  thinking 
about  pedagogical  processes,  it  means  thinking  about  the  funda- 
mental goals  of  the  institution,  and  it  means  thinking  about  the 
way  we  evaluate  what’s  happening  and  what  we’re  achieving. 
Those  all  need  to  be  orchestrated.  They  need  to  be  thought  about 
collectively  and  interactively. 


What  about  the  role  of  parents  in  that  equation? 


A They  certainly  should  have  some  role.  What  the  role  is  I 

' think  is  something  that  administrators  need  to  think  about. 

I don’t  think  that  you  can  proceed  to  make  the  important  changes 
that  you  want  without  parent  participation.  However,  I lean  ini- 
tially towards  giving  teachers  the  lead.  I think  that  you  can  push 
democracy  too  far  in  professional  matters.  I don’t  think  that 
everyone  needs  to  vote  on  everything  that  is  done  in  schools. 
There  are  certain  areas  in  which  parents  should  play  an  impor- 
tant role,  but  I want  to  start  with  the  professionals  who  have 
dedicated  their  lives  to  thinking  about  education. 


q Over  the  past  decade  or  so  there  has  been  a move- 
1 — 1 ment  to  narrow  the  focus  of  the  education  of  chil- 
dren by  defining  specific  curriculum  and  nationally  test 
that  knowledge.  How  do  we  reconcile  the  need  to  expand 
concepts  of  learning  with  desires  to  return  to  the  “good 
old  days?” 

A I think  that  there  are  two  things  that  need  to  be  addressed. 

' One  has  to  do  with  communication  channels  between 

schools  and  parents.  There  can  be  things  like  educational  forums 
in  which  there  is  communication  about  some  of  the  issues  that 
we’v  been  talking  about.  That  discussion  can  be  related  to  sub- 
stantive educational  issues  that  go  on  in  the  schools.  This  doesn’t 
happen  very  often,  even  at  school  board  meetings.  Another  step 
is  that  the  rights  of  passage  that  influence  educational  priorities 
like  how  students  are  assessed  need  to  be  addressed  and  altered 
through  political  action  if  necessary  so  that  they  don't  create  the 
kinds  of  constraints  that  now  exist.  If  you  change  those  rights  of 
passage  you  arc  much  more  likely  to  have  a receptive  public  who 
can  come  to  the  conclusion  that  they  are  not  jeopardizing  their 
child’s  chances  for  academic  success  if  they  encourage  attention 
to  some  of  these  broader  issues. 

(continued  on  page  26) 
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An  Interview  with  Elliot  Eisner  (continued) 


|Q  Something  that  I am  frustrated  by  is  how  educa- 
1 — tional  policy  seems  to  made  without  the  insights  of 
educational  theory  and  educational  research.  Why  is  there 
such  a chasm? 


^ Educational  research  generally  is  not  read  by  people  outside 

of  the  academic  community.  We  need  to  make  a concerted 

efforts  to  interpret  research  for  people  who  shape  educational 
policy.  My  hope  is  that  we  will  develop  at  AERA  some  public 
service  monographs  that  distilled  and  report  research  that  is 
relevant  to  key  educational  policy  issues.  These  monographs 
would  be  designed  for  those  who  shape  educational  policy,  such 
as  state  legislators  and  people  in  Congress.  These  monographs 
should  be  user  friendly,  but  intellectually  deep.  They  should  help 
policymakers  understand  the  best  thinking  and  research,  for 
example  on  multicultural  curriculum,  tracking,  on  national  testing, 
integrated  curriculu,  on  teacher  assessment,  and  so  forth.  We- 
need  to  make  a much  greater  effort.  We  also  have  to  understand 
that  educational  policy  making  is  buffered  by  political  winds  not 
just  by  a knowledge  base.  There  are  also  value  issues  that  may 
not  be  altered  by  the  facts.  People  believe  in  certain  visions  and 
hold  values.  Legislators  feel  that  they  have  to  reflect  the  wishes 
of  certain  constituencies.  That  is  the  price  one  pays  for  democracy 
so  to  speak.  Plato  was  not  enthusiastic  about  democracy.  He 
thought  that  giving  all  people  the  right  to  vote  was  a way  of 
giving  ignorance  the  same  weight  as  understanding.  That  is  why 
he  believed  in  a philosopher  king,  someone  who  understood  the 
true,  good,  and  the  beautiful  and  was  in  a position  to  move  the 
culture  toward  this  realization.  But  that’s  not  our  situation. 


I q I How  do  you  view  the  growing  interest  in  qualitative 
' — 1 research  methods  in  education  and  the  debate  that 
it  has  inspired? 


ferent  ways  of  understanding  the  situation.  Educational  research 
traditionally  has  so  emphasized  the  first  that  it  has  provided  no 
space  for  the  later.  My  aim  is  not  to  replace  the  first  with  the 
second,  but  to  broaden  the  array  of  approaches  that  can  be  legiti- 
mately employed  by  educational  researchers.  These  are  options. 
They  can  both  be  employed.  They  both  can  be  handled  well  or 
poorly.  They  both  basically  deal  with  how  we  see,  describe,  and 
come  to  understand  the  educational  world  we  are  interested  in. 


j q | What  would  like  to  accomplish  as  President  of  AERA? 

I ^ I I would  like  to  help  become  more  Janus-headed.  It  has  his- 

torically  looked  exclusively  to  the  academy;  its  publications 

and  its  annual  meeting  have  served  the  academy  and  have  served 
the  academy  well.  I would  like  for  AERA  to  have  a more  public 
presence  in  the  nation  as  a whole,  and  not  only  toward  the 
policy.  We  have  important  social  and  educational  questions  in 
this  country  I think  AERA  has  some  important  things  to  say  to 
the  world  about  educational  matters.  It  is  the  most  prestigious  edu- 
cational organization  in  this  country  and  it  ought  to  convey  what 
it  can  to  enlighten  and  facilitate  the  creation  and  implementation 
of  sound  educational  policy  by  people  who  care  about  education. 


|~Q~|  Is  AERA  too  big? 


^ No.  When  people  are  being  well  served  they  vote  with  their 

feet.  If  people  are  voting  with  their  feet  by  coming  in  the 

door,  I wouldn’t  say  that  it  was  a bad  thing. 


What  do  you  see  as  the  role  for  regional  groups 
like  MWERA? 


^ I Quantitative  and  qualitative  approaches  are  two  different 

1 ways  of  describing  the  world.  To  describe  the  room  that  we 

are  sitting  in  quantitatively  you  would  get  length,  width,  and 
volume;  and  it  will  be  an  accurate  and  true  description  of  this 
room  in  those  terms.  A qualitative  description  of  this  room  will 
deal  with  how  it  looks,  how  it  makes  us  feel,  how  it  got  to  be 
the  way  it  is  and  what  traditions  it  reflects  architecturally,  and 
so  on.  It’s  not  that  the  first  is  bad  and  the  second  is  good,  or 
that  the  first  is  good  and  the  second  is  bad.  These  are  two  dif- 


^ First  of  all  regional  groups  have  local  needs  that  are  special 

to  those  areas.  AERA  had  18,000  members  and  it  is  sort  of 

the  big  arena.  I think  the  regional  and  state  associations  can  pro- 
vide a friendly  and  helpful  context  organizationally  for  young 
researchers  coming  up,  and  can  address  some  of  the  issues  that 
may  pertain  to  state  and  regional  policy  developments  and  educa- 
tional needs  located  within  regions.  I think  that  the  strengthening 
of  state  and  regional  organizations  is  a good  way  to  strengthen 
AERA  in  general. 


Reflections  on  Teacher  Education : 
An  Interview  ivith  Lee  Shulman 

By  Gregory  J.  Marchant,  Ball  State  University,  and  Isadore  Newman,  The  University  of  Akron 


[q~  If  I said  to  you,  “What  is  teacher  reform?”  what 
would  you  say? 


^ The  notion  of  reform  suggests  that  it’s  like  reform  school. 

It  suggests  that  something  pathological  has  to  he  healed; 

something  that's  got  to  be  recast.  Take,  for  example,  the  prepara' 
tion  of  teachers.  In  some  ways,  the  preparation  of  teachers  probably 
achieved  a great  equilibrium  at  the  height  of  the  normal  schools. 
Normal  schools  were  perfectly  lovely  places  to  prepare  teachers. 
So  the  question  is,  why  didn’t  we  just  continue  normal  schools? 
One  reason  has  to  do  with  status  and  mobility.  Normal  schools, 
like  the  old  hospital-based  nursing  schools,  were  not  part  of  the 
higher  education  system.  The  way  you  know  whether  something 
is  part  of  a system  is  whether  credits  that  are  earned  in  one  part 
of  the  system  can  be  spent  in  another  part.  If  things  from  one 
part  of  the  system  can  be  spent  in  another,  then  they’re  part  of 
the  same  system.  If  they  can’t,  they  aren’t.  In  old  hospital-based 
nursing  programs  you  went  to  nursing  school  for  three  years,  got 
your  RN,  wore  your  cap,  then  decided  if  you  wanted  to  get  a 
bachelor’s  degree  in  nursing.  How  many  credits  did  you  have 
that  you  could  take  to  the  university?  Zero.  Well,  the  normal 
schools  were  not  seen  as  part  of  the  same  system  of  higher  edu- 
cation. First  you  go  to  the  normal  school  for  two  or  three  years 
and  you  would  teach.  Subsequently,  you  might  want  to  get  a 
university  or  college  degree,  but  how  much  transfer  credit  did 
you  have?  In  order  to  be  legitimate  and  to  provide  the  necessary 
status  and  mobility  to  teachers  they  had  to  modify  the  relation- 
ship between  normal  schools,  colleges,  and  universities.  What 
that  usually  meant  was  that  you  cither  incorporated  normal  schools 
within  colleges  and  universities  in  a merger  process,  or  you  trans- 
formed what  were  originally  normal  schools,  like  many  of  our 
institutions,  into  colleges  and  universities.  In  doing  so,  one  of  the 
things  you  did  was  to  weaken  the  autonomy,  integrity,  and  coher- 
ence of  those  institutions  as  teacher  preparation  institutions. 
That’s  sort  of  looking  at  it  negatively,  the  positive  sense  is  that  in 
many  ways  normal  schools  were  places  that  preserved  the  norm. 
They  were  places  where  one  learned  the  “norms”  of  good  teaching. 
They  were  modeled.  That’s  why  normal  schools  all  have  demon- 
stration schools  for  teachers  to  demonstrate  good  teaching  that 
other  teachers  could  emulate.  Typically,  the  textbooks  they  used 
were  the  same  texts  they  would  he  teaching  from  in  the  schools 
where  they  would  teach.  So  what  you  have  was  a highly  con- 
servative function  with  regard  to  openness  to  change.  This 
was  what  caused  Dewey  to  argue  for  a laboratory  school  instead 
of  a demonstration  school  when  he  started  the  Department 
of  Education  at  The  University  of  Chicago  in  1895.  He  wanted  a 
place  where  people  would  experiment  with  his  yet  unproven 


ideas,  instead  of  just  demonstrate  the  best  practices  that  were 
currently  understood. 

But  anyway,  for  perfectly  good  reasons  normal  schools 
were  destroyed  and  made  into  universities  in  order  to  empower 
teachers  and  to  improve  their  liberal  and  general  education,  rather 
than  make  them  technical  masters  of  the  existing  trade.  Teacher 
education  moved  to  institutions  that  had  multiple  agendas.  These 
multiple  agendas  all  pull  teacher  education  and  its  curriculum 
in  a variety  of  ways.  So  in  solving  one  problem,  we  created  a new 
one.  Teachers  are,  in  all  kinds  of  ways,  better  educated  than  ever 
before,  but  ironically,  less  well  prepared  to  teach  on  Monday 
morning.  The  response  to  that  is  that  if  you  want  to  prepare 
better  plumbers,  don’t  send  them  to  universities;  that’s  not  what 
universities  and  colleges  are  for.  Send  them  to  plumbing  schools. 
So,  with  regard  to  the  reform  of  teacher  education,  the  reason 
that  it  is  an  endless  activity  is  because  teacher  education  is  pulled 
on  the  one  hand  by  the  norms  and  commitments  of  the  academy 
of  the  universities,  pulled  by  the  demands  of  preparing  a group 
of  people  who  will  be  teaching  on  Monday  mornings,  and  pulled 
by  the  demands  of  school  reformers  who  are  not  the  same  as 
either  one  of  those,  but  are  people  who  have  a vision  of  what 
schools  might  be. 


Lj  | 1 think  there’s  a movement  across  the  country  to  get 
1 1 rid  of  colleges  of  education.  There  is  also  the  move- 

ment shared  by  the  Holmes  Group  and  the  Carnegie  Foun- 
dation to  eliminate  undergraduate  teacher  education,  and 
we  also  had  American  2000  which  seemed  to  support 
alternative  teacher  certification.  How  do  those  fit  in 
with  your  concept  of  knowledge  and  pedagogy? 

^ I happen  to  believe  strongly,  both  because  of  my  own  re- 

search  and  some  of  that  of  my  colleagues  as  well  as  because 

of  my  own  socialization,  that  the  primary  responsibility  of  teachers 
is  the  conservation,  extension,  elaboration,  and  creation  of  knowl- 
edge. That’s  my  sense  of  what  teaching  is  all  about.  I think  that 
there  are  other  professional  groups  that  are  responsible  for  the 
mental  health  of  youngsters,  for  physical  health,  for  the  social 
development  of  families,  and  so  on.  Although  you  can’t  draw 
sharp  lines  between  the  obligations  of  the  professions,  there  is  a 
need  to  reorganize  the  institutions  of  caring  so  that  it’s  easier  for 
people  who  arc  being  prepared  to  work  on  the  different  aspects 
of  the  child’s  welfare  to  coordinate  their  efforts.  So,  I begin  with 
that  notion  that  the  unique  obligation  of  the  teacher  is  the  intel- 
ligence of  the  nation.  And  intelligence,  as  we  psychologists  know, 

(continued  r m fxige  28) 
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is  not  a retrospective  notion;  it’s  a prospective  notion.  Intelligence 
tests  are  supposed  to  measure  not  only  what  you  have  learned, 
but  what  you  are  capable  of  doing,  what  you  are  apt  to  be  able 
to  do.  It  is  intelligence  in  its  many  manifestations,  talent  in  its 
many  manifestations,  that  I think  schools  are  about. 

At  AERA  a couple  of  years  ago  you  suggested  that 
pedagogy  might  be  considered  the  highest  level  of 
Bloom’s  taxonomy  of  the  cognitive  domain.  How  does 
this  fit  into  your  notion  of  teacher  preparation? 

Bloom  placed  evaluation  at  the  top  of  the  taxonomy  (he 
was  an  evaluator).  I was  arguing  that  even  higher  on  the 
taxonomy  than  the  ability  to  critically  evaluate  competing  truth 
claims  is  pedagogy.  It’s  the  capacity  to  transform  that  sort  of  under- 
standing into  instruction  that  we  connect  with  the  lives  of  others. 
However,  it  is  very  clear  that  one  of  the  conclusions  to  be  drawn 
from  the  more  recent  research  on  critical  thinking  is  that  unless 
you  embed  the  learning  at  the  lower  levels  concurrently  in  higher 
order  tasks,  you  can  actually  inhibit  the  development  of  the  higher 
order  abilities.  If  you  are  too  unremittingly  sequential  you  can 
really  screw  things  up.  One  way  to  think  about  this  is  to  say, 
“Well,  first  you  get  all  of  your  subject  matter  and  then  you  tack 
on  a fifth  year  for  pedagogy.”  And  that,  in  effect,  is  the  way  Cali- 
fornia law  requires  that  we  do  it. 

If  I had  my  druthers,  I would  inter-penetrate  the  two 
much  earlier.  And  there  are  a number  of  formats  for  doing  it. 
During  the  first  two  years  at  Brooklyn  College  the  students  are 
studying  the  liberal  arts,  but  many  of  them  in  college  elect  edu- 
cation as  their  major  already.  They  have  what  they  call  a studio 
course.  They’re  using  the  analogy  of  preparation  of  an  artist.  A 
studio  course  runs  alongside  the  liberal  arts  courses.  Here  they 
already  begin  thinking  about  the  pedagogy  of  the  content  material. 
At  the  University  of  Dayton,  they  have  a very  similar  approach 
that  Tom  Lasley  and  his  colleagues  have  helped  pioneer.  At  the 
same  time  they’re  doing  liberal  arts  study  they  do  portfolio  work 
to  help  them  think  about  the  pedagogy  of  these  things.  If  I were 
designing  teacher  education  I would  rather  see  some  kind  of 
sandwich,  goulash,  or  some  interweaving  of  the  pedagogical  and 
the  substantive. 

In  my  own  teaching,  even  in  the  fifth  year,  I weave  the 
substantive  in  very,  very  strongly.  I teach  a required  course  for 
all  of  our  teacher  education  students.  All  of  them  are  secondary. 
It’s  called  Foundations  of  Learning  for  teaching.  It’s  sort  of  a 
combination  of  educational  psychology'  and  Philosophy  of  Educa- 
tion. Rather  than  teach  generic  concepts,  what  I do  is  embed 
everything  we  do  in  specific  concepts,  even  though  only  20  per- 
cent of  the  class  may  actually  be  learning  to  teach  that  cognate. 
We  actually  read  some  Romeo  and  Juliet  together.  So  everybody 
discusses  some  of  the  psychological  and  philosophical  issues  in 
teaching  Romeo  and  Juliet.  What’s  hard  about  this.’  What  is  it 
that  makes  this  linguistically,  conceptually,  and  culturally  difficult 
even  if  you’re  not  a black  kid  from  the  inner  city?  Then  my  students 
write  case  studies  of  their  own  interning  teaching  experiences. 


One  of  the  goals  of  Stanford’s  teacher  education 
program  is  to  develop  reflective  teachers.  How  func* 
tional  is  the  concept  of  reflection  in  teaching  and 
teacher  education? 

^ Sometimes  I feel  the  term  should  be  refraction  rather  than 

reflection,  because  refraction  suggests  a lens,  reflection  simply 

reflects  a mirror.  In  her  dissertation  research  and  follow-up  research, 
Anna  Richert  demonstrated  that  reflection  has  got  to  be  guided 
by  both  -knowledge  and  points  of  view.  For  example,  how  does 
one  reflect  on  the  quality  of  the  unit  he  or  she  has  just  taught 
on  human  evolution  and  natural  selection?  What  does  it  mean 
to  reflect  on  that?  First  of  all  one  can  ask  oneself,  how  intellec- 
tually honest  was  the  unit  1 just  taught?  How  truly  faithful  was 
what  I taught  to  the  real  complexities  of  human  evolution?  Did  it 
oversimplify?  Conversely,  did  it  not  give  enough  respect  to  the 
fact  that  there  are  other  perspectives?  What  we  find  is  that  un- 
schooled teachers,  teachers  who  are  not  prepared  to  think  deeply 
about  student  understanding  and  misconceptions,  arc  asking  the 
students,  “How  did  you  like  the  unit?”  They  ask  this  type  of 
question  instead  of  doing  any  careful  monitoring  of  student  under- 
standing. You  have  to  know  a great  deal  to  understand  which 
relevant  kinds  of  information  are  worth  reflecting  upon.  That  is 
where  reflection  shifts  from  being  a mere  slogan  to  being  a strategy 
of  teaching  and  learning  from  teaching. 

Now  you  ask,  what’s  the  role  of  the  school  of  education? 
First  of  all,  it  has  to  be  perfectly  clear,  that  content  knowledge 
alone  is  not  the  only  lens  through  which  you  have  to  refract  these 
experiences.  You  want  teachers  to  connect  the  subject  matter  to 
the  pedagogy.  You  want  them  to  reflect  on  the  representation  of 
subject  matter  and  about  the  strategies  for  organizing  classrooms 
into  learning  environments  that  work.  A lovely  example  of  this 
is  Pam  Grossman’s  book,  The  Making  of  a Teacher , which  won 
both  the  AACTE  Award  for  Teacher  Education  Research  and  the 
Outstanding  Research  Award  from  the  National  Council  of 
'Teachers  of  English.  It  is  a book  that  in  large  measure  contrasts 
equally  well-prepared  subject  matter  specialists  in  English  litera- 
ture, some  of  whom  have  had  teacher  preparation  and  some  who 
have  not.  It  is  not  a statistical  study.  It  is  a set  of  contrastive  case 
studies.  What  you  find  are  the  limitations  of  deep  subject  matter 
alone.  People  with  deep  subject  matter  essentially  attempted  to 
reproduce  in  the  classroom  the  kind  of  pedagogy  they  themselves 
had  gotten  in  graduate  school,  essentially  reteaching  their  graduate 
course  more  slowly  and  trying  to  make,  or  not  even  trying  to 
make,  what  Bruner  called  the  courteous  translations.  The  people 
who  had  been  well-trained  as  English  teachers  recognized  that 
the  first  problem  was  to  try  to  find  some  books  in  the  content 
area  that  would  connect  to  the  ways  of  thinking,  bodies  of  experi- 
ences, and  prior  learning  of  the  students,  and  you  sec  an  utterly 
different  process  of  pedagogical  reasoning  and  action  building. 

One  of  the  things  you  have  said  is  "yes,  we  can  teach 
people  that  they  have  to  evaluate.”  You  can  teach 
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people  methods  of  evaluating,  but  what  we  also  have  to 
teach  them  are  relevant  questions  to  ask*  But  we  don't 
teach  inquiry  very  effectively;  we  teach  technique.  We're 
still  “training"  teachers.  And  1 think  what  you’re  talking 
about  is  that  we  need  to  teach  people  how  to  think. 

I ^ I I’m  saying  more  than  that.  You  have  to  learn  how  to  think 

within  a domain.  I think  that  is  what  we  now  understand 

from  the  work  on  critical  reasoning.  I can  know  how  to  think 
brilliantly  about  literature  and  not  about  the  stock  market.  I can 
learn  to  think  brilliantly  about  chemical  reactions  and  not  be  able 
to  think  with  the  same  kind  of  facility  about  historical  connections. 


|q  I What  you’  re  saying  would  seem  to  have  major  implL 
1 — ‘ cations  concerning  specialization  in  instruction,  in 
particular  for  elementary  teachers.  If  we  are  going  to 
accept  the  notion  that  any  kind  of  pedagogy  is  going  to 
be  very  content  specific,  then  with  an  elementary  teacher 
you  have  someone  whose  job  is  not  to  just  teach  math, 
but  to  teach  literature,  to  teach  reading,  to  teach  writing, 
to  teach  art,  in  many  cases  to  teach  everything.  If  every 
kind  of  knowledge  has  its  own  specific  pedagogy,  and 
if  it  takes  five  years  to  create  a secondary  teacher,  how 
are  we  going  to  go  about  making  a really  good  elemerv 
tary  teacher? 

^ There  are  several  assumptions  that  we  ought  to  question. 
— If  we  learned  that  we  had  designed  an  airplane  that  was 
impossible  for  one  pilot  to  fly,  we  would  not  say,  “Well,  maybe  if 
we  train  pilots  for  15  years  they  can  fly  it.”  Instead  we  might  ask, 
“How  can  we  either  redesign  the  cockpit  or  configure  a crew 
capable  of  flying  the  airplane?”  I feel  that  the  subject  matter 
demands  on  elementary  teachers  are  greater  than  the  subject 
matter  demands  on  secondary  teachers.  The  ideas  that  elemen- 
tary teachers  are  trying  to  teach  are  in  many  ways  more  funda- 
mental than  those  of  secondary  school;  the  minds  of  the  students 
are  more  elusive.  Add  to  that  the  complexity  of  the  multi-sub- 
jects expectations.  I once  characterized  the  elementary  school 
teacher  as  a hybrid  of  Leonardo  daVinci  and  Ann  Landers, 
because  you’re  also  supposed  to  be  enormously  caring  and  nur- 
turing. Having  said  that,  1 feel  it’s  important  to  say  that  most 


elementary  school  teachers  are  already  subject  specific  pedagogues 
and  the  subject  is  reading  and  language  arts. 

I q I We  have  this  big  push  for  content  knowledge,  and 
— 1 1 know  from  looking  at  a number  of  studies,  if  you 
ask  teachers  and  principals,  “What’s  wrong  with  bad 
teachers?  When  your  teachers  fail,  why  do  they  fail?"  the 
responses  tend  not  to  be,  “Oh,  that  science  teacher,  the 
quantum  physics  stuff  is  beyond  him."  Principals  say  the 
problem  is  that  they  can’t  teach.  You  ask  the  teachers 
what  they  have  problems  with,  it's  not,  “Well,  I don’t 
understand  these  laws  of  physics,"  or  “1  don’t  understand 
'whatever.' " They  don't  understand  how  to  teach  it  or 
how  to  manage  the  class. 

^ We  often  ask  the  wrong  people  the  wrong  question  in  the 

first  place.  We  ask  the  principal,  “Who  is  a good  teacher?” 

Well,  the  principal  doesn’t  know  quantum  mechanics  from  diddly. 
The  principal’s  going  to  walk  in  with  his  Madeleine  Hunter  chart 
and  if  the  teacher  is  teaching  absolute  nonsense  about  trigonometric 
functions  or  about  the  War  of  1812,  as  long  as  the  kids  are  on 
task  and  teacher  seems  to  be  doing  advanced  organizers  and 
stuff  it  looks  terrific.  If  you  ask  a general  question,  you’ll  get  a 
general  answer.  If  you  ask  the  question,  “What  are  the  attributes 
of  a good  teacher  of  algebra?”  then  suddenly  the  characterization 
changes  a little.  If  I say  to  you,  “What  are  the  characteristics  of  a 
good  teacher  for  the  first  course  in  statistics  for  anxious  master’s 
students  in  a school  of  education?”  the  answer  changes.  If  the 
stat  teacher  doesn't  know  anything  about  statistics,  then  he 
couldn’t  share  it.  But  if  all  he  knows  is  statistics,  he’s  going  to 
have  those  people  wetting  their  pants.  If  you  asked  me  the  ques- 
tion, “WTiat  does  somebody  need  to  know  to  be  able  to  teach 
Moby  Dick?”  I will  describe  to  you  someone  who  understands 
both  the  mind  of  Melville  and  the  mind  of  the  high  school  junior, 
and  the  ways  in  which  the  turmoils  of  Ahab  and  Ishmael  and  the 
turmoil  of  the  lives  of  adolescent  human  beings  in  our  society 
connect  with  one  another.  Is  that  just  content?  No,  it’s  also  the 
ability  to  understand  how,  at  certain  propitious  moments,  to  pose 
problems  that  the  kids  can  break  up  into  small  groups  and  work 
on  and  bring  back.  I’m  not  trying  to  make  it  all  content,  but 
I’m  saying,  in  some  very  real  sense,  content  keeps  on  poking  its 
head  up  as  it  informs  the  pedagogy,  as  it  informs  the  evaluations. 
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Overview  of  Computer  Use 
in  Qualitative  Research 

Qualitative  research  often  requires  the  analysis  of  large 
quantities  of  unstructured  data.  Research  questions  are  addressed 
using  data  in  the  form  of  interviews,  observations,  field  notes, 
journals,  video  and  audio  tapes.  There  are  several  major  analysis 
tasks  employed  by  qualitative  researchers.  These  tasks  include 
identifying  individual  words,  counting  word  frequencies,  coding 
key  words,  and  identifying  emerging  concepts. 

In  order  to  deal  with  analysis  of  information  qualitative 
researchers  have  had  to  rely  on  paper,  index  cards,  markers,  hole 
punches,  scissors,  and  tape.  Computers  are  beginning  to  aid  in 
the  process.  The  most  common  software  tool  supporting  qualita- 
tive  research  is  the  word  processor.  However,  several  computer 
software  programs  are  being  designed  to  specifically  support  quali- 
tative research  data  analysis  (Pfaffenberger,  1988;  Tesch,  1990,  1991). 

Reflecting  on  a 1984  special  issue  of  the  journal  Qualitative 
Sociology,  Tesch  (1989)  comments  on  the  vision  and  expectations 
posited  in  comparison  to  events  which  have  transpired  over  the 
past  several  years.  “No  revolutionary  software  for  interpretive  text 
analysis  has  been  introduced. . . . The  dissemination  of  existing 
analysis  software  has  been  relatively  slow,  and  the  literature  about 
computer-assisted  qualitative  analysis  is  still  sparse11  (p.  142).  People’s 
expectations  were  greater  than  the  capabilities  of  the  technology. 
There  were  hopes  that  computers  would  “listen”  and  enter  the 
text  of  audio-taped  interviews.  There  were  also  hopes  that  intel- 
ligent computers  would  perform  sophisticated  analysis.  Addi- 
tional’ /,  it  was  believed  that  once  the  technology  was  developed 
it  would  be  rapidly  diffused. 

The  current  status  of  technological  support  for  the  process 
of  qualitative  research  needs  to  be  considered.  This  paper  will 
address  this  issue  by  presenting  information  on  the  development 
of  computer  programs  which  support  the  qualitative  research  pro- 
cess and  focus  specifically  on  Metamorph™1,  an  innovative  text 
retrieval  software  tool. 

Software  Support  and  Development 

For  those  faced  w'ith  recording,  organizing,  and  intercon- 
necting mounds  of  data,  the  use  of  word  processing  and  data  base 
software  affords  a way  to  tame  this  part  of  the  analysis  process. 
Adding  codes,  copying  passages,  assembling  classification  items, 
attaching  analysis  notes  to  files  am  easily  accomplished  with  w'ord 
processing  software.  Easy  relative  to  actually  producing  multiple 
copies  of  data  sources,  physically  cutting  and  pasting,  coding, 
sorting,  and  filing  the  data  for  latter  analysis  strategies.  Word  pav 


cessing  software  is  not  capable  of  searching  for  occurrences  and/or 
co-occurrences  of  noncontiguous  words  or  phrases.  Therefore 
some  researchers  have  ventured  into  electronically  arranging  their 
data  into  fields  based  on  coding  strategies  to  import  into  data 
base  programs.  This  provided  a means  to  search  for  possible  pat- 
terns and/or  connections  between  and  among  categories  (fields). 

Of  interest,  but  not  widely  used  in  qualitative  research, 
are  hypertext  programs  and  Artificial  Intelligence  (AI)  (Brent, 
1989;  Fielding  Lee,  1991;  Pfaffenberger,  1988).  The  advent  of 
hypertext  programs  has  provided  a way  to  link  concepts  in  a non- 
linear fashion  to  facilitate  browsing.  “Hypertext  is... a means  of 
navigating  from  one  node  of  information  to  another  node  of  in- 
formation in  an  associative  manner”  (Gluck,  1991,  QUALRS-L 
discussion  group).  Thoughts  of  utilizing  AI  has  raised  hopes  for 
the  creation  of  AI  programs  that  would  perform  sophisticated 
analysis  strategies  like  those  employed  by  human  beings.  To  date 
AI  programs  have  not  been  able  to  imitate  the  higher  cognitive 
functions  of  the  human  brain. 

Development  and  research  into  AI  embodies  a variety  of 
approaches.  Some  AI  development  strategies  are  built  on  (a)  rule- 
based  systems,  (b)  precedent-based  systems,  or  (c)  natural  language- 
based  systems  (Schrodt,  1989).  Brent  (1989)  suggests  that  tw'o  AI 
subareas,  expert  systems  and  natural  language  understanding, 
hold  promise  for  qualitative  research. 


Software  Adaptation  and  Development 

Evidence  exists  that  applying  technology  to  the  qualitative 
research  process  has  been  beneficial.  A group  of  social  scientists 
attributed  the  improvement  in  the  quality  of  their  research  to 
their  utilization  of  the  microcomputer. 

The  social  scientists  studied. . .believed  that  the 
use  of  microcomputers  in  their  wfork  has  not  altered 
the  information-processing  tasks  in  w’hich  they 
engage  but  that  they  now'  have  far  greater  personal 
control  over  those  tasks  and  that  they  are  doing 
them  much  more  effectively.  (Danziger,  1989,  p.  76). 

All  aspects  of  the  technological  process  have  not  been 
viewed  favorably,  however.  Researchers  have  raised  concerns 
(Conrad  &.  Reinharz,  1984;  Freidheim,  1984;  Lyman,  1984;  Pfaffen- 
berger, 1988;  Seidel,  1991;  and  Tesch,  1989).  There  are  concerns 
with  having  computer  software  define  the  research  problems, 
concerns  that  researchers  may  distance  themselves  from  their 
data,  concerns  over  the  accumulation  of  volumes  of  data,  and 
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finally,  concerns  that  researchers  may  prematurely  terminate  the 
data  analysis  process. 

Ways  have  been  found  to  address  these  concerns  by  using 
existing  software  and  creatively  adapting  these  programs  to  analysis 
needs.  Adaptation  occurs  by  combining  the  best  of  existing  soft' 
ware  and  incorporating  the  researchers’  analysis  techniques  and 
strategies.  The  adaptive  process  has  led  qualitative  researchers 
into  the  realm  of  software  design.  Examples  of  these  programs  are 
Aquad™,  Ethnograph™,  Ethno™,  HyperQual™,  HyperResearch™ , 
Hypersoft™,  MECA™  (Map  Extraction  Comparison  and  Analysis), 
NUDIST™  (Non-numerical  Unstructured  Data  Indexing  Search- 
ing and  Theorizing),  Qualog™  Qualpro™  TAP™  (Text  Analysis 
Package),  and  Textbase  Alpha™  (see  Appendix  A). 

A reflection  of  the  interest  in  computer  use  for  data  analysis 
can  be  found  in  the  initial  dialogue  flooding  the  QUALRS-L2 
(Qualitative  Research  for  the  Human  Sciences)  discussion  group 
via  B1TNET.  This  discussion  group,  begun  September  6,  1991, 
currently  has  over  370  members.  Discussions  of  the  use  of  com- 
puters in  qualitative  research  dominated  this  list  for  the  first  month 
and  a half.  These  early  discussions  focused  on  (a)  types  and  uses 
of  computer  programs  known  (ieM  Ethnograph™)  and  not  as  well 
known  (ie.,  Kwalitan™3),  (b)  experimental  software  (i.e.,  ATLAS/ 
ti4,  ART5)  and  its  availability  to  beta-tester,  (c)  strengths  of  IBM 
and  Macintosh,  and  (d)  the  use  of  and  explanation  of  hypertext. 

For  some  researchers,  computer  use  is  a necessity  in  data 
analysis.  As  expressed  by  a participant  in  the  QUALRS-L  dis- 
cussion group: 

I think  part  of  the  fascination  of  social  scientists  with 
computer  programs  such  as  ethnograph  and  hypertext 
arise  out  of  a subjective  frustration  that  occurs  when 
one  is  too  close  to  one’s  data— and  needs  to  find  a rela- 
tively unbiased  way  to  approach  the  text.  The  rapid 
manipulation  of  text,  and  the  oftentimes  accidental 
juxtaposition  of  images,  can  allow  experimentation  with 
data  that  could  take,  literally,  forever,  without  the  new 
media  technologies.  Statisticians  aren’t  the  only  ones, 
now,  who  have  convenient  ‘tools’  to  explore  recurring 
patterns  in  their  data.  (Wilson,  1991,  QUALRS-L  dis- 
cussion group). 

One  thing  is  certain,  as  additional  software  tools  and 
modifications  to  existing  programs  become  available,  there  will  be 
users  ready,  willing,  and  able  to  apply  them  in  qualitative  research. 

Metamorph™:  A Discovery 

The  nature  of  computer  software  programs  tends 
to  be  highly  structured.  This  may  pose  a problem  to  the  qualitative 
researcher  trying  to  fit  unstructured  data  into  a highly  structured 
computer  environment.  A solution  to  this  problem  may  exist 
in  the  form  of  a uniquely  designed  text  analysis  program,  Meta- 
morph™. This  program  is  able  to  manipulate  raw  (ASCII)  data 
without  imposing  classical,  Boolean  logic. 


Qualitative  data  analysis  required  the  researcher  to  sift 
through  large  quantities  of  text  to  develop  taxonomies,  explicate 
themes,  formulate  hypotheses  and/or  generate  support  for  triangu- 
lation.  Unfortunately,  most  software  programs  do  not  provide  the 
liberty  to  freely  search  multitudes  of  unorganized  textual  data. 

This  sophisticated  computer  software  program  was  acci- 
dentally discovered  that  may  have  the  potential  to  assist  many 
qualitative  researchers  in  data  analysis.  A professor  at  Kent  State 
University,  Dr.  William  Patton,  had  been  reading  through  some 
business  articles  that  were  reviewing  computer  software.  He  came 
across  a description  of  Metamorph™,  a free-form  text  analysis 
tool  used  primarily  by  business  and  government  agencies.  Dr.  Pat- 
ton believed  the  nature  of  Metamorph™  could  lend  itself  to  quali- 
tative research.  Several  of  Dr.  Patton’s  colleagues  felt  the  potential 
of  this  program  was  worth  exploring  and  contacted  the  developers. 

It  was  to  Kent  State  University’s  advantage  that  Meta- 
morph™ was  written  and  distributed  by  a Cleveland  business 
firm,  Expansion  Programs  International,  Inc  Several  Kent  State 
University  researchers  brought  the  author  of  Metamorph™ , Bart 
Richards,  to  campus  to  explore  the  possibilities  of  using  his  pro- 
gram for  qualitative  research.  Kent  State  University  has  been 
working  with  Richards  for  nearly  two  years  in  determining  ways 
to  adapt  the  essence  of  Metamorph™  to  the  needs  of  the  quali- 
tative research  community. 

Metamorph™:  A Description 

Metamorph™  is  a computer  software  program  designed  to 
work  with  large  quantities  of  unstructured  text.  It  is  currently 
being  used  in  many  fields  and  areas  of  inquiry  such  as  (a)  medi- 
cine (e.g.,  cancer  and  AIDS  databases),  (b)  air  mishap  analysis, 
(c)  law,  (d)  Bible  study,  and  (e)  government  contract  and  pro- 
curement tracking. 

Typically,  Metamorph™  is  used  to  quickly  scan,  documents, 
manuals,  and  unstructured  records  to  find  information.  By  his- 
torically retracing  the  information  searching  process  we  can  see 
the  benefits  of  the  Metamorph™  technology.  Looking  back  only 
a decade  ago  the  researcher  would  go  to  the  library  and  begin 
his/her  literature  search  by  looking  through  a card  catalogue, 
table  of  contents  or  indexes.  Once  referents  and  pages  were  found, 
each  item  was  manually  located  and  read.  Relevant  information 
was  duplicated  for  future  use.  The  procedure  was  slow  and  tedious. 

In  the  last  eight  years  on-line  databases  have  aided  in  the 
search  piocess.  Databases  are  highly  structured  information  sources. 
Raw  or  unstructured  information  (ie.,  reference  manuals,  trans- 
criptions, etc.)  is  manipulated  into  broad  categories  called  records, 
then  subdivided  into  more  discreet  categories  called  fields.  Infor- 
mation is  retrieved  by  using  key  words  that  have  been  predeter- 
mined by  the  database  program.  The  person  who  does  the  infor- 
mation search  is  dependent  upon  the  design  of  the  database.  Free 
and  random  searching  is  typically  not  possible. 

Unlike  the  Boolean  logic  designs  of  most  database  programs, 
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Metamorph™  is  built  on  a systematic  structure  of  pattern  match- 
ing  and  set  logic.  It  may  have  the  potential  to  revolutionize  infor- 
mation searching.  This  program  is  useful  for  both  on-line  databases 
(e.g.,  ERIC  and  Psychological  Abstracts)  and  ASCII  transcriptions. 
The  program  user  is  able  to  freely  search  information  by  entering 
a word,  a concept,  a proper  name,  or  a combination  of  words. 
Metamorph™  is  able  to  rapidly  scan  vasts  amounts  of  information 
finding  “hits.”  The  Metamorph™  “hit”  is  the  actual  word(s)  or  a 
thesaurus  form  of  the  word(s).  This  information  is  presented  on  the 
computer  monitor  in  its  original  context  with  the  “hits”  highlighted. 

Once  the  information  is  presented  on-screen,  the  person 
using  Metamorph™  is  able  to  mark  any  information  he/ she  wants 
to  retain  and  save  this  information  to  an  appendable  file.  This 
process  allows  rapid,  unstructured  information  searching,  in-context 
judgment  of  information  relevance,  and  “clipping”  of  selected 
information  which  can  be  saved  in  ASCII  format. 


What  does  Metamorph™  Mean 
for  Qualitative  Research? 

Unlike  other  computer  data  analysis  software,  Metamorph™ 
is  a tool  which  can  be  utilized  throughout  the  research  process. 
It  provides  a way  for  researchers  to  handle  large  quantities  of  data 
that  might  otherwise  appear  daunting.  There  is  often  a concern 
that  significant  literature  may  be  overlooked  when  searching 
through  vast  amounts  of  information.  Because  of  Metamorph’s™ 
efficient  and  thorough  search  “engine”  it  is  possible  to  (a)  search 
through  all  the  available  article  abstracts  found  on  CD-ROM 
and,  (b)  review  the  selected  articles  (converted  to  ASCII  text  files) 
using  Metamorph™.  . . 

After  the  initial  review  of  literature,  Metamorph™  can 
continue  to  be  used  at  various  stages  of  data  analysis.  Qualitative 
data  are  entered  into  the  computer  as  ASCII  text  files.  These  data 
can  take  the  form  of  field  notes,  text  transcriptions  of  audio  tapes, 
subjects’  and  researcher’s  journals,  etc.  Initial  data  analysis  can 
begin  once  these  files  are  available  to  the  Metamorph™  com- 
puter program. 

Data  query  can  be  done  in  a natural  language  format. 
Metamorph™  is  built  on  semantic  relationships  providing  the 
researcher  with  the  flexibility  to  interact  with  his/her  data  using 
the  language  of  the  participants.  To  understand  how  Metamorph™ 
accomplishes  this  task  think  about  matching  all  query  word  items 
against  all  possible  thesaurus  entries.  After  making  list  sets  of  all 
thesaurus  combinations  (see  Figure  1),  Metamorph™  rapidly  scans 
the  text  files  for  corresponding  matches.  When  a “hit”  is  found, 
it  is  highlighted  and  displayed  in  context  on  the  monitor  for  the 
researcher  to  review  (see  Figure  2,  top  of  page  33).  This  provides 
immediate  information  to  the  researcher  on  how  successful  the 
query  was  and  leads  the  researcher  to  utilize  higher  level  thinking 
strategies  to  uncover  subsequent  findings  or  in  guiding  the  rephras- 
ing of  the  query.  In  essence,  Metamorph™  allows  the  researcher 
ro  have  a conversation  with  his/her  data. 


Figure  1 

Samples  of  Equivalents  for  Thesaurus  Entries 
“Problem”  and  “Care.” 

Editing:  Equivalence  lists 

< CR  > = Ok,  Delete,  Edit 

— Page  ULast) PgDn:  F.  PgUp:  B- 

= problems  IB  equivalences 
brothers 

headache;n 

query  ;n 

cares 

issue;  n 

questions 

conundrums 

]abvrimh;n 

riddle;n 

difficultvs 

mysterv;n 

troubles 

enigmas 

predicaments 

worrys 

hang  up;n 

puzzles 

- < Z:help  > --  < ESC:prev  menu  > < 

R:top  menu  > 

Editing:  Equivalence  lists 
<CR>  = Ok,  Delete,  Edit_ 
—Page  l(Last) PgDn:  F, 

pguPr  b 

“ carc;n  55  equivalences 
administrations 

distress-.n 

thoughtfulnes$;n 

aa\iery;n 

fidelitvs 

troubles 

attentions 

heed;n 

mtelaage;n 

bothers 

impatience, n 

\variness;n 

bugbears 

hdustry;n 

worryjn 

caution;n 

interests 

worryings 

chagrins 

misfortunes 

zcal;n 

circumspections 

niceness;  n 

attention  ;n 

concerns 

pcrplcxitv;n 

bewares 

conduct;n 

prec  ution;n 

carcfulness;n 

conscientiousness^ 

problem;  n 

concerns 

consideration;  n 

prudenccin 

guardianships 

custody  ;n 

regard  ;n 

managements 

difnculty;n 

regret;n 

prudences 

diligcnce;n 

scrup!cs;n 

supervisions 

disasters 

solicitude;n 

attends 

discretions 

supervisions 

Preliminary  broad  groupings  can  be  saved  into  separate 
text  files.  These  files  can  be  further  analyzed  to  facilitate  the  refine- 
ment of  data  groups  into  thematic  relationships,  domain  categories 
or  matrices  building.  In  multiple  case  study  research,  within-site 
files  can  be  queried  to  develop  insights  into  cross-sites’  similarities 
and  differences. 


Qualitative  Research 
Studies  Using  Metamorph™ 

Metamorph™  is  currently  being  used  at  Kent  State  Univer- 
sity6 to  analyze  data  on  several  qualitative  research  projects. 
Metamorph™  was  first  purchased  by  the  Department  of  Special 
Education  and  used  to  assist  in  scanning  the  ERIC  CD-ROM  for 
articles  in  the  area  of  deaf  education. 

More  extensive  exploration  of  Metamorph’s™  possibilities 
included  analyzing  teachers'  journal  transcriptions  and  researchers’ 
observational  notes  for  the  Lighthouse  Educational  Enhancement 
Project.  This  IBM  partnership  grant  involves  Kent  State  University 
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Figure  2 

Sample  oj  Two  Hits  Based  on  the  Intersection  of  the 
Search  Words  “Problem"  and  “Care!' 

File:  command.log 

Quit,  <CR>  - Next,  Last,  exit  Context,  Top,  Bottom^  Editor,  Hot  func,  Spit,  Make 
— Fwd,  Rev,  Point,  Goto  Hit  PgDn:  F,  PgUp:  B 

Date:  4/19/91 

The  major  activity  of  today  involved  passing  out  and  collecting  Health  and 
Physics  tests.  Everyone  cooperated  very  well,  and  w'e  got  everything  taken  care 
of.  We  are  having  some  probfems  with  people  not  returning  books,  pens,  pen- 
cils,  white  out,  tape,  scissors,  etc.  Everything  else  is  running  smoothly.  We  faxed 
in  the  band  documentarions  of  who  practiced  when.  That's  about  it! 

~ < Z:help  > — < ESC:  prev  menu  > — < R:top  menu  > 

<care  problem 


File:  medical.log 

Quit,  <CR>  - Next,  Last,  exit  Context,  Top,  Bottom^ Editor,  Hot  func,  Spit,  Make 

— Fwd,  Rev,  Point,  Goto  Hit PgDn:  F,  PgUp:  B 

Apparently,  he  was  trying  to  get  work  done,  but  when  we  found  him,  he  was  sup- 
posed  to  be  sleeping.  An  Education  Specialist  tried  to  ask  him  a question,  but  he  was 
unresponsive  and  shivering  violently.  He  immediately  carried  him  to  the  male  medical 
quarters  where  we  began  questioning.  It  was  difficult  for  him  to  answer  questions. 

He  either  could  not  speak  or  had  difficulty  comprehending  what  we  were  saying.  He 
had  not  slept  more  than  four  hours  the  entire  simulation  while  he  was  scheduled  for 
sixteen  so 

- < Z;help  > — < ESC:  prev  menu  > < R:top  menu  > 

<care  problem 


and  three  surrounding  school  districts  working  together  to  restruc- 
ture  math  education,  supported  by  the  use  of  technology. 

The  success  of  Metamorph™  as  a qualitative  research  tool 
has  been  shared  with  several  research  classes  at  Kent  State  Uni- 
versity. As  a result,  one  master  degree  student  and  three  doctoral 
students  have  begun  working  with  Metamorph™  to  assist  them 
with  their  research  projects  and/or  dissertations. 


The  most  significant  breakthrough  with  Metamorph™  as  a 
qualitative  research  tool  has  happened  most  recently.  An  elaborate 
partnership  grant  currently  in  progress  at  Kent  State  University, 
entitled  Cooperative  Alliance  for  Gifted  Education  (CAGE), 
involves  as  many  as  15  different  educational,  community  and 
business  agencies  committed  to  restructuring  education.  In  order 
to  determine  the  effectiveness  of  their  project,  they  are  accumu- 
lating vast  quantities  of  unstructured,  text-based  data  in  the  form 
of  observations,  interviews,  journals,  and  videotape.  A team  of 
researchers  has  begun  to  categorize  this  data  with  the  help 
of  Metamorph™ . 

As  the  CAGE  team  members  work  with  Metamorph™ 
they  have  been  identifying  their  research  needs.  Ways  to  adapt 
and  strengthen  Metamorph™  have  been  determined.  For  instance, 
the  researchers  identified  a need  to  attach  personal  notes  to  the 
electronic  text.  They  also  wanted  to  identify  portions  of  text  by 
category  and  later  sort  this  information  into  manageable  files. 
The  beta  version  of  this  adaptation  of  Metamorph™  is  currently 
being  tested. 

Metamorph™  is  proving  to  be  the  type  of  computer  tool 
that  can  benefit  qualitative  research.  It  is  the  researcher  that  drives 
Metamorph™  through  every  step  in  the  data  refinement  process 
The  researcher  decides  what  to  keep  and  what  to  get  rid  of.  The 
researcher  determines  the  categories  and  domains.  At  all  points 
in  the  process  it  is  the  researcher  who  must  extract  meaning  from 
his/her  data.  Metamorph’s™  greatest  contribution  to  qualitative 
research  is  its  ability  (a)  to  actively  involve  the  researcher  in  natural 
language  querying,  and  (b)  to  speed  up  the  process  of  dealing  with 
large  amounts  of  unstructured  information. 

Computer  technology  has  lifted  some  of  the  burden  off 
the  data  intensive  tasks  involved  in  qualitative  research.  Having 
the  researcher  immersed  in  the  software  design  process  is  critical 
to  the  evolution  of  this  type  of  technology.  In  so  doing  the  tech- 
nology will  be  adapted  to  the  research  process  and  not  vice  versa. 


Appendix  A 


The  software  programs  mentioned  in  this  article  fall  into 
two  broad  categories,  intcrprctive/descriptivc  programs  and  theory 
building  analysis  programs  (Tesch,  1990). 

Interpretive/Descriptive  Theory  Building  Analysis 


Specific  information,  demonstration  disks,  and  consultation 
can  be  obtained  for:  Aquad™,  The  Ethnograph™,  HypcrQual™, 
HyperResearch™,  NUDIST™,  Qualpro™,  and  Textbase  Alpha ™ by 
writing  or  calling  Qualitative  Research  Management,  73-425  Hilltop 
Road,  Desert  Hot  Springs,  CA  92240,  phone:  (619)  329-7026. 


The  Ethonograph™  (MS  Dos) 
Qual  Pro™  (MS  Dos) 

Textbase  Alpha™  (MS  Dos) 
HypcrQual™  (Macintosh) 
Ethno™  (MS  Dos) 

Hypersoft™  (Macintosh) 
MECA™  (MS  Dos) 

Qualog™  (Mainframe) 

TAP™  (MS  Dos) 


Aquad™  (MS  Dos) 
HyperResearch™  (Macintosh) 
NUDIST*  (Macintosh) 


BEST  COPY  AVAILABLE 


Addresses  for  Specific  Programs: 

Aquad™:  Qualitative  Research  Management,  73-425  Hilltop  Road, 
Desert  Hot  Springs,  CA  92240,  USA. 

Ethno™:  National  Collegiate  Software  of  Duke  University  Press, 
6697  College  Station,  Durham,  NC  27708,  USA. 

The  Ethnograph™:  Qualitative  Research  Associates,  P.O.  Box  2240, 
Corvallis,  OR  97  H9,  USA. 

(commut'd  on  pugt’  34) 
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HyperResearch™:  Researchware  Inc.,  20  Soren  Street,  Randolph, 
MA  02368,  USA. 

Hypersoft™:  Ian  Dey,  45  Colinton  Road,  Edinburgh,  EH  10  SEN,  UK. 

MECA™:  Dr.  Kathleen  Carley,  Department  of  Social  and  Decision 
Science,  Carnegie  Mellon  University,  Pittsburgh,  PA  15213,  USA. 

NUDIST*  NUDIST  Project,  ACRI,  LaTrobe  University,  Bundoora, 
VIC  3083. 

Qualog™:  Ernest  Sibert  and  Anne  Shelly,  Syracuse  University, 
4416  CST,  School  of  Computer  and  Information  Science, 
Syracuse,  NY  13244,  USA. 

Qualpro™:  Qualitative  Research  Management,  73-425  Hilltop  Road, 
Desert  Hot  Springs,  CA  92240,  USA. 


TAP™:  Dr.  Kriss  A.  Drass,  Department  of  Sociology,  Southern 
Methodist  University,  Dallas,  TX  75275,  USA. 

Textbase  Alph™:  Qualitative  Research  Management,  73-425  Hilltop 
Road,  Desert  Hot  Springs,  CA  92240,  USA. 

Articles  and/or  chapters  concerning  software  designed  for 
qualitative  research  can  be  found  in: 

Fielding,  N.  G.,  Sc  Lee,  R.  M.  (Eds.).  (1991).  Using  computers  in  quali- 
tative research.  Newbury  Park,  CA:  Sage  Publications,  Inc. 

Tesch,  R.  (1990).  Qualitative  research:  Analysis  types  and  software  tools. 
Bristol,  PA:  Falmer  Press. 

Tesch,  R.  (Ed.).  (1991).  Special  Issue  of  Qualitative  Sociology.  14 
(3  and  4). 
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2 Qualrs-L,  to  join  this  discussion  group  via  Bitnet  issue  the  follow- 
ing command  at  the  VM/CMS  prompt:  TELL  LISTSERV 
AT  UGA  SLIB  QUALRS-L  (your  full  name).  From  a Vax  (you 
must  be  at  the  MAIL  prompt)  issue  the  SEND  command.  To: 
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6 For  information  on  Metamorph™  projects  at  Kent  State  Uni- 
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Performance  Assessment 

By  David  Sweet,  U.S.  Department  of  Education 


Performance  assessment,  also  known  as  alternative  or 
authentic  assessment,  is  a form  of  testing  that  requires  students 
to  perform  a task  rather  than  select  an  answer  from  a ready-made 
list.  For  example,  a student  may  be  asked  to  explain  historical 
events,  generate  scientific  hypotheses,  solve  math  problems,  con- 
verse in  a foreign  language,  or  conduct  research  on  an  assigned 
topic.  Experienced  raters— either  teachers  or  other  trained  staff- 
then  judge  the  quality  of  the  student’s  work  based  on  an  agreed- 
upon  set  of  criteria.  This  new  form  of  assessment  is  most  widely 
used  to  directly  assess  writing  ability  based  on  text  produced  by 
students  under  test  instructions. 

How  Does  It  Work? 

Following  are  some  methods  that  have  been  used  success- 
fully to  assess  performance: 

• Open-ended  or  extended  response  exercises  are  questions 
or  other  prompts  that  require  students  to  explore  a topic  orally 
or  in  writing.  Students  might  be  asked  to  describe  their  observa- 
tions from  a science  experiment,  or  present  arguments  a historic 
character  would  make  concerning  a particular  proposition.  For 
example,  what  would  Abraham  Lincoln  argue  about  the  causes 
of  the  Civil  War? 

• Extended  tasks  are  assignments  that  require  sustained 
attention  in  a single  work  area  and  are  carried  out  over  several 
hours  or  longer.  Such  tasks  could  include  drafting,  reviewing, 
and  revising  a poem;  conducting  and  explaining  the  results  of  a 
science  experiment  on  photosyntheses;  or  even  painting  a car 
in  auto  shop. 

• Portfolios  are  selected  collections  of  a variety  of  perform- 
ance-based work.  A portfolio  might  include  a student’s  “best  pieces” 
and  the  student’s  evaluation  of  the  strengths  and  weaknesses  of 
several  pieces.  The  portfolio  may  also  contain  some  “works  in 
progress”  that  illustrate  the  improvements  the  student  has  made 
over  time. 

These  methods,  like  all  types  of  performance  assessments, 
require  that  students  actively  develop  their  approaches  to  the 
task  under  defined  conditions,  knowing  that  their  work  will  be 
evaluated  according  to  agreed-upon  standards.  This  requirement 
distinguishes  performance  assessment  from  other  forms  of  testing. 

Why  Try  It? 

Because  they  require  students  to  actively  demonsrnate  what 
they  know,  performance  assessments  may  be  a mom  valid  indicator 
of  students*  knowledge  and  abilities.  There  is  a big  difference 


between  answering  multiple  choice  questions  on  how  to  make 
an  oral  presentation  and  actually  making  an  oral  presentation. 

More  important,  performance  assessment  can  provide 
impetus  for  improving  instruction,  and  increase  students’  under- 
standing of  what  they  need  to  know'  and  be  able  to  do.  In  pre- 
paring their  students  to  work  on  a performance  task,  teachers 
describe  what  the  task  entails  and  the  standards  that  will  be  used 
to  evaluate  performance.  This  requires  a careful  description  of  the 
elements  of  good  performance,  and  allows  students  to  judge  their 
ow'n  work  as  they  proceed. 

What  Does  the  Research  Say? 

Active  /earning.  Research  suggests  that  learning  how  and 
w'here  information  can  be  applied  should  be  a central  part  of  all 
curricular  areas.  Also,  students  exhibit  greater  interest  and  levels 
of  learning  when  they  are  required  to  organize  facts  around  major 
concepts  and  actively  construct  their  owrn  understanding  of  the 
concepts  in  a rich  variety  of  contexts.  Performance  assessment 
requires  students  to  structure  and  apply  information,  and  thereby 
helps  to  engage  students  in  this  type  of  learning. 

Curricidum'based  testing.  Performance  assessments  should 
be  based  on  the  curriculum  rather  than  constructed  by  someone 
unfamiliar  with  the  particular  state,  district  or  school  curriculum. 
This  allows  the  curriculum  to  “drive”  the  test,  rather  than  be 
encumbered  by  testing  requirements  that  disrupt  instruction,  as 
is  often  the  case.  Research  shows  that  most  teachers  shape  their 
teaching  in  a variety  of  ways  to  meet  the  requirements  of  tests.  Pri- 
marily because  of  this  impact  of  testing  on  instruction,  many  prac- 
titioners favor  test  reform  and  the  new'  performance  assessments. 

Worthwhile  tasks.  Performance  tasks  should  be  “worth 
teaching  to”;  that  is,  the  tasks  need  to  present  interesting  possi- 
bilities for  applying  an  array  of  curriculum-related  knowledge 
and  skills. 

The  best  performance  tasks  are  inherently  instructional, 
actively  engaging  students  in  w'orthw'hile  learning  activities.  Stu- 
dents may  be  encouraged  by  them  to  search  out  additional  infor- 
mation or  try  different  approaches,  and  in  some  situations,  to 
work  in  teams. 

What  Does  It  Cost? 

These  positive  features  of  performance  assessment  come 
at  a price.  Performance  assessment  requires  a greater  expense  of 
time,  planning  and  thought  from  students  and  teachers.  One 
teacher  reports,  “We  cant  just  march  through  the  curriculum 
anymore.  It’s  hard.  1 spend  more  time  planning  and  more  time 

(continued  on  fuge  .36) 
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Performance  Assessment  (continued) 


coaching.  At  first,  my  students  just  wanted  to  be  told  what  to 
do.  I had  to  help  them  to  start  thinking.” 

Users  also  need  to  pay  close  attention  to  technical  and 
equity  issues  to  ensure  that  the  assessments  are  fair  to  all  students. 
This  is  all  the  more  important  as  there  has  been  very  little  research 
and  development  on  performance  assessment  in  the  environment 
of  a high  stakes  accountability  system,  where  administrative  and 
resource  decisions  are  affected  by  measures  of  student  performance. 

What  are  Examples  of 
Successful  Strategies  and  Programs? 

• Charlotte  Haguchi  is  a third'  and  fourth-grade  teacher 
at  Farmdale  Elementary  School  in  Los  Angeles.  Regarding  assess- 
ment  and  instruction  as  inseparable  aspects  of  teaching,  Ms. 
Haguchi  uses  a wide  array  of  assessment  strategies  to  determine 
how  well  her  students  are  doing  and  to  make  instructional  deci- 
sions. She  uses  systematic  rating  procedures,  keep  records  of 
student  performances  on  tasks,  and  actively  involves  students 
in  keeping  journals  and  evaluating  their  own  work.  Ms.  Haguchi 
can  be  seen  in  action  along  with  other  experts  and  practitioners 
in  the  videotape  Alternatives  for  Measuring  Performance  by  NCREL 
and  CRESST  (See  Jen  Nowakowski  and  Ron  Dietel,  below). 

• William  Symons  is  the  superintendent  of  Alcoa  City 
Schools  in  Alcoa,  Tennessee.  Seeking  higher,  more  meaningful 
student  standards  through  curriculum  reform,  Dr.  Symons  works 
with  school  staff  and  the  community  to  create  a new  curriculum 
focused  on  standards  and  an  assessment  linked  to  the  curriculum. 
Comments  and  advice  from  Dr.  Symons  and  other  practitioners 
and  experts  are  available  on  the  audiotape  Conversations  about 
Authentic  Assessment  by  Appalachia  Educational  Laboratory.  (See 
Helen  Saunders,  below.) 

• Ross  Brewer  is  the  director  of  planning  and  policy  develop- 
ment in  the  Vermont  Department  of  Education.  Vermont  is 
assessing  fourth-  ancLeighth -grade  students  in  writing  and  mathe- 
matics using  three  methods;  a portfolio,  a “best  piece”  from  the 
portfolio,  and  a set  of  performance  tasks.  Other  states  that  have 
been  very  active  in  developing  and  implementing  performance 
assessments  include:  California,  Arizona,  Maryland,  New 
York,  Connecticut,  and  Kentucky.  (See  Ed  Roeber  and  state 
officers,  below.) 


Where  Can  I Get  More  Information? 

W.  Ross  Brewer,  Planning  and  Policy  Department,  Vermont 
Department  of  Education,  Montpelier,  VT  05602,  (802)  828-3135. 

Don  Chambers,  National  Center  for  Research  in  Mathe- 
matical Sciences  Education,  University  of  Wisconsin  at  Madison, 
1025  West  Johnson  Street,  Madison,  Wl  53706,  (608)  263-4285. 

Ron  Dietel,  National  Center  for  Research  on  Evalua- 
tion, Standards,  and  Student  Testing  (CRESST)/ UCLA,  145 
Moore  Hall,  405  Hilgard  Avenue,  Los  Angeles,  CA  00024-1522, 
(310)  206-1532. 

James  Gilchrist,  New  Standards  Project,  Learning,  Re- 
search, and  Development  Center,  3939  O’Hara  Street,  Pittsburgh, 
PA  15260,  (412)  624-8319. 

Kate  Maloy,  National  Research  Center  on  Student 
Learning/ LRDC,  3939  O’Hara  Street,  Pittsburgh,  PA  15260, 
(412)  624-7457. 

Joe  McDonald,  Coalition  of  Essential  Schools,  Brown 
University,  Box  1969,  Providence,  RI  02912,  (401)  863-3384. 

Jeri  Nowakowski,  North  Central  Regional  Educational 
Laboratory  (NCREL),  1900  Spring  Road,  Suite  300,  Oak  Brook, 
IL  60521,  (708)  571-4700. 

Edward  Reidy,  Office  of  Assessment  and  Accountability, 
Kentucky  Department  of  Education,  19th  Floor  Capital  Plaza 
Tower,  500  Mero  Street,  Frankfort,  KY  40601,  (502)  564-4394. 

Douglas  Rindone,  Division  of  Research,  Evaluation  and 
Assessment,  Connecticut  Department  of  Education,  Box  2219, 
Hartford,  CT  06145,  (203)  566-1684. 

Ed  Roeber,  Council  of  Chief  State  School  Officers,  1 Mas- 
sachusetts Avenue  NW,  Suite  700,  Washington,  DC  20001-1431, 
(202)  336-7045. 

Larry  Rudner,  ERIC  Clear inghouse/AIR,  3333  K Street 
NW,  Suite  300,  Washington,  DC  20007,  (202)  342-5060. 

Helen  Saunders,  Appalachia  Educational  Laboratory, 
1031  Quarrier  Street,  P.O.  Box  1348,  Charleston,  WV  25325, 
(304)  347-0400. 


This  article  was  published  courtesy  of  the 
Office  of  Educational  Research  and  Improvement;,  US.  Department  of  Education. 
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Voices  in  Education 


The  Mid'Westem  Educational  Researcher  asked  leaders  in 
education  to  respond  to  the  question: 

Do  you  support  the  practice  of  using  the 
results  of  standardized  achievement  tests  as  the  criteria 
for  student  promotion  to  the  next  grade  level? 

Why?  If  yes,  at  what  grade  level(s)? 

No.  Never.  Students  shorn^.  ' "ays  be  promoted,  but 
never  awarded  degrees  if  they  haven’t  the  competencies 

implied  by  the  degree.  _David  Berliner,  Arizona  State  University 

Standardized  reading  tests  have  many  purposes  including 
suggestions  for  instruction.  Although  most  intermediate  schools 
classify  students  by  grades,  there  are  great  variations  in  the  levels 
at  which  students  function  by  grade  and  within  grades.  Promoting 
or  retaining  students  in  a grade  is  usually  a serious  matter  that 
should  be  based  on  many  criteria— student  functioning,  whether 
the  students’  needs  will  be  better  met  in  the  next  higher  grade 
or  not,  and  how  the  student  feels  about  promotion  or  non-promo- 
tion. A test  score  is  only  one  of  the  criteria  in  the  decision. 

—Jeanne  Chall,  Harvard  University 

No.  The  “promotion  decision”  is  actually  much  more  fre- 
quently a “retention  decision”  that  should  be  approached  with 
broad  clinical  sensitivity  by  teachers,  parents,  administrators,  and 
the  students  themselves,  lest  performance  is  one  potentially  useful 
input  into  this  important  decision,  but  is,  by  itself,  insufficient. 

—Christopher  Clark,  Michigan  State  University 

No,  1 would  not.  1 would  not  advocate  using  any  one 
indicator  of  performance  for  promotion,  but  rather  a “performance 
profile”  which  would  include  standardized  test  scores,  beginning 
as  early  as  students  take  these  tests. 

—Lyn  Como,  Teachers  College  Columbia  University 

No.  All  the  emphasis  on  standardized  testing  is  a way  to 
avoid  facing  up  to  the  real  problems  that  exist  in  our  schools.  It 
is  perfectly  clear  that  tests  don’t  facilitate  learning.  If  we  use  stand- 
ardized tests  as  the  basis  for  promotion  to  the  next  grade,  what 
we  will  accomplish  is  focusing  people’s  attention  on  how  to  pass 

standardized  tests.  — Edward  Deci,  University  of  Rochester 

No.  The  grade  level  is  a myth;  there  is  no  such  thing.  The 
effort  to  measure  grade  levels  by  means  of  standardized  achieve- 
ment tests  merely  mystifies  the  myth. 

—John  Goodlad , University  of  Washington 

Not  the  only  criteria.  Too  many  students  are  poorly 
served.  I hope  portfolios  can  be  used  to  supplement  the  stand- 

a iz  tests.  _ Maxine  Greene,  Teachers  College  Columbia  University 
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If  you  mean  "the”,  criterion,  my  answer  is  that  I do  not 
support  such  use.  My  reasons  are  rooted  in  beliefs  about  test  fair- 
ness and  other  sociopolitical  perspectives,  but  they  are  also  strongly 
supported  by  my  understanding  of  the  narrow  range  of  most 
tests,  and  the  minimal  intellectual  requirements  they  call  forth. 
Also,  I hold  the  view  that  the  local  school  context,  with  particular 
emphasis  on  its  curriculum,  is  seldom  matched  by  standardized 

test  items.  —Gary  Griffin,  University  of  Arizona 


No.  I do  not.  No  single  test,  given  at  any  single  time  and 
divorced  from  consideration  of  contextual  factors,  should  be  used 
as  the  sole  criterion  for  making  such  important  decisions  about 
a child’s  educational  program. 

—Thomas  Guskey,  University  of  Kentucky 

Under  optimal  assessment  circumstances,  that  is,  when 
criterion-referenced  tests  measuring  truly  worthwhile  outcomes 
are  employed,  there  may  be  merit  in  using  students’  test  results 
as  promotion  criteria.  Typically,  the  assessment  circumstances 

aren  t optimal.  _j W.  James  Popham,  IO!X  Assessment  Associates 

I do  not  support  the  practice  of  using  the  results  of  stand- 
ardized achievement  tests  as  the  criterion  for  student  promotion. 
First,  research  thus  far  has  not  shown  failure  to  promote  a student 
as  an  effective  teaching  strategy.  Second,  achievement  tests  should 
be  carefully  aligned  to  instruction;  currently  our  nonstandardized 
curriculum  varies  in  a way  ^ .at  prevents  alignment  by  a single 

standardized  test.  —Andrew  Porter \ University  of  Wisconsin-hAadison 

Yes,  but  beginning  in  sixth  grade.  Standardized  achieve- 
ment tests  have  the  potential  of  tightening  up  what  is  currently 
a relaxed  educational  system  in  elementary  and  secondary 
schools  and  causing  us  finally  to  ponder  seriously  “what  is  most 

worth  knowing.  — Kevin  Ryan,  Boston  University 

No  The  use  of  only  standardized  achievement  tests  as  the 
criteria  for  student  promotion  promotes  a misconception  of  pro- 
viding an  equal  opportunity  for  all  students  to  succeed  academi- 
cally. Utilizing  portfolio  assessment  for  promotion  is  the  key  element 
if  we  want  all  students  to  have  a chance  to  succeed. 

—Jane  Stallings,  Texas  A<$?M  University 

No.  Standardized  achievement  tests  attempt  to  assess  only 
a small  part  of  what  children  need  to  learn.  The  school  needs 
to  develop  a plan  for  the  student  to  have  opportunity  for  con- 
tinuous progress  in  his  learning,  rather  than  a rigid  organization 


of  the  curriculum. 


—Ralph  Tyler,  Center  for  Advanced 
Study  in  Behavioral  Sciences 


In  a well-designed  and  implemented  system,  yes— for  all 
grade  levels.  — Herbert  Walbcrg,  University  of  Ulmois-Chicago 
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In  Conclusion: 

Praise  for  American  Public  Education 

By  David  C.  Berliner,  Arizona  State  University 


Abstract 

Data  which  suggest  the  failure  of  America's  schools  to  educate  its  youth  do  not  survive  careful  scrutiny.  School  reforms  based 
on  these  questionable  data  are  wrongheaded  and  potentially  destructive  to  quality  education.  Reforms  of  the  kind  proposed  by  those 
who  have  started  from  an  assumption  that  America's  schools  have  failed  will  exacerbate  the  differences  between  the  “have”  and  the 
“have-not”  school  districts. 


It  is  not  difficult  to  understand  why  so  many  people  are 
concerned  about  schooling  and  youth.  One  only  has  to  read 
newspaper  headlines  and  summaries  to  learn  why  people  think 
so  poorly  of  the  system  that  attends  to  the  care  of  the  next  genera- 
tion. For  example,  these  stories  were  culled  from  the  media: 

• In  a typical  year  during  the  1980s,  minors  aged  fourteen 
to  nineteen  accounted  for  43.4  percent  of  all  criminal  offenders; 
54  percent  of  all  murder  ^ases  in  the  nation  involved  jobless  youth.1 

• High  school  girls  turn  to  prostitution  for  entertain- 
ment, curiosity,  and  as  a source  of  revenue— police  report  their 
rate  up  262  percent.2 

• At  a public  junior  high  school  a gang  of  six  students 
had  extorted  $2,500  from  about  120  classmates.3 

• A fourteen  year-old  student  who  was  repeatedly  tor- 
mented and  beaten  by  school  toughs  hangs  himself.4 

• Forty-four  high  school  students  go  wilding,  raid  five 
shops  for  merchandise.3 

• Teen  tortured  by  two  school  gang  members,  cigarettes 
used  to  burn  his  hands  and  back.6 

• Kids  report  feeling  refreshed  after  beating  up  on 
another  child." 

• Because  they  didn’t  like  a lecture  on  how  they  might 
lead  a better  life,  eight  junior  high  toughs  demanded  an  apology 
from  their  teacher.  He  refused,  so  they  hit  him,  kicked  him,  threw 
his  papers  all  around,  and  fought  with  ten  other  teachers  as  well. 
Finally  the  teacher  knelt  before  the  youths  and  apologized  to 
avoid  further  confusion.8 

• Ten  percent  of  the  nation’s  public  middle  schools  request 
police  guards  for  their  graduation  ceremonies.9 

Other  similar  stories  exist,  but  these  are  enough  to  make 
clear  the  awful,  brutal  world  of  youth  and  the  failure  of  public 
schooling.  This  is  an  old  story  by  now  in  the  United  States;  but 
what  you  may  not  have  anticipated  as  vou  read  these  clippings 
is  that  all  of  them  are  from  the  Japanese  press  describing  incidents 
in  Japanese  schools  (see  Notes  1-9). 

The  evidence  is  quite  clear  that  the  Japanese  public  school 
svstem  is  a brutal  and  an  enormous  failure  by  most  of  the  stand' 
ards  we  as  a nation  have  lor  sehcxiling,  saw  one,  achievement 
in  mathematics  and  science. 

Tlie  Japanese  system  is  one  m whiih: 


• Crude  forms  of  cheating  at  the  college  level  are  rampant 
because  there  usually  is  no  penalty  for  it. 

• Parents  pay  teachers  ‘thank  you’  money  for  giving  good 
grades  and  letters  of  recommendation  to  their  children. 

• A teacher  was  taunted  by  his  colleagues  for  being  too 
soft  on  students,  so  when  a student  on  a field  trip  used  a hair 
dryer— an  act  forbidden  by  the  school— that  teacher  beat  and 
kicked  the  student  to  death.  At  the  trial  the  defense  was  that 
everyone  at  the  school  expected  this  teacher  to  use  corporal 
punishment.  This  seemed  perfectly  reasonable  to  the  judge,  who 
was  quite  lenient  in  sentencing. 

I became  concerned  about  the  possibility  of  erroneous 
information  being  disseminated  by  officials  of  our  government 
when  this  same  Japanese  system  of  education  was  scrutinized  by 
a team  of  visiting  Americans,  whose  views  were  reported  in  the 
Japan  Times  (October  26,  1985)  under  the  headline:  “U.S.  Edu- 
cators Marvel  at  Japan’s  Schools.”  The  then  U.S.  Assistant  Secre- 
tary of  Education,  Chester  Finn,  a member  of  the  study  tour, 
said  of  the  Japanese: 

Thev’vc  demonstrated  that  you  can  have  a coherent  cur- 
riculum, high  standards,  good  discipline,  parental  sup- 
port, a professional  teaching  force  and  a well-run  school. 
They  have  shown  that  the  average  student  can  learn  a 
whole  lot  more.  (Washington  Post,  October  19,  1985) 

Herbert  Walbcrg,  a distinguished  educational  researcher, 
was  on  the  visiting  panel  and  concurred  with  Dr.  Finn  that  much 
in  the  Japanese  system  could  help  to  solve  the  problems  of  edu- 
cation in  the  United  States  stating,  “I  think  it’s  portable.  Gump- 
tion and  willpower,  that's  the  key  (Washington  Post,  Octo- 
ber 19,  1985).” 

Knowing  something  about  the  Japanese  system,  I asked 
myself.  Do  we  have  the  gumption  and  willpower  to  resist  turning 
our  schools  into  institutions  where  2h,000  junior  high  school 
students  and  4,000  elementary  sch<x4  students  refuse  to  go  to 
school  because  they  are  tormented  by  teachers  and  bullied  by 
students  and  where  47,000  ot  hers  miss  at  least  fifty  days  of  school- 
ing per  year  because  of  the  abuse  thev  must  face  at  h h<x4  (Chicago 
Tribune,  November  24,  1985).’  Whore  the  number  of  pleats  allowed 
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in  a girl’s  skirt  is  specified?  Where  students  with  curly  hair  are 
required  to  carry  certificates  attesting  that  their  hair  is  not  permed? 
Where  some  of  the  teachers  at  the  middle  school  kick  and  beat 
the  students  regularly,  in  full  view  of  other  teachers.  Where  a 
Tokyo  mother  questioned  the  school  system  for  allowing  teachers 
to  beat,  kick,  and  drag  her  son  around  the  school  yard  frequently 
over  a three-year  period,  at  times  hammering  his  head  against  a 
goal  post,  and  once  throwing  him  in  a garbage  dump  and  jump- 
ing on  him,  because  the  student  in  question  once  skipped  Sunday 
soccer  practice  to  go  fishing  with  a friend  (see  Schoolland,  1990, 
for  additional  examples  and  documentation). 

I am  pleased  that  there  are  no  student  offenses  in  the 
United  States  for  which  such  cruelty  on  the  part  of  teachers 
would  be  tolerated.  But  in  Japan,  over-regulation  and  harsh  treat- 
ment of  students  is  common.  We  certainly  need  “willpower  and 
gumption”  alright,  but  it  is  to  resist  a system  that  is  at  odds  with 
our  cultures  humane  and  enlightened  views  of  childhood  and 
schooling.  We  certainly  need  the  gumption  and  willpower  to 
resist  importing  a system  that  has  been  recognized  as  a failure 
in  Japan,  according  to  their  own  prime  minister  and  his  council 
of  advisors,  who  have  said,  “Bullying,  suicides  among  school  chil- 
dren, dropping  out  from  school,  increasing  delinquency,  violence 
both  at  home  and  at  school,  heated  entrance  exam  races,  over- 
emphasis on  scholastic  ratings,  and  torture  of  children  by  some 
teachers  are  the  result  of  the  pathological  mechanisms  that  have 
become  established  in  Japan  s educational  system.”  ( Japan  Times, 
April  2*1,  19S6). 

I have  a hundred  criticisms  of  our  school  system  and  my 
list  grows  daily.  I hope  that  we  can  improve  our  svstem,  since 
public  education  in  a vibrant  dynamic  democracy  should  never 
be  considered  finished.  But  reforms  should  be  based  on  facts 
about  the  system  and  input  from  its  practitioners.  Reforms  pro- 
posed by  politicians,  business  leaders  or  other  citizens  should  not 
be  undertaken  without  reliable  evidence  or  credible  stories  of 
experience  to  back  them  up.  I was  concerned  that  if  so  much 
nonsense  could  be  spoken  and  written  in  the  United  States  about 
the  glories  of  the  Japanese  educational  system,  perhaps  informa- 
tion being  disseminated  about  the  American  system  was  also 
fa  be.  I began,  therefore,  to  examine  the  validitv  of  the  criticisms 
made  about  our  educational  system. 

Perhaps  the  criticisms  are  onlv  partially  true.  Perhaps  our 
public  education  is  failing  certain  students  and  their  families,  but 
not  others,  and  perhaps  it  is  not  even  failing  most  of  the  students 
in  the  public  schools.  Perhaps  Americans  haw  been  lied  to,  be- 
i uise  when  nations  have  economic  difficulties  or  go  through 
social  change,  their  leaders  look  for  scapegoats,  and  the  American 
schixM  swem  is  a lundv  one.  Perhaps  we  are  changing  im<>  a 
plutocracy,  where  a wealthv  elite  chooses  not  to  use  the  public 
schools  and  participates  in  undermining  confidence  in  that  system 
>o  as  to  promote  the  i one  option  of  schooling  as  a commodity, 
to  be  bought  like  meduine,  to  he  regarded  as  a privilege  rather 
than  a right  of  everv  American.  Perhaps  we  arc  in  a peculiarly 
American  cvclo,  where  every  generation  or  so  we  like  to  plav 
“kick -the  n acher.” 


In  two  articles  I have  specifically  identified  numerous 
examples  of  mis-interpretation  and  mis-information  published 
about  American  public  education  (Berliner,  1993a,  1993b).  What 
I found  was  a pattern  of  questionable  facts  and  selective  atten- 
tion to  detail. 

The  Children  and  Parents 
Served  by  the  Public  Schools 

It  was  not  difficult  for  me  to  find  respectable  data  suggest- 
ing that  the  basic  premises  underlying  contemporary  thinking 
about  school  reform  in  the  nation,  are  faulty.  It  is  not  that  the 
lesults  I have  found  are  “true,”  while  the  arguments  of  others  are 
“false.”  And  it  is  not  that  I am  a defender  of  the  status  quo,  for 
I am  not.  It  is  simply  that  there  are  numerous  lines  of  evidence 
suggesting  that  the  American  public  school  system  is  not  a failure. 

I have  seen  that  the  charge  suggesting  that  contemporary 
youth  are  not  as  smart  as  they  used  to  be  is  debatable.  They  may, 
in  fact,  be  smarter  than  they  have  ever  been,  at  least  as  measured 
by  the  most  well-respected  intelligence  tests  that  we  have  (Flynn, 
1987)  and  by  student  performance  in  advanced  placement  courses 
and  on  the  GRE  (Carson,  Huelskamp,  <Sc  Woodall,  1991).  School- 
ing seems  to  have  made  these  achievements  possible.  On  standard- 
ized tests,  whether  we  use  the  SATs,  the  N AEP  examinations,  the 
Iowa  Tests  of  Basic  Skills,  the  California  Achievement  Test,  the 
specially  designed  social  studies  tests  of  Drs.  Ravitch  and  Finn, 
or  many  other  standardized  tests,  we  can  find  more  evidence  for 
increased  achievement  over  time,  or  evidence  for  maintenance 
of  achievement,  than  we  can  for  a decline  in  achievement  (Carson, 
Huelskamp,  Sc  Woodall,  1991;  Linn,  Graue,  Sc  Sanders,  1990). 
Educators  should  be  given  presidential  citations  for  this  accom- 
plishment, since  their  success  took  place  during  the  time  period 
when  the  problems  of  the  young  people  served  by  the  public 
schools  have  become  more  difficult  for  the  schools  to  solve. 

The  National  Commission  on  Children  (1991),  chaired  by 
Senator  Rockefeller,  makes  this  abunda  it!y  clear.  For  example, 
in  TO,  12  percent  of  our  youth  lived  in  one  parent  households. 
By  1989  that  rate  had  more  than  doubled,  to  25  percent.  Over 
17  million  children  under  the  age  of  thirteen  have  mothers  work- 
ing outside  the  home.  Over  eight  million  children  under  the 
age  of  18  currently  have  no  health  coverage.  Since  1980  no  prog- 
ress has  been  made  in  reducing  the  rate  of  low  birth-weight  babies, 
and  for  African-American  babies  that  rate  has  actuallv  risen. 
Public  school  teachers  must  nurture  children  whose  families  arc 
poor,  ill,  and  stressed.  And  the  longer  they  remain  in  that  state, 
the  less  hope  those  children  have  of  it  ever  being  different  Accord- 
ing to  federal  definitions  about  1 5 million  youngsters  live  in  poverty, 
two  million  more  than  just  a decade  ago.  Five  million  of  those 
children  live  in  families  with  incomes  half  the  amount  the  govern- 
ment sets  as  the  jxwerty  level.  From  1978  to  1989  educators  have 
been  dealing  with  the  emotional  lives  of  children  whose  age  group 
has  seen  a 259  percent  increase  in  child  abuse  and  neglect.  In 
the  early  1980s  we  had  275,000  youngsters  in  foster  homes,  by 
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1995  we  will  have  550,000  in  foster  homes.  The  government  in- 
forms us  that  our  nation  has  up  to  100,000  children  under  16 
who  are  actually  homeless  every  night,  and  as  many  as  one  mil- 
lion adolescents  each  year  who  are  throwaways  or  runaways,  living 
on  the  streets,  in  cars  or  with  friends  (Foscarinis,  1991).  Regard- 
less of  the  nature  or  the  severity  of  the  problem,  it  is  the  public 
educational  system  that  is  called  on  to  work  with  these  children. 

Educators  worked  with  teenagers  that,  as  a group,  were 
100  percent  more  likely  to  be  murdered  in  1989  than  they  were 
in  1965.  Educators  work  today  with  African-American  teenagers 
that  are  more  likely  to  die  of  gunshot  wounds  than  from  all 
natural  causes  of  death  combined.  From  the  1960s  to  the  1970s, 
mostly  among  white  adolescents,  educators  saw  the  suicide  rate 
double,  and  then  rise  another  30  percent  bv  the  1980s.  While 
our  black  youth  are  getting  shot  at  record  levels,  our  white  youth 
are  killing  themselves  off  at  record  levels. 

During  this  time  period  the  public  schools  of  our  nation 
seem  to  have  maintained  or  increased  their  productivity.  I wish 
industry  were  nearly  as  productive,  adaptive  and  cost  efficient. 
For  rhe  nation  does  not  spend  nearly  enough  on  pre-primary, 
primary  and  secondary  education  as  it  professes  to,  and  we  have 
learned  also  that  money  spent  for  instructional  purposes  has 
direct  effects  on  student  achievement  (Rasell  <Sc  Mishcl,  1990). 
This  high  achieving,  productive,  comparatively  cheap  system  of 
education  is  producing  all  the  technically  able  workers  we  need, 
and  it  has  done  so  for  years  (Carson,  Heulskamp,  <St  Woodall, 
1991).  Our  work  force,  though  not  our  business  leaders,  seem  to 
be  among  the  most  skilled  in  the  world.  And  in  the  international 
comparisons  of  school  achievement  we  have  learned  the  remark- 
able fact  that  school  children  learn  what  schools  choose  to  teach 
them,  and  that,  conversely,  they  do  not  learn  what  schools  do 
not  teach.  National  systems  of  education  have  schools  and  curricula 
that  reflect  their  visions  of  childhood  and  achievement.  Compara- 
tive assessments,  if  thev  are  any  good,  will  show  those  national 
differences  more  clearly.  On  the  other  hand,  we  learn  absolutely 
nothing  that  is  not  simple  to  predict  when  there  is  inadequate 
samplirg,  lack  of  control  over  the  time  spent  preparing  for  the 
assessment,  differences  in  opportunity  to  learn,  and  difference* 
in  motivation  (for  a discussion  of  this  see  Berliner,  199 Li). 

This  American  system  of  ours  has  performed  so  well  that 
the  majority  of  parents  with  students  in  public  schools  have  been 
very  satisfied  with  their  children’s  teachers.  Parents  throughout 
the  nation  have  been  saying  to  the  poll  takers  for  fifty  years  that 
their  local  schools  are  prettv  darn  good.  In  one  recent  example 
of  this,  a nationallv  representative  group  of  parents  were  asked 
how  thev  rated  the  school  attended  bv  their  oldest  child  tEIam, 
1900).  A startling  72  percent  of  the  parents  awarded  that  school 
the  grade  of  A or  B.  Only  two  percent  of  the  parents  who  haw 
the  greatest  contact  with  the  public  si  bools  thought  the  school 
their  child  attended  deserved  a grade  of  F.  These  data  are  rela 
nvelv  unchanged  since  the  end  of  World  War  11. 

Reloiiu  pioposuls  hetoie  us  recommending  choice  in 
schooling  are  based  on  a belief  that  the  customer  i*  di*sit lMicd 
with  the  scluvls  and  that  the  schools  ate  failing  to  do  theii  job. 


I can  find  no  evidence  that  cither  is  true  when  we  look  at  the 
nation  as  a whole.  Why  then  would  so  much  be  made  of  choice? 
Perhaps  some  people  have  noted  that  the  public  expenditures 
for  education  are  large  and  it  would  be  nice  to  get  that  budget 
into  the  private  sector.  Then  education  could  be  treated  as  a 
privilege,  not  a right,  and  it  would  ensure  that  children  of  wealthier 
segments  of  our  population  will  inherit  their  positions.  This 
is  frightening. 

I find  it  ironic  that  Total  Quality  Management  (TQM), 
suggested  by  business  leaders  as  a cure  for  supposedly  ailing 
schools,  requires  constant  assessment  of  customer  satisfaction.  We 
educators  have  done  that  and  been  found  terrific  by  the  parents 
who  have  children  in  the  schools,  our  customers.  Those  who  see 
the  schools  as  a failure  usually  do  not  have  children  in  the  public 
schools.  For  example,  the  ever-critical  Dr.  Finn,  whose  daughter 
attended  Exeter,  says  that  the  ordinary  parents  of  the  nation  are 
not  to  be  trusted  with  their  opinions  (Kozol,  1991),  They  haven’t 
rigorous  enough  standards  to  make  these  kinds  of  judgments 
about  the  schools  (Finn,  1991).  People  who  find  the  general  public 
unable  to  make  intelligent  judgments  scare  me.  They  are  often 
part  of  a self-proclaimed  elite  that,  for  the  good  of  the  nation, 
will  be  pleased  to  tell  each  of  us  what  we  are  to  believe  and  how 
we  arc  to  act.  1 would  much  rather  put  my  faith  in  the  common 
people  of  the  country,  as  messy  as  that  can  sometimes  be. 

The  Critics 

At  least  some  of  the  criticism  of  the  schools  comes  from 
an  elite  that  is  against  public  schooling.  They  need  to  he  fought 
as  they  have  had  to  he  fought  from  the  beginning  of  the  crusade 
for  public  schooling  (Crcmin,  1989).  There  have  always  been 
those  who  never  could  believe  in  the  intelligence  of  the  common 
person,  or  thev  never  wanted  to  share  the  advantages  of  educa- 
tion with  common  people.  The  late,  wise  historian  of  education, 
Lawrence  Crcmin,  has  remarked  on  this  issue: 

...social  groups  possessing  a relatively  rare  and  highly 
valued  commodity  that  establishes  their  superiority  over 
other  social  groups  are  reluctant  to  sec  that  commodity 
more  widelv  distributed.  Wide  distribution  becomes  tan- 
tamount to  devaluation...  (Crcmin,  1989,  p.  11) 

Some  of  the  criticism  of  education,  however,  is  simple 
scapegoating.  It  is  no  longer  fashionable  m most  social  settings, 
and  in  the  mainstream  press,  to  blame  rhe  great  economic  and 
social  tragedies  ot  contemporarv  American  life  on  the  interna- 
tional Jewish  conspiracy,  or  on  the  lack  oi  motivation  or  talent 
of  African-American,  Polish-American  or  Mexii an- American 
workers.  The  grvcdv  union  bovo  and  the  wcliare  queen*  cannot 
be  blamed  anymore  *nuc  we  no  longer  have  strong  unions,  and 
the  amounts  spent  on  well  arc  arc  small  pc^rnroc*  compared  ro 
tlie  amounts  we  u*cd  io  bail  out  the  sivinc*  and  loan  companies. 
The  SibcL  robber \ ot  the  Amernan  people  was  jxrpct  rated  hv 
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nice,  middle-class,  well-educated,  religious  white  men  from  two- 
parent  households,  the  kind  of  Americans  who  wouldn’t  possibly 
want  to  hurt  their  nation.  But  blame  for  society’s  ills,  of  which 
there  seem  so  many,  needs  to  be  assigned  somewhere.  And  there 
was  one  ordinarily  passive,  relatively  dcfensless  group  available. 
From  1983  on,  this  nation  has  been  told  relentlessly  by  its  leaders 
that  we  are  a nation  at  risk  because  our  schools  and  our  teachers 
have  failed  us.  But  the  truth,  I think,  is  that  those  leaders  have 
failed  the  schools  and  the  teachers  of  America.  Rather  than  lead 
us  to  ruin,  the  vast  majority  of  teachers  have  run  a system  that 
is  remarkably  good  for  the  relatively  advantaged  children  of 
America.  The  teachers  in  the  schools  with  the  least  support, 
serving  children  who  need  the  most  help,  are  indeed,  having  a 
harder  time.  Those  schools  may  be  failing,  but  the  causes  for 
that  arc  usually  outside  the  school  building.  Those  causes  are 
embedded  in  the  social  inequities  prevalent  in  our  society. 

It  is  easy  to  use  the  schools  as  a scapegoat.  It  has  been 
a traditional  American  pastime.  For  example,  in  1909  the  Adamic 
Mont/iK  criticized  the  schools  for  (a)  not  teaching  enough  knowl- 
edge, (b)  not  teaching  thinking  skills,  and  (c)  not  preparing  young 
people  for  jobs.  These  laments  are  still  current  ninety  years  later 
and  seem  to  have  been  current  since  public  schooling  began  in 
the' United  States  of  America.  The  Ladies  Home  Journal  of  1912 
has  always  been  my  favorite.  There  Ella  Francis  Lynch  criticized 
the  schools  because  life  in  America  had  changed  and  the  schools 
had  not  changed  with  them,  another  old  criticism  still  current. 
That  vear  the  Journal  also  pointed  out  to  their  readers  that  the 
tests  and  the  grades  given  in  schools  were  ruining  our  nation, 
another  contemporary  theme. 

Let  us  jump  ahead  to  the  1946  Ladies  Home  Journal , 
where  it  was  reported  that  teachers  were  inadequately  trained 
to  meet  the  needs  of  the  baby  boomers;  where  poor  pay  was 
rampant;  where  there  were  discrepancies  in  schooling  based  upon 
geography,  income  and  class;  where  there  were  no  standards  any- 
more; and  where  indifference  to  the  schools  by  parents  was  ram- 
pant (this  discussion  is  adapted  from  Kent,  1987).  Time  magazine 
in  1949  charged  that  the  schools  were  failing  to  teach  traditional 
subject  matter  because  it  was  too  concerned  with  life  adjustment 
education.  The  year  1951  seemed  a particularly  good  year  for 
criticism  (Kent,  1987),  though  most  people  think  of  that  time 
period  as  among  those  halcyon  days  of  yore. 

In  1953,  we  saw  publication  of  Arthur  Bestors  Educationa1 
Wastelands:  The  Retreat  from  Learning  in  our  Public  Schools  and 
Albert  Lynd’s  best-selling  Qiwckerv  in  the  Public  Schools.  In  the 
late  1950s  we  saw  Hyman  Rickover  rip  the  schools,  for  they  were 
endangering  the  nation.  In  the  Saturday  Evening  Post  a captain 
of  a missile  site  reported  that  the  draftees  he  received  were  unable 
to  read,  write  or  do  simple  arithmetic,  and  that  he  was  getting  the 
best  of  the  recruits!  Life  magazine  of  1958  said  we  were  paying 
too  miu  h attention  to  “stupid  children”  and  not  enough  to 
the  gifted— that  we  simply  had  to  set  higher  standards.  Familiar 
laments,  all. 

And  the  business  community  v\as  in  on  the  criticisms 
then,  it  k rodnv  (see  Rippn.  1988).  While  lolebniiing  tht  first 


quarter  century  of  the  National  Association  of  Manufacturers 
(NAM),  the  treasurer  in  1920  was  applauded  vigorously  when 
he  said 

I live  in  a manufacturing  town — We  are  going  to  spend 
over  a million  dollars  for  a high  school  to  teach  the  chil- 
dren of  the  working  people  of  that  town . . . The  expendi- 
ture that  is  now  being  made  [for  the  public  school  system], 
and  the  laws  that  are  being  passed  for  its  expenditure  are 
as  absolutely  a waste  as  though  it  were  thrown  into  the 
gutter  (Rippa,  1988,  p.  142). 

In  1927  the  chairman  of  the  NAM  education  committee 
told  the  businessmen  of  the  Association  that 

Forty  percent  of  high  school  graduates  haven’t  a command 
of  simple  arithmetic,  cannot  multiply,  subtract,  and  divide 
correctly  in  simple  numbers  and  fractions.  Over  forty 
percent  of  them  cannot  accurately  e'xpress  themselves  in 
the  English  language  or  cannot  write  in  their  mother 
tongue  (Rippa,  1988,  p.  143), 

It  sounds  so  familiar.  And  this  was  when  only  a small 
elite  finished  high  school.  I wonder  how  the  nation  survived? 
Furthermore,  decades  before  the  lectures  about  Total  Quality 
Management  were  offered  to  the  schools  by  our  business  com- 
munity, a community  that  by  and  large  has  failed  to  keep  America 
economically  strong,  business  executives  also  felt  it  necessary  to 
lecture  educators.  The  spokesperson  for  the  National  Associa- 
tion of  Manufacturers  informed  the  schools  of  his  day  about  the 
marvels  of  management  in  that  day,  claiming  that  “the  public 
schools  should  be  systematized,  thoroughly,  comprehensively, 
and  with  the  sole  view  of  utmost  efficiency;  efficiency  in  every 
direction,  to  the  last  degree,  and  for  the  last  child”  (Rippa,  1988, 
p.  141).  It  should  he  clear  by  now  that  for  the  business  community 
and  the  general  citizenry  of  our  nation  the  games  of  kick-the- 
teacher  and  dump-on-the-schools  have  a long  history.  Along  with 
baseball,  it  seems  to  be  our  national  pastime. 


Conclusion 

So  what  shall  we  make  of  all  this?  The  data  suggesting 
the  'zross  failure  of  the  American  school  system  simply  does  not 
hold  up.  There  has  been  a campaign  of  disinformation.  As  Clark 
Kerr  noted  “seldom  in  the  course  of  policy  making  in  the  LIS. 
have  so  many  firm  convictions  held  by  so  many  been  based  on 
so  little  convincing  proof’  (Education  Week , 2/27/91).  A school 
reform  movement  based  on  so  many  invalid  assumptions  is  bound 
to  be  wrongheaded.  Some  of  the  school  reform  efforts  arc  thinly 
disguised  elitist  attempts  to  get  rid  of  public  education,  to  pro- 
tect the*  privilege  such  individuals  have  already  bestowed  on  their 
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children.  After  all,  the  greater  the  disparities  in  schooling,  the 
greater  the  assurance  that  the  privileged  have  someone  to  mow 
their  lawns,  to  wait  at  their  tables  and  care  for  their  children. 
The  reforms  they  offer— higher  standards,  a tougher  curriculum, 
more  tests,  with  no  increase  in  spending,  will  ensure  that  the 
children  of  New  Trier  High  School,  near  Chicago,  and  the  chib 
dren  of  Princeton,  New  Jersey,  and  the  children  of  Manhasset, 
New  York,  will  succeed  even  more  than  they  do  today.  The  chil- 
dren at  P.S.  79  in  the  Bronx,  New  York,  will  fail  at  even  greater 
rates  than  they  do  today.  Children  at  P.S.  79  and  similar  schools 
in  Los  Angeles,  California;  Camden,  New'  Jersey;  Detroit,  Michi- 
gan; and  San  Antonio,  Texas— schools  described  so  poignantly 
by  Jonathan  Kozol— do  not  have  textbooks  for  their  students, 
arc  forced  to  hold  some  of  their  classes  in  closets,  teach  word 
processing  skills  without  any  word  processors,  teach  science  with- 
out laboratories,  conduct  physical  education  and  an  classes  without 
proper  equipment.  These  arc  schools  that  cannot  regulate  heating 
or  cooling  or  keep  out  the  rain.  Their  teachers  are  often  those 
rejected  by  the  wealthier  suburbs,  and  large  percentages  of  their 
classes  are  taught  by  uncertified  people. 

Reforms  of  the  kind  being  proposed  will  exacerbate  the 
differences  between  the  have  and  the  have-not  school  districts. 
The  haves  are  already  doing  quite  well.  Those  children  of  privi- 
lege are  attending  decent  schools,  achieving  well,  scoring  well  on 
standardized  tests,  graduating  high  school,  and  going  to  college. 
They  are  the  smartest  and  healthiest  generation  America  has 
ever  produced.  There  really  is  not  much  to  reform  for  these  kids, 
since  their  schools  are  not  failing,  at  least  by  the  traditional  mea- 
sures we  use  to  assess  such  things.  On  the  other  hand,  I see  noth- 
ing in  America  2000,  and  the  new  schools  that  are  to  break- 
the-mold',  that  will  address  the  social  issues  causing  parts  of  our 
nations  school  system  to  be  in  ruin. 

Instead  of  President  Bush’s  goals  for  year  2000,  let  me 
suggest  some  that  address  the  real  failures  of  our  schools  more 
directly.  First,  let  us  agree  with  our  former  education  President 
that  all  children  should  come  to  school  ready  to  learn.  Let  us 
therefore  provide  high  quality  dav  care  and  preschool  to  all  Ameri- 
can children,  and  ensure  that  they  and  their  families  have  the 
finest  health  care  in  the  world.  This  is  how  we  can  ensure  that 
they  will  come  to  school  ready  to  profit. 

Second,  let  us  choose  to  have  safe  schools.  But  let  us  go 
on  to  guarantee  every  child  a school  where  plumbing  works, 
where  toilet  paper 'and  chalk  are  available,  where  heating  and 
cooling  systems  are  operational,  where  the  rain  does  not  run  into 
the  school  building,  and,  where  the  plaster  is  not  falling.  Let  us 
guarantee  each  child  access  to  current  textbooks,  computers,  and 
science  laboratories,  and  provide  children  who  are  eligible  the 
bilingual  education  to  which  they  are  legally  entitled.  Mavbe  we 
could  just  guarantee  that  everv  child  in  America  shall  have  a cor 
tified  teacher  who  knows  their  name  and  their  familv. 

Third,  by  the  year  2000  we  should  be  number  one  in 
the  world  in  the  percentage  of  18-vcar-olds  that  are  politic allv 
and  socially  involved.  Far  more  important  than  our  mathematics 
and  our  science  vims  is  the  involvement  o t the  next  generation 


in  maintaining  our  democracy  and  helping  those  within  it  that 
need  assistance— the  young,  the  ill,  the  old,  the  retarded,  the 
illiterate,  the  hungry  and  the  homeless.  Schools  that  cannot  turn 
out  politically  active  and  socially  helpful  citizens  should  be  iden- 
tified, and  their  rates  of  failure  announced  in  the  newspaper. 

Fourth,  by  the  year  2000  we  should  strive  to  make  the 
American  teacher  the  highest  paid  in  the  world.  Here  is  where 
we  should  emulate  the  Japanese.  We  should  pay  our  teachers 
what  they  pay  theirs.  This  would  mean  our  teachers  would  earn 
10  percent  more  than  whatever  the  top-level  civil  servant  earns 
in  the  service  of  government.  This  would  purchase  and  keep  the 
talent  needed  to  give  our  students  the  best  schooling  in  the  world. 

Fifth,  we  should  equalize  the  funding  of  schooling,  so 
that  schools  in  one  part  of  the  state  or  even  within  a district, 
cannot  spepd  twice  or  three  times  more  per-child  per-ycar  than 
other  schools  in  the  state.  The  parents  of  Grosse  Pointc  and 
Great  Neck  and  Princeton  should  inform  the  state  legislatures 
what  it  takes  to  educate  their  children  properly,  and  that  stand- 
ard of  support  should  be  applied  to  every  district  in  the  state. 

It  is  my  belief  that  the  American  school  system,  as  a 
whole,  has  been  and  continues  to  be  a remarkable  success.  The 
campaign  to  discredit  it  and  to  blame  it  for  the  ills  of  our  nation, 
leads  inevitably  to  making  the  wrong  decisions  about  what  to 
fix.  Greater  school  improvement  will  come  from  providing  poor 
people  with  jobs  that  pay  enough  to  allow  them  to  live  with 
dignity,  than  from  all  the  fooling  around  we  can  do  with  curric- 
ulum and  instruction,  or  with  standards  and  tests.  Children  who 
are  poor,  unhealthy,  and  from  families  and  neighborhoods  that 
are  dysfunctional  do  not  do  well  in  schools.  Educators  cannot 
work  miracles.  Children  from  families  that  have  some  hope,  some 
income  and  some  health  care  have  a chance.  Families  with  those 
characteristics  are  in  less  stress  and  they  take  control  of  their 
neighborhoods.  P.S.  79,  on  181st  Street  in  the  Bronx  is  a neigh- 
borhood elementary  school  that  is  failing,  and  it  was  not  always 
that  way.  When  people  in  the  tenements  around  that  school  had 
hope,  that  ugly  school  for  the  working  classes  was  remarkably 
successful.  I know.  It  is  the  school  1 attended  in  the  neighbor- 
hood in  which  I grew  up. 

Educators  must  now  speak  up.  It  is  time  for  us  to  inform 
the  politicians  and  business  leaders  of  America  that  we  cannot 
solve  all  the  problems  that  they  are  creating.  We  will  no  longer 
take  the  blame  for  their  actions.  All  of  us  in  this  nation  must 
find  wavs  to  help  each  familv  live  with  dignity,  so  those  families 
can  give  their  children  hope.  Education  is  irrelevant  to  those 
without  hope,  and  succeeds  remarkably  well  for  those  who  have  it. 


Notes 
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The  Effects  of  a School-University 
Collaborative  Change  Project  on  Teacher 
Behaviors:  A Case  Study 

By  James  T.  Hardy,  The  University  of  Akron,  and  Richard  Ambrose,  Kent  State  University 


Abstract 

This  is  a case  study  of  the  effects  on  the'behaviors  of  those  teachers  who  were  selected  to  reform  an  urban,  inner-city  ele- 
mentary school  from  within  during  the  first  year  of  implementation.  Using  field  notes  gathered  from  weekly  staff  meetings,  small 
group  meetings,  structured  interviews  and  document  analyses,  researchers  in  this  project  found  that  when  given  the  opportunity 
for  school-based  restructuring,  teachers  pursued  teaching  practices  not  previously  contained  in  their  teaching  repertoire;  assumed 
responsibility  for  their  professional  development;  became  interested  in  examining  their  practice  and  supporting  it  with  documenta- 
tion; developed  direction  and  commitment  to  agreed-upon  school  goals;  engaged  in  collaborative  efforts  with  varying  constituencies 
to  accomplish  school  goals;  and  questioned  district-wide  practice  in  light  of  their  understanding  of  teaching  and  learning. 


During  the  decade  of  the  1980s,  school  improvement 
efforts  typically  focused  on  accountability,  and  projects  were  ini- 
tiated, monitored  and  evaluated  from  the  top  down  (Lieberman 
<Sc  X'lillcr,  1986).  Such  efforts  often  featured  new  instructional 
programs,  new  texts  or  curriculum  improvements  which  were 
dev- eloped  by  policymakers  and  researchers  and  directed  to  teachers 
to  implement.  Most  of  these  reform  projects  found  little  accept- 
ance from  classroom  teachers  because  such  efforts  failed  to  take 
into  account  the  complexities  of  the  teaching/learning  process, 
and  they  did  very  little  to  improve  the  conditions  of  teaching 
(Good lad,  1984;  Lieberman  <Sc  Miller,  1986;  Sarason,  1982). 

More  recently,  however,  sc  hoed  improvement  literature 
has  begun  to  call  for  teacher  empowerment  accomplished  bv 
restructuring  schools  as  well  as  rethinking  the  roles  teachers  play 
in  schools  (Holmes  Group,  19S6;  McCarthy  <Sc  Petersor.  .989). 

According  to  current  reform  literature,  in  order  for  change 
initiatives  to  he  effective,  they  must  be  shaped  by  practitioners 
and  guided  by  craft  wisdom.  Teachers  are  being  asked  to  move 
into  interactive,  dynamic  roles  (David,  1989)  and  to  collaborate 
with  other  educators  in  site-based  decision  making.  They  are 
being  empowered  to  redesign  the  work  teachers  do  in  schools 
and  to  utilize  scarce  resources  differently  than  they  have  in  the 
past.  They  are  being  called  upon  to  improve  the  teaching/learn- 
ing  process  (Murphy,  1990). 

In  contrast  to  earlier  reform  movements  vvlr.ch  tried  to 
came  teachers  to  adopt  specific  intruuional  models,  many  of 
today’s  initiatives  attempt  to  capitalize  on  the  energy  and  the 
creativity  of  individuals  within  the  school  to  bring  about  mean- 
ingful change  and  to  include  the  participation  and  ongoing 
support  of  other  educators  within  as  well  as  outside  the  school 
(Lieberman  Miller,  1986). 

While  collaboration  within  schools  has  begun  to  show 
some  success,  ev  idence  of  cuuess.Vl  school-university  collabora- 
tion to  bring  about  sc  hool  improvement  is  practically  non -existent 
(Smith,  ll)92V  Caw  report  v m*c  m ti  bet  hi  moM  common  evident  e 


in  the  literature  (Binke  <Sc  Ncubert,  1984;  Carter,  1988;  Clift,  Veal, 
Johnson  <Sc  Holland,  1990;  Cochran-Smith,  1991;  Molner,  1988; 
Penick  <Sc  Yager,  1988-89;  Takacs  <Sc  McArdle,  1984;  Williams, 
1988).  Most  of  these  case  reports  present  school -un me rsity  col- 
laborations from  the  perspective  of  the  university-based  faculty, 
and  they  tend  to  focus  on  desired  outcomes  of  the  innovation. 
Few  studies  in  the  literature,  however,  speak  to  the  initiation  and 
the  maintenance  of  the  collaboration  or  provide  empirical  evi- 
dence of  program  effectiveness  (Smith,  1992\ 

As  Goodlad  (1988)  concluded: 

The  history  of  school-university  collaboration  is  not  so 
much,  then,  replete  with  failure  as  it  is  short  on  examples 
of  carefully  crafted  agreements  and  programs  accompanied 
by  the  ingredient  considered  by  Clark  (1986)  to  be  essen- 
tial for  success-namely  individual  and  institutional  com- 
mitment on  both  sides.  In  short,  the  juining  of  schools 
(and  school  districts)  and  universities  in  commonly  pur- 
posive and  mutually  beneficial  linkages  is  a virtually  un- 
tried and  therefore,  unstudied  phenomenon,  (p.  12). 

Purpose  of  Study 

The  professional  development  work  of  one  school  which 
came  about  because  of  the  collaborative  effort  of  a school  dis- 
trict and  a college  of  education  in  Northeast  Ohio  was  studied. 
The  focus  was  on  rite  overarching  question,  “How  might  the 
behaviors  of  the  teachers  selected  for  such  a collaborative  improve- 
ment project  be  affected  bv  an  opportunity  to  reform  a school 
from  within?” 

This  rescan  h effort  was  based  on  the  assumptions  that 
the  only  meaningful  reform  begins  with  those  who  inhabit  the 
siIhhiI  and  at  smh  efforts  tan  only  be  sustained  in  the  lone 
term  bv  mratv-  of  a strong  partnership  bn  ween  public  Mrhoob 
and  higher  cJiii.it ion  institution*. 


Effects  on  Behavior  (continued) 

Considerations  That  Frame  the  Study 

The  focus  of  this  one-year  study  was  a multicultural,  highly 
mobile,  low  SES  school  located  in  inner-city  Akron,  Ohio. 

Prompted  by  past  successful  school-university  collabora- 
tive efforts,  the  administration  of  the  school  district,  the  Akron 
Education  Association  and  the  College  of  Education  at  Kent 
State  University,  entered  into  an  agreement  to  designate  a pro- 
fessional development  school.  Elementary  teachers  from  the 
33,000  student  school  system  were  invited  to  apply  and  were 
screened  by  a team  composed  of  Akron  teachers  and  administrators. 

As  a result  of  the  selection  process  held  in  1989-90,  eight 
applicants  'fifteen  applicants  applied)  were  selected  to  join  the 
existing  subject  area  specialists  and  faculty  who  opted  to  remain 
at  the  school  site. 

It  was  understood  by  the  participants,  who  were  asked 
to  make  a three-year  commitment  to  the  project,  that  they  would 
teach  for  two  and  conduct  action  research  in  the  school  for  one 
of  the  three  years.  During  the  first  year  four  of  the  newly  selected 
teachers  were  assigned  to  classrooms  and  the  other  four  were 
assigned  to  an  action  research  team. 

At  the  close  of  a three-day  orientation  which  was  held 
prior  to  the  initiation  of  the  project,  the  original  group  ot  eight 
teachers  chose  several  goals  for  the  1989-90  school  year:  (1)  to 
implement  an  interdisciplinary  reading  program;  (2)  to  design  a 
.collaborative  curriculum  development  process;  (3)  to  focus  their 
professional  development  that  year  on  skill  building  related  to 
decision  making,  conflict  resolution,  and  group  work;  (4)  to  ini- 
tiate an  action  research  process  enabling  the  staff  to  reflect  upon 
their  professional  practice  and  to  begin  to  build  a body  of  useful 
knowledge  about  the  teaching/learning  process. 

Method 

Participants  and  Data  Collection 

During  the  Spring  of  1989— prior  to  the  project’s  start-up 
date  in  the  Fall  of  1989— teacher  position  listings  for  the  targeted 
school  reform  were  posted  for  district-wide  elementary  school 
teachers'  consideration.  The  position  listing  included  a call  for 
teachers  who  had  the  skills  and  dispositions  to  (1)  develop  and 
demonstrate  alternative  methods  for  delivering  educational  ser- 
vices, (2)  provide  leadership  in  program  development,  staff  develop- 
ment, a. id  action  research,  and  (3)  develop  and  demonstrate 
superior  teaching  strategies  for  the  education  ot  the  district’s 
children.  A selection  committee,  consisting  of  district  adminis- 
trators union  representatives,  and  classroom  teachers,  screened 
applicants  w ho  were  asked  to  submit  a videotape  of  their  teach- 
ing, complete  a questionnaire,  submit  references,  and  were  sub- 
sequently interviewed.  Eight  teachers  from  a pool  oi  15  vears  of 
lea  nmg  experience,  were  selected  to  participate  in  this  project. 

Thtouuhoui  the  lu89.O0  sduvl  Year,  data  gathering  using 
a c.iw  uudv  approach  was  incorporated  in  ibis  Mtidv.  Principle 
data  cathennc  tnuhaniMm  c omitted  ol  e\iuH\e  field  note 


focusing  primarily  upon  weekly  staff  meetings  (30  meetings,  ap- 
proximately an  hour  long);  small  group  informal  meetings  (two 
or  more  project  teachers— 45  field-noted  meetings);  and,  struc- 
tured interviews  at  the  beginning,  middle  and  end  of  the  school 
year  (24  interviews).  A sample  of  the  interview'  questions  follows: 

• Why  did  you  choose  to  be  a part  of  the  Demonstration 
School  project? 

• What  skills  do  you  feel  you  will  gain  or  strengthen  as 
a result  of  this  project? 

• Have  you  done  “things”  differently  this  year  than 
previous  years? 

• Identify  and  describe  some  of  the  projects/activities  that 
you  have  been  involved  in? 

• My  biggest  accomplishment  this  year  has  been... 

• My  biggest  regret  this  year  has  been.. . 

The  interviews  were  audiotaped  and  later  transcribed  for 
analysis.  Document  analysis  of  written  products  also  took  place 
(e.g.,  school  goals,  curriculum  development  products,  grant 
applications). 

Two  researchers,  a university  college  of  education  faculty 
member  and  a doctoral  student,  collected  the  data  and  were  also 
quasi-participant  observers  in  their  dual  roles  of  providing  docu- 
mentation and  support  for  the  project. 

Data  Analysis 

The  phenomenological  approach,  involving  case  study 
research  within  a naturalistic  setting,  promoted  by  Guba  and 
Lincoln  (1983;  Lincoln  <Sc  Guba,  1985),  established  a preliminary 
procedural  basis  for  initial  data  analysis  that  targeted  key  events 
and  phenomena  (staff  meetings,  informal  meetings,  structured 
interviews,  and  document  analysis).  Data  were  first  collected 
broadly  and  then  based  on  concurrent  analysis  (Miles  &.  Huber- 
man,  1984).  The  scope  of  the  data  was  then  reduced  so  that  its 
length  could  he  increased  through  domain  analysis  and  inductive 
categorization  processes  (Spradley,  1979). 

Data  from  the  staff  meetings,  informal  meetings,  struc- 
tured interviews,  and  document  analysts  were  then  organized 
topically  and  scanned  for  regulations  and  patterns  resulting  in 
subsequent  categories.  Six  key  categories— curriculum  restructuring, 
professional  development  deliberation,  teacher  inquiry,  project 
vision,  collaboration,  and  teacher  reflection— emerged  from  con- 
stant comparative  examination  of  the  data  and  are  reported  in 
the  subsequent  results  section. 

B'lr  example,  during  the  first  month  of  the  project,  teachers 
decided  to  meet  vveoklv  to  discuss  innovative  project  activities 
for  the  upcoming  year.  From  these  informal  meetings,  field  notes 
Oaken  by  one  of  the  researchers!  were  recorded.  Specific  activities 
were  discussed,  written  about,  and  key  elements  of  the  discus 
sion  writings  emerged  from  the  data  through  subsequent  ethno- 
graphic analvsis. 

,1  j\t.y  li >) 
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Effects  on  Behavior  (continued) 

Results 

Finding  One:  When  given  the  opportunity  for  school-based  cur- 
ricular and  pedagogic  restructuring , reac/ias  pursued  teaching  prac- 
tices not  previously  contained  in  their  teaching  repertoire. 

Several  examples  of  school-wide  collaborative  efforts  were 
attempted  during  the  first  year  of  the  project.  For  example,  thematic 
teaching  was  embraced  by  all  the  teachers  and  highlighted  by 
means  of  multi-age,  cross-grade  groupings  focusing  on  quarterly 
units.  One  thematic  unit  on  “families”  enabled  students  to  choose 
areas  of  interest  and  explore  them  with  teachers  and  other  same- 
age  and  cross-age  students  in  which  students  and  teachers  shared 
responsibilities  for  teaching  and  learning.  One  component  of  this 
unit,  “Families  in  Literature”  provided  students  and  teachers 
with  the  opportunity  to  examine  specific  interest  areas  related 
to  this  topic  and  later  present  their  findings  to  other  groups. 

Teachers  collaborated  with  each  other  to  develop  and 
implement  units  for  study.  Such  cooperative  planning  and  teaching 
had  been  totallv  alien  to  the  teachers  prior  to  this  experience. 

Yet  another  example  of  curricular  and  pedagogic  restruc- 
turing centered  upon  the  use  of  whole  language  and  child-centered 
learning.  Each  of  the  teachers  had  some  experience  with  these 
two  practices  and  philosophical  orientations  but  admitted  to 
having  only  a limited  understanding  and  ability  to  apply  the 
teaching  strategies  supportive  of  whole  language  and  child- 
centered  learning. 

One  of  the  teachers  related: 

Being  here,  I’ve  been  able  to  put  a lot  of  things  together. 

I was  able  to  kinda  struggle  through  and  use  whole  lan- 
guage this  past  year  and  make  mistakes  with  it  and  come 
away  this  vear  with  a better  grasp  of  it.  I was  able  to  use 
a lot  of  cooperative  learning  (child-centered  emphasis) 
in  the  classroom  this  year.  1 didn’t  feel  like  the  time  that 
1 spent  on  cooperative  learning  was  really  taking  awav 
from  other  subjects.  1 was  able  to  go  to  a workshop  on 
cooperative  learning. .. and  1 think  the  kids  arc  ready 
to  go.  I just  hope  next  year  they  get  someone  who  will 
carry  that  on. 

Project  teachers  were  willing  to  take  risks  in  their  teaching 
practice  because  the  school  environment  nor  only  tolerated  such 
activity,  groups  of  teachers  promoted  such  teaching  practice  which 
challenged  the  conventional  norms  associated  with  teaching  as 
an  isolated  teacher  directed  activity. 

Assuming  that  teacher  knowledge  and  skills  are  related 
to  productive  learning  environments,  fostering  the  expansion  of 
knowledge  and  skills  in  a supportive  environment  enhances 
teacher  and  students’  learning.  By  encouraging  experimentation 
siuh  as  thematic  teaching,  whole  language,  and  child-centered 
learning,  tenc  hers  were  able  to  raise  questions  about  <.  onvention.il 
practice.  By  critically  examining  and  evaluating  their  learning 
b\  doing,  teachers  were  able  to  confront  their  old  beliefs  with 
new  beliefs  about  professional  practice. 


Finding  Two:  Teachers  assumed  responsibility  for  their  men  pro- 
fessional development. 

Although  project  teachers  took  advantage  of  the  inscrvtce 
opportunities  provided  by  the  school  system,  early  on  they  took 
responsibility  for  the  planned  site-based  professional  development 
related  to  their  established  needs. 

During  September  of  the  first  year,  a school-wide  staff 
development  needs  assessment  (Target  Area  Survey)  was  distributed 
and  completed  by  the  project  staff.  Survey  responses  were  ranked 
and  a committee  was  charged  with  the  task  to  develop  and  im- 
plement professional  development  strategies.  “Mom’s  Meetings” 
(Meeting  of  the  Minds)  were  initiated  which  consisted  of  tri-weekly 
afternoon  sessions  (substitute  teachers  were  provided)  that  focused 
on  specific  curriculum  development  or  teaching  strategies  including 
portfolio  assessment,  whole  language,  grant  writing,  curriculum 
integration,  and  action  research.  The  Mem’s  Meetings  enabled 
lengthy  discussion  and  consideration  of  chosen  topics  for  current 
reflection  and  the  opportunity  for  follow-up  and  refocus  for  future 
meetings.  “Recipe  Luncheons”  consisted  of  bi-weekly  sharing  of 
teaching  practices  over  lunch  at  a nearby  restaurant.  The  Recipe 
Luncheons  were  quick,  often  how-to,  approaches  to  teaching  that 
the  project  teachers  had  successfully  used  in  the  past  or  had  exper- 
imented with  more  recently.  The  Recipe  Luncheons  gave  the 
staff  ample  opportunity  to  share  promising  practices  that  either 
were  occurring  or  could  oc’cur  at  the  school. 

Teachers  throughout  the  first  year  shared  the  knowledge 
and  skills  they  had  gleaned  from  workshops,  conferences,  pro- 
fessional readings,  college  courses,  and  other  resource  people. 

A professional  library  was  established  with  hooks  on  loan 
from  the  central  office.  Other  professional  resources  were  also 
purchased  throughout  the  year  from  a professional  development 
budget  controlled  by  the  project  staff. 

Finding  Three:  Teachers  became  interested  in  examining  their  own 
practice  and  supporting  it  inch  docHmenrution. 

The  teachers  were  introduced  to  action  research  at  the 
Mom’s  Meetings  and  several  of  the  staff  individually  and  col- 
labomtivcly  engaged  in  responding  to  questions  about  their  teach- 
ing practices.  For  example,  two  of  the  teachers  focused  on  the 
action  research  question,  “W  hat  effect  will  a whole  language-' 
integrated  curricular  approach  have  upon  a first /second  grade 
combination  class?”  In  their  attempt  to  answer  the  question,  the 
two  teachers  kept  n reaction  journal,  an  activities  log,  and  inter- 
viewed the  children  periodically  throughout  the  academic  year. 

Teachers  also  began  to  engage  in  grantsmanshtp.  Onlv 
two  of  the  staff  had  had  any  previous  experience  in  such  an  en- 
deavor. Several  grant  writing  projects  took  place  that  first  year 
that  targeted  local,  state  and  national  binding  sources.  With  the 
assistant  e ol  a Kent  State  l hiiveratv  faculty  member,  grants  were 
written  which  focused  on  the  documentation  of  project  activity 
and  kinds  for  curricular  innovation  through  school-based  re- 
form initiatives. 

Finding  Four:  TaJuo  (Li»/i»/hJ  dnutmu  */mf  ccmnwrnunf  {<■ 
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Effects  on  Behavior'  (continued) 


A mission  statement  and  a set  of  school-wide  goals  for 
the  project  school  were  developed  early  in  the  school  year  and 
reviewed  at  the  end  of  year  one.  The  staff  emphasized  in  their 
statement  that  the  mission  of  the  school  was  “to  ensure  that 
no  one  struggles  alone.”  Borrowing  from  Lieberman,  Saxl  and 
Miles  (1988),  teachers  were  asked  to  commit  themselves  to  (1) 
trust  and  rapport  building,  (2)  the  diagnosis  of  the  school’s  organi- 
zational and  instructional  needs,  (3)  work  with  the  process  of 
teaching  and  learning,  (4)  utilize  whatever  resources  were  avail- 
able to  them,  (5)  collectively  manage  the  work  load,  and  (6)  build 
skill  and  confidence  in  others. 

Parents  who  had  children  in  the  project  school  were 
•asked  to  (1)  understand  the  academic  goals  of  the  school  and  (2) 
support  their  children’s  and  teacher’s  efforts  to  reach  those  goals. 

The  students  in  the  project  school  were  asked  to  (1)  come 
prepared  to  learn,  (2)  respect  themselves  and  others,  (3)  respect 
other  people’s  property,  and  (4)  ask  for  help  when  they  needed  it. 

The  goals  of  the  project  school  staff  were  indicative  of 
their  shared  vision  for  the  school.  Such  goals  included  (1)  inte- 
grating the  curriculum  thematically  across  grade  and  ability  levels, 
(2)  giving  students  a positive  outlook  on  learning  and  encouraging 
them  to  attain  a positive  self-concept,  (3)  increasing  parental  in- 
volvement in  the  school  and  the  education  of  their  children,  (4) 
encouraging  full  staff  participation  in  and  support  for  programs 
and  changes,  and,  (5)  providing  the  time  during  the  work  day 
for  teachers  to  meet  professionally. 

Both  the  mission  statement  and  the  goals  statement 
biggest  a school-wide  responsibility  for  internal  control  that 
might  result  in  a divergence  of  practice  compared  to  external 
control  and  uniformity  of  practice.  Since  borh  statements  were 
developed  hv  the  staff,  ownership  and  professional  commitment 
to  the  combined  statements  would  appear  to  he  forthcoming. 
This  belief  was  reflected  in  the  following  teacher’s  comments: 

1 think  that  the  first  meeting  we  had  outside  of  school 
last  week  was  prohahlv  one  of  the  most  productive  things 
I’ve  done  in  education.  And,  we  sat  down  for  four  hours 
and  we  were  verv  task  -oriented,  and  wc  were  there  to  hash 
out  things  uhe  mission  and  goals  statements).  I think  that 
wo  got  into  some  real  nittv-gritties.  I think  some  people 
were  uncomfortable  from  time  to  time... But,  I think  ns 
we  questioned  and  other  people  started  sharing  ideas, 
and  we  learned  to  listen  to  each  other,  and  it  was  exhaust- 
ing. . .So  that  I felt  it  was  one  of  the  best  experiences  I’ve 
had.  As  a classroom  teacher,  l\c  never  had  that  kind  of 
meeting.  Ever.  That's  sad. 

Finding  Five:  TecMu’i'  it  til  engage  Hi  ailiuh'umtc  e#n-n  wth 
uHitfifMctii  io  to  Mmol  uu/c  c<>ub 

I mi  lie  (ll,?M  and  others  have  noted  ih.it  teaching  practice 
is  often  an  isolated  endvauu  and  that  te.kheis  do  not  have  ex- 
tended opportunities  to  profc-si, uinllv  inUr.nt  with  each  other 
or  other  groups. 

The-  U'.nheis  in  this  project  Kluud  ih.it  thete  Acre  rc 


sources  and  support  systems  beyond  the  confines  of  their  school 
thar  would  benefit  teaching  and  learning  at  their  school.  Several 
first-year  projects  were  initiated  that  engaged  groups  in  varying 
degrees  of  collaborative  activity. 

A “Partners  and  Pals”  program,  for  example,  involved 
community  members  who  periodical^  correspnded  and  visited 
with  the  children.  A grant  involving  a local  children’s  hospital 
to  provide  a computerized  instructional  hook-up  between  chil- 
dren with  extended  illnesses  and  the  school  children  was  developed 
by  the  staff. 

A family  literacy  program  cosponsored  by  the  school  staff 
and  Kent  State  University  was  implemented.  High  school  stu- 
dents from  a nearby  private  school  were  involved  with  a tutorial 
program  for  the  project  school  students. 

Each  of  the  projects  was  initiated  by  groups  of  project 
teachers  who  took  responsibility  for  facilitating  the  activities  and 
reporting  back  the  results  to  the  school  staff. 

Finding  Six:  /n  tuning  degrees  teachers  questioned  disirici-u  ide 
teaching  practices , and  often  in  their  conversations  displayed  disposi- 
tions towards  examination  of  actual  teaching  practice  and  the  beliefs 
thiit  drive  sueh  practice. 

The  questioning  of  district-wide  teaching  practices  created 
a tension  and  a sense  of  ambiguity  that  was  disconcerting  at  best 
and  at  times  dysfunctional  among  the  teachers.  The  following 
teacher  comment  suggests  a strong  desire  not  to  readily  accept 
certain  teaching  practices  (and  the  implied  beliefs)  in  light  of  the 
teacher’s  own  understanding  of  the  teaching/learning  process: 

Direct  instruction .. .that’s  the  thing  that  bothers  me 
about  some  of  the  effective  schools  (district  emphasis). 

You  know,  it’s  alwavs  direct  instruction,  direct  instruction. 

1 think  there’s  a place  for  direct  instruction,  and  I know 
some  principals  that  have  gone  overboard.  You  know, 
rhev  want  the  teacher  up  in  front  of  the  class  almost  everv 
manure  of  the  day.  And  that  really  borhers  me  because 
1 think  that  a lot  goes  on  sometimes  when  there’s  little 
groups  working  and  I’m  hack  there  with  another  group, 
when  I'm  flitting  around,  that  kind  of  thing,  and  I don't 
want  to  see  people  thinking  it’s  the  teacher  giving  that 
knowledge  all  the  time.  And  so  I think  that's  renllv  dan- 
gerous to  education.  1 think  tl  en  they  put  up  the  teacher 
as  sort  of  the  knowledge  broker,  then  we  renllv  get  into 
some  really  detrimental  kinds  of  learning  going  on...vou 
get  very  little  learning.  You’re  pouring  it  into  their  heads, 
you’re  the  giver  of  information,  and  I think  that  kids 
renllv  do  need  to  realize  them’s  a lot  inside  them.  And 
they  have  a lot  of  ways  of  finding  out  wlut  thev  a ant 
to  know,  and  thev  can  ask  their  own  questions  too,  .. 
it's  oknvl  And  time  on  task,  you  know.  I linnllv  said  to 
a principal,  you  know,  what  do  mu  mean  by  “time  on 
laT.'  I can  have  the  kids  eop\  at  of  rhe  encyclopedia 
every  minute,  and  thev’d  be  on  task.  Are  we  talking  about 
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Effects  on  Behavior  (continued) 


...you  know,  what  kind  of  time  on  task  arc  we  talking 
about?  I want  my  kids  to  be  in  productive  learning.  On 
the  other  hand,  my  room  isn't  always  going  to  be  quiet. 

It  would  appear  that  one  sign  of  a professional  would 
be  to  question  one’s  field  of  professional  practice  and  be  able  to 
support  one’s  own  practice  based  on  current  knowledge  of  the 
professional  field.  Teachers  in  the  project  intuitively  understood 
this  as  they  collectively  tried  to  expand  upon,  “What  works  best 
for  our  school?”  through  the  process  of  immersing  themselves 
in  the  professional  literature  and  the  body  of  knowledge  they 
began  to  build  from  an  ongoing  reflection  of  their  own  profes- 
sional practice. 

Conclusion/Discussion 

In  the  first  year  of  this  venture,  it  became  obvious  that 
when  given  the  opportunity  to  restructure  their  curricular  and 
pedagogic  paradigms  with  the  nurturing  and  support  required  of 
such  an  undertaking,  teachers  will  begin  to  pursue  teaching-' 
learning  practices  not  previously  in  their  repertoire.  An  environ- 
ment of  supportive  ’‘risk-taking”  became  apparent  as  individual 
and  groups  of  project  teachers  initiated,  planned,  developed  and 
delivered  educational  services  in  a manner  not  previously  con- 
sidered in  their  past  teaching  years.  A sense  of  ownership  and 


empowerment  was  fostered  in  a collegial  manner  resulting  in  cur- 
riculum and  pedagogic  changes.  Furthermore,  professional  develop- 
ment became  more  site-specific  and  consciously  planned  to  benefit 
both  individual  and  collective  needs  of  project  teachers.  Collabo- 
ration, not  teacher  isolation;  a school-wide  focus,  not  just  indi- 
vidual classroom  focus;  and  professional  accountability  through 
the  need  for  documentation  materialized  as  project  teachers  en- 
gaged and  stuggled  with  the  many  problems  and  concerns  of  an 
urban  inner-city  elementary  school.  Through  teacher  ownership 
and  empowerment,  a group  of  teachers  appeared  capable  to  re- 
think and  make  initial  attempts  at  reforming  educational  prac- 
tice at  the  school  level.  This  bottom-up  approach,  built  upon 
teacher  empowerment  and  craft  wisdom,  promotes  a different 
means  for  educational  reform  than  years  past.  The  study  of  such 
reform  enables  insight  into  the  complexity  of  such  efforts  as  well 
as  providing  a means  to  capture  educational  reform  from  the 
perspective  of  teachers. 

Although  we  have  attempted  to  address  the  question 
of  what  effects  such  a collaborative  improvement  project  might 
have  on  teacher  behaviors,  it  is  important  to  caution  the  reader 
that  this  is  a one-year  study  and  that  the  participants  chose  to 
become  involved,  thus  introducing  the  impact  of  selectivity. 

However,  these  limitations  can  and  should  be  addressed 
by  replications  of  this  case  study.  Such  studies  are  under  way  and, 
when  published,  should  add  to  the  growing  literature  on  the 
effects  of  collaboration  within  as  well  as  between  institutions. 


References 


Binko,  J.,  <Sc  Ncuhcrt,  G.  (1934).  An  inservice  education  model; 
Teachers  and  professors  as  coequals.  Journal  of  Teacher  Education , 

35(6),  15-17. 

Carter,  K.  (1983).  Using  cases  to  frame  mentor-novice  conversations 
about  teaching.  Theon  /nto  Practice,  27,  214-222. 

Clark,  R.W.  (lQ86).  Schoo/-imirer.sit>  relationships:  Partnerships  and 
netu-orks  (Occasional  Paper  No.  2).  Seattle;  University  of  Wash- 
ington, College  of  Education,  Center  for  Educational  Renewal. 

Clift,  R.,  Neal,  M.  L.,  Johnson,  M.,  & Holland,  P.  (1990).  Restruc- 
turing teacher  education  through  collaborative  action  research, 
joiimci/  of  Teacher  Education , 4/(2),  52-62. 

Cochmn-Smirh,  M.  (1902).  Reinventing  student  teaching.  Journal 
of  Teacher  Education , 42,  104-118. 

Goodlad,  J.  (1084).  A place  called  school.  New  York:  McGraw-Hill. 

C jondlad,  ].  (1088).  School-university  partnerships  for  educational 
renewal;  Rationale  and  concepts.  In  K.  Sirotnik  and  J.  Goodlad 
(Eds.),  School  uniuTMf\  partnerships  in  action:  Concepts,  cases, 
and  coiuvnu  (pp.  Ml).  New  York:  Ten*,  hers  College  Pres^. 


Cuba,  EG.,  vk  Lincoln,  Y.S.  (1983).  Effectiie  a aluation.  San  Fran- 
cisco; Jossey-Bass. 

Holmes  Group.  (1986).  Tomorrows  teachers:  A report  of  the  Holmes 
Group.  East  Lansing,  MI:  Author. 

Licbcrman,  A.,  Saxl,  E.  R.,  (Sc  Miles,  M.  B.  (1988).  Teacher  leader- 
ship; Ideology  and  practice.  In  A.  Liebcrman  (Ed.),  Building  a 
projessional  culture  in  schools  (pp.  148-166).  New  York:  Teachers 
College  Press. 

Liebcrman,  A.,  &.  Miller,  L.  (J986).  School  improvement:  Themes 
and  variations.  In  A.  Licherman(EJ.),  Rethinking  school  improve- 
ment: Research,  craft  and  concept  (pp.  96-1 11).  New  York:  Teachers 
College  Press. 

Lincoln,  Y.  S.,  (Sc  Cuba,  E.  G.  (1985).  Xatwatisuc  inquiry.  Beverly 
Hills,  CA:  Sage. 

Lottie,  DC.  (1975).  School  teacher.  A sociological  study.  Chit  ago: 
Umversitv  of  Uhuago  Press. 

^ (continued) 

38; 5 


12 


Effects  on  Behavior  References  (continued) 


McCarthy,  S.  J.,  <Sc  Peterson,  P.  L.  (1989,  March).  Teacher  roles:  Weav- 
ing note  patterns  in  classroom  practice  and  school  organization. 
Taper  presented  at  the  meeting  of  the  American  Educational 
Research  Association,  San  Francisco. 

Miles,  M.  B.,  (Sc  Hubcrman,  A.M.  (1984).  Qiw/icatiYe  data  analysis: 
A sourcebook  of  new  methods.  Beverly  Hills,  CA:  Sage. 

Molner,  L.  (1988).  Colorado  brings  expert  teachers  to  campus  as 
clinical  professors.  Holmes  Group  F omm,  3(1),  11. 

Murphv,  J.  (1990).  Helping  teachers  prepare  to  work  in  restructured 
schools.  Journal  of  Teacher  Education,  41(4),  50-56. 

Penick,  J.,  (Sc  Yager,  R.  (1988-1989).  A model  school -based  program 
for  science  education  majors.  Action  in  Teacher  Education , 910 
(4),  19C  b 


Smith,  S.D.  (1992).  Professional  partnerships  and  educational  change: 
Effective  collaborations  over  time.  Joumctl  of  Teacher  Education, 
43(4),  243-256. 

Spradley,  J.  (1979).  Erhnographic  inccnieu*.  New  York:  Holt,  Rine- 
hart (Sc  Winston. 

Takacs,  C.,  (Sc  McArdic,  R.  (1984).  Partnership  for  excellence:  The 
visiting  instructor  program.  Journal  of  Teacher  Education , 35 
(6),  11-14. 

Williams,  D.  (1988).  The  Erigham  Young  University-Public  School 
Partnership.  In  K.  Sirotnik  <Sc  J.  Goodlad  (Eds.),  SchooUmiversity 
partnerships  in  action : Concepts , cases  and  concerns  (pp.  124-147). 
New  York:  Teachers  College  Press. 


AERA  Meeting  Participants’  Ratings 
of  Journals  in  Their  Disciplines 

By  M.  Cecil  Smith,  Northern  Illinois  University;  Russell  N.  Carney,  Southwest  Missouri  State  University; 
Wesley  C.  Covalt,  Northern  Illinois  University;  and  Mary  Beth  Mann,  University  of  Missouri-Kansas  City 


Abstract 

AERA  meeting  participants  were  surveyed  regarding  the  relative  quality/ prestige  of  various  journals  in  their  respective  disci- 
plines.  Subjects  were  asked  to  “rank  those  journals  that  you  consider  to  be  among  the  top  ten  in  your  discipline.. .[those]  which  you 
would  most  like  to  be  published  in  and/or  those  in  which  you  expect  to  find  information  important  to  you  as  an  educator  and/or  re- 
searcher/ Demographic  data,  listings  of  the  top  five  journals  for  AERA  Divisions  A-K,  and  an  overall  list  of  the  top  10  based  on  the 
572  respondents,  are  provided. 


In  197S,  Luce  and  Johnson  published  a survey  in  the 
Educational  Researcher  entitled  “Rating  of  Educational  and  Psy- 
chological Journals.”  This  survey  asked  AERA  members  in  the 
various  divisions  (seven  at  that  time)  to  .list. . .those  journals 
that  you  consider  to  be  among  the  top  10;  in  other  words,  those 
journals  in  which  you  would  most  like  to  be  published  and/or 
those  in  which  you  expect  to  find  material  important  to  you  as 
an  educator  (p.  S).”  Results  were  reported  in  tabular  form,  listing 
the  top  10  journals  for  each  division,  and  for  other  demographic 
categories.  Luce  and  Johnson  suggested  that  their  empirical  find- 
ings regarding  journal  quality  would  serve  as  useful  information 
for  tesearchers,  journal  readers,  and  for  “administrators  who  are 
confronted  with  the  task  of  evaluating  the  quality  of  journal  pub- 
lications, oftentimes  in  disciplines  foreign  to  them  (p.  8).” 

Given  the  passage  of  time,  and  the  rapid  growth  of  new 
journals  in  the  interim,  we  wondered  what  changes  might  have 
taken  place  since  W78.  To  answer  that  question,  we  conducted 
a similar  survey  of  AERA  participants  in  November  of  1990.  Our 
results  list  demographic  data,  the  top  five  journals  for  each  of 
the  11  AERA  divisions,  and  an  overall  ranking  of  the  ton  10 
based  on  the  572  total  respondents  to  our  survev. 

Method 

Sample 

Subjects  were  randomly  selected  from  the  “Address  Direc- 
tory of  Presenters”  in  the  back  of  the  l AERA  Annual  Meeting 
Program.  Each  presenter  had  a .6  chance  of  being  selected.  Our 
reasoning  in  choosing  this  sample  was  twofold.  First,  addresses 
listed  in  the  back  of  the  1990  program  were  relatively  current. 
Second,  the  resultant  ratings  should  reflea  the  judgments  of  per- 
sons active  in  the  organization.  For  reasons  of  economy,  wc  ex- 
cluded individuals  having  international  addresses  and  conse- 
quently mailed  out  1/M1  questionnaires  This  number  represented 
54  percent  of  the  approximately  \h00  AERA  meeting  presenters 
in  1^00,  and  11  percent  ol  the  lr,lll  total  AERA  member*,  li 
interesting  to  note  that,  as  oi  this  writing  (February  the 

AERA  national  office  is  reporting  current  membership  at  1 9,700. 


Because  our  sample  was  limited  to  those  persons  listed  as 
presenters  at  the  1990  AERA  meeting,  it  would  tend  to  reflect 
the  judgments  of  active  AERA  members.  It  is  possible  that  active 
members  may  favor  particular  journals  over  those  members  who 
are  inactive  or  are  infrequent  contributors  to  AERA  meetings. 

Materials  and  Procedure 

A cover  letter  described  the  nature  of  the  study.  In  order 
to  replicate  their  survey,  directions  regarding  the  ranking  pro- 
cedure paralleled  those  provided  by  Luce  and  Johnson  (1978), 
as  follows: 

Please  rank,  from  the  list  below,  those  journals  that  you 
consider  to  be  among  the  top  ten  in  vour  discipline.  In 
other  words,  rank  those  journals  in  which  you  would  most 
like  to  be  published  and/or  those  in  which  you  expect  to 
find  material  tmpormnr  to  you  as  an  educator-' researcher. 
Indicate  your  ranking  on  the  blank  adjacent  to  the  journal 
title  using  a number  1 next  to  the  journal  which  you  con- 
sider the  best,  2 next  to  rhe  journal  you  consider  second 
best,  and  so  on,  until  you  have  ranked  10  journals.  If 
journals  that  you  consider  to  be  among  the  top  10  are 
not  listed,  enter  the  title(s)  on  the  blank  lines  at  the  bottom 
of  the  questionnaire,  arid  rank  using  the  above  criteria. 
Please  return  your  survev  promptly  to  in  the  stamped, 
pre-add ressed  e nvolope. 

Similar  to  Luce  and  Johnson  (1978),  we  prov  ided  a list  of 
225  journals  on  the  hack  of  the  rating  form— hut  stressed  that 
respondent’s  choices  should  not  he  limited  to  that  list.  This  list- 
ing was  generated  via  textbooks  (e.g.,  Best,  1981),  previous  research 
(c.g.,  Koulnck  <Sc  Kcsseltnan  1975;  Luce  Johnson,  TTS),  and 
informal  surveys  of  education  and  psychology  faculty  members 
at  a midwestern  institution.  The  latter  approach  served  to  add 
journals  to  the  list  which  have  K en  initiated  since  N7S.  Respon- 
dents were  asked  to  verify  AERA  membership,  to  identify  prin- 
ciple divisional  affiliation,  work  setting,  and  to  indicate  whether 
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they  considered  themselves  mere  active  in  education  or  psychology. 
Survey  materials,  including  a postage  paid  business  reply  envelope, 
were  assembled  and  mailed  at  the  end  of  November  1990. 

Results 

Of  1,941  questionnaires  mailed,  586  (30.1  percent)  were 
returned.  The  mid-December  due  date  unfortunately  coincided 
with  a very  busy  time  for  most  AERA  members.  And  again,  for 
reasons  of  economy,  we  were  unable  to  send  a reminder  to  those 


Table  1 

Comparison  of  Survey  Sample  to  Actual 
Membership  of  A ERA  in  1990. 


Characteristic 

Percent  of 
572  Survey 
Respondents 

Percent  of 
Total  AERA 
Membership 

University  Work  Setting 

76 

70 

Primary  Discipline 

Education 

85 

67 

Psychology 

10  ' 

17 

Responsibility 

Teaching 

30 

34 

Research 

34 

11 

Imlm 

Mgmt./Admin 

12 

18 

Degree 

Ph.D./Ed.D. 

76 

73 

Master’s 

6 

23 

Note:  AERA  percent*  .iKwr  arc  ha."cd  on  data  published  in  EditocmondJ  Researcher 
l A ERA  Staff. 


Table  2 

Comparison  per  Division  of  Survey  Respondents  to  Actual 
Percentage  of  AERA  M embers  in  December  of  JOQ0. 

Percent  of 

Percent  of 

572  Survey 

17,111  AERA 

Division 

Respondents 

Members 

A •-  Administration  (n  = 70)  

i*. 

16 

}3  - Ourruulum  Studies  (n  - 6 ') . . . . . 

12 

16 

C " Learning  &.  Instruction  In  - 176) 

31 

36 

D - Measurement  &.  Research  (n  = 126 
E = Counseling  &.  Human 

22 

25 

Development,  (n  = 37) 

6 

Q 

F - Historv  (n  = 25) 

4 

4 

G - Social  Context  In  - S6) 

H ~ School  Evaluation  6*.  Program 

15 

14 

Development  In  '-63) 

11 

15 

1 - Education  in  the  PnffesMohMn  30 

5 

6 

I - Pi 'St  secondary  Education  In  - 5%) 

V) 

K - Teacher  EJiuatinn  tn  - 142)  ... 

25 

- 

Note:  ll.i  snum  lor  AkRA  divi*:oiul  nurahcphip  d.ua  w. 
H*r*h:r  Tilh  tor  P:\mihcT  o|  |'*V 

: tin  ALRA  Mm. 

who  did  not  respond.  Thus,  our  return  rate  was  lower  than  we 
had  hoped.  Of  the  586  returned,  572  (29.5  percent)  were  usable 
(i.e.,  respondents  identified  divisional  memberships,  ranked  jour- 
nals, etc.).  Among  usable  surveys,  538  of  the  respondents  indi- 
cated AERA  membership,  and  34  were  nonmembers— hence  the 
term  AERA  “participants.”  Demographic  data  comparing  our 
survey  participants  with  total  AERA  membership  characteristics 
are  provided  in  Tables  1 and  2. 

Rating  results  are  summarized  into  listings  of  the  top  five 
journals  by  divisional  affiliation,  as  well  as  an  overall  ranking  of 
the  top  10  (see  Table  3).  Since  rankings  at  the  divisional  level 
were  based  on  smaller  ns,  we  elected  to  list  the  top  five  journals 
for  each  division  instead  of  the  top  10.  Respondents  sometimes 
listed  more  than  one  principle  divisional  affiliation.  In  those  in- 
stances, their  choices  were  tallied  for  each  of  the  divisions  they 
identified.  Thus,  the  sum  ot  the  ns  across  the  divisions  is  greater 
than  the  572  total  respondents. 

Discussion 

Tacit  knowledge  exists  among  researchers  regarding  the 
relative  importance  of  various  journals  in  their  disciplines.  The 
purpose  of  this  survey  was  to  produce  current,  empirically-based 
rankings  of  journals  based  on  a sample  of  individuals  who  had 
participated  in  the  1990  AERA  meeting.  Although  there  has 
been  a proliferation  of  new'  journals  during  the  past  two  decades, 
many  of  the  major  journals  of  the  late  1970s  appear  to  be  “hold- 
ing their  own”  in  the  early  1990s.  For  example,  regarding  the 
overall  rankings  (sec  Table  3),  seven  of  the  top  10  journals  are 
the  same  as  those  listed  by  Luce  and  Johnson  in  1978:  Ameri- 
can Educational  Research  Journal  (AERJ),  Review  of  Educational 
Research  (RER),  Harvard  Educational  Review  (HER),  Phi  Delta 
Kappan  (PD  fO,  Educational  Researcher  (ER),  Journal  of  Educational 
Psychology  (JEP),  and  Journal  of  Educational  Measurement  (JEM;. 
The  presence  of  AERA  publications  AERJ , RER,  and  ER  at  or 
near  the  top  of  the  list  is  not  surprising,  but  at  least  confirms 
the  hope  that  AERA  members  think  highly  of  their  organiza- 
tions publications.  Broad-based  journals  such  as  HER  and  PDK”, 
while  not  published  by  AERA,  drew’  a good  deal  of  support 
from  survey  participants— as  did  APAs  JEP  and  NCME’s  JEM. 
Journals  new  to  the  list  were  Teacher’s  College  Record,  Educa- 
tional Leadership,  and  AERA’s  Educational  Evaluation  and 
Policy  Analysis. 

While  an  examination  of  Table  3 reveals  generally  strong 
support  across  the  hoard  for  the  top  10  journals,  it  is  perhaps 
more  meaningful  to  examine  journal  rankings  division  by  divi- 
sion. For  example,  members  of  Divisions  I and  1 which  repre- 
sent more  specialized  area  within  education  (e.g.,  medical  edu- 
cation, post-secondary  education),  identified  more  specialized 
journals.  Health  and  medical  education  journals  were  highly 
rated  within  Division  1,  while  journals  concerned  with  higher 
eckuaiion  issues,  practices,  and  research  wore  mom  valuable  to 
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Journal  Ratings  (continued) 


Percent  (and  Ranking)  for 

Table  3 

the  Top  10  Journals  Overall,  and  the  1 op  5 for 

Each  Dit 

is  ion 

Journal 

Overall 

Divisions 

A 

B 

C D E 

F 

G 

H l 

J 

K 

Amer.  Ed.  Research  J 

49(1) 

50(5) 

50(1) 

70(1)  49(3)  59(1) 

3X4) 

44(3) 

60(1) 

43(3) 

62(1) 

Review  of  Ed.  Research  . . . 

45(2) 

48(2) 

61(2)  52(2)  51(3) 

52(3)  60(1) 

57(2) 

Harvard  Ed.  Review 

33(3) 

51(3) 

47(3) 

68(1) 

63(1) 

46(5) 

42(4) 

49(3) 

Ed.  Researcher 

32(4) 

47(3) 

33(4) 

32(5) 

42(5) 

46(5) 

Phi  Delta  Kappan 

29(5) 

63(1) 

44(3) 

56(2) 

46(5) 

Journal  of  Ed.  Pysch 

23(6) 

52(3)  41(41 

Teacher’s  College  Record 

21(7) 

41(5) 

56(3) 

45(2) 

Educational  Leadership 

17(8) 

Ed.  Eval.  & Pol.  Analysis 

17(9) 

51(3) 

4^(4) 

Journal  of  Ed.  Meas 

15(10) 

61(1) 

30(5) 

Educ.  Admin.  Quarterly 

59(2) 

Journal  of  Teacher  Ed 

4^(3) 

Cognition  &.  Instruction 

.... 

33(4) 

J.  of  Ed.  Statistics 

41(4) 

Psychological  Bulletin 

37(5) 

Child  Development 

59(1) 

Developmental  Psych 

41(4) 

History  of  Ed.  Quarterly  .... 

64(2) 

Academic  Medicine 

53(2) 

. 

Eval.  &.  Health  Professions  . . 

53(2) 

Teach.  &.  Learn,  in  Medicine 

37(4) 

Research  in  Higher  Ed 

55(1) 

Journal  of  Higher  Ed 

47(2) 

Review  of  Higher  Ed 

42(4) 

Note:  Boldprint  = AERA  publication.  Overall 

n = 572. 

N?s  tor  di 

visions  are  as  follows: 

A = Administration  (n  = 70) 

E = Counseling  &.  Human  Dcvcl.  (n  = 37 

i 

I = Education  in  ihe  Professions  (n  = 3(1) 

B = Curriculum  Studies  (n  = 66) 

F = History  (n  = 25) 

j = Posr  secondary 

Education  (n 

= 53) 

C = Learning  &.  Instruction  (n  = 

176) 

G = Social  Context  in  = 86) 

K - Teacher  Educat  ion  (n  = 142 

D = Measurement  &.  Research  (n 

= 126) 

H - Schl  Eval.  & Program  Dcvcl  In  = 63) 

Division  J members.  As  jusr  one  more  example,  the  highly  re- 
spected but  more  specialized  journal  Child  Development  appealed 
to  a smaller  subset  of  AERA  members.  Although  it  did  not  “make" 
the  top  10  overall  list,  it  was  ranked  first  in  Division  E (along 
with  AERJ).  This  illustrates  the  limitation  of  the  “top  10"  ap- 
proach, and  the  need  for  the  division  by  division  analysis.  Indeed, 
one  may  argue  that  even  at  the  divisional  level,  scholarly  interests 
are  too  diverse  for  ratings  of  this  nature  to  be  valid  assessments 
of  journal  quality. 

While  of  limited  construct  validity,  our  survey  provides 
an  interesting  glimpse  of  academics’  perceptions  of  the  importance 
and  relative  contributions  of  journals  in  their  respective  disci- 
plines. However,  given  the  very  real  limitations  of  this  survey, 
caution  is  urged  in  interpreting  these  findings.  Indeed,  as  one 
of  the  reviewers  of  this  manuscript  noted,  the  “information  has 
a great  potential  to  be  more  powerful  than  the  data."  For  instance, 
it  would  be  unfortunate  if  promotion  and  tenure  committees  were 
to  rely  upon  survev  findings  to  evaluate  faculty  members'  publi- 
cation records.  Any  resulting  expectation  that  scholars  publish 
their  work  in  the  top  five  or  ten  journals  listed  in  our  survey 
would  Itc  misguided.  Many  excellent,  but  narrowly  focused  journals, 
have  limited  appeal  to  the  general  AERA  population,  but  arc  the 
bread  and  butter  oi  mnnv  scholars.  The  relative  importance  of  a 


professional  publication— its  quality,  prestige,  utility,  and  appeal 
—is  difficult  to  quantify.  Nevertheless,  our  survey  provides  a snap- 
shot of  how  the  respondents  value  the  journals  in  their  discipline^). 
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An  earlier  version  ot  this  paper  \uis  presented  at  the  annual  meeting 
of  the  American  EJiunttonal  Research  Association,  Chicago,  1*901. 
We  wish  to  iliank  the  rv\  uwers  for  Mui AYtwtrm  Edutjfionw/  Researcher 
who  pit  a ided  comments  on  an  earlier  draft  of  this  manusuipt. 
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MWERA  Communication  & Update 


Election  Results 


The  results  from  the  spring  MWERA  election  are  as  follows: 

By-Law  Approval 

Yes 

Vice  President 

Greg  Marchant,  Ball  State  University 

Member-At- Large 

jack  Snowman,  Southern  Illinois  University 


Association  Council 

Kim  Metcalf,  Indiana  University 
Marlene  Schommer,  Wichita  State  University 
Jennifer  Fager,  South  Dakota  State  University 
Stephen  Jurs,  University  of  Toledo 
Leslie  Lukin,  University  of  Missouri 
Isadore  Newman,  The  University  of  Akron 
Mary  Sudzina,  University  of  Dayton 


MWERA  in  Atlanta 

As  has  become  a tradition,  the  members  of  the  Mid-  Member-at-Large  Sharon  McNeely  arranged  for  a room  at  the 
Western  Educational  Research  Association  found  time  between  Atlanta  Hyatt  and  the  membership  practiced  a little  southern 

papers  and  symposia  to  gather  and  socialize  during  the  annual  hospitality.  The  event  was  well  attended  and  a pleasant  time 

meeting  of  the  American  Educational  Research  Association.  was  had  by  all. 


Mcm.Vr-At-Lflr^c  Sharon  McNeely  and  President-Elect,  Rick  Pugh  Southern  Illinois  in  Atlanta 


MWERA  Comnumication  Update  ( continued ) 


New  Editors  Appointed 


The  editors  of  the  official  MWERA  publication  are  ap' 
pointed  every  three  years  by  the  current  President  of  the  Associa- 
tion. After  serving  a three-year  term  as  co-editors,  Greg  Marchant 
and  Isadore  Newman  will  be  replaced  by  the  former  president 
of  the  Association  who  appointed  them.  Ken  Kiewra  appointed 
Ayres  D’Costa,  Ohio  State  University,  to  serve  as  the  editor  with 


Susan  Brookhart,  Duquesne  University,  and  John  Surber,  Uni- 
versity of  Wisconsin-Mihvaukee,  to  serve  as  associate  editors  of 
the  Mid-Western  Educational  Researcher  beginning  with  the  Winter 
1994  issue.  Greg  Marchant  was  elected  to  the  Executive  Council 
as  vice  president  and  will  be  serving  as  next  year’s  program  chair. 
Isadore  Newman  was  elected  to  the  Association  Council. 


"Mid-U’esccm  Educational  Researcher ” Editors,  Incoming  editors,  Ayres  D’Costa  and  Susan  Brookhart.  Incoming  editor , John  Surber 

Greg  Marchant  and  Isadore  Xeuman. 


Reviewers  Thanked 


As  the  Mid-Western  Educational  Researcher  has  become 
established  as  a peer  reviewed  journal,  the  number  of  manuscripts 
submitted  has  increased.  The  journal  is  indebted  to  the  editorial 

M.  Kay  Alderman,  The  University  of  Akron 
A.  AlRubaiy,  The  University  of  Akron 
Thomas  Andre,  Iowa  State  University 
Linda  Annis,  Ball  State  University 
Carolyn  Benz,  University  of  Dayton 
Richard  Brosio,  Ball  State  University 
Ayres  D’Costa,  The  Ohio  State  University 
Margaret  Dietzer,  Ball  State  University 
Anthony  Edmonds,  Ball  State  University 
Frank  Farley,  University  of  Wisconsin-Madison 
Naim  Gupta,  Ball  State  University 

Judson  Harmon,  Wisconsin  Department  of  Public  Instruction 

William  Hazard,  Northwestern  University 

Tonya  Huber,  Wichita  State  University 

Adria  Karle-Weiss,  University  of  South  Florida 

Gary  Knowles,  University  of  Michigan 

Dennis  Leitner,  Southern  Illinois  University 

Suzanne  MacDonald,  The  University  of  Akron 


board  and  the  following  reviewers  who  helped  shape  the  quality 
content  of  the  Mid-Western  Educational  Researcher. 

Keith  McNeil,  New  Mexico  State  University 

Teresa  Miller,  Ball  State  University 

Carole  Newman,  The  University  of  Akron 

Sharon  Paulson,  Ball  State  University 

Francine  Peterman,  Ball  State  University 

John  Pohlmann,  Southern  Illinois  University 

Jay  Price,  University  of  Wisconsin-Stcvens  Foint 

Richard  Pugh,  Indiana  University 

Ulrich  Reitzug,  1 diversity  of  Wisconsin-Milwaukee 

James  Schucrger,  Cleveland  State  University 

Lawrence  Sherman,  Miami  University 

Jack  Snowman,  Southern  Illinois  University 

Mary  Sudzina,  University  of  Dayton 

Marcia  Summers,  Ball  State  University 

Roy  Weaver,  Ball  State  University 

Terry  Weidmer,  Ball  State  University 

Doug  Wilkin,  D.W.  Enterprises 


Woolfolk  to  Speak  at  MATEP 


Anita  \\N4folk,  researcher  and  author  ot  the  best-selling 
introductory  educational  psyihok>gv  textbook,  will  open  and  close 
the  annual  meeting  ol  the  Midwest  Association  ol  Teachers  oi 
Educational  Psychology.  The  conference  will  feature  paper  sessions, 
workshops,  and  discussion  groups.  A dinner  speech  bv  Isadore 


Newman  will  focus  on  the  application  of  Deming’s  principles  and 
statistical  quality  control  in  education.  The  conference  will  be  held 
C Ytobcr  1-2  at  Anderson  University  in  Anderson,  Indiana  00  miles 
northeast  of  Indianapolis),  For  more  information  contact:  Greg 
Man  ham,  MATER  EDPSYBSt  ■ Muncie,  IN  47 


-33t 


18 


Research  Alive: 

How  Accurate  is  the  Conventional  Wisdom 
About  Classroom  Testing  Practices ? 

By  Jack  Snowman,  Southern  Illinois  University  at  Carbondale 


Surveys  of  classroom  life  indicate  that  a fair  amount  of 
time  is  devoted  to  measuring  how  much  knowledge  and  skill 
students  have  learned.  Depending  on  how  broadly  the  nature 
of  measurement  is  defined,  this  process  may  consume  as  much 
as  20  percent  of  a student’s  typical  day.  The  single  most  influen- 
tial measurement  activity  is  the  written  test,  accounting  for  about 
45  percent  of  a typical  student’s  course  grad'  The  overall  impor- 
tance of  classroom  measurement  activities  was  pointed  out  by 
Terrence  J.  Crooks  (1088).  In  a broad  review  of  the  classroom 
measurement  literature  that  appeared  in  volume  58  of  the  Review 
of  Educational  Research , Crooks  noted  that  classroom  evaluation 
guides  students’  “judgments  of  what  is  important  to  learn,  affects 
their  motivation  and  self-perceptions  of  confidence,  structures 
their  approaches  to  and  timing  of  personal  study  (e.g.,  spaced 
practice),  consolidates  learning,  and  affects  the  development  of 
enduring  learning  strategies  and  skills.”  The  implication  that  falls 
out  of  these  findings  is  clear:  teachers  and  students  should  be  as 
accurately  informed  as  possible  about  the  nature  of  measurement 
in  general  and  about  written  tests  in  particular.  But,  as  the  studies 
summarized  below  point  out,  teachers  and  students  often  have 
distorted  ideas  about  certain  aspects  of  classroom  testing. 

In  this  column  I will  look  at  five  recent  studies  that  address 
various  classroom  testing  practices  and  I will  compare  the  results 
of  each  study  with  what  teachers,  students,  and  measurement 
experts  generally  believe  to  be  true  (the  so-called  “conventional 
wisdom”).  The  specific  issues  that  these  studies  address  are: 

1.  Should  students  change  their  answers  to  multiple- 
choice  questions? 

2.  Do  students  learn  more  when  they  arc  tested  and 
receive  feedback  as  compared  to  being  given  the  same  amount 
of  time  for  additional  study? 

5.  Do  students  learn  more  when  they  are  given  more  tests? 

4.  How  valid  are  two  multiple-choice  item-waiting  rules 
(“Avoid  ‘none  of  the  above’  as  an  option.”  “Use  either  the  question 
format  or  the  completion  format  when  phrasing  the  stem.”)? 

If  von  .have  ever  changed  vour  answer  to  one  or  more 
multiple-choice  questions  because  you  weren’t  sure  about  the 
accuracy  of  vour  first  choice,  but  nevertheless  felt  that  such  answer- 
^wirching  wouldn’t  improve  your  score  anyway,  your  behavior 
and  attitude  was  both  typical  and  misinformed.  In  volume  59, 
number  \ of  the  Jourau/  of  Experimental  Education,  Marshall  A. 
Geiger  (1901)  notes  that  the  conventional  wisdom  among  students 
is  that  the  first  answer  selected  on  a multiple-choice  test  is  likely 
to  be  the  coned  one.  But  the  handful  of  studies  carried  out  over 
the  past  (V  wars  indicate  that  for  every  point  lost  because  of 


answer-switching,  about  2 to  3 points  are  gained.  Geiger’s  goals 
were  to  replicate  this  basic  finding  and  to  see  if  students  could 
accurately  predict  the  consequences  of  their  answer-switching. 

For  each  of  four  one-hour  exams  in  accounting  that  124 
undergraduates  took  over  the  course  of  a semester,  Geiger  noted 
the  number  of  answers  that  were  changed  and  asked  students  to 
indicate  whether  they  thought  their  changes  produced  higher 
scores,  lower  scores,  or  the  same  score.  Consistent  with  the  his- 
torical pattern,  students  gained  an  average  of  2.6  points  for  every 
point  they  lost.  Futhermore,  70  percent  of  the  group  increased 
their  scores.  But  at  the  same  time,  most  thought  they  did  them- 
selves a disservice  by  changing  answers.  (Perhaps  this  is  the  source 
of  the  conventional  wisdom.)  Twenty-three  of  the  students  (18  per- 
cent) believed  that  they  improved  their  scores  by  changing  initial 
responses,  whereas  65  students  (52  percent)  believed  that  they 
lost  points,  and  36  students  (29  percent)  believed  that  it  made  no 
difference  in  their  overall  score. 

In  volume  59,  number  4,  of  the  Journal  of  Experimental 
Education , Clifton  A.  Casteel  (1991)  reports  on  an  investigation  of 
the  role  of  reading  ability  on  the  efficacy  of  answer-switching 
among  eighth-grade  students.  The  test  that  these  students  took 
was  the  Cornell  Critical  Thinking  Test.  Because  this  test  contains 
items  that  measure  inference,  induction,  deduction,  and  evalua- 
tion, Casteel  assumed  it  would  induce  students  to  spend  more 
time  thinking  about  the  accuracy  of  their  answers,  thereby  pro- 
ducing a high  level  of  answer-switching. 

Although  level  of  reading  ability  did  not  influence  the 
number  of  answers  changed,  poor  readers  were  more  likely  than 
good  readers  to  change  an  incorrect  response  to  a correct  response. 
Consistent  with  previous  research,  students  changed  about  twice 
as  many  wrong  answers  to  right  answers  as  right  answers  to  wrong 
ones.  Clearly,  teachers  need  to  get  the  • *^rd  out  to  students  that 
they  should  not  be  hesitant  to  change  answers  they  have  doubts 
about,  particularly  if  they  can  narrow  their  choice  to  two  options. 

A second  piece  of  conventional  knowledge  among  stu- 
dents at  all  levels  of  education  is  that  additional  study  time  in 
lieu  of  a test  produces  at  least  as  much,  if  not  more,  learning  of 
the  target  information.  (And  how  many  of  us  haven’t  made  a similar 
appeal  to  a teacher  at  one  time  or  another?)  This  notion  was  put 
to  the  test  by  Mark  A.  McDaniel  and  Ronald  P.  Fisher  (1991).  In 
volume  16,  number  2,  of  Contempordrv  Educational  Psychology, 
they  reporr  on  how  well  four  groups  of  undergraduates  fared  when 
assigned  to  different  types  of  testing  or  additional  study  conditions. 

To  control  for  prior  knowledge,  the  students  were  asked 
to  learn  a set  of  54  little  known  facts  (e.g.,  Pocahontas  is  buried 
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Research  Alive  (continued) 


along  the  Thames  River”  UA  row  of  crows  is  called  a murder”). 
An  initial  level  of  learning  was  produced  by  asking  t he  students 
to  rate  each  item  for  comprehensibility  on  a five-point  scale.  Fol- 
lowing the  initial  learning  task,  about  one-fourth  of  the  subjects 
saw  36  of  the  original  54  facts  for  5 seconds  apiece  and  repeated 
that  fact  aloud  for  another  10  seconds.  A second  group  saw  the 
same  facts  for  five  seconds  apiece  and  then  gave  a plausible  reason 
why  the  sentence  is  true.  Students  in  the  third  group  received  a 
question  about  each  of  the  36  facts  (e.g.,  “Why  is  Pocahontas 
buried  along  the  Thames  River?”),  were  given  the  answer  after 
five  seconds,  and  then  repeated  the  answer  aloud  for  another 
10  seconds.  Students  in  the  fourth  group  also  received  a question 
about  each  of  the  36  facts,  also  saw  the  answer  five  seconds  later, 
and  then  gave  a plausible  reason  why  the  answer  is  true.  Twenty- 
four  hours  later,  all  students  responded  to  54  questions  about  the 
original  54  target  facts. 

There  were  two  noteworthy  findings.  First,  students  in 
the  testing  and  feedback  conditions  (groups  three  and  four)  sig- 
nificantly outscored  students  in  the  additional  study  conditions 
(groups  one  and  two).  Second,  type  of  processing— rote  rehearsal 
or  elaboration— did  not  significantly  affect  performance. 

Now  that  we  know  that  testing  leads  to  more  learning 
than  additional  study  time,  the  question  that  logically  follows 
is,  Do  students  who  take  more  tests  learn  more  than  students  who 
take  fewer  tests?  Although  most  students  would  disagree,  manv 
teachers  have  long  believed  that  students  learn  and  retain  more 
information  when  they  arc  tested  relatively  more  often.  The  exist- 
ing literature  tends  to  support  the  teachers’  conventional  wisdom, 
although  the  effect  is  usually  a small  one.  The  more  frequently 
tested  group  scores  about  one-fifth  of  a standard  deviation  higher 
on  a final  achievement  test  than  the  less  frequently  tested  group 
(as  effect  size  of  .20  for  those  of  you  who  think  in  meta-analysis 
terms).  Whether  this  finding  can  be  generalized  to  high  school 
students  is  uncertain  because  only  four  studies  have  focused  on 
the  performance  of  this  age  group,  and  thev  all  contained  serious 
methodological  flaws.  For  example,  in  some  studies  items  from 
each  of  several  quizzes  were  repeated  verbatim  on  the  final  achieve- 
ment test.  This  gave  an  advantage  to  the  more  frequently  tested 
students  because  they  took  more  quizzes.  Another  flaw  in  some 
studies  is  that  the  less  frequently  tested  students  took  but  one 
test— the  final  achievement  test. 

An  examination  of  the  role  of  frequency  ot  testing  among 
high  school  students  that  avoided  methodological  flaws  like  the 
two  just  mentioned  was  conducted  by  Abdulkalig  Khalaf  and 
Gerald  S.  Hanna  (1992).  Writing  in  volume  17,  number  1,  of  Con- 
temporary  Educational  Psychology , Khalaf  and  Hanna  report  on  a 
stud'-  conducted  in  Saudi  Arabia  on  over  200  tenth-grade  male 
students.  As  part  of  their  normal  classroom  routine,  the  less  fre- 
quently tested  students  were  given  one  short  quiz  a month.  The 
more  frequently  tested  students  were  given  two  quizzes  each  month. 
All  students  took  an  end-of-semester  exam  and  a delayed  exam 
three  months  later.  For  each  of  the  two  criterion  measures,  the 
mote  frequently  tested  students  settled  about  one-third  of  a stand 
ard  deviation  higher  than  the  less  frequently  tested  students. 


Summarizing  across  the  McDaniel/Fisher  and  Khalaf/ 
Hanna  studies  (and  bearing  in  mind  the  danger  of  straightforwardly 
generalizing  from  one  culture  to  another,  and  from  one  gender 
to  another),  it  appears  that  current  findings  about  whether  to 
test  and  relatively  how  often  favor  the  teachers'  conventional  wis- 
dom over  that  of  the  students.  So,  the  next  time  your  students 
groan  at  the  prospect  of  having  to  prepare  for  and  take  a test,  tell 
them  that  you’re  doing  it  for  their  benefit  and  that  they’ll  thank  you 
for  it  one  day.  While  they  may  not  like  it  or  believe  it,  and  they 
probably  will  not  thank  you  one  day,  they  do  seem  to  learn  more. 

The  last  testing  issue  1 will  take  up  concerns  the  rules  and 
guidelines  for  writing  multiple-choice  items  that  are  typically  found 
in  classroom  measurement  textbook:-  In  an  article  that  appeared 
in  volume  59,  number  2,  of  the  Journal  of  Experimental  Education , 
Kevin  Crehan  and  Thomas  Haladyna  (1991)  point  out  that  this 
large  body  of  conventional  wisdom  is  based  on  a relatively  small 
empirical  base  (about  100  studies),  and  that  most  of  the  studies 
deal  with  a small  subset  of  the  entire  set  of  rules.  For  example, 
slightly  more  than  half  of  the  studies  deal  with  the  issues  of  whether 
three,  four,  or  five  options  are  best,  and  the  desirability  of  having 
each  option  keyed  correct  about  equally  often.  Crehan  and  Hala- 
dyna  examined  the  validity  of  two  commonly  mentioned  but 
lightlv  researched  rules  for  writing  multiple-choice  items:  "Avoid 
‘none  of  the  above’  as  an  option”  and  "Use  either  the  question 
format  or  the  completion  format  when  phrasing  the  stem. 

In  a review  that  appeared  in  volume  2,  number  1,  of  Ap- 
plied Measurement  in  Education,  Thomas  Haladyna  and  Steven 
Dewing  (1989)  found  strong  disagreement  among  34  authors 
on  whether  to  include  “none  of  the  above”  as  an  option  in  a 
multiple-choice  item.  Nineteen  authors  felt  it  should  he  avoided, 
while  fifteen  felt  its  use  was  acceptable.  The  empirical  literature 
seems  to  fa\ror  the  majority  opinion  in  this  case.  As  was  the  case 
in  10  earlier  studies  conducted  by  other  researchers,  Crehan  and 
Haladyna  found  the  while  “none  of  the  above"  makes  items  slightly 
more  difficult,  it  does  not  improve  a teacher's  ability  to  discrimi- 
nate between  levels  of  student  mastery.  Thev  recommend  spending 
more  time  trying  to  write  better  distractors  than  relying  on  “none 
of  the  above.” 

The  conventional  wisdom  about  the  relative  merits  of  a 
question  format  for  the  stem  versus  a completion  format  is  more 
unified.  Of  41  references  that  addressed  this  issue,  all  agreed  that 
both  formats  were  equally  acceptable.  But  the  six  studies  that 
make  up  the  empirical  base  for  this  rule  indicate  that  the  question 
format  makes  items  slightly  easier  and  test  scores  more  reliable 
and  valid.  Crehan  and  Haladyna,  however,  found  no  significant 
differences  in  difficulty  or  discriminahility  as  a function  of  format. 

One  moral  that  inn  be  drawn  from  this  brief  review  is  the 
same  one  that  has  been  drawn  in  many  other  fields:  know  the 
facts  of  the  phenomenon  you’re  dealing  with  because  the  majority 
view,  while  right  on  some  occasions,  is  wrong  on  many  others. 
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Assessment,  Instruction,  Advice 
An  Interview  with  W.  James  Popham 


By  Barbara  S.  Flake, 

Burns  Institute  of  Mental  Measurements, 
University  of  Nebraska-Lincoln 

BP  First,  I’d  like  you  to  tell  us  a little 

bit  about  your  background  and 

how  your  career  developed. 

j ]p  j Originally,  l wasn’t  interested  in  mea- 
^ — surement  or  evaluation  or  anything 
mildly  quantitative.  1 had  been  a high  school 
teacher  and  decided  that  teacher  education 
was  such  a travesty  1 should  move  into  it 
at  the  college  level;  it  was  a field  in  which 
competence  did  not  prevail . 


What  subject  did  you  teach  in 
high  school? 


jp  In  high  school  1 taught  in  a small  bachelors  and  master’s  < 

eastern  Oregon  HS;  1 taught  every-  fbrdand  and  his  docmite 

thing.  I taught  geography,  English,  speech,  imp.  He  has  numoui 
social  studies,  tennis  coach.  I decided  1 hooks  to  his  audit  He  sc 
wanted  to  go  into  teacher  education  as  a * the  funding  oik 

professor.  Therefore,  when  I went  to  grad-  AnciksLc 

uatc  school  1 focused  on  instruction,  not 
on  measurement.  In  fact,  I took  only  one  course  in  measurement. 
So  instruction  was  where  I started  my  interest  and  then  I discovered 
that  the  really  controlling  feature  of  instruction  was  the  goals  to 
which  the  teacher  aimed  the  instruction.  Therefore,  1 found  my- 
self dealing  with  objectives  and  I realized  that  objectives  without 
measurement  are  just  so  much  rhetoric.  1 found  myself  gravitating 
toward  measurement;  in  the  last  20  years,  that’s  where  my  head 
has  been. 


gp  You’ve  been  at  UCLA  for  about  30  years.  After  you 

finished  your  graduate  work  did  you  go  straight 

to  UCLA? 

jp  Well,  I went  to  graduate  school  at  Indiana  University.  1 

enjoved  the  time  there.  I taught  at  a couple  ot  colleges,  San 

Francisco  State  College  for  two  years.  Kansas  State  College  of 
Pittsburg  was  the  fir^t  place  1 could  get  a job,  I taught  then.* 
for  two  vcnr«.  W hen  1 went  to  UCLA,  mv  louts  was  instruction 
exclusively.  I taught  courses  in  how  to  prepare  teachers  which  is 
what  1 wanted  to  do.  But  in  the  puness  of  ronllv  thinking  hard 
about  itiMnutuMt,  it  became  apparent  that  measurement  w,>  a 
powcilul  tool  to  mtlueiKc  mMriktton.  When  the  aciountabilm 
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movement  took  over  and  people  really  had 
to  deal  with  high  stakes  tests  and  the  enor- 
mous impact  of  those  tests,  it  just  happened 
that  l was  in  that  area. 


BP  Tell  me  a little  bit  about  the  evo- 

lution  of  IOX  (Instructional 

Objectives  Exchange). 


IjX  JP  h happened  on  a trip  to  Fresno.  I 

was  giving  a presentation  in  Fresno 

describing  the  raptures  of  behavioral  objec- 
tives  and,  at  the  conclusion  of  the  day,  the 
superintendent  and  his  colleagues  took  me 
to  the  airport  and  told  me  that  they  were 
going  to  engage  in  the  creation  of  behavioral 
objectives  for  mathematics  grades  K through 

mro f!OX  Asament  6-  Two  daYs  earlier  1>d  been  at  Us  Ve8as 

jomia  He  mekei  his  m r^e  Clark  County  Schools  and  had 

from  the  Unnosip'  of  been  informed  that  they  too  w'ere  going  to 
:zrion  from  Indiana  Uni-  create  mathematics  behavioral  objectives 
s,  articles,  chapters,  and  K through  6.  It  struck  me  that  there  \yould 
the  pesident  of  AERA  be  enormous  repetition,  so  on  the  plane 

location  Ewkatim  and  back  from  Fresno  I thought  I should  figure 
out  some  way  to  have  an  exchange  of  objec- 
tives so  people  wouldn’t  have  to  do  other 
people’s  w'ork.  I went  to  the  UCLA  Center  for  the  Study  of  Eval- 
uation; they  thought  it  was  a great  idea  and  the  prc>ject  got  started 
in  1%8.  After  tw*o  years,  w'e  were  told  by  the  Federal  Govern- 
ment to  break  off  from  UCLA  because  it  was  a service,  not  re- 
search and  development,  so  we  did.  We  moved  off  campus  and 
have  been  operating  independently  ever  since. 


BP  i That  service  now  provides  items  as  well  as  objectives. 


jp  Right.  The  original  thought  just  to  prepare  objectives  was 

not  well  convened;  that’s  one  of  the  mistakes  I made.  1 

found  that  although  the  objectives  were  being  bought  pretty 
widclv  across  the  country,  they  weren’t  influencing  instruction 
at  all.  1 decided,  maybe  1 >20  years  ago,  to  move  IOX  from  an  ob- 
ject ives-dispensing  enterprise  to  an  assessment -creating  enterprise. 


[bp]  I’m  very  interested  in  your  perception  of  the  na- 

! tional  exam  movement.  In  particular,  what  do  you 

think  of  the  major  forces  behind  it.  what  do  you  think 
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Interview  with  W.  James  Popham  (continued) 


are  the  positive  consequences  and  what  are  the  nega- 
tive  and  unintended  consequences  of  such  a system? 

jp  First  off,  I confess  that  I read  about  the  efforts  of  the  pro- 

ponents  of  national  testing,  but  I’m  not  intimately  familiar 

with  the  innards  of  the  various  projects.  The  basic  premise  of 
national  testing  is  one  that  I find  compelling.  IOX  has  developed 
criterion-referenced  high-stakes  tests  for  more  than  a dozen  states. 
The  degree  of  overlap  in  certain  main  line  curricular  areas  is  enor- 
mous. There  really  aren’t  that  many  fundamental  differences  in 
mathematics  instruction  between  California  and  Montana.  How- 
ever, having  once  recognized  that  national  assessment  is  conceiv- 
able, it  all  depends  on  the  way  that  national  assessment  and 
national  goals  in  assessment  are  conceptionalized.  If  it  turns  out 
that  the  architects  of  those  national  assessment  systems  install 
instructionally  insensitive  tests,  then  substantial  harm  will  have 
been  done.  It  will  have  set  up  standards  and  expectations  that 
educators  will  have  a great  deal  of  difficulty  achieving  because 
there  are  no  instructional  implications  associated  with  the  tests. 
If  the  tests  are  created  exclusively  by  people  who  know  measure- 
ment but  not  instruction,  then  1 would  predict  they  will  have  a 
very  harmful  effect  on  the  quality  of  schools. 


BP  Do  you  think  it  will  become  the  focus  of  instruction? 


jp  Let’s  think  about  a tvpical  norm -referenced  achievement 

test  and  the  degree  of  instructional  clarity  it  supplies  for 

teachers.  The  answer  is  very  little  instructional  claritv.  In  fact 
there  is  a great  deal  of  generality  and  vagueness  associated  with 
the  test.  Let's  assume  for  the  moment  that  the  architects  of  the 
new  national  test  carry  with  them  the  norm-referenced  concep- 
tion and  they  want  to  sample  broadly  from  large  domains  of  interest. 
The  only  wav  a teacher  can  really  teach  effectively  toward  a norm 
referenced  test,  because  forms  change,  is  to  teach  to  particular 
items:  item-specific  instruction,  in  other  words.  That’s  prettv  repre- 
hensible. If  vou  don’t  conceptualize  the  test  in  such  a wav  that 
people  can  actually  teach  kids  to  do  those  things,  then  vou  created 
a force  for  educational  penalties,  not  progress. 

BP  I see  two  directions  to  resolve  that.  One  is  to  go  to 
criterion-referenced  items  rather  than  norm-refer- 
enced items.  I’d  like  you  to  talk  about  the  implications  of 
that.  The  other  would  be  to  do  more  instructionally  sen- 
sitive tasks,  like  performance  assessment  alternative  assess- 
ment tasks, 

jp  1 think  both  of  those  approaches  have  virtue.  In  the  first 
* place,  ii  these  national  tests  are  norm-refereiu ed  in  theii 
concept ionnlizat ion,  ihev’re  simple  going  to  be  repugnant  assess 
mctu  instruments.  1 would  ceriainlv  like  to  endorse  a criterion 
referenced  orientation.  The  nature  of  the  criterion-referenced  test 
is  quite  a diflerem  matter.  It  then*  tests  measure  students’  knowl- 


edge domains  or  skills  that  arc  impervious  to  instruction  or  relatively 
difficult  to  instruct  toward,  the  tests  probably  won’t  accomplish 
much  good.  I think  it’s  possible  to  engage  in  simultaneous  cakc- 
having  and  cake-eating  where  you  can  create  a legitimate  assess- 
ment instrument,  but  create  it  in  such  a way  that  teachers  will 
be  benefited  by  knowing  what  is  sought.  High  stakes  tests  influ- 
ence instruction;  such  tests  simply  have  to  have  the  right  kind 
of  conceptualization. 


BP  In  order  for  the  criterion-referenced  approach  to 

be  instructionally  valid  and  meaningful,  both  the 

tasks  have  to  be  sensitive  to  instruction  (as  you  say,  not 
impervious  to  instruction)  but  also  need  to  provide  more 
information  about  domain  specificity.  Then  I can  actually 
say  Johnny  can  or  can’t  do  addition  with  decimals;  my 
instructional  decisions  are  more  specific.  If  that’s  the  case 
you  would  end  up  with  more  items  to  administer  which 
means  more  time  and  testing.  What  are  the  implications 
of  that? 

jp  The  problem  is  an  important  one.  I don’t  think  it’s  pos- 

sihle  for  a test  to  assess  all  that  many  outcomes.  1 think 

the  tests  must  measure  only  an  intellectually  manageable  number 
of  outcomes.  That  means  the  teacher  will  pay  attention  to  a half 
dozen  or  so  outcomes,  hut  the  teacher  will  not  pay  attention  to 
25  or  50  or  500:  Once  you’ve  conceived  the  possibility  that  you 
have  several  important  outcomes  as  opposed  to  a plethora  of 
them,  then  you  have  to  recognize  that  you  can  assess  that  terminal 
competency  with  a fair  number  of  items,  yet  not  so  many  that 
vou  yield  a diagnostic  picture  of  the  student’s  progress  on  “en 
route”  tasks.  To  get  the  latter,  you  have  to  do  other  kinds  of  test- 
ing. First,  you  find  out  that  the  kid  hasn’t  mastered  that  particular 
outcome.  Then,  in  order  to  find  out  whore  the  defic  its  arc  within 
it,  we  have  more  informal,  shorter  tests. 


Bp  The  items  we’ve  been  talking  about  so  far  have  been 

paper  and  pencil.  What  is  your  thought  about  doing 

performance  assessment  at  the  national  level  in  this  kind 
of  a system? 

jp  j Performance  assessments  have  a great  deal  of  potential  and 

; promise.  One  of  the  real  virtues  of  measurement  in  this 

countrv  today,  from  a criterion -referenced  perspective,  L authentic 
assessment.  One  of  the  real  vices  of  educational  measurement 
today  is  also  authentic  assessment.  There  are  too  manv  devotees 
o I perform  a nc  e testing  who  are  not  reallv  thinking  carefully  about 
the  practu  alitv,  the  cost  implications,  and  some  of  the  psycho- 
metric issues.  1 think  the  general  push  toward  more  defensible 
kinds  of  student  tom]vtenc  ics  ] xTformnru. e-assessocl  competencies 
iv  a verv  laudable  activity  and  1 really  think  that  the  movement 
is  great.  The  problem  is  that  the  people  who  are  trying  to  imple- 
ment u seem  oblivious  of  some  of  the  pt.ktkal  obstacles. 
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Interview  ivith  W.  James  Popham  (continued/ 


BP  Do  you  think  the  movement  is  going  to  fail  because 

1 of  inappropriate  or  too  early  implementation? 

What’s  your  vision  of  how  this  is  going  to  play  out? 

jp  Well,  my  score  on  the  prophecy  scale  has  been  zero  of  late, 

hut  PH  be  glad  to  take  a shot.  1 think  that  there  is  a real 

possibility  that  authentic  assessment,  because  it  will  be  assailed 
on  legitimate  psychometric  grounds,  may  be  seriously  waylaid.  1 
think  that  can  be  avoided  if  authentic  assessments  p'oponents 
move  more  cautiously  toward  advocacy  of  their  approaches.  For 
a while,  authentic  assessment  was  being  done  in  several  states  on 
an  almost  controlled-study  basis.  Now  it’s  being  advocated  in  all 
settings  for  all  purposes.  1 think  that’s  just  ludicrous. 

pp  What  do  you  think  are  the  major  legal  issues  in 

educational  measurement  as  you  see  them  through 

your  experience? 

jp  I I think  that  the  violations  of  professionally  sound  pro- 
— cedurcs  constitute  a cause  for  tests’  being  overturned.  And 
that  does  not  mean  you  have  to  relv  on  the  Civil  Rights  Act  of 
‘64  and  the  recent  ‘^1  Civil  Rights  Act.  Rather,  it  means  that  the 
courts  will  be  attentive  to  the  plea  of  failed  examinees.  If  it  can 
be  shown  that  a test  was  not  properly  developed  and  evaluated, 
and  if  the  test  has  a disparate  impact  on  minorities,  women,  or 
anv  potected  group,  the  test  can  legitimately  be  attacked.  I think 
that  we  are  all  learning  much  more  about  what  it  takes  to  make 
a test  legally  defensible.  In  that  process,  though,  I think  we  see 
that  many  of  our  current  tests  are  woefully  inadequate. 


Bp  With  regard  to  the  teacher  licensure,  what  are  the 

major  weaknesses  that  you  see  that  are  brought 

into  debate  about  the  test? 


I jp  One  is  the  inadequacy  of  the  evidence  regarding  validity; 

1 1 that  is,  the  evidence  that  can  be  used  to  bolster  the  notion 

that  the  inferences  based  on  the  tests  would  he  valid.  This  is  an 
attack  on  several  grounds,  hut  frequently  on  the  grounds  that 
either  criterion-related  evidence  of  validity  was  not  present  at 
all  or  that  the  content-relaied  evidence  of  validity  was  not  well 
gathered.  Often  that  is  the  case!  Frequently  we  do  not  do  criterion- 
related  studies  of  validity  because  there  is  no  legimitate  external 
criterion.  In  situations  where  we  gather  e\idence  regarding  con- 
tent validity,  1 find  a good  deal  of  it  to  be  quite  soft.  1 think  there 
are  procedures  people  have  been  using  for  quite  some  time  that 
would  allow  us  t o renllv  judge  whether  the  content  of  a rest  i< 
bona  fide,  and  those  have  to  be  employed.  The  second  area  is 
setimg  of  the  cut -scorn.  One  finds  this  js  done  verv  frequently  in 
a manner  that  is  not  equitable  for  all  examinees.  "1  hose  are  the 
two  are.e  wheie  l think  (he  tests  are  most  \ ulneiYihle. 

1 pp ] One  of  x he  things  you  were  commenting  about  was 
■ - 1 lack  of  content  validation  steps.  It  occurred  to  me 


that  part  of  the  problem  is  often  too  little  time,  too  little 
resources  to  accomplish  the  task.  There  are  probably 
compromises  that  can  be  made  that  will  still  address 
issues  of  content  validity,  not  in  the  perfect  content  valid' 
ity  study. 

jp  That’s  exaedy  right.  There’s  an  expression  in  bridge— if 

you’re  forced  to  sit  down  with  a loser  for  a partner,  you 

don’t  play  for  the  best  possible  result.  Rather,  you  play  for  the  best 
result  possible.  Under  the  circumstances  of  having  a weak  bridge 
partner  or  an  RFP  (Request  for  Proposal)  that  makes  you  race 
instead  of  think  carefully,  you  do  the  best  job  you  can  under  those 
circumstances  and  it’s  often  acceptable.  The  difficulty  is  sometimes 
that  RFPs  are  led  by  state  officials  who  have  very  high  aspirations 
hut  don’t  realize  the  cost  implications  of  those  aspirations. 


pp  How  do  we  solve  the  problem  where  the  legislators 

will  legislate  that  there  will  be  a.  test,  and  it’ll  be 

able  to  be  used  in  ways  that  are  probably  not  feasible. 
How  do  we  educate  them  to  let  them  know  they  are  ask- 
ing for  the  impossible? 

jp  You  put  your  finger  on  it.  We  need  to  be  more  proactive 

with  respect  to  educational  legislation.  The  idea  of  sitting 

back  and  allowing  state  legislators  to  create  assessment  programs 
without  our  at  least  giving  a solid  effort  to  modify  their  thinking 
strikes  me  as  irresponsible.  Yet  1 find  many  state  departments  of 
education  where  the  only  contact  is  initiated  by  the  legislature, 
never  by  the  state  department.  I think  if  I were  head  of  an  assess- 
ment program  in  a state,  I would  spend  a fair  amount  of  my  time 
trving  to  educate  legislators.  In  general  I've  found  these  people 
to  be  relatively  able  and  well  intentioned  but,  unfortunately, 
ignorant  regarding  what  can  and  cannot  be  done  with  testing. 
So  I think  the  way  to  address  that  is  to  get  cracking  with  respect 
to  informing  those  folks-. 

pp  One  of  the  important  questions  that  1 want  to  spend 

J time  on  involves  giving  advice  to  graduate  students. 

One  of  the  major  goals  of  MWERA  is  working  with  grad- 
uate students  in  their  professional  development,  in  par- 
ticular in  the  area  of  educational  research  and  in  pub- 
lishing. What  kind  of  advice  would  you  give  to  the  aspiring 
little  Jimmy  Popham  who  is  now  in  graduate  school  and 
in  general  education  research? 


jp  1 suppose  I’d  start  by  encouraging  them  to  read  a little 
L ■ column  that  I recently  wrote  for  the  EductuimuH  Researcher 
called  A L lice  of  Advice.  Essentiallv  it  savs,  “do  these  things  and 
don’t  do  those  thing.”  That  prohnhlv  represents  mv  host  bit  oi 
advice  ioeducntion.il  professionals.  With  respect  to  research  kvitsed 
graduate  students,  one  thing  I’d  recommend  foi  sure  is  to  acquire 
a meaningful  conversance  with  the  principles  of  educational 
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Interview  with  W.  James  Popham  (continued) 

measurement.  I find  that  deficit,  that  shortcoming,  so  pervasive 
on  the  part  of  people  who  are  getting  out  of  graduate  schools.  If 
students  only  had  some  competence  in  educational  measurement, 
they  will  be  markedly  more  employable  and  potentially  able  to 
influence  education  in  a more  effective  fashion.  I would  certainly 
stress  measurement  even  more  than  statistics  or  research  design. 
Testing  will  happen  in  this  country,  and  it’s  not  going  to  go  away. 
Therefore,  we  need  some  more  competent  people  who  know  how 
to  play  the  measurement  game. 


BP 


Students  often  ask  me  what  kind  of  professional 
activities  they  should  get  involved  with.  Should 
students  get  involved  with  that?  Is  that  good?  Should  they 
seek  internships  or  should  they  just  concentrate  on  their 
studies  and  get  done?  What  do  you  think  about  diversity 
of  professional  development? 


JP 


I think  it  depends  a lot  on  the  student.  I’ve  certainly  en- 
countered many  students  at  UCLA  through  the  years  who 
profited  enormously  from  working  as  interns  at  IOX  or  as  interns 
at  ETS  or  endeavors  of  that  sort.  I think  that  the  practicum  kind 
of  experience  is  invaluable  for  most  students.  On  the  other  hand, 
for  some  students  l think  that  the  best  thing  they  can  possibly 
do  is  race  through  the  graduate  program  and  get  out.  I think  its 
almost  an  individual  call.  My  leaning  would  be  toward  more  real- 
world  experience.  1 think  there  is  something  very  unfortunate 
about  an  academic  community  where  the  professorial  flock  has 
not  faced  real  world  problems  for  several  decades. 


gp  What  about  going  to  national  meetings?  Do  you 
1 think  it’s  advantageous  for  students  to  go  to  na- 
tional meetings? 


JP 


The  question  of  whether  it’s  good  is  answered  only  one 
way;  it  is  good.  The  question  of  whether  it’s  good  enough 
to  warrant  the  cost  depends  how  far  the  national  meeting  is.  I 
find  that  I would  frequently  encourage  my  students  to  go  to  AERA 
when  it  was  in  San  Francisco  because  the  cost  of  getting  from 


Los  Angeles  to  San  Francisco  is  fairly  modest.  When  the  meeting 
was  in  Boston  or  Washington,  D.C.  l would  think  a lot  harder 
about  recommending  it.  I think  the  state  or  regional  educational 
research  associations,  such  as  the  one  you’re  representing  or  the 
California  Educational  Research  Association,  are  every  good  locales 
for  beginners  to  try  their  own  wings  and  to  listen  to  others. 


gp  Students  sometimes  are  interested  in  working  on 

’ research  projects  or  working  on  service  projects, 

but  often  they  also  want  to  have  financial  support  in  order 
to  make  time  in  their  prioritization.  Some  of  them  are 
concerned  about  being  exploited.  What  do  you  think  of 
the  problem  of  potential  exploitation? 


JP 


Exploitation  takes  place  in  universities  of  graduate  students 
and  it’s  unfortunate.  It’s  sufficiently  particularistic;  we  have 
to  really  deal  with  a given  situation.  I think  in  general  there  is 
less  exploitation  and  more  real  effort  to  get  students  involved  in 
practical  work  than  we  might  think.  However,  you  have  to  be 
constantly  on  guard.  If  you  are  a graduate  student,  vou  have  to 
make  up  your  own  mind  as  to  whether  or  not  this  professor  is 
really  trying  to  give  you  a meaningful  educational  activity. 


BP 


Do  you  have  other  advice  for  graduate  students  in 
the  program  beyond  what  Pve  brought  out? 


JP 


I think  the  advice  that  I have  for  graduate  students  is  to 
really  go  out  of  your  way  to  spend  some  time  w’ith  respected 
professors  and  pose  practical  real  career  problems  to  them.  1 think 
graduate  students  are  too  reluctant  to  ask  for  this  kind  of  practical 
advice.  The  more  they  ask,  the  more  insights  they  get.  If,  for 
example,  a graduate  student  asked  me  the  kinds  of  questions  that 
you  just  have,  that  graduate  student  might  get  some  important 
insights  out  of  the  answers.  Granted  that  a graduate  student 
doesn’t  know  as  much  as  you  do  about  asking  questions  on  the 
content,  but  still  I think  there  arc  good  professors  w'hose  insights 
should  be  sought. 
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Developing  Structural  Equation  Models 

By  Randall  E.  Schumacker,  University  of  North  Texas 

Abstract 

Structural  equation  models  have  been  developed  in  a number  of  academic  disciplines  to  substantiate  theory.  The  structural 
equation  modeling  approach  involves  developing  measurement  models  to  define  latent  variables  and  then  establishing  structural  equa- 
tions among  the  latent  variables.  This  article  was  written  to  provide  educational  researchers  with  a better  understanding  of  how  to 
develop  structural  equation  models.  A deliberate  attempt  was  made  to  minimize  matrix  and  statistical  notation  so  the  reader  could 
better  understand  the  structural  equation  modeling  approach. 


Structural  equation  models  establish  the  relationship  bet- 
ween latent  variables  or  constructs  given  a theoretical  perspective. 
The  basis  for  structural  equation  models  is  found  in  multiple  regres- 
sion, path  analyis,  and  factor  analysis  techniques.  A brief  review 
of  these  statistical  approaches  will  be  presented  to  provide  a better 
understanding  and  background  for  the  development  of  structural 
equation  models. 

Overview 

Multiple  regression  is  a widely  accepted  analysis  technique 
and  used  by  educational  researchers.  Multiple  regression  methods 
basically  determine  the  overall  contribution  of  a set  of  observed 
variables  to  the  prediction,  of  another  variable  in  a model,  or 
delineate  the  best  subset  of  multiple  independent  predictors.  A 
multiple  regression  model  is  generally  depicted  as: 

Y'  = P,X,  + P2X2 PnX„. 

where  Y is  the  criterion  variable  or  the  variable  to  be  predicted 
and  X are  the  predictors.  R2,  adjusted  R2,  Cp,  or  PRESS  statistics 
are  used  to  determine  the  ability  of  a set  of  variables  to  predict 
(Younger,  1979).  Multiple  regression  equations  also  permit  the 
use  of  nominal,  ordinal,  effect,  contrast,  or  polynomial  coded 
variables  (Pedhazur,  1982).  The  multiple  regression  approach  how- 
ever is  not  robust  to  measurement  error  and  model  mispecification 
(Bohrnstedt  <Sc  Carter,  1971)  and  forms  an  additive  model  rather 
than  a relational  model,  hence  the  emergence  of  path  analysis. 

Wright  (1921),  a biologist,  developed  path  analysis  to  gain 
a better  understanding  of  genetic  theory.  In  the  early  1960s,  the 
technique  became  popular  in  the  behavioral  and  social  sciences 
(Asher,  1976),  Path  analysis  provides  the  methodology  for  examin- 
ing theoretical  models.  It  essentially  permits  the  determination 
of  data  fit  to  a theoretical  model,  the  specifying  of  a causal  rela- 
tionship from  correlated  data,  and  the  testing  of  alternative  theo- 
retical models  (James,  Muliak,  <Sc  Brett,  1982).  Path  models  are 
analyzed  by  simply  conducting  several  multiple  regression  analyses 
(Williams  <Sc  Klimpci,  1974). 

Path  analysis  equips  the  educational  researcher  with  a 
method  to  specifically  relate  observed  variables  based  upon  theory 
in  a manner  that  is  relational  (causal),  not  additive  as  in  multiple 


regression.  For  example,  Figures  la,  lb,  and  lc  indicate  three  dif- 
ferent ways  a path  model  can  be  depicted  depending  upon  whether 
a correlated  causal  effect,  mediated  causal  effect,  or  independent 
causal  effect  respectively  is  present  (Pedhazur,  1982).  The  advan- 
tage of  path  analysis  over  multiple  regression  analysis  is  this  ability 
to  specify  the  type  of  relationship  among  the  independent  variables 
when  predicting  the  dependent  variable.  The  determination  of 
which  model  is  best  or  correct  however  requires  a theoretical 
perspective  and  model  fit  statistics  to  compare  competing  theo- 
retical models. 


Pedhazur  (1982)  cited  certain  assumptions  which  must  be  met  in 
performing  path  analysis:  (1)  the  relationship  among  the  variables 
in  the  model  should  be  linear,  additive,  and  sausal;  (2)  each  residual 
should  not  be  correlated  with  variable  error  that  precedes  it  in 
the  model;  (3)  there  is  a one-way  vausal  flow  in  the  model;  (4)  the 
variables  are  measured  on  an  interval  scale;  and,  (5)  the  variables 

(continued  on  page  26) 
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Structural  Equation  Modeling  (continued) 


are  measured  without  error.  These  assumptions  continue  to  be 
cited  as  necessary  for  path  analysis  (Baldwin,  1989;  Loehlin,  1992; 
Tracz,  1992).  However,  Boyle  (1970)  and  Lyons  (1971)  previously 
indicated  that  nominal  or  ordinal  variables  arc  pcrmissable  and 
that  path  coefficients  can  be  corrected  for  measurement  error.  In 
addition  to  these  assumptions,  certain  conditions  remain  for  the 
appropriate  use  of  path  analysis:  (1)  temporal  ordering  of  the  vari- 
ables in  the  model;  (2)  covariation  among  the  variables;  and,  (3) 
controlling  for  other  causes  (Pedhazur,  1982).  Tracz  (1992)  has 
recommended  that  path  analysis  be  based  upon  sound  theory, 
utilize  large  samples,  meet  assumptions,  present  both  standardized 
and  unstandardized  path  coefficients,  and  be  replicated  and/or 
cross-validated  to  confirm  conclusions. 

Path  analysis  has  distinct  advantages  over  multiple  regres- 
sion. It  affords  the  ability  to  establish  a causal  relationship  among 
independent  variables,  specify  the  relationship  among  the  inde- 
pendent variables,  and  model  the  complex  nature  of  variable  rela- 
tionships posited  by  theory.  Path  analysis  also  has  certain  limita- 
tions. For  example,  manv  path  models  do  not  include  interaction 
effects  (Newman,  Mnrchant,  Ridenour,  1993)  and  the  observed 
variables  arc  assumed  to  be  perfectly  measured  (Bohrnstedt  <Sc 
Cartcrr,  1971).  Moreover,  the  path  coefficients  are  prone  to  mis- 
interpretation (Tracz,  1992)  and  the  assumption  of  linear  causal 
relationships  precludes  testing  for  apparent  nonlinear  effects  in 
theoretical  models  (Pohlmann,  1991), 

Structural  equation  models  were  developed  to  resolve  the 
problem  of  single  observed  variables  and  their  related  measure- 
ment error  in  path  analysis.  The  measurement  error  of  a single 
variable  tends  to  overstate  or  understate  the  causal  impact  on 
the  disturbance  term  of  a dependent  variable  (Frerichs,  1990a; 
1990b).  Today,  it  is  commonly  accepted  that  multiple  observed 
variables  are  preferred  over  a single  variable  in  defining  a latent 
variable  (Pedhazur  <Sc  Schmelkin,  1992).  Structural  equation  models 
differ  from  path  analysis  models  in  that  they  use  latent  variables 
rather  than  observed  variables  and  combine  a measurement  model 
with  a structural  model  to  substantiate  theory. 

Measurement  Models 

Confirmatory  factor  analysis  methods  reflect  measurement 
models  where  observed  variables  define  constructs  or  latent  vari- 
ables. Latent  variables  arc  considered  to  not  be  di recti v measur- 
able (factors  or  constructs,  e.g.  spatial  abilitv).  Instead,  the  factor 
leading  of  each  observed  variable  indicates  the  correlation  with 
the  construct  of  interest  and  in  sharing  communalitv  (common 
variance)  with  other  variables  identifies  the  latent  variable  (Kim 
Mueller,  1978a;  N78b).  Figure  2a  presents  a measurement  model 
which  defines  two  independent  (ext'geneous)  latent  variables,  home 
background  and  ability,  based  upon  their  respective  observed 
variables.  Figure  2h  presents  a measurement  model  which  defines 
two  de|X.*ndent  (endogeneous)  latent  variables,  occupational  aspira- 
tions and  achievement,  based  upon  their  respective  observed 
variables.  In  the  structural  equation  model  example  presented 


later,  aspirations,  will  also  serve  as  an  independent  (exogcncous) 
variable  when  predicting  achievement. 


The  abilitv  of  the  observed  variables  to  measure  each 
latent  variable  is  assessed  by  h:  or  the  sum  of  the  factor  loadings 
squared  divided  by  the  number  of  variables.  The  expression  1 - h2 
indicates  the  amount  of  variance  not  explained  or  the  degree  to 
which  the  latent  variable  is  not  defined  bv  the  observed  variables. 
The  measurement  model  (confirmatory  factor  analysis)  reflects  how 
reliable  the  observed  variables  are  in  defining  the  latent  variables. 

Structural  Equation  Models 

Structural  equation  models  establish  the  relationship  be- 
tween the  latent  variables  (factors).  Structural  equation  modeling 
is  also  referred  to  as  covariance  structure  analysis,  latent  variable 
analysis,  or  linear  structural  relationships  (Duncan,  1975;  Loehlin, 
1992).  Structural  equation  models,  in  establishing  latent  variable 
relationships,  differ  from  either  path  analysis  or  factor  analysis 
which  use  observed  variables  (Lomax,  1982;  Long,  1983).  Struc- 
tural equation  models  have  become  widely  used  in  the  social  and 
behavioral  sciences  to  combine  the  confirmatory  factorial  measure- 
ment model  with  the  structural  relationship  among  the  latent 
variables  (Saris  Stronkhorst,  1984;  Anderson,  1987;  Fassinger, 
1987;  Bollen  Ting,  1991). 

Structural  equation  modeling  has  been  shown  to  be  re- 
lated to  multiple  regression,  path  analysis  and  factor  analysis  tech- 
nique^ (Svhumacker,  1989).  Factor  analysis  establishes  the  measure- 
ment models  whereby  several  observed  variables  serve  to  define 
the  latent  variables  ol  interest.  In  structural  equation  models, 
these  measurement  models  arc  determined  for  both  independent 
latent  variables  and  dependent  latent  variables.  Multiple  regres- 
sion techniques  permit  the  formulation  of  a structural  equation 
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Structural  Equation  Modeling  (continual) 


which  specifies  the  prediction  of  the  dependent  latent  variable(s) 
hv  the  independent  latent  variables(s).  Path  analysis  provides  the 
framework  in  which  to  diagram  the  specific  relationships  between 
the  independent  and  dependent  latent  variables  of  interest  given 
a theoretical  perspective.  A structural  equation  model  example 
that  combines  the  latent  variables  previously  mentioned  and 
which  has  been  used  elsewhere  for  illustrative  purposes  is  in  Figure 
3 (Joreskog,  1973). 


Figure  3 
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The  observed  variables  income  (Y5),  father’s  education 
(Y6),  and  mother’s  education  (Y7)  with  their  respective  error 
terms  define  the  latent  variable  home  fiacfcgroimd  (F3);  the  ob- 
served variables  verbal  ability  (Y8)  and  quantitative  ability  (Y9) 
with  their  respective  error  terms  define  the  latent  variable  ability 
(F4);  the  observed  variables  education  aspirations  (VI)  and  aspira- 
tions (Y2)  with  their  respective  error  terms  define  the  latent  vari- 
able aspirations  (FI);  and  finally  the  observed  variables  verbal 
achievement  (Y3)  and  quantitative  achievement  (V4)  with  their 
respective  error  terms  define  the  latent  variable  achictcmenf  (F2). 
These  comprise  the  measurement  models.  Home  background  (F3) 
and  ability  (F4)  are  exogeneous  (independent)  latent  variables 
that  covarv  in  predicting  aspirations  (FI),  an  endogenous  (depen- 
dent) latent  variable  with  error  (Dl).  Also,  home  background, 
ability,  and  occupational  aspirations  predict  achievement  (f2),  an 
endogeneous  latent  variable  with  error  (02).  These  comprise  the 
structural  equation  models. 

F.QS,  a computer  program  which  does  not  require  matrix 
notation  for  expressing  the  measurement  and  structural  equations, 
has  been  developed  for  analyzing  structural  equation  models 
(Bender,  l°S0i.  EQS  programs  ik‘  lour  basic  prefixes  to  specify 
equations:  observed  variables  (\‘),  observed  variable  error  (F), 
latent  variables  (F).  and  latent  variable  error  (P).  The  < SPECIFI- 
CATIONS statement  indicates  the  number  of  cases,  number  of 


variables,  and  the  method  of  a.  .alysis,  e.g.  least  squares,  maximum 
likelihood.  The  /EQUATIONS  statement  identifies  which  ob- 
served variables  define  which  latent  variables  and  their  corres- 
ponding residual  error  as  well  as  the  structural  equations  which 
relate  the  latent  variables.  The  equations  are  taken  directly  from 
the  observed  and  latent  variable  relationships  diagrammed  in  the 
model.  The  /VARIANCES  statement  indicates  which  error  term 
parameters  are  to  be  estimated.  The  /COVARIANCES  statement 
indicates  that  the  error  terms  for  fathers  education  and  mother's 
education  covary  as  does  the  latent  variables  home  background 
and  ability.  The  /DIAGRAM  statement  will  draw  the  structural 
equation  model.  The  measurement  models  (Figures  2a,  2b),  in 
equation  form,  would  be  expressed  as: 


education  aspiration?  = 
occupational  aspirarions  = 
verbal  achievement  ~ 
quantitative  achievement  = 
income  = 
fathers  education  = 
mothers  education  = 
verbal  ability  - 
quantitative  ability  = 


aspirations 

Jr 

error 

aspirations 

+ 

error 

achievement 

4- 

error 

achievement 

+ 

error 

home  background 

+ 

error 

home  background 

+ 

error 

home  background 

4- 

error 

ability 

-r 

error 

ability 

* 

error. 

and  the  structural  models  (Figure  3),  in  equation  form,  expressed  as: 

aspirations  = homeback  ground  -»*  abilitv  + + error 

achievement  = homebackgnound  + abilitv  + aspirations  + error. 


The  EQS  program  to  conduct  the  structural  equation 
model  analysis  is  in  the  Appendix.  As  in  path  analysis,  structural 
equation  models  should  have  an  appropriate  theoretical  frame- 
work. Any  proposed  model  has  assumptions  which  involve  speci- 
fication, estimation,  and  the  testing  of  alternative  models.  The 
theoretical  proposed  models  are  substantive  in  nature  and  as  such 
the  goodness-of-fit  statistics  guide  the  interpretation  of  results 
(Bender,  1990,  Bollen,  1989;  Muliak,  et  nl.,  1989),  The  emphasis  is 
on  data  fitting  d to  theoretical  model,  not  the  model  fitting  the  data. 


Discussion 

James,  Mulaik,  and  Brett  (1982)  proposed  a two-step  model 
approach  which  emphasized  the  analysis  of  the  two  conceptually 
distinct  latent  variable  models:  measurement  and  structural.  Ander- 
son and  Gerhing  (1988)  described  their  approach  by  stating  that 
the  measurement  model  provides  an  assessment  of  convergent 
.and  discriminant  validity  and  the  structural  model  provides  an 
assessment  of  predictive  validity.  Muliak,  et  a!.  (1989)  further  ex- 
panded the  idea  of  assessing  the  fit  of  the  structural  equation 
model  among  latent  variables  (structural  model)  independent  of 
assessing  the  fit  of  the  observed  variables  to  the  latent  variables 
(measurement  model).  Their  rationale  was  that  with  few  latent 
variables,  mist  parameter  estimates  define  the  relationships  of  the 
observed  variables  to  the  latent  variables  in  the  measurement 
model,  rather  than  the  structural  equation  relationships  of  the 

(amlimad  on  payc  28) 


Structural  Equation  Modeling  (continued) 

latent  variables  themselves.  A discussion  remains,  but  regardless 
of  a one  or  two-step  approach,  care  should  be  taken  to  define  in 
a valid  and  reliable  manner  the  latent  variables  prior  to  deter- 
mining how  well  they  predict  in  the  structural  equations. 

Summary 

Loehlin  (1992)  and  Schumacker  (1989)  have  previously 
indicated  that  structural  equation  models  merge  multiple  regres- 
sion, path  analysis,  and  factor  analysis  techniques  into  a single 
data  analytic  framework.  Baldwin  (1989)  provided  additional  infor- 
mation concerning  assumptions  and  how  structural  equation 
modeling  is  used.  This  article  focused  on  how  to  develop  struc- 
tural equation  models  using  path  diagrams  and  the  concepts  of 
measurement  and  structural  equation  models. 

Basically,  confirmatory  factor  analysis  provides  the  mea- 
surement model  for  defining  latent  variables,  multiple  regression 


yields  the  structural  equations  between  the  independent  (exo- 
geneous)  latent  variables  and  the  dependent  (endogeneous)  latent 
variables,  while  path  analysis  affords  the  rudiment  for  diagram- 
ming the  model.  Structural  equation  modeling  involves  the  devel- 
opment of  both  measurement  models  and  structural  equations. 

The  use  of  structural  equation  models  which  establish  the 
relationships  among  the  latent  variables  are  subject  to  substantive 
theory  or  model  assumption  validity  as  in  path  analysis.  The  use 
of  this  methodology  is  also  impacted  by  the  requirement  of  suffi- 
cient sample  size,  interpretation  of  model  fit  statistics  which  lack 
known  distributional  properties,  missing  data,  outlier  effects, 
model  identification,  multivariate  normality,  and  research  hypo- 
thesis testing  concerns  (Fornell,  1983).  Bagozzi  and  Yi  (1988)  also 
cited  problems  with  the  evaluation  of  model  fit  and  concerns 
related  to  validity,  cross  validation,  power,  and  generalizations 
from  structural  models.  Future  research  will  further  clarify  these 
issues  given  the  usefulness  of  structural  equation  models. 
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Insidious  Structural  Errors  in 
Latent  Variable  Models 

By  John  T.  Pohlmann,  Southern  Illinois  University,  Carbondale 


Abstract 

This  article  illustrates  a specification  error  problem  in  a simple  structural  model.  A quadratic  relationship,  described  by  a linear 
structural  model  with  a latent  variable,  is  shown  to  have  less  predictive  validity  than  a simple  manifest  variable  regression  model.  The 
use  of  simpler  analyses  that  require  fewer  structural  assumptions  is  advocated  as  a preliminary  analysis  to  latent  variable  structural 
modeling.  A discussion  of  the  role  of  statistical  models  in  the  detection  of  causal  relationships  is  also  provided. 


John  Stuart  Mill  advocated  experimentation  for  the  detec- 
tion of  causal  mechanisms.  Mill  established  empirical  guidelines 
for  researchers  pursuing  causal  hypotheses  with  his  Canons  of 
Agreements,  Differences  and  Residues  (Harre,  1972,  p.  38;  Hol- 
land, 1988).  Letting  X and  Y represent  events  which  are  respec- 
tively a cause  and  an  effect,  experimental  methods  provide  con- 
vincing evidence  for  the  proposition  “X  is  a cause  of  Y”  because 
a positive  outcome  from  a well-designed  experiment  ensures  three 
things:  1.  X temporally  precedes  Y,  2.  X and  Y are  related,  and  3. 
all  other  influences  on  X and  Y arc  controlled  (Kenny,  1979,  p.  3). 
In  this  scheme  X is  an  independent  variable  and  Y is  a depen- 
dent variable.  Temporal  sequencing  is  established  in  an  experi- 
ment by  first  manipulating  X and  then  measuring  Y.  Point  2 is 
established  if  a nonrandom  association  is  observed  between  X 
and  Y.  Finally,  point  3 is  assured  if  the  experiment  is  properly 
designed.  Nonexperimental  causal  investigators  look  for  these 
three  sources  of  evidence  in  natural  systems  of  variables. 

Temporal  sequences  of  variables  can  be  detected  using 
longitudinal  observation  designs.  Relationships  between  variables 
are  easy  to  detect  with  modern  computers.  If  X and  Y are  vari- 
ables measured  on  a random  sample,  we  can  examine  hypotheses 
of  the  form: 

H0:  E(Y1X  = c)  = E(YIX  = d) 

where  E is  the  expectation  operator  and  c and  d arc  any  two 
distinct  values  in  the  sample  space  of  X.  Rejection  of  such  hypo- 
theses leads  to  the  conclusion  that  X is  related  to  Y. 

On  the  other  hand,  control  of  extraneous  variables  is  a 
problematic  issue  in  nonexperimental  designs.  The  experimental 
techniques  of  randomization  and  holding  variables  constant  are 
usually  replaced  with  statistical  controls  or  targeted  sampling  in 
nonexperimental  studies.  One  can  only  control  for  v ariables  that 
have  been  measured.  And  we  only  measure  those  variables  which 
are  thought,  a priori,  to  be  important.  There  always  exists  the  pos- 
sibility that  some  antecedent  unmeasured  variable  might  produce 
a spin  ious  relationship  between  X and  Y which  would,  in  turn, 
give  only  the  illusion  of  a causal  relationship  to  the  naive  observer. 

The  analysis  of  linear  structural  relations  is  the  statistical 
method  of  dunce  for  nuxlern  causal  analysis  in  nonexperimental 
settings.  These  analyses  estimate  linear  model  structures  which 


are  presumed  to  describe  the  causal  mechanisms  governing  vari- 
ables. The  underlying  models  for  these  analyses  are  guided  by 
Mill’s  criteria  listed  above.  Additionally,  linear  measurement  models 
may  be  imposed  on  the  observations,  in  which  measured  or  mani- 
fest variables  are  assumed  to  be  caused  by  unmeasured  latent 
variables.  The  structural  assumptions  linking  the  manifest  and 
latent  variables  are  linear  in  form  and  the  latent  variables  are  esti- 
mated from  linear  combinations  of  the  manifest  variables. 

This  critique  will  address  two  insidious  specification  errors 
associated  with  the  common  use  of  these  models:  1.  nonlinear 
causal  patterns  and  2.  prediction  with  latent  variables  instead  of 
manifest  variables.  These  errors  can  result  in  serious  misinterpre- 
tations which  will  be  illustrated  here. 

Linear  relationships  between  variables  are  usually  assumed 
because  of  the  simplicity  of  the  models  which  result.  The  rela- 
tionship between  two  variables  can  be  conveniently  described  by 
one  structural  parameter-a  slope.  Latent  variables  are  also  used  in 
structural  models  in  order  to  simplify  an  analysis.  Simpler  models 
result  if  many  manifest  variables  can  be  subsumed  under  a fewer 
number  of  latent  variables.  While  simplicity  and  parsimony  are 
desirable  attributes  of  models,  there  is  a much  more  fundamental 
attribute  which  should  guide  us-accuracy. 

The  matrix  expression  for  the  most  general  linear  struc- 
tural model  is  given  by 

pn  = r^  + c (i) 

where  B is  a matrix  of  the  coefficients  of  the  effects  of  the  en- 
dogenous variables  on  endogenous  variables,  is  a vector  of 
latent  endogenous  variable,  T is  a matrix  of  coefficients  measur- 
ing the  effects  of  the  exogenous  latent  variables  & on  the  en- 
dogenous latent  variables  and  £ is  a vector  of  errors. 

The  manifest  endogenous  and  exogenous  variables  arc 
assumed  to  be  determined  by  latent  variables  in  two  measure- 
ment models 

y = AyTj  + e (2) 

and 

x — ax^  +5  (3) 

where  y and  x are  manifest  endogenous  and  exogenous  variables 
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respectively,  T|  and  £ are  the  corresponding  latent  variables, 
Ay  and  Ax  are  the  structure  coefficients  and  £ and  5 are  the 
respective  errors  of  measurement.  In  the  above  expressions  all 
manifest  and  latent  variables  are  assumed  to  be  standardized. 

Figure  1 below  presents  a path  diagram  for  a simple  struc- 
tural model  with  two  latent  variables.  Three  exogenous  and  two 
endogenous  variablesare  expressed  in  the  model  as  working 
through  latent  variables  and  ^ll  respectively. 


The  structural  parameters  denoted  in  Figure  1 and  Yi)  des- 
cribe linear  relationships.  Xj  is  a factor  loading  or  the  slope  of 
the  standardized  regression  of  XI  on  ^ , and  Yi  i is  the  slope  of 
the  standardized  regression  of  'Hi  on  ^ . Clearly,  if  the  latent 
and  causal  structures  are  not  linear  then  the  model  represented 
in  Figure  1 would  not  accurately  describe  the  relationships  among 
the  variables. 

Also  the  model  of  Figure  1 transmits  the  causal  influence 
of  Xh  X2  and  X3  through  ^ , a latent  variable.  If  this  model 
is  correct,  then  the  use  of  ^ is  justified  over  the  use  of  the 
separate  predictors,  X„  X2  and  X3,  because  ^ will  be  measured 
more  reliably  than  the  individual  Xs.  An  implicit  assumption  is 
made  here— Xh  X2  and  X3  have  no  specific  or  direct  influence  on 


Figure  2 

Model  2 for  ’Hi  with  no  Latent  Variable  for  the  Xs 


% and  Y2.  If  a researcher  suspected  direct  and  specific  linkages 
between  the  Xs  and  Ys,  an  alternative  to  the  model  in  Figure  1 
might  be  explored. 

The  model  described  in  Figure  2 frees  Xh  X2,  and  X3 
from  a common  latent  variable  and  allows  them  the  have  separate 
structural  parameters  ' (Yi , Y2  Y3)  with  respect  to  T|l  . This 
model  fits  an  ordinary  regression  equation  to  T|  | with  three  pre- 
dictors: Xj,  X2  and  X3. 

The  following  example  serves  to  illustrate  the  specifica- 
tion error  problem  discussed  here.  Assume  that  two  exogenous 
independent  variables  (XI  and  X2)  are  used  to  explain  one  en- 
dogenous dependent  variable  (Y).  Table  1 presents  the  correlation 
matrix  among  the  variables. 


Table  1 

The  Correlation  Matrix  for  XI,  X2  and  Y 


XI  X2  X3 

XI 1.0000  .9655  .0000 

X2  1.0000  -.2606 

X3  1.0000 


The  empirical  basis  for  a latent  variable  is  the  observation 
of  correlated  manifest  variables.  The  two  independent  variables 
in  the  above  illustration  are  so  highly  correlated  that  a researcher 
could  reasonably  conclude  that  they  are  derived  from  a common 
latent  variable.  XI  and  X2  could  then  be  combined  to  form  a 
highly  reliable  measure  of  that  latent  variable.  In  this  example, 
the  Spearman-Brown  prophesy  formula  yields  a reliability  estimate 
for  (XI  + X2)  of  .9824.  The  correlation  matrix  also  suggests  that 
Y is  not  very  strongly  determined  by  XI  and  X2.  Figure  3 shows 
the  solved  structural  model. 


Figure  3 

A Latent  Variable  Model  for  Y 
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Not  surprisingly,  this  solution  shows  a very  strong  latent  struc- 
ture linking  XI  and  X2  with  . Factor  loadings  of  .9913  are  in- 
deed large.  Also  a weak  structure  links  £ { with  Y (y1=  —.1317) . 

Yi  was  estimated  by  regressing  Y on  a standardized  principal 
factor  score  for  XI  and  X2.  A researcher  might  despair  at  these 
results  since  they  suggest  a very  poor  model  for  Y.  Before  leaving 
this  data  set,  though,  the  researcher  might  attempt  another  model 
in  which  XI  and  X2  ere  not  constrained  to  estimate  a latent 
variable.  Figure  4 shows  the  solution  using  an  ordinary  path 
analysis  model  on  the  manifest  variables. 


The  picture  changes  markedly  when  XI  and  X2  are  freed 
from  their  latent  variable.  This  model  explains  100  percent  of  the 
variance  in  Y.  Clearly,  the  best 
model  for  Y is  an  ordinary 
regression  model  using  XI  and 
X2  as  separate  predictors.  This 
situation  seems  paradoxical 
since  there  is  such  a high  cor- 
relation between  XI  and  X2. 

Insight  into  this  seem- 
ing paradox  may  be  had  by 
examining  the  raw  data  values 
in  Table  2.  XI  consists  of  con- 
secutive integers  ranging  from 
0 to  20.  X2  is  the  square  of 
XI,  and  Y = X/  - .05X2. 

Y is  a perfect  quadratic  func- 
tion of  XI , and  this  is  why  the 
initial  linear  structural  models 
did  not  predict  very  well.  All 
variables  were  standardized 
to  produce  the  solution  pre- 
sented in  Figure  4.  In  raw 
score  terms  the  model  for  Y 
would  be: 


Y = 0 + XI  - .05X2  (4) 

Figure  5 shows  the  scatter  plot  and  the  line  of  best  fit  when  Y is 
regressed  on  XI.  An  ordinary  regression  model  using  XI  and 
X2  to  predict  Y would  fit  the  quadratic  relationship  between 
XI  and  Y.  The  model  portrayed  in  Figure  4 was  just  such  a model. 


Figure  5 

Scatter  Plot  and  Regression  of  Y on  XI 


When  variables  are  combined  to  estimate  latent  variables, 
their  weighting  coefficients  are  solved  which  maximize  the  relia- 
bility of  estimating  the  latent  variable.  An  estimate  of  t,  (tf) 
is  obtained  using  a linear  combination  of  the  Xs  as  follows 

S'  = SajXj  (5) 

The  weights,  are  the  factor  scoring  coefficients.  The  impor- 
tant point  being  that  the  values  arc  not  influenced  by  the 
relationships  between  the  £ and  T|  latent  variables.  Whereas  a 
path  analytic  model  using  manifest  independent  variables  pro- 
duces weights  for  the  Xs  which  maximally  predict  the  variance 
of  the  Ys  or  a latent  variable  estimate  using  the  Ys.  So  one  should 
not  expect  a latent  variable  model  for  the  ^s  to  be  more  predic- 
tive than  a simple  path  model  on  manifest  variables. 

There  are  certain  special  conditions  that  would  lead  to 
equivalent  solutions  for  a manifest  variable  path  analysis  and  a 
latent  variable  analysis:  (1)  the  factor  scoring  weights  are  propor- 
tional to  the  corresponding  least  squares  path  coefficients,  and 
(2)  the  Xs  have  no  specific  variance  components  which  relate 
to  the  Ys.  But  these  are  onerous  assumptions  and  certainly  un- 
tenable for  most  applications. 

These  assumptions  are  testable  inferentially.  An  F test 
could  be  used  to  compare  the  models  of  Figures  3 and  4.  The 
models  in  Figures  4 and  3 could  serve  as  the  full  and  restricted 
models  respectively. 

Full  Model:  Y = p()  + (3,Xl  - P2X2  = ef 

Where  the  p cc  ‘ficicnts  are  the  regression  parameters  and  £f 
is  the  error  term.  The  null  hypothesis  states  that  the  regression 
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Table  2 

The  Raw  Data  Values  for 
XI  t X2  and  Y 

XI 

X2 

Y 

0 

0 

0.00 

1 

l 

0.95 

*) 

4 

1.80 

3 

9 

2.55 

4 

16 

3.20 

5 

25 

3.75 

6 

36 

4.20 

7 

19 

4.55 

8 

64 

4.80 

9 

81 

4.95 
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coefficients  (pt)  are  proportional  to  ihe  factor  scoring  weights  (aj) 
Hq:  Pi/a1  = p2/a2,  or 
Hq:  p2  = Pl(a2^a0 

And  since  £/  is  estimated  by  Za^X;  in  the  model  of  Figure  3, 
the  restricted  model  would  become 

Restricted  Model:  Y = pG  + pi  (a1x1  + a2x2)  + ^ 

Y - Po+  Pi  ^ + £r  ® 

Again  the  p values  denote  the  regression  parameters  and  £r 
represents  the  error  term  for  the  restricted  model  The  F ratio 
would  have  1 and  n-3  degrees  of  freedom. 


Conclusion 

This  illustration  has  shown  that  nonlinear  relationships  and 
latent  variable  assumptions  can  lead  to  serious  specification  errors 
in  structural  models.  While  linear  structural  analysis  is  a very 
convenient  and  powerful  technique,  an  analyst  must  be  aware 
of  the  structural  assumptions  made  when  the  model  is  specified. 
Simpler  analyses,  such  as  inspection  of  scatter  diagrams  and  tests 
for  linearity,  are  prudent  preliminary  analyses.  Latent  variable 
models  should  not  automatically  be  fit  unless  they  have  been 
statistically  compared  to  manifest  variable  models.  Because,  as 
this  illustration  has  shown,  highly  reliable  latent  variables  can 
produce  models  with  poorer  validity  than  manifest  variable  models. 
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Student  Assessment 
of  an  Electronic  Learning  System 

By  Mark  Charles  Fissel,  Ball  State  University 


Two  fundamental  problems  face  institutions  installing 
electronic  learning  systems:  will  faculty  use  the  system  and  will 
students  benefit?  This  article  addresses  the  latter  question.  Most 
faculty  and  administrators,  unlike  educational  specialists,  do  not 
always  pause  to  pose  pedagogical  questions  or  prepare  evaluatory 
mechanisms  for  new  learning  technologies  (Jackson,  1990;  Ehr- 
mann, 1988).  When  Ball  State  University  (21,000  students)  installed 
its  “Video  Information  System”  in  1989,  it  had  few  paradigms 
from  which  to  frame  evaluatory  mechanisms,  as  it  was  the  first 
system  of  its  kind  to  be  installed  in  a university  (Fissel,  1990). 
Nor  did  the  students  know  what  to  expect,  many  of  them  being 
first  semester  freshmen  with  no  college  learning  experience.  This 
study  focused  on  this  “first  generation,”  student  opinions  being 
solicited  in  the  first  complete  course  offered  entirely  with  VIS 
support  through  a full  semester.  The  student  responses  were  ex- 
tremely positive.  The  integrated  information  system  promises  to 
invigorate  the  university  curriculum  at  a time  when  state  legis- 
latures and  trustees  are  demanding  better  education  for  the  insti- 
tutional dollar. 

The  Instructional  Delivery  System 

The  Video  Information  System  permits  the  fiber-optic 
distribution  of  teaching  media  (video  and  audio  cassettes,  optical 
laser  disks,  Ihmm  films,  video  floppies,  etc.)  from  a central  re- 
source facility  in  the  University  Library.  Computer  interfacing  is 
also  possible.  Losing  a touch  panel  equipped  with  a multi-media 
control  pad,  telephone,  data  jack  and  wireless,' faculty  select  and 
control  the  presentation  of  audio-visual  materials.  Information 
mows,  not  the  equipment.  What  was  once  scrawled  on  a black- 
board or  overhead  projector  is  presented  in  a tidier  fashion  through 
graphics  generated  hv  computers,  most  often  digitally  recorded 
on  video  floppy  disks. 

A new  video  switch  (50  inputs  by  100  outputs)  has  been 
added  to  the  three  extant  switches,  expanding  the  system’s  de- 
livery capacity  and  making  operational  nearly  300  rooms  on 
campus.  Of  the  155  room"  exclusively  set  aside  for  teaching,  135 
now  have  VIS  capability.  A specially-designed  computer,  which 
tan  accommodate  within  minutes  faculty  requests  for  material, 
command"  the  switch  to  route  a specific  visual  and  ;or  audio  source 
to  a particular  classroom,  and  then  relinquishes  control  of  that 
source  to  the  instructor,  at  the  cla^room  control  box. 

VIS  reioncile"  the  dualism  of  analog  (video)  and  digital 
(computer)  instruction.  1 he  fact  is  that  faculty  do  not  have  to 
bother  with  conversion  from  one  platform  to  another.  The  media 
sources,  be  the\  analog  or  digital,  are  converted  to  analog  when 
the  sienals  go  through  the  "Witch.  An  FM  transmitter  "end"  tlu 


instructional  medium  through  the  fiber  as  a light  signal,  which 
is  then  converted  by  the  classroom  receiver  and  decodes  it  to  a 
standard  video  (NTSC)  signal,  which  is  then  displayed  on  the 
monitor.  The  students  and  instructors,  however,  need  not  bother 
with  all  this.  The  teacher  need  not  be  a technician,  and  the  stu- 
dents receive  their  instruction  without  the  intrusion  of  sundry 
contraptions  wheeled  into  the  room. 

Not  only  does  the  instructor  control  the  media,  but  often- 
times creates  them  as  well.  The  system  encourages  curriculum 
development.  Faculty  design  and  assemble  visual  databases  and 
draw  from  them.  According  to  Tom  Beatty,  Director  of  VIS,  teachers 
enjoy  flexibility'  in  selecting  media.  “Videotape  is  our  most  popular 
medium,  accounting  for  58  percent  of  our  use.”  Beatty  adds  that 
video  floppy  technology  has  increased  in  popularity,  virtually 
replacing  35mm  slides.  As  the  “digital  revolution”  proceeds,  faculty 
are  initiating  computer  interfaces,  and  the  use  of  CD-I  has  begun. 

The  Study 

The  study  reported  here  consisted  of  more  than  300  under- 
graduates taking  a required  general  studies  course  in  an  auditorium 
previously  equipped  only  with  a microphone  and  overhead  pro- 
jector. VIS  was  utilized  from  the  very  first  day  of  class.  At  the 
end  of  the  term,  students  were  asked  about  the  system,  including 
whether  or  not  it  helped  their  note-taking,  made  the  text  book 
more  understandable,  encouraged  their  learning,  and  what  advan- 
tages and  disadvantages  they  perceived. 

In  analyzing  student  responses,  one  should  be  aware  that 
the  students  have  no  official  means  by  which  to  determine  which 
classes  are  supported  by  VIS.  Likewise,  faculty  could  not  always 
count  on  being  fortunate  enough  to  be  assigned  to  an  equipped 
room.  Initially  180  receive  and  control  sites  were  selected  through- 
out the  600-acre  university,  out  of  roughly  300  classrooms,  labs, 
conference  rooms,  and  auditoriums  available  for  instructional 
purposes.  Consequently,  students  cannot  choose  an  “electronic 
curriculum”  nor  can  faculty  be  certain  that  all  sections  of  a given 
course  will  he  able  to  be  taught  with  VIS. 

The  Curriculum  and  the  Questions 

The  database  for  the  western  civilization  course  consisted 
primarily  of  about  850  graphics  (diagrams,  slides,  etc.),  recorded 
on  an  eight  inch  optical  laser  disk.  There  were  made  up  of  maps, 
illustration*  with  explanatory  graphics  (photographs  of  locations, 
portrait*  of  historical  figures  examples  ol  art  work,  etc.),  computer* 
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generated  diagrams  (such  as  Parliament,  the  feudal  system,  etc), 
quotations,  concepts,  and  vocabulary.  Arranged  in  linear,  chrono- 
logical  succession,  the  images  formed  the  informational  backbone 
of  the  course.  While  the  graphics  appeared  on  a 16-foot  screen 
above  the  auditorium  stage,  the  lectures  amplified  and  embellished 
the  visual  material.  The  optical  disk  was  supplemented  by  video 
floppies  as  well  as  VHS  and  SVHS  cassettes.  Video  modules 
(commercial  and  custom-made)  were  inserted  in  the  course  at 
appropriate  points. 

How  students  learn  through  technology  is  a matter  of 
intense  study  (Kozma,  1991;  Dwyer  <Sc  Dwyer,  1985;  Joseph  <Sc 
Dwyer,  1984;  Parkhurst  Dwyer,  1983).  This  study  concentrated 
on  the  students’  perceptions  of  electronic  learning.  Did  they  think 
they  were  learning  more?  Did  VIS  help  them?  Did  it  aid  them  in 
note-taking  and  text-reading?  Showcased  are  the  students'  reac- 
tions and  their  opinions  of  integrated  information  system  teaching 
and  visualized  instruction. 

Results  * 

Eighty -seven  percent  of  the  314  students  believed  that  the 
integrated  information  system  helped  them  learn.  Eight  percent 
were  neutral.  VIS  appeared  to  help  undergraduates  conceptalize, 
especially  in  converting  ideas  presented  verbally  into  mental  images. 
Students  ‘‘remembered  pictures  from  VIS”  during  subsequent 
examinations.  One  described  himself  as  a “visual  learner”  and 
another  felt  that  the  system  provided  “visual  reference”  points. 
As  a result,  the  graphics  “made  the  material  easier  to  remember 
and  study.”  Undergraduates  saw  this  as  a means  to  better  per- 
formance and  higher  grades:  “During  the  test  I could  sometimes 
visualize  part  of  the  lecture  the  [exam)  question  was  dealing  with.” 
The  system  facilitated  concept-mapping  (Novak  & Govvin,  1986). 
If  it  is  true  that  visual  and  audio  data  are  stored  in  different 
fashions  by  the  human  brain,  then  the  combination  of  traditional 
lecture  with  an  integrated  information  system  would  enable  stu- 
dents to  retain  more  information  (Paivio,  1971).  The  evaluations 
bore  out  this  theory:  “When  you  have  visual  and  hearing  at  the 
same  time,  you  will  always  comprehend  more.”  “Pictures  and  maps 
really  helped  reinforce  ideas;”  “[VIS]  increased  my  learning  capa- 
bilities." The  system  nurtured  confidence  in  students,  assuring 
them  that  they  could  learn,  ns  well  a*  actuallv  teaching  them. 
The  system,  often  working  in  conjunction  with  the  University 
College  Learning  Center’s  Supplemental  Instruction  program, 
provided  freshmen  with  guidance  in  processing,  retaining  and 
mastering  a bewildering  amount  of  data  (Kirkwood,  1902). 

Note-taking  is  one  of  the  first  challenges  to  face  the  under- 
graduate, and  rarelv,  if  ever,  are  freshmen  told  how  to  take  note'*. 
We  have  assumed  that  thev  will  develop  this  skill  intuitively  (Pauk, 
1°78).  Y1S  enable''  freshmen  to  grasp  the  essentials  of  note-taking 
from  the  verv  first  dav  of  c lass,  using  the  monitor  as  a telcpmmpter. 
Nmctv-one  percent  of  M6  respondents  voiced  the  opinion  that 
VIS  had  helped  their  note-taking,  with  five  percent  remaining 
neutral.  Their  remarks  are  self-explanatory:  “The  needed  note* 


were  readily  available  and  easy  to  read”  thanks  to  large  graphics 
presented  on  the  screen,  where  they  remained  while  that  topic 
was  being  discussed.  The  system  “kept  notes  organized”  and  “gave 
more  life  co  notes.”  They  “could  see  the  main  idea”  and  “didn’t 
have  to  rush”  to  keep  up.  Correct  spellings  were  presented  at  the 
outset  and  key  vocabulary  were  highlighted.  Electronic  learning 
“helped  outline  the  material.’*  Not  the  least  consideration  was  the 
fact  they  did  not  have  to  “decipher”  a professor’s  sometimes  unclear 
handwriting,  another  clear  advantage  over  the  cumbersome  and 
sloppy  overhead  projectors  of  old.  “Seeing  and  hearing  made  note 
taking  easier,”  again  emphasizing  the  efficiency  of  synchronized 
audio  and  visual  teaching.  Students  were  explicit  in  their  opinions: 

• “I  didn’t  know  what  a college  prof  wanted.  VIS  made 
it  a lot  easier.” 

• “You  could  read  what  was  important  clearly  from  any- 
where in  the  class." 

• “I  could  read  it  ifl  didn’t  hear  it  correctly.” 

• “1  could  keep  more  attention  on  what  the  instructor 
was  saying  and  not  miss  information.” 

• “VIS  saved  time  because  the  instructor  didn’t  have  to 
write  things  out.” 

• “A  key  word  or  passage  on  the  screen  aided  in  retention 
because  it  associated  the  key  word  with  a picture.” 

• “Seeing  pictures  and  diagrams  helps  get  me  in  the  mood 
for  note-taking." 

Clearly,  the  system  helped  dc-mystify  note-taking  for  many 
students.  VIS  “clafifies  and  summarizes  the  main  points  and  makes 
note-taking  and  retention  easier  by  visualization.”  As  a technology 
solution,  the  instantaneous  transmission  of  custom  graphics  is 
fairly  simple.  Computer-generated  graphics  can  be  fashioned  quickly 
through  new  software  programs,  and  at  Ball  State,  student  assis- 
tants oftentimes  operate  the  computers  and  help  faculty  design 
curricula.  The  collaborative  experience  brings  together  teachers 
and  students. 

VIS  makes  large  lower  division  lecture  courses  more  palat- 
able to  both  facultv  and  students.  Scores  of  undergraduates  pointed 
out  that  being  taught  through  an  integrated  information  system 
was  “interesting,  entertaining  and  educational.”  Some  were  more 
candid:  “this  is  the  first  history  class  I have  been  able  to  tolerate— 
I'm  usually  bored”  and  "I  hated  history,  hut  [Y1S|  made  the  class 
interesting.”  Perhaps  the  latter  two,  unintentionally,  are  the  most 
encouraging  remarks.  Larger  classes,  which  are  inescapable  in  the 
1°90>  ;md  beyond  due  to  teacher  shortages,  are  sure  to  proliferate. 
Irremediable  demography  trends  will  reduce  the  number  of  quali- 
fied faculty  at  a time  when  enrollments  are  increasing.  Teachers 
and  administraiors  will  he  pressured  hv  legislators,  alumni  and 
parents  demanding  a more  efficacious  educational  environment, 
and  inflating  classroom  enrollments.  Quality  education  can  he 
made  compatible  with  large  lecture  sections  without  the  aliena- 
tion of  students  and  the  exhaustion  of  teachers.  The  s\  stem  inte- 
grates the  educational  experiences. 

Manipulation  and  arrangement  of  information  remains 
one  of  the  great  challenges  to  elec  ironic  learning  (Vanelos,  ct.  aid 
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1984).  Moving  masses  of  data  is  meaningless  if  humans  cannot 
handle  them  (Gazzaniga,  1984;  Kahneman,  1973).  Students  referred 
to  VIS’s  ability  to  select  randomly  within  a matter  of  seconds 
many  of  the  graphics  used  during  the  semester.  After  class,  stu- 
dents would  gather  at  the  instructor’s  lectern  and  clear  up  any 
areas  of  confusion  by  accessing  graphics  from  any  point  in  the 
course.  Informal  review'  sessions  were  supplemented  by  small  dis- 
cussion sections  in  classrooms  also  wired  for  the  VIS.  Hence,  grad- 
uate  assistants  were  capable  of  summoning  up  the  very  same 
visuals  used  in  class,  plus  any  of  their  own  making. 

Video  and  Reading 

Another  benefit  in  regard  to  information  processing  came 
about  in  regards  to  textbook  reading  assignments.  Of  course, 
students  are  supposed  to  read  before  attending  lectures.  But  very 
often  the  ideal  fails  to  meet  reality.  During  the  semester  a number 
of  students  remarked  that  the  VIS  had  made  the  once  tedious 
task  of  textbook  assimilation  somewhat  more  interesting.  At  the 
course’s  end,  of  315  respondents,  more  than  half  (52  percent) 
stated  that  VIS  had  facilitated  their  understanding  of  the  text- 
book. Twenty-five  percent  were  neutral.  For  many  undergraduates, 
lectures  and  reading  interfaced.  This  was  no  trivial  accomplish- 
ment, as  any  experienced  classroom  instructor  will  attest.  Inte- 
grating readings  with  that  transpires  in  class  is  not  easy,  and  en- 
suring that  students  get  full  value  from  their  reading  is  equally 
difficult.  According  to  these  students,  however,  the  introduction 
of  materials  via  integrated  information  system  oftentimes  plowed 
the  untilled  ground  of  the  text  and  yielded  some  unanticipated 
responses.  VIS  “put  the  textbook  in  a more  organized  and  topic 
related  order;”  in  other  words,  the  book  could  be  disassembled, 
so  to  speak,  and  restructured  according  to  the  topic  headings  pre- 
sented in  class  (Salomon,  1984).  Students  were  given  specific  pages 
to  read  for  particular  week  of  the  semester,  so  it  was  not  a great 
burden  to  read  the  book  with  reference  to  classroom  notes.  Through 
electronic  learning  the  student  “knew  what  to  look  for  while 
reading.”  The  techniques  used  by  the  instructor,  the  prioritization 
of  data,  could  be  applied  to  reading  assignments.  “VIS  helped  tie 
lecture  and  book  together,”  and  “ made  the  text  easier  to  under- 
stand.” Instead  of  venturing  into  unknown  territory,  the  classroom 
excursions  into  new  topics  familiarized  students  with  ideas,  con- 
cepts and  subjects  they  then  encountered  in  reading.  “After  view- 
ing the  material,  the  text  was  easier  to  understand,”  so  that  “the 
two  complemented  each  other”  “it  visualized  what  I was  reading 
and  made  it  much  clearer  in  my  mind,”  a student  reflected.  VIS 
“outlined  the  emphasized  main  points  to  focus  on  when  reading.” 
“The  major  points  on  the  VIS  were  explained  in  the  text,”  so 
that  reading  served  to  flesh  out  topics  which,  due  to  time  con- 
straints, could  onlv  be  discussed  brieflv  in  class.  Consequent! v, 
“VIS  held  the  material  in  the  textbook  together.” 

One  of  the  more  frightening  aspects  of  technology  and 
education  is  that  when  most  of  what  young  people  know  comes 
from  video,  rather  than  written,  sources,  an  entire  generation 


may  lose  touch  with  the  printed  word  and  become  techno-illit- 
erates. By  interfacing  video,  lecture,  and  reading  in  the  classroom, 
perhaps  instructors  can  inspire  students  to  be  accomplished  in 
all  modes  of  communication  (Szabo,  et.  al.,  1981).  Certainly  an 
information  system  which  makes  college  reading  more  attractive 
to  a large  segment  of  the  undergraduate  population  is  worthy  of 
further  development  and  support.  Support  of  the  faculty  is  evi- 
dent, and  faculty  use  of  the  system  continues  to  rise.  “We’re  seeing 
an  average  of  forty-eight  requests  per  day  now,  twice  the  use  of 
just  a year  ago.  The  number  of  faculty  using  the  system  increased 
twenty-five  percent  in  just  one  semester,”  Beatty  commented  in 
1990.  By  spring  semester  1991,  an  average  of  fifty-one  requests  for 
VIS  were  processed  each  regular  school  day.  In  the  autumn,  re- 
quests rose  to  sixty-three.  Not  only  is  the  system  being  used  to 
greater  potential,  a more  technologically-innovative  faculty  is 
developing  (Bruning,  1992). 

Future  Curricular 
Applications  of  Technology 

Future  assessment  of  the  classroom  learning  experience 
must  confront  some  pithy  pedagogical  questions.  Are  students 
swamped  by  the  mass  of  data?  Can  VIS  hone  critical  thinking 
skills?  The  answer  may  lie  in  the  digital  interfacing  of  video  and 
computers.  A challenge  for  the  future  will  be  to  incorporate  fac- 
ulty-controlled, visual  information  systems  with  student-manipu- 
lated, largely  computer-based  networks  and  create  a collaborative 
multimedia  education  experience  (Kean  &.  Kean,  1992;  Shore  & 
Daniel,  1992).  A secondary  sub-menu  has  been  developed  with 
the  teacher  may  access  without  calling  for  assistance  from  the 
central  control  area.  This  menu  includes  compact  disk  interactive 
capabilities.  Increasingly,  teachers  will  bring  computerized  instruc- 
tion to  their  students  (as  a collective  body  as  well  as  individually) 
through  integrated  information  systems.  The  result  will  be  a more 
“problematic”  curriculum,  with  a dynamic  supplied  by  teacher- 
student  integration  through  computers.  Researchers  will  have  to 
see  if  students  react  positively  to  this  more  collaborative  relation- 
ship with  teachers  and  technology. 

Given  the  fact  that  students  are  often  more  computer 
literate  than  their  teachers,  the  intrusion  of  cooperative  computer 
learning  through  VIS  (or  more  accurately  now  - IIS,  an  integrated 
information  system)  may  have  far  more  profound  effects  on  cur- 
riculum design  than  was  the  case  during  the  first  few  years  of  the 
system’s  operation.  Compact  disk  interactives  may  take  us  away 
from  linear,  uni-lateral  education.  CD-I  assignments  introduced 
in  class  could  be  completed  by  the  students  out  of  class,  indi- 
vidually or  in  small  groups  (Isbouts,  1992).  In  addition  to  the  cus- 
tomary textbook,  a student  might  purchase  a course  CD-I,  with 
“paths”  worked  into  the  syllabus.  What  was  once  an  analog  video 
information  system  incorporates  digital  sources  (Curtis,  1992). 

Having  now  made  possible  the  inclusion  of  new  forms 
(and  quantities)  of  instructional  material  into  the  classroom,  we 
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Student  Assessment  < continued. ) 


must  now  focus  on  how  students  assimilate  these  materials  and 
how  the  process  can  enhance  reading,  writing,  and  critical  think' 
ing  skills.  Will  what  was  once  predominantly  a passive  medium 
become  more  cooperative  as  it  is  digitized?  Although  integrated 
information  system  teaching  builds  upon  a traditional  pedagogical 


base,  clearly  it  leads  teachers  into  unexplored  areas  of  curriculum 
development.  As  a result,  technology  makes  the  human  teacher 
even  more  important  in  the  achievement  of  student  academic 
success  (Dwyer,  1972;  19S7). 
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Structural  Equation  Models  Appendix  (continued) 


TITLE 

STRUCTURAL  EQUATION  MODEL  EXAMPLE 
' SPECIFICATIONS 

CAS =200;  YAR=9;  ME=ML; 

LABELS 

\'1=EDASP;Y:=0CASP;\')=YERBACH;\4=QUANT-\CH;\,5=F/\MINC; 
Y6=FAED;  Y7=MOED;\T=\TRBAB;Yq=QUANT\RiFl=ASPlRE;F:=ACHlEYE; 
F4=HOME:F4= ABILITY; 

. EQUATIONS 


Yl=  FI  + El 

Y4=  F3-E4; 

\'g=i*F4 

+ Eg; 

Y2  = I*F1  + E2 

Y6=  I*F4  - E6: 

Fl  = 1*F4 

- 1*F4 

Y3=  F2  f E4 

\‘7 - 1*F3  - E7; 

f:=i*fi 

- l‘F* 

Y4  = 1*F2  - E4; 

YS=  F4  *■  ES, 

VARIANCES 

El  = I*; 

E4=l*. 

Eq=i‘; 

E:=r 

E6=  1*; 

ni  = i*(  * 

E3  = U 

E7  = 1*; 

D2  = l\ 

E4  = 1*; 

ES=U; 

COVARIANCES 

E6.E7  =1*; 

FLF4- 1*. 

MATRIX 

1.024 

jg;  \ 

1.027  W 1 

S44 

244 

1.2S6 

.467  .4*7 

S7* 

.642  >42 

.444  .424 

677 

.426  .M6  .670 

4M  vsq 

644 

.•W8  .474  .444  .716 

.5.N?  .464 

sol 

.716  .446  .422  .474 

V4J 

.4'>i  A™ 

SSS 

.M6  .SOS  . ll"l 

t j 

DIAGRAM 

ES  E6  E7 

El 

E2  : 

V4  \ 6 v: 

VI 

Y2  . 

1 3 

11 

D1  , 

F4 

i: 

n:  . 

VS  V«  V? 

Y4  , 

D H‘»  I'  Ei 

END 
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Voices  in  Education 


The  Mid-V&stern  Educational  Researcher  asked  leaders  in 
education  to  respond  to  the  question: 

What  effects  do  you  believe  the  increased  use 
of  the  National  Teachers  Examination  (NTE)  will  have 

on  colleges  of  education  and  the  quality  of 
teachers  entering  the  field? 

Good,  but  I’m  talking  about  the  neu1  NTE  called  the 
Praxis  Series  which,  on  paper  at  this  time,  looks  to  be  very  good. 

—David  Berliner,  Arizona  State  University 

Probably  no  greater  effect  than  the  use  of  the  Scholastic 
Aptitude  Test  has  had  on  the  curriculum  of  high  schools  whose 
students  take  that  test  as  part  of  a colledge  admission  process. 
Similarly,  I think  that  the  quality  of  teachers  entering  the  field 
is  unmeasurable  and  multiply  determined. 

—Christopher  Clark , Michigan  State  University 

I believe  that,  if  the  NTE  is  revised  in  the  direction  that 
its  developers  intend  it  to  be,  there  is  potential  to  reshape  teacher 
education  in  a favorable  direction.  Instituted  practice  like  teacher 
education  needs  a jolt  to  get  change  to  take  place.  While  ini- 
tial ramifications  may  be  less  optimal,  over  time,  good  things 

could  result.  —Lyn  Como,  Teachers  College  Columbia  University 


Norm-referenced  admissions  tests,  because  they  fail  to  cir- 
cumscribe adequately  the  knowledge  and/or  skills  being  assessed, 
typically  have  an  adverse  impact  on  preparation  programs  and 
the  students  attempting  to  enter  them. 

—W.  James  Popham,  IOX  Assessment  Associates 

The  NTE  will  soon  be  replaced  with  a much'  stronger  bat- 
tery of  tests,  to  be  called  PRAXIS.  The  battery  will  include  assess- 
ment of  basic  skills,  subject  matter  knowledge  and  pedagogy,  and 
actual  teaching  performance.  The  influence  of  PRAXIS  on  col- 
leges of  education  and  on  the  quality  of  teachers  entering  the 
field  will,  however,  be  greatly  dependent  upon  how  PRAXIS  is 
used  and  the  standards  that  are  set. 

— Andrew  Porter,  University  of  Wisconsin-Madison 

On  the  one  hand,  the  improved  NTE  could  clarify  what 
a teacher  ought  to  know  and  bring  greater  clarity  to  the  cognitive 
learnings  expected  of  teachers.  On  the  other  hand,  it  could  rein- 
force the  current  lack  of  attention  to  the  role  of  the  teacher  as  a 
moral  exemplar  and  a contributor  to  character  formation. 

— Kevin  Ryan,  Boston  University 

The  effects  will  focus  on  the  quality  of  courses  offered  in 
teacher  preparation  programs  and  the  field  experiences  related  to 
coursework.  The  accountability  for  the  final  product  has  intensi- 
fied in  many  colleges  of  education  throughout  the  country. 

—Jane  Stallings , Texas  A&M  University 


The  NTE  should  be  regarded  merely  as  a criterion  of 
minimum  competence.  For  this  purpose,  it  is  very  useful  and 
might  readily  be  used  as  a substitute  for  a licensing  examination 

in  a given  state.  —John  Goodlad , University  of  Washington 

I am  afraid  it  may  have  a negative  effect  when  it  comes 
to  the  admission  of  minority  teachers.  I am  not  convinced  of  the 
positive  consequences  for  “quality.” 

—Maxine  Greene,  Teachers  College  Columbia  University 

Much  the  same  as  its  historical  effects— not  much. 

—Gary  Griffin , University  of  Arizona 


The  NTE  is  a standardized  test  and  measures  only  a small 
part  of  the  teacher’s  performance.  Each  institution  should  develop 
a plan  for  helping  the  student  learn  to  be  an  effective  teacher 
which  involves  much  more. 

—Ralph  Tyler,  Center  for  Advanced 
Study  in  Behavioral  Sciences 

Some  gearing  of  teacher-preparation  curricula  toward  con- 
tent and  skills  represented  on  the  NTE  tests  and  perhaps  some 
improvement  in  quality. 

—Herbert  Walberg,  University  of  lllinois-Chicago 
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The  Mid-Western  Educational  Research 
Association  (MWERA)  is  a nonprofit  organi- 
zation of  professional  educational  researchers 
primarily  from  states  and  provinces  located  in 
the  midwestern  region  of  the  United  States 
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Chartered  in  1858,  Iowa  State  Uaivenity  of  Science  and  Technology  is  the  land  grant  institution  of  the  first 
state  to  accept  the  terms  of  the  Morrill  Land-Grant  act  in  1862.  As  Iowa  State  has  adapted  the  land-grant  philosophy 
to  the  changing  needs  of  the  approaching  21st  century,  it  has  become  a university  with  special  teaching  responsibility 
in  science  and  technology,  extension  education,  and  research  and  scholarship  to  advance  the  frontiers  of  learning. 

The  covered  walkways  of  Lagomarcino  Hall  surround  its  garden-like  courtyard  and  provide  a contemplative  back- 
drop for  the  Psychology  Department,  located  in  the  building’s  west  wing.  The  Psychology  Department  encompasses 
active  research  and  graduate  programs  in  individual  differences,  school  psychology,  and  applied  cognitive  psychology 
including  science  learning  and  education,  the  development  of  reasoning  skill,  and  human/equipment  interfacing.  Of 
particular  note,  the  Office  of  Precollegiate  Programs  for  the  Talented  and  Gifted  (OPPTAG)  in  the  department  is  home 
to  the  Study  of  Mathematically  Precocious  Youth,  initiated  by  Julian  C.  Stanley,  and  now  directed  by  Camilla  P.  Benbow 
and  David  LubinskL  SMPY  is  conducting  a 50-year  longitudinal  study  of  intellectually  talented  individuals  which 
is  now  in  its  third  decade.  Through  programs  such  as  the  Iowa  Talent  Search,  ACES,  CYTAG,  and  the  Iowa  Scholars 
Academy,  OPPTAG  provides  services  to  6,000  gifted  youth  yearly. 


Information  for  Contributors  to  the  Mid-Western  Educational  Researcher 

The  MidWestem  Educational  Researcher  accepts  research-based  manuscripts  that  would  appeal  to  a 
wide  range  of  readers.  All  materials  submitted  for  publication  must  conform  to  the  language,  style,  and  format  of  the 
Publication  Manual  of  the  American  Psychological  Association,  3rd  ed.,  1983  (available  from  Order  Department, 
American  Psychological  Association,  PQ  Box  2710,  Hyattsville,  MD  20784). 
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8V4xll  paper.  Only  words  to  be  italicized  should  be  underlined.  Abbreviations  and  acronyms  should  be  spelled  out  for 
the  first  mention.  Pages  should  be  numbered  consecutively,  beginning  with  the  page  after  the  title  page. 
Manuscripts  should  be  less  than  20  pages  long.  An  abstract  of  less  than  100  words  should  accompany  the  manuscript. 

The  manuscript  will  receive  blind  review  from  at  least  two  professionals  with  expertise  in  the  area  of  the  manuscript. 
The  author’s  name,  affiliation,  etc,  should  appear  on  the  title  page  only.  Efforts  will  be  made  to  keep  the  review  process 
to  less  than  two  months.  The  editors  reserve  the  right  to  make  minor  editorial  changes  in  order  to  facilitate  a 
concise  clear  article.  The  author  will  be  consulted  if  any  major  changes  are  necessary. 

Manuscripts  should  be  sent  with  a cover  letter  to: 

Gregory  J.  Marchant  Isadora  Newman 

Educational  Psychology  Educational  Foundations  and  Leadership 

Teachers  College  or  College  of  Education 

Ball  State  University  The  University  of  Akron 

Muncie,  IN  47306-0595  Akron,  OH  44325-4205 
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October  13-16, 1993 


Fifteenth  Annual  Meeting 


Program  Orientation 

Greetings!  Welcome  to  the  1993  MWERA  Program.  This  year’s  agenda  incorporates  the  new 
with  the  old.  You'll  find  many  traditional  events  that  make  our  conference  so  special,  and  you’ll 
discover  some  exciting  new  offerings,  too.  So  mark  your  calendars  to  join  us  October  13-16  at 
the  historic  Bismarck  Hotel  in  Chicago.  Here  is  what  you  have  to  look  forward  to  this  year. 


Invited  Speakers 


Invited  Address 


Wednesday,  Oct.  13, 1993  8:00-9:00  p.m. 

Medill  Room 
Chair  Thomas  Andre 
John  Bransford,  Vanderbilt  University 
Macro-contexts  for  Problem-based  Learning: 
Design  Principles  for  Enhancing  Learning  and 
transfer. 


Luncheon  Kevnote  Address 


Friday,  Oct.  15, 1993  12:35-1:25 
Walnut  Room 
Chair:  KenKiewra 

Jere  Brophy,  Michigan  State  University 
Trends  in  Research  in  Teaching 


October  13-1C,  1983 


Fifteenth  Annual  Meetini 


Division  F Invited  Presentation 


Thurs.  Oct.  14, 1993  2:30-3:35  p.m.  Parlor  D 
Chair  Don  Castle 

Gregory  Gerrich,  Ashland  University 
Responsibility  of  Schools  of  Higher  Education  in 
Providing  Leadership  in  Restructuring 
Public  Education 


Division  D Invited  Presentation 


Friday,  Oct.  15, 1993,  4:30-6:00  p.m. 

Chair  Robert  S.  Barcikowski 

Frank  Baker.  University  of  Wisconsin.  Madison 


Equating  Tests  Under  Item  Response  Theory 


Division  B & G Invited  Presentation 


Friday,  Oct.  15, 1993,  2:00-2:55  p.m. 

Chair  Joan  Timm 

Christine  Sleeter,  University  of  Wisconsin, 
Parkside 

An  Analysis  of  the  Critiques  of  Multicultural 

Education 


October  13-16,  1993 


Fifteenth  Annual  Meeting 


Workshops 

Workshops  require  preregistration  and  an  additional  nominal 
fee  that  is  shared  between  MWERA  and  the  presenter.  The  fee 
is  kept  as  low  as  possible  to  encourage  MWERA  participation. 
Fees  help  defray  the  cost  of  putting  on  the  workshops.  All 
workshops  participants  must  be  registered  for  the  conference. 
Register  early,  workshops  with  insufficient  registrants  bv  Oct. 

5,  1993  will  be  dropped. 

Wed.  Oct.  13.  1993,  1:00-5:00  p.m.  Parlor  A 
Workshop  1 

Robert  Ziomek,  Director 
Department  of  Program  Evaluation  and 
Research  Services,  ACT. 

New  Products  and  Programs  from  ACT. 

Cost:  free  [Note:  Participants  must  register  for  the 

conference] 

Informational  workshop  presenting  to  participants  the  new 
products  developed  by  ACT  in  response  to  recent  trends  in 
education  such  as  authentic  assessment  and  describing  the 
areas  and  type  of  research  that  ACT  is  conducting  to  meet  the 
challenges  facing  K-12  education  in  future. 

Wed.  Oct.  13.  1993.  1:00-5:00  p.m.  Parlor  B 
Workshop  2 

Wendy  L.  Shapiro,  Kent  State  University 
Rebecca  Clemente,  Ball  State  University 
Metamorph:  Computer  Support  for  Qualitative 
Research 

Cost  $20.00 

This  workshop  provides  training  in  the  use  of  Metamorph. 
Metamorph  is  a computer  application  that  works  with 
unstructured  text  to  scan  documents,  manuals,  and 
unstructured  records.  Metamorph  uses  pattern  matching  and 
set  logic  to  help  structure  text  databases.  It  allows  rapid, 
unstructured  data  searching,  in-context  relevance  judgment, 
and  flipping"  of  selected  information  into  a file. 

Wed.  Oct.  13,  1993.  1:00-5:00  p.m.  Parlor  C 
Workshop  3 

Kathleen  M.  Long,  Indiana  University 
Students  as  Evaluators  of  Self,  Peers,  and 
Curriculum  & Instruction 

Cost:  $15.00 

After  a brief  discussion  of  theory  and  research  supporting 
students  as  evaluators,  Dr.  Long  will  describe  the  process  of 
empowering  students  as  assessors  of  their  own  learning 
experiences,  the  products  of  peers,  and  the  curriculum  and 
instruction  in  any  classroom/school.  Several  alternative 
assessment  models  will  be  shared,  and  workshop  participants 
will  develop  an  evaluation  tool  pertinent  to  their  own  needs. 
An  assessment  instrument  created  by  Dr.  Long  and  thirty  “at- 
risk"  students  that  was  recently  utilized— with  faculty 
permission-  to  assess  the  curriculum  and  instruction  of  a 
1300  student  high  school  will  be  provided. 


Wed.  Oct.  13.  1993.  1:00-5:00  p.m.  Parlor  D 
Workshop  4 

Richard  M.  Smith,  University  of  South  Florida 
Item  and  Person  Analysis  with  the  RASCH 
Model . 

Cost:  $30.0( 

Note;  Includes  materials  normally  costing  $99.00  when  given  a 

other  workshops 

This  workshop  will  provide  participants  with  the  opportunity  t< 
explore  the  use  of  RASCH  measurement  models  to  analyze 
item  and  person  performance  for  both  dichotomous  and  rating 
scale  response  formats.  These  analyses  supplemen 
information  currently  available  from  a Rasch  calibratioi 
program  and  allow  the  direct  investigation  of  a variety  o 
response  patterns  for  persons  (guessing,  response  styles 
etc.)  and  items  (misfit,  differential  item  familiarity,  etc.  ) an< 
provide  information  that  can  be  used  to  improve  th< 
performance  of  items  and  the  quality  and  interpretability  a 
person  response  patterns.  The  differences  in  interpretation  c 
overfit  and  undertit  for  the  dichotomous  and  rating  seal- 
models  and  the  interrelationships  between  item  and  persoi 
misfit  will  be  discussed.  The  theoretical  basis  for  thes< 
analyses  and  practical  applications  of  the  procedures  will  b 
presented.  PC-based  programs  and  textbooks  used  ii 
workshop  demonstrations  will  be  provided  to  participants 
Prior  experience  with  Rasch  calibration  programs  may  b 

helpful,  but  is  not  necessary 

R7.12  Thurs.  4:00-6:00  p.m.  Parlor  F 
Workshop  5 

Carole  Newman,  University  of  Akron 
Lynn  Smolen,  University  of  Akron 
Isadore  Newman,  University  of  Akron 
Becoming  More  Competitive  In  An  Interview: 
Portfolios  As  An  Authentic  Representation  of 
Teaching  Skills . 

Cost  $15.0 

In  an  increasingly  competitive  job  market,  teacher  candidate 
have  to  create  a strong  positive  impression  that  will  allow  th 
interviewer  to  distinguish  them  from  the  hundreds  of  oth« 
applicants  vieing  for  a limited  number  of  teaching  position! 
This  workshop  will  discuss  portfolios  as  a vehicle  ft 
presenting  a unique  and  authentic  view  of  the  candidate 
teaching  abilities.  It  will  also  provide  information  for  fr 
teacher  candidate  on  what  administrators  want  to  see  in 
portfolio,  how  to  use  a portfolio  during  an  interview,  and  ho 
to  write  reflective  statements  and  a philosophy  of  education  1 
help  the  prospective  employer  better  interpret  the  candidate 
accomplishments  and  potential.  Insights  into  this  process  ai 
based  upon  recent  studies  conducted  by  the  authors,  whic 
involved  the  surveying  of  administrators  in  sixty-five  rur« 
urban,  and  suburban  school  district 
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October  13-15, 1993 


Fifteenth  Annual  Meetii 


F7.9  Thurs.  2:30-5:30  p.m.  Maximilian  Room 
Workshop  6 

Jeffrey  B.  Hecht,  Illinois  State  University 
Sara  B.  Wills,  Illinois  State  University 
David  J.  Dwyer,  Illinois  State  University 
Nicole  K.  Roberts,  Illinois  State  University 
FLEXTEXT : A Methodology  for  the  Qualitative 
Analysis  of  Textual  Data 

Cost:  $15.00 

Researchers  using  written  surveys  tend  towards  easily  coded 
and  analyzed  restricted  response  items.  Many  situations, 
however,  could  benefit  from  the  addition  of  narrative  response 
items.  Unfortunately,  the  analysis  of  narrative  response  items 
can  be  exhaustively  time  consuming  and  difficult  to  master. 
New  computer  software  reduces  the  work  while  increasing  the 
useability  of  the  data.  This  workshop  will  acquaint  attendees 
with  one  successful  computer  methodology.  The  workshop 
will  begin  with  a review  of  the  theoretical  and  historical 
traditions  employed  in  narrative  response  analysis.  The 
FLEXTEXT  computer  program  will  be  demonstrated  using  real 
examples.  Attendees  will  participate  in  the  coding  and 
analysis  of  their  own  responses  to  a survey  instrument  The 
workshop  handbook  will  include  a session  summary, 
reference  citations,  and  a road  map  showing  the  easy  linkage 
among  the  data  entry,  form  validation,  coding,  initial  reporting, 
and  analysis  in  software  packages.  Attendees  will  experience 
the  issues  involved  in  narrative  response  item  analysis,  and 
participate  in  using  one  computer-based  technique  that  can 

simplify  this  task. 

F6.7  Fri.  Oct.  15.  1993.  3:00-6:00  Parlor  F 
Workshop  7 
Kisubi,  Alfred 
Muench,  Karen  E. 

Using  the  Arts  in  the  Classroom 

Cost:  $15.00 

This  workshop  appraises  creativity  as  an  inborn  or  natural 
tendency  which  if  so  appraised  in  the  training  of  any 
professional,  most  especially  human  service  workers,  can  be 
used  therapeutically  in  the  healing  of  emotional  disturbances 
and  disordered  attitudes.  In  addition,  it  can  be  used  to 
encourage  wholeness  in  the  individual  because  we  believe 
creativity  helps  unite  left  and  right  brain  hemispheres.  The 
workshop  presents  suggestions  for  more  inclusive  approaches 
to  teaching  through  the  effective  use  of  the  creative  process, 
because  we  believe  that  creativity  builds  on  the  innate  facet  of 
every  person's  Inheritance  Eros,  the  will  to  live.  For  to  create 
is  in  some  sense  to  be  bom  again.  The  workshop  is 
concerned  with  substantive  issues  of  methods  and  analysis, 
with  extending  the  boundaries  of  thoughts,  with  widening  its 
scope  of  investigation,  with  sharpening  perspectives  and 
clarifying  purposes  through  the  arts.  Emphasis  on 
participation  and  involvement  and  maximum  intensity  of 
enjoyment  and  helping  participants  sharpen  their  perspective 

responses  to  the  work  of  art. 


F7.2  Fri.  Oct.  15,  1993  4:30-6:30  p.m.  Parlor  A 
Workshop  8 

Nicole  K.  Roberts,  Illinois  State  University 
Jeffrey  B.  Hecht,  Illinois  State  University 
VTLOGANL:  A Method  for  the  Qualitative 
Analysis  of  Videotaped  Data 
Cost  $25.00  includes  cost  of  videotape  distribi 

to  particip; 

The  decrease  in  cost  and  convenience  of  video  cameras 
recorders  has  led  to  an  explosion  of  use  among  social  sci 
researchers.  Unfortunately,  the  dominant  modes  of  ans 
of  such  data  require  transcripts  of  spoken  words  and  w 
descriptions  of  scenes,  people,  and  movement  In  the  < 
for  data  reduction  and  conceptual  understanding,  1 
analytical  methods  ignore  the  richness  of  images  and  so 
captured  on  videotape  and  lose  tape's  richnej 
communicating  research  findings.  The  worksho 
introduce  participants  to  a new  way  of  conceptualizinf 
executing  the  analysis  of  data  recorded  on  videotape, 
workshop  will  begin  with  an  overview  of  traditional  mel 
for  video  data  analysis.  The  VTLOGANL  (Video 
Logging  and  Analysis)  computer  program  will  th« 
highlighted  using  actual  field  video  and  coded  logs, 
workshop  give  participants  the  opportunity  to  use  the 
cameras,  microphones,  tripods,  lights,  recorders/playen 
the  VTLOGANL  computer  program.  Each  participai 
receive  a workshop  handbook  and  videotape  summarizir 
session,  relevant  citations,  the  data  acquisition,  codin; 
analysis  method,  and  the  terms  and  equipment  used  in  \ 

based  resc 

S3.10  Sat.  9-11  & 11-1.  Room  501 
Workshop  9 & Workshop  10.  Two  2-hour 
workshops  presented  back-to-back. 

Thomas  S.  Parish,  Kansas  State  University 
James  J.  McCluskey,  University  of  Oklahoma 
Ways  to  Enhance  Teacher  Effectiveness  and 
Student  Motivation 

Cost:  $2 

This  workshop  presents  valuable  information  and  in 
regarding  identification  of  problems  that  currently  e 
classrooms.  Several  teaching  strategies  are  shared  tha 
been  found  to  effectively  motivate  students  at  various  le> 
education.  Explanations  and  research  support  of 
strategies  are  provided.  In  addition  to  describing  pc 
problems  associated  with  poor  student  performance  and 
to  ameliorate  them,  the  workshop  will  also  present  a t< 
evaluation  instrument  that  should  be  helpful  in  discer 
teachers  are  effectively  getting  through  to  their  studi 

various 

R6.10  Thurs.  1:00-2:25  Rm.  501 
New  Member  Workshop  - Publishing,  Not 
Perlshingl  Winning  at  the  Publication  Game 
Open  to  new  members  first,  others  admitted  as  room  allo\ 
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October  13-19,  1993 


Fifteenth  Animat  Meeting 


Special  Activities 


We  are  especially  pleased  to  have  offerings  for  Graduate 
Students  this  year.  MWERA  encourages  students  to  present 
their  research.  Certificates  will  be  presented  to  students  who 
author/co-author  and  present  a research  paper  and  attend  the 
General  Business  Meeting  scheduled  for  Friday,  10:30  -11:40 
a.m. 

The  1993  program  has  several  social  activities  planned. 
A New  Member  Welcome,  Thursday  at  8:30  a.m.  has  been 
organized  by  Carmen  R.  Giebelhaus,  Ohio  State  University,  it 
will  be  hosted  by  the  Executive  Committee.  First-time 
conference  attendees  will  be  introduced  to  the  MWERA 
organization  and  to  the  conference  proceedings. 


Midwest  Hospitality  greets  all  conference  participants 
Thursday-Saturday  from  8:00  a.m.  to  9:00  a.m.  Meet  old  and 
new  friends  alike  and  enjoy  coffee  and  rolls. 

The  traditional  Cracker  Barrel  Social  is  on  Thursday 
evening  from  6:00  p.m.  to  7:00  p.m. 

Friday  night  is  the  President's  Reception,  beginning  at 
9:00  p.m.  in  the  Regency  Suite. 

The  President's  reception  will  be  followed  by  an  early 
morning  roll  call  for  the  third  annual  Fun  Run/Walk/Crawl 
Along  the  Lake  Shore.  This  light  exercise  route  is 
approximately  2 miles  long  near  the  Chicago  Yacht  Club. 
President  Kenneth  A Kiewra,  University  of  Nebraska,  is  again 
the  organizer  and  exuberant  guide  for  the  event. 


Summary  of  Events 


Wednesday,  October  13 
0 1:00-5:00  p.m. 

Preconference  Training  Workshops 
0 8:00-9:00  p.m. 

Invited  Address,  John  Bransford,  Medill  Room 
Thursday,  October  14 
© 8:00-9:00  a.m. 

Midwest  Hospitality  Maximilian  Room 
© 8:30-  9:20  a.m. 

New  Member  Welcome  Lincoln  Room 
© 9:30-10:30  a.m. 

Keynote  Address,  John  Bransford,  Maximilian 
Room 

© 10:30-11:50  a.m. 

Concurrent  Sessions 
O 12:10-12:55  p.m. 

Brown  Bag  Lunch-Division  Meetings 
© 1 :30-5:55  p.m. 

Concurrent  Sessions 
© 6:00-8:00  p.m. 

Cracker  Barrel  Social  Maximilian  Room 


Friday,  October  15 
© 8:00-9:00  p.m. 

Midwest  Hospitality  Maximilian  Room 
© 9:00-10:30  p.m. 

Concurrent  Sessions 
© 10:00-4:00  p.m. 

Exhibits 

© 10:30-11:40  a.m. 

General  Business  Meeting/Graduate  Student 
Awards 

© 11:50-1:25  p.m. 

Luncheon:  Keynote  Address,  Jere  Brophy 
© 1:30-6:00  p.m. 

Concurrent  Sessions 
0 9:00  p.m.-???? 

President's  Reception 
Saturday,  October  16 
© 7:00  a.m. 

Fun/Run/Walk/Crawl  Along  the  Lake  Shore 
© 8:00-9:00  a.m. 

Midwest  Hospitality 
0 . 8:00-Noon 

Concurrent  Sessions 
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1993  Program  Committee 


Program  Chair 

Thomas  Andre,  Iowa  State  University 

Program  Assistant 

Bonnie  Smith,  Iowa  State  University 

Associate  Program  Chairs 

For  Private  Organization/Industry  Coordination 
Gene  Kramer,  American  Dental  Association 
For  Workshops 

Gary  D.  Phye,  Iowa  State  University 
Bruce  G.  Rogers,  University  of  Northern  Iowa 
For  Convention  Recruitment 

Jack  Snowman,  Southern  Illinois  University 
For  Local  Coordination  and  Exhibits 

Sharon  McNeely,  Northeastern  Illinois  University 
For  New  Member  Welcome 

Carmen  R.  Giebelhaus,  Ohio  State  University 

Division  Co-Chairs 

A.  William  L Sharp,  Southern  Illinois  University 
Carol  B.  Furtwengler,  Wichita  State  University 

B.  Rose  Mary  Scott,  Univ.  cf  Wisconsin  -Parkside 
Linda  S.  Behar,  University  of  Florida 

C.  Gregory  Schraw,  University  of  Nebraska 
Jennifer  J.  Fager,  South  Dakota  State  University 

D.  Robert  S.  Barcikowski,  Ohio  University 
Jeffrey  B.  Hecht,  Illinois  State  University 

E Thomas  El'  Midgette,  University  of  Arkansas 
Eddie  Glenn,  University  of  Arkansas 

F.  Donald  R.  Castle,  Ashland  University 
Gary  D.  Shank.  Northern  Illinois  University 

G.  Joan  S.  Timm,  University  of  Wisconsin-Oshkosh 
Mary  Ann  Flowers,  Cleveland  State  University 

H.  Daniel  J.  Mueller,  Indiana  University 

Corenna  C.  Cummings,  Northern  Illinois  University 

I.  Richard  C.  Smith,  University  of  South  Florida 


J.  Kim  K.  Metcalf,  Indiana  University 
Martha  A.  Wilson,  Capital  University 

K.  Donald  L.  Haefele,  Ohio  State  University 
Josue  Cruz,  Jr.,  Ohio  State  University 
Deborah  L Bainer,  Ohio  State  Univ.-Mansfield 

Midwest  Hospitality  Coordinator 

Charles  Anderson,  ETS  (Ret.)  and  MWERA, 
Executive  Officer 

Social  Coordinator 

Adria  Karie-Weiss,  University  of  South  Florida 

Convention  Recruitment  Committee 

Tom  Andre,  Steve  Benton,  Bob  Brennan,  Rogt 
Bntning,  Alice  Corkill,  Beverly  Dretzke,  Nelson 
DuBols,  Orpha  Duell,  Frank  Farley,  Carol  Anne 
Kardash,  Ken  Kiewra,  Joyce  Killian,  Judy 
Lambiotte,  Joel  Levin,  Dick  Upka,  Bill  Loadma 
Anne  Marie  Palincsar,  Barbara  Plake,  Jane 
Zaharias 

Associate  Divisional  Program  Chairs 
Division  E. 

Nudie  E.  Williams,  University  of  Arkansas 
Jean  Harper,  Dayton,  Ohio 
J.  Harris  Moore,  Student  Development  Office 
Mary  Ann  Flowers,  Cleveland  State  University 
Nelson  Strobert,  Gettysburg  Lutheran  Seminary 

A special  thank  you  to  all  who  reviewed  proposal 
to  Charles  Anderson  (Executive  Officer),  and  to 
Executive  Committee  Members  Plake,  Kiewra, 
Pugh,  Mueller,  McNeely,  Anderson,  Marchant,  ar 
Newman. 
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Association  Executive  Committee 


Immediate  Past  President 
Barbara  Plake,  Ohio  State  University 

President 

Kenneth  A-  Kiewra,  University  of  Nebraska 
President-Elect 

Richard  C.  Pugh,  University  of  Nebraska 
Vice-President 

Thomas  Andre,  Indiana  University 
Secretary 

Ralph  O.  Mueller,  University  of  Toledo 
Member-at-Large 

Sharon  McNeely,  Northeastern  Illinois  University 

Executive  Officer  (ex  officio) 

Charles  Anderson,  ETS  (Ret.) 

Co-Editors  Mid-Western  Educational  Researcher  (ex 
officio)  (term  ends  1993) 

Gregory  J.  Marchant,  Ball  State  University 
isadore  Newman,  University  of  Akron 

Editors-Mid-Westem  Educational  Researcher 
Ayres  G.  D'Costa,  Editor,  Ohio  State  University 
Susan  M.  Brookhart,  Associate  Editor,  Duquesne 
University 

John  R.  Surber,  Associate  Editor,  Univ.  of  Wisconsin, 
Milwaukee 


Association  Council 


Term  Expires  1993 

Sonya  Blixt,  Kent  State  University 

Alice  J.  Corkill,  University  of  Nevada-Las  Vegas 

Mary  Ann  Flowers,  Cleveland  State  University 

Sarah  E.  Peterson,  Northern  Illinois  University 

John  T.  Pohlmann,  Southern  Illinois  University 

E.  Jane  Williams,  Columbus  Public  Schools 

Jane  Zaharias,  Cleveland  State  University 

Term  Expires  1994 

Linda  Bakken,  Wichita  State  University 

Robert  S.  Barcikowski,  Ohio  University 

Stephen  L.  Benton,  Kansas  State  University 

Paula  J.  Dupuy,  University  of  Toledo 

Carolanne  M.  Kardash,  University  of  Missouri-Columbia 

Thomas  Knapp,  Ohio  State  University 

Thomas  E.  Midgette,  University  of  Arkansas 

Rose  Mary  Scott,  Univ.  of  Wisconsin-Parkside 


Election  Results 


By-Law  Approval:  Yes 
New  Officers 

Vice  President:  Gregory  J.  Marchant,  Ball  State 
University 

Secretary:  Ralph  O.  Meuller,  University  of  Toledo 

Association  Council  (1993-95) 

Jennifer  J.  Fager,  South  Dakota  State  University 
Stephen  G.  Jure,  University  of  Toledo 
Leslie  E.  Lukin,  University  of  Missouri 
Kim  K.  Metcalf,  Indiana  University 
Isadore  Newman,  University  of  Akron 
Marlene  Schommer,  Wichita  State  University 
Mary  R.  Sudzina,  University  of  Dayton 


Business  Meetings 


MWERA  Division  Meetings 
Thursday,  October  14 
12:10-12:55  p.m. 

MWERA  Association  Council  and  Executive 
Committee 
Thursday,  October  14 
4:30-5:50  p.m..  Room  501 

MWERA  General  Business  Meeting 

Friday,  October  15 

10:30-11:40  a.m.,  Maximilian  Room 

MWERA  1993  Program  Committee  and  1994 
Program  Chair 

Thursday,  2:30-3:25  p.m.  Parlor  B 

MWERA  -Executive  Committee 
Saturday,  October  16 
1:00-3:00  p.m.,  Regency  Suite 


October  13-19,  1993 


Fifteenth  Annual  Meeting 


How  to  Get  to  the  Conference 

Whan  coming  to  Chicago,  attendees  have  a variety  of  transportation  options.  (See  options  below.) 

O'Hare  Airport  to  the  Bismarck  Hotel  (3  options) 

1)  Take  a CTA  train  to  downtown  for  about  $2.00.  Catch  the  train  in  the  basement  of  Terminal  3.  Take  an  A or  B line.  Ge 
at  the  Lake  Transfer  station.  This  is  in  the  basement  of  the  State  of  Illinois  Building.  Climb  the  stairs  and  proceed  to 
Bismarck,  one  block.  This  is  the  fastest  way  during  rush  hours,  and  the  cheapest 

2)  Take  the  Continental  Bus  for  $12.50  one-way  or  $22.00  round  trip.  No  reservations  are  required  from  the  airport  See 
agent  at  the  booth  in  the  lower  level  baggage  claim  area. 

3)  Take  a cab  for  around  $20.00.  Wait  in  the  cab  stand  area.  In  off-hours  a ride  takes  about  30  minutes.  In  rush  hours  (j 
a.m.,  3-7  p.m.),  the  ride  could  take  a hour  or  more.  Tips  average  fifteen  percent. 

Midway  Airport  to  the  Bismarck  Hotel  (3  options) 

1)  Take  a CTA  bus  and  train  to  downtown  for  about  $2.00.  Catch  the  Cicero  Bus  54B  (headed  North)  on  Cicero  Avenue,  aci 
from  the  airport.  Ask  for  a transfer  for  the  train  when  you  board.  Get  off  at  22nd  and  Cicero.  Catch  the  Douglas-O'Hare 
train  going  East  (to  the  Loop).  Get  off  at  the  Lake  Transfer  station.  This  is  the  basement  of  the  State  of  Illinois  Builc 
Climb  the  stairs  and  proceed  to  the  Bismarck,  one  block. 

2)  Take  a Continental  Airport  Bus  for  $9.50  one-way  or  $16.75  round  trip.  No  reservations  are  required  from  the  airport, 
the  agent  at  the  booth  for  tickets. 

3)  Take  a cab  for  around  $18.00.  See  O'Hare  information  above  regarding  time. 

Driving  But  NOT  Parking  Downtown  (3  options) 

From  the  North  or  West 

1)  Park  near  a Metra  station  and  take  a Metra  Train  downtown.  From  the  Metra  station  you  will  need  to  take  a cab  to  the  h 
Depending  on  where  you  board  the  train,  your  ride  can  be  inexpensive.  For  details  call  (312)  836-7000.  Be  certain  to 
out  about  return  trips,  especially  on  weekends. 

2)  Park  at  O'Hare  remote  (follow  highway  signs  to  O'Hare),  take  a shuttle  into  O'Hare  and  follow  any  of  the  O'Hare  opti 
Remote  parking  is  inexpensive. 

3)  Park  at  Kiss  and  Ride  at  either  the  Cumberland  or  the  Harlem  Avenue  exits  off  of  1-94  (the  Kennedy).  Take  the  CTA 
(See  O'Hare  option  1).  Parking  is  inexpensive. 

From  the  South  or  East 

1)  Park  near  a Metra  station  and  take  a Metra  Train  . See  1 above. 

Driving  And  Parking  Downtown  (4  options) 

• Listen  to  the  Radio  (670  or  780  a.m.)  for  traffic  reports. 

• Remember,  rush  hours  are  7-10  a.m.,  3-7  p.m.  in  both  directions.  Travel  in  the  city  takes  time.  There  is  a l> 
construction.  Plan  at  least  two  hours  from  the  near  suburbs  to  downtown.  Plan  one-half  hour  (minimum)  in  down 
traffic. 

1)  Coming  in  on  1-94  from  the  North:  1-94  junctions  with  the  Kennedy  at  Irving  Park  Road.  Continue  downtown.  If  traf 
good,  it  should  take  40  minutes  from  the  junction  as  the  Kennedy  is  under  construction.  Beyond  the  Ohio  Street  exit,  { 
the  right-hand  lane.  Exit  at  Washington  Street  going  East.  At  LaSalle,  make  a left,  go  one  block  and  make  a le 
Randolph  to  the  hotel.  After  you  drop  off  your  baggage,  you  can  park  your  car  in  a self-park  (about  $15.00/day)  or  hav 
hotel  park  it.  There  is  NO  street  parking. 

2)  Coming  in  on  1-90  from  the  Northwest:  Follow  1-90  downtown.  This  becomes  the  Kennedy.  Follow  directions  of  1 a 
for  exits  and  parking. 

3)  coming  in  on  1-90/1-90  from  the  Southeast:  Take  the  1-90  (Skyway)  in.  The  toll  will  be  about  $2.00,  but  it  will  save  you 
of  time.  Get  in  the  Express  Lanes  to  downtown.  When  you  approach  the  LOOP  follow  the  signs  saying  1-94,  Kenned; 
Wisconsin.  Exit  at  Monroe  Street  and  head  east.  At  LaSalle,  take  a left,  then  a left  on  Randolph  to  the  hotel.  After  you 
off  your  baggage,  you  can  park  your  car  in  a self-park  (about  $15/day)  or  have  the  hotel  park  it. 

4)  Coming  from  the  South  or  Southwest:  Take  the  1-57  in.  This  junctions  with  1-94  and  1-90.  Read  No.  3 above. 

If  you  are  arriving  some  other  way9  or  have  any  questions,  please  call  Sharon  McNeely  at  (312)  794-2788  before  y 
trip.  She  wilt  be  happy  to  help. 


October  13-18, 1993 


Fifteenth  Annual  Meeting 


Conference  Registration  information 

General  Information 

1.  The  Conference  sessions  begin  Wednesday,  October  13,  1993  and  ends  Saturday,  October  16,  1993.  Please  make 
travel  arrangements  accordingly. 

2.  Pre-register  for  the  conference  using  the  following  registration  materials.  Be  certain  to  register  for  the  conference, 
make  hotel  reservations,  and  if  interested,  register  for  one  or  two  conference  training  workshops.  Workshop 
descriptions  enclosed. 


3.  All  conference  participants  must  be  members  of  MWERA  . Please  pay  1993  dues  if  you  have  not  already  done  so. 
Now  is  an  excellent  time  to  pay  1994  dues  as  well.  Membership  in  MWERA  includes  a subscription  to  the  Midwestern 
Educational  Researcher. 


4.  On-site  registration  and  packet  pickup  are  in  the  lobby  of  the  Bismarck  Hotel  at  the  following  times: 


Wednesday,  October  13, 1993 
Thursday,  October  14, 1993 
Friday,  October  15, 1993 
Saturday,  October  16, 1993 


11:00  a.m.  -4:00  p.m. 
8:00  a.m.  - 4:00  p.m. 
8:00  a.m.  - 4:00  p.m. 
8:00  a.m.  - 10:C0  a.m. 


5.  Please  bring  this  program  with  you  to  the  conference.  A replacement  copy  will  cost  $3.00. 


6.  Please  share  your  conference  program  and  registration  materials  with  co-authors,  colleagues,  and  students  and  invite 
them  to  attend. 


October  13-16, 1993 


Mid-Western  Educational  Research  Association 
Membership  Application 


Fifteenth  Annual  Meeting 


5.  INSTITUTION/EMPLOYER: 

6.  POSITION: 7.  DEGREE: 

8.  MWERA  DIVISIONS  OF  PRIMARY  INTEREST: AERA  MEMBER? 

9.  NEW  MEMBERSHIP  REQUEST: RENEWAL: 

10.  FAX  number 11.  EMAIL  address 


10.  Dues  for  the  calendar  year  (January  through  December)  are  $18.00  (Regular  Member),  $10.00  (Grad 
Student)  & $180  (Life  Membership).  Make  your  check  payable  to:  Mid-Western  Educational  Research 
Association  (MWERA).  Send  completed  application  and  check  to: 

Charles  Anderson 
MWERA  Executive  Officer 
1332  Southwind  Drive 
Northbrook,  Illinois  60062 
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October  13-1$,  1993 


Fifteenth  Annuel  Meeting 


MWERA  Divisions 

A.  Administration 

B.  Curriculum  Studies 

C.  Learning  and  Instruction 

D.  Measurement  and  Research  Methodology 

E.  Counseling,  Human  Development  and  Special  Education 

F.  History  and  Philosophy  of  Education 

G.  Social  Context  of  Education  and  Motivation 

H.  School  and  Program  Evaluation 

I.  Professional  and  Medical  Professions 

J.  Postsecondary  Education 

K.  Teaching  and  Teacher  Education 

Summary  of  Concurrent  Sessions  by  Room 


nz 

Rooms  | 

Medill 

Parlor  A 

Parlor  B 

Parlor  C 

Parlor  D 

Parlor  E 

Parlor  F 

Lincoln 

Maximilian 

nriwri.M 

10:30 

A 

B 

c 

D 

E 

F 

G 

i 

K 

1:00 

A 

B 

c 

D 

E 

k 

G 

H 

K 

2:30 

C 

B 

D 

J 

K 

A 

D 

K 

3:30 

E 

4:00 

4:30 

K 

Genl. 

K 

C 

D 

K 

K 

■■■■ 

mnmm 

9:00 

K 

A 

B 

K 

Genl. 

E 

F 

Exhibits 

G 

1:30 

J 

H 

D 

K 

E 

Genl. 

K 

Exhibits 

2:00 

Exhibits 

G 

3:00 

K 

C 

D 

K 

K 

Exhibits 

G 

4:30 

K 

J 

D 

F 

E 

K 

naw 

EETTTffTPHM 

8:00 

K 

F 

9:00 

K 

A 

D 

E 

G 

Genl. 

K 

1 

C 

10:30 

K 

j 

K 

C 

G 

Genl. 

K 

F 

B 

Suggestions  to  Presenters 

To  make  conference  sessions  as  helpful  and  enjoyable  as  possible,  the  Executive  Committee  asks  presenters  to  please  follow  the 
guidelines: 

1.  Send  a completed  copy  of  your  paper  to  the  Session  Discussant  so  that  it  is  received  no  later  than  September  30,  IS 
Discussants  are  not  obligated  to  discuss  papers  received  after  this  date. 

2.  Bring  at  least  40  copies  of  your  paper  to  the  conference.  People  interested  in  your  paper  should  receive  a copy  at  the  conferenc 

3.  Make  overheads  and  handouts  that  are  attractive  and  readable. 

4.  Plan  to  present,  rather  than  read,  your  paper  in  the  time  allotted. 

5.  Because  of  purchase  costs,  storage  space,  snd  maintenance  issues,  equipment  other  than  overheads  will  not  be  provided. 


October  13-16, 1993 


Fifteenth  Annual  Meeting 


Conference  Program 


Sessions  are  listed  by  day,  time,  and  location.  The  division  is  indicated  where  appropriate.  Institutional  affiliations  are  listed 
in  the  indices.  There  is  a presenting  author  index,  a chair  index,  a discussant  index,  and  co-author  indices.  There  is  a daily 
summary  at  the  start  of  each  day. 


| Wednesday  October  13, 1993 


Workshop  1.  1:00-5:00  PM  Parlor  A 
Robert  Ziomek,  Director,  Department  of  Program 
Evaluation  and  Research,  ACT 
New  Products  and  Programs  from  ACT 

Cost:  Free  [Note:  Participants  must  register  for  the 

conference] 

Workshop  2 1:00-5:00  PM  Parlor  B 
Wendy  l_  Shapiro,  Kent  State  University 
Rebecca  Clemente,  Ball  State  University 
Metamorph:  Computer  Support  for  Qualitative 
Research 

Cost:  $15:00 

Workshop  3 1:00-5:00  PM  Parior  C 
Kathleen  M.  Long,  Indiana  University 
Students  as  Evaluators  of  Self,  Peers,  AND 
Curriculum  & Instruction 

Cost  $15.00 

Workshop  4 1:00-5:00  PM  Parior  D 

Richard  M.  Smith,  University  of  South  Florida 

Item  and  Person  Analysis  with  the  RASCH  Model. 

Cost:  $30.00 

Note:  Includes  materials  normally  costing  $99.00  when  given 
at  other  workshops. 


Invited  Address  • Medill  Room 
Wednesday.  Oct.  13. 1993 
8:00-9:00  PM 
Chair:  Thomas  Andre 

Macro-contexts  for  problem-based  learning: 
Design  Principles  for  Enhancing  Learning 
and  transfer. 

John  Bransford 

Vanderbilt  University 


426 

» 


Session  Overview  Schedule  for  Thursday,  October  14, 1993 

Division 

Time 

A B C | D E 1 F G H | 1 | J K 

8:00-9:00 

Midwest  Hospitality-Maximilian  Room 

8:30-9:20 

New  Member  Welcome  Lincoln  Room 

9:30-10:25 

Opening  Keynote  Address 
John  Bransford 

Vanderbilt  Un«versity-Maximilian  Room 

10:30-11:50 

V V V V V | V 

1 

1 

B 

12:10-12:55 

Brown  Bag  Lunch  - Division  1 

Meetinc 

[» 1 

1:00-2:25 

V 

V 

V 

V 

V 

>/ 

V 

w 

2:30-3:25 

V 

V 

vv 

3:30-4:25 

, 

4:30-5:55 

V 

"V 

UN 

6:00-7:00 

Cracker  Barrel 

Socia 

R1.1  Midwest  Hospitality  Coffee  and  Friends 
8:00-9:00  AM  - MAXIMILIAN  ROOM 
Organizer  Charles  Anderson,  ETS  (Ret.)  and 
MWERA,  Executive  Officer 

R2.1  New  Member  Welcome 
8:30-9:20  AM  LINCOLN  ROOM 
Host  Executive  committee 
Organizer  Carmen  Giebelhaus,  Ohio  State 
University 

First-time  conference  attendees  are  invited  to  sip  a 
cup  of  coffee  while  being  introduced  to  the 
organization,  the  officers,  and  the  conference. 
Special  Badges  will  identify  new  members  and  first- 
time attendees. 

R3.1  OPENING  KEYNOTE  ADDRESS 
9:30-10:30  am  Maximilian  Room 
Chair:  Thomas  Andre 

Program  Chair,  MWERA 
Iowa  State  University 
Welcome:  Ken  Kiewra 

President,  MWERA 
University  of  Nebraska 

John  Bransford,  Vanderbilt 
University 

Research  on  Macrocontexts  for 
Problem-based  Learning 


R4.1  Issues  in  Administration  2 
10:30-11:50  p.m.  - MEDILL  ROOM 
Division  A Paper  Session 
Chair  Hazel  Loucks 
Discussant:  Donald  Hendricks 
Six  keys  to  success  in  systematic  school  restructuring. 
Learning  from  case  studies 
In-Sook  Lee, 

Guiding  framework  for  clarifying  core  values  in  system 
school  restructuring 

In-Sook  Lee 

Quality  improvement  implementation  in  schools:  An 
analysis 

Willis  J.  Furtwengler 

Differential  perceptions  of  elementary  school  teachers 
principals  about  the  appropriateness  of  recess  time  an 
their  alternative  suggestions 

Connie  Nolte 

R4.2  Literacy  Issues 
10:30-11:50  am  Parlor  A 
Division  B Paper  Session 
Chair  Charlotte  Haselhuhn 
Comparison  of  words  correct  and  correct  letter  sequel 
scoring  procedures  for  curriculum  based  spelling 
measures 

Alex  Thomas 

Voices  of  students  speak  a critical  discourse 

Thomas  E.  Oldenski 

Justice  and  equality:  The  missing  components  of 
American  History  textbooks 

Michael  H.  Romanowski 


A On 


R4.3  Epistemological  Beliefs 
10:30- 1 1:50  p.m.  Parlor  B 
Division  C Alternative  Format  Session 
Chain  Marlene  Schommer 
Discussant:  OrphaDuell 

Searching  for  the  big  picture  of  epistemological  beliefs: 
The  first  town  meeting 
Marlene  Schommer 

R4.4  Cognitive  Measurement 
10:30-11 :50  am 
Division  D Paper  Session 
Chair.  Dennis  Leitner 
Discussant:  Isadora  Newman 
The  validity  of  concept  maps  for  assessing  cognitive 
structure 

Robert  S.  Michael,  Daniel  J.  Mueller 

Essay  tests  and  cognitive  style  of  the  reader 

Clinton  I.  Chase 

Look  inside  the  black  box:  A proposal  for  weighting  test 
items  for  cognitive  processing  demands 
Dennison  Bhola,  Barbara  S.  Plake 
Teachers'  perceptions  of  the  adequacy  of  their  own 
teaching  skills  one  to  ten  years  after  graduation:  An 
example  of  scale  construction 

Cynthia  L.  Velotta,  William  E.  Loadman 

R4.5  Special  Education  and  Special  Populations 
10:30-11:50  p.m.  Parlor  D 
Division  E Paper  Session 
Chain  James  Mullins 

An  investigation  of  urban  school  psychologists'  perception 
of  their  future  role  and  function  in  relationship  to  four 
areas  of  the  school  reform  movement 
David  J.  Goodman,  Ronald  R.  Morgan 
Special  educators’ metaphorical  descriptions  of 
instructional  practical  knowledge 
Mark  P.  Mostert 

Family  functioning  analysis  of  families  with  disabled 
infants  and  toddlers:  Implications  for  PL  99-457  and 
teacher  training 

Linda  S.  Behar,  Vivian  Correa,  Cheryl  Beverly 


R4.6  Division  F Invited  Presentation 
2:30-3:25  p.m.  Parlor  D 

Chair.  Don  Castle 

Responsibility  of  schools  of  higher  education  in 
providing  leadership  In  restructuring  public 

education 

Gregory  Gerrich,  Ashland  University 


R4.7  Family  and  School  Relationships 
3:00-4:25  p.m.  MAXIMILIAN  ROOM 
Division  G Paper  Session 
Chain  Shirley  S.  Wilbert 

A study  to  explore  the  inter-relationships  among  factors 
affecting  substance  abuse  of  secondary  school  students 
C.  V.  Nelson,  Van  E.  Cooley,  Jay  C.  Thompson 
An  examination  of  relationships  of  parent's  actions  toward 
their  children 

James  R.  Necessary,  Thomas  S.  Parish 
Parents'  actions:  Are  they  related  to  children's  self- 
concepts,  evaluation  of  parents,  and  to  each  other? 

Thomas  S.  Parish,  James  R.  Necessary 
Conflict  strategies  and  resolutions:  Peer  conflict  in  an 
integrated  early  childhood  classroom 
Heidi  L.  Malloy,  Paula  McMurray 

R4.8  Rasch  Measurement 

10:30-11:50  p.m.  -UNCOLNROOM 
Division  I Symposium 

Applications  of  Rasch  measurements  in  professional 
certification/licensure 

Chair  and  Organizen  Richard  M.  Smith 
Using  the  RASCH  Model  to  set  standards 
Benjamin  D.  Wright 
Computer  adaptive  testing  for  certification 
Betty  Bergstrom 

R4.9  New  Roles  for  Teachers 

10:30-1 1:50  p.m.  - MAXIMILIAN  ROOM 
Division  K Symposium 
Chain  Patricia  Hulsebosch 
Organizen  Elaine  C.  Koffman 
New  roles  for  teachers:  Curriculum  developer, 
researcher,  and  educator-of-future  teachers 

Elaine  C.  Koffman,  Anna  Austin,  Nancy  Green, 
Syvilla  Rushdan,  Jolie  Lasaine,  Nadine  Lee 

R5.1  Brown  Bag  Division  Meetings 
12:05-1:00  p.m. 

Division  A Parlor  A 

Division  B Parlor  B 

Division  C Parlor  C 

Division  D Parlor  D 

Division  E Parlor  E 

Division  F Parlor  F 

Division  G MAXIMILIAN  ROOM 

Division  H BLACKHAWK  ROOM 

Division  I MAXIMILIAN  ROOM 

Division  J LINCOLN  ROOM 

Division  K MEDILL  ROOM 


IS 


R6.1  Issues  in  Administration 
1:00-2:25  p.m.  - MEDILL  ROOM 
Division  A Paper  Session 
Chair  Rebecca  W.  Llibler 
Discussant:  Robert  S.  Estabrook 
Get  involved  in  the  legislative  process:  A survey  of  Ohio 
legislators 

William  Hughes 

Principals  and  the  first  amendment:  The  case  of  icons  in 
public  schools. 

Lyndon  G.  Furst 

The  reform  movement:  A fifty-state  survey  of  state  action 
for  administrator  evaluation 

Carol  B.  Furtwengler,  David  Hurst, 

Nancy  P.  Gibons 

Effects  of  personal  and  school  factors  on  teacher 
turnover  A discriminant  analysis 

Hyun-Seok  Shin 

R6.2  Curriculum  Issues 
1:00-2:25  p.m.  Parlor  A 
Division  B Paper  Session 
Chair  EvaWeisz 

A content  analysis  of  middle  school  team  meetings 

Carla  C.  Shaw 

Knowledge  requirements  in  doctoral  curriculum  and 
instruction  programs 

Linda  S.  Behar 

Field  testing  as  an  issue  in  curriculum  development 

Ruth  A.  Shafer 

Elementary  curriculum  integration:  A content  analysis  of 
leading  practitioner  journals 

Gloria  T.  Alter 

R6.3  Predicting  Performance 
1:00-2:25  p.m.  Parlor  B 
Division  C Paper  Session 
Chair  Gregg  Schraw 
Discussant:  Gregg  Schraw 
Investigating  different  raters'  perception  of  the 
components  of  the  foreign  language  speaking  skill 
Micheline  B.  Chalhoub-Deville 
The  reading  practices  and  study  behaviors  of 
developmental  and  nontraditional  community  college 
students 

M.  Cecil  Smith,  Robert  J.  Keller 

Predicting  performance  on  a test  of  general  education 
skills 

Timothy  J.  Sewall 


R6.4  Person  Measurement 
1:00-2:25  p.m.  Parlor  C 
Division  D Paper  Session 
Chair  Paula  Woehlke 
Discussant:  Ralph  Mueller 
The  consistency  of  stimulated  recall  interviews  in  data 
gathering  and  analysis 
Mark  P.  Mostert 

Comparing  methods  for  reducing  person  misfit 

Rita  K.  Bode 

Assessing  discipline  effects  in  faculty  ratings  of  student 
written  essays 

Laura  L Bames,  Ron  Petrin,  Dale  Fuqua, 

Namok  Bryant,  Kenneth  McKinley, 

Becky  Johnson 

Interpreting  the  IV,  B,  and  Sato  caution  indexes 
Ayres  G.  D'Costa 

R6.5  Critical  Research  Issues  in  Counseling 
1:00-2:25  p.m..  Parlor D 
Division  E Symposium 
Chair  Eddie  E.  Glenn 
Organizer  Thomas  E.  Midgette 
Critical  research  issues  in  counseling:  Cultural  and 
clientele  diversity 

Thomas  E.  Midgette,  Eddie  E.  Glenn, 

Betty  S.  King,  Lynn  Siebring,  James  Mullins, 
Richard  L.  Allen 

R6.6  Teacher  Roles 
1:00-2:25  p.m.  Parlor  E 
Division  K Paper  Session 
Chair  Doug  Smith 

Practicing  what  they  teach:  Should  teachers  'Do  as  th( 
say?' 

Lynda  R.  Wiest 
Practitioner’s  View 

Leon  J.  Zalewski 

Extended  wait-time  I and  university  student  achieveme 

Orpha  K.  Duell 

R6.7  Moral  Reasoning  and  Cultural  Values 
1:00-2:25  p.m.  Parlor  F 
Division  G Paper  Session 
Chair  Mary  Ann  Flowers 

An  ethic  of  sharing:  Perspectives  on  the  dispositions  c 
elementary  students  to  share 

Melissa  M.  Bogan,  Thomas  J.  Lasley 
Autonomous  morality  of  older  adolescents  and  the 
influence  of  implicit  intention  of  an  action 
Rich  Hofmann 

Apply  Kluckhohn's  value  orientations  in  multicultural 
education:  A structural  approach  to  understanding 
diversity 

Joan  S.  Timm 


R6.8  Non-Traditional  High  School 
1:00-2:25  p.m.  - LINCOLN  ROOM 
Division  H Symposium 
Chair  William  Loadman 
Discussant:  Daniel  Mueller 
Organizer  Micheline  B.  Chalhoub-Deville 
Conceptualizing,  implementing  and  evaluating  a non- 
traditional  high-school  program 

William  Loadman,  Craig  W.  Deville,  Judy  Hummel, 
Rich  Houchen 

R6.9  Alternative  Certification 

1:00-2:25  p.m.  - MAXIMILIAN  ROOM 
Division  K Symposium 

Promises  and  perils  of  alternative  certification:  Lessons 

from  a mid-career  teacher  training  program 

Chair  Susan  M.  Hegland 

Meeting  the  needs  of  the  professional  seeking 

certification:  Identifying  and  removing  the  academic 

barriers 

Susan  M.  Hegland, 

Distance  learning  and  assessment  systems:  Portfolios, 
qualitative  observations,  quantitative  ratings , interviews 

Valerie  Samuels 

Alternative  certification:  A student  view 

Nikki  Keraus 

But  how  good  are  they?  A word  from  cooperating 
teachers  and  supervisors 

Delora  Hade 


R6.10  NEW  MEMBER  WORKSHOP 

1:00-2:25 

Publishing,  Not  Perishing! 

Winning  at  the  Publication  Game. 

Journal  Editors  and  Publishing  Gurus  discuss  the  process  of  developing  a a 
productive  research  and  publishing  program.  Bring  a draft  article  and 
receive  a presubmission  review  back  from  a MWERA  Researcher  Editor. 
New  members  have  priority  in  this  session.  Other  members  may  attend  if 
space  Is  available 


R7.1  Metacognition 

2:30-4:25  p.m.  - MEDILL  ROOM 
Division  C Paper  Session 
Chair  Daniel  Robinson 
Discussant:  Daniel  Robinson 
Practice  effects  on  learners'  collaboration  of  performance 
Rayne  S.  Dennison,  Gregory  Schraw 
What  do  you  think?  College  students'  awareness  of  their 
own  ideas  during  class 

Jean  W.  Pierce,  Adel  Sultan 
A comparison  of  three  presentation  methods  of  teaching 
statistics 

Abbot  L.  Packard,  Glen  A.  Holmes 


A pilot  study  of  urban  middle  school  students'  perception 
of  their  efficacy  with  respect  to  academic  achievement 

Vicky  L.  Timme,  Jerry  L.  Jinks, 

Josephine  Logan-Woods 

R7.2  Research  on  Literacy 
2:30-3:25  p.m.  Parlor  A 
Division  B Paper  Session 
Chair.  EvaWeisz 

Heightening  students'  understanding  of  problem-solution 
relationships:  A method  for  enhancing  comprehension  of 
word  problems 

Carol  A.  Stevens 

A description  of  a research  program  for  enhancing  literacy 
in  the  workplace 

Edward  E.  Gordon,  Ronald  R.  Morgan, 

Judy  J.  Ponticell 

R7.3  1993  Program  Committee,  Divisional  Chairs,  and 
1994  Program  Chair. 

2:30-3:25  Parlor  B 

R7.4  Addressing  the  Needs  of  Exceptional  Learners 
2:30-4:25  p.m.  Parlor  C 
Division  J Paper  Session 
Chair.  Kim  K.  Metcalf 

A comparison  of  alternatives  for  enhancing  the  algebra 
skills  of  adult  college  students 

Peggy  G.  Woodard,  David  E.  Suddick, 

John  H.  Meyer 

The  cognitive  levels  of  the  educational  programs  offered 
adult  vocational  instructors:  A study  of  adult  vocational 
education  instructors  in  joint  vocational  schools  and 
community  education  career  centers  in  central  Ohio 
Patrick  J.  Squire,  Larry  Miller 
Noncognitive  variables  and  academic  performances  of 
minority  university  freshman 

Hing  Kwan  Luk,  Lucy  C.  Jacobs 
An  evaluation  of  the  honors  program  at  College  of  Lake 
County 

Carole  Bulakowski 

R7.5  Teaching 

2:30-3:25  p.m.  Parlor  E 
Division  F Symposium 
Chair  and  Organizer  Linda  S.  Behar 
Teaching  and  the  art  of  war 
Gregory  J.  Marchant 

The  shifting  assumptions  of  curriculum  history:  Defining  a 
field  of  research 

McDonald  Joyce 

Polanyi’s  tacit  knowing  and  education 

Robert  M.  Boody 
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R7.6  Issues  in  Administration 
2:30-3:25  p.m.  Parlor  E 
Division  A Paper  Session 
Chair  Will  Place 
Discussant:  Sally  Childs 

An  early  warning  system  for  schools:  An  examination  of 
Illinois'  financial  watch  list 

William  L.  Sharp 

A follow-up  study  of  shared  training  for  schcol-based 
instructional  leadership 

Edie  L Holcomb 

Technology  in  education:  Attitudes,  opinions,  and 
knowledge  of  community  and  school  personnel 

David  S.  Hurst 

Relationship  between  leadership  and  decentralization:  A 
multi-university  study 

Dianne  Brown-Wright.  Isadore  Newman, 

Larry  G.  Bradley 

Predictors  of  microcomputer  use  by  faculty  in  higher 
education 

Caryl  A.  Hess 

R7.7  Power  Analyses 
2:30-4:25  p.m.  Parlor  F 
Division  D Paper  Session 
Chair  Ralph  Mueller 
Discussant:  Bruce  G.  Rogers 
A comparison  of  the  power  of  statistical  tests  of 
independence  in  contingency  tables  with  small  samples 
Cynthia  G.  Parshall,  Jeffrey  D.  Kromrey 
Comparative  power  of  meta-analysis  in  the  Solomon  four- 
group  design 

Shlomo  S.  Sawilowsky,  D.  Lynn  Kelly 
Barry  S.  Markman 

Investigation  of  power  using  F approximations  for 
Hotelling's  trace  and  Pillai's  trace 

Ronald  S.  Elliot,  Robert  S.  Barcikowski 
Effects  of  unreliability  of  the  concomitant  variable  on  t- 
power  of  four  between-subjects  designs 
Janet  K.  Sheehan,  Ritu  Khanna 

R7.8  Teaching  Teachers 

2:30-4:25  p.m.  - LINCOLN  ROOM 
Division  K Symposium 

Teaching  teachers:  Selected  perspectives  of 
undergraduate  special  education  teacher  preparation 
Chair  and  Organizer  Mark  Mostert 
Practical  issues  in  writing  and  teaching  case  studies  to 
special  education  students 
Mark  P.  Mostert 

Philosophy,  instructional  methodology,  training,  and  goals 
of  teachers  of  the  behaviorally  disordered 

Paul  Beare 


The  quality  of  IEP  Objectives  and  their  relevance  to 
instruction  for  students  with  mental  retardation  and 
behavioral  disorders 

Susan  Severson 


R7.9  Workshop6 

2:30-5:30  p.m.  - MAXIMILIAN  ROOM 
Cost  $15.00.  Preregistration  Required 
FLEXTEXT:  A Methodology  for  the  Qualitative  Analysis 
of  Textual  Data 

Jeffrey  B.  Hecht,  Illinois  State  University 
Sara  B.  Wills,  Illinois  State  University 
David  J.  Dwyer,  Illinois  State  University 
Nicole  K.  Roberts,  Illinois  State  University 


R7.10  New  Approaches  in  Counseling 
3:30-4:25  p.m.  Parlor  B 
Division  E Paper  Session 
Chair.  Betty  S.  King 

The  effect  of  the  Canfield  Learning  Style  Inventory  (LSI) 
and  intrusive  counseling  methods 
Isaiah  Sessoms 

A description  and  a comparative  evaluation  of  a social 
skills  training  program 

Sheila  Morrison,  Ronald  R.  Morgan 
Group  conflict:  Relationship  of  group  member  conceptu 
level,  conflict  verbal  tactics,  and  group  development 
Carolyn  R.  McRoy 

The  rolw  of  teachers  in  promoting  muticultural  educatior 
in  South  Africa 

Zodwa  Dlamini 

R7.11  Student  Teaching  Supervision 
3:30-4:25  p.m.  - LINCOLN  ROOM 
Division  K Paper  Session 
Chair  Ronald  Marso 

Cooperating  teachers  and  university  supervisors:  The 
state  of  the  art  in  the  supervision  of  student  teaching 
Donald  A.  Williams,  Jeff  Peck,  Doug  Smith 
What  do  we  know  about  effective  student  teaching 
supervision? 

Victor  Hernandez,  Maria  Eiio  Galvez 


R7.12  Workshop  5 
4:00-6:00  p.m.  Parlor  F 
Cost  $15.00  Preregistration  Required 
Becoming  More  Competitive  in  an  Interview:  Portfolios 
an  Authentic  Representation  of  Teaching  Skills 
Carole  Newman,  University  of  Akron 


R8.1  Technical  Computers 

4:30-5:55  p.m.  - MEDILL  ROOM 
Division  K Paper  Session 
Chain  Jeffrey  Peck 
Educational  resources  on  the  Internet 
Kwan-Yau  Lam 

Kansas  middle  and  high  school  computer  use  survey 

Bill  Yates 

R8.2  The  Semiotic  Experience 
4:30-5:55  p.m.  Parlor  A 
MWERA  Paper  Session 
Chair.  Gary  Shank 

Chaos  theory  and  educational  research:  A semiotic 
encounter 

Edward  S.  Wood 

Qualitative  analysis  of  a synthetic  culture:  A 
methodological  inquiry 

Suzanne  C.  MacDonald,  Isadore  Newman, 

Kyle  Waite 

R8.3  Early  Childhood  Teacher  Preparation 
4:30-5:55  p.m.  Parlor  B 
Division  K Paper  Session 
Chain  Paula  McMurray 

Antecedent  experiences  in  early  childhood  teacher 
education:  The  hidden  treasure 

Amy  B.  Palmeri 

R8.4  Metacognition:  Integrating  Theory  & Practice 
4:30-5:55  p.m.  Parlor  C 
Division  C Alternative  Format  Session 
Chain  Eileen  J.  Wood 
Metacognition:  Integrating  theory  and  practice 
Eileen  J.  Wood,  Greg  Shraw,  Alice  Corkill, 

Tina  Willoughby,  Jacqui  Specht 

R8.5  Advanced  Measurement 
4:30-5:55  p.m.  Parlor  D 
Division  D Paper  Session 
Chain  Betty  Bergstrom 
Discussant  Barbara  Plake 
Parameter  invariance  and  factorial  invariance 
Dennis  Hocevar,  C.  Tina  Huang 
Confirmatory  factor  analysis  of  the  multidimensionality  of 
Marsh's  students’  evaluations  of  educational  quality 
(SEEQ) 

Dennis  Hocevar,  Hung  Chi 
A comparison  of  maximum  likelihood  generalized  least- 
squares,  and  weighted  least-squares  estimation 
procedures  using  ordinal  data 
Wendy  C.  Naumann-Sandoval, 

Deborah  L.  Bandalos 


Effects  of  measurement  error  on  the  pretest  covariate  in 
three  designs  of  experiments  using  ANCOVA 
Irina  R.  Soderstrom,  Tianqi  Han 

R8.6  Early  Childhood  Education 
4:30-5:55  p.m.  Parlor  E 
Division  K Symposium 

Current  practices  in  early  childhood  education 
Chain  Beverly  Gulley  & Marge  ret  Matthias 
Organizen  Deborah  Moberiy 
Alternative  assessment  methods 
Beverly  Gulley,  Barbara  Myers 
Curriculum  planning  and  facilitation  of  learning 
Deborah  Moberiy 

Teacher  evaluation  and  staff  development 

Paula  Woehlke 

The  effect  ofpartent  involvement  on  parental  expectations 
for  children's  educational  achievements 

Linda  Fiock 

A comparative  study  of  observed  language  behaviors  of 
pre-kindergarten  children  at  risk  of  academic  failure  in  the 
context  of  a literacy-enriched  play  environment 
Margaret  Matthias 

R8.7  Synergy 

4:30-5:55  p.m.  - UNCOLN  ROOM 
Division  K Alternative  Format  Session 
Synergy:  Capitalizing  on  collaboration 

Bemita  L.  Krumm,  Jennifer  Fager, 

Gary  Steinley,  Barbara  Kleinjan, 

Patricia  Hacker,  Marcy  Reisetter, 

Kathryn  Penrod 


R8.8  Association  Council  and  Executive  Committee 
Meeting 

4:30-5:55  p.m.  - Room  501 
Executive  Committee  members  and  Association  Council 
members  should  plan  on  attending 


Session  Overview  Schedule  for  Friday  October  15, 1993 

Division 

Time 

ABC 

D E F G H 1 1 J K 

8:00-9:00 

M 

idwest  Hospitality  Maximilian  Room 

9:00-10:25 

V V | V 

V V | V V | V V 

10:30-11:40 

General  Business  Meeting  - Maximilian  Room 

11:50-1:25 

MWERA  Luncheon  Walnut  Room  Lobby  Level 

12:30-1:25 

Luncheon  Keynot 
Jere  Brop 
Michigan  State  l 

e Address 
hy 

Iniversity 

1:30-2:55 

V 

V 

V 

2:00-2:55 

V 

3:00-4:25 

V 

V 

V 

vvv 

4:30-5:55 

V 

V 

V 

w 

9:00-? 

President's  Reception-Regency  Suil 

£ 1 

F1.1  Midwest  Hospitality 

8:00-9:00  am  - MAXIMILIAN  ROOM 

F2.1  Student  Teaching  II 

9:00-10:25  p.m.  - MEDILL  ROOM 
Division  K Paper  Session 
Chain  Terry  Corwin 
The  problems  of  student  teachers 
Sonja  J.  Smith 

Peer  conferencing  and  Its  implications  upon  preservice 
teacher  training 

Connie  L.  Bowman 

Senior  intern's  concerns  toward  a supervisory  innovation: 
The  integrated  systems  model  for  professional 
development 

Diane  Nelson 

Clinical  supervision-control  or  empowerment:  Has  the 
paradigm  changed? 

Susan  R.  Cramer,  Ruth  Koskela 

F2.2  Translating  Theories  and  Research 
9:00-10:25  am  Parlor  A 
Division  A Symposium 

Translating  theories  and  research  into  administrative 
practice:  Implications  for  school  leadership 
Chair.  Charles  D.  Almo 
Organizer.  Martin  H.  Jason 
Discussant:  Frances  Carroll,  Richard  Smith 
Perspectives  on  the  value  of  theory  for  school 
administrator  and  students  in  leadership  preparation 
programs 

Charles  D.  Almo 

Applying  theory  through  action  research 

Martin  H,  Jason 


Applying  theories  to  the  doctoral  internship  in  educatii 
administration 

Tom  Van  Dam 

An  exploration  of  instructional  approaches  to  bridging 
gap  between  theory  and  practice  in  educational  leade. 
courses. 

Yiping  Wan 

F2.3  Content  and  Instructional  Strategies 
9:00-10:25  Parlor  B 

Division  B Paper  Session 
Chair  Linda  S.  Behar 

Effects  of  LOGO-based  instruction  on  student  attitud( 

Mian  M.  Yusuf 

A comparison  of  student-constructed  versus  teacher- 
constructed  learning  activities  In  phase  two  of  the  ST. 
cycle 

William  J.  Gnagey,  Nora  Y.  Navarro 
Countdown:  Using  cable  television  technology 
Diane  Schiler,  Doroothy  Giroux, 

Catherine  Thomas, 

F2.4  Teacher  Education  Curriculum 
9.00- 10:25  MAXIMILIAN  ROOM 
Division  K Paper  Session 
Chair:  Susan  M.  Hegland 
An  alternative  in  teacher  preparation  delivery:  The 
challenge  of  planning 
Kathleen  Maury 

Using  needs  assessment  during  student  teaching:  A 
preliminary  study  using  a needs  assessment  instrum 
train  pre-service  tearhers 

Charles  K.  Runyan,  Rozanne  H.  Sparks, 
Richard  Lipka 
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F2.5  MWERA  Invited  Presentation 
9:00-10:25  am  Parlor  D 

Chain  Ayres  D’Costa 

Composition  analysis 
Benjamin  D.  Wright 


F2.6  African  American  Male  Academics 
9:00-10:25  am  Parlor  E 
Division  E Symposium 
Chair  and  Organizer  Thomas  E.  Midgette 
African-American  male  academics:  Male  and  female 
differences  and  similarities 

Thomas  E.  Midgette,  Eddie  E.  Glenn, 

Nudie  E.  Williams,  Mary  Ann  Flowers, 

Clara  A.  New,  Isaiah  Sessom, 

Nelson  Strobert 

F2.7  Race  and  Education 
9:00-10:25  am  Parlor  F 
Division  F Paper  Session 
Chain  Valerie  Samuels 

Race  and  education  and  its  negative  impact  beyond  the 
classroom  for  blacks 

Jennifer  N.  Humphries 

The  city  normal  schools  of  Cleveland  and  Akron,  Ohio 

Melinda  J.  Kline 

F2.8  Equity/Equality/Education 
9:00-10:25  p.m.  MAXIMILIAN  ROOM 
Division  G Symposium 
Chair  and  Organizer  Linda  S.  Behar 
Visions  of  equity  and  equality  in  education 
Linda  S.  Behar,  Geneva  Gay, 

Martin  Haberman,  Ronald  R.  Morgan, 

Allan  C.  Ornstein 


F3.1  General  Business  Meeting 
10:30-11:40  am-MAXIMILIAN  ROOM 


F4.1  MWERA  Luncheon 

1 1:50-1:25  p.m.  WALNUT  ROOM 


F4.  2 Luncheon  Keynote  Address 
12:35-1:25  p.m.WALNUT  ROOM 

Chair:  Richard  Pugh 

Trends  in  Research  in  Teaching 
Jere  Brophy,  Michigan  State  University 


F5.1  Job  Satisfaction 

1:30-2:55  p.m.MEDILL  ROOM 
Division  K Paper  Session 
Chair  Clara  A.  New 

Professional  selfesteem  of  teacher  educators 

Richard  J.  Reynolds 

Teacher  career  development  concern  stages  of  traditional 
and  nontraditional-aged  beginning  secondary  teachers 
Mary  K.  Bendixen-Noe 
Predicting  teacher  job  satisfaction 

Inyoung  C.  Kim,  William  E.  Loadman 
Methodological  approaches  in  teacher  job  satisfaction 
Inyoung  C.  Kim,  William  E.  Loadman 

F5.2  Enhancing  School  Practice 
1:30-2:55  p.m.  Parlor  A . 

Division  H Paper  Session 
Chair  Corenna  C.  Cummings 
Dick  and  Jane  revisited:  Personal  reflections  of  ability 
grouping 

Mary  Ann  Wham 

Integrating  continuous  quality  improvement  principles  in 
educational  leadership  program 

Susan  R.  Cramer,  Scherie  E.  Lampe 
Chasing  elephants  with  butterfly  nets:  Initial  evaluation 
efforts  of  a large  teacher  education  program  by  two 
graduate  students 

Steven  Koch,  Lawrence  Rogien 

F5.3  Scaling  and  Measurement 
1:30-2:55  p.m.  Parlor  B 
Division  D Paper  Session 
Chair  Isadore  Newman 

A note  on  the  accuracy  of  passing  scores  set  by  the  Angof 
and  Nedelsky  methods 

Michael  J.  Subkoviak,  Todd  M.  Franke 
Potential  errors  in  the  use  of  probabilistic  methods  to 
determine  cheating  on  multiple  choice  examinations 
David  J.  Dwyer,  Jeffrey  B.  Hecht 
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F5.3  Cont 

A journey  through  the  world  of  scale  equating:  An 
example  using  the  national  data  base  for  scale 
transformation 

Susan  A.  Granoff,  William  E.  Loadman 

Item  parameters  estimated  by  structural  equation 
modeling  and  item  response  theory 

Dennis  Houvar 


A comparative  analysis  of  specifically  prepared  and 
generally  prepared  middle  school  preservice  teachers 

Theresa  M.  Stabler 

Instructional  preferences  of  preservice  teachers  at  three 
different  levels  of  academic  aptitude 

Charles  E.  Skipper 

Students' perspective  on  teacher  preparation 

Joy  D.  McCullough 


F5.4  Student  Teaching 
1:30-2:55  p.m.  Parlor  C 
Division  K Paper  Session 
Chair.  Ruth  Koskela 

Improving  teacher  education  field  experiences:  Seeking 
collaborative  feedback 

Alice  L.  Young,  Ron  Copenhaver 
Cooperating  teacher  feedback  to  student  teachers: 

Current  practices  and  future  directions 
Elizabeth  A.  Wilkins,  Donna  M.  Post 
The  mechanical  third  ear  device:  A student  teaching 
supervision  alternative 
Carmen  R.  Giebelhaus 

F5.S  Human  Development:  Psychosocial  Aspects 
1:30-2:55  p.m.  Parlor  D 
Division  E Paper  Session 
Chain  Linda  Bakken 

Psychosocial  characteristics  of  persisters  and 
nonpersisters  in  undergraduate  teacher  education 
programs 

Elaine  Baker,  Sue  Dowd,  Jane  Belt, 

James  Tramitl,  Linda  Bakken 
Preservice  teacher  education  students:  Their 
development  of  mature  psychosocial  characteristics 
Jane  Beit,  Sue  Dowd,  Elaine  Baker, 

James  Tramill,  Linda  Bakken 
Psychosocial  differences  between  elementary  and 
secondary  preservice  teacher  candidates 
Sue  Dowd,  Elaine  Baker,  Jane  Belt, 

James  Tramill,  Linda  Bakken 

F5.6  Getting  Started  with  the  Basic  Coding  of  Textual 
Data 

1:30-2:55  Parlor  E 

MWERA  Alternative  Format  Session 
Chair.  Rich  J.  Hofmann 
Discussant:  Rich  J.  Hofmann 

F5.7  Preservice  Teachers 
1:30-2:55  p.m.  Parlor  F 
Division  K Paper  Session 
Chair.  Deborah  Bainer 

A longitudinal  study  of  student  perceptions  of  classroom 
management  courses  using  a simulation  methodology 

Douglas  M.  Brooks,  Robert  Shearer 


FS.8  Divisions  B & G Invited  Presentation 
2:00-2:55  p.m.MAXIMIUAN  ROOM 

Chain  Joan  Timm 
Discussant:  Rose  Mary  Scott 

An  analysis  of  the  critiques  of  multicultural  educati 
Christine  Sleeter 

University  of  Wisconsin,  Parkside 


F6.1  Portfolio  Assessment 
3:00-4:25  p.m.MEDILL  ROOM 
Division  K Paper  Session 
Chair  Connie  Bowman 

A summary  of  published  research:  Classroom  teacher 
and  other  educators'  attitudes  toward  and  support  of 
teacher-made  testing 

Fred  L.  Pigge 

Using  a teaching  portfolio  as  an  evaluation  tool  with 
student  teachers 

Karen  M.  Dutt,  Mary  A.  Kayler 
The  use  of  teaching  portfolios  in  teacher  education 
James  E.  Green,  Sheryl  O.  Smyser 
Developing  competency  in  preservice  training  progran 
through  portfolio  assessment 

Marilyn  K.  Urquhart,  Lana  M.  Danielson 

F6.2  Outcomes-based  Education 
3:00-4:25  p.m.  Parlor  A 
MWERA  Paper  Session 
Chair  Delora  Hade 

An  assessment  of  teachers'  and  administrators'  attitu* 
and  knowledge  about  outcome-based  education,  quai 
performance  accreditation,  and  staff  development 

Carol  B.  Furtwengler,  James  Carroll, 

Wilis  Furtwengler,  Louise  C.  Herrington, 

Melva  Owens 

Secondary  journalism  programs:  A "natural'' for 
outcomes-based  education 

Laura  Schaub 

Fire  up  for  OBT:  A paradigm  shift  as  clear  as  Glasse, 
James  J.  McCluskey,  Thomas  S.  Parrish 
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F6,3  Conceptual  Learning  and  Assessment 
3:00-4:25  p.m.  Parlor  R 
Division  C Paper  Session 
Chair.  Cecil  Smith 

Using  concept  maps  as  tools  for  authentic  assessment 
Marcia -Reisetter,  Gary  Steinley 
Graphic  organizers  facilitate  more  integrated  writing  and 
better  study  strategies 
Daniel  H.  Robinson 

The  importance  of  sound  during  silent  reading 

Daniel  H.  Robinson 

Concept  mapping  in  the  junior  high  school  science 
classroom  as  it  relates  to  student  achievement  and  the 
examination  of  conceptual  change 

Jodi  J.  Haney,  Carrie  Bradley,  Liz  Berkoltz 

F6.4  Testing  in  Practice 
3:00-4:25  p.m.  Parlor  C 
Division  D Paper  Session 
Chair.  Bruce  Rogers 

Using  standardized  test  scores  to  predict  outcomes  on 
statewide  proficiency  tests 

Michael  H.  Wronkovich,  Isadcre  Newman, 

James  Robinson 

Setting  an  optimum  time  limit  for  a computer-administered 

test 

Dennison  S.  Bhola,  Barbara  S.  Plake 
Computerized  adaptive  testing:  The  theory  and  the  reality 
Ellen  R.  Julian,  Anthony  Zara,  Carol  Hartigan 
Opinions  of  measurement  specialists  regarding 
appropriate  testing  and  grading  practices  for  teachers 
Tracy  Thomdike-Christ,  James  Impara 

F6.5  Educators  and  Research 
3:00-4:25  p.m.  Parlor  D 
Division  K Paper  Session 
Chain  Kathleen  Maury 

Looking  back  at  teacher  education  in  MWERA:  Direction 
for  the  future 

Joy  D.  McCullough 

The  research  productivity  of  teacher  educators  in  private 
institutions 

Linda  B.  Morrow 

Perceptions  of  the  research  component  in  master's  level 
teacher  education  programs 
Ruth  David,  Marjorie  R.  Leon 

F6.6  Teacher  Education  National  Database 
3:00-4:25  p.m.  Parlor  E 
Division  K Symposium 

National  database:  Differences  across  teacher  education 
institutions 

Chair  and  Organizer  William  E.  Loadman 


The  data  profile:  Descriptive  characteristics  of  recent 
graduates  contained  within  the  national  database  on 
teacher  follow-up 

William  E.  Loadman 

Relationship  of  gender  and  teaching  level  with  self  rating 
of  teaching  skills 

Susan  M.  Brookhart 

Comparing  three  methodologies  of  scale  equating 

Susan  Granoff 

The  history,  purpose,  and  quality  of  the  national  database 

Beverly  Klecker 


F6.7  Workshop  7 

3:00-6:00  p.m.  Parlor  F 
Cost  $15.00.  Preregistration  Required 
Using  the  Arts  in  the  Classroom 
Alfred  Kisubi, 

Karen  E.  Muench 


F6.8  Perceptions  of  Institutional  Contexts 
3:00-4:25  p.m.MAXIMlUAN  ROOM 
Division  G Paper  Session 
Chair  Mary  R.  Sudzina 

Inservice  teachers'  and  future  administrators'  awareness 
of  culturally  responsive  pedagogy  for  the  1990's  and 
beyond 

Linda  D.  Hayes 

Are  professors' behaviors,  students' behaviors,  and 
student  self-concepts  related  to  one  another? 

Thomas  S.  Parish,  Robert  V.  Parish 
Professors'  actions  and  attitudes:  How  do  they  relate  to 
another? 

James  R.  Necessary,  Thomas  S.  Parish 

Preservice  and  inservice  teacher  differences  in  their 
perceptions  of  personal  teaching  efficiency 

Mary  Ann  Flowers 

F7.1  Teaching  and  Collaboration 
4:30-5:55  p.m.MEDILL  ROOM 
Division  K Paper  Session 
Chair  Rebecca  Turner 

Homework  and  cooperative  learning:  One-year  follow-up 
study  of  a classroom  field  experiment 
Harvey  C.  Foyle,  Lawrence  Lyman 
Views  of  classroom  teaching:  Comparing  the  thoughts  of 
not-so-masterful  and  masterful  teachers 
Rozanne  Sparks,  Richard  P.  Lipka 
Profiles  of  interaction  among  novice,  reassigned,  and 
experienced  elementary  teachers 

Deborah  L.  Bainer,  Cheryl  K.  Didham 
The  university/school  partnership:  Clinical  teaching 
faculty 

Carmen  R.  Giebelhaus,  Steven  Hoffman, 

Judith  Snyder 
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F7.2  Workshop  8 

4:30-6:30  p.m.  Parlor  A 
Cost  $25.00,  Preregistration  required 
VTLOGANU  A Method  for  the  Qualitative  Analysis  of 
Videotaped  Data 

Nicole  K.  Roberts,  Illinois  State  University 
Jeffrey  B.  Hecht,  Illinois  State  University 


F7.3  Non-Traditional  Instruction  in  Higher  Ed 
Division 

4:30-5:55  Parlor  B 

Division  J Paper  Session 
Chair  Deb  Bainer 

Comparative  effects  of  on-campus  and  off-campus  clinical 
experiences  for  preservice  teachers 
Ronen  Hammer,  Kim  K.  Metcalf 
A comparison  of  preservice  teachers'  perceived 
effectiveness  of  a clinical  laboratory  experience  and 
subsequent  student  teaching  experiences 
Zaine  Ridling 

Development  of  guidelines  for  planning  university  class 
presentations  in  distance  education 

Richard  C.  Pugh 


F7.4  Division  D Invited  Presentation 
4:30-6:00  p.m.  Parlor  C 

Chair:  Robert  S.  Barcikowski 

Equating  Tests  Under  Item  Response  Theory 
Frank  Baker,  University  of  Wisconsin,  Madison 


F7.5  Diversity  in  Education 
4:30-5:55  Parlor  D 
Division  F Roundtable 

Chicago  Research  Ensemble  of  Northern  Illinois 
University 


F7.6  Assessment  Issues 
4:30-5:55  p.m.  Parlor  E 
Division  E Paper  Session 
Chair.  LynnSiebring 

Ego  identity  status  and  the  structure  of  students'  daily 
college  experience 

Susan  C.  Root 

Evaluating  the  relationship  between  college  students’ 
vocational  congruence,  academic  success,  and  career 
maturity:  Career  counseling  implications  and  future 
directions 

Darrell  A.  Luzzo 

Personality  and  job  characteristics:  Relation  to  job 
satisfaction  and  absenteeism 

Walter  C.  Buboltz 

Utilization  of  the  Child  Behavior  Checklist  as  it  relates 
DSM-lll-R  classifications:  A concern  for  interpretability 

Paul  J.  Britton,  Cynthia  D.  Smith, 

Isadora  Newman 

F7.7  Personalities  of  Teachers 
4:30-5:55  p.m.MAXlMlUAN  ROOM 
Division  K Symposium 

The  personalities  of  pre-service  teachers  as  measured  b] 
Cattell's  1 6 PF:  Estimates  of  factor  structure  stability, 
norms,  and  relationship  to  program  choice  and  Holland 
types 

Chair  and  Organizer  Isadora  Newman,  James 
Schuerger 

The  factor  structure  of  preservice  teachers'  personalities 
as  measured  by  the  16PF:  Estimates  of  stability  across 
time  and  gender 

Joseph  Marth 

Cattellian  variables  in  predicting  education  specialization 

Madhavi  Warrick 

Personality  dimensions  of  education  majors:  Holland  typ 
and  the  16  PF 

James  DeLamatre 
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Session  Overview  Schedule  for  Saturday  October  16, 1993 


Division 


Time 

A 

B 

C 

D 

E 

F 

G 

H , 

1 

J 

8:00-9:00 

1 

Midwesl 

Hospitality  Maximilian  Room  | 

8:00-8:55 

V 

V 

9:00-10:25 

V 

V 

V 

V 

V 

V 

10:30-12:00 

V 

mm 

V 

vw 

1:00-3:00 

Executive  Committee  Meeting-Regency  Suite  I 

S3.1  Teacher  Evaluation 


51.1  Fun  Run,  Walk,  Crawl 

7:00-8:00  am  Bismarck  Lobby 

52.1  Midwest  Hospitality 
8:00-9:00  am-MAXIMILIAN  ROOM 

52.2  External  Expertise 
Division  F Symposium  Parlor  F 

Applying  external  expertise  to  education. 

Chicago  Educational  Expertise  Consortium 

52.3  Diversity/Multicultural  Considerations 
8:00-8:55  Parlor  C 

Division  K Paper  Session 
Chain  Mary  Ann  Flowers 

Cultural  diversity  and  the  changing  family:  A survey  of 
middle  grades'  teachers 

Ervin  F.  Sparapani 

Some  social  implications  of  teacher  testing  for  minorities 
in  education 

Donald  J.  Reyes,  Alan  M.  Voelker 

Effects  of  the  minority  mentorship  project  on  its 
participants 

Donald  Collins,  A,  Branch,  M.  Bailey, 

E.  Ogbeide 

Multicultural  education  in  physical  education:  A study  of 
knowledge,  attitudes,  and  experiences 

William  G.  Sparks,  K.  L.  Butt,  M.  Pahnos 


9:00-10:25  am-MEDILL  ROOM 
Division  K Paper  Sessions 
Chair.  Sue  Brookhart Teachers'  and  principals' 
perceptions  of  teacher  evaluation  practices 

Donald  L.  Haefele,  Bret  Barnard  Radical  educational 
reform:  Reactions  of  teachers  on  the  firing  line  in  northern 
Kentucky 

Suzanne  G.  Cortez,  Dale  Lawver 

Multiple  methods  of  assessing  pre-service  and  practicing 
teachers:  A study  examining  unified  assessment 
procedures  based  on  program  goals 
Marcia  F.  Reisetter,  Jennifer  Fager, 

Gary  Steinley 

Classroom  evaluation  approaches  as  perceived  by 
prospective  teachers 

Robert  M.  Boody,  Bruce  G.  Rogers 

S3.2  Issues  in  Administration  5 
9:00-10:25  am  Parlor  A 
Division  A Paper  Session 
Chain  Pamela  Barnet 
Discussant:  Jason  H.  Martin 
A faculty  consistency  pay  program 
John  W.  Fraas 

The  effect  of  educational  administrator  level  and  location 
on  perceived  need  for  student  assessment  knowledge  and 
the  importance  of  assessment  tasks 

Lisa  A.  Moore,  James  C.  Impara, 

Barbara  S.  Plake 

State-financed  school  integration  in  metropolitan 
Milwaukee:  Fiscal  impacts  and  efficient  effects 

Sang-Jin  Ban 

Residence  hall  security,  as  perceived  by  students  and 
parents  at  two  public  universities 

Sara  B.  Wills,  Edward  R.  Hines 
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53.3  Validity  Issues 
9:00-10:25  am  Parlor  B 
Division  D Paper  Session 

Chair:  Sharon  F.  Schattgen 
Discussant:  Paula  Woehlke 
A construct  validation  of  the  DCAT 
Caryl  Cox,  Tianqi  Han 

An  investigation  of  the  relationship  between  essential 
dimensionality  of  broader  and  specific  content  categories 
of  items  of  the  Secondary  International  Mathematics 
Study 

Dennis  Hocevar,  Yu-Chung  Wang 

53.4  Parenting  and  Child  Research 
9:00-10:25  am  Parlor  C 
Division  E Paper  Session 

Chair  Richard  Allen 
Discussant:  J.  Harris 

Yes,  there  is  an  optimal  parenting  style  for  single  parents 
who  want  to  promote  achievement  in  their  children 
James  J.  Johnson,  Elmer  A.  Lemke, 

Julia  Neunreiter 

The  relationship  between  parenting  styles,  self-esteem, 
and  personality 

Elmer  A.  Lemke,  Audra  Bima, 

David  Smith,  James  J.  Johnson 

Correlation  between  Type  A behavior  and  levels  of 
violence 

Joe  Stronsick,  Kim  Bemardi 

53.5  Motivation  Research 
9:00-10:25  am  Parlor  D 
Division  G Paper  Session 

Chair  and  Discussant:  Bertram  Chiang 
Fairness  and  motivation 
Theresa  A.  Thorkildsen 

A comparison  of  college-bound  females  planning  to  major 
in  mathematics  or  science-related  fields  with  those  of 
other  fields 

Gail  T.  McClure,  Michael  A.  Boatwright 
Continuities  between  motivation  research  and  whole 
language  approaches 

Cheryl  LaFave,  David  A.  Bergin 

53.6  Teacher  and  Student  Tr?«ts 
9:00-10:25  am  Parlor  E 
MWERA  Paper  Session 

Chain  Rose  Mary  Scott 

A study  of  preservice  and  professional  teachers'  attitudes 
toward  grade  retention 
Mallouh  B.  Alkhrisha 

District  and  student  characteristics:  Correlates  with 
science  scores  on  the  Illinois  Goal  Assessment  Program 

Grace  Gonwa,  David  Suddick,  Leon  J.  Zalewski 
Personal  teaching  efficacy  and  the  Myers-Briggs  types 

Mary  Ann  Flowers 


53.7  Field  Experience 
9:00-10:25  am  Parlor  F 
Division  K Symposium 

Chair  and  Organizer  Ron  Copenhaver 
Post-modem  teacher  education  field  experiences: 
Teaching  as  problem  solving 

Ron  Copenhaver,  Donna  Pot,  Jerry  Ligon, 

Alice  Young,  Beth  Wilkins 

53 .8  Measurement  Issues 
9:00-10:25  LINCOLN  ROOM 
Division  I Paper  Session 

Chair  Isadora  Newman 

Differential  item  functioning:  A comparison  of  item 
calibration  on  written  and  computer  adaptive  examinadot 
Gregory  E.  Stone,  John  A.  Stahl 
Career  development  predicts  medical  school  academic 
success 

Daniel  M.  Lewis,  Bonnie  Jones 

53.9  Issues  in  Learning  & Cognition 
9:00-10:25  am-MAXIMILIAN  ROOM 
Division  C,  H,  K Poster  Session 

A teaming  iask  hierarchy  analysis  of  discrimination 
learning  set  acquisition  in  nursery  school  children 
Gerald  J.  Blumenfield 

Relating  interest  to  successful  strategy  use:  A 
developmental  perspective 

Mary  Moltz,  Teena  Willoughby,  Eileen  Wood 
Cognitive  factors  influencing  the  comprehension  of  AIDS 
education  materials 

Kathryn  J.  Quick,  Thomas  Andre 
Self-regulated  learning  in  college  students:  There's  mor 
to  regulate  than  learning 

Reinhard  W.  Lindner,  Bruce  R.  Harris 
High  school  seniors'  perception  of  and  preferences  for 
intellectual  styles 
William  J.  Neumeier 

Mentoring  and  other  supportive  relationships  in  the 
elementary  school  setting 

Deborah  L.  Bainer,  Cheryl  K.  Didham 
Measures  that  are  sensitive  to  equity  issues 

Thomas  V.  Tinkler,  J.  Wheaton 

53.10  Workshop  9 & Workshop  10.  Two  2-hour 
workshops  presented  back-to-back 

9:00-11:00  am  & 11:00-1:00  p.m.  Room  501 
Cost.  $20.00  Preregistration  required. 

Ways  to  enhance  teacher  effectiveness  and  student 
motivation 

Thomas  S.  Parish,  Kansas  State  University 
James  J.  McCluskey,  University  of  Oklahoma 
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54.1  Knowledge  and  Measurement 
10:30-1 1:55  am-MEDILL  ROOM 
Division  K Paper  Session 

Chair  Don  Williams 

Preservice  teachers  in  the  field:  Accessing  and  applying 
professional  knowledge 

Susan  M.  Brookhart,  Rick  R.  McCown 
Training  and  management  perceptions  of  public  school 
testing  directors:  Implications  for  teacher  educators 
Ronald  N.  Marso,  Fred  L.  Pigge 
What  should  teachers  know?  A content  analysis  of 
educational  psychology  textbooks 
Jeffrey  W.  Peck 

54.2  Policy  and  Evaluation  in  Higher  Education 
10:30-1 1:55  am  Parlor  A 

Division  J Paper  Session 
Chair  Martha  Wilson 

Financial  exigency  and  program  discontinuance:  The 
legal  implications  for  higher  education  via  analysis  of 
cases 

Eleanor  A.  Jones,  Edward  R.  Hines 

Correlating  students'  evaluations  of  course  and  instructor 
with  their  quiz  performance 

Ralph  F.  Darr 

The  descriptive  tests  of  mathematics  skills:  Additional 
evidence  of  predictive  validity 

Peggy  G.  Woodard,  David  E.  Suddick,  John  H. 
Meyer 

54.3  Collaboration 
10:30-1 1:55  am  Parlor  B 

Division  K Alternative  Format  Session 
Chair  Ruth  Ravid 

A conversation  and  collaboration:  Voices  of  school-based 
and  university-based  research  partners 

Marianne  Handler,  Stephen  Bloom,  Cathy 
Cosgrove,  Peter  Fisher,  Steven  Wolk,  Jeanne 
Chaney 

54.4  Learning  Strategies 
10:30-11:55  am-MAXIMILIAN  ROOM 
Division  C Poster  Session 

Learning  strategies  of  preservice  teachers:  Needs, 
assessments,  and  interventions 

Kay  M.  Alderman,  R.  C.  McClendon,  L.  Wilkinson 
Retention  of  relational  and  factual  information  from 
different  representations 

Richard  K.  Staley,  Nelson  F.  DuBois 
Information  sources  used  by  students  in  making  self 
estimations  of  learning 
Peter  J.  Brady 

School  type,  size  and  location:  Correlation  with 
achievement 

Michael  A.  Boatwright,  Randy  McClanahan 


Outline  vs.  matrix  representations:  Pictorial  & Mnemonic 
enhancements 

Tom  G.  Meyers,  Kenneth  A.  Kiewra,  Sung-il  Kim, 
Jiel  Levin 

Strategies  for  teaching  strategies  for  representing  text 

Jean  W.  Pierce,  Jay  Adler 

54.5  Cultural  Connections 

10:30-11:55  am  Parlor  D 
Division  G Paper  Session 
Chair  Joan  Timm 

The  value  of  literature  in  multicultural  learning 

Shirley  S.  Wilbert 

Exploring  diversity  issues  in  teaching  through  case  studies 

Mary  R.  Sudzina 

Some  cultural  differences  in  students'  academic 
motivation  orientations  between  American  and  Chinese 
students 

Jupian  J.  Leung 

Cognitive  style  and  culture:  An  analysis  of  Chinese 
students'  field  dependence/independence  among  three 
age  groups 

Lilly  Liao,  Bert  Chiang 

54.6  African  American  Teacher  Administration 
Division  K Alternative  Format  Session 

Chair  Carol  P.  Felder 

Meeting  the  needs  of  African  American  students  at 
predominantly  white  institutions 

Carol  P.  Felder,  Joyce  Killian 

54.7  Educational  Psychology 
10:30-12:00  p.m.  Parlor  E 
MWERA  Symposium 

Chair  and  Discussant:  Orpha  Duell 
Teaching  educational  psychology  to  preservice  teachers 
Edward  Wood,  Rick  McCown, 

Gregory  J.  Marchant,  Mario  Schommer 
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54.8  Art  as  Research 

10:30-1 1:55  am-UNCOLN  ROOM 
Division  F Alternative  Format  Session 
Chair.  Deborah  L Smith-Shank 
Art  education  as  questing:  A ritual  performance 
Deborah  L.  Smith-Shank 

54.9  Multiculturalism 

10:30-11:55  am  Parlor  C 
Chair  Joseph  Larkin 
Clarifying  language  in  the  exploration  of 
mutticulturalism/globalism  dialogue 

A.  Al  Rubaiy 

Constructing  the  meaning  of  behavior  in  diverse 
classrooms 

Clara  A.  New 

Multicultural  education  coursework  as  antiracist  curriculum 

Christine  E.  Slater 

Uiteracy  education  from  a multicultural  perspective 
Rose  Mary  Scott 
Mathematics  and  multiculturalism 

Mian  Yusuf 
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Alderman,  Kay  M- 
SessiodTime  S4.4 
Univ.  of  Akron 

Dept  of  Ed  Found  & Leadership 
Univ  of  Akron 
Akron,  OH  44325- 
RlKA@VMLCC.UAKRON.EDU 


Bainer,  Deborah  L- 
SesrionTime  F7.1 
Ohio  State— Mansfield 
1680  University  Dr. 
Mansfield,  OH  44906- 


Baker,  Frank  - 
Session  Time  F7.4 
University  of  Wisconsin 
Madison,  W1  - 


Behar,  Linda  S~ 

Session  Time  F2.8 
University  of  Florida 
2412  Norman  Hall 
Dept  of  Educ.  Leadership 
Gainesville,  FL  32611- 


Beh,  Jane  - 
Session  Time  F5.5 
Wichita  State  University 
Dept  of  Couns,  Ed,  A School 
Psych.,  Box  123 
Wichita,  KS  67208-123 


Bhola,  Dennison  - 
Session  Time  R4.4 
Univ  of  Nebraska-Lincoln 
3512  Portia  St,  Apt  308 
Lincoln,  NE  68521- 
dbhola@unlinfo.unl.edu 


Bode,  Rita  K- 
Scsrion  Time  R6.4 
Univ  of  Illinois  at  Chicago 
1823  N.  Thatcher 
Elmwood  Park,  IL  60635-3546 
u44481@utc.vm 


Presenting  Author  Index  and  Addresses 

AlKhrbha,  Mallouh  B- 
Scssioo  Time  S3.6 
University  of  Cincinnati 
2716  Stratford  Ave. 

Cincinnati,  OH  45220- 


Balner,  Deborah  D- 
Session  Time  S3.9 
Ohio  State  University/Mansfield 
1680  University  Drive 
Mansfield,  OH  44906- 


Ban,  Sang-Jin  - 
Session  Time  S3.2 
University  of  Wisconsin-Madison 
Dept  of  Educ.  Admin. 

945B  Eagle  Heights 
Madison,  WI  53705- 


Behar,  Linda  S- 
SessionTime  R4.5 
Univ  of  Florida 
2412  Norman  HaU 
Dept  of  Educ.  Leadership 
Gainesville,  FL  32611- 


Bendixen-Noe,  Mary  K- 
SessionTime  F5.1 
Ohio  State  University  at  Newark 
12384  WoodsfieldE. 
Pickerinlon,  OH  43147- 


Bhxmenfieid,  Gerald  J- 
Session  Time  S3.9 
Univ.  of  Akroa 

Dept  of  Educ.  Found.  A Leader 
Univ.  of  Akron 
Akron , OH  44325- 
RIG  JB@AKRONVM 


Bogan,  Melissa  M- 
Session  Time  R6.7 
Carrollton  Schools 
7610  Rolling  Oak  Dr. 
Centerville,  OH  45459- 


AKer,  Gloria  T- 
SessionTime  R6*2 
Northern  Illinois  University 
Dept  of  Curriculum  A Instr. 
Gabel  Hall,  No.  ni.Univ. 
DcKalb,  IL  60115- 


Baker,  Elaine - 
Session  Time  F&S 
Wichita  State  University 
Dej*.  of  Coum.,  Ed.,  A School 
Psych.,  Box  123 
Wichita,  KS  67208-0123-123 


Barnes,  Laura  L- 
Session  Time  R6.4 
Oklahoma  State  University 
Applied  Beh  Studies,  OSU 
316  N.  Murray 
Stillwater,  OK  74078- 


Behar,  Linda  S- 
Session  Time  R6.2 
University  of  Florida 
2412  Norman  HaU 
Dept  of  Educ.  Leadership 
Gainesville,  FL  32611- 


BboU,  Dennison  S~ 

Session  Time  F6.4 
Univ  of  Nebraska-Lincoln 
3512  Portia  St  Apt  308 
Lincoln,  NE  68521- 
dsb@unlinfo.unl.edu 


Boatwright,  Micheal  A- 
Session  Time  S4.4 
American  College  Testing 
2255  North  Dubuque  Road 
P.O.  Box  168 
Iowa  City,  LA  52243- 


Boody,  Robert  M- 
Sess ion  Time  R7.5 
UNI 

DejX.  of  Educational  Psych 
and  Foundations 
Cedar  Falls,  LA  506140607 
boody@uni.edu 
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Boody,  Robert  M- 
SessiooTime  S3.1 
University  of  Northern  Iowa 
Dept  of  Ed  Psych 
University  of  Northern  Iowa 
Cedar  Falls,  IA  50614-0607 
boody@uni.edu 


Presenting  Author  Index  and  Addresses 

Bowman,  Connie  L- 
SessionTime  F2.1 
Ohio  State  University 
839  Knollwood  Circle 
WCH,  OH  43160- 


Brady,  Peter  J- 
SessionTime  S4.4 
Clark  State  Community  College 
Arts  Sc  Science  Div.,  Clark  St 
PO  Box  570 

Springfield,  OH  45501- 


Britton,  Paula  J- 
SessiooTime  F7.6 
Kent  State  University 
115  Kent  Hall 
Kent  State  University 
Kent,  OH -44242- 


Brookhart,  Susan  M- 
SessionTiroe  S4.1 
Duquesne  University 
School  of  Education 
Dusquesne  University 
Pittsburgh,  PA  15282- 
brookhart@duq3.duq.edu 


Brooks,  Douglas  M- 
SessionTime  F5.7 
Miami  University 
Dept  of  Teacher  Ed,  School 
of  Ed,  Miami  University 
Oxford,  OH  45056- 


Brown-Wright,  Dianne  - 
Session  Time  R7.6 

The  University  of  Akron,  College  of  Education 
Dept  ofEduc.  Found.  Sc  Lead. 

301-C  Zook  Hall 
Akron,  OH  44325-4206 


Buboltx,  Walter  C- 

SessicnTime  F7.6 
Kent  Stale  Univ. 
4065  Pardee  Rd 
Stow,  OH  44224- 


Bnlaknwaki,  Carole  - 
Session  Time  R7.4 
College  of  Lake  County 
19351  W.  Washington  Street 
Grayshke,  ILq60030  60030-1198 


CEEC,  - 

Session  Time  S2.2 

Chicago  Educational  Expertise  Consortium  of  N.  Blino 


Chattioub-Deville,  Micheline  B- 
Scssion  Time  R63 
Ohio  State  Univ 

Dept  of  Ed  Services  <fe  Resource 
287  Arps  Hall,  1945  N High  St 
Columbus, OH  43210- 

MCHALHOU@MAGNUS . ACS.OHIO-STATE 


Chase,  Clinton  I- 
Sessioc  Time  R4.4 
Indiana  Univ. 

School  ofEduc. 

Indiana  Univ. 

Bloomington,  IN  47405- 
CHASE@lUS.Indiana.Edu 


Collins,  Donald  - 
Session  Time  S23 
Prarie  View  A&M  University 
15240  Old  galveston  Rd  #102 
Webster,  TXZ  77598- 


Copenhaver,  Ron  - 
Session  Time  S3.7 

Southern  Illinois  Umversity-Carbondale 
419  Hyde  Park 
Mt  Vernon,  1L  62864- 


Corkffl,  Alice  - 
Session  Tone  R8.4 
Univ.  of  Nevada 
Dept  of  Coons.  Sc  Educ.  Psych. 
College  of  Education 
Las  Vegas,  NV  89154-3001 


Cortex,  Suzanne  G- 
Session  Time  S3. 1 , 

Northern  Kentucky  University 
NKU  Dept  of  Education,  BEP250 
Nunn  Drive 

Highland  Heights,  KY  41099- 


Cox,  Caryl  - 
Session  Time  S3 3 
So.  Illinois  Univ 
Educ  Psychology  Dept 
So.  Illinois  Univ. 
Carbondale,  1L  62901- 
GR3301@SIUCVMB.EDU 


Cramer,  Susan  R- 
Session  Time  F2.1 
Univenity  of  Wisconsin 
800  Algotna  Boulevard 
Oshkosh,  WI  54901- 


Cramer,  Susan  R- 
S ess  ion  Time  F5.2 
Univenity  of  Wisconsin/Oshkosh 
College  of  Ed  and  Human  Scr. 
800  Algoma  Blvd 
Oshkosh,  Wl  54901- 


CRE  of  NHJ,  - D'Coata,  Ayres  G- 

Session  Time  F7.5  Session  Time  S3 3 

Chicago  Research  Ensemble  of  Norther  Illinois  Univers  Ohio  Stale  Univ 


* h\'c 
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Darr,  Ralph  F- 
Session  Time  S4.2 
Univenity  of  Akron 
Room  301  A,  Zook  Hall 
Akron,  OHq  44325-4208 


Presenting  Author  Index  and  Addresses 

David,  Ruth  - 
Session  Time  F6.5 
National-Louis  University 
2840  Sheridan  Road 
Evanston,  1L  60201- 


Dowd,  Sue  - 
Session  Time  F5.5 
Wichita  State  University 
Dept  ofCouns,  Ed,  A School 
Psych.,  Box  123 
Wichita,  KS  67208-123 


Dwyer,  David  J- 
Session  Time  F5J 
Illinois  State  University 
Dept  of  Ed.  Ad.  A Found 
MC  5900  Coll,  of  Educ. 
Normal,  1L  61790-5900 
djdwyer@vm.cmp.ilstu.edu 


Flowers,  Mary  Ann  - 
Session  Time  F6.8 
Cleveland  State  University 
9946  Darrow  Park  Dr.  #107J 
Twinsburg,  OH  44087- 


DucU,  Orpha  K- 
Session  Time  R6.6 
Wichita  State  University 
322  Hubbard  Ilali 
Wichita  State  University 
Wichita,  KS  67260-01232 


Elliot,  Ronald  S- 
SessionTime  R7.7 
Ohio  University 
571  W.  Fifth  St 
POBox  629 
Chillicothe,  OH  45601- 
EIliot@ouaccvmb.  BITN  ET 


Flowers,  Mary  Ann  - 
Session  Time  S3.6 
Cleveland  State  University 
9943  Darrow  Park  Drive  U 1 07J 
Twinsburg,  OH  44087- 


Fraas,  John  W- 
Session  Time  S3.2 
Ashland  University 
220  Andrews  Hall 
Ashland,  OH  44805- 


Furst,  Lyndon  G.- 
Session  Time  R6.1 
Andrews  University 
Dept  of  Educational  Admin. 
Bell  Hall  173 

Berrien  Springs,  Ml  49104-100 


Furtwengler,  Carol  B- 
Scssion  Time  R6.1 
Wichita  State  University 
115  Hubbard  Hall 
Box  142 

Wichita,  KS  67260-142 


Furtwengler,  Willis  J- 
Sesaion  Time  R4.1 
Wichita  State  University 
115  Hubbard  Hall 
Box  142 

Wichita,  KS  67260-142 


Gibson,  Nancy  P- 
Session  Time  R6.1 
Illinois  State  University 
Dept  of  Educ.  Adra.  and  Found 
33 1 Degarmo  Hall 
Normal,  IL  61761-6901 


Glebe  Hums,  Carmen  R- 
Session  Time  F5.4 
Ohio  State  University 
236  E Ramscver  Hall 
29  W.  WoodrufT  Avenue 
Columbus,  Oil  43210- 


Dennlson,  Rayne  S- 
Session  Time  R7.1 
Univ  of  Nebraska -Lincoln 
Educ  Psychology 
1302  Seaton  Hall,  UN-L 
Lincoln,  NE  68588-641 


l>u  tt,  Karen  M- 
SessionTime  F6.1 
Orinncll  College 
Dept  of  Education 
Grinnell  College  Steiner 
Griimell,  IA  50112-806 


Felder,  Carol  P- 
SessionTime  S4.6 
Southern  Illinois  University 
College  of  Ed  Student  Serv. 
Carbondale , 1L  62901- 


Foyie,  Harvey  C- 
Session  Time  F7.1 
Empria  Slate  University 
Box  4037 

1200  Commercial  Street 
Emporia,  KS  66801- 


Furtweng ler,  Carol  B- 
Session  Time  F6.2 
Wichita  State  University 
1845  Fairmount 
Wichita,  KS  67260-142 


Gerrich,  Gregory  - 
Session  Time  R4.6 
Ashland  University 
Mansfield,  OH  44907- 


Glebelhaus,  Carmen  R- 
SessionTime  F7.1 
Ohio  State  University 
29  We*!  Woodruff 
236  E Ramseycr  Hall 
Columbus,  OH  43210- 
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Gnagey,  William  J- 
ScssionTime  ¥23 
Illinois  Slate  Univ 
4620  Department  of  Psychology 
Normal,  IL  61790-4620 


Gordon,  Edward  E- 
S ess  ion  Time  R7.2 
Roosevelt  Univ 
820  N.  Michigan  Ave 
Chicago,  IL  60611- 


Haefele,  Donald  L- 
Scssion  Time  S3.1 
Ohio  State  University 
C of  E 287  Arps  Hall 
1945  N.  High  Street 
Columbus,  OH  43210- 


llaney,  Jodi  J- 

Session  Time  F6.3 

Univ  of  Toledo 

University  of  Toledo 

2801  W.  Bancroft 

Toledo, OH  43606- 

JHancy@UofT02.UTOLEDO.cdu 


Hernandez,  Victor  - 
Session  Time  R7.ll 
Ohio  State  University 
225  Ramseyer  Hall 
20  W.  Woodruff  Ave. 
Columbus,  OH  43210- 


Ilocevar,  Dennis  - 
Session  Time  R8.5 
Univ  of  So.  California 
School  of  Educ  - WPH 
University  Park 
Los  Angeles,  CA  90089-3 1 


Hofmann,  Rich  - 
Session  Time  R6.7 
Miami  University 
350  1 9th Guffey  IUU 
Department  of  Education 
Oxford,  OH  45056- 
rhofmann@miamiu 
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Gonwa,  Grace  - 
Session  Time  S3.6 
Governor*  Slate  University 
College  of  Education 
University  Parkway 
University  Park,  IL  60466- 
L-Zalewski@acs.gsu.bgu.cds 


GranofT,  Susan  A- 
Session  Time  F53 
Ohio  State  University 
4494  Christina  Ln. 

Gohanna,  OH  43230- 
sgranofl@magnus.acs.ohio-state 


Hammer,  Ronen  - 
Session  Time  F73 

School  of  Education,  Indiana  University 
Campus  View  #817 
Bloomington,  IN  47406- 
Rohamme@iubacs 


Hayes,  Linda  D- 
SessionTimc  F6.8 
The  University  of  Akron 
4400  Clark  wood  Parkway,  #517 
Wartcnsville  Heights,  OH  44128- 


I less,  Caryl  A- 
Session  Time  R7.6 
John  Carroll  University 
2535  18th  St 

Cuyahoga  Falls,  OH  44223- 


llocevar,  Dennis  - 
Session  Time  S33 
Univ  of  Southern  California 
3350  Trevis  Way 
Cannel,  CA  93923- 


llolcomb,  Edle 
Session  Time  R7.6 
University  of  Wisconsin-Madison 
Nit  Cen.  for  Effective  Sch. 

1025  W.  Johnson  SL,  Rm.  685 
Madison,  W!  53706- 


Good  man,  David  J- 
S ess  ion  Time  R4,5 
Loyola  Univ 
820  N.  Michigan  Ave 
Chicago,  IL  60611- 


Green,  James  E- 
Se&sionTime  F6.1 
Ball  State  University 
Teachers  College, 
Ball  Stale  University 
Muncie,  IN  47306- 


Uandler,  Marianne  - 
Session  Time  S43 
Nalional-Louis  University 
2840  Sheridan  Road 
Evanston,  IL  60201- 
MHAN@NLU 


Hegland,  Susan  M- 
ScssionTime  R6.9 
Iowa  State  University 
201  Child  Development 
Dept  ofHDFS 
Ames , IA  50011-1030 
M1.SUE@ISUMVS 


Hocevar,  Dennis  - 
Session  Time  R8.5 
Univ  of  So.  California 
3350  Trevis  Way 
Carmel,  CA  93923- 
hooevar@mvsa.usc.edu 


Hofmann,  Rich  J- 
Session  Time  F5.6 
Miami  University 
350  McGuffey  Hall 
Dept  Ed,  Leadership 
Oxford,  OH  45056- 
RH0FMANN@M1AM1U 


Houvar,  Dennis  - 
Session  Time  F53 
University  of  Southern  California 
3330  Trevis  Way 
Carmel,  CA  93923- 
houvar@mvsa.usc.cdu 
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Hughes,  William  - 
Session  Time  R6.1 
Ashland  University 
102  Bixler  Hall 
Ashland,  OH  44805- 


Presenting  Author  Index  and  Addresses 

Humphries,  Jennifer  N- 
Session  Time  F2.7 
Ashland  University 
3 19  Bixler  Hall 
Ashland  University 
Ashland,  OH  44805- 


Hurst,  David  S- 
Scssion  Time  R7.6 
Wichita  State  University 
Dept  of  Educ.  Admin. 

Campus  Box  142 
Wichita,  KS  67260-142 
HURST  @ TWSUVM  (Bitnct) 


Jason,  Martin  II- 
SessionTime  F2.2 
Roosevelt  University 
430  South  Michigan  Avenue 
Chicago,  IL  60605-1394 


Johnson,  James  J- 
S css  ion  Time  S3.4 
Illinois  State  University 
Dept  of  Psychology 
Illinois  State  Univ. 
Normal, IL  61761- 


Jones,  Eleanor  A- 
Scssion  Time  S4.2 
Illinois  Stale  University 
134  Juilian  Hall 
3470  IL  St  Univ. 
Normal,  IL  61790-3470 
najones@i  Istu  .bitnet 


Joyce,  McDonald  - 

Session  Time  R7.5 
Indiana  University 
Education  3 140 
WW  Wright  School  of  Ed 
Bloomington,  IN  47405- 
jmcdonal 


Julian,  Ellen  R- 
Session  Time  F6.4 
NCSBN 

676  North  Saint  Clair 
Suite  550 

Chicago,  IL  60611-2921 


Kim,  Inyoung  C- 
Session  Time  F5.1 
Ohio  State  University 
c/o  NCSTL 
1929  Kenney  Road 
Columbus, OH  43210 


Kim,  Inyoung  C- 

Session  Time  F5.I 
Ohio  State  University 
c/o  NCSTL 
1929  Kenney  Rd 
Columbus,  Oil  43210- 


Klinc,  Melinda  J- 
Scssion  Time  F2.7 
Brunswick  City  Schools 
6245  Mud  Lake  Road 
Crcston,  OH  44217- 


Koch,  Steven  - 
Session  Time  F5.2 
Indiana  University 
620  Tulio  Tree 
Bloomington,  IN  47406- 
SMKOCII@indiana.cdu 


KofTman,  Elaine  C- 
Scssion  Time  R4.9 
Northeastern  University 
EDFN  Dept 

5500  N.  St  Louis  Avenue 
Chicago,  IL  60625- 


Krumm,  Bemita  L- 
ScssionTimc  R8.7 
South  Dakota  State  University 
Box  507 
Wenona  Hall 
Brookings,  SD  57007-95 


LaFavc,  Cheryl  - 
Session  Time  S3.4 
University  of  Toledo 
7257  Marchestcr 
Maumce.  Oil  43537- 


Lam,  Kwan-Yau  - 
Session  Time  R8.1 
Northern  Illinois  University 
University  Libraries 
Northern  Illinoois  University 
DeKalb,  IL  60115-2868 
kwanlam@mp.cs.niu.cdu 


Lemke,  Elmer  A- 

ScssionTimc  S3.4 
Illinois  Stale  University 
Dept  of  Psychology 
Illinois  State  University 
Normal.  IL  61761- 


Lce,  In-Sook- 
SessionTimc  R4.1 
Indiana  University,  Bloomington 
1603  East  3rd  Street 
East  University  Apt,  109 
Bloomington,  IN  47406- 
INLEE  @ lndiana.edu 


Leung,  Juplan  J- 
Session  Time  S4.5 
University  of  Wisconsin,  Oshkosh 
College  of  Education 
800  AJgoma  Blvd 
Oshkosh,  W1  54901- 


44S 


Lee,  In-Sook- 
Scssion  Time  R4.1 
Indiana  University,  Bloomington 
1603  East  3rd  Street 
East  University  Apt,  109 
Bloomington,  IN  47406- 
INLEE  @ Indiana.edu 


Lewis,  Daniel  M- 

Session  Time  S3.8 
NEOU  College  of  Medicine 
NEOUCOM,  Behavioural  Sciences 
Dept.,  box  95 

RooUtown,  OH  44272-0095 
dlcwii@kentvm  kentedu 
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Liao,  Lilly  - 
Session  Time  S4.5 
Tamkang,  University, 
Department  of  English 
Taipei,  Taiwan,  OS  - 


Load  man,  William  - 
Session  Time  R6.8 
Ohio  State  University 
287  Alps  Hall 
1945  N High  Street 
Columbus,  OH  43210-1172 


MacDonald,  Suzanne  C- 
Session  Time  R8.2 
University  of  Akron 
College  of  Education 
Zook  3016 

Akron,  OH  44325-4208 
RISCM2@VMI.CCUAKRON.IDU 


Marso,  Ronald  N- 

Scssion  Time  S4.1 
Bowling  Green  State  University 
Educational  Foundations  and 
Inquiry,  BGSU 
Bowling  Green,  OH  43403- 


McCullough,  Joy  D- 
SessionTime  F6.5 
Trinity  Western  University 
7600  Glover  ROad 
Langley,  BC  V3A6H4 
(Canada 


Meyers,  Tom  G- 
SessionTime  S4.4 
Univ.  Ncbraska-Lincoln 
Admin.  North,  Rm  234 
Univ.  of  Nebraska 
Lincoln,  NE  68588-477 


Mid  gette,  Thomas  E- 
Scssion  Time  R6.5 
Univ.  of  Arkansas 
136  Graduate  Educ.  Building 
Fayetteveliie,  AR  7270 1 - 


Presenting  Author  Index  and  Addresses 

Lindner,  Relnhard  W- 
Session  Time  S3.9 
Western  Illinois  Univ 
Dept  of  Educ.  Foundations 
Homabin  Hall,  80,  WIU 
Macomb,  IL  61455- 


Luk,  IllngKwan  - 

Session  Time  R7.4 
Indiana  University 
BEST  Room  M005 
Franklin  Hall 
Bloomington,  IN  47405- 
LUKH@UCS.INDI  AN  A EDU 


Malloy,  Ileldi  L- 
Scssion  Time  R4.7 
Iowa  State  Univerisly 
Dept  of  I1DFS 
101  Child  Development  Bldg. 
Ames,  IA  5001 1 - 


Maury,  Kathleen  - 
Session  Time  F2.4 
Mankato  State  University 
Box  52;  P.O.  8400 
Mankato,  MN  56002- 


Mclure,  Gall  T- 
SessionTime  S3.4 
American  College  Testing 
2255  N.  Dubuque  Rd. 

PO  Box  168 
Iowa  City,  1A  52243- 


Michael,  Robert  S- 
SessionTime  R4.4 
Indiana  University 
2343  Brandon  Court 
Bloomington,  IN  47401- 
rsmichae@ucs.indiana.edu 


Mobcrly,  Deborah  - 
Session  Time  R8.6 

Southern  Illinois  University  at  Carbondatc 
Dept  of  Curriculum  & Instr. 

Carbondatc,  1L  62901- 


447 


Load  man,  William  E- 
Session  Time  F6.6 
Ohio  State  University 
287  Arps  Hall 
1945  N.  High  Street 
Columbus,  Oil  43210-1127 
wloadman.@magnus.acs.ohio-statc.cdu 

Luzxo,  Darrell  A- 

Session  Time  F7.6 
Saint  Ambrose  Univ. 

518  West  Locust  Street 
Davenport,  IA  52803- 


M archant,  Gregory  J- 
Session  Time  R7.5 
Ball  State  University 
Educational  Psychology- 
Ball  State  University 
Muncie,  IN  47306-0595 


McCullough,  Joy  D- 
SessionTime  F5.7 
Trinity  Western  University 
7600  Glover  Road 
Langley,  BC  V3A6H4 

(Canada, 


McRoy,  Carolyn  R- 
Session  Time  R7.10 
Western  Kentucky  University 
College  of  Educ.  & Beh.  Scienc 
Dcp(  of  Educ  Leadership 
Bowling  Green,  KY  42101- 


Mtdgette,  Thomas  E- 
Session  Time  F2.6 
Univ.  of  Arkansas 
1 36  Graduate  Educ.  Building 
Fayetteville,  AR  72701- 


Moore,  Lisa  A- 
SessionTime  S3.2 
University  of  Nebraska-Lincoln 
1316  Seaton  Hall 
Lincoln,  NE  68588-641 

lmoore@unlinfo.unl.edu 
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Morrison,  Sheila  - 
Session  Time  R7.10 
Loyola  Univ 
820  N.  Michigan  Ave 
Chicago,  IL  6061 1- 


Mostert,  Mark  P- 
SessionTime  R6.4 
Moorhead  State  Univ 
DcptSP  ED 
Moorhead  State  Univ 
Moorhead,  MN  56563- 
mosteit@Mndi  .mooihcadmsus.  edu 


Presenting  Author  Index  and 

Morrow,  Linda  B- 
Scssion  Time  F6*5 
Muskingum  College 
Montgomery  Hall 
Muskingum  College 
New  Concord,  OH  43762- 


Mostert,  Mark  P- 
Session  Time  R7.8 
Moorhead  State  University 
Dept,  of  Spec.Ed.  & Counsel. 
Moorhead,  MN  56563- 
mostert@mhdl.moorhead.msus.edu 


Mostert,  Mark  P- 
SessionTime  R4.5 
Moorhead  State  Univ 
Dept  of  Special  Educ 
Moorhead  State  Univ 
Moorhead,  MN  56563- 
mostert@mhdl.moorhead.msus.edu 

Motz,  Mary  - 
Session  Time  S3.9 
Wilfrid  Lauricr  Univ. 

Dept  of  Psychology 
75  University  Ave 
Waterloo,  ON  N2L-3C5 


Naumann -Sandoval,  Wendy  C- 
Scssion  Time  R8.5 
Univ  of  NEr Lincoln 
1322  Seaton  Hali,UNL 
Lincoln,  NE  68588-643 
WNAUMANN@unlinfo.unl.cdu 

Necessary,  James  R- 
S ess  ion  Time  R4.7 
Balt  Stale  University 
mail  to  T.  Parish,  317 
Bluemont  Hall  KSU 
Manhattan,  KS  66506- 

Necessary,  James  R- 
Scssion  Time  R4.7 
Balt  State  University 

c/o  T.Parish,  317  Bluemont  Hall,  Kansas  State 
Manhattan, 

Manhattan,  KS  66506- 

Nelson,  C.  V- 
Scssion  Time  R4.7 
Ball  State  University 
Department  of  Comp.  Science 
RB  376 

Muncic,  IN  47306- 

Nelson,  Diane  - 
Session  Time  F2.1 
Miami  University 
Dept  of  E L School  of  E 
andAP 

Oxford,  OH  45056- 

Neumeler,  William  J- 
Session  Time  S3. 9 
Miami  U.  (Oxford) 
3500  Poplar  St 
Trenton,  OH  45067- 

Newman,  Isidore  - 
Session  Time  F7.7 
University  of  Akron 
Dept  of  Educational 
Foundations 

Akron,  OH  44325-4208 
rlin@akronvm 

Nolte,  Connie  - 
Session  Time  R4.1 
The  University  of  Akron 
22  Scenic  View  Drive 
Akron,  OH  44321- 

Oldensld,  Thomas  E- 
Session  Time  R4.2 
Miami  University 
350  McOufTcy  Hall 
Miami  Univ 
Oxford,  OH  45056- 

Packard,  Abbot  L- 
SessionTime  R7.1 
Virginia  Tech 
321  E.  Eggleston  llall 
Virginia  Tech 

Blacksburg,  V A 24061-302 
AbbotP@VTVMl.CC.VT.EDU 

Palmeri,  Amy  B- 
ScssionTime  R8J 
Indiana  University 
703  West  Gourlcy  Pike  U9 
Bloomington,  IN  47404- 
apalmeri@ucs.indiana.edu 

Parish,  Thomai  S- 
Session  Time  F6.8 
Kansas  State  University 
317  Bluemont  Hall 
Manhattan,  KS  66506- 

Parish,  Thomas  S- 
SessionTimc  F6.8 
Kansas  State  University 
317  Bluemont  Ave 
Manhattan,  KS  66506- 

Parshatl,  Cynthia  G- 
SessionTime  R7.7 
ACT 

PO  Box  168 
Star  Dept 

Iowa  City,  IA  52243- 
Panhall@ACT-ACTS-PO.ACT.ORG 

Peck,  Jeffrey  W- 
Session  Time  S4.1 
Ohio  State  University 
310  W.  Kanawha  Ave. 
Columbus,  Ohio  43214- 
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Pierce,  Jean  W- 
Session  Time  S4.4 
Northern  111.  Univ 
EPCSE  Dept 
Northern  Illinois  Univ. 
DeKtlb.IL  60115- 
P30JWPl@NIU 


Pugh,  Richard  C- 

Session  Time  F7J 

School  of  Education,  Indiana  University 
Wright  Ed  Bldg.  2072 
Indiana  University 
Bloomington,  IN  47405- 
Pugh@UCS.lndiana.cdu 


Relscttcr,  Marcia  F- 
Session  Time  S3.1 
South  Dakota  Stale  University 
College  of  E and  C 
Box  507  Wenona  Hall 
Brookings,  SD  57007-0095 


RJdllng,  Zaine  - 
Session  Time  F7J 
Indiana  University 
4399  Castlewood  Ct 
Bloominglom,  IN  47404-9607 
ZRIDLING@ucs.indiana.edu 


Romanowsld,  Michael  II- 
SessionTime  R4.2 
Ohio  Northern  University 
Center  for  Teacher  Ed  A Cert 
Ohio  Northern  Univ. 

Ada,  OH  45810- 


Sawilowsky,  Shlomo  S- 
Session  Time  R7.7 
Wayne  Slate  Univ 
#347  Educ,  College  of  Educ 
Wayne  State  University 
Detroit,  MI  48202- 
shlomo@edstatcoe.\vayne.edu 


Schommer,  Marlene  - 
Session  Time  R43 
Wichita  Stale  University 
Coll,  of  Educ.  #123 
Wichita  State  Univ. 
Wichita,  KS  67260-123 
schommer@twsuvm 


Presenting  Author  Index  and  Addresses 

Pierce,  Jean  \V- 
SessionTime  R7.1 
Northern  Illinois  Univ 
EPCSE  Dept 
Northern  Illinois  Univ 
DeKalb,  IL  60115- 
P30JWP1@N1U 
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This  MWER  issue  bears  the  signature  of  a new  group  of  editors... yes,  our  Board  of  Directors  thought  fit  to  appoint  the  three 
of  us  to  replace  the  two  of  them  that  brought  MWER  to  the  status  that  it  currently  enjoys.  As  we  take  over  this  honored 
responsibility  from  Greg  Marchant  and  Isadore  Newman,  we  want  to  acknowledge  their  vision  and  dedication. 

Our  challenge  now  is  to  maintain  their  fine  traditions.  We  promise  that  we  will: 

* Maintain  professional  quality  by  using  good  judgment  and  seeking  appropriate  blind  reviews  of  all  manuscripts. 

* Strive  to  educate  and  develop  our  Journal  contributors  toward  quality  writing  and  research. 

* Work  to  produce  MWER  issues  that  we  can  all  be  proud  of. 

We  need  your  manuscripts  and  your  advice.  We  know  that  there  is  room  for  improvement.  We  would  like  MWER  to  achieve 
the  status  of  another  "regional"  journal,  the  New  England  Journal  of  Medicine . Why  not? 

— Ayres  G.  D ' Costa 
— Susan  M.  Brookhart 
— John  R.  Surber 


ON  THE  COVER 

.Founded  in  1 878  by  the  Congregation  of  the  Holy  Ghost,  Duquesne  University  carries  on  a more-than- 
century-old  tradition  of  providing  a unique  liberal  and  professional  education  with  an  emphasis  on  moral  values,  a 
dedication  to  quality  teaching,  and  a commitment  to  service.  Today,  Duquesne  University  serves  more  than  8,000 
undergraduate  and  graduate  students,  offering  more  than  1 50  programs  on  the  bachelor’s,  master’s,  and  doctoral  levels 
in  its  nine  schools:  the  College  and  Graduate  School  of  Liberal  Arts  and  Sciences,  the  A.  J.  Palumbo  School  of  Business 
Administration,  the  John  G.  Rangos  Sr.  School  of  Health  Sciences,  and  the  Schools  of  Education,  Law,  Music,  Nursing 
and  Pharmacy. 

Attesting  to  the  excellence  of  a Duquesne  education  are  the  University’s  listing  as  one  of  the  “300  Best  Buys” 
in  American  higher  education  by  Barron’s  Education  Guide  and  its  selection  as  one  of  the  top  1 0 Catholic  universities 
in  the  United  States  by  U.S.  News  and  World  Report. 

Situated  on  a 40-acre  hilltop  overlooking  downtown  Pittsburgh,  Duquesne’s  newly  renovated  campus  was 
cited  as  the  safest  urban  campus  in  Pennsylvania  and  as  one  of  the  safest  in  the  country  by  U.S.A.  Today.  The  cover 
photo  shows  Canevin  Hall,  which  houses  the  School  of  Education. 

Photo  by  Steven  Perdziola 


Information  for  Contributors  to  the  Mid-Western  Educational  Researcher 


The  Mid-Western  Educational  Reseracher  accepts  research-based  manuscripts  that  would  appeal  to  a 
wide  range  of  readers.  All  materials  submitted  for  publication  must  conform  to  the  language,  style,  and  format  of  the 
Publication  Manual  of  the  American  Psychological  Association , 3rd  ed.,  1983  (available  from  Order  Department, 
American  Psychological  Association,  P.O.  Box  2710,  Hyattsville,  MD  20784). 

Three  copies  of  the  manuscript  should  be  submitted  typed  double-spaced  (including  quotations  and  references)  on 
8V2  x 1 1 paper.  Only  words  to  be  italicized  should  be  underlined.  Abbreviations  and  acronyms  should  be  spelled  out 
when  first  mentioned.  Pages  should  be  numbered  consecutively,  beginning  with  the  page  after  the  title  page. 
Manuscripts  should  be  less  than  20  pages  long.  An  abstract  of  less  than  100  words  should  accompany  the  manuscript. 

The  manuscript  will  receive  blind  review  from  at  least  two  professionals  with  expertise  in  the  area  of  the  manuscript. 

The  author's  name,  affiliation,  etc.,  should  appear  on  the  title  page  only.  Efforts  will  be  made  to  keep  the  review 
process  to  less  than  two  months.  The  editors  reserve  the  right  to  make  minor  changes  in  order  to  produce  a concise 
and  clear  article.  The  authors  will  be  consulted  if  any  major  changes  are  necessary. 

Manuscripts  should  be  sent  with  a cover  letter  to: 

Ayres  G.  D'Costa,  MWER  Editor 

287  Arps  Hall,  1945  N.  High  Street,  The  Ohio  Slate  University,  Columbus,  OH  43210 
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Is  Self-Confidence  in  Teaching  Multidimensional  or 
Unidimensional?  An  Exploratory  Study 


Hripsime  A.  Kalaian,  Michigan  State  University,  Donald  J.  Freeman,  Arizona  State  University, 
and  Richard  T.  Houang,  Michigan  State  University 

Abstract 

This  study  examined  the  factor  structure  of  a 1 2-item  Self-Confidence  in  Teaching  Scale.  Two  samples  of  teacher 
candidates  participated:  1,176  students  (80%  females)  entering  a teacher  preparation  program  and  861  candidates  (77% 
females)  completing  their  final  semester  in  the  program.  Even  though  the  scale  was  deliberately  designed  to  assess 
candidates'  self-confidence  in  executing  12  distinct  teaching  roles  (as  confirmed  by  a panel  of  judges),  principal  axis  factor 
analyses  yielded  only  one  factor  with  an  eigenvalue  greater  than  1 .0.  Also,  similar  patterns  of  factor  loadings  were  found 
across  all  subsample  contrasts  that  were  considered  (e.g.,  females  vs.  males;  entry-  vs.  exit-level  candidates).  These  results 
suggest  that  the  measure  of  self-confidence  in  teaching  considered  in  this  investigation  is  a unidimensional  rather  than  a 
multidimensional  scale. 


Teacher  educators  generally  assume  that  self-confi- 
dence is  a necessary  condition  for  success  in  teaching  (see,  for 
example,  Maeroff,  1 989;  Cecil,  1991 ).  Thisimplicitassumption 
is  bolstered  by  agrowing  body  of  research  which  indicates  that 
improvements  in  self-confidence  promote  positive  changes  in 
attributes  related  to  teaching  performance.  One  line  of  inquiry 
suggests  that  teachers  who  have  relatively  high  levels  of  self- 
confidence  are  likely  to  think  about  teaching  in  more  positive 
ways  than  those  who  lack  self-confidence  (see,  for  example, 
Pigge  & Marso,  1987;  Kalaian  & Freeman,  1989;  Solliday  & 
Jacko,  1 986).  Other  studies  suggest  that  teachers  may  devalue 
even  the  most  critical  tasks  in  teaching  if  they  lack  confidence 
in  their  abilities  to  successfully  execute  those  tasks.  For 
example,  Solliday  and  Jacko  (1986)  have  shown  that  candi- 
dates’ ratings  of  the  importance  of  various  teaching  tasks  are 
directly  related  to  their  self-confidence  in  performing  each  task. 

Even  though  teacher  educators  agree  that  self-confi- 
dence is  a critical  attribute  in  teaching  and  a growing  body  of 
research  has  supported  this  assumption,  none  of  this  work  to 
date  has  centered  on  the  development  of  adequately  defined 
measures  of  self-confidence  in  teaching.  This  investigation 
attempted  to  address  this  need.  Its  basic  purposes  were:  (a)  to 
explore  the  factor  structure  of  the  items  in  a Self-Confidence  in 
Teaching  Scale  developed  at  Michigan  State  University  (MSU), 
and  (b)  to  examine  the  extent  to  which  the  self-confidence  factor 
structure  differs  for  males  and  females  or  among  teacher  can- 
didates at  different  points  in  their  professional  development. 

Michigan  State  University  Self-Confidence  in 
Teaching  Scale 

The  12-item  Self-Confidence  in  Teaching  Scale  was 
designed  by  teacher  education  faculty  at  MSU  and  has  been 
used  in  several  other  research  studies  (e.g.,  Kalaian  & Freeman, 
1989).  Each  item  asks  candidates  to  describe  the  level  of 
confidence  they  have  in  their  ability  to  perform  one  of  twelve 
different  teaching  roles  (e.g.,  assessing  student  learning  and 


development).  Responses  to  each  item  are  recorded  on  a four- 
point  scale  ranging  from  “little  or  no  confidence”  to  “complete 
confidence.”  Each  item  was  deliberately  designed  by  the  faculty 
panel  to  depict  a distinct  aspect  of  teaching.  The  set  of  12  roles 
was  also  selected  to  provide  a representative  sample  of  the  full 
range  of  major  teaching  responsibilities  (Table  1 lists  each  of  the 
12  items  in  the  scale). 

Related  Research 

Although  studies  of  the  factor  structure  of  measures  of 
constructs  that  may  be  directly  related  to  self-confidence  have 
been  reported  in  the  literature,  the  authors  are  not  aware  of  any 
comparable  studies  of  scales  that  assess  self-confidence  in 
teaching.  Researchers  examining  the  factor  structure  of  self- 
esteem or  self-concept  scales  have  nearly  always  concluded  that 
these  constructs  are  multidimensional  (see,  for  example,  Byme  & 
Shavelson,  1987;  Marsh,  Smith  & Bames,  1985;  Marsh,  Smith, 
Barnes  & Butler,  1983;  Marsh  & Shavelson,  1985).  Only  on  rare 
occasions  have  researchers  concluded  that  self-concept  is  a 
unidimensional  construct  and  should  not  be  broken  into  distinct 
subparts  or  facets  (e.g.,  Marx  & Winne,  1978).  Drawing  on  this 
literature,  the  authors  speculated  that  the  factor  structure  of 
responses  to  the  MSU  Self-Confidence  in  Teaching  Scale  would 
be  multidimensional,  particularly  since  the  MSU  scale  was  delib- 
erately designed  to  focus  on  12  distinct  aspects  of  teaching. 

Genderand  Developmental  Differences 

Interest  in  potential  differences  between  the  factor  struc- 
tures of  the  self-confidence  scale  for  male  and  female  respondents 
stems  from  the  growing  body  of  research  literature  that  consis- 
tently indicates  that  males  and  females  express  different  levels  of 
self-confidence  in  their  abilities  as  teachers.  Kalaian  and  Freeman 
( 1 989),  for  example,  provided  evidence  that  female  teacher  candi- 
dates enter  teacher  preparation  programs  with  lower  levels  of 
confidence  than  males  and  that  this  differential  persists  to  pro- 
gram completion.  In  a similar  vein,  Pigge  and  Marso  (1987), 
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reported  that  the  student  teaching  experience  reduces  anxieties 
about  one’s  role  as  a teacher  to  a greater  extent  for  females  than 
for  males. 

Studies  examining  gender  differences  in  the  factor 
structures  of  measures  of  self-esteem  and  self-concept  have 
yielded  inconsistent  findings  (see,  for  example,  Byrne  & 
Shavelson,  1987;  March,  Smith  & Barnes  1985;  Lemer  & 
Brackney,  1981;Norem-Hibeisen,  1976;  Skaalvik,  1986).  Byrne 
and  Shavelson  (1987),  for  example,  concluded  that  the  factor 
structures  and  subscale  reliabilities  of  measures  of  self-con- 
cepts differed  as  a function  of  gender.  In  contrast,  Marsh,  Smith 
and  Barnes  (1985)  found  that  the  factor  structures  of  self- 
concept  measures  were  invariant  for  males  and  females.  Given 
these  inconsistencies  and  the  lack  of  a direct  parallel  between 
measures  of  self-concept  and  measures  of  self-conf  dence  in 
teaching,  the  authors  wanted  to  determine  if  the  factor  structure 
and  patterns  of  factor  loadings  across  individual  items  of  the 
MSU  Self-Confidence  in  Teaching  Scale  would  be  similar  or 
different  for  male  and  female  teacher  candidates. 

Finally,  the  authors  also  wanted  to  determine  if  the 
factor  structure  and  patterns  of  factor  loadings  would  vary 
among  experienced  and  inexperienced  teacher  candidates  (i.e., 
among  those  just  entering  an  undergraduate  teacher  prepara- 
tion program  and  those  who  are  completing  the  program). 
Although  there  was  no  research  literature  to  draw  upon,  we 
conjectured  that  these  two  factor  structures  would  probably 
vary  since  those  completing  the  teacher  education  program 
have  considerably  more  experience  in  executing  each  teaching 
role  than  is  true  for  those  who  are  just  entering  the  program. 

Methodology 

Samples 

The  two  groups  of  teacher  candidates  who  partici- 
pated in  this  study  will  be  referred  to  as  the  entry  and  exit 
samples: 

1.  The  “entry  sample”  included  1,176  undergraduate 
teacher  candidates  (80%  females;  less  than  4%  minorities). 
Members  of  this  sample  completed  the  MSU  Self-Confidence  in 
Teaching  Scale  during  the  first  week  of  the  first  required  educa- 
tion course.  Most  members  of  this  sample  (66%)  were  college 
juniors. 

2.  The  “exit  sample”  included  861  preservice  candi- 
dates (77%  females)  who  completed  the  MSU  Self-Confidence 
Scale  during  the  final  weeks  of  student  teaching,  the  final 
education  requirement  for  most  students.  Most  members  of  this 
sample  (81%)  were  college  seniors. 

Analyses 

The  SPSS/PC  version  of  principal  axis  factoring  method 
(PA2)  was  used  to  examine  the  factor  structure  of  the  self- 
confidence  scale.  In  this  factoring  method,  squared  multiple 
correlation  coefficients  between  a given  item  and  the  rest  of  the 
items  in  the  MSU  self-confidence  scale  were  entered  as  initial 
communal ity  estimates.  Then,  factors  were  extracted  through  an 
iterative  procedure  utilizing  a convergence  criterion  of  .001. 
Factors  with  a minimum  eigenvalue  of  1 .0  were  retained. 


The  series  of  factor  analyses,  that  were  ultimately 
conducted  began  with  an  analysis  of  responses  to  the  self- 
confidence  scale  for  all  members  of  the  entry  sample  (males  and 
females  combined).  The  analysis  was  then  repeated  for  the  exit 
sample.  Then,  the  data  for  males  and  females  in  each  sample  were 
independently  analyzed. 

Results 

Internal  Consistencies 

The  inter-item  correlations  among  the  12  items  in  the 
self-confidence  scale  were  consistently  high,  ranging  from  0.34 
to  0.70  for  the  entry  sample  and  from  0.29  to  0.62  for  the  exit 
sample.  The  corresponding  coefficient  alphas  were  0.92  for  both 
the  entry  and  exit  data.  Coefficient  alphas  were  also  computed 
separately  for  males  and  females  in  each  of  the  samples.  Once 
again,  high  levels  of  internal  consistency  were  found.  For  the 
entry  sample,  the  alphas  for  males  and  females  were  0.9 1 and  0.93  * 
respectively.  The  coefficient  alphas  were  0 .92  for  both  males  and 
females  in  the  exit  sample. 

Factor  Analyses  of  Responses  to  the  Self-Confidence  Scale 
The  results  of  principal  axis  factor  analysis  of  the 
MSU  Self-Confidence  in  Teaching  Scale  are  presented  in  Table 
1 for  both  the  entry  and  exit  samples.  As  these  results  indicate, 
both  sets  of  data  yielded  only  one  factor  with  an  eigenvalue  of 
greater  than  1 .0.  This  general  factor  accounted  for  57.5%  of  the 


Tablet 

Factor  Loadings for  Factor  1 (Overall  Level  of  Confidence 
in  Oneself  as  a Teacher):  Entry  vs.  Exit  Samples' 

Item 

Entry 

Exit 

l.  Making  instructional  decisions  in 
a sound  and  defensible  manner. 

Sample 

.82 

Sample 

.73 

2.  Maximizing  student  understanding 
of  the  subject  matter. 

.81 

.75 

3.  Providing  instruction  that  addresses 
individual  needs  and  achievements. 

.80 

.74 

4.  Assessing  student  learning  and 
development. 

.76 

.70 

5.  Motivating  students  to  participate 
in  academic  tasks. 

.76 

.73 

6.  Establishing  a classroom  environ- 
ment in  which  students  actively 
take  rcsponsibilty  for  themselves 
and  for  others  in  the  group. 

.74 

.74 

7.  Designing  lessons,  units,  and 
courses  of  study. 

.73 

.71 

8.  Applying  effective  methods  of 
teaching  specific  subjects  such  as 
reading  and  mathematics. 

.71 

.76 

9.  Deciding  what  content  to  teach 
and  what  not  to  teach. 

.69 

.58 

(continued  on  page  4) 
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(Table  1 continued) 

Item 

10.  Analyzing  and  improving  your 
own  teaching  performance. 

Entry 

Sample 

.69 

Exit 

Sample 

.62 

11.  Establishing  effective  working 
relationships  with  students  from 
diverse  cultural  and  academic 
backgrounds  (e.g.,  students  whose 
ethnic  backgrounds  are  different 
from  your  own;  gifted  students; 
students  with  learning  problems). 

.63 

.57 

12.  Responding  appropriately  to 
disruptive  student  behaviors. 

.62 

.69 

1 Each  item  in  this  table  is  presented  as  il  appears  in  the  MSU  Self-Confidence 
in  Teaching  Scale  However,  items  in  Table  1 are  listed  in  descending  order  of 
factor  loadings  and  not  in  the  order  in  which  they  appear  in  the  Scale 

total  entry  data  variance  (eigenvalue  = 6.7)  and  52.7%  of  the  total 
exit  data  variance  (eigenvalue  = 6.5). 

As  might  be  expected,  the  loadings  for  Factor  1 were 
fairly  uniform  across  all  12  items  in  the  entry  and  exit  samples.  For 
the  entry  sample,  factor  loadings  ranged  for  0.62  to  0.82.  The 
corresponding  figures  forthe  exit  sample  ranged  from  0.57  to  0.76. 

Gender  Differences 

Entry  Sample.  For  the  entry  sample,  the  principal  axis  factor 
analysis  for  male  respondents  yielded  only  one  factor  with  an 
eigenvalue  greater  than  1.0.  This  factor  had  an  eigenvalue  of  6.  12 
and  accounted  for  5 1 .0%ofthe  total  variance.  Similarly,  only  one 
factor  was  extracted  from  the  data  provided  by  entry-level  female 
candidates.  This  factor  accounted  for  58.5%  of  the  total  variance 
and  had  an  eigenvalue  of  7.1 . As  shown  in  Table  2,  the  factor 
loadings  on  the  first  factor  ranged  from  0.61  to  0.83  for  females 
in  the  entry  sample;  and  from  0.52  to  0.82  for  males.  The  pattern 
of  loadings  across  items  was  also  similar  for  males  and  females. 


Table  2 

Factor  Loadings  for  the  Factor  1:  Male-Female  Contrasts 
Item 


1 . Making  sound  instructional 
decisions 

2.  Maximizing  student  under- 
standing 

3.  Individual  instruction 

4.  Assessing  student  learning 
and  development 

5.  Motivating  students 

6.  Promoting  student  res- 
ponsibility. 


Entry  Sample 
Male  Female 

Exit  Sample 
Male  Female 

.82 

.81 

.71 

11 

.74 

.83 

77 

.72 

.75 

.82 

.74 

.76 

73 

.77 

.70 

.70 

72 

.76 

72 

.77 

67 

74 

73  .76 

(continuedl 
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Item  Entry'  Sample  Exit  Sample 

Male  Female  Male  Female 

7.  Designing  lessons,  units 


and  courses  of  study 

.73- 

.73 

.70 

.73 

8.  Applying  effective 
methods  of  teaching 
specific  subjects 

.60 

.73 

.77 

.74 

9.  Deciding  what  to  teach 

.61 

.71 

.58 

.57 

10.  Analyzing  own  teaching 
performance 

.67 

.69 

.61 

.68 

1 1 . Establishing  relations  with 
students  from  diverse 
backgrounds 

.52 

.65 

.57 

.59 

12.  Responding  to  disruptive 
student  behaviors 

.58 

.61 

.68 

.67 

Exit  Sample.  The  results  of  principal  axis  factor  analyses  for 
males  and  females  in  the  exit  sample  were  similar  to  those  reported 
for  the  entry  sample.  Analyses  of  data  provided  by  male  respon- 
dents yielded  only  one  factor  that  had  an  eigenvalue  greater  than 
1 .0.  This  factor  had  an  eigenvalue  of  6.4  and  accounted  for  52.1% 
of  the  variance.  Likewise,  exit  data  provided  by  females  yielded 
only  one  interpretable  factor  which  accounted  for  54.2%of  the  total 
variance  and  had  an  eigenvalue  of  6.5.  As  shown  in  Table  2,  factor 
load:ngs  on  Factor  1 ranged  from  0.57  to  0.77  for  both  males  an 
femaies  in  the  exit  sample. 

Discussion 

A Closer  Look  at  the  Unidimensionality  of  the  MSU  Scale 

Cooper  ( 1 983)  has  shown  that  the  use  of  the  "eigenvalue- 
less-than- 1 .0“  decision  rule  to  determine  the  number  of  intelligible 
factors  in  a given  factor  matrix  may  mask  factors  that  would  be 
identified  if  the  matrix  were  rotated.  As  a further  test  of  the 
unidimensionality  of  the  factor  structure  of  the  MSU  Self-Confi- 
dence in  Teaching  Scale,  the  authors  therefore  conducted  a scree 
test  to  determine  if  the  only  significant  drop  in  eigenvalues 
occurred  between  the  first  and  second  factors  and  if  all  subsequent 
decreases  in  these  values  gradually  trailed  off  across  additional 
factors.  The  results  of  the  scree  analyses  for  the  entry  and  exit 
samples  are  shown  in  Figure  1 . 
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As  this  figure  illustrates,  eigenvalues  for  the 
entrysample  dropped  from  6.7  to  .97  from  Factor  1 to  Factor  2, 
then  .65,  .6 1 , .56,  .55,  .47,  .40,  .38,  .34,  .32, and  .29  across  Factors 
3 through  12.  The  corresponding  eigenvalues  for  the  exit  sample 
were  6.5,  .79,  .68,  .63,  .56,  .53,  .47,  .45,  .42,  .38,  .36,  and.33  for 
Factors  1 through  12.  Although  not  shown  in  Figure  1,  similar 
patterns  of  eigenvalues  occurred  for  each  of  the  other  four 
subsamples  that  were  considered  in  the  study  (e.g.,  male  stu- 
dents at  exit).  These  consistent  patterns  across  all  analyses 
suggest  that  Factors  2 through  1 2 are  largely  measuring  random 
error.  It  is  therefore  reasonable  to  conclude  that  there  is  only  one 
meaningful  and  interpretable  factor  within  the  factor  structure 
of  the  MSU  Scale. 

Conclusion 

The  results  of  this  exploratory  study  suggest  that  measures  of 
self-confidence  in  teaching  are  likely  to  be  unidimensional, 
rather  then  multidimensional  scales.  Likewise,  it  is  reasonable 
to  hypothesize  that  this  unidimensionality  will  hold  for  both 
males  and  females  and  for  those  who  are  completing  teacher 
preparation  programs  as  well  as  for  those  who  are  just  beginning 
their  studies  in  education.  However,  given  that  this  study 
considered  only  one  self-ccnfidence  measure  and  only  one 
institutional  ccntext,  there  is  a clear  need  to  determine  the 
generalizability  of  these  findings  across  alternative  measures  of 
self-confidence  (e.g.,  scales  that  include  additional  items)  and 
other  institutional  contexts.  Further  research  focusing  on 
alternative  measures  of  teachers’  self-confidence  may  yield 
different  factor  structures  and  different  inferences  about  the 
self-confidence  in  teaching  construct. 
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Parenting  Style  and  Parental  Involvement 
Relations  with  Adolescent  Achievement 


Sharon  E.  Paulson,  Ball  State  University 

Abstract 

The  purposes  of  this  study  were  to  explore  the  influence  of  parenting  style  (demandingness  and  responsiveness) 
and  parental  involvement  (commitment  to  achievement)  on  school  achievemer.i  in  adolescents,  and  to  compare  the  relative 
importance  of  the  different  dimensions  of  parenting  for  the  achievement  outcome.  Subjects  were  80  ninth-grade  boys  and 
girls  from  a suburban  community  in  the  southeast.  Questionnaire  measures  of  adolescents'  perceptions  of  maternal  and  paternal 
demandingness,  responsiveness,  and  commitment  to  achievement  were  designed  for  this  program  of  research.  Boys'  reports 
of  both  maternal  and  paternal  parenting  significantly  predicted  their  achievement  outcome,  with  parental  values  towards 
achievement  significantly  predicting  achievement  in  boys  above  and  beyond  dimensions  of  parenting  style.  Girls'  reports  of 
parenting  did  not  predict  their  achievement  outcome. 


In  the  research  on  family  influences  on  achieve- 
ment, a number  of  parenting  characteristics  have  been  found  to 
be  related  positively  to  children’s  school  achievement,  includ- 
ing parental  involvement  (see  Christenson,  Rounds,  & Gorney, 

1 992,  and  Hess  & Holloway,  1 984,  for  reviews)  and  authoritative 
parenting  styles  (Baumrind,  1967,  1971;  Dombusch,  Ritter, 
Leiderman,  Roberts,  & Fraleigh,  1987;  Steinberg,  Elmen,  & 
Mounts,  1 989).  Traditionally,  the  influences  of  parental  involve- 
ment and  parenting  styles  have  been  studied  within  different 
disciplines,  with  parental  involvement  being  the  primary  focus 
in  the  field  of  education,  and  parenting  styles  being  the  primary 
focus  in  the  field  of  developmental  psychology.  But,  even  when 
developmentalists  or  educators  study  both  parental  involve- 
ment and  parenting  styles,  they  generally  do  so  in  separate  lines 
of  research.  Additionally,  the  majority  of  this  research  has 
focused  on  elementary  school  children. 

The  major  purpose  of  this  study  was  to  explore  the 
influence  of  both  parenting  style  and  parental  commitment  to 
achievement  on  the  achievement  outcome  of  adolescents.  In 
light  of  previous  research  (Baumrind,  1 967, 1971;  Dornbusch  et 
al. , 1 987;  Steinberg  et  al 1 992),  it  was  expected  that  adolescents 
of  parents  who  were  high  on  both  demandingness  and  respon- 
siveness would  have  higher  levels  of  achievement  than  adoles- 
cents from  other  parenting  styles.  Similarly,  it  was  predicted  that 
a high  parental  involvement  in  achievement  would  be  positively 
related  to  the  achievement  outcome  of  the  adolescents  (Hess  & 
Holloway,  1984;  Steinberg  et  al .,  1992;  Stevenson  & Baker, 
1987).  Although  it  was  expected  that  parental  involvement  in 
achievement  would  be  positively  related  to  demand  bigness  and 
responsiveness,  it  was  expected  that  high  levels  of  parental 
involvement  in  achievement  would  predict  achievement  above 
and  beyond  that  predicted  by  parenting  style.  Such  an  outcome 
would  support  educators’  views  that  parental  involvement  in 
children’s  achievement  is  the  most  important  component  of 
parenting.  Developmentalists  have  argued  that  parenting  style 
is  more  important  than  parental  involvement  for  adolescents’ 
school  achievement  (Steinberg  et  al .,  1 992),  but  no  studies  have 
made  a direct  comparison  of  the  relative  importance  of  the 


different  dimensions  of  parenting. 

Parental  Involvement 

In  major  reviews  of  the  research  on  family  influences 
on  achievement,  Hess  and  Holloway  (1984)  and  Christenson 
and  colleagues  (1992)  discussed  characteristics  of  parental 
involvement  which  were  found  to  have  the  most  consistent 
relations  with  achievement.  In  general,  high  expectations  of 
parents  for  their  children’s  achievement  (Gottfried  & Gottfried, 
1989;  Marjoribanks,1988;  Parsons,  Adler,  & Kaczala,  1982; 
Seginer,  1 983, 1 986;  Thompson,  Alexander,  & Entwisle,  1 988), 
positive  parental  beliefs  and  attributions  about  their  children’s 
abilities  (Holloway  & Hess,  1 982;  Sigel,  1 982;  Stevenson,  Lee, 
Chen,  Lummis,  Stigler,  Fan,  & Ge,  1990)  and  positive  home 
learning  environments,  including  helping  with  homework  and 
monitoring  grades  (Epstein,  1987;  Steinberg,  Lamborn, 
Dornbusch,  & Darling,  1992;  Stevenson  & Baker,  1987)  were 
found  to  be  related  positively  to  achievement.  Additionally, 
parental  involvement  at  school  (involvement  in  school  activi- 
ties, sports  events,  or  other  school-related  functions)  was 
found  to  have  a positive  influence  on  children's  school  achieve- 
ment (Linney&  Vernberg,  1983;  Stevenson  & Baker,  1987). 

These  different  dimensions  of  parental  involvement 
(i.e.  parental  expectations,  parental  encouragement,  helping 
with  homework,  and  involvement  in  school  activities)  usually 
are  studied  in  separate  lines  of  research.  When  they  are  studied 
together,  they  frequently  are  combined  into  single  measures  of 
parental  involvement.  For  example,  although  Steinberg  and 
others  ( 1 992)  studied  the  influences  of  parental  encouragement 
and  parental  involvement  as  separate  dimensions,  their  mea- 
sure of  parental  involvement  included  both  help  with  home- 
work and  involvement  in  school  activities.  This  study  consid- 
ered three  elements  of  parental  involvement  separately:  (1) 
values  towards  achievement , (2)  interest  in  grades  and  school- 
work,  a^d  (3)  involvement  in  school  functions  Additionally, 
adolf-:'.".  s’  perceptions  of  both  maternal  and  paternal  com- 
mitmt.  j achievement  were  obtained  so  as  not  to  ignore 
fathers’  roles. 
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Parenting  (continued) 

Parenting  Style 

Affective  relationships  between  parents  and  children  and 
discipline  and  control  strategies  (Baumrind,  1971;  Crouter, 
MacDermid,  McHale,  Perry-Jenkins,  1990;  Dombusch  e/ a/.,  1987; 
Grolnick  & Ryan,  1989;  Hess  & McDevitt,  1984;  Steinberg  etal. , 
1992)  have  been  found  to  be  related  to  achievement  as  well.  These 
two  parenting  characteristics  (level  of  affect  and  level  of  control) 
have  been  used  to  represent  two  dimensions  of  parenting  called 
responsiveness  and  demandingness,  respectively  (Maccoby  & 
Martin,  1983).  These  are  the  same  dimensions  originally  identified 
by  Schaefer  (1965)  as  warmth  and  control.  The  interplay  between 
responsiveness  and  demandingness  is  evident  in  Baumrind’s 
typology  of  parenting  styles  (Baumrind,  1971).  Baumrind  (1967, 
1971)  found  that  children  of  authoritative  parents  (those  with  high 
levels  of  both  demandingness  and  responsiveness)  have  higher 
achievement  than  children  of  either  authoritarian  (high  levels  of 
demandingness,  but  low  levels  of  responsiveness)  or  permissive 
(low  levels  of  demandingness)  parents,  suggesting  that  high  levels 
of  both  control  and  affect  were  more  conducive  to  positive  achieve- 
ment outcome  than  were  other  parenting  characteristics. 

In  a more  recent  study  of  the  relations  between  parenting 
style  and  achievement  in  high  school  students,  Dombusch  and 
colleagues  (1987)  similarly  found  a positive  relationship  between 
authoritative  parenting  and  adolescents'  grades,  and  a negative 
relationship  between  grades  and  both  authoritarian  and  permissive 
parenting  styles.  Their  measures,  however,  integrated  parental 
involvement  within  parenting  style.  For  example,  items  on  the 
permissiveness  scale  suggested  that  “parents  are  not  involved  in 
education,  they  do  not  attend  school  programs  for  parents,  they  do 
not  help  with  homework,  and  they  do  not  check  the  child’s  home- 
work” (Dombusch  et  al.y  1 987,  p.  1 247).  Although,  it  was  reason- 
able to  assume  that  parenting  style  was  correlated  with  parental 
involvement  (i.e.  authoritative  parents  display  higher  levels  of 
commitment  to  achievement  than  do  parents  with  other  parenting 
styles),  it  may  be  necessary  to  measure  the  two  constructs  sepa- 
rately and  consider  the  relative  importance  of  each  in  determining 
achievement  outcome. 

A measure  of  parenting  style  was  created  for  the  current 
study  using  the  two  continuous  dimensions  of  demandingness  and 
responsiveness.  Adolescents’  perceptions  of  both  maternal  and 
paternal  demandingness  and  responsiveness  were  obtained.  The 
measures  were  modeled  after  a number  of  measures  which  have 
assessed  similar  dimensions  of  parenting,  including  the  Children’s 
Report  of  Parental  Behavior  Inventory  (Schaefer,  1 965),  the  Family 
Environment  Scale  (Moos  & Moos,  1981)  and  the  Parental  Atti- 
tudes Questionnaire  (Spence  & Helmreich,  1978),  as  well  as  mea- 
sures of  parenting  used  by  John  Hill  and  colleagues  in  their  line  of 
research  on  adolescent  family  relations (e.g.  Hill,  Holmbeck,  Marlow, 
Green, & Lynch,  1985a, b;  Paulson,  Hill, & Holmbeck,  1991). 

The  developmental  literature  on  adolescents  suggests 
that  the  influences  of  parenting  style  may  be  different  for  boys  and 
girls  because  of  the  increased  need  for  autonomy  in  early  adoles- 
cence. Studies  have  found  negative  outcomes  in  boys,  but  not  in 
girls,  resulting  from  too  much  independence  (too  little 
demandingness)  too  soon  (Crouter  et  a!.,  1990;  Grolnick  & Ryan, 
1 989).  Therefore,  separate  analyses  were  done  for  boys  and  for  girls 
in  the  current  study. 


Method 

Subjects 

Subjects  for  this  study  were  80  ninth  grade  boys  and 
girls  (n  = 34  boys  and  46  girls),  recruited  from  public  high  schools 
in  a suburban  county  in  the  southeast.  All  ninth  graders  from  two 
county  high  schools,  chosen  to  assure  a wide  range  of  socio- 
economic status,  were  asked  to  participate.  The  only  criterion  for 
selection  was  that  the  students  lived  with  two  parents  (who  may 
or  may  not  be  natural  parents),  because  the  influences  of  both 
mothers’  and  fathers’  parenting  were  of  interest.  Additionally, 
the  primary  goal  of  this  study  was  to  explore  the  influence  of 
current  parenting  (regardless  of  the  biological  relation  of  the 
parents  to  the  adolescents)  on  current  school  achievement. 

The  mean  age  of  the  adolescents  was  14.90  (19  of  the 
adolescents  were  14  years  old,  50  w:ere  15,  and  1 1 were  16).  Eighty- 
five  percent  of  the  families  were  White,  9%  were  African-Ameri- 
can, 5%  were  Asian-American,  and  1%  was  Hispanic- American. 
Fifty  percent  of  the  families  were  middle  to  upper-middle  class 
and  50%  were  working  class  (classified  as  lower-middle  class  by 
other  measures)  as  assessed  by  the  four-factor  Hollingshead 
index  ( 1 975).  The  wide  range  of  SES  in  the  sample  was  represen- 
tative of  the  population  in  the  county. 

Procedure 

Questionnaire  packets  were  mailed  to  the  homes  of  approxi- 
mately 150  ninth-graders  who  had  responded  positively  to  an 
earlier  letter  requesting  their  participation.  About  50%  of  the 
adolescents  completed  and  returned  the  questionnaires  creating 
the  final  sample  of  80  subjects. 

Measures 

Achievement  Outcome . Adolescents’  self-reported  grades 
from  the  most  recent  grading  period  were  used  to  measure 
achievement.  An  average  grade  was  calculated  from  the  grades 
reported  on  five  core  courses  using  a 4-point  grading  scale 
(A=4.0,B=3.0,etc).  Self-reported  grades  as  a measure  ofachieve- 
ment  were  endorsed  by  Dombusch  and  others  (1987)  because 
such  grades  were  found  to  correlate  highly  with  school  records 
(r>  .70)  and  they  reflect  current  achievement  rather  than  level  of 
intellectual  potential  (which  was  not  of  interest  in  this  study). 

Parenting  Measures . A 1 5-item  scale  was  designed  to  assess 
maternal  and  paternal  demandingness.  Items  were  written  to 
assess  the  general  level  of  parental  control  in  the  family  and 
included  questions  about  rules  and  discipline  strategies.  Sample 
items  include  “My  mother  (father)  disciplines  me  a lot”  and  “My 
mother  (father)  gives  me  chores  to  do  around  the  house.” 
Another  15-item  scale  was  designed  to  measure  maternal  and 
paternal  responsiveness,  which  assessed  parental  warmth  and 
whether  parents  allowed  their  adolescents  to  have  a say  in 
discipline  matters.  Sample  items  include  “My  mother  (father) 
believes  I have  a right  to  my  own  point  of  view”  and  “My  mother 
(father)  enourages  me  to  talk  to  her  (him)  honestly.”  A 22-item 
scale  was  designed  to  measure  maternal  and  paternal  involve- 
ment in  achievement.  Three  subscales  were  created  from  this 
measure  in  order  to  assess  specific  dimensions  of  parental 
commitment  to  achievement:  achievement  values,  interest  in 
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Parenting  (continued) 

schoolwork,  and  involvement  in  school  functions.  Sample 
items  from  the  three  subscales  include  “My  mother  (father)  tries 
to  get  me  to  do  my  best  on  everything  1 do,”  “My  mother 
(father)  makes  sure  that  1 have  done  my  homework,”  and  “My 
mother  (father)  usually  goes  to  activities  in  which  1 am  involved 
in  school,”  respectively. 

Only  adolescents’  reports  of  the  parenting  measures 
were  used  for  the  purposes  of  this  study,  because  previous 
research  has  shown  that  adolescents’,  but  not  parents’,  reports 
of  parenting  are  correlated  with  their  achievement  outcome 
(Paulson,  1993).  Adolescents  responded  to  all  the  items  as  they 
described  their  mother,  then  again  as  they  described  their 
father,  using  a 5-point  response  scale  ranging  from  “Very  unlike 
my  mother  (father)”  to  “Very  like  my  mother  (father).”  Higher 
scores  indicated  higher  levels  of  parenting.  The  order  of 
presentation  of  the  maternal  and  paternal  scales  was  altered  in 
half  of  the  questionnaires  to  control  for  possible  response  bias. 
Total  scores  for  each  scale  were  obtained  by  averaging  across 
scale  items.  Cronbach  alphas  for  adolescents’  reports  of 
maternal  and  paternal  demandingness  were  .82  and  .90,  respec- 
tively. Cronbach  alphas  for  adolescents'  reports  of  maternal 
and  paternal  responsiveness  were  .87  and  .86,  and  alphas  for 
adolescents’  reports  of  maternal  and  paternal  commitment  to 
achievement  were  .83  and  .74,  respectively. 

Evidence  for  the  validity  of  the  parenting  measures 
was  found.  The  two  parenting  factors  (demandingness  and 
responsiveness)  were  confirmed  using  a principal  components 
factor  analyses  with  Varimax  rotation.  Two  distinct  factors 
emerged  with  the  demandingness  items  loading  on  one  factor 
and  the  responsiveness  items  loading  on  the  other  factor. 
Factor  analysis  of  the  parental  involvement  scale  revealed  two 
factors  with  items  from  the  achievement  values  and  interest  in 
schoolwork  subscales  loading  on  one  factor  (these  subscales 
are  highly  correlated)  and  the  items  from  the  school  functions 
subscale  loading  on  the  other  factor.  In  additional  analyses  of 
the  measures,  adolescents’  reports  of  demandingness  were 
found  to  correlate  negatively  with  the  Extreme  Autonomy  scale 
(r=-.58  and  r=-.60,  p<.01  for  maternal  and  paternal  measures 
respectively)  and  positively  with  the  Enforcement  of  Discipline 
scale  (r=.60  and  r=.64,  p<  0 1 for  maternal  and  paternal  measures) 
of  the  Children's  Report  of  Parental  Behavior  Inventory  (CRPB1; 
Schaefer,  1965).  Adolescents’  reports  of  responsiveness  cor- 
related highly  (r=.76  and  .79,  p<.01  for  maternal  and  paternal 
measures)  with  the  Acceptance  of  Individuation  subscale  of 
the  CRPBI.  Demandingness  also  correlated  highly  with  the 
Control  scale  (r=.54  and  r=  49,  p<.01  for  maternal  and  paternal 
measures)  of  the  Family  Environment  Scale  (FES;  Moos  & 
Moos,  1981),  responsiveness  correlated  with  the  Expressive- 
ness scale  (r=.43  and  r=  38,  p<.01  for  maternal  and  paternal 
measures)  of  the  FES,  and  parental  involvement  correlated  with 
the  Achievement  scale  (r=.47  and  r=.36  for  maternal  and  paternal 
measures)  of  the  FES. 

Analysis 

Pearson  correlation  coefficients  between  the  parenting 
measures  arc  shown  in  Table  1 for  both  boys’  and  girls'  reports 
of  both  maternal  and  paternal  parenting.  Correlations  among 


boys’  reports  are  shown  above  the  diagonals  and  correlations 
among  girls’  reports  are  shown  below  the  diagonals.  These 
correlations  were  examined  for  multicollinearity. 

Multiple  regression  analyses  were  employed  to  assess 
the  relations  between  parenting  and  achievement  outcome.  Five 
measures,  namely  demandingness,  responsiveness,  and  the  three 
subscales  of  parental  involvement,  were  entered  simultaneously  to 


Table  1 

Correlations  among  Adolescents ' Reports  of  Parental  Demandingness , 
Responsiveness,  and  Commitment  to  Achievement 


Parenting  Measures  D 

R 

V 

1 

A 

Maternal  Parenting 

Demandingness  (D)  — 

-.18 

.06 

.13 

.01 

Responsiveness  (R)  -.43** 

— 

.31 

.44** 

.01 

Values  Achievement  (V)  .11 

.54** 

— 

.46** 

.20 

Interest  in  Schoolwork  (I)  .14 

.50** 

.67** 

— 

.20 

Attends  School  Functions  (A)  -.05 

.51** 

.31* 

.42** 

— 

Paternal  Parenting 

Demandingness  (D)  — 

-.51** 

.41* 

.11 

-.36* 

Responsiveness  (R)  „ -.47** 

— 

.18 

.36* 

.12 

Values  Achievement  (V)  .39** 

.14 

— 

.65** 

-.54** 

Interest  in  Schoolwork  (I)  .40** 

.27 

.41** 

— 

.16 

Attends  School  Functions  (A)  -.12 

.45** 

.14 

.20 

Note.  Correlations  among  boys'  perceptions  of  parenting  are  shown  above  the  diagonals 
in  each  matrix,  and  correlations  among  girls'  perceptions  are  shown  below  the  diagonals. 
•p<  .05,  **p<  .01. 


determine  the  proportion  of  variance  in  achievement  explained  by 
the  combination  of  parenting  variables.  Separate  analyses  were  run 
for  boys’  and  girls’  reports  of  maternal  and  paternal  parenting.  The 
small  sample  size  precluded  entering  both  maternal  and  paternal 
parenting  variables  into  the  same  regression  equation. 

Results 

The  results  of  the  four  regression  analyses  are  shown  in 
Table  2.  As  expected,  boys’  reports  of  both  mothers’  and  fathers’ 
parenting  significantly  predicted  their  achievement  outcome 
(R2=.39,  p<.01  and  R2=.42,  p<.01  for  mothers  and  fathers,  respec- 
tively). Girls’  reports  of  parenting  did  not  predict  a significant 
amount  of  variance  in  their  achievement. 

Squared  semi-partial  correlations  were  examined  to  as- 
sess the  unique  proportion  of  variance  in  achievement  predicted  by 
each  of  the  parenting  dimen 'dons  above  and  beyond  all  other 
variables.  Whereas  the  squared  multiple  correlations,  reported 
earlier,  assessed  the  combined  contribution  of  the  parenting  vari- 
ables to  the  prediction  of  achievement,  the  squared  semi-partial 
correlations  provided  important  information  about  the  unique 
contribution  of  each  factor  by  controlling  for  the  shared  variance 
in  the  parenting  variables.  These  results  revealed  that  maternal 
demandingness  (sr2  - .1 1 , p < .05)  and  both  maternal  and  paternal 
values  towards  achievement  (sr2  = . 1 8,  p < .0 1 and  sr2 « . 1 3,  p < .05, 
respectively)  were  positively  related  to  achievement  outcome,  and 
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Parenting  ( continued ) 


Table  2 

Summary  of  Multiple  Regression  Analyses  of  the  Influence  of 
Parenting  Variables  on  Achievement  Outcome 


Maternal 

Parenting 

Paternal 

Parenting 

Variables  Entered 

sr 

sr2 

R2 

sr 

sr: 

R2 

Boys’  Reports 

.39** 

.42** 

Demandingness 

.33 

.11* 

.18 

.03 

Responsiveness 

.26 

.07+ 

-.16 

.03 

Values  Achievement 

.43 

.18** 

.36 

.13* 

Interest  in  School- 

work 

.31 

10* 

-.36 

.13* 

Attends  School 

Functions 

.10 

.01 

.27 

.07+ 

Girls’  Reports 

.12 

.04 

Demandingness 

.11 

.01 

.09 

.01 

Responsiveness 

.05 

.00 

.01 

.00 

Values  Achievement 

.33 

.11* 

.15 

.03 

Interest  in  School- 

work 

.16 

.03 

.07 

.00 

Attends  School 

Functions 

.05 

.00 

.01 

.00 

Noic.  +p<IO,  *p<,05.  **p<01;  R = multiple  regression  coefficient;  sr  = semi-partial 
correlation  for  each  predictor 


both  maternal  and  paternal  interest  in  schoolwork  (sr2  = .10  and 
. 1 3,  p < .05,  respectively)  were  negatively  related  to  achievement 
above  and  beyond  the  other  parenting  characteristics.  Maternal 
responsiveness  (sr2  - .07,  p < .10)  and  paternal  attendance 
school  functions (sr^  .07,  p < . 1 0)  had  marginal  unique  relations 
with  achievement  in  boys. 

Discussion 

As  expected,  in  families  of  boys,  adolescents’  reports 
of  both  maternal  and  paternal  demandingness,  responsiveness, 
and  commitment  to  achievement  predicted  a significant  propor- 
tion of  the  variance  in  achievement  (39%  and  42%  for  mothers 
and  fathers,  respectively).  Although  it  has  been  suggested  that 
mothers  have  more  influence  than  fathers  in  children’s  disci- 
pline (Hoffman,  1 974;  Bronfenbretmer&  Crouter,  1982;  Hess  & 
Holloway,  1984),  in  this  study  both  mothers’  and  fathers’ 
parenting  practices  had  important  influences  on  achievement  in 
adolescent  boys.  This  finding  provided  further  evidence  for  the 
argument  that  research  must  explore  both  maternal  and  paternal 
influences  on  adolescent  achievement  outcome. 

The  results  of  this  study  must  be  interpreted  cau- 
tiously because  of  a number  of  limitations,  and  the  study  should 
be  considered  a pilot  study  which  can  provide  a basis  for  future 
research  in  the  area.  The  sample  is  this  study  was  small  and 
somewhat  restricted.  Those  famil  ies  who  agreed  to  complete  the 
parenting  questionnaires  may  very  well  be  biased  towards  those 
with  healthier  styles  of  parenting,  producing  a restricted  range 
on  the  parenting  variables.  Although  there  was  a widc-rangc  of 
socio-economic  status  represented  in  the  sample,  the  small 
- sample  size  precluded  being  able  to  analyze  the  data  separately 


by  SES.  It  is  possible  that  parenting  has  different  relationships 
with  achievement  in  different  family  types.  And  although  the 
sample  was  restricted  to  intact  families,  both  biological  and 
blended  families  participated.  The  parenting  characteristics  of 
these  two  family  structures  may  be  very  different  and  have 
different  relationships  with  achievement.  Finally,  the  proportion 
of  variance  in  achievement  explained  by  parenting  was  expected 
to  be  small  (similar  to  the  results  reported  by  Dornbusch  et  al., 

1 987);  however,  the  sample  size  made  it  difficult  to  detect  small 
relationships  which  may  in  fact  exist.  Regression  results  are 
discussed  in  a tentative  fashion,  with  as  many  questions  being 
raised  as  being  answered. 

In  agreement  with  similar  research  (Dornbusch  et  aiy 
1 987;  Crouter  et  al .,  1 990),  higher  levols  of  parental  control  were 
related  to  higher  levels  of  achievement  in  boys.  Although,  it 
might  be  expected  that  lower  levels  of  demandingness  would 
enhance  the  increased  importance  of  autonomy  in  early  adoles- 
cence (Douvan&  Adelson,  1 966;  Kandel&  Lesser,  1972;Grotevant 
& Cooper,  1985),  these  results,  like  those  of  Crouter  and  her 
colleagues  (1990),  suggest  that  negative  outcomes  in  boys  may 
be  the  result  of  too  much  independence  too  soon.  Contrary  to 
expectations,  however,  paternal  responsiveness  was  negatively 
related  to  achievement  in  boys,  whereas  maternal  responsive- 
ness was  positively  related,  revealing  possible  differences  in  the 
influences  of  mothers’  and  fathers’  parenting. 

As  predicted,  high  levels  of  both  maternal  and  paternal 
commitment  to  achievement  were  significantly  predictive  of 
achievement  outcome  in  boys.  More  specifically,  above  and 
beyond  the  influence  of  parenting  style  (i.e.  regardless  of 
parenting  style),  boys  who  perceived  their  parents  as  having 
higher  achievement  values  had  higher  grades  in  school  than  did 
boys  who  did  not  perceive  high  achievement  values  in  their 
parents.  In  contrast  to  what  developmentalists  have  implied 
(Steinberg  etal.y  1992),  it  appears  that  parental  encouragement 
for  achievement  is  a more  important  dimension  for  adolescents’ 
achievement  outcome  than  parenting  stylealone.  Demandingness 
and  responsiveness  are  obviously  important  parenting  charac- 
teristics and  they  are  likely  to  be  accompanied  by  high  values 
towards  achievement,  but  parents  with  less  than  desirable 
parenting  styles  may  be  effective  in  helping  their  children  achieve 
in  school  by  valuing  and  encouraging  achievement.  Paternal 
interest  in  school  functions  also  contributed  uniquely  to  achieve- 
ment in  boys.  It  may  be  very  important  for  boys  to  see  their 
fathers  interested  in  what  they  do  at  school.  These  findings  were 
consistent  with  those  of  earlier  work  which  examined  the  effects 
of  family  on  achievement  (see  Christenson,  etaiy  1992  and  Hess 
& Holloway,  1 984  for  reviews;  Gottfried  & Gottfried,  1 989;  Linney 
& Vemberg,  1983). 

Contrary  to  expectation,  however,  boys  who  perceived 
their  parents  as  more  interested  in  their  schoolwork  had  lower 
grades  than  did  boys  who  perceived  their  parents  as  less 
interested  in  schoolwork.  In  a review  of  the  literature  on  family 
influences  on  achievement,  Hess  and  Holloway  (1984)  con- 
cluded that  children  whose  parents  help  with  their  homework 
and  take  an  interest  in  their  grades  and  schoolwork  have  higher 
achievement  outcomes  than  do  children  whose  parents  do  not 
show  such  arv  interest  These  findings,  however,  were  most 
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evident  in  studies  with  elementary-school-age  subjects.  By  the 
time  students  reach  high  school,  parents  may  not  take  as  active 
a role  in  their  children’s  schoolwork  unless  there  is  a problem. 
Therefore  ninth  graders  who  do  more  poorly  in  school  may  have 
parents  who  more  closely  monitor  their  work,  hence  the  nega- 
tive relation.  It  is  important  for  educators  to  understand  that 
parents  are  more  likely  to  take  a reactive  approach  to  helping 
their  children  with  homework  when  they  reach  high  school. 
Parents  need  to  be  encouraged  to  take  a more  proactive  ap- 
proach to  monitoring  their  adolescents’  school  performance  in 
order  to  influence  their  achievement  positively. 

No  significant  relationships  were  found  between 
parenting  and  achievement  outcome  in  girls.  A number  of 
explanations  may  be  possible.  During  the  transition  to  adoles- 
cence, increased  parental  control  of  girls  has  been  found  to  be 
evident  as  girls  begin  dating  and  becoming  more  social  (Hill, 

1 980;  Col  lins,  1 990).  Girls  may  react  more  positively  to  moderate 
levels  of  demandingness  than  to  either  very  low  or  very  high 
levels.  It  may  be  possible  that  influences  from  other  develop- 
mental contexts  (peers  and  school)  become  moderating  influ- 
ences to  girls’  achievement  outcomes.  During  adolescence, 
girls’achievement  motives  are  more  likely  than  boys’  to  be 
influenced  by  their  peers  (Bardwick  & Douvan,  1971;  Dweck  & 
Light,  1980). 

It  appears  that,  at  least  for  boys,  some  aspects  of 
parental  involvement  in  education  are  related  to  ninth-graders’ 
achievement  in  ways  beyond  what  is  explainable  by  parenting 
style.  Girls  and  boys  may  experience  these  effects  differently. 
These  issues  are  central  for  both  developmentalists  and  educa- 
tors; therefore,  these  findings  call  for  replication  with  a larger 
and  more  representative  sample.  These  findings  can  be  gener- 
alized only  to  ninth  grade  students;  therefore,  exploration  of  the 
developmental  changes  in  the  importance  of  various  parenting 
practices  would  also  be  an  important  addition  to  this  line  of 
work. 
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Educational  Psychology:  Future  Directions 
An  Interview  with  Anita  Woolfolk 


Mary  R.  Sudzina,  The  University  of  Dayton,  and 
Isadore  Newman,  The  University  of  Akron 


1 ■ Why  doyou  thinkyourtext 

L~wmM  is  the#l  best-selling  educa- 
tional psychology  text?  What  makes 
it  unique? 


There  are  many  answers  to  your  first 
question,  including  luck  and  the  help 
of  committed  people.  I hope  my  book 
strikes  a balance  between  clarity  and 
complexity.  Educational  Psychology 
is  rich  with  ideas,  theories,  principles, 
research  results — but  just  presenting 
this  wealth  of  information  is  not 
enough.  Students  must  understand 
and  value  the  ideas  before  they  can 
apply  them.  I believe  a textbook  is  only 
one  of  many  resources  that  students 
need  to  understand  educational  psy- 
chology, but  a text  can  provide  a frame 
of  support.  The  text  should  be  clear 
and  encourage  students  to  think  be- 
yond the  words  on  the  page.  Some 
texts  don't  stimulate  thinking  beyond 
them  because  students  spend  all  their 
efforts  dealing  with  the  text's  com- 
plexities. 1 am  surprised  when  some 
students  say  to  me  that  mine  is  the  first 
psychology  book  they  really  under- 
stand. It  is  as  if  they  expect  a text  to  be 
difficult  or  confusing.  I have  taught 
educational  psychology  every  semes- 
ter for  almost  25  years  and  I respect  the 
concerns  of  the  students.  I also  teach  a student  teaching 
seminar  and  other  graduate  courses,  so  I see  students  at 
different  periods  of  their  development.  I try  to  incorporate  a 
realistic  understanding  of  the  developing  student/reader  into 
my  writing  and  talk  directly  to  students,  providing  many 
examples  and  illustrations.  I think  the  book  has  done  well  in 
part  because  students  and  professors  find  it  worthwhile — that 
is  always  a challenge  for  a required  course.  Professors 
teaching  educational  psychology  have  to  make  the  case  for 
the  value  of  the  field  and  I am  told  my  book  helps  to  make  the 
case.  Ideas  are  tied  to  action,  to  applications.  In  the  text, 
experienced  teachers  tell  how  they  solve  problems  with  the 
help  of  principles  from  educational  psychology.  Students 
who  use  the  book  see  value  in  studying  these  principles. 


Anita  Woolfolk,  author,  researcher,  and  teacher 
is  a member  of  the  Department  of  Educational 
Psychology,  Graduate  School  of  Education, 
Rutgers  University.  She  is  also  Vice-President  of 
Division  K,  Teaching  and  Teacher  Education,  of 
the  American  Educational  Research  Association. 
Dr.  Woolfolk  is  well  known  as  the  author  of  Edu- 
cational Psychology,  5th  Edition  (Allyn  & Bacon, 
1 993)  and  Research  Perspectives  on  the  Graduate 
Preparation  of  Teachers  (Allyn  & Bacon,  1989). 


If  you  could  teach  only  3 concepts  from 
your  text,  what  would  they  be  and  why 
are  they  important? 

Three  concepts,  that's  tough.  One  no- 
tion I emphasize  is  the  importance  of 
understanding  your  students'  under- 
standing. No  matter  how  you  teach,  no 
matter  what  the  goal,  no  matter  who  the 
students  are,  as  a teacher  you  must  keep 
asking  what  sense  the  students  are 
making.  One  of  the  most  important 
things  a teacher  can  do  is  to  understand 
how  students  think  about  an  idea  or 
subject.  Second,  I often  find  myself 
saying  that  "students  are  just  like 
people."  By  this  I mean  students  don't 
happily  repeat  unpleasant  events,  they 
prefer  work  that  is  real  and  important, 
they  like  to  grow  more  competent,  and 
they  need  to  be  a valued  member  of  a 
group — just  likeallofus— just  likepeople, 
because,  of  course,  they  are.  Third, 
there  is  no  one  best  way  to  teach.  Know 
your  students.  Understand  how  they 
learn.  Try  a range  of  approaches.  Be 
persistent  and  inventive. 


□ 


Howdoes  the  knowledge  of  educa- 
tional psychology  make  a differ- 
ence in  the  preparation  of  preservice  teachers? 

Educational  psychology  asks  critical,  basic  questions  about 
how  people  learn  and  how  to  support  learning,  particularly  in 
classrooms.  Educational  psychology  studies  how  people  (with 
all  their  histories  and  abilities)  learn  something  in  a particular 
physical  and  social  setting.  In  earlier  times  the  focus  was  on  the 
person,  but  today  educational  psychologists  study  the  learn- 
ing of  subjects  and  the  settings  for  learning.  These  understand- 
ings are  fundamental  for  teachers.  Teachers  must  know  their 
students.  They  must  know  how  their  students  make  sense  of 
specific  subjects.  They  must  know  how  situations — including 
other  people — affect  learning. 
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How  would  this  bedifferentiated  at  the  undergraduate  and 
graduate  levels? 

That  depends  on  the  backgrounds  of  the  students.  For 
example,  many  of  my  undergraduate  students  have  had  sev- 
eral courses  in  developmental,  cognitive,  and  clinical  psychol- 
ogy. They  can  handle  psychological  concepts  easily.  But 
they  have  not  taught.  1 spend  time  bringing  the  classroom 
experience  to  them  with  video,  cases,  examples,  samples  of 
kids'  work,  and  field  assignments.  I have  them  read  selected 
research  and  sometimes  require  them  to  conduct  small-scale 
studies.  At  the  Master's  level,  many  of  my  students  have 
taught,  but  their  background  in  psychology  is  limited.  They 
read  several  texts  and  many  studies.  1 help  them  build  an 
understanding  of  psychological  principles  by  analyzing  their 
own  and  each  others'  teaching. 

Ifyou  had  total  control  ofthecurriculum  to  prepare 
preservice  teachers,  how  would  you  redesign  the 
curriculum  to  maximize  the  effectiveness  of  teacher  prepa- 
ration? 

1 doubt  that  there  is  one  best  way  to  prepare  teachers.  But  any 
worthwhile  program  must  solve  several  problems.  First, 
prospective  teachers  must  have  a context  for  learning.  Too 
often  we  expect  the  students  to  build  knowledge  for  answering 
questions  that  they  are  not  yet  asking.  Whether  through  well 
planned  and  supervised  field  experiences,  discussion  of  cases, 
assignments  in  teaching  laboratories,  or  inventive  uses  of 
technology,  prospective  teachers  must  be  surrounded  with 
real  educational  problems  that  can  be  identified,  analyzed,  and 
solved  by  applying  their  growing  understanding  of  the  psy- 
chology, sociology,  methodology,  history,  and  philosophy  of 
teaching.  Second,  we  have  to  solve  the  problem  of  a 
disconnected  curriculum.  Preparing  teachers  is  everyone’s 
responsibility  and  sensible  designs  require  cooperation  among 
faculty,  school  systems,  and  students.  Everyone  who  teaches 
or  supervises  in  a teacher  preparation  program  should  know 
what  is  happing  in  all  the  other  courses  and  experiences.  The 
administrative  structure  should  make  it  simple  for  faculty  and 
local  school  people  to  work  together  and  to  try  new  ap- 
proaches. I just  spent  the  last  two  days  with  a small  group 
of  elementary  and  secondary  teachers  from  around  the  coun- 
try advising  the  Educational  Testing  Service  about  how  to  use 
cases  to  develop  a licensing  examination  for  the  "principles  of 
learning  and  teaching"component  of  the  new  Praxis  II  series. 
I wish  my  students  had  been  in  the  room  to  hear  the  sensitive 
analyses  of  the  cases  we  considered.  1 wish  my  students  could 
have  heard  these  gifted  teachers  talk  about  their  thinking. 
There  should  be  ways  for  the  beginning  teacher  education 
student  to  join  in  those  kinds  of  discussions.  Third,  the 
preparation  of  teachers  should  be  seen  as  ongoing  develop- 
ment, not  as  the  completion  of  requirements.  Any  teacher 
preparation  program  must  support  and  encourage  increasing 


cutonomy.  Becoming  a teacher  should  be  seen  as  a continuing 
process,  not  something  that  magically  occurs  after  all  courses 
are  completed.  This  means  prospective  teachers  need  to 
assume  more  and  more  responsibility  for  real  teaching  over  the 
course  of  their  preparation  as  they  gain  knowledge  and  skill. 

What  is  the  role  of  research  in  teacher  preparation? 

Research  is  process  and  product.  Students  should  learn  about 
the  findings  of  relevant  studies  .because  teaching  is  not 
simple.  "Holding  students  back"  has  effects;  ability  grouping 
has  effects;  different  approaches  to  teaching  reading  support 
different  kinds  of  learning;  certain  signs  suggest  that  a stu- 
dent might  have  learning,  vision,  hearing,  or  emotional  prob- 
lems; stanine  scores  and  percentiles  tell  us  some  things  and 
not  others  about  students'  performances;  there  are  alterna- 
tives to  traditional  testing  and  grading;  there  are  advantages 
and  dangers  in  small  group  learning;  some  explanations  clarify 
and  others  confuse;  certain  ways  of  interacting  with  students 
support  and  others  undermine  motivation;  the  list  goes  on.  As 
a profession,  teaching  has  a vocabulary  and  base  of  special- 
ized knowledge.  Prospective  teachers  should  own  knowl- 
edge, just  as  they  must  know  that  knowledge  is  constantly 
evolving.  Research  is  also  process.  Teachers  must  be 
researchers  as  they  strive  to  understand  their  students  and  the 
effects  of  teaching.  Teachers  are  ethnographers  as  they  enter 
the  world  of  their  students  and  study  life  in  their  classrooms. 
They  are  experimenters  as  they  try  a different  approach  to  the 
unit  on  fractions  and  carefully  note  the  results  in  terms  of  the 
students'  learning,  not  just  the  "feel"of  the  lesson.  Research 
gives  teachers  new  ways  to  think  and  new  ideas  to  think  about. 
Research  should  also  produce  a healthy  skepticism  as  teach- 
ers consider  alternative  explanations  for  why  things  hap- 
pened as  they  did. 

What  is  your  personal  area  of  research  interest? 
Wliatare  its  implications  for  educational  psychol- 
ogy and  teacher  education? 

My  early  work  centered  on  nonverbal  communication  in 
classrooms.  I was  particularly  interested  in  ways  that  teachers 
communicate  attitudes  and  expectations  to  students  and  the 
nonverbal  cues  that  teachers  use  to  form  expectations.  More 
recently,  l have  studied  teachers’  beliefs  about  classroom 
management  and  about  their  own  sense  of  efficacy.  I have 
looked  at  how  feelings  of  efficacy  relate  to  ideas  about 
motivating  and  managing  students  and  how  all  these  beliefs 
change  with  initial  teaching  experience.  With  a colleague  at 
Rutgers,  Carol  Weinstein,  I have  used  multiple  approaches 
including  concept  maps,  surveys,  analysis  of  videotapes,  and 
the  development  of  metaphors  for  management,  to  study  how 
the  experience  of  student  teaching  changes  beliefs  about 
classroom  management’s  role  in  good  teaching.  With  another 
colleague,  Wayne  Hoy,  1 have  studied  how  the  climate  of  the 
school  is  related  to  the  experienced  teacher's  sense  of  efficacy. 


My  work  on  student  teachers'  evolving  beliefs  about  manage- 
ment suggests  that  teacher  preparation  programs  need  to 
acknowledge  prospective  teachers'  struggle  to  develop  per- 
sonal theories  about  management.  We  do  not  listen  to  our 
students  enough  but  rather  give  them  solutions  for  problems 
they  are  not  experiencing.  Many  of  my  students  in  elementary 
certification  programs,  for  example,  feel  conflict  about  the 
desire  to  be  caring  and  the  need  to  control.  Jim  McLaughlin 
identified  this  tension  in  his  research  on  beginning  teachers 
and  I see  it  in  my  students  as  well . This  important  issue  is  never 
directly  addressed  in  most  teacher  preparation  programs,  so 
much  of  what  we  do"cover"  on  classroom  management  seems 
irrelevant  or  off  target. 


My  work  on  school  climate  and  teacher  efficacy  is  at  a very 
early  stage,  but  it  suggests  that  some  cooperation  among 
teacher  and  administrator  preparation  programs  might  be 
useful.  Certain  kinds  of  support  from  administrators  encour- 
age teachers'  sense  of  efficacy.  The  support  that  matters  is  not 
"cheerleading"  or  close  supervision  but  help  in  doing  the  work 
of  teaching — help  in  achieving  the  teachers' goals  of  reaching 
the  students. 


□ Should  there  be  theories  derived  from  a feminist 
perspective  in  educational  psychology  as  have  been 
applied  in  the  areas  of  counseling  theory  and  research? 


Yes.  When  anthropologists  turned  their  attention  to  class- 
rooms, we  learned  about  the  culture  of  the  class  and  how 
participation  is  more  complicated  than  just  raising  your  hand. 
When  sociolinguists  studied  small  groups,  we  had  insights 
about  questions,  explanations,  and  learning.  Different  tools 
allow  the  creation  of  different  understanding.  It  is  important 
to  keep  asking  new  questions  and  to  ask  old  questions  in  new 
ways. 


7 I How  do  you  balance  all  the  different  aspects  of  your 
life  including:  teaching,  writing,  research,  leader- 
ship, family,  and  recreation? 

Balance  is  not  my  strong  suit.  I'm  better  at  intensity  and 
focus.  I learned  when  my  daughter  was  very  young  that  I 
could  not  enjoy  the  luxury  ofempty  time.  I am  usually  doing 
several  things  at  once.  Laundry,  writing,  and  cooking — they 
go  well  together.  I can  get  up  from  the  computer,  dump 
another  load  in  the  washer  while  I mentally  edit  a paragraph, 
then  check  the  soup  and  return  to  the  computer  with  an  idea 
about  how  to  improve  the  paragraph.  When  I jog,  I either 
watch  the  news  while  plodding  on  a tread  mill,  or  run  outside 
with  a friend  so  we  can  catch  up  on  each  other's  lives.  I have 
a portable  computer,  so  every  plane  trip  is  worth  at  least  5 
pages  of  writing.  On  the  way  to  work  I listen  to  tapes  of 
AERA  sessions  I missed  or  treat  myself  to  music.  If  I am 
doing  on.  r one  thing,  lam  falling  behind.  I write  at  home.  1 
am  connect  by  fax  and  modem  to  colleagues  around  the 
country  and  to  the  Rutgers  computer.  When  I go  to  Rutgers, 
I give  my  complete  attention  to  teaching,  students,  and 
department  business.  Because  my  daughter  is  away  at 
college  now,  I have  no  trouble  writing  every  night  or  all  day 
Saturday,  but  I also  take  total  breaks  from  work.  My  style 
is  to  work  intensely  for  a period  of  time,  then  play  for  a few 
days,  then  return  to  the  work.  My  favorite  weekend  trips  are 
to  Washington  DC,  Boston,  Philadelphia,  and  New  York  (in 
that  order).  I like  to  get  to  a beach  once  or  twice  a year  and 
read  novels  all  day.  And  I love  to  dance.  A few  years  ago 
I won  the  twist  contest  at  a New  Year's  Eve  party  (of  course, 
everyone  won  something)  and  I am  planning  to  learn  cajun 
dancing  in  time  for  the  New  Orleans  meeting  of  AERA  next 
April.  Come  to  the  Division  K reception  April  5th  at  7:30  PM 
and  see  if  1 succeeded.  The  reception  will  be  cosponsored 
by  A ACTE,  AFT,  NEA,  and  Allyn  & Bacon — we  hope  to 
have  a great  band! 


□ If  you  had  to  name  the  top  three  issues  that  educa- 
tional psychologists  will  have  to  face  in  the  future, 
what  issues  do  you  think  they  will  be? 


Educational  psychologists  must  be  clear  about  who  we  are 
and  why  we  matter.  In  some  states  we  have  been  told  we  are 
not  needed  in  the  preparation  of  teachers.  We  are  not 
consulted  when  our  own  universities  make  decisions  that 
woulu  benefit  from  our  expertise.  We  must  resist  the  accusa- 
tion that  we  are  irrelevant.  As  the  field  grows,  it  will  have  to 
integrate  knowledge  about  brain  functioning  with  our  under- 
standing of  learning  and  the  design  of  learning  environments. 
This  will  take  quite  a while  and  require  sophisticated  abilities 
to  translate  complex  information  into  understandable  but  not 
oversimplified  implications  for  teaching.  Finally,  we  have  to 
resist  splintering  into  camps  that  spend  most  of  their  energy 
attacking  the  world  views  of  the  other  camps. 


MESSAGE  FROM  PRESIDENT  RICHARD  C.  PUGH 


7Tie  Mid- Western  Educational  Research  Association  ejects  a new  Vice  President  each  year  who  subsequently  becomes 
President-elect,  President,  and  Immediate  Past  President  for  a four-year  commitment  of  service  to  the  Association.  In  alternate 
years  the  Association  elects  a new  Member-at-Large  for  a two-year  term.  Approximately  half  of  the  MWERA  Association 
Council  members  are  elected  each  year  for  a two-year  term.  The  Nomination  Committee  consists  of  the  current  President, 
the  President-elect  and  the  Immediate  Past  President  with  the  President  serving  as  Chair. 

I invite  you  as  a member  to  participate  in  this  important  process  by  recommending  the  nomination  of  individuals  who  you 
consider  qualified  candidates  for  these  positions  for  1995-96.  They  will  be  formally  nominated  during  the  annual  meeting 
that  is  scheduled  for  October  12-15,1 994  and  will  be  voted  on  duringthe  spring  of  1 995.  If  elected,  they  will  officially  assume 
their  roles  at  the  annual  meeting  in  October,  1995. 

For  your  information  in  making  your  recommendations,  the  Association  Bylaws  state  that  only  members  in  good  standing 
may  be  nominated  and  hold  elective  office.  The  duties  of  the  Vice  President  are  numerous,  including  the  very  important 
responsibility  of  serving  as  the  Annual  Conference  Program  Chair  in  the  year  following  election  as  Vice  President.  The 
Member-at-large  duties  include  the  evaluation  ofthe  Annual  Conference  and  serving  as  Chair  of  the  Membership  Committee. 
Association  Council  members  serve  to  review  and  approve  all  Association  policy  and  take  active  roles  in  governance  at  all 
levels. 

Recommendations  for  nominations  should  be  addressed  to  me  at  the  Wendell  W.  Wright  Education  Building,  Indiana 
University,  Bloomington,  IN  47405  or  by  internet  address  PUGH@UCS.Indiana.Edu.  TheNominations  Committee  will  meet 
in  January,  1994,  to  begin  formulating  a slate  for  the  Association  to  consider  at  the  Annual  Meeting  next  October.  Your 
recommendations  would  be  most  helpful  if  they  were  received  prior  to  our  January  meeting. 


MWERA  Membership  Application 

The  Mid-Western  Educational  Research  As- 
sociation (MWERA)  is  a nonprofit  organiza- 
tion of  professional  educational  researcners  pri- 
marily from  states  and  provinces  located  in  the 
midwestem  region  of  the  Un  i States  and 
Canada.  Membership  is  open  to  faculty,  stu- 
dents, and  administrators  from  any  university, 
college,  and  school.  Col  lege  students  engaged  in 
educational  research  are  especially  encouraged  to 
join  as  members.  Also  any  educational  research- 
ers in  business  and  industry,  as  well  as  those  in 
national,  state,  local  and  private  agencies  and 
organizations  are  welcome.  The  Association 
promotes  and  disseminates  educational  research 
through  its  publications,  its  scholarship  pro- 
gram, and  its  Annual  Meeting. 

The  1 994  dues  of  $ 1 0 for  students  and  $ 1 8 for 
professional  membership  include  a subscription 
to  the  Mid-Western  Educational  Researcher  ?n6 
a reduced  registration  fee  for  the  Annual  Meeting. 

Address  membership  correspondence  to:  Charles 
C.  Anderson,  Jr.,  MWERA  Executive  Officer, 

1332  Southwind  Drive,  Northbrook,  II,  60062; 
phone  (708)  564-4796. 
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1993  Convention  Pictures 
Bismarck  Hotel , Chicago 
October  13-16 , 1993 


President  Kenneth 
Kiewra  greets  the  con- 
vention attendees . 


(LtoR):  Barbara  Plake pre- 
sents Isadore  Newman  and 
Gregory  Merchant  with 
certificates  of  appreciation 
for  their  role  as  Editors  of 
Mid-Western  Educational 
Researcher  from  1991 
through  1993. 


(L  to  R):  Jere  Brophy,  Luncheon  Speaker,  chats  with  Thomas 
Andre , Program  Chair.. 


The  General  Business  Meeting  was  held  in  the 
Maximilian  Room. 


r - 
L 


Changes  for  this  Call  for  Proposals: 

* Deadline : Proposals  must  be  received  by  May  1 5 , 1 994 . 

* Subject  Descriptors:  Authors  should  provide  two  descriptive  terms  to  be  used  in  a subject 
index  in  the  program  and  published  abstracts. 

* Sub-division  Chairs:  Sub-division  chairs  have  been  identified  for  Divisions  G and  K.  Please 
send  your  DivisionGandKproposalstothe  appropriate  sub-division. 

* Poster-tables:Analtemativeformatforpresentationwillbepostertables.  This  will  functionas 
a regular  poster  session  (a  poster  highlighting  the  paper  will  be  produced  by  the  presenter), 
however  that  poster  willbe  laid  on  topofthe  table  instead  ofbeingplaced  upright. 

* M WERA  On-line : Acopy  of  this  Call  is  currently  available  and  the  Conference  Program,  and 
theMeeting  Abstracts  will  beavailableuponrequestfiomOOGJMARCHANT@BSUVC.BSU. 
EDU 


GENERAL  INFORMATION 


1 . Proposals  may  be  in  the  form  of  alternative  sessions, 
symposia,  scholarly  papers,  or  poster-tables.  Partici- 
pants are  encouraged  to  develop  proposals  that  best 
communicate  their  research  and  theoretical  ideas  and/or 
provide  for  scholarly  debate  about  research  and  theoreti- 
cal issues.  MWERA  sessions  are  designed  to  promote 
communication  about  education  and  educational  research. 
It  is  contrary  to  MWERA  policy  to  present  previously 
published  papers  or  to  promote  a commercially  available 
product  or  service  (except  for  Exhibits)  that  go  beyond 
the  limits  of  appropriate  scholarly/scientific  communica- 
tion. Indviduals  interested  in  displaying  educationally 
related  productsorseivicesshouldcontactSharon  McNeely, 
P.O.  Box  34421,  Chicago,  IL  60634.  (312)  794-2788. 

2.  Deadline:  Alt  proposals  must  be  received  no  later 
than  May  15,  1994. 

3 . All  proposals  will  be  peer  reviewed. 

4.  Any  educational  researcher,  whether  MWERA  member 
or  not,  may  submit  a proposal.  Non-members  whose 
proposals  are  accepted  must  join  MWERA  upon 
notification  of  an  accepted  proposal. 

5.  MWERA  reserves  the  right  to  reproduce  and  distribute 
summaries  and  abstracts  of  all  accepted  proposals. 

Unless  expressly  prohibited  in  writing  by  the  authors), 
summaries  may  also  be  made  available  to  the  press  or 
other  interested  parties  upon  request.  Such  limited 
distribution  docs  not,  of  course,  preclude  subsequent 
publication  of  a summary  or  complete  paper  by  the 
authors).  Authors  are  encouraged  to  submit  their  papers 
to  ERIC  and  to  consider  publication  in  the  Mid-Western 
Educational  Researcher. 

6.  All  persons  attending  the  Annual  Meeting,  includ- 
ing participants,  are  required  to  register  for  this 
meeting  and  to  be  members  of  MWERA.  All  sessions 
listed  in  the  program  will  be  open  to  anyone  registered 
for  the  meeting.  A fee  will  be  charged  and  enrollment  may 
be  limited  for  workshops.  Materials  for  registering  for  the 
Annual  Meeting  will  be  published  in  the  Mid-Western 
Educational  Researcher  and  available  upon  request. 

7.  Participants  In  paper  sessions,  symposia,  and  alter- 
native session!  must  distribute  complete  papers  or 
handouts  to  attendees  r t their  sessions.  This  handout 


should  include  a complete  a copy  of  the  paper,  or  a summary  of  the 
symposium  talk  or  alternative  presentation,  as  possible. 

8.  Participants  are  responsible  for  submitting  their  written 
paper  or  summary  to  the  Session  Chair  and  Discussant, 
Divisional  Program  Chair  and  Program  Chair  one  month  prior  to 
the  Conference  (Sept.  12,  1994).  Failure  to  do  so  may  lead  to 
eliminatioj.  of  the  paper  from  the  program. 

9.  Some  papers  will  be  accepted  as  poster-tables.  Proposers  will 
have  the  opportunity  to  indicate  a preference  for  a poster-table 
or  traditional  paper  sessions.  For  a poster-table  the  presenter  will 
prepare  a poster  to  lay  on  a table.  The  program  committee 
will  make  the  final  decision  concerning  format  based  upon  the 
nature  of  the  paper,  similar  paper  topics  presented,  and  availability 
of  rooms  and  tables.  Proposers  whose  papers  are  accepted  for  poster- 
tables  will  be  responsible  for  producing  appropriate  poster  materials. 
Poster  should  measure  approximately  3x3  feet. 

10.  Overhead  projectors  will  be  available  in  every  meeting  room 
for  use  by  presenters.  No  other  AV  equipment  will  be 
provided  by  MWERA.  If  special  AV  equipment  is  needed,  partir  i- 
pants  are  responsible  for  providing  such  equipment  at  the  partici- 
pants’ expense. 

1 1 . Submission  of  a proposal  entails  an  ethical  responsibility  on 
the  part  of  the  proposer  to  present  the  paper,  symposium,  or 
alternative  session  if  it  is  accepted.  If  a proposer  becomes  unable 
to  present  an  accepted  proposal,  it  is  the  responsibility  of  the 
proposer  to  arrange  for  some  alternative  means  of  distributing  the 
paper  and  to  notify  the  Program  Chair  in  advance. 


MWERA  STUDENT  RESEARCH 
INCENTIVE  AWARDS 


All  graduate  students  who  author  or  co-author  an  accepted  proposal  will  receive 
a certificate  ofachievemcnt.  Up  to  3 graduate  students  will  be  randomly  selected 
from  the  group  of  graduate  students  who  author  or  co-author  a proposal  to  each 
receive  a Research  Incentive  Award  to  be  presented  during  the  MWERA 
Business  Meeting  on  October  14.  Any  graduate  student  who  has  authored/co- 
authored a research  paper,  is  prc-rcgistcred  for  the  1994  Annual  Meeting,  and 
is  present  at  the  MWERA  Business  Meeting  will  qualify  for  an  award.  The 
Research  Incentive  Award  will  consist  of  a free  membership  in  MWERA  for  the 
coming  year  and  free  registration  at  the  next  annual  meeting. 
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GUIDELINES  FOR 

ALTERNATIVE  SESSION  PROPOSALS 


Alternative  session  proposals  are  designed  to  explore  alternative 
ways  of  presenting  and  communicating  educational  research.  They  are 
limited  only  by  your  creativity  and  the  requirements  to  fit  within  the 
time  restrictions  of  MWERA  sessions  and  to  not  entail  any  additional 
expense  to  MWERA.  As  suggested  by  AERA,  experimental  formats  do 
not  necessarily  have  to  be  radical.  A single  paper  presented  with  several 
discussants  whose  function  it  is  to  lead  small  group  discussions  would  be 
considered  experimental.  A Panel  Discussion  format  in  which  four  or 
five  scholars  each  give  a short  (e.g.  5 minute)  position  statement  on  a 
noteworthy  or  controversial  issue  and  then  a discussion  the  panelists  and 
audience  ensues  would  also  be  considered  experimental.  A debate 
between  proponents  of  alternative  views  on  a controversial  issue  might 
provide  another  example.  A media-driven  session  would  be  another 
example. 

MATERIAL  TO  SUBMIT  WITH  AN 
ALTERNATIVE  SESSION  PROPOSAL 

1 . Alternative  Session  Proposal  Cover  Sheet,  (see  attached). 
Six  copies  with  all  applicable  items  completed. 

2.  Summary.  Six  copies  of  a 2-3  page  single-spaced  summary 
for  use  in  judging  the  merits  of  the  session.  Three  copies 
of  the  summary  should  include  the  name(s)  and  institu- 
tional affiliations  of  the  organizer,  session  chair,  partici- 
pants/authors,  and  discussants  (or  other  individuals  who 
may  participate  in  the  alternative  session).  Three  copies 
should  omit  that  information  unless  the  identity  of  the 
participants  is  a critical  component  in  evaluating  the  value 
of  the  proposal.  Panel  Discussions  and  other  proposals 

in  which  the  names  and  reputations  of  the  participants  are 
part  of  the  value  of  the  proposal  should  include  the  names  on 
all  six  copies.  Proposals  that  use  an  alternative  format  to 
describe  the  results  of  an  empirical  investigation  should  pro- 
vide for  blind  review.  Proposers  should  use  their  best  judg- 
ment in  this  regard.  Describe  the  nature  and  format  of  the 
alternative  session.  If  there  are  invited  participants,  indicate 
who  they  are  and  what  their  roles  and  contributions  will  be. 
Summarize  the  content  to  be  presented  or  discussed  in  the 
session.  Make  clear  the  scientific/scholarly  value  of  the 
session  and  the  theoretical  and  empirical  issues  addressed. 
Make  clear  how  the  session  represents  an  alternative  to 
traditional  paper/poster  and  symposium  sessions.  Examine 
the  guidelines  for  paper  and  symposium  proposals  and 
describe  as  many  of  the  types  of  information  presented  there 
as  are  relevant  and  applicable  to  your  proposal.  Remember 
the  reviewers  must  evaluate  both  the  worth  of  the  content 
and  the  format 

3 . Abstracts.  Six  copies,  as  appropriate,  three  with  the  name(s) 
and  institutional  affiliation(s)  of  the  author(s)/participant(s), 
three  without  the  name(s)  and  institutional  affiliation(s).  A 
150-200  word  narrative  abstract  should  be  prepared  for  pub- 
lication in  the  Annual  Meeting  Abstracts.  The  Abstract 
should  contain,  in  abbreviated  form,  information  listed  in  the 
Summary  guidelines.  Use  clear,  precise  language  and  no 
abbreviations  confusing  to  readers  unfamiliar  with  the  disci- 
pline. An  abstract  longer  than  150  words  will  not  be  published. 
Include  a word  count  at  the  end  of  the  abstract.  On  the  copies 
including  the  name(s)  type  the  following  information 

at  the  top  left  margin  of  the  page:  Title  of  Paper,  Authors), 
Institutional  affiliation(s). 

4 . Envelopes.  Five  stamped  self-addressed  business-size 
envelopes  for  (1)  acknowledgement  of  the  receipt  of  the 
proposal,  (2)  notification  of  the  decision  of  the  program 
committee,  (3)  notification  of  the  scheduled  session  time,  (4) 
a reminder  to  submit  the  paper  to  the  discussant,  session 


chair,  divisional  program  chair,  annual  meeting  program  chair, 
and  (5)  notification  of  receipt  of  the  paper. 

5.  Index  Cards,  (two,  3x5  index  cards).  These  should  contain:  Title 
of  Alternative  Session,  Name  of  Organizer/Proposer,  Institutional 
Affiliation,  Complete  Address  with  ZIP  Code,  Business  Telephone 
Number  with  Area  Code,  Evening  Telephone  Number  with  Area 
Code,  FAX  Telephone  Number,  E-mail  Address. 

6.  List  Three  copies  (8.5x1 1)  of  a list  of  all  author(s)/participant(s), 
including  name(s),  institutional  affiliation(s),  complete  address(es), 
day  and  evening  telephone  number(s),  FAX  number(s).  E-mail 
address(es). 


GUIDELINES  FOR 

PAPER/POSTER-  TABLE  PROPOSALS 


1 . Only  papers  not  previously  presented  or  published  are  eligible. 

2 . . Papers  may  be  given  as  a presentation  to  be  grouped  with  other  papers 

describing  empirical  research  or  as  poster-table  sessions.  The 
proposer  may  indicate  a preference  for  a presentation  or  for  a poster- 
table  session.  The  Program  Committee  reserves  the  right  to  place 
papers  into  either  a poster-table  or  a paper  presentation  session  in 
order  to  best  meet  the  needs  of  the  program. 

3.  The  Program  Committee  will  group  papers  into  sessions  organized 
by  topics  of  interest  to  the  conference.  A discussant  will  be  assigned 
to  comment  on  the  papers  in  most  paper  sessions.  Those  presenters 
assigned  a discussant  are  to  provide  a copy  of  the  paper  to  the 
discussant  one  month  prior  to  the  meeting. 

4.  Generally,  papers  wili  be  allotted  no  more  than  15  minutes  per 
presentation.  It  will  be  the  responsibility  of  the  Session  Chair  to 
consult  with  the  presenters,  allocate  time,  and  ensure  that  the  agreed 
schedule  is  followed.  Poster-table  sessions  will  last  approximately 
50  minutes. 

5.  It  is  the  responsibility  of  the  authors  of  an  accepted  proposal  to 
appear  at  the  Annual  Meeting  to  present  the  paper.  If  unforeseen 
circumstances  arise  that  prevent  an  author  from  presenting  a paper, 
it  is  his/her  responsibility  to  arrange  for  a suitable  substitute  to  make 
the  presentation,  discuss  the  arrangements  with  the  Session  Chair, 
and  inform  the  Divisional  Chair  and  Annual  Meeting  Program  Chair: 
Greg  Marchant,  Educational  Psychology,  Ball  State  University, 
Muncie,  IN  47306-0595;  Phone:  (317)  285-8505;  E-mail: 
0OGJMARCHANT@BSUVC.BSU.EDU 

MATERIALS  TO  SUBMIT  WITH  A 

PAPER/POSTER-TABLE  PROPOSAL 

1 . Proposal  Cover  Sheet  (Six  copies).  Sec  attached  forms. 

2.  Summary  (6  copies  of  a 2-3  page  summary  typed  singie-spaced  on 
8.5  x 11  paper  with  one  inch  margins  in  no  smaller  than  10  point 
type).  Three  copies  of  the  summafy  should  include  the  name(s)  and 
institutional  affiliations  of  the  author(s).  Three  copies  should  omit 
that  information.  It  should  contain  as  many  of  the  following 
sections  as  applicable: 

a.  Title  of  Paper. 

b.  Name  of  Author(s)-(3  copies  only). 

c.  Institutional  Affiliation  of  Author(s)-(3  copies  only). 

d.  Objectives. 

e.  Perspectives(s)  or  theoretical  framework  (brief 
literature  review). 

f.  Methods:  data  source  (subjects),  instruments,  tech- 
niques, procedures.  ■ 

g.  Results,  conclusions,  or  point  of  view, 

h.  Educational/scientific  importance  of  the  study. 

3.  Abstract  (6  copies:  three  with  the  namc(s)  and  institutional 
affiliation(s)  of  the  authors),  three  without  the  name(s)  and 
institutional  affiliaiion(s).)  A 100-150  word  narrative  abstract 
should  be  prepared  for  publication  in  the  Annual  Meeting  Abstracts. 
The  Abstract  should  contain,  in  abbreviated  form,  information  listed 
in  the  Summary  guidelines.  Use  clear,  precise  language  and  no 
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abbreviations  confusing  to  readers  unfamiliar  with  the  disci- 
pline. An  abstract  longer  than  1 50  words  will  not  be  published. 
Include  a word  count  at  the  end  of  the  abstract.  On  the  three 
copies  including  the  name(s)  type  the  following  information 
at  the  top  left  margin  of  the  page:  Title  of  Paper,  Authors), 
Institutional  affiliation(s). 

4.  Envelopes  (5  self-addressed,  stamped,  business-size  enve- 
lopes). These  will  be  used  to  inform  you  of  (1)  the  receipt  of 
the  proposal,  (2)  the  reviewers'  decisions,  (3)  the  scheduled 
session  time,  (4)  a reminder  to  forward  the  paper  to  the  Session 
Chair,  Discussant,  Divisional  Chair,  and  Annual  Meeting  Pro- 
gram Chair,  (5)  the  receipt  of  the  complete  paper. 

5.  Index  Cards  (two,  3x5  index  cards).  These  should  contain: 
Title  of  Paper,  Name  of  Presenting  Author,  Institutional 
Affiliation,  Complete  Address  with  ZIP  Code,  Business  Tele- 
phone Number  with  Area  Code,  Evening  Telephone  Number 
with  Area  Code,  FAX  Telephone  Number,  E-mail  Address 

6.  List.  Three  copies  (8.5x1 1)  of  a list  of  all  authors),  including 
name(s),  institutional  affiliation(s),  complete  address(es),  day 
and  evening  telephone  number(s),  FAX  number(s),  E-mail 
address(es). 


GUIDELINES  FOR  SYMPOSIUM  PROPOSALS 


A symposium  is  intended  to  provide  an  opportunity  for  examination  of 
a specific  problem  or  topic  from  a variety  of  perspectives.  In  addition  to 
allowing  for  informative  discussion,  a symposium  should  provide  for  the 
presentation  of  alternative  solutions  or  interpretations  either  of  a 
common  problem  or  in  relation  to  a complementary  theme.  This  purpose 
is  best  served  when  individuals  with  diverse  or  conflicting  views  are  allowed 
to  interact  on  a topic  of  sufficient  scope  and  importance.  It  should  be  noted 
that  a symposium  should  not  be  merely  a presentation  of  a set  of  related 
papers.  While  such  complementary  papers  are  clearly  worthwhile,  they 
should  be  submined  as  individual  papers  with  an  indication  of  suggested 
grouping  on  the  Cover  Sheet.  Symposia  should  allow  time  for  discussion 
between  the  presenters  and  the  audience.  It  is  recommended  that  there  be 
no  more  than  3-4  presenters  at  a symposium. 

RESPONSIBILITY  OF  ORGANIZERS  OF  SYMPOSIA 

It  is  the  responsibility  of  the  symposium  organizer  to  select  the  topic  and 
to  solicit  speakers  and  discussants.  Organizers  of  symposia  must  have  the 
consent  of  all  participants  before  submitting  the  proposal.  Organizers  not 
wishing  to  chair  the  session  must  invite  chairpersons.  The  organizer  of 
a symposium  is  responsible  for  ascertaining  that  each  person  named  as  a 
participant  will  be  present  at  the  meeting  if  the  session  is  accepted.  Should 
unforeseen  circumstances  prevent  a participant  from  attending,  it  is  the 
responsibility  of  the  organizer  to  find  a suitable  replacement  and  notify 
all  other  participants  in  the  session  as  well  as  the  Divisional  Chair  and 
Annual  Meeting  Program  Chair.  Participants  in  a symposium  must  submit 
a summary  of  their  remarks  to  the  discussant(s),  the  other  participants, 
the  symposium  chair,  and  the  discussant  one  month  prior  to  the  conven- 
tion (Sept.  12, 1994).  Only  the  organizer  will  be  notified  of  the  acceptance 
of  a symposium;  hc/she  is  responsible  for  notifying  the  other  participants 
in  the  Symposium. 

MATERIALS  TO  BE  SUBMITTED  WITH  A SYMPOSIUM 
PROPOSAL 

1 . Symposium  Proposal  Cover  Sheet  (6  copies).  See  form. 

2.  Summary  (6  copies  of  a summary  typed  single  spaced  on 
8.5x1 1 paper  with  one  inch  margins  in  no  smaller  than  10 
point  type).  Include  the  following: 

a.  Title  of  Symposium 

b.  Name  of  Organizer 

c.  Institutional  Affiliation  of  Organizer 

d.  Name  of  Chair 

e.  Institutional  Affiliation  of  Chair 


f.  Names  of  Participants 

g.  Institutional  Affiliation  of  Participants 

h.  Summary  of  Symposium  including:  ( 1 ) Overview. 
A 300  word  overview  of  the  symposium  includ 
ing:  topic,  objectives,  approaches,  planned  for- 
mat, (2)  300  word  summaries  of  each  of  the 
symposium  presenters'  presentations  including 
titles. 

3.  Abstract  6 copies  with  the  name(s)  and  institutional  affilia- 
tion^) of  the  author(s).  A 1 50-200  word  narrative  abstract 
should  be  prepared  for  publication  in  the  Annual  Meeting 
Abstracts.  The  Abstract  should  contain,  in  abbreviated  form, 
information  listed  in  the  Summary  guidelines.  Use  clear,  precise 
language  and  no  abbreviations  confusing  to  readers  unfamiliar 
with  the  discipline.  An  abstract  longer  than  200  words  will  not 
be  published.  Include  a word  count  at  the  end  of  the  abstract. 
Include  the  following  information  typed  at  the  top  left  margin 
of  the  page:  Title  of  Symposium,  Organizer,  Chair,  Presenters, 
Discussants,  Institutional  affiliation(s)  of  each. 

4.  Envelopes  (5  self-addressed,  stamped,  business-size  envelopes). 
These  will  be  used  to  inform  you  of  (1)  the  receipt  of  the 
proposal,  (2)  the  reviewers'  decisions,  (3)  the  scheduled  session 
time,  (4)  a reminder  to  forward  the  Symposium  to  the  Session 
Chair,  Discussant,  Divisional  Chair,  and  Annual  Meeting  Pro- 
gram Chair,  (5)  the  receipt  of  the  complete  Symposium  papers. 

5 . Index  Cards  (two,  3x5  index  cards).  These  should  contain: 
Title  of  Symposium,  Name  of  Organizer,  Institutional  Affili- 
ation, Complete  Address  with  ZIP  Code,  Business  Telephone 
Number  with  Area  Code,  Evening  Telephone  Number  with 
Area  Code,  FAX  Telephone  Number,  E-mail  Address 

6.  List.  Three  copies  (8.5  x 1 1)  of  a list  of  organizer,  chair,  all 
presenters,  including  name(s),  institutional  affiliation(s),  com- 
plete addrcss(es),  day  and  evening  telephone  number(s),  FAX 
number(s),  E-mail  address(es). 


GUIDELINES  FOR 
WORKSHOP  PROPOSALS 


Workshop  topics  should  be  of  interest  and  use  to  a number  of  MWERA 
members.  Presenters  will  receive  an  honorarium  based  on  the  number  of 
participants  attending  the  workshop.  All  persons  listed  as  presenters  are 
required  to  appear  at  the  conference  and  present  the  workshop  at  the 
designated  time.  Most  workshops  will  be  held  on  Wednesday  after- 
noon, October  12,  1994. 

MATERIALS  TO  BE  SUBMITTED  WITH  A WORKSHOP 
PROPOSAL 

1 . Cover  Sheet  (Use  Workshop  Proposal  Cover  Sheet.  See  form .) 
Send  two  copies  with  all  items  complete.  Indicate  “Work 
shop'’  and  the  total  amount  of  time  you  believe  will  be  needed. 
Please  note  that  in  special  circumstances  a workshop  may  be 
allocated  more  than  three  hours. 

2.  Summary  (3  copies  of  a 2-3  page  summary  typed  single-spaced 
on  8.5  x 1 1 paper).  This  will  be  used  to  judge  the  proposal.  The 
summary  should  include  information  such  as  the  following. 

a.  Objectives  (knowledge,  skills  for  participants) 

b.  Suggested  entry-level  skills  for  participants 

c.  Educational  or  scientific  importance  of  the  topic 

d.  Perspectives , orientations,  or  theoretical  frame 
work 

e.  Methods  or  techniques  of  instruction 

f.  Description  of  presenter 's  relevant  experience 

3 . Abstract  (3  copies).  A 1 50-200  word,  narrative  abstract  should 
be  prepared  for  publication  in  the  Annual  Meeting  Abstracts. 
This  should  briefly  describe  the  objectives,  content,  and  meth- 
ods of  the  workshop.  Use  clear,  precise  language  and  no  abbre- 
viations confusing  to  readers  unfamiliar  with  the  discipline.  Ab- 
stracts should  be  typed  single-spaced  on  8 '/a  x 11  paper.  An 
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abstract  longer  than  200  words  will  not  be  published.  For 
all  copies  of  the  abstract,  the  title  of  the  workshop,  the 
presenters),  and  their  institutional  affiliation(s)  should  be 
typed  at  the  top  left  margin,  in  the  format  below: 

Title  of  Workshop  (Caps  and  lower  case) 

PRESENTER(S)  (ALL  CAPS),  Institutional  affiliation  (Caps 
and  lower  case) 

4.  Envelopes  (3  self-addressed,  stamped,  business-size  enve- 
lopes). These  will  be  used  to  inform  you  of  (l)receipt  of  the 
proposal,  (2)  the  reviewers’  decision,  and  (3)  the  scheduled 
session  time. 

5 . Index  Cards  (two,  3x5  index  cards).  These  should  be 
prepared  as  follows: 

Title  of  Workshop 

Name(s)  of  Workshop  presenters  (last  name  first),  identify 
contact  person.  Institutional  affiliations,  Complete  address 
(with  zip  code)  of  contact  person,  Telephone  number  (with 
area  code)  of  contact  person 

Mail  Workshop  Proposals  to  1994  Workshop  Coordinator:  Linda  E. 

Morrow,  Chair,  Department  of  Education,  Muskingum  College,  New 

Concord,  OH  43762;  (614)  292-4094  ext.  469. 

Proposals  must  be  received  by  May  15,  1994, 


WHERE  TO  SUBMIT  PROPOSALS 


Proposals  should  be  submitted  to  the  Division  Program  Chair  listed 
below  whose  division  best  fits  the  content  of  the  proposal.  Proposals 
may  be  submitted  to  only  one  division.  (However,  a proposal  may  be 
submitted  as  a cross-division  alternative  session.  In  that  case,  the 
proposer  must  contact  the  Division  Chairs  of  the  respective  divisions 
and  discuss  the  proposal  with  them  prior  to  submitting  it.  If  the  Division 
Chairs  believe  that  such  a cross-divisional  proposal  is  the  best  way  to 
submit  the  proposal,  it  should  be  submitted  to  both  divisions  with  an 
explanatory  letter.  Such  proposals  will  be  reviewed  by  both  divisions.) 
If  a proposal  u'oes  not  fit  any  of  the  indicated  divisions,  it  should  be  sent 
to  'ue  Annual  Meeting  Program  Chair:  Gregory  J.  M archant,  Educa- 
tional Psychology,  Ball  State  University,  Muncie,  IN  47306-0595. 
Please  contact  the  Program  Chair  prior  to  submission:  telephone  (317) 
285-8505,  E-mail  00GJMARCHANT@BSUVC.BSU.EDU 

Proposals  must  be  received  in  hard  copy  form  by  May  15,  1994. 


DIVISION  C: 

LEARNING  AND  COGNITION 


Theoiy  and  research  on  human  abilities,  learning  styles,  individual  differences, 
problem  solving,  and  other  cognitive  factors 


Jennifer  J.  Fager 

College  of  Education  and  Counseling 

South  Dakota  State  University 

Box  507  Wenona  Hall 

Brookings,  SD  57007-0095 

Phone:  (605)  688-4362 

E-mail:  ED07@SDSUMUS.SDSTATT.EDU 


DIVISION  D: 

MEASUREMENT  AND  RESEARCH  METHODOLOGY 


Measurement,  statistical  methods,  and  research  design  applied  to  educational 
research 


Jeffery  B.  Hecht 
336  Dcgarmo  Hall  - M.C.  5900 
Illinois  State  University 
Normal,  IL  61761-6901 
Phone:  (309)  438-5585 
E-mail:  JBHECHT@1LSTU.EDU 


DIVISION  E: 

COUNSELING,  HUMAN  DEVELOPMENT, 
AND  SPECIAL  EDUCATION 


l 


Special  education,  human  development,  and  the  application  and  improve- 
ment of  counseling  theories,  techniques,  and  training 


Eddie  Glenn 

Department  of  Counsellor  Education 
136  Graduate  Education  Building 
University  of  Arkansas 
Fayetteville,  AR  72701 
Phone:  (501)  575-3509 


DIVISION  A: 
ADMINISTRATION 


Research,  theory,  development,  and  improvement  of  practice  in  the 
organization  and  administration  of  education 


DIVISION  F: 

HISTORY  AND  PHILOSOPHY  OF  EDUCATION 


Findings  and  methodologies  of  historical  research  in  education 


Carol  B.  Furtwengler 
1 15  Hubbard  Hall-Box  142 
Wichita  State  University 
Wichita,  KS  67260-0142 
Phone:  (316)  689-3325 
E-mail:  CFURTWEN@TWSUVM 


DIVISION  B: 
CURRICULUM  STUDIES 


Curriculum  and  instructional  practice,  theory,  and  research 

Linda  S.  Bchar 

2412  Norman  Hall 

Dept,  of  Educational  Leadership 

University  of  Florida 

Gainesville,  FL  32611 

Phone:  (904)  392-2391 

E-mail:  UBEHAR@NERVM.NERDC.UFL.EDU 


Gary  D.  Shank 
EPCSP  Department 
Northern  Illinois  University 
DeKalb,  IL  60115 
Phone:  (815)  753-8448 
E-mail:  P30GDS  1@NIU.BITNET 


DIVISION  G: 

SOCIAL  CONTEXT  OF  EDUCATION 
AND  MOTIVATION 


Sub-Bivision  Gl: 

Practice  and  research  related  to  cultural  and  multicultural  contexts 

Mary  Ann  Flowers 
Curriculum  and  Foundations 
Cleveland  State  University 
Euclid  at  24th  Street 
Cleveland,  OH  44115 
Phone:  (216)  687-4577 
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Sub-Division  G2: 

Theory,  practice,  and  research  on  social,  moral,  affective,  and  moti 
vational  characteristics  and  development 

Linda  D.  Hayes 
Curriculum  and  Foundations 
Cleveland  State  University 
Euclid  at  24th  Street 
Cleveland,  OH  44115 
Phone:  (216)  523-7138 


DIVISION  H: 

SCHOOL  AND  PROGRAM  EVALUATION 


Research  and  evaluation  to  improve  school  practice,  including  program 
planning  and  implementation 


Corenna  C.  Cummings 
EPCSE 

Northern  Illinois  University 
DeKalb,  IL  60115 
Phone:  (815)  753-8423 


DIVISION  I: 

PROFESSIONAL  AND  MEDICAL  EDUCATION 


Educational  practice,  research,  and  evaluation  in  the  professions  (e.g. 
medicine,  nursing,  public  health,  business,  law,  and  engineering) 


Richard  M.  Smith 

University  of  South  Florida 

15426  Plantation  Oaks  Drive,  Apt.  11 

Tampa,  FL  33647 

Phone:  (813)  974-3220 


DIVISION  J:  | 

POSTSECONDARY  EDUCATION  1 

Broad  range  of  issues  related  to  two-year,  four-year,  and  graduate 
education 


Martha  Wilson 
Education  Department 
Renner  Hall  - Room  130 
Capital  University 
Columbus,  OH  43209 
Phone:  (614)  236-6303 


DIVISION  K: 

TEACHING  AND  TEACHER  EDUCATION 


Sub-Division  Kl: 

Research  on  teacher  preparation,  the  teaching  profession,  and 
teacher  development 


Deborah  L.  Baincr 
Ohio  State  University-Mansfield 
1680  University  Drive 
Mansfield,  OH  44906 
Phone:  (419)  755-4287 


Sub-Division  K2: 

Research  on  teaching,  conditions  and  behaviors  of  teaching 

Kim  K.  Metcalf 

Teacher  Education  Laboratory 

W.W.  Wright  Education  Bldg. 

Indiana  University 
Bloomington,  IN  47405-1006 
Phone:  (812)  856-8125 
E-mail:  kmetcalf@iubacs.bitnet  or 
kmetcalf@ucs.indiana.edu 


WORKSHOPS 


Linda  E.  Moitow 
Muskingum  College 
6740  Friendship  Drive 
New  Concord,  OH  43762 
Phone:  (614)  826-8033 


MWERA/TEACHER  LIAISONS 


Sharon  McNeely 
Northeastern  Illinois  University 
P.O.  Box  34421 
Chicago,  IL  60634 
Phone:  (312)  794-2788 


Jay  C.  Adler 
Cary  School  District  26 
405  West  Main  Street 
Cary,  IL  60013 
Phone:  (708).  639-2148 


DEANS’  FORUM  COORDINATORS 


i 


Roy  A.  Weaver 

Office  of  the  Dean 

Teachers  College 

Ball  State  University 

Muncie,  IN  47306 

Phone:  (317)  285-5254 

E-mail:  0ORAWEAVER@BSUVC.BSU.EDU 


Thomas  Andre 
Dept,  of  Psychology 
W.  112  Lagomarcino 
Iowa  State  University 
Ames,  IA  50011-3180 
Phone:  (515)  294-1754 


ASSOCIATE  PROGRAM  CHAIRS 


Carmen  R.  Giebelhaus,  Ohio  State  University 
Adria  Karle-Wciss,  Murray  State  University 
Sharon  McNeely,  Northeastern  Illinois  University 
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ALTERNATIVE  FORMAT,  WORKSHOP,  OR  SYMPOSIUM  PROPOSAL  COVER  SHEET 

1 994  M WERA  Annual  Meeting 


SESSION  TYPE..  TIME  KEQUESTEB 

Alternative  Format  1 hour  1 l/2hour  2 hours 

Symposium  1 hour  1 1/2  hour  2 hours 

Workshop  2 hours  3 hours  4 hours 


Other  (specify) 
Other  (specify) 


Pleas?  panic, r.typg 

Title 


Organizer’s  Name 

LAST  NAME  FIRST  NAME  Ml 


Affiliation  

Complete  address 


Phone  ( ) 


FAX( ). 


E-mail 


Are  you  a member  of  MWERA?  . _Yes  No 

NOTE:  All  presenters  must  be  MWERA  members  and  pay  registration  for  the  Annual  Meeting 

Attach  a separate  sheet  listing  name,  institutional  affiliation,  complete  address,  telephone  number,  and  title  of  presentation 
for  each  participant  Include  and  identify  the  chair,  discussant(s),  and  presenters. 

(Please  type  this  information.) 

One  or  more  of  the  participants  is  a graduate  student. 

Please  clearly  indicate  which  presenters  are  graduate  students. 


1-2  Word  Descriptors  for  Session 


I hereby  certify  that,  if  this  proposal  is  accepted  and  placed  on  the  program,  all  presenters  of  this  proposal  will  register  for  the  Annual 
Meeting,  and  be  responsible  for  its  presentation.  I hereby  declare  that  I have  assurances  from  the  other  participants  that  they  will  register 
and  make  their  respective  presentations. 


SIGNATURE 


DATE 


Be  certain  all  of  the  following  are  enclosed: 

SIX  SETS  OF  MATERIALS,  STAPLED  TOGETHER . EACH  CONTAINING  ONE  OF  EACH  OF  THE  FOLLOWING: 

* Symposium/workshop  proposal  cover  sheet 

* Separate  sheet  listing  all  participants  and  presentations 

* 3-5  page  Summary  of  the  session 

* 150-200  word  Abstract  (to  appear  in  the  Meeting  Abstracts) 

* Self-addressed  stamped  envelope  (5  total) 

* 3 x 5 index  card  (2  total,  see  guidelines) 

THIS  INFORMATION  MUST  BE  RECEIVED  BY  MAY  15, 1994. 
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BEST  COPY  AVAILABLE 


REQUESTED  SESSION  TYPE:  Paper  presentation  Poster-table 


Title 

Presenting  Author 

Affiliation  

Complete  address 


LAST  NAME 


Phone  ( ) 


FAX( ). 


FIRST  NAME 


E-mail 


MI 


Are  you  a member  of  MWERA?  Yes  No 

NOTE:  All  presenters  must  be  MWERA  members  and  pay  registration  for  the  Annual  Meeting 


Attach  a separate  sheet  listing  name,  institutional  affiliation,  complete  address,  telephone  number,  for  each  co-author.  (Please  typ< 
this  information.  ONLY  PRESENTING  AUTHORS  WILL  BE  SCHEDULED  TO  AVOID  CONFLICTS). 

One  or  more  of  the  authors  arc  graduate  students. 

Please  clearly  indicate  which  authors  are  graduate  students  on  an  attached  sheet  (include  paper  title,  name  of  graduat 
student,  and  address). 


1-2  Word  Descriptors  for  Paper 
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Research  Alive: 

Educational  Research  Cun  Inform  Educational  Practice 

Jack  Snowman,  Southern  Illinois  University  at  Carbondale 


livery  fall  and  spring  semester,  I teach  a doctoral  seminar 
on  behavioral  foundations  of  education  that  all  students  in  the 
College  of  Education  are  required  to  take.  The  topic  of  discussion 
for  the  second  week  of  class  is,  “To  what  degree  does  educational 
research  contribute  to  improvements  in  classroom  learning?"  The 
reading  assignment  for  that  week  is  a pair  of  articles  from  volume  65, 
number  7 of  Phi  Delta  Kappan.  The  first  article,  written  by  Elliott 
Eisner,  is  titled,  “Can  Educational  Research  Inform  Educational 
Practice?"  The  second  article,  written  by  Eva  Baker,  is  titled,  “Can 
Educational  Research  Inform  Educational  Practice?  Yes!"  As  you 
can  gather  from  the  titles,  Eisner  was  somewhat  less  sanguine  about 
the  relationship  between  research  and  practice  than  was  Baker. 

In  a nutshell,  Eisner  argued  that  educational  research  does 
not  serve  the  classroom  teacher  at  any  level  of  education  particu- 
larly well  for  at  least  three  reasons:  (a)  Research  is  not  informed  by 
well-developed  theories  of  instruction  that  specify  potential  rela- 
tionships among  such  variables  as  teaching  methods,  subject 
matter,  characteristics  of  teachers,  characteristics  of  students,  and 
the  learning  process.  As  a result,  some  of  the  subtle  but  powerful 
aspects  of  teaching,  such  as  values,  timing,  tempo,  gesture,  expres- 
sion, silence,  and  emphasis  are  overlooked  by  most  researchers,  (b) 
Contemporary  research  studies  are  not  sufficiently  long  to  ad- 
equately study  the  variables  that  are  examined.  After  reviewing  all 
of  the  experimental  studies  that  were  published  in  one  year  in  a 
prominent  educational  journal,  Eisner  calculated  the  median 
treatment  time  at  72  minutes,  (c)  Researchers  are  more  interested  in 
conducting  studies  that  address  theoretical  issues  than  in  studies 
that  address  the  everyday  concerns  of  teachers. 

Baker  responded  that  while  the  problems  cited  by  Eisner 
were  valid  ones,  research  does  inform  educational  practice,  and  has 
done  so  for  some  time.  This  sentiment  has  been  expressed  more 
recently  by  Herbert  Walberg.  Writing  in  volume  7 1 , number  6 of  Phi 
Delta  Kappan , Walberg  cites  several  psychological  elements  of 
instruction  (e.g.,  specific  objectives,  pretests,  graded  homework, 
reinforcement,  teacher  questions)  that  have  been  shown  in  most 
studies  to  have  at  least  moderate  positive  effects  on  achievement. 

Although  I agree  with  the  criticisms  made  by  Eisner,  it 
should  come  as  no  surprise  to  regular  readers  of  this  column  that  I 
agree  even  more  with  the  basic  argument  made  by  Baker  and  by 
Walberg.  Part  of  the  reason  for  my  agreement  with  Baker  and 
Walberg  can  be  seen  in  the  summaries  of  the  following  recently 
published  studies,  each  of  which  suggests  a way  to  improve  student 
performance  in  the  classroom. 

Learning  is  Believing 

Since  learning  typically  begins  (or  doesn’t  begin)  with  the 
altitudes,  beliefs,  and  values  that  students  bring  with  them  to  the 
classroom,  fm  going  to  begin  with  a study  that  has  examined  the 
development  of  high  school  students’  epistemological  beliefs  and 


the  influence  that  those  beliefs  have  on  overall  academic  perfor- 
mance. 

In  1988,  Ron  Schmeck,  my  colleague  from  the  psychol- 
ogy department  at  Southern  Illinois  University,  speculated  about 
the  relationship  between  epistemological  beliefs  and  learning 
strategies  in  a book  edited  by  Claire  Weinstein,  Ernest  Goetz,  and 
Patricia  Alexander.  Because  of  the  basic  nature  of  such  beliefs, 
he  argued  that  even  a small  change  at  this  level  will  have  a 
significant  effect  on  how  students  approach  learning  tasks. 
“What  might  be  the  effect,"  he  asked,  “if  every  learning  strate- 
gies training  program  included  a section  that  addressed  ques- 
tions such  as:  What education?  What  is  learning?  and  What 
is  the  individual  student’s  personal  responsibility  with  regard  to 
these  processes?"  Recent  research  by  Marlene  Schommer  of 
Wichita  State  University  that  appeared  in  volume  85,  number  3 of 
the  Journal  of  Educational  Psychology  indicates  that  under- 
standing the  nature  and  development  of  students’  epistemologi- 
cal beliefs  might  well  provide  an  avenue  for  improving  both  how 
well  students  approach  learning  tasks  and  how  well  they  perform. 

Schommer  administered  an  epistemological  question- 
naire to  1,182  male  and  female  freshmen,  sophomore,  junior,  and 
senior  high  school  students.  Statements  about  knowledge  and 
learning(e.g.,  “Almost  all  the  information  you  can  learn  from  a 
textbook  you  will  get  during  the  first  reading")  were  rated  on  a 
five-point  scale  and  reflected  a continuum  of  beliefs  that  ranged 
from  naive  to  sophisticated.  A factor  analysis  of  the  students’ 
responses  yielded  a four-factor  solution  that  explained  53.3%  of 
the  variance.  Stated  from  the  naive  perspective,  these  factors 
were  labeled  Fixed  Ability  (the  ability  to  learn  is  unchangeable), 
Simple  Knowledge  (knowledge  is  discrete,  unambiguous,  and 
handed  down  by  authority),  Quick  Learning  (Lean  ng  is  quick  or 
not  at  all),  and  Certain  Knowledge  (Whatever  we  have  learned  we 
know  for  certain). 

An  analysis  of  how  males  and  females  responded  to  the 
questionnaire,  and  how  epistemological  beliefs  develop  from  the 
freshman  through  the  senior  year  of  high  school  yielded  two 
statistically  significant  findings. 

First,  girls  were  less  likely  than  boys  to  believe  in  fixed 
ability  or  quick  learning  (which  may  help  explain  the  often  made 
observation  that  adolescent  girls  are  easier  to  raise  than  adoles- 
cent boys).  Second,  juniors  and  seniors  were  less  likely  than 
freshmen  and  sophomores  to  believe  in  simple  knowledge,  quick 
learning,  or  certain  knowledge  (but  note  that  beliefs  about  fixed 
ability  remained  largely  fixed).  As  Schommernotes,  however,  we 
shouldn’t  run  to  the  bank  too  quickly  with  this  second  finding. 
Since  her  study  used  a cross-sectional  design,  there  is  no  way  to 
tell  how  many  students  with  unchangeable,  naive  beliefs  dropped 
out  of  school  at  the  first  opportunity.  A longtitudinal  design  may 
reveal  a different  developmental  pattern.  If  this  turns  out  to  be  the 
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case  at  some  later  date,  I’m  sure  it  won’t  bother  the  readership  of 
the  Researcher  who  recognize  that  there  is  little  about  educational 
and  psychological  knowledge  that  is  certain. 

An  analysis  of  the  relationships  among  epistemological 
beliefs,  intelligence,  and  grade-point  average  (GPA)  found  that 
the  higher  students  scored  on  an  IQ  test  and  the  less  they  believed 
in  quick  learning,  simple  knowledge,  certain  knowledge,  and  fixed 
ability,  the  higher  were  their  GPAs. 

Although  Schommer’s  work  was  not  designed  to  an- 
swer the  question  of  whether  classroom  interventions  can  accel- 
erate the  development  of  epistemological  beliefs,  by  generalizing 
from  research  on  Piagetian  stages  of  cognitive  development  and 
Kohlbergian  stages  of  moral  development,  one  can  assume  that 
the  possibility  exists,  at  least  to  some  degree.  If  you  are  comfort- 
able with  this  assumption,  you  might  find  the  practical  implica- 
tions she  offers  to  be  of  value.  For  example,  teachers  might  want 
to  focus  more  on  helping  students  understand  concepts  and  their 
interrelationships  than  on  learning  isolated  facts  by  rote,  assign 
more  complex  and  time-consuming  tasks,  assign  projects  that 
reveal  why  conclusions  about  some  phenomenon  changed  over 
time,  and  design  test  items  that  allow  for  alternative  acceptable 
responses. 

To  Question,  or  Not  to  Question?  That  is  the 
Question 

Previous  research  on  student-generated  questions  tells 
a good  news-bad  news  story.  On  the  one  hand,  most  studies  show 
thai  students  who  ask  themselves  higher  level  questions  (usually 
defined  as  anything  above  the  Comprehension  level  of  Bloom's 
Taxonomy)  as  they  read  score  higher  on  tests  of  comprehension 
than  do  students  who  generate  lower  level  questions.  On  the 
other  hand,  most  of  the  questions  asked  by  elementary  grade 
students  are  lower  level  in  nature.  Some  likely  reasons  for  this 
deficiency  in  question-asking  are  that  children  are  not  systemati- 
cally taught  how  to  generate  such  questions  as  they  read,  most 
of  the  question-asking  modeled  by  teachers  is  of  the  low  level 
variety,  and  children  do  not  believe  that  it  is  their  place  to  ask 
questions.  Clearly,  then,  educators  need  to  know  how  to  foster 
high  level  question-asking  by  students.  How  one  might  accom- 
plish this  goal  by  using  cooperative  learning  and/or  mastery 
learning  techniques  was  examined  by  Zemira  Mevarech  and  Zi  va 
Susak  of  Bar-Ilan  University,  Israel  in  an  article  published  in 
volume  86,  number  4 of  the  Journal  of  Educational  Research. 

Cooperative  learning  was  chosen  as  one  approach  to  the 
training  of  student  question-asking  because  children  in  peer 
groups  are  more  likely  to  ask  questions  of  peers  than  of  adults,  and 
their  answers  are  likely  to  be  longer  and  more  complex.  Mastery 
learning  was  chosen  as  another  approach  because  its  practice- 
with-feedback  feature  is  known  to  be  a powerful  method  for 
teaching  complex  cognitive  skills. 

Mevarech  and  Susak  randomly  assigned  271  third-  and 
fourth-grade  Israeli  children  to  either  a cooperative  learning  (CL), 
mastery  learning  (ML),  cooperative-mastery  learning  (CML),  or 
control  condition,  and  then  randomly  assigned  teachers  to  con- 
ditions. Over  a two  month  period,  each  group  worked  through  a 
common  six-step  curriculum  unit  that  was  linked  to  the  reading 
text  for  that  grade:  distinguish  between  a question  and  an  answer. 


understand  the  meaning  of  questioning  words  (e.g.,  who,  what, 
where,  when,  why),  classify  questions  according  to  students’ 
suggestions,  distinguish  between  higher  level  and  lower  level 
questions,  generate  questions  and  answer  them,  and  practice 
asking  and  answering  questions.  At  each  step,  students  read  a 
paragraph  from  the  text,  interpreted  it,  and  then  did  seatwork 
activities. 

The  CL  groups  were  composed  of  four  to  six  students 
whose  seatwork  activities  were  specially  designed  booklets  and 
group  games.  For  example,  a “fishing  game”  was  used  to  help 
students  distinguish  between  lower  and  higher  level  questions. 
Each  student  had  to  “fish”  questions  from  a “pool,”  identify  the 
cognitive  level  of  the  questions,  and  answer  the  questions.  CL 
students  often  acknowledged,  recognized,  and  praised  each  other’s 
contributions.  Children  in  the  ML  group  completed  their  seatwork 
activities  individually,  after  which  the  teacher  provided  feedback 
t out  its  quality.  Children  whose  responses  did  not  meet  a preset 
Ci  iterion  were  asked  to  keep  working  at  the  task  until  they  achieved 
the  mastery  level.  Children  in  the  CML  group  worked  in  small, 
heterogeneous  groups  on  the  same  activities  as  did  the  children 
in  theCL  group,  were  given  individual  feedback  by  the  teacher,  and 
were  required  to  work  at  the  task  until  the  mastery  level  was 
attained.  Children  in  the  control  group  learned  the  same  material 
via  direct  instruction.  The  teacher  explained  to  the  whole  class  the 
questioning  skill  in  question,  provided  examples,  asked  the  stu- 
dents to  generate  examples  of  their  own,  and  used  guided  practice 
ofthe  skill. 

After  the  two-month  treatment  period,  children  were 
assessed  for  how  well  they  could  generate  lower  level  and  higher 
level  questions,  how  fluent,  flexible,  and  original  theirthinking  had 
become  (as  measured  by  the  “Improving  a Toy”  subtest  of  the 
Torrance  Tests  of  Creative  Thinking),  and  for  how  much  of  the 
curriculum  they  had  learned  (as  measured  by  a 20-item  multiple- 
choice  test).  Alternate  forms  of  these  same  instruments  were 
administered  prior  to  the  beginning  of  the  experiment. 

Although  the  average  number  of  lower  level  questions 
posed  by  the  students  exceeded  the  average  number  of  higher 
level  questions  by  a wide  margin  ( 1 1 .5  versus  3.4),  the  ML  and  CML 
groups  exhibited  about  a fourfold  increase  in  their  frequency  of 
higher  level  question-asking.  The  CL  group  increased  its  higher 
level  question-asking  by  33%,  while  the  control  group  showed  a 
25%  decrease.  The  ML  and  CML  groups  did  not  differ  from  each 
other  in  frequency  of  higher  level  question-asking,  but  both 
performed  »ignificantly  better  than  the  CL  group  which,  in  turn, 
outperformed  the  control  group.  For  fluency  and  flexibi  I ity,  the  ML 
group  significantly  outscored  the  CML  group,  which  significantly 
outscored  the  CL  group.  The  fluency  and  flexibility  scores  of  the 
CL  group  did  not  differ  from  those  ofthe  control  group . There  were 
no  between-groups  differences  for  originality.  Finally,  there  were 
no  significant  between-groups  differences  for  achievement. 

In  sum,  this  study  demonstrates  that  relatively  young 
children  can  be  taught  to  improve  their  frequency  of  higher  level 
of  question-asking,  and  that  either  a mastery  learning  approach  or 
a combined  cooperative  learning  - mastery  learning  approach  is 
the  method  of  choice.  Furthermore,  the  mastery  approach  to 
question-asking  produced  higher  fluency  and  flexibility  scores 
than  did  any  of  the  other  three  approaches. 
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You  Can  Get  There  From  Here,  But  You  Need  a 
Good  Map 

Research  by  Donald  Dansereau  and  his  associates  at 
Texas  Christian  University  in  the  late  1980s  on  the  effects  of 
knowledge  maps  found  that  they  enhanced  knowledge  acquisi- 
tion and  transfer  for  undergraduates  as  compared  to  learning  from 
standard  text.  Knowledge  maps  are  spatial/visual  arrangements 
of  text  ideas  and  their  interrelationships  that  look  something  like 
flowcharts.  The  ideas  are  paraphrased  and  enclosed  in  a circle  or 
ellipse;  ideas  that  are  related  to  each  other  are  linked  by  lines  or 
arrows  that  indicate  the  type  of  relationship.  For  example,  ideas 
A and  B may  be  linked  by  a line  labeled  with  the  letter  L,  indicating 
that  A leads  to  B. 

The  likely  reason  w’hy  these  knowledge  maps  work  is 
that  they  quickly  help  students  see  the  structure  of  a passage; 
that  is,  how  the  various  concepts  and  facts  that  make  up  a passage 
relate  to  each  other.  But  the  passages  used  in  these  studies  all 
dealt  with  a single  topic.  This  limitation  left  open  the  question  of 
whether  knowledge  maps  would  still  be  effective  aids  to  learning 
when  the  passages  contained  (as  most  texts  do)  different  but 
related  topics.  In  a study  reported  in  volume  6 1 , number  1 of  the 
Journal  of  Experimental  Education , Richard  Hall,  Donald 
Dansereau,  and  Lisa  Skaggs  assessed  how  well  each  of  four 
conditions  (sequential  text,  comparative  text,  sequential  map,  and 
comparative  map)  helped  students  learn  the  information  from  a 
passage  that  contained  two  related  topics. 

In  tne  sequential  text  condition,  the  two  topics  were 
presented  sequentially  (e.g.,  the  sympathetic  and  then  the  para- 
sympathetic divisions  of  the  autonomic  nervous  system).  The 
material  in  the  comparative  text  condition  was  arranged  according 
to  related  features  (e.g.,  the  part  of  the  spinal  cord  from  which 
nerves  exit  for  the  sympathetic  and  parasympathetic  systems).  In 
the  sequential  map  condition,  the  maps  for  the  two  topics  were 
presented  one  after  another.  In  the  comparative  map  condition, 
the  knowledge  maps  for  each  topic  were  displayed  side  by  side. 

In  the  first  of  three  2-hour  sessions,  92  undergraduates 
were  given  a 15-minute  introduction  to  the  nature  and  use  of 
knowledge  maps.  They  were  told  that  they  might  be  assigned  to 
a map  condition,  and  were  shown  how  to  use  these  maps  to  study 
the  sequential  presentation  of  information  from  a single  topic  and 
the  simultaneous  presentation  of  information  from  two  related 
topics.  Students  were  then  assigned  to  one  of  the  four  condi- 
tions. In  each  condition,  students  were  given  material  on  the 
autonomic  nervous  system,  and  told  to  study  it  for  four  minutes. 
They  then  completed  a questionnaire  about  their  attitudes  to- 
ward the  subject,  and  were  required  to  study  the  material  for 
another  45  minutes. 

Two  days  later,  students  completed  a free  recall  test  of 
the  autonomic  nervous  system,  read  a second  passage  on  the 
topics  of  descriptive  versus  experimental  research  designs  for 
four  minutes,  completed  another  questionnaire,  and  then  studied 
the  material  again  for  another  45  minutes. 

The  final  session  occurred  two  days  after  the  second 
one.  Students  completed  a free  recall  test  on  the  research  design 
material  and  vocabulary  test  that  was  used  as  a covariatc. 


The  map  groups  recalled  significantly  more  ideas  than 
the  text  groups  on  the  autonomic  nervous  system  passage.  There 
was  no  significant  difference  among  the  groups  for  recall  of  ideas 
on  the  research  design  passage.  The  questionnaire  data  was 
consistent  with  the  recall  data.  Compared  with  students  in  the  text 
groups,  students  in  the  map  groups  felt  they  learned  more  and 
found  the  material  to  be  more  organized. 

There  is  Strength  in  Numbers  and  (Sometimes)  in 
Diversity 

Cooperative  learning  is  an  instructional  tactic  that  is  in 
the  enviable  (and  somewhat  unusual)  position  of  being  both 
extremely  popular  among  educators  from  kindergarten  through 
college  and  strongly  supported  by  research  findings.  A charac- 
teristic of  cooperative  learning  that  is  presumed  to  contribute  to 
its  effectiveness  is  heterogeneous  groups — groups  that  are  com- 
posed of  students  of  different  abilities,  ethnic  backgrounds, 
social  class,  and  genders.  Lower-ability  students  are  supposed 
to  benefit  from  having  the  higher-ability  students  serve  as  models 
of  good  thinking  and  problem  solving,  as  well  as  from  the  direct 
help  they  get  from  higher-ability  peers.  Higher-ability  students 
are  supposed  to  benefit  from  the  mental  reorganization  that 
occurs  when  they  explain  things  to  their  peers.  But,  as  Simon 
Hooper  of  the  University  of  Minnesota  points  out  in  volume  85, 
number  3 of  the  Journal  of  Educational  Research , research 
findings  on  the  benefits  of  heterogeneous  groups  are  inconclu- 
sive. Hooper  argued  that  this  inconsistency  may  be  due  to 
uncontrolled  differences  in  how  group  members  interact  with  one 
another.  To  test  his  hypothesis,  Hooper  provided  cooperation 
training  to  fifth-  and  sixth-grade  students,  and  examined  how  well 
heterogeneous  groups,  homogeneous  groups,  and  individual 
students  learned  a computer-based  lesson  on  arithmetic  skills. 

The  students  who  participated  in  this  study  were  clas- 
sified as  high  or  average  ability  accordingto  how  well  they  scored 
on  the  mathematics  subscale  of  the  Cal  ifomia  Achievement  Test. 
The  mean  score  for  the  high-ability  students  was  at  the  95th 
percentile.  The  mean  score  for  the  average  ability  students  was 
at  the  64th  percentile. 

The  cooperation  training  that  each  student  received 
was  intended  to  illustrate  the  efficacy  of  group  work  and  to 
promote  effective  intragroup  interaction.  The  first  goal  was 
accomplished  by  having  pairs  of  students  and  individual  stu- 
dents solve  two  tasks  (calculate  the  number  of  sides  of  a three- 
dimensional  figure  and  classify  objects  as  examples  or  non- 
examples of  a concept),  and  by  publicly  comparing  the  perfor- 
mances of  the  pairs  against  those  of  the  individuals.  The  second 
goal  was  accomplished  by  having  groups  of  four  students 
summarize,  paraphrase,  communicate,  and  check  on  the  accuracy 
of  a message  (definitions  of  nonsense  words  and  a story  repre- 
sented by  a sequence  of  pictures).  Students  rotated  through  the 
roles  of  summarizer,  paraphrases  and  checker. 

In  addition  to  providing  the  students  with  cooperation 
training,  observers  were  trained  to  classify  intragroup  communi- 
cation into  one  of  four  categories:  transmission  of  lesson  content 
(e.g.,  reading  material  from  the  computer  screen),  helping  behav- 
ior (e.g.,  explaining  a solution  process,  correcting  errors),  positive 
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social  comments  (e.g.,  statements  of  praise  or  encouragement),  and 
negative  social  comments  (e.g.,  statements  critical  of  the  learning 
task  or  the  partner). 

The  target  of  both  the  cooperation  training  and  the  ob- 
server training  was  a three-part  computer-based  mathematics  tuto- 
rial. In  order  to  progress  to  the  next  unit,  students  had  to  complete 
a mastery  quiz.  Students  worked  through  the  tutorial  either  in  pairs 
or  individually,  and  were  paired  in  one  of  three  ways:  two  high-ability 
students,  two  average-ability  students,  one  high-ability  student  and 
one  average-ability  student.  Measures  were  taken  of  number  of 
mastery  quizzes  attempted,  intragroup  interaction,  and  achieve- 
ment. The  achievement  test  contained  40  items  that  measured  factual 
knowledge,  application,  generalization,  and  problem  solving. 

Having  students  work  through  the  program  in  pairs  proved 
to  be  an  efficient  instructional  tactic  as  paired  students  met  the 
mastery  criterion  for  each  unit  more  quickly  than  did  the  students  who 
worked  alone. 

With  regard  to  intragroup  interaction,  high-ability  stu- 
dents gave  and  received  more  help  when  they  were  paired  with 
another  high-ability  student  than  when  they  were  paired  with  an 
average-ability  student.  The  average-ability  students,  on  the  other 
hand,  did  not  change  their  help  pattern  as  a function  of  group  type. 

Most  research  on  cooperative  learning  finds  that  students 
who  work  in  groups  leam  more  than  students  who  work  alone.  This 
study  simply  adds  one  more  brick  to  that  pile.  Students  who  worked 
in  pairs  obtained  higher  scores  on  the  achievement  posttest  than  did 
students  who  worked  alone.  But  some  of  Hooper's  other  findings 
challenge  some  of  the  standard  beliefs  about  cooperative  learning 
and  should  be  investigated  further  by  others.  Most  notably,  high- 
ability  students  scored  about  the  same  as  average-ability  students 
when  they  were  heterogeneously  paired,  but  scored  significantly 
higher  than  average-ability  students  when  they  were  homoge- 
neously paired.  Finally,  students  who  worked  in  heterogeneous 
pairs  answered  significantly  more  problem-solving  items  correctly 
than  did  students  who  worked  in  homogeneous  pairs. 

Testing,  Testing,  1,  2,  3 (and  4,  5,  6,  & 7) 

In  my  last  Research  Alive  column  (volume  6,  number  3),  I 
summarized  a study  that  reported  a moderately  positive  effect  size 
(about  i/3  of  a standard  deviation)  for  increased  frequency  of 
classroom  testing.  That  is,  students  who  took  more  tests  during  the 
course  of  a term  scored  higher  on  an  end-of-term  examination  then 
did  students  who  took  fewer  tests.  Although  many  other  studies  and 
reviews  have  reported  positive  effects  for  this  instructional  tactic, 
contrary  findings  do  exist.  To  clarify  the  inconsistencies  about  the 
effects  of  more  frequent  versus  less  frequent  testing,  Robert  Bangert- 
Drowns,  James  Kulik,  and  Chen-Lin  Kulik  conducted  a meta-analysis 
of  this  literature  and  reported  their  findings  in  volume  85,  number  2 
of  the  Journal  of  Educational  Research. 

Bangert-Drowns,  Kulik,  and  Kulik  located  40  studies  that 
met  their  criteria  of  relevance  (the  studies  had  to  have  been  done  in 
real  classrooms  and  used  conventional  classroom  tests)  and  metho- 
dological adequacy,  and  reported  three  major  findings. 

First,  the  average  effect  size  of  frequent  testing  was  .23. 
Students  who  were  tested  relatively  more  frequently  scored  .23  of  a 
standard  deviation  higher  on  a final  criterion  test  than  did  students 


who  were  tested  relatively  less  frequently.  In  terms  of  percen- 
tile ranks,  this  translates  to  an  increase  from  the  50th  percentile 
to  the  59th  percentile.  Second,  a moderately  large  effect  size 
(.54)  was  found  when  the  frequently  tested  group  (which, 
depending  on  the  study,  meant  anything  from  1 to  21  tests) 
was  compared  to  a control  group  that  received  no  tests.  When 
the  control  students  took  at  least  one  test,  the  average  effect 
size  dropped  to  .15.  The  third  finding  was  perhaps  the  most 
interesting.  Data  from  eight  studies  that  directly  compared 
three  levels  of  testing  frequency  found  that  as  the  average 
number  of  tests  taken  by  students  increased,  the  average 
effect  size  increased,  but  at  a diminished  rate.  Students  in  the 
intermediate-frequency  conditions  took  an  average  of  seven 
tests  and  scored  r'most  1/4  of  a standard  deviation  higher  on 
an  end-of-term  test  than  did  students  in  the  low-frequency 
conditions,  who  averaged  only  one  test  (average  effect  size 
= .23).  Students  in  the  high-frequency  conditions,  on  the  other 
hand,  took  an  average  of  23  tests  and  scored  almost  1/2  of  a 
standard  deviation  higher  than  did  the  low-frequency  condi- 
tion students  (average  effect  size  = .49).  Thus,  as  Bangert- 
Drowns,  Kulik,  and  Kulik  point  out,  a threefold  increase  in  test 
frequency  (from  seven  to  23  tests)  brings  about  only  a 
doubling  of  effect  size.  This  finding  suggests  that  as  students 
take  more  and  more  tests  over  the  course  of  a term,  they  will 
probably  score  higher  on  a final  exam,  but  the  increases  will 
become  successively  smaller.  An  additional  analysis  seemed 
to  bear  out  this  hypothesis.  Increasing  the  number  of  tests  per 
term  from  zero  to  two  to  four  to  seven  would,  according  to  a 
regression  model  constructed  by  the  authors,  increase  perfor- 
mance on  a final  exam  by  .4 1 standard  deviations,  .49  standard 
deviations,  and  .56  standard  deviations,  respectively.  If  one 
were  to  give  as  many  as  23  tests,  the  predicted  effect  size  would 
be  .74.  These  findings  suggest  that  in  most  classroom  situa- 
tions a teacher  should  give  somewhere  between  one  and 
seven  tests  prior  to  a final  exam. 


Trends  In  Research  On  Teaching 


Dr.  Brophy  delivered  the  luncheon  keynote  address  at  the  annual 
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Distinguished  Professor  and  Co-Director  of  ihe  Institute  for 
Research  on  Teaching  at  Michigan  State  University. 


Jere  Brophy,  Michigan  State  University 


In  this  presentation  I offer  some  reflections  on  the  past  30 
years  or  so  of  research  on  teaching.  Let  me  begin  by  noting  that 
although  1 take  an  interest  in  developing  grounded  theory,  1 
approach  research  on  teaching  primarily  from  a practical  rather  than 
a theoretical  standpoint.  I think  of  myself  as  a functionalist,  working 
inductively  by  first  establishing  empirical  information  about  vari- 
ables and  their  relationships,  and  then  identifying  the  causal 
linkages  that  explain  these  relationships  and  developing  implica- 
tions for  teachers. 

I view  both  teaching  and  research  as  means,  not  ends. 
Teaching  is  action  taken  to  help  students  make  progress  toward 
instructional  goals.  Research  is  action  taken  to  answer  some 
question.  To  evaluate  either  teaching  or  research,  we  need  to 
consider  both  the  importance  of  their  goals  and  the  degree  to  which 
they  get  accomplished.  Good  teaching  is  good  because  it  succeeds 
in  helping  students  attain  worthwhile  learning  goals.  Good  research 
is  good  because  it  succeeds  in  answering  worthwhile  questions. 

Classroom  teaching  is  difficult  to  study  because  it  is 
multifaceted  professional  practice  that  takes  place  in  a complex  and 
evolving  interpersonal  context.  Nevertheless,  research  on  teaching 
has  begun  to  establish  a knowledge  base  capable  of  informing 
teacher  planning  and  decision-making. 


Some  educators  view  this  development  with  suspicion,  believing 
that  attempts  to  apply  an  ostensible  knowledge  base  for  teaching 
will  place  counterproductive  pressures  on  teachers  rather  than 
supporting  their  development  as  professionals.  I have  two  points 
to  make  in  response  to  this  important  concern. 

First,  in  theory,  research-based  information  about  teach- 
ing practices  should  empower  teachers  by  enabling  them  to  act 
confidently  on  the  basis  of  well-established  principles.  An 
analogy  to  the  medical  profession  illustrates  this  point.  As  my 
colleague,  Charles  W.  (Andy)  Anderson  points  out,  if  w'e  had  the 
choice  of  going  to  our  regular  physicians  or  to  reincarnations  of 
historically  prominent  physicians  such  as  Galen  and  Hippocrates, 
we  would  stick  with  our  regular  physicians  because  they  give  us 
access  to  the  vital  medical  knowledge  and  technology  that  have 
been  developed  since  Galen  or  Hippocrates  lived.  Far  from 
oppressing  modern  physicians  or  turning  them  into  deskilled 
technicians,  the  proliferation  ofthe  knowledge  base  that  undergirds 
their  practice  has  had  primarily  empowering  effects.  Modern 
physicians  can  do  many  things  that  were  unknown  to  medical 
pioneers,  and  they  can  use  safe  and  efficient  routines  for  doing 
things  that  formerly  were  chancy  and  dangerous.  These  advances 
have  brought  responsibilities  as  well  (physicians  can  be  sued  for 
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malpractice),  but  their  primary  effects  have  been  to  expand  fhe 
power  of  medical  practice.  Modem  medicine  demands  professional 
judgments  and  offers  opportunities  for  artistry  and  creativity  as 
much  as  it  ever  did,  but  in  addition  to,  rather  than  in  the  absence  of, 
systematic  application  of  scientific  knowledge  and  technical  skill. 
We  can  look  forward  to  similar  developments  in  the  power  of 
educational  practice  as  the  knowledge  base  informing  the  teaching 
profession  expands. 

My  second  point  is  an  important  qualification  on  the  first: 
The  developing  research  base  will  have  these  desirable  effects  only 
to  the  extent  that  it  is  understood  and  interpreted  accurately.  As 
a researcher  who  has  generated  some  of  this  information,  I recog- 
nize that  it  can  be  misinterpreted  and  misused.  Consequently,  along 
with  making  empirical  contributions,  I have  emphasized  writing 
textbooks  and  review  articles  in  which  research  findings  are  sum- 
marized carefully  and  qualified  appropriately.  I will  draw  on  some 
of  these  syntheses  during  this  presentation  to  offer  comments. on 
several  prominent  lines  of  research,  and  then  1 will  highlight  some 
key  findings  from  my  own  recent  work  in  social  studies.  More 
extensive  statements  can  be  found  in  the  sources  listed  in  the 
bibliography. 

Teacher  Expectations 

Until  recently,  most  research  in  education  was  done  by 
people  like  myself  who  got  into  education  accidentally  after  being 
trained  in  psychology,  sociology,  or  anthropology.  When  I first 
began  research  in  classrooms,  I was  not  so  much  an  educational 
researcher  as  a clinical  and  developmental  psychologist  who 
happened  to  be  studying  psychological  questions  in  classrooms. 
I later  evolved  into  an  educational  researcher — a person  who  selects 
questions  to  study  because  they  are  important  to  education  rather 
than  to  some  other  discipline. 


My  earliest  work,  done  in  collaboration  with  Tom 
Good,  Carolyn  Evertson,  and  others,  linked  teacher  expecta- 
tions and  attitudes  to  student  opportunity  to  learn  and  patterns 
of  teacher-student  interaction.  I am  proud  of  those  contribu- 
tions, but  when  I view  them  as  an  educational  researcher,  I find 
it  ironic  that  we  focused  on  those  teacher  expectations  that  have 
the  least  generalized  and  powerful  effects  on  student  learning, 
namely  differential  expectations  for  students  in  the  same  class. 
We  have  since  come  to  appreciate  that,  for  most  teachers,  these 
differential  student  achievement  expectations  are  relatively 
minor  variations  around  more  general  norms  representing  be- 
liefs about  what  can  be  accomplished  by  the  class  as  a whole. 
In  turn,  these  class  or  grade-level  expectations  are  shaped  by  the 
publishers'  instructional  materials  and  by  local,  state,  national, 
and  international  assessment  data,  among  other  influences. 

We  are  still  struggling  to  understand  expectation 
issues,  but  our  purview  has  shifted  from  the  micro  to  the  macro 
level.  Also,  our  terms  of  discourse  have  shifted  from  teacher 
expectations  language  to  language  associated  with  national 
standards  and  goals,  international  test  score  comparisons, 
teachers’  epistemological  beliefs  about  learning,  and  teachers’ 
content  pedagogical  beliefs  about  subject  matter.  I will  return 
to  these  issues  of  expectations  and  standards  later  in  discussing 
recent  research  on  subject  matter  teaching. 

Student  Motivation 

In  studying  motivation  in  education,  I have  tried  to 
highlight  areas  that  I think  need  more  attention  and  to  note  ways 
in  which  general  motivational  principles  need  to  be  qualified  or 
contextualized  for  implementation  in  classrooms.  I have  noted, 
for  example,  that  teacher  praise  is  not  always  experienced,  and 
often  is  not  even  intended  as  reinforcement;  and  I have  devel- 


Table  1.  Guidelines  for  Effective  Praise 

Effective  Praise 

Ineffective  Praise 

l. 

Is  delivered  contingently. 

1. 

Is  delivered  randomly  or  unsystematically. 

2. 

Specifies  the  particulars  of  the  accomplishment. 

2. 

Is  restricted  to  global  positive  reactions. 

3. 

Shows  spontaneity,  variety,  and  other  signs  of  credibility;  suggests 
clear  attention  to  the  student's  accomplishment. 

3. 

Shows  a bland  uniformity  that  suggests  a conditioned  response 
made  with  minimal  attention. 

4. 

Rewards  attainment  of  specified  performance  criteria  (which  can 
include  effort  criteria,  however). 

4. 

Rewards  mere  participation,  without  consideration  of 
performance  processes  or  outcomes. 

5. 

Provides  information  to  students  about  their  competence  or  the 
value  of  their  accomplishments. 

5. 

Provides  no  information  at  all  or  gives  students  information 
about  their  status. 

6. 

Orients  students  toward  better  appreciation  of  their  own  task- 
related  behavior  and  thinking  about  problem  solving. 

6. 

Orients  students  toward  comparing  themselves  with  others  and 
thinking  about  competing. 

7. 

Uses  student's  own  prior  accomplishments  as  the  context  for  des- 
cribing present  accomplishments. 

7. 

Uses  the  accomplishments  of  peers  as  the  context  for  describ- 
ing student's  present  accomplishments. 

8. 

Is  given  in  recognition  of  noteworthy  effort  or  success  at  difficult 
(for  this  student)  tasks. 

8. 

Is  given  without  regard  to  the  effort  expended  or  the  meaning 
of  the  accomplishment. 

9. 

Attributes  success  to  effort  and  ability,  implying  that  similar 
success  can  be  expected  in  the  future. 

9. 

Attributes  success  to  ability  alone  or  to  external  factors,  such  as 
luck  or  (easy)  task  uifficulty. 

10. 

Fosters  endogenous  attributions  (students  believe  that  they  expend 
effort  on  the  tasks  because  they  enjoy  the  task  and/or  want  to 
develop  task-relevant  skills) 

10. 

Fosters  exogenous  attributions  (Students  believe  that  they 
expended  effort  on  the  tasu  for  external  rcasons-to  please 
the  teacher,  win  a competition  or  reward,  etc  ). 

n. 

Focuses  students'  attention  on  their  own  task-relevant  behavior 

11 

Focuses  .students’  attention  on  the  teacher  as  an  external 

12. 

Fosters  appreciation  of,  and  dcsirahle  attributions  about,  task- 

authority  figure  who  is  manipulating  them. 

relevant  behavior  after  the  process  is  completed. 

12. 

Intrudes  into  the  ongoing  process,  distracting  attention  from 
task-relevant  behavior 

Source  Brophy.  J (1981)  Teacher  praise  \ functional  analysts  Review  of  i.Jucouanal  Research,  51,  5-32  Reprinted  with  permission  of  the  American  Educational 
Research  Association 
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oped  research-based  guidelines  for  praising  effectively  (Table 
l ).  Using  the  expectancy-value  model  as  a theoretical  base,  1 
also  have  emphasized  that  we  need  attention  to  the  value 
aspects  of  motivation,  not  just  its  expectancy  aspects.  This 
point  is  summed  up  in  the  title  of  a recent  article:  “I  know  I can 
do  this,  but  where  is  my  motivation?”  To  be  motivated  to  do 
something,  we  need  good  reasons  for  doing  it,  not  just 
confidence  that  we  can  do  it  successfully  if  we  try. 

Researchers  concerned  with  motivation  in  educa- 
tion have  not  paid  enough  attention  to  strategies  for  motivat- 
ing students  to  engage  in  learning  activities  eagerly,  or  at  least 
willingly.  Further,  many  who  have  addressed  this  issue  have 
done  so  by  calling  forteachers  to  emphasize  either  extrinsic  or 
intrinsic  motivation  strategies.  I do  not  believe  that  either  of 
these  two  general  approaches  is  capable  of  stimulating  stu- 
dents’ motivation  to  leam  school  subjects  in  classroom  set- 
tings. Offering  rewards  for  good  performance  can  stimulate 
achievement  striving,  at  least  among  students  who  value  the 
rewards  and  believe  that  they  can  reach  the  necessary  perfor- 
mance levels  if  they  put  forth  reasonable  effort.  However, 
extrinsic  rewards  appear  to  be  more  effective  for  stimulating 
brute-force  learning  efforts  (rote  learning,  skills  practice)  than 
for  stimulating  the  more  reflective  cognitive  and  metacognitive 
processes  that  yield  understanding,  appreciation,  and  the 
disposition  to  apply  subject-matter  content. 

Intrinsic  motivation  approaches,  with  their  emphasis 
on  student  choice  and  enjoyment,  seem  more  promising,  at 
least  at  first.  However,  the  potential  for  using  intrinsic 
motivation  strategies  in  the  classroom  is  quite  limited.  School 
is  not  a day  camp  where  we  send  children  to  pursue  recre- 
ational activities  of  their  own  choosing  in  whatever  fashion 
suits  them.  Instead,  it  is  a place  that  we  send  them  to  master 
a curriculum  designed  to  prepare  them  for  adult  roles  in  our 
society.  Most  of  their  time  is  spent  in  activities  that  they  would 
not  choose  to  engage  in  on  their  own.  Furthermore,  their 
participation  in  these  activities  requires  concentration  and 
effort,  and  it  results  in  teacher  evaluation  and  report-card 
grades. 

I believe  that  as  educational  researchers  we  need  to 
accept  these  realities  as  boundary  conditions  and  frame  our 
efforts  to  develop  motivational  strategies  within  them,  rather 
than  try  ing  to  ignore  or  dream  them  away  with  Utopian  visions 
of  schooling.  We  can  begin  by  reducing  emphasis  on  strat- 
egies for  controlling  behavioi  through  extrinsic  rewards  or 
capitalizing  on  intrinsic  motivation  by  trying  to  make  learning 
fun.  Instead,  we  can  begin  to  emphasize  strategies  for  moti- 
vating students  to  leam  by  engaging  their  interest  and  devel- 
oping their  appreciation  for  the  value  of  accomplishing  learn- 
ing goals.  These  strategies  imply  that  learning  should  be 
worthwhile,  meaningful,  and  goal-oriented,  but  not  fun  in  the 
usual  sense  of  the  word  (see  Section  E of  Table  2). 

I view  the  readiness  to  engage  in  academic  activities 
with  motivation  to  learn  as  a schema — a network  of  connected 
insights,  skills,  values,  and  dispositions  that  enable  students 
understand  what  it  means  to  engage  in  academic  activities 
with  the  intention  of  accomplishing  their  learning  goals  and 


Table  2.  Essential  Preconditions  for  Motivating  Students  and 

Form  Sets  of  Motivational  Strategies 

A. 

Essential  Preconditions 

l. 

Supportive  environment 

2. 

Appropriate  level  of  challenge/difficulty 

3. 

Meaningful  learning  objectives 

4. 

Moderation/optimal  use  of  strategies 

B. 

Motivating  by  Maintaining  Success  Expectations 

5. 

Program  for  success 

6. 

Teach  goal  setting,  performance  appraisal,  and  self-reinfor- 
cement 

7. 

Provide  remedial  socialization  foi  discouraged  students 

a.  Portray  effort  as  investment  rather  than  risk 

b.  Portray  skill  development  as  incremental  and 
domain  specific 

c.  Focus  on  mastery 

d.  Provide  attribution  retraining 
c.  Miminize  test  anxiety 

C. 

Motivating  by  Supplying  Extrinsic  Incentives 

8. 

Offer  rewards  as  incentives  for  good  (or  improved)  per- 
formance 

9. 

Structure  appropriate  competition 

10. 

Call  attention  to  the  instrumental  value  of  academic 
activities 

D. 

Motivating  by  Capitalizing  on  Students'  Existing  Instrinsic  Motivation 

11. 

Adapt  tasks  to  students'  interests 

a.  Incorporate  content  that  students  find  interest- 
ing or  activities  that  they  find  enjoyable 

b.  Offer  choices  of  alternative  tasks  or  opprtunities 

to  exercise  autonomy  in  selecting  among  alterna- 
tive ways  to  meet  requirements 

c.  Encourage  student  comments  and  questions 

d.  Include  divergent  questions  and  oppportunities  for 

students  to  express  opinions  or  make  other  res- 
ponses to  the  content 

12. 

Plan  for  novelty  and  variety 

13. 

Provide  opportunities  to  respond  actively 

14. 

Provide  immediate  feedback  to  student  responses 

15. 

Allow  students  to  create  finished  products 

16. 

Incorporate  "fun  features"  into  academic  activities 

a.  Fantasy  or  imagination  elements 

b.  Simulation  exercises 

c.  Gamelike  features 

d.  Peer  interaction  opportunities 

E. 

Strategies 

for  Stimulating  Student  Motivation  to  Leam 

17. 

Model  intcresi  in  learning  and  motivation  to  leam 

18. 

Communicate  desirable  expectations  and  attributions 
about  students'  motivation  to  leam 

19. 

Minimize  students'  performance  anxiety  during  learning 
activities 

20. 

Project  intensity 

21. 

Project  enthusiasm 

22. 

Induce  task  interest  or  appreciation 

23. 

Induce  curiosity  or  suspense 

24. 

Induce  dissonance  or  cognitive  conflict 

25. 

Make  abstract  content  more  personal,  concrete,  or 
familiar 

26. 

Induce  students  to  generate  their  own  motivation  to  leam 

27. 

State  learning  objectives  and  provide  advance  organizers 

28. 

Model  task-related  thinking  and  problem  solving 

Source.  Reprinted  with  permssion  from  Brophy,  J (1987)  Synthesis  of  Research  or 
Strategics  for  Motivating  Students  to  Leam  Educational  Leadership,  45(2).  40-48 
Copyright  by  ASCD 
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with  metacognitive  awareness  of  the  strategies  used  in  attempting 
to  do  so.  The  total  schema  cannot  be  taught  directly,  although 
some  of  its  conceptual  and  skills  components  can.  In  addition,  its 
value  and  dispositional  components  can  be  stimulated  and  rein- 
forced through  teacher  modeling,  communication  of  expectations, 
and  socialization  of  students  into  a cohesive  learning  community. 
My  writings  on  strategies  for  motivating  students  to  learn  reflect 
this  orientation. 

Classroom  Management 

Classroom  management  is  one  of  the  most  successfully 
researched  aspects  of  teaching.  Investigators  using  a variety  of 
methods  in  different  parts  of  the  country  all  have  found  that 
teachers  who  approach  management  as  a process  of  establishing 
an  effective  learning  environment  tend  to  be  more  successful  than 
teachers  who  emphasize  their  roles  as  disciplinarians.  Successful 
managers  are  clear  and  consistent  in  articulating  their  expecta- 
tions. They  model  or  provide  direct  instruction  in  desired  proce- 
dures if  necessary,  and  they  provide  cues  and  reminders  when 
these  procedures  are  needed.  They  keep  students  engaged  in 
worthwhile  lessons  and  activities;  they  monitor  the  classroom 
continually  and  respond  to  emerging  problems  before  they  be- 
come disruptive;  and  when  possible  they  intervene  in  ways  that 
do  not  disrupt  lesson  momentum  or  distract  students  who  are 
working  on  assignments.  Their  classroom  management  activities 
support  their  instructional  systems. 

These  principles  that  emerged  from  1970s  and  1980s 
research  seem  just  as  applicable  to  currently  emphasized  social 
constructivist  approaches  to  teaching  as  they  are  to  earlier- 
emphasized  transmission  approaches,  but  the  particulars  of  imple- 
mentation need  to  be  adjusted.  Students  of  constructivist  teach- 
ers will  need  direction  and  assistance  concerning  their  participa- 
tion in  active  discussion,  not  just  recitation,  and  also  their  partici- 
pation in  collaborative  learning  in  pairs  and  small  groups,  not  just 
working  alone  on  seatwork  assignments. 

In  summary,  I think  that  the  basic  principles  of  good 
management  are  now  well  understood  and  empirically  validated, 
although  thoughtful  analysis  will  be  needed  to  determine  how  to 
apply  them  to  emerging  instructional  innovations.  This  can  be 
done  by  determining  what  students  will  need  to  do  in  order  to 
engage  optimally  in  an  innovative  learning  format,  then  working 
backwards  from  this  goal  to  determine  what  forms  of  managerial 
instruction  or  assistance  may  be  needed. 

Process-Outcome  Research 

A productive  approach  that  became  prominent  in  the 
1970s  was  research  designed  to  identify  relationships  between 
classroom  processes  and  student  outcomes.  Two  forms  of  pro- 
cess-outcome research  were  school  effects  research  and  teacher 
effects  research.  School  effects  research  identified  characteristics 
observed  consistently  in  schools  that  elicit  good  achievement 
gains,  notably  strong  academic  leadership,  a safe  and  orderly 
school  climate,  positive  teacher  attitudes  toward  students  and 
expectations  regarding  their  abilities  to  master  the  curriculum, 
careful  monitoring  of  progress  through  student  testing  and  staff 
evaluation  programs,  and  strong  parent  involvement  programs. 

Teacher  effects  research  identified  teacher  behaviors 


and  teacher-student  interaction  patterns  associated  with  stu- 
dent achievement  gains.  Along  with  a great  many  more  speci  fic 
elaborations,  this  research  firmly  established  three  major  conclu- 
sions about  teacher  effects  on  student  achievement. 

1 . Teachers  make  a difference.  Some  teachers  reliably 
elicit  greater  gains  than  others,  because  of  differences  in  how 
they  teach. 

2.  Differences  in  achievement  gains  occur  in  part 
because  of  differences  in  exposure  to  academic  content  and 
opportunity  to  learn.  Teachers  who  elicit  greater  gains:  (1) 
emphasize  developing  mastery  of  the  curriculum  in  establishing 
expectations  for  students  and  defining  their  own  roles  as  teach- 
ers; (2)  allocate  most  of  the  available  time  for  activities  designed 
to  foster  such  mastery;  and  (3)  are  effective  managers  who  keep 
their  students  engaged  in  ongoing  academic  activities. 

3.  Teachers  who  elicit  greater  achievement  gains  do 
not  merely  maximize  " time  on  task;  ” in  addition , they  spend  a 
great  deal  of  time  actively  instructing  their  students. They 
spend  more  time  in  interactive  lessons  and  less  time  in  indepen- 
dent seatwork.  Rather  than  depend  solely  on  curriculum  mate- 
rials as  content  sources,  they  interpret  and  elaborate  the  content 
for  their  students,  stimulate  them  to  react  to  it  during  recitation 
and  discussion  activities,  and  circulate  during  seatwork  times  to 
monitor  progress  and  provide  assistance  when  needed.  They  are 
active  instructors,  although  most  of  their  instruction  occurs 
during  interactive  discourse  with  students  rather  than  during 
extended  lecture  presentations. 

The  process-outcome  research  of  the  1 970s  was  impor- 
tant because  it  contributed  the  findings  just  summarized  and 
because  it  began  to  provide  education  with  a knowledge  base 
capable  of  moving  the  field  beyond  testimonials  and  unsup- 
ported claims  toward  scientific  statements  based  on  credible 
data.  However,  this  research  was  limited  in  certain  respects.  First, 
it  focused  on  important  but  very  basic  aspects  of  teaching.  These 
aspects  differentiate  the  least  effective  teachers  from  other 
teachers,  but  they  do  not  include  the  more  subtle  and  finer  points 
that  distinguish  the  most  outstanding  teachers.  Also,  most  of 
this  research  relied  on  standardized  tests  as  the  outcome  mea- 
sure, which  meant  that  it  assessed  mastery  of  relatively  isolated 
knowledge  items  and  skill  components,  but  not  the  degree  to 
which  students  had  developed  understanding  of  networks  of 
knowledge  that  they  could  use  in  authentic  applications. 

Research  on  Teaching  for  Understanding  and  Use 
of  Knowledge 

During  the  1 980s  a newer  kind  of  research  emerged  that 
emphasized  teaching  subject  matter  for  understanding  and  use 
of  knowledge.  This  research  focuses  on  particular  curriculum 
units  or  even  individual  lessons,  taking  into  account  the  instruc- 
tional goals  and  assessing  learning  accordingly.  The  research- 
ers establish  what  the  teacher  is  trying  to  accomplish,  record 
detailed  information  about  classroom  processes  as  they  unfold 
during  the  lesson  or  unit,  and  then  assess  learning  using  evalu- 
ation measures  keyed  to  the  instructional  goals.  Often  these 
include  detailed  interviews  or  portfolio  assessments,  not  just 
conventional  short-answer  tests. 

This  research  has  reinforced  and  elaborated  on  find- 
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ings  indicating  that  teachers  play  a vital  role  in  stimulating  student 
learning,  but  it  also  has  focused  on  the  role  of  the  student.  It 
recognizes  that  students  do  not  merely  receive  or  copy  input  from 
teachers.  Instead,  they  actively  mediate  it  by  trying  to  make  sense 
of  it  and  relate  it  to  what  they  already  know  (or  think  they  know)  about 
the  topic.  Thus,  students  develop  new  knowledge  through  a process 
of  active  construction.  To  get  beyond  rote  memorizing  and  achieve 
true  understanding,  they  need  to  develop  and  integrate  a network  of 
associations  linking  new  input  to  pre-existing  knowledge  anchored 
in  concrete  experience.  This  means  that  teaching  involves  inducing 
conceptual  change  in  students,  not  infusing  knowledge  into  a 
vacuum.  When  students’  preexisting  beliefs  about  a topic  are 
accurate,  they  facilitate  learning  and  provide  a natural  starting  place 
for  teaching.  If  the  students  also  harbor  misconceptions,  however, 
these  misconceptions  will  need  to  be  corrected  so  that  they  do  not 
persist  and  distort  the  new  learning. 

To  the  extent  that  new  learning  is  complex,  the  construction 
of meaning  required  to  develop  clear  understandingofit  will  take  time 
and  will  be  facilitated  by  interactive  discourse.  Clear  explanations 
and  modeling  from  the  teacher  are  important,  but  so  are  opportunities 
to  answer  questions  about  the  content,  discuss  or  debate  its  mean- 
ings and  implications,  or  apply  it  in  authentic  problem-solving  or 
decision-making  contexts.  These  activities' allow  students  to  pro- 
cess the  content  actively  and  “make  it  their  own”  by  paraphrasing 
it  into  their  own  words,  exploring  its  relationships  to  other  knowledge 
and  to  past  experience,  appreciating  the  insights  it  provides,  or 
identifying  its  implications  for  personal  decision-making  or  action. 
Increasingly,  research  is  pointing  to  thoughtful  discussion,  and  not 
just  teacher  lecturing  or  student  recitation,  as  characteristic  of  the 
classroom  discourse  involved  in  teaching  for  understanding. 

Researchers  have  also  begun  to  stress  the  complementary 
changes  in  teacher  and  student  roles  that  should  occur  as  learning 
progresses.  Early  in  the  process,  the  teacher  assumes  most  of  the 
responsibility  for  structuring  and  managing  learning  activities  and 
provides  students  with  a great  deal  of  information,  explanation, 
modeling,  and  cueing.  As  students  develop  expertise,  however,  they 
can  begin  regulating  their  own  learning  by  asking  questions  and  by 
working  on  increasingly  complex  applications  with  increasing  de- 
grees of  autonomy.  The  teacher  still  provides  task  simplification, 
coaching,  and  other  “scaffolding”  needed  to  assist  students  with 
challenges  that  they  are  not  yet  ready  to  handle  on  their  own,  but  this 
assistance  is  gradually  reduced  in  response  to  gradual  increases  in 
student  readiness  for  independent  and  self-regulated  learning. 

Research  on  teaching  school  subjects  for  understanding 
and  use  of  knowledge  is  still  in  its  infancy,  but  it  already  has  produced 
successful  experimental  programs  in  most  subjects.  Even  more 
encouraging,  analyses  of  these  programs  have  identified  a set  of 
principles  and  practices  that  are  common  to  most  if  not  all  of  them. 
These  common  elements,  which  might  be  considered  components  in 
a model  of  good  subject-matter  teaching,  include  the  following: 

1.  The  curriculum  is  designed  to  equip  students  with 
knowledge,  skills,  values,  and  dispositions  that 
they  will  find  useful  both  inside  and  outside  of 
school. 

2.  Instructional  goals  emphasize  developing  stu- 
dent expertise  within  an  application  context 
and  with  emphasis  on  conceptual  under 


standing  of  knowledge  and  self- regulated 
application  of  skills. 

3.  The  curriculum  balances  breadth  with  depth 
by  addressing  limited  content  but  develop- 
ing this  content  sufficiently  to  foster  con- 
ceptual understanding. 

4.  The  content  is  organized  around  a limited  set 
of  powerful  ideas  (basic  understandings  and 
principles). 

5.  The  teacher’s  role  is  not  just  to  present 
information  but  also  to  scaffold  and  respond 
to  students'  learning  efforts. 

6.  The  students’  role  is  not  just  to  absorb  or 
copy  input  but  also  to  actively  make  sense 
and  construct  meaning. 

7.  Students’  prior  knowledge  about  the  topic  is 
elicited  and  used  as  a starting  place  for 
instruction,  which  builds  on  accurate  prior 
knowledge  and  stimulates  conceptual  change 
if  necessary. 

8.  Activities  and  assignments  feature  tasks 
that  call  for  problem  solving  orcritical  think- 
ing, not  just  memory  or  reproduction. 

9.  Higher  order  thinking  skills  are  not  taught  as 
a separate  skills  curriculum.  Instead,  they  are 
developed  in  the  process  of  teaching  sub- 
ject-matter knov/1  edge  with  in  application  con- 
texts that  call  for  students  to  relate  what  they 
are  learning  to  their  1 ives  outside  of  school  by 
thinking  critically  or  creatively  about  it  or  by 
using  it  to  solve  problems  or  make  decisions. 

10.  The  teacher  creates  a social  environment  in 
the  classroom  that  could  be  described  as  a 
learning  community  featuring  discourse  or 
dialogue  designed  to  promote  understand- 
ing. 

Qualifications  on  Recent  Findings 

It  is  gratifying  to  see  a convergence  of  findings  that  fit 
well  with  one  another  and  replicate  across  grade  levels  and 
subject  areas.  This  bodes  well  for  the  prospects  of  developing 
an  empirically  grounded  theory  of  classroom  teaching  to  serve 
as  a basis  for  teacher  education.  However,  enthusiasm  for  these 
recent  findings  needs  to  be  tempered  by  some  important  cau- 
tions and  qualifications. 

First,  the  research  base  supporting  these  ideas  is  still 
quite  thin,  especially  if  you  look  for  studies  that  include  both 
comparison  groups  and  systematic  measurement  of  student 
outcomes.  Several  studies  in  mathematics  have  shown  that 
treatments  based  on  these  principles  increased  students'  at- 
tainment of  higher-order  outcomes  without  reducing  their  per- 
formance on  lower-order  outcomes,  compared  to  students 
taught  more  traditionally.  Also,  some  work  in  language  arts  and 
science  has  shown  that  experimental  programs  increased  attain- 
ment of  the  program’s  primary  goals,  although  these  studies 
usually  did  not  contain  comparison  groups  or  attempts  to 
assess  the  tradc-olTs  involved  in  replacing  the  earlier  program 
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with  the  newer  one.  Some  of  the  best  known  and  most  widely 
respected  innovations,  such  as  the  KJEEP  program  and  recip- 
rocal teaching,  have  produced  mixed  rather  than  uniformly 
positive  results.  Others,  such  as  Magdalene  Lampert's  work 
in  mathematics,  have  yet  to  produce  any  systematic  evidence 
of  effects  on  student  outcomes. 

I would  be  less  concerned  about  this  paucity  of 
attention  to  student  outcomes  if  I thought  it  was  just  a 
temporary  problem  soon  to  be  eliminated  through  an  abun- 
dance of  data.  Unfortunately,  I see  little  evidence  of  this  except 
among  some  of  those  concerned  with  program  evaluation, 
teacher  or  school  effects,  or  teaching  school  subjects  for 
understanding  and  use  of  knowledge.  Worse,  I find  that  the 
current  Zeitgeist  in  education  features  unscientific,  and  occa- 
sionally antiscientific,  attitudes.  Too  often,  the  effectiveness 
of  advocated  practices  is  merely  assumed  rather  than  sup- 
ported with  empirical  evidence.  Some  reform  advocates,  most 
notably  several  leaders  in  the  whole-language  movement, 
disavow  any  responsibility  for  systematically  testing  their 
ideas  before  foisting  them  on  other  people’s  children.  \ 
consider  this  attitude  to  be  not  merely  unprofessional  but 
immoral.  Other  advocates,  especially  some  of  the  self-identi- 
fied social  constructivists,  seem  to  think  that  their  ideas  can  be 
validated  merely  by  showing  them  to  be  consistent  with  the 
theorizing  of  John  Dewey  or  Lev  Vygotsky.  I share  their 
respect  for  Dewey  and  Vygotsky’s  theoretical  contributions, 
but  I also  point  out  that  both  of  these  theorists  have  been  dead 
for  more  than  40  years  and  neither  engaged  in  systematic 
testing  of  educational  programs. 

Whole-language  and  social  constructivism  are  just 
two  innovations  currently  being  advocated  on  the  basis  of 
strong  theoretical  commitments  without  much  evidence  of 
acceptance  of  responsibility  to  test  these  ideas  scientifically. 
Similaradvocacy  isseenforeliminatingtracking  and  grouping, 
breaking  down  subject-matter  barriers  in  order  to  integrate  the 
curriculum,  school  voucher  plans  and  other  proposals  for 
wholesale  changes  in  school  organization  and  funding,  the 
Holmes  group  approach  and  other  proposals  for  wholesale 
changes  in  teacher  education,  and  various  schemes  for  teach- 
ing generic  thinking  skills,  developing  multiple  intelligences, 
or  matching  students’  learning  styles.  These  and  other 
z*  :tgeist  ideas  need  to  be  assessed  scientifically,  with  empha- 
sis on  clarifying  their  underlying  theories  and  generating 
appropriate  empirical  data  to  assess  the  trade-offs  involved  in 
adopting  them. 

Research  on  teaching  school  subjects  for  under- 
standing and  use  of  knowledge  suggests  several  such  trade- 
offs. One  is  the  depth  versus  breadth  dilemma.  For  some  time 
now,  American  curriculum  guides  have  been  expanding  to 
accommodate  more  and  more  topics  and  skills.  Textbooks 
have  expanded  too,  but  even  so,  much  of  the  increase  in 
breadth  of  topic  coverage  has  been  achieved  at  the  expense  of 
depth  of  development  of  key  ideas.  Recent  research  has 
shown  the  need  to  cut  back  on  topic  coverage  and  shift  from 
curricula  featuring  parades  of  facts  and  skills  exercises  to 
sustained  study  of  networks  of  connected  content  structured 
around  powerful  ideas.  But  what  is  the  optimal  balance?  How 


much  do  students  need  to  know  about  a topic,  and  how  long  should 
the  teacher  persist  in  efforts  to  make  sure  that  all  student'  n the  class 
master  this  network  of  knowledge?  It  may  take  weeks  or  even  months 
to  develop  connected  understandings  of  a topic  such  as  photosyn- 
thesis, and  even  then  some  students  will  still  be  vague  or  confused. 
If  we  really  want  to  teach  for  understanding  and  use  of  knowledge,  we 
wil  1 have  to  reduce  breadth  oftopic  coverage  drastically.  Are  we  ready 
for  middle-school  science  courses  that  address  only  four  or  five  topics 
across  the  entire  school  year?  If  not,  what  would  be  a reasonable 
compromise  between  this  level  of  depth  emphasis  and  the  overempha- 
sis on  breadth  that  we  have  now?  Also,  how  would  we  decide  which 
topics  to  retain  in  the  curriculum  and  which  to  exclude? 

These  questions  illustrate  how,  even  as  research  on  teach- 
ing for  understanding  and  use  of  knowledge  has  generated  increasing 
consensus  around  instructional  method  issues,  it  has  reopened  basic 
curricular  issues:  What  is  worth  teaching  to  K-l 2 students,  and  why? 
Like  the  process-outcome  research  that  preceded  it,  this  more  recent 
research  has  finessed  these  issues  rather  than  addressed  them. 
Process-outcome  research  did  it  by  using  standardized  tests  as  their 
criteria  for  learning,  which  embodied  the  1 imitations  mentioned  earlier. 
More  recent  research  has  finessed  curricular  issues  by  equating  the 
teaching  of  K- 1 2 school  subjects  with  enculturation  into  the  academic 
disciplines.  Usually  this  is  done  only  implicitly,  although  a few 
investigators  have  done  it  explicitly  and  defended  their  choice.  I 
believe  that  this  choice  leads  to  problematic  curricular  decisions. 

I have  become  sensitized  to  this  issue  through  my  involve- 
ment in  social  studies.  Among  educators  associated  with  the  major 
school  subjects,  social  studies  educators  have  been  uniquely  insis- 
tent on  the  importance  of  distinguishing  between  academic  disci- 
plines and  school  subjects.  Leaders  such  as  Shirley  Engle  have 
pointed  out  that  an  academic  discipline  is  a community  of  inquiry  that 
focuses  on  some  particular  content  domain  and  generates  increas- 
ingly differentiated  and  elaborated  knowledge  about  it.  The  discipline 
focuses  on  expanding  this  specialized  knowledge  base,  not  on  explor- 
ing its  applications  to  everyday  life  or  its  connections  with  other  forms 
of  knowledge.  In  contrast,  school  subjects  are  collections  of  knowl- 
edge organized  for  instruction  to  K-l 2 students  as  preparation  for 
everyday  living  and  performance  of  adult  roles  in  society.  Although 
informed  by  the  academic  disciplines,  school  subjects  are  mecha- 
nisms for  accomplishing  citizen  education,  not  generating  disciplin- 
ary knowledge.  Therefore,  decisions  about  what  ought  to  be  included 
in  the  K- 1 2 curriculum  should  be  informed  by  deliberations  about  what 
constitutes  basic  knowledge  that  all  citizens  need  to  know.  This 
knowledge  should  be  consistent  with  disciplinary  knowledge,  but  it 
should  be  selected,  organized,  and  taught  as  citizen  education,  not  as 
induction  into  an  academic  discipline. 

When  I view  recent  research  from  this  perspective,  I often 
find  myself  admiring  the  instructional  methods  illustrated  but  at  the 
same  time  questioning  the  choice  of  content.  Sometimes  I question 
the  content  itself.  In  reading  some  of  Lampert’s  reports,  for  example, 
I question  the  value  of  spending  several  lessons  on  topics  such  as 
prime  numbers  or  engaging  students  in  extended  reasoning  about 
arcane  mathematical  questions.  From  a disciplinary  perspective,  there 
is  no  problem  here,  because  the  students  are  engaged  in  doing 
mathematics,  and  all  mathematics  are  more  or  less  equal ly  acceptable. 
From  a citizen  education  standpoint,  however,  I question  spending 
precious  curriculum  time  on  content  that  seems  to  be  lacking  in 
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application  potential. 

Sometimes  I qup-tion  not  so  much  the  content  itself  but 
the  cost  effectiveness  of  introducing  it  at  a particular  grade  or 
seeking  to  develop  it  to  sophisticated  levels.  When  I read  the 
conceptual  change  science  work  of  Charles  Anderson  and  Kathleen 
Roth,  for  example,  I am  impressed  with  their  ingenuity  in  devel- 
oping ways  to  teach  complicated  topics  such  as  photosynthesis 
to  middle-school  students,  but  at  the  same  time,  I find  myself 
questioning  whether  it  is  worth  the  time  and  trouble  that  it  takes 
to  do  so.  Perhaps  the  topic  should  be  developed  less  completely, 
or  even  withheld  until  later  grades. 

As  knowledge  proliferates,  the  depth  versus  breadth 
dilemma  and  its  underlying  curricular  issues  concerning  what 
content  is  most  worth  teaching  will  become  both  more  important 
and  more  difficult  to  manage.  These  issues  won’t  be  solved  by 
lengthening  the  school  day  or  school  year,  or  by  looking  to  the 
disciplines,  to  assessment  data,  or  to  the  Japanese  for  definitive 
answers.  I recognize  that  they  cannot  be  resolved  through  purely 
empirical  methods  because  they  involve  value  questions.  How- 
ever, curricular  arguments  always  contain  implied  assumptions 
that  can  be  tested  empirically,  such  as  readiness  assumptions 
(that  students  at  a given  grade  level  are  ready  to  learn  particular 
content)  or  transfer  assumptions  (that  mastery  of  such  content 
will  enable  them  to  handle  certain  life  situations  effectively).  It  is 
important  for  us  as  educational  researchers  to  begin  to  pay 
attention  to  these  curricular  issues,  as  well  as  to  press  for 
clarification  and  testing  of  the  empirical  claims  embedded  in  the 
theory-based  position  advocacy  that  typifies  the  public  dis- 
course about  education.  One  good  place  to  start  is  to  recognize 
that  the  school  subjects  and  the  academic  disciplines  are  different 
entities  with  different  purposes.  Particular  content  does  not 
necessarily  belong  in  the  K-I2  curriculum  just  because  it  is 
currently  of  interest  to  one  of  the  disciplines. 

Another  thing  that  I have  come  to  appreciate  through 
my  involvement  with  social  studies  is  that  different  kinds  of 
knowledge  are  emphasized  in  different  school  subjects.  The 
basic  skills  subjects  emphasize  procedural  knowledge.  They  also 
include  propositional  knowledge,  but  this  propositional  knowl- 
edge is  limited  in  scope  and  is  taught  in  conjunction  with 
procedural  knowledge  that  is  tightly  linked  to  it.  As  my  colleague 
Ralph  Putnam  has  noted,  it  is  difficult  to  consider  knowledge 
about  the  mean  without  simultaneously  thinking  about  the 
mathematical  procedures  involved  in  computing  the  mean. 
However,  it  is  possible  to  teach  procedures  through  isolated 
skills  exercises,  and  scholars  interested  in  basic  skills  subjects 
complain  that  all  too  often,  this  is  exactly  what  happens.  The 
curriculum  becomes  a series  of  fragmented  skills  exercises  in 
which  students  use  primarily  rote  learning  methods  to  practice 
skills  in  isolation,  without  getting  sufficient  opportunities  to  use 
these  skills  within  authentic  application  contexts  or  to  learn 
related  propositional  knowledge  that  would  embed  the  proce- 
dural knowledge  within  a context  of  meaning.  These  concerns 
have  led  to  calls  for  more  emphasis  on  comprehension  and  reader 
response  in  teaching  reading,  on  authentic  communication  in 
teaching  writing,  and  on  problem  solving  in  teaching  mathemat- 
ics. 

The  situation  is  different  for  subjects  associated  with 


the  sciences,  and  especially  the  social  sciences  and  humanities. 
These  subjects  feature  a great  deal  of  propositional  knowledge 
but  not  that  much  subject-specific  procedural  knowledge. 
Furthermore,  except  for  a few  subareas  such  as  map  skills  or 
laboratory  procedures,  the  procedural  knowledge  taught  within 
these  subjects  usually  is  not  tightly  linked  to  particular  propo- 
sitional knowledge.  Students  are  not  taught  about  the  U.S. 
Constitution  or  the  human  body,  for  example,  to  prepare  them 
to  perform  specific  everyday  tasks  or  to  function  effectively  in 
particular  life  situations.  Instead,  they  learn  these  subjects 
partly  as  general  background  knowledge  that  anyone  literate  in 
the  current  culture  would  be  expected  to  know  and  partly  as 
information  that  could  inform  thinking  and  decision  making  in 
a broad  range  of  life-application  situations  (such  as  deciding 
howto  vote  in  an  election  orto  maintain  one’s  own  nutrition  and 
health).  In  the  humanities,  some  things  are  taught  without  any 
particular  practical  life  applications  in  mind  but  with  the  inten- 
tionofimprovingthe  learners’ quality  oflife by  broadeningtheir 
purviews,  developing  their  knowledge  and  appreciation  of  the 
human  condition  as  it  has  evolved  through  time  and  exists  today 
across  cultures,  and  exposing  them  to  ideas  believed  to  have 
enduring  heuristic  value. 

Scholars  studying  instruction  in  these  subjects  that 
feature  a great  deal  of  propositional  knowledge  are  not  so  much 
concerned  about  mindless  skills  practice  as  about  mindless 
memorization  (followed  by  forgetting)  of  disconnected  and 
often  trivial  information.  They  want  these  subjects  taught  in 
ways  that  will  help  students  to  appreciate  their  value  and  see 
their  applications  to  life  outside  of  school.  They  usually 
recommend  developing  powerful  ideas  in  depth,  which  includes 
focusing  questions  and  activities  around  these  ideas  and  their 
applications  to  students’  lives. 

These  considerations  underscore  the  need  for  differ- 
entiated models  of  teaching  that  take  into  account  the  different 
conditions  of  learning  that  are  presented  by  different  school 
subjects  or  instructional  situations.  In  this  regard,  many  of  the 
currently  popular  models  of  teaching  and  learning  are  badly  in 
need  of  qualification  concerning  their  spheres  of  application. 
For  example,  models  that  emphasize  strategy  instruction,  situ- 
ated learning,  or  modeling,  coaching,  and  scaffolding  appear  to 
be  much  more  suited  to  teaching  basic  skills  subjects  than  the 
sciences,  social  studies,  or  humanities. 

Social  constructivist  notions  and  conceptual  change 
notions  appear  to  have  broader  application  potential,  although 
with  subject-matter  differences  in  how  important  they  are  and 
how  they  are  manifested  in  the  classroom.  These  ideas  are  most 
applicable  when  it  is  possible  to  engage  students  in  discussion 
of  topics  about  which  they  have  a great  deal  of  prior  knowledge, 
especially  if  this  knowledge  includes  personal  life  experiences 
that  students  can  reflect  on  as  a basis  for  reasoning.  Social 
constructivist  and  conceptual  change  notions  are  less  appli- 
cable, however,  when  students  are  getting  initial  exposure  to 
primarily  new  propositional  knowledge,  as  when  fifth  graders 
are  introduced  to  chronological  treatment  of  U.S.  history.  In 
these  situations  it  is  often  necessary  to  first  establish  a common 
base  of  information  before  attempting  to  engage  students  in 
forms  of  discourse  that  implicitly  assume  understanding  of  this 
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information.  1 believe  that  some  social  constructivists  are 
being  unrealistic,  even  romantic,  in  suggesting  that  teachers 
should  routinely  avoid  transmitting  knowledge  and  instead 
function  only  as  discussion  facilitators  and  scaffolders  of 
learning  in  the  zone  of  proximal  development. 

Recent  Work  in  Social  Studies 

My  recent  work  in  social  studies  elaborates  on  some 
of  the  themes  developed  above  and  introduces  a few  new 
ones.  Much  of  this  research  was  done  as  part  of  the  work  of 
the  Elementary  Subjects  Center  at  Michigan  State,  in  which 
research  teams  used  similar  methods  to  address  similar  ques- 
tions concerning  effective  teaching  of  elementary  mathemat- 
ics, science,  social  studies,  literature,  art  and  music. 

One  of  the  things  we  did  was  study  commonly  used 
instructional  materials  supplied  by  the  major  publishers  and, 
where  possible,  compare  these  with  more  distinctive  materials 
developed  with  an  emphasis  on  teaching  the  subject  for 
understanding  and  use  of  knowledge.  Our  analyses  looked 
not  only  at  content  coverage  in  the  student  texts  but  also  at 
the  information  about  the  program  supplied  in  the  teacher's 
manual,  the  suggested  questions  and  activities,  and  the 
ancillary  worksheets  and  tests.  We  tried  to  assess  the  enacted 
curriculum  that  would  result  if  the  teacher  not  only  used  the 
instructional  materials  but  followed  the  teaching  suggestions 
in  the  manual. 

Our  analyses  revealed  serious  problems  with  these 
materials.  The  root  problem  was  that  their  development  was 
not  consistently  driven  by  major  subject-matter  purposes  and 
goals.  In  social  studies,  for  example,  the  materials  typically 
gave  lip  service  to  the  notion  that  citizen  education  is  the 
transcendent  goal  of  social  studies,  so  that  the  subject  should 
be  organized  as  preparation  for  fulfilling  one's  social  and  civic 
roles  in  our  society.  Unfortunately,  however,  these  major 
social  education  goals  got  lost  in  the  shuffle  as  curriculum 
planners  generated  a scope  and  sequence  and  divided  it  into 
grade  levels,  units,  and  lessons.  Analysis  of  lessons  indicated 
that  the  ostensible  purposes  and  goals  did  not  functionally 
guide  curriculum  development  and  instructional  planning. 

Instead,  the  lessons  apparently  were  developed  by 
identifying  the  knowledge,  skills,  and  values  emphasized  in 
state  and  district  guidelines  for  each  grade  level  and  then 
covering  them,  especially  those  that  were  likely  to  be  tested. 
When  curriculum  development  focuses  on  content  coverage, 
ultimate  goals  tend  to  fade  into  the  background,  as  do  many 
of  the  originally  recognized  connections  and  intended  life 
applications  of  particular  content  items.  Knowledge  gets 
fragmented  into  disconnected  bits  that  can  be  memorized  but 
not  easily  learned  with  understanding  or  appreciation  of  their 
potential  significance.  Skills  get  taught  and  practiced  in 
isolation  from  the  knowledge  content,  not  as  tools  for  using 
the  knowledge  in  authentic  life  applications.  The  curriculum 
becomes  a parade  of  facts  and  isolated  skills  exercises  to  be 
memorized  for  tests,  instead  of  a vehicle  for  helping  students 
to  understand  and  participate  effectively  in  the  social  world. 

For  example,  a grade  level  goal  states  that  students 
should  understand  and  appreciate  that  the  roles  and  values  of 


family  members  may  differ  according  to  the  structure  of  the  family, 
its  circumstances,  and  its  cultural  setting.  However,  at  the  unit  level, 
the  goal  statement  simply  mentions  understanding  that  families 
differ  in  size  and  composition.  This  unit  level  goal  makes  no 
reference  to  concepts  such  as  cultures  and  roles  that  are  referred  to 
in  the  higher  level  goal,  or  to  values  and  dispositions  such  as 
multicultural  appreciation.  Unless  the  teacher  has  a coherent  view 
of  the  purposes  and  goals  of  social  studies,  or  unless  the  manual 
does  an  excellent  job  of  keeping  the  teacher  aware  of  how  particular 
lessons  fit  within  the  big  picture,  the  result  is  likely  to  be  a version 
of  social  studies  that  is  long  on  isolated  practice  of  facts  and  skills 
but  short  on  integration  and  application  of  social  learning. 

The  manuals  typically  do  little  or  nothing  to  provide  such 
help  to  teachers.  Often  there  is  no  basis  for  doing  so  because  the 
content  is  inherently  trite  or  is  developed  in  ways  that  do  not 
promote  progress  toward  significant  social  education  goals.  Units 
on  shelter  convey  the  fact  that  people  live  in  a great  variety  of  homes, 
but  usually  say  little  about  the  reasons  for  this  variety.  Units  on 
government  mention  titles  (president,  governor,  mayor),  places 
(Washington,  state  capitals),  and  symbols  (flag,  ballot  box),  but 
precious  little  else.  In  particular,  they  say  little  about  the  functions 
and  services  performed  at  different  levels  of  government.  Students 
learn  that  there  are  people  called  the  mayor,  the  governor,  and  the 
president,  but  not  much  about  what  these  people  or  their  govern- 
ments do.  Given  the  triteness  of  the  content,  it  is  not  surprising  that 
the  suggested  questions  and  activities  tend  to  be  trite  too.  They 
focus  on  recitation  and  reinforcement  of  memory  for  specific  facts. 
In  the  absence  of  powerful  ideas  capable  of  supporting  authentic 
applications,  what  else  could  they  do? 

With  my  colleague  Janet  Aileman,  l have  been  examining 
social  studies  instructional  materials  in  considerable  detail  in  order 
to  identify  examples  of  good  and  bad  content  coverage  and  related 
questions  and  activities.  We  have  identified  some  additional 
problems  with  these  materials  besides  those  commonly  discussed 
in  the  literature.  One  is  inserted  skills  exercises  that  have  little  value 
in  their  own  right  and  detract  from  the  coherence  of  the  curriculum 
by  interrupting  it  to  address  skills  that  have  nothing  to  do  with  the 
unit  topic  (e.g.,  a map  skills  exercise,  using  a schematic  map  of  a 
fictional  contemporary  suburban  neighborhood,  inserted  into  the 
middle  of  a unit  on  Native  American  tribes).  Another  problem  lies 
in  the  activities  suggested  as  ways  to  integrate  across  subjects. 
Many  of  these  have  no  value  in  any  subject  (e.g.,  alphabetizing  the 
state  capitals).  Others  have  value  for  some  other  subject  but  lack 
social  education  value  and  thus  should  not  be  taking  up  social 
studies  time. 

Jan  and  l have  developed  guidelines  for  selecting  and 
implementing  activities  (Table  3).  These  guidelines  can  be  helpful 
in  deciding  which  suggested  questions  and  activities  to  retain,  in 
developing  substitutes  for  questions  or  activities  that  are  not 
suitable,  and  in  preparing  to  implement  activities  in  ways  that  are 
likely  to  maximize  their  pedagogical  value.  Sometimes  it  is  necessary 
to  replace  curriculum  content  as  well,  if  powerful  ideas  capable  of 
supporting  authentic  activities  are  lacking.  Ultimately,  what  is 
needed  is  curriculum  development  guided  by  major  subject-  matter 
goals.  Ideally,  goals  would  be  expressed  as  learner  outcomes — the 
knowledge,  skills,  attitudcs,values,  and  dispositions  that  one  wishes 
to  develop  in  students — and  all  cuniculum  planning  and  implementa- 
tation  decisions  would  be  driven  by  these  goals.  As  a result,  all 
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Table  3.  Principles  for  the  Design,  Selection,  and  Evaluation 

of  Activities 

A.  Primary  Principles.  These  are  necessary  criteria  that  must  be  applied 
10  each  individual  activity. 

Al.  Goal  Relevance.  Activities  must  be  useful  means  of  accom- 
plishing worthwhile  curricular  goals  (phrased  in  terms  of  target 
capabilities  or  dispositions  to  be  developed  in  students). 

A2.  Appropriate  Level  of  Difficulty.  As  implemented  (i.e., 
taking  into  account  not  onle  the  activity  itself  but  also  the 
degree  of  scaffolding  provided  by  the  teacher),  each  activity 
must  be  pitched  within  the  optimal  range  of  difficulty  (i.e.,  the 
students'  zones  of  proximal  development). 

A3.  Feasibility.  Activities  must  be  feasible  for  implementation 
within  the  constraints  under  which  the  teacher  must  work. 

A4.  Cost  Effectiveness.  The  social  education  benefits  expected 
to  be  derived  from  the  activity  must  justify  its  anticipated  costs 
(for  both  the  teacher  and  students). 

B.  Secondary  Principles.  These  principles  identify  features  of 
activities  that  are  desirable  but  not  strictly  necessary.  Each  individual 
activity  should  embody  all  the  primary*  principles  and  as  many  of  the 
secondary  principles  as  can  be  incorporated  in  ways  that  are  consis- 
tent with  the  primary  principles. 

Bl.  Multiple  Goals.  An  activity  that  simultaneously  accom- 
plishes many  goals  is  preferable  to  one  that  accomplishes  fewer 
goals  (so  long  as  it  is  just  as  effective  in  accomplishing  the 
primary  goal). 

B2.  Motivational  value.  Other  things  being  equal,  activities  that 
students  are  likely  to  enjoy  tor  at  least  find  meaningful  and 
worthwhile)  are  preferable  to  activities  that  students  are  not 
likely  to  enjoy. 

B3.  Topic  Currency.  Activities  that  are  constructed  around  cur- 
rently or  recently  taught  powerful  ideas  and  that  cohere  as  a set 
and  build  toward  major  goals  are  preferable  to  "orphan"activities 
that  are  constructed  around  isolated  content. 

B4.  Whole-task  Completion.  Oppportunities  to  complete 
whole  tasks  are  preferable  to  isolated  practice  of  part-skills, 
matching  of  words  to  definitions,  ot  other  work  that  does  not 
cohere  and  result  in  closure  as  completion  of  a meaningful  task. 
B5.  Higher  Order  Thinking.  The  best  activities  challenge 
students,  not  just  to  locate  and  reproduce  information  but  to 
respond  to  a question  or  problem  that  cannot  be  resolved 
through  routine  applicaion  of  previously  learned  knowledge. 
B6.  Adaptability.  Activities  that  can  be  adapted  to  accomodate 
students'  individual  differences  in  interest  or  abilities  arc  pref- 
erable to  activities  that  cannot. 

C.  Principles  That  Apply  To  Sets  Of  Activities.  The  principles  in 
A and  B apply  to  each  activity  considered  individually.  In  contrast, 
the  principles  in  C apply  to  sets  of  activities  developed  as  part  of  the 
plan  for  accomplishing  the  goals  of  the  unit  or  curriculum  strand.  Each 
principle  might  not  apply  to  each  separate  activity  in  the  set,  but  the 
set  as  a whole  should  reflect  the  principles  (insofar  as  it  is  possiblle  to 
do  while  still  meeting  the  primary  goals). 

Cl.  Variety.  The  set  should  contain  a variety  of  activity  formats 
and  student  response  modes. 

C2.  Progressive  Levels  Of  Difficulty  Or  Complexity’.  Activi- 
ties should  progressively  increase  in  levels  of  challenge  as 
student  expertise  develops. 

C3.  Life  Applications.  Students  should  get  to  apply  what  they  are 
learning  to  current  events  or  other  aspects  of  their  lives  outside 
of  school  (in  ways  that  make  sense,  given  their  levels  of 
development). 

C4.  EkU  Range  of  C.qhIs  Addressed  As  a set,  the  activities 
should  reflect  the  full  range  of  goals  identified  for  the  unit  or 
strand. 


C5.  Concrete  Experiences.  Where  students  lack  sufficient 
experiential  knowledge  to  support  understanding,  sets  of 
activities  should  include  opportunities  for  them  to  view  dem- 
onstrations, inspect  realia  or  photos,  visit  sites,  or  in  other  ways 
experience  concrete  examples  of  the  content. 

C6.  Connecting  Declarative  Knowledge  With  Procedural 
Knowledge.  To  the  extent  that  doing  so  is  important  as  part 
of  developing  basic  understanding  of  a topic,  students  should 
learn  relevant  processes  and  procedural  knowledge,  not  just 
declarative  or  factual  knowledge. 

C7.  ’’Natural"  Application.  Activities  that  arc  "naturals"  for 
developing  understanding  of  certain  content  should  be  included 
in  the  set  for  the  unit.  For  example,  retrieval  charts  and  related 
comparison/contrast  methods  should  be  used  whenever  the 
content  has  focused  on  different  examples  or  cases  of  concepts 
or  generalizations  (c.g..  Native  American  tribes). 

E.  Implementation  Principles.  These  principles  refer  to  the  ways  that 

activities  are  implemented  and,  in  particular,  the  ways  that  teachers 

structure  and  scaffold  the  activities  for  their  students. 

El.  Completeness.  A complete  activity  ordinarily  would  include 
the  following  stage:  (a)  introduction,  (b)  initial  scaffolding,  (c) 
independent  work,  and  (d)  debriefing/reflection/assessment. 

E2.  Introduction.  If  students  are  to  get  the  intended  learning 
benefits  from  engaging  in  an  activity,  they  will  need  to 
understand  its  intended  purposes  and  what  these  imply  about 
how  they  should  respond  to  the  activity. 

E3.  Initial  Scaffolding.  Before  releasing  students  to  work  mostly 
independently,  teachers  should  provide  whatever  explicit  ex- 
planation and  modeling  that  the  students  may  need  in  order  to 
understand  what  to  do,  how  to  do  it,  and  why  it  is  important. 

E4.  Independent  Work.  Once  students  have  been  released  to 
work  mostly  independently,  the  teacher  should  monitor  their 
efforts  and  provide  any  additional  scaffolding  or  responsive 
elaboration  on  the  instructions  that  may  be  needed  to  structure 
or  simplify  the  task,  clear  up  confusion  or  misconceptions,  or 
help  students  to  diagnose  and  develop  repair  strategies  when 
they  have  made  a mistake  or  used  an  inapppropriate  strategy. 

E5.  Feedback.  Activities  should  be  planned  so  that  the  students 
will  get  feedback  about  their  performance  not  only  in  the  form 
of  information  about  the  correctness  of  responses  but  also  in 
the  form  of  diagnosis  of  the  reason  for  the  errors  and  explana- 
tion of  how  these  errors  may  be  corrected  or  how  general 
qualitative  aspects  of  performance  may  be  improved. 

E6.  Dchriefing/Rcflcction/Assessment.  Activities  should  be 
brought  to  closure  in  ways  that  link  them  back  to  their  intended 
goals  and  purposes. 

E7.  Optimal  Format.  Where  alternatives  arc  possible,  the 

activity  should  be  implemented  in  whatever  format  will  maxi- 
mize the  time  the  students  spend  in  active  and  thoughtful 
cognitive  engagement. 

E8.  Optimal  Use  Of  instructional  Time.  If  the  independent 
work  phase  of  the  activity  calls  for  forms  of  work  that  are  time 
consuming  but  do  not  require  close  teacher  monitoring,  these 
aspects  of  the  work  can  be  done  outside  the  time  allocated  for 
social  studies  instruction. 

Source:  Adapted  from  J.  Brophy  and  J Allcmcn  (1991).  Activities  as  Instructional 
Tools.  A Framework  for  Analysis  and  Evaluation  Educational  Rsearcher . 20(4),  9- 
23.  Reprinted  with  permission  of  the  American  Educational  Research  Association 


elements  selected — the  basic  content,  the  ways  that  this  content  is 
represented  and  explicated  to  students,  the  questions  asked,  the 
types  of  teacher-student  and  student-student  discourse  that  oc- 
cur, the  activities  and  assignments,  and  the  methods  used  to  assess 
progress  and  grade  performance — would  be  included  because  they 
were  believed  necessary  for  moving  students  toward  accomplish- 
ment of  the  major  goals. 

Jan  and  l arc  currently  planning  to  develop  and  lest  goals- 
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driven  and  coherent  units  of  instruction  in  elementary  social  stud- 
ies, using  methods  similar  to  those  used  by  Anderson  and  Roth  in 
science.  Part  of  the  preparation  for  this  has  involved  interviewing 
students  before  and  after  their  social  studies  units  to  determine  the 
nature  of  their  prior  knowledge,  to  document  changes  in  -esponse 
to  instruction,  and  to  identify  commonly  occurring  naive  concep- 
tions or  misconceptions  that  may  need  to  be  addressed.  So  far,  these 
analyses  have  been  developed  most  fully  with  respect  to  fifth- 
graders’  ideas  about  U.S.  history,  studied  in  collaboration  with 
Bruce  VanSledright. 

We  have  found  that  most  fifth  graders  know  that  history 
has  to  do  with  the  past,  although  many  of  them  think  that  it  is  limited 
to  the  exploits  of  famous  or  important  people  or  to  events  that 
occurred  long  ago,  not  realizing  that  history  includes  the  recent  past 
and  the  lives  of  everyday  people.  Many  students  initially  confused 
history  with  archaeology.  Other  than  interviewing  living  witnesses, 
they  did  not  know  much  about  ways  to  discover  information  about 
the  past  except  for  digging  up  bones  and  other  material  found 
underground.  They  did  not  realize  that  a variety  of  written  records 
extending  back  for  thousands  of  years  is  available  to  historians. 

Someoftheirmisconceptions  involved  overgeneralization 
of  specific  examples  (all  American  Indians  lived  in  tepees  and 
hunted  buffalo:  colonies  were  small  villages  surrounded  by  wooden 
stockades).  Others  simply  repeated  inaccuracies  commonly  in- 
cluded in  stories  told  to  children  (everyone  but  Columbus  thought 
that  the  earth  was  flat).  Still  others  included  elements  generated  by 
the  children  themselves  in  an  attempt  to  make  sense  of  these  sto- 
ries and  fill  in  .he  explanatory  gaps  in  them.  For  example,  instead  of 
saying  that  the  Pilgrims  landed  at”  Plymouth  Rock,  several 
children  said  that  they  landed  ‘‘on”  Plymouth  Rock.  Follow-up 
questioning  indicated  that  some  of  these  children  believed  that  the 
Pilgrims  settled  at  Plymouth  because  they  literally  sailed  into 
Plymouth  Rock  and  had  to  stop  there  because  their  ship  was 
damaged.  Similarly,  when  asked  why  people  came  to  the  New  World, 
several  students  suggested  that  Europe  was  getting  too  crowded. 
Other  misconceptions  were  related  to  the  use  of  children’s  literature, 
as  in  the  case  of  students  who  listed  Johnny  Tremaine  as  a signer 
of  the  Declaration  of  Independence  and  Louisa  May  Alcott  as  a 
female  participant  in  the  Revolution. 

Some  students  declined  to  speculate  when  they  realized 
that  their  knowledge  was  limited,  but  others  concocted  imaginative 
elaborations  in  their  attempts  to  generate  coherent  stories  based  on 
the  limited  historical  information  that  they  possessed.  Our  favorite 
informant  was  interviewed  initially  as  a fourth  grader  about  Ameri- 
can history  topics  she  would  study  the  following  year.  She  told  us 
that  although  Columbus  gets  credit  for  discovering  America,  when 
he  reached  it  he  found  that  it  was  already  owned  by  Amerigo,  who 
was  “a  pirate  or  something”  who  had  gotten  here  two  years 
previously  and  decided  to  name  the  place  after  himself.  She  had 
reconstructed  this  narrative  based  on  information  retained  from 
viewing  an  episode  of  the  ‘‘Chipmunks”  TV  show  in  which  Simon 
and  Alvin  were  helping  Theodore  prepare  for  a history  test.  This 
girl  also  reported  that  the  Pilgrims  had  settled  at  Plymouth  Rock, 
which  she  located  somewhere  in  the  Upper  Peninsula  of  Michigan, 
and  that  their  boat  was  called  the  Mayflower,  which  is  how  we  got 
the  saying  "April  showers  bring  May  flowers."  The  Pilgrims  had 
come  to  the  New  World  because  "their  own  world  was  getting  wrec- 


ked by  something.  Someone  was  like  trashing  it.  They  were 
ruining  their  world  and  they  had  to  find  a new  one.”  The  first 
winter  was  rough  because  the  people  did  not  know  how  to 
survive  in  the  New'  World  and  “They  had  just  one  little  loaf  of 
bread  and  it  had  to  last  them  all  winter.  Then  the  Indians 
brought  them  food  when  the  spring  came  for  Thanksgiving  and 
that’s  how  we  got  Thanksgiving.  They  had  turkey  and 
stuffing.” 

It’s  fun  to  report  these  more  fanciful  narratives,  and 
it’s  interesting  to  learn  about  where  students  get  their  ideas 
about  social  studies  topics  before  studying  them  in  school. 
The  basic  scientific  purpose  of  this  line  of  work,  however,  is  to 
identify  general  developmental  trends  in  students’  social 
learning  that  can  be  incorporated  within  powerful  approaches 
to  elementary  social  studies  curriculum  and  instruction.  In  the 
coming  years,  our  research  will  trace  developments  in  stu- 
dents’ knowledge  of  universal  needs  and  experiences  such  as 
food,  clothing,  shelter,  families,  communities,  work,  transpor- 
tation, and  communication,  and  then  follow  up  by  developing 
and  assessing  social  studies  units  on  these  topics.  These  units 
will  be  structured  around  powerful  ideas  and  informed  by  the 
disciplines  of  history,  geography,  and  the  social  sciences. 
However,  unit  content  will  be  selected  and  organized  primarily 
to  accomplish  citizenship  preparation,  not  induction  into  these 
disciplines,  and  instruction  and  assessment  will  be  designed 
accordingly. 

Conclusion 

Educational  research  has  begun  to  establish  a 
knowedge  base  capable  of  informing  instructional  planning 
and  assessment,  although  the  information  it  has  generated 
needs  to  be  synthesized  accurately  and  applied  with  recogni- 
tion of  its  limitations.  Different  school  subjects  and  instruc- 
tional goals  create  different  conditions  of  learning,  which  in 
turn  call  for  different  approaches  to  instruction.  Few  if  any 
specific  teacher  behaviors  are  optimal  for  all  teaching  situa- 
tions, although  certain  more  general  principles  have  broad  if 
not  universal  applicability  if  adapted  to  the  instructional  goals 
(e.g.,  positive  expectations,  "with-it-ness",  teaching  networks 
of  knowledge  structured  around  powerful  ideas,  encouraging 
students  to  construct  knowledge  by  encoding  new  input  into 
their  own  words  and  connecting  it  to  their  prior  knowledge). 
Recent  research  has  produced  consensus  about  the  value  of 
discourse-based  instructional  methods,  but  it  also  has  fi- 
nessed basic  curricular  issues  (What  is  most  worth  teaching 
in  K-12  education,  and  why?).  The  validity  and  applicability 
of  proposed  reforms  in  education  cannot  be  established  by 
appeals  to  theory  or  even  to  the  academic  disciplines.  Instead, 
they  need  to  be  argued  using  a combination  of  (I)  systematic 
explication  of  the  advocates'  goal  priorities  and  assumptions 
about  what  kinds  of  curriculum  content  and  instructional 
methods  will  be  required  to  enable  students  to  accomplish 
those  goals;  and  (2)  emprical  evidence  th.  t the  advocated 
program  is  feasible  for  the  classroom  implementation,  that  its 
assumptions  are  valid  (it  accomplishes  its  goals),  $nd  that  its 
implementation  yields  acceptable  trade-offs  compared  to  those 
offered  by  recognized  alternatives.  My  current  work  in  social 
studies  is  an  attempt  to  move  in  these  directions. 
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A Special  Tribute 
to  MWERA' s First  President 


Edward  M.  Griffin 
1934-1993 


We  are  sad  to  learn  that  Ed  Griffin  passed  away  very  unexpectedly  shortlyafter  the  1 993  AERA  Conference  in  Atlanta. 
Ed  was  a charter  member  of  MWERA,  served  as  Co-chair  with  Sam  Mayo  of  the  Planning  Group  instrumental  in  establishing 
MWERA  in  1 978,  and  became  our  First  President  in  1 979. 

Ed  continued  to  be  active  with  MWERA  and  AERA  over  the  years.  He  came  to  many  of  our  Annual  Meetings  and 
was  a source  of  vitality  and  encouragement  at  our  Past-President  receptions.  His  most  recent  pet  project  was  AERA/SIG:  State 
and  Regional  Educational  Research  Associations  (SRERA),  where  he  held  the  important  position  of  Database  Project  Chair. 
The  SRERA  News  notes  that  uIn  Atlanta,  Ed  surprised  many  of  us  by  talking  about  early  retirement.  He  seemed  too  young 
for  that  kind  of  talk,  too  young  in  his  looks  and  in  his  youthful  vitality." 

Ed  is  survived  by  his  wife  and  two  children.  To  them  and  to  his  colleagues  at  Ferris  State  University,  we  extend  our 
deepest  sympathies. 
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Gregory  J.  Marchant  asked  leaders  in  education  to  respond  to 
the  question: 

What  need(s)  do  you  see  in 
doctorate  programs  in  education? 

Research  internships.  Paid  assistantships. 

- David  Berliner,  Arizona  State  University 

There  are  many.  One  of  the  most  crucial  is  the  lack 
of  time  for  advising  students.  When  one  has  too  many 
advisees,  one  cannot  possibly  give  to  students  the  academic 
care  each  needs  nor  the  personal  attention. 

Jeanne  Chall,  Harvard  University 

Early  and  authentic  involvement  in  educational  re- 
search projects  and  programs  by  all  doctoral  students,  as  a 
real  context  for  making  sense  of  readings,  coursework,  etc.  in 
substance  and  methods  of  inquiry. 

- Christopher  Clark,  Michigan  State  University 

Better,  more  focussed  and  more  rigorous,  research 
training.  Coursework,  experience,  and  direct  training  in  col- 
lege teaching. 

-Lyn  Como , Teachers  College  Columbia  University 

More  emphasis  on  critical  thinking  and  creative 
problem-solving. 

- Edward  Deci,  University  of  Rochester 

1 . A much  sharper  distinction  between  the  Doctor  of 
Education  and  the  Ph.  D.  degrees. 

2.  A clear  orientation  of  the  Doctor  of  Education 
degree  toward  educational  missions  and  the  requirements 
they  make  for  top-  level  practitioners. 

-John  Goodlad,  University  of  Washington 

A richer  involvement  in  the  intellectual  and  aesthetic 
1 ife  of  the  culture.  A much  wider  social  vision  and  commitment 
to  the  education  of  an  “articulate  public’*. 

-Maxine  Greene,  Teachers  College  Columbia 
University 


Programs  differ  so  I can  only  speak  for  the  ones  l 
know.  My  primary  concern  is  that  Ph.D.  programs  sometimes 
stray  so  far  ffom  practice  (schooling,  teaching,  learning)  that 
students  become  distanced  ffom  that  practice  and  even  see  it 
as  somehow  unimportant.  In  terms  of  the  curricula  of  doctoral 
programs,  they  are  often  lacking  in  intellectual  coherence  (I 
don’t  mean  uniformity)  and  students’  understandings  emerge 
as  fragments  of  information  rather  than  conceptualizations  of 
importance. 

-Gary  Griffin,  University  of  Arizona 

Educational  doctoral  programs  should  be  somewhat 
less  focused  on  customary  educational  content  fields,  e.g. 
curriculum  or  social  foundations,  and  aimed  more  directly  at 
preparing  the  types  of  specialists  currently  needed  in  educa- 
tion. 

-W.  James  Popham,  IOX  Assessment  Associates 

Top  quality  students  are  badly  needed  for  doctorate 
programs  in  education.  Better  financial  support  for  doctoral 
students  would  help  fill  this  need.  I would  also  like  to  see 
increased  opportunities  for  research  internships  with  pub- 
lishing faculty  for  all  students  in  education  doctorate  pro- 
grams. 

-Andrew  Porter,  University  of  Wisconsin-Madison 

Fewer  numbers.  Higher  quality.  Less  ideology. 
More  scholarship.  Less  psychology.  More  humanities. 

-Kevin  Ryan,  Boston  University 

A major  need  of  today  is  to  prepare  students  to  enter 
the  field  that  is  changing  constantly,  to  adapt  to  society's 
demands  and  the  need  for  programs  to  address  the  research 
and  practical  issues  related  to  the  politics  of  race  and  gender. 

-Jane  Stallings,  Texas  A&M  University 

As  we  seek  to  educate  every  student  we  find  many 
problems  not  yet  solved.  A good  doctoral  program  gives 
training  in  problem-solving. 

-Ralph  Tyler,  Center  for  Advanced  Study  in  Behavioral 

Sciences 

Broad  knowledge  of  major  fields  of  education  plus  a 
deep  mastery  of  chosen  specialty.  Writing,  computing,  pre- 
sentation skills  and  disciplined  effort  for  60  to  80  hours  per 
week. 

•Iferbert  Walberg,  University  of  Illinois-Chicago 
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IN  THIS  ISSUE 


This  issue  of  the  journal  has  something  for  everyone!  Three  very  different  articles  represent  the  range  of  interests  in  the  Association.  Fred 
Pigge  and  Ron  Marso  report  on  a study  about  attitude  changes  in  preservice  teachers;  this  study  takes  its  place  in  the  authors'  ongoing  research 
agenda  about  preservice  teacher  development.  James  Mead  presents  principles  for  developing  and  using  large  qualitative  databases  that 
come  from  his  experiences  with  the  National  Center  for  Research  on  Teacher  Education  at  Michigan  State  University.  Oipha  Duell  gives 
advice  to  new  faculty  members  about  university  hiring,  promotion,  and  tenure  processes. 

Invited  addresses  from  the  October  1 993  conference  also  speak  to  arangeof  interests.  Rose  Mary  Scott  and  Joan  S.Timm  summarize  Christine 
Sleeter's  speech  about  multicultural  education.  Gregory  Gerrick  provides  the  text  of  his  remarks  on  leadership  in  school  restructuring.  Ben 
Wright  develops  his  theory  of  composition  analysis,  a new  addition  to  the  measurement  toolbox.  Marlene  Schommer,  the  new  editor  of 
Voices,  develops  anew  format  to  allow  longer  responses  to  questions.  We  will  occasionally  publish  book  reviews,  and  editor  Ayres  D’Costa 
does  the  first  one.  We  hope  these  articles  and  features  include  something  of  interest  to  each  of  you,  our  members  and  readers. 

This  issue  also  contains  Mid-Western  Educational  Research  Association  business.  Of  particular  interest  to  members  are  the  Conference 
highlights  and  a request  for  volunteers  to  be  discussants  and  session  chairs  at  the  1994  Annual  Meeting. 

Ayres  D’Costa 
Sue  Brookhart 
John  Surber 

ON  THE  COVE  R 

The  College  of  Education  at  The  Ohio  State  University  is  widely  acknowledged  as  a preeminent  professional  school  of 
education,  both  in  terms  of  the  quality  of  its  preparation  programs  for  entry-level  educators,  education  leaders  and  the  education 
professoriate,  and  as  an  accomplished  center  for  research  and  development  initiatives.  Hence,  for  decades  it  has  received  the 
highest  rankings  from  its  peers. 

In  1 974,  Change  Magazine  reported  college  ofeducation  rankings,  placing  OSU  ’s  college  in  the  top  five,  following  only  Stanford 
and  Harvard,  making  this  College  the  numberone  public  college  of  education  in  the  country.  In  the  Forgan  ( 1 989)  reputational  study 
of  colleges  of  education,  OSU’s  College  of  Education  ranked  number  one,  tied  with  Michigan  State  University,  in  preparation 
programs  for  teachers  and  other  practitioners,  and  in  the  top  five  for  research  efforts  in  education  and  services  contributed  to  the 
profession  and  the  community.  In  one  of  the  most  comprehensive  rankings  studies  to  date,  conducted  by  West  and  Rhee  ( 1 993), 
and  assessing  institutions  and  departments  on  multiple  variables,  OSU’s  College  of  Education  ranked  third  in  the  country  on  both 
productivity  and  program  impact,  and  prestige.  Further,  across  seven  academic  areas,  it  was  in  the  top  five  in  four  of  these  and 
in  the  top  10  in  two  others. 
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Relationships  of  Prospective  Teachers'  Personality  Type  and  Locus  of 
Control  Orientation  with  Changes  in  Their  Attitude  and  Anxiety  about 

Teaching 

Fred  L.  Pigge  and  Ronald  N.  Marso,  Bowling  Green  State  University 


This  study  was  designed  to  investigate  relationships  between  prospective  teachers * Myers- Briggs ' personality 
type  and  Rotter's  feelings  of  locus  of  control  and  their  attitude/anxiety  about  teaching  as  they  progressed  through 
their  teacher  preparation.  A series  of  two-factor  AN  OVA  *s  with  repeated  measurements  on  one  factor  revealed  that  as 
the  teacher  candidates  progressed  through  their  preparation  program,  anxiety'  decreased  and  attitude  remained  high 
and  positive ; that  the  introverted  candidates  expressed  more  anxiety  and  experienced  less  of  a decrease  in  anxiety 
than  the  extroverts ; that  the  candidates  with  a judging  preference  reported  a more  positive  attitude  about  teaching 
than  did  their  perceptive  cohorts;  and  that  the  internally  controlled  candidates  throughout  their  preparation  generally 
reported  less  anxiety'  about  teaching  than  did  the  candidates  with  average  or  high  feelings  of  externality'. 


There  is  increasing  research  evidence  that  affective 
changes  do  occur  in  prospective  teachers  as  they  progress 
through  preservice  teacher  preparation  and  that  at  least  some 
of  these  changes  follow  predictable  patterns  within  theo- 
retical frameworks  such  as  Fullers  (Fuller  & Bown,  1975) 
developmental  concerns  model  (e.g.,  Adams,  Hutchinson, 
& Martray,  1980;  Adams  & Martray,  1981 ; Pigge  & Marso, 
1987;  Silvernail  & Costello,  1983).  The  results  of  these 
and  similar  studies,  however,  also  have  revealed  perplex- 
ing inconsistencies  in  the  specific  nature  of  the  influence 
of  teacher  education  upon  aspiring  teachers.  Efforts  to  study 
these  inconsistencies  have  led  to  research  findings  which 
suggest  that  the  personal  characteristics  of  prospective 
teachers  as  well  as  the  characteristics  of  the  preservice  edu- 
cation experience  impinge  upon  their  development  as  teach- 
ers (e.g.,  Marso  & Pigge,  1989;  Tabachnich  & Zcichner, 
1984;  Villeme  & Hall,  1980;  Weinstock  & Peccolo,  1970). 

Byler  and  Byler  (1984)  found  that  a positive  change  in 
prospective  teachers'  morale  during  student  teaching  was 
related  to  the  extent  of  prospective  teachers'  early  field 
experience,  to  the  expectations  of  student  teachers  in  the 
assigned  school  setting,  to  the  degree  to  which  cooperating 
teachers  accepted  student  teachers  as  fellow  professionals, 
and  to  the  level  of  their  cooperating  teachers'  morale. 
McCaulley  and  Natter  ( 1 974)  reported  that  individuals  with 
different  Mycrs-Briggs  personality  types  arc  attracted  to 
different  grade  levels  and  subject  areas  of  teaching.  And, 
Villeme  and  Hall  (1980)  found  that  prospective  teachers' 
attitude  toward  teaching  was  influenced  by  their  gender, 
anticipated  teaching  grade  level,  and  selected  teaching  ma- 
jor. 

Lawrence  (1979)  maintains  that  “ample"  evidence  ex- 
ists which  indicates  that  teachers'  personality  types  do  af- 
fect the  way  they  teach  and  the  way  they  prefer  to  teach, 
and  considerable  research  has  revealed  relationships  be- 


tween teachers'  locus  of  control  and  their  classroom  be- 
havior and  their  pupils’  achievement  (Lefcourt,  1 982).  For 
example,  Harpin  ( 1 980)  and  Harpin  and  Sandler  ( 1 979)  re- 
ported a relationship  between  teachers'  locus  of  control 
and  the  nature  of  their  classroom  control,  and  DeNovellis 
and  Lawrence  (1983)  identified  a relationship  between 
teachers'  Myers-Briggs  personality  type  and  the  nature  of 
their  classroom  control.  Further,  Guyton  and  DeMoulin 
(1989)  reported  that  effective  and  ineffective  inservice 
teachers  differed  in  personality  but  not  in  age,  years  of  teach- 
ing experience,  gender,  race,  and  academic  degrees  earned. 
Effective  teachers,  as  opposed  to  ineffective  teachers,  were 
found  to  be  more  self-reliant,  independent,  dominant,  as- 
sertive, competitive,  resourceful,  cheerful,  and  trusting  and 
understanding  of  others  but  less  respectful  of  school  rules. 

Other  researchers  (e.g.,  Parkay,  Greenwood,  Olejnik, 
& Proller  [1988];  Sadowski,  Blackwell,  & Willard  [1986]; 
McIntyre  [1984];  Meadow  [1981])  have  identified  relation- 
ships between  teachers'  behavior  and  their  feelings  of  stress 
and  locus  of  control.  These  researchers  found  that  teach- 
ers reporting  low  levels  of  stress  and  feelings  of  internal 
locus  of  control  had  fewer  classroom  discipline  problems, 
fewer  intrapcrsonal  conflicts,  and  better  relations  with  su- 
periors, colleagues,  and  parents  of  their  pupils  than  did  their 
more  stressful  and  externally  controlled  colleagues. 

Relatedly,  Ashton,  Webb,  and  Doda  ( 1 983)  reported  that 
teachers  with  feelings  of  self-efficacy  and  an  internal  locus 
of  control  accepted  more  personal  responsibility  for  their 
pupils' success  or  failure.  And,  Murray  and  Stacbler  ( 1974) 
found  that  those  teachers  reporting  a high  internal  as  op- 
posed to  a high  external  locus  of  control  had  higher  achiev- 
ing pupils. 

The  purpose  of  the  present  study  was  to  ascertain 
whether  relationships  existed  between  changes  in  prospec- 
tive teachers'  attitude  and  anxiety  about  teaching  during 
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teacher  prepar  and  their  personality  type,  as  measured 
by  the  Myers-Bi  .0gs  Type  Indicator,  and  their  locus  of  con- 
trol orientation,  as  measured  by  Rotter’s  External-Internal' 
Locus  of  Control  Scale.  More  specifically,  answers  to  the 
following  four  questions  were  sought:  1 ) In  an  overall  sense, 
will  the  prospective  teachers  reveal  significant  changes  over 
time  (from  commencement  to  conclusion  of  their  educa- 
tion) in  their  attitude  and  anxiety  about  teaching?  2)  Will 
there  be  significant  differences  in  the  prospective  teachers' 
anxiety  and'or  attitude  scores  when  the  teachers  are  classi- 
fied by  levels  of  their  locus  of  control  scores?  3)  Will  there 
be  significant  differences  in  the  prospective  teachers’  anxi- 
ety and/or  attitude  scores  when  the  teachers  are  classified 
by  Myers-Briggs  personality  types?  4)  Will  there  be  sig- 
nificant interactions  between  locus  of  control  levels  and/or 
personality  types  and  time  in  teacher  education  (commence- 
ment to  conclusion  of  preparation)  with  respect  to  the  pro- 
spective teachers’  anxiety  and  attitude  about  teaching 
scores? 

Method 

The  subjects  of  this  investigation  were  composed  of  all 
students  entering  teacher  preparation  at  a large  teacher  edu- 
cation institution,  during  the  calendar  year  1985,  who  had 
completed  their  student  teaching  experience  at  this  same 
institution  by  the  end  of  the  spring  semester  of  1988.  This 
sample  consisted  of  150  prospective  teachers,  of  whom  126 
were  female,  and  of  whom  56  anticipated  teaching  at  the 
secondary  level,  74  at  the  elementary  grade  level,  and  20 
were  seeking  K-I2  certification. 

Upon  entrance  to  teacher  education,  and  again  upon 
the  completion  of  the  student  teaching  practicum,  the  sub- 
jects completed  The  Attitude  Toward  Teaching  As  A Ca- 
reer Scale  (Merwin  & DiVesta,  1959)  and  The  Teaching 
Anxiety  Scale  (Parsons,  1973).  In  addition,  each  subject 
completed  the  Myers-Briggs  Type  Indicator  (Myers  & 
McCaulley,  1985)  and  Rotter’s  Internal-External  Locus  of 
Control  (Rotter,  1966)  just  prior  to  the  commencement  of 
their  student  teaching  experience. 

The  attitude  scale  contains  1 1 attitudinal  statements 
about  teaching  as  a career,  each  of  which  is  responded  to 
on  a scale  from  strongly  disagree  (1)  to  strongly  agree 
(6),  where  the  higher  scores  indicate  a more  positive  atti- 
tude. The  anxiety  scale  is  comprised  of  29  items  address- 
ing feelings  about  various  events  associated  with  teaching, 
with  a response  continuum  for  each  item  from  never  ( I ) to 
always  (5),  with  higher  scores  indicating  more  anxiety  to- 
ward teaching  as  a career. 

Five  two-factor  ANOVAs  with  repeated  measurements 
on  one  factor  (Time)  were  completed  for  each  of  the  two 
dependent  variables  (Attitude  and  Anxiety).  For  each  analy- 
sis, two  measurement  times  during  teacher  preparation 
(upon  the  commencement  of  preparation  and  during  stu- 
dent teaching)  formed  the  ANOVA  column  heading  [Time 
(within  subjects)  main  effects].  For  each  dependent  vari- 
able, the  three  locus  of  control  and  four  sets  of  personality 


type  classifications  formed  the  five  sets  of  ANOVA  row 
headings  [Type  (between  subjects)  main  effects].  Specifi- 
cally, the  row  classifications  were  the  Rotter  externality 
scores  classified  as  top,  middle,  and  lowest  one-thirds;  and 
the  Myers-Briggs’  four  dichotomous  preference  types:  ex- 
troversion or  introversion,  sensing  or  intuitive,  thinking  or 
feeling,  and  judging  or  perceptive.  These  preference  type 
classifications,  rather  than  the  more  complex  16  combina- 
tions of  types  derived  from  these  four  dimensions,  were 
used  in  accord  with  prior  research  practice  as  the  frequency 
distribution  of  subjects  within  career  field  samples  across 
the  1 6 types  has  proven  to  be  far  from  equivalent  (Myers  & 
McCaulley,  1985).  In  the  present  moderately  large  sample 
of  150  prospective  teachers,  the  distribution  of  subjects 
within  the  16  types  resulted  in  n’s  <5  for  9 of  the  16  types. 

Findings 

Overview.  A significant  Time  effect  was  found  with 
regard  to  anxiety  but  not  for  attitude;  attitude  toward  teach- 
ing tended  to  remain  relatively  high  and  stable  throughout 
the  training  period,  but  scores  from  the  teaching  anxiety 
scale  were  significantly  lower  during  student  teaching  than 
they  were  prior  to  teacher  training.  Locus  of  control  levels 
were  found  to  be  related  to  the  pre-post  anxiety  but  not  to 
the  pre-post  attitude  measurements.  Myers-Briggs’  extro- 
vert-introvert classifications  were  found  to  be  related  to 
changes  in  anxiety.  Also,  the  students  classified  as  judging 
were  found  to  have  a higher  average  attitude  toward  teach- 
ing than  did  those  classified  as  perceptive. 

Alpha  Levels.  The  above  overview  of  the  major  find- 
ings was  based  on  individual  test  alphas  of  .05.  Statisti- 
cally conservative  readers  may  desire  to  adjust  this  overall 
alpha  of  .05  downward  to  guard  against  making  an  overall 
experiment  error  that  is  likely  to  be  somewhat  greater  than 
.05.  In  this  regard,  the  original  .05  level  could  be  divided 
as  Bonferroni  suggested  by  5,  the  number  of  repeated  tests 
applied  to  each  dependent  variable  to  obtain  a revised  al- 
pha of  .01.  These  conservative  readers  would  then,  unlike 
the  authors  of  the  present  study,  demand  p values  of  .01  or 
less  before  concluding  the  various  F-ratio  values  presented 
in  Tables  1 and  2 to  be  significant. 

Affective  change.  Data  presented  in  Tables  1 and  2 
reveal  that  the  prospective  teachers’  attitudes  toward  teach- 
ing remained  relatively  high  and  stable  throughout  the  du- 
ration of  their  teacher  training.  Three  non-significant  F- 
ratios  are  presented  which  relate  to  the  evaluation  of  pos- 
sible changes  in  their  attitude  over  time:  F = 0.98,  p = .32 
(Table  1);  F = 0.36.  p = .55  (Table  2);  and  F = 0.04,  p = .84 
(Table  2). 

In  a similar  manner.  Tables  1 and  2 present  two  unam- 
biguous F-ratios  which  indicate  that  prospective  teachers’ 
anxiety  toward  teaching  significantly  decreased  over  time: 
F - 51.01,  p < .0001  (Table  I)  and  F = 50.60,  p < .0001 
(Table  2).  The  third  main-effect  related  to  anxiety  over 
Time  F ~ 43.08.  p < .0001  (Table  2)  is  somewhat  ambigu- 
ous because  there  was  an  interaction  between  the  extro- 
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vert-introvert  classifications  and  Time.  Regardless,  the  two 
former  F-ratios  and  accompanying  probability  values  ind- 
icate quite  clearly  that  the  prospective  teachers'  anxiety 
scores  significantly  decreased  between  the  commencement 
of  teacher  training  and  completion  of  the  student  teaching 
practicum. 


Table  l 

Main  Effects  and  Interaction  F's  Related  to  Attitude  and  Anxiety' 
Pre  and  Posttest  Means  Classified 
by  Rotter's  Locus  of  Control 


Dependent 

Variable 

Externals 
Pre  Post 
(Average) 


.Locus  (Row)  Effect) 
Middle 

Pre  P ost 
(Average) 


Attitude 

50.63  50.42  51.11  51.60 

(50.43)  (51.40) 

Anxiety 

*71.03  63.33  76.06  66.07 


(67. IS)  A, B** 

Time  (Column) 
Effect 

Pre  Post 


(71.51  )A 


Internals 
Pre  Post 
(Average) 


51.56  53.14 

(52.35) 

67.02  60.75 

(64.3  3 )B 


Attitude 

Anxietv 


51.00  51.73 

71.62  63.65 

Locus 


0.0S  .32 

51.01  .0001 

Locus  XTime 
F p 


Attitude 

Anxietv 


* Total  \ for  this  analysis  was  38  + 35+36.  respectively  by 
:l ossification , or  109.  Two  small  classes  of  the  original  150  students 
were  not  administered  the  Rotter 's  instrument. 

** Means  coded  with  the  same  letter  do  not  differ  significantly  (Scheffe 
70s t- hoc  pair-wise  test,  a = .05) 


Table  2 

Main  Effects  and  Interaction  F's  Related  to  Attitude  and  Anxiety' 
Pre  and  Posttest  Means  Classified  by  Myers-Briggs  E-I  and  J-P  Type 

Classifications 

Dependent 

lariable 

Myers-Briggs  Type  (Row)  Effect * 

.V  Pre  Post 

.V 

Pre  Post 

(Average) 

(Average) 

Extrovert 

Introvert 

Attitude 

104  51.87  52.16 

45 

49.91  0.36 

(52.01) 

(50.13) 

Anxiety 

105  70.83  61.98 

45 

72.11  67.67 

(66.40) 

(69.89) 

Time  (Column)  Effect 

Time 

S Pre  Post 

F p 

Attitude 

149  51.2S  51.62 

0.36  .55 

Anxiety 

150  71.21  63.69 

43.08  .0001 

Type 

Type  A'  Time 

F p 

F p 

Attitude 

3.59  .06 

0.01  .91 

Anxiety • 

4.52  .035 

4.73  .031 

Myers-Briggs  Type  (Ron)  Effect* 

S Pre  Post 

\ 

Pre  Post 

(Ave.) 

(Ave.) 

Judging 

Perceptive 

Attitude 

109  51.86  52.28 

41 

49.68  49.83 

(52.07) 

(49.75) 

Anxiety 

110  71.09  63.63 

40 

71.55  63.85 

(67.36) 

(67.70) 

Time  (Column)  Effect 

Time 

X Pre  Post 

F p 

Attitude 

150  51.28  51.62 

0.04  .84 

Anxiety 

150  -M.21  63.69 

50.60  .0001 

Type 

Type  A'  Time 

F p 

F p 

Attitude 

5.14  .025 

0.04  .84 

Anxiety' 

0.04  .84 

0.01  .91 

*Xo  significant  Main  Effect  Type  or  Type  X Time  F-ratios  were 
identified for  the  Myers- Briggs  sensing/intuitive  and  thinking/feeling 

1 comparisons ; thus  data  from  these  compariso 

ix  are  omitted  from  this 

manuscript 

Locus  of  Control.  The  external  (X  > 11),  middle  (X 
--  9 through  1 1 ),  and  internal  locus  of  control  (X  < 9)  ap- 
proximate one-thirds  classifications,  derived  from  Rotters 
locus  of  control,  yielded  significant  combined  mean  differ- 
ences F - 5.76,  p - .004,  (Table  1 ) for  the  prospective  teach- 
ers' anxiety  about  teaching,  but  not  for  attitude  about  teach- 
ing. The  Scheffe  procedure  for  post-hoc  pair-wise  mean 
comparisons  indicated  that  those  prospective  teachers  with 
internal  feeling  of  control  reported  less  average  anxiety 
about  teaching  (M  =■-  64.33)  than  did  those  in  the  middle 
one-third  (M  - 71.51 );  whereas  the  aspiring  teachers  with 
high  feelings  of  external  control  (M  - 67.18)  did  not  differ 
significantly  in  anxiety  from  cither  of  the  other  two  groups. 


Regarding  mean  differences  within  each  locus  of  con- 
trol classification,  the  average  of  the  pre  and  post  anxiety 
standard  deviations  based  on  the  total  group  (N  = 150)  was 
10.93.  Using  this  average  standard  deviation  as  a yard- 
stick in  much  the  same  manner  as  a researcher  would  in 
computing  effect  sizes  (Borg  & Gall,  1989),  the  following 
findings  emerge:  1 ) The  externals'  posttest  mean  when 

compared  to  their  pretest  mean  was  .70  of  an  average  S.D. 
lower,  for  the  mid  group,  the  posttest  mean  was  .83  of  a 
standard  deviation  lower  than  the  pretest  mean,  and  for  the 
internals  it  was  .66.  Thus,  it  may  be  concluded  that  each  of 
the  three  groups  had  significantly  and  probably  meaning- 
fully lower  posttest  than  pretest  means.  2)  Comparing  just 
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pretest  means  it  can  be  observed  that  the  internals'  mean 
(67.92)  was  .74  of  an  average  S.D.  lower  than  the  pretest 
mean  (76.06)  of  the  middle  group  and  .28  of  an  average 
S.D.  less  than  the  pretest  mean  (71.03)  for  the  externals. 
Not  only  did  the  internals  have  the  lowest  pretest  anxiety 
mean,  they  also  had  the  lowest  posttest  mean. 

Myers-Briggs  Type.  Analyses  u:ing  the  Myers-Briggs 
extrovert  versus  introvert  classification  revealed  that  the 
majority  of  this  sample  of  aspiring  teachers  were  extrovert 
types  (70%).  An  interaction  effect  was  revealed  between 
the  extrovert  versus  introvert  classification  and  the  two 
measurement  points  during  training  for  the  anxiety  about 
teaching  criterion  measure  F = 4.73,  p = .031  (Table  2). 
The  pattern  of  means  for  this  interaction  is  depicted  in  Fig- 
ure 1 . The  data  presented  in  Figure  1 suggest  that  both  the 
introverts  and  extroverts  significantly  reduced  their  anxi- 
ety toward  teaching  over  time  but  that  the  extroverts  expe- 
rienced a significantly  greater  reduction  in  anxiety  about 
teaching  during  the  period  of  undergraduate  teacher  edu- 
cation than  did  their  cohorts  classified  as  introverts. 


The  prospective  teachers  classified  as  extroverts  also 
appeared  to  express  somewhat  of  a more  positive  attitude 
about  teaching  (M  - 52.01)  than  did  those  classified  as 
introverts  (M  = 50.13).  It  should  be  noted,  however,  that 
the  average  mean  difference  for  this  comparison  just  ap- 
proached the  selected  test-wise  statistical  significance  level 
F = 3.59.  p = .06  (Table  2).  Evaluativcly,  the  average  pre 
and  post  S.D.  for  the  attitude  scores  (N  = 149)  was  6.57. 
This  small  attitude  mean  difference  (1.88  points)  is  only 
1.29  of  a S.D.,  hardly  enough  to  warrant  further  examina- 
tion. 

The  judging  (58%)  versus  perceptive  (42%)  classifica- 
tions of  the  teacher  candidates  derived  from  the  Myers- 
Briggs'  instrument  indicated  that  the  judging  (M  - 52.07) 
candidates  reported  a more  positive  attitude  toward  teach- 
ing than  did  the  perceptive  (M  49.75)  candidates  F 
5.14,  p - 025  (Table  2).  This  Myeis-Bnggs*  classification 


did  not  reveal  a significant  difference  in  anxiety  mean 
scores. 

Summary  and  Discussion 

The  prospective  teachers  reported  a decrease  in  anxi- 
ety about  teaching  during  teacher  preparation,  but  their  at- 
titude toward  teaching  remained  stable  and  positive  between 
the  commencement  of  teacher  education  and  the  student 
teaching  practicum.  More  specific  to  the  purpose  of  this 
study,  the  prospective  teachers'  attitude  and  anxiety  about 
teaching  were  found  to  be  related  to  their  personality  pref- 
erences; and  then  anxiety  toward  teaching,  but  not  their 
attitude,  were  found  to  be  related  to  their  loci  of  control. 
The  aspiring  teachers  with  feelings  of  internal  control  re- 
ported less  anxiety  about  teaching  than  did  those  prospec- 
tive teachers  with  middle  or  high  feelings  of  externality. 
The  extroverted  prospective  teachers  reported  less  initial 
anxiety  and  reduced  their  anxiety  about  teaching  to  a greater 
extent  during  teacher  education  than  did  their  introverted 
cohorts,  and  the  judging  prospective  teachers  reported  a 
more  positive  attitude  about  teaching  than  did  their  per- 
ceptive cohorts.  Neither  the  Myers-Briggs’  sensing-intui- 
tive nor  the  thinking-feeling  preferences  were  found  to  be 
related  to  cither  the  attitude  or  anxiety  measures. 

The  finding  of  a decrease  in  anxiety  about  teaching 
during  teacher  preparation  in  the  present  study  is  consis- 
tent with  the  developmental  model  of  teacher  evolution; 
but,  contrary  to  the  developmental  model,  attitude  toward 
teaching  did  not  become  increasingly  more  positive  during 
the  period  of  undergraduate  teacher  education.  Piggc  & 
Marso  (1987)  also  reported  a decrease  in  anxiety  but  no 
change  in  attitude  about  teaching  during  teacher  prepara- 
tion for  cross-sectional  samples  of  aspiring  teachers.  In 
contrast,  Callahan  ( 1980)  and  Lipka  and  Garlet  (1981)  have 
reported  that  prospective  teachers  develop  less  positive  at- 
titudes toward  teaching  during  preservice  education. 

Data  obtained  from  the  Myers-Briggs  and  Rotter  in- 
struments for  this  sample  of  prospective  teachers  appear  to 
be  generally  consistent  with  findings  reported  by  Myers 
and  McCaulley  ( 1 985)  and  Lcfcourt  ( 1 982).  These  research- 
ers have  described  public  school  teachers  as  likely  to  be 
internally  controlled,  extroverted  sensing,  feeling,  and  judg- 
ing (i.c.,  being  responsible  for  their  own  behavior;  relating 
more  easily  to  the  outer  world  than  to  the  inner  world  of 
ideas;  possessing  a preference  for  working  with  known  facts 
rather  than  searching  for  possibilities  and  relationships; 
making  decisions  based  upon  personal  values  rather  than 
on  impersonal  analysis  and  logic;  and  having  a preference 
for  a planned  and  orderly  way  of  life  rather  than  a flexible, 
spontaneous  way,  respectively). 

The  results  of  this  study,  although  limited  to  a sample 
from  a single  teacher  education  program,  have  provided 
further  evidence  that  measurable  and  generally  desirable 
(at  least  in  a theoretical  sense)  affective  changes  in  pro- 
spective teachers  do  occur  during  teacher  preparation.  Sec- 
ondly. the  present  study  pi  oxides  more  evidence  that  affee- 
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tive  changes  in  prospective  teachers  during  preservice  edu- 
cation are  predictable  and  are  likely  to  be  influenced  by 
their  personality  type  and  perceptions  of  locus  of  control. 
Regarding  future  implications,  it  is  anticipated  that  contin- 
ued research  on  the  affective  attributes  of  those  teacher  can- 
didates who  successfully  progress  through  early  career  de- 
velopment and  who  have  a positive  impact  upon  their  pu- 
pils may  eventually  result  in  sufficient  knowledge  to  better 
counsel  individuals  considering  whether  or  not  they  might 
become  successful  teachers. 
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Some  Issues  in  Constructing , Managing,  and  Using  Large  Qualitative 

Databases1. 

James  V.  Mead  Michigan  State  University 


l hope  that  this  article  helps  researchers  who  are 
thinking  about  building  qualitative  databases  for  future 
analysis.  My  emphasis  is  on  the  construction,  managing, 
and  building  of  large  databases.  In  the  article  1 discuss 
seven  possible  purposes  for  qualitative  databases.  I discuss 
how  researchers  could  organize  the  storage  and  the  retrieval 
of  data  in  useful  subsets  for  analysis  and  presentation. 
Therefore,  I emphasize  the  period  before  data  collection 
and  1 will  not  review  specialized  qualitative  data  analysis 
packages  available  on  mainframes  or  IBM-type  and 
Macintosh  personal  computers.  Specialized  qualitative 
analysis  packages  suit  individual  researchers  working  with 
small  data  sets.  I have  opinions  on  data  analysis  programs 
but  I do  not  discuss  them  in  this  article.  Readers  interested 
in  qualitative  data  analysis  using  computers  could  try 
Pfaffenberger  (1988)  or  the  collection  of  articles  edited  by 
Fielding  and  Lee  (1991). 

1 want  to  turn  our  attention  to  the  neglected  issue  of 
data  storage  and  its  retrieval  before  analysis.  Sadly,  when 
it  comes  to  qualitative  data  there  is  truth  in  the  old  joke 
that  the  analysis  quality  was  as  good  as  the  size  of  the 
researcher's  floor.  Floor  size  limited  the  area  where  the 
researcher  could  spread  out  sheets  of  paper  or  index  cards 
and  then  play  an  adult  version  of  Kim's  Game  or 
Concentration,  the  memory  game  wc  played  as  children. 
The  computer  can  contribute  in  either  a positive  or  negative 
way  to  enlarge  that  “physical  floor  space  and  its 
effectiveness." 

These  thoughts  prepare  the  way  for  researchers  to  design 
their  database  for  their  individual  projects.  In  my 
experience,  it  is  a mistake  to  postpone  serious  reflection 
about  how  wc  will  store  and  manage  the  data  until  after 
data  collection.  An  all  too  common  response  by  researchers 
is  to  say,  “1  am  going  to  use  X software  to  organize  and 
analyze  my  data."  It  appears  to  some  people  that  making 
this  statement  represents  sufficient  preplanning  on  their  part. 

1 base  this  article  upon  experiences  1 had  designing  large- 
scale  databases  at  the  National  Center  for  Research  on 
Teacher  Learning  (NCRTL)  at  Michigan  State  University. 
However,  researchers  with  small  data  sets  will  find 
something  they  can  apply  to  their  research.  I assume  that 
my  reader  knows  little  about  computers  and  software  beyond 
basic  word  processing.  Finally,  1 have  no  hidden  agenda  to 
“sell"  my  favorite  software  to  the  reader;  one  of  my  favorite 
database  programs  is  no  longer  on  the  market. 


1 All  footnotes  ate  presented  nf  end  of  article. 


Initial  Qualitative  Database 
Building  Issues 

First,  we  must  consider  carefully  the  human,  hardware, 
and  software  resources  available.  I find  researchers  prepared 
to  agonize  over  every  detail  designing  their  instruments. 
They  invest  inordinate  amounts  of  time  collecting  the  data. 
Researchers  devote  considerable  time  and  energy  into 
analyzing  their  data.  However,  those  same  careful 
researchers  often  store  that  data  by  throwing  it  to  an 
unlabeled  box  in  random  order. 

A research  database  manager  acts  as  diplomatic  scold, 
cleaner,  and  defender  against  data  neglect  that  blights  almost 
every  project.  Choosing  the  person  responsible  for 
constructing  the  database  can  be  a major  personnel  decision 
with  direct  impact  on  the  eventual  research  produced.  It  is 
worth  asking  if  you  are  comfortable  learning  and  using  the 
complex  database  software.  If  the  honest  answer  is  that 
you,  the  researcher,  feel  uncomfortable  w'ith  anything  but 
basic  word-processing,  then  you  are  either  going  to  devote 
time  to  learn  or  going  to  rely  on  an  “expert." 

Second,  computer  databases  quickly  grow'  very  large. 
These  days  larger  capacity  hard  disks,  faster  processing 
machines,  and  computer  data  compression  programs2  are 
available,  but  these  technological  advances  carry  a cost  that 
goes  beyond  dollars  and  cents.  For  example,  data 
compression  programs,  like  all  software,  have  version 
numbers  printed  on  the  box  or  disks.  It  is  easy  to  forget 
that  any  version  is  never  perfect,  and  the  compression 
software  may  fail  usually  when  we  least  expect  it.  A good 
compression  program  should  be  “seamless."  This  means 
we  should  not  notice  the  wordprocessing,  database,  and 
other  programs  running  slowly,  not  performing  some 
functions,  or  freezing  the  screen  at  inconvenient  moments. 
Also,  compression  programs  take  up  the  computer's 
Random  Access  Memory  (RAM).  Modern  computer 
software  makes  great  demands  on  RAM,  and  this  demand 
leaves  users  frustrated  when  the  computer  refuses  to  run  a 
program  because  there  is  not  enough  RAM  memory  free. 
Finally,  the  compression  program  must  work  harmoniously 
with  your  chosen  back-up  program.  A computer 
environment  can  produce  unexpected  problems  that  take 
experts  weeks  to  solve1. 

Intense  competition  among  computer  hardware 
companies  has  made  large  hard  disks  cheap.  Unfortunately, 
the  larger  disk  capacity  tempts  users  to  store  bigger  data 
sets,  and  this  increases  the  costs  involved  in  a disk  failure. 
Wc  all  hate  to  backup  data  files.  1 invent  creative  reasons 


8 


Mid-Western  Educational  Researcher 


Volume  7.  Number  1 # Spring  NlM 


to  postpone  feeding  that  stack  of  disks  into  the  machine. 
Of  course,  there  are  alternatives  to  backing  up  a hard  disk 
with  floppies.  Removable  hard  disk  drives  and  other  devices 
exist  for  the  express  purpose  of  backing  up  hard  disks.  1 
urge  a small  pilot  experiment  that  tests  the  backup  system 
chosen  with  real  data.  The  time  to  discover  that  the  back- 
up system  does  not  work  is  before  data  are  entered  and  not 
when  the  completed  database  collapses.  Backup  is  a time- 
consuming  chore  but  one  that  is  essential. 

At  the  NCRTL  I accidentally  erased  several  weeks'  work. 
Other  disk  failures  on  my  computer  built  a sense  of 
insecurity  about  the  computers  hard  disk  storage4.  My 
sister,  a professional  archivist,  reinforced  my  insecurities 
by  telling  me  that  archivists  only  speculate  on  the  “shelf 
life’'  and  eventual  degrading  of  floppy  disks.  The  Center 
used  two  floppy  backup  disk  sets  which  added  cost, 
especially  as  l used  new  disks  every  year  just  in  case  constant 
use  affected  their  reliability.  Each  week  1 backed  up  the 
data  on  one  set  and  then  the  next  week  I used  the  other  set. 
The  Central  Point  PC-Tools  backup  program  allowed  me 
to  date  and  record  when  I used  each  set.  1 kept  a third 
backup  set  that  I used  once  a month  at  home  so  if  the  Center 
burnt  to  the  ground  I had  another  set.  Other  Center  staff 
kept  copies  at  home  or  in  other  locations.  Later,  when  we 
had  a reliable  computer  network,  the  NCRTL  maintained  a 
secure  subdirectory  where  1 loaded  yet  another  copy.  At  a 
conservative  estimate,  the  NCRTL  spent  several  million 
dollars  collecting  the  data.  Therefore,  it  did  not  make  sense 
to  Center  administrators  to  save  a few  dollars  economizing 
on  disks  and  regular  backup. 

Third,  an  important  step  is  to  estimate  the  final  database  s 
size.  There  is  nothing  as  embarrassing  and  potentially 
dangerous  as  partially  constructing  a database  and  then 
discovering  the  disk  will  not  store  the  complete  data  set. 
Therefore,  a good  estimate  saves  time  and  anxiety. 
Transferring  data  already  in  the  software  format  to  a new 
hard  disk  is  an  operation  full  of  unpleasant  surprises  and 
not  for  the  faint-hearted. 

1 employ  the  rule  of  thumb  that  a page  of  interview  text 
in  a wordprocessing  program  occupies  twice  that  in 
kilobytes  as  a basic  unit  in  my  estimate.  For  example,  even 
with  fast  talkers  a two-hour  interview  generates  a sixty  page 
transcript  that  creates  a one  hundred  and  twenty  thousand 
kilobyte  file.  The  pilot  instruments  help  document  size 
estimates.  The  sampling  or  research  design  gives  the 
potential  volume  of  interviews,  observations  and  other 
possible  instruments  that  generate  data.  A calculator  and 
half  an  hour  should  give  a reasonable  estimate  for  the 
database  size. 

At  the  NCRTL.  we  held  many  meetings  after  pilot  site 
visits  to  discuss  the  final  site  selection  and  possible  data 
collection  schedules.  It  should  surprise  nobody  that 
participants  argued  to  expand,  not  to  limit,  the  data 
collection  schedule  over  several  geographical  sites.  We 
planned  three  interview  and  observation  points  with  one 
site  visit  per  year  planned  at  the  eleven  selected  programs. 


1 used  the  discussions  to  determine  that  there  would  be 
ten  to  fifteen  program  participant  interviews.  The  pilot 
instruments  gave  me  an  estimate  that  those  interviews  would 
last  about  two  hours  and  generate  sixty  pages  each.  An 
observation  translated  into  another  twenty  pages  per  person. 
Then  l added  six  thousand  pages  of  program-related 
interviews  and  a further  two  thousand  pages  for  observation 
and  collected  documents.  The  director  and  1 sat  one 
afternoon  and  estimated  the  final  Teacher  Education  and 
Learning  to  Teach  (TELT)  database  could  generate  twenty- 
nine  thousand  seven  hundred  pages  of  program  participant 
interviews  (15  people  * 60  pages  * 3 visits  * 1 1 sites),  nine 
thousand  nine  hundred  pages  of  observation  (15  people  * 
20  pages  * 3 visits  * 1 1 sites),  and  eight  thousand  pages  of 
other  data.  Adding  a little  extra  for  safety,  we  discovered 
we  were  about  to  have  fifty  thousand  pages5  of  data  (95 
MB).  This  large  size  estimate  resulted  from  what  many 
researchers  had  argued  was  an  inadequate  data  collection 
schedule. 

The  disk  size  estimate  of  95  MB  is  too  small  because  it 
ignores  the  fact  that  wordprocessing  and  database  programs 
create  temporary  files  and  therefore  need  extra  space  to 
operate.  This  software  requirement  causes  those  annoying 
“disk  fuir  message  even  when  the  disk  still  shows  some 
free  space.  Furthermore,  database  and  infobase  software 
require  extra  disk  space  to  make  a backup  copy  during 
“house-cleaning  duties"  that  update  the  index6  and  repair 
damaged  texts.  Cheaper  and  larger  hard  disks  should 
encourage  generous  estimates.  Once  the  disk  is  filled,  you 
need  a computer  expert’s  help  to  preserve  the  database's 
integrity.  For  example,  without  enough  space  to  copy  the 
database  index  files,  data  can  become  irretrievable.  Any 
extra  hard  disk  space  is  rarely  wasted  because  we  need  it 
for  exporting  data  subsets  and  for  working  on  them  without 
resorting  to  slower  floppy  disks. 

After  we  know  the  data  set's  size,  the  next  step  is  to 
consider  which  machine  should  become  the  data's 
storehouse.  The  following  questions  might  guide  that 
thinking. 

A)  Is  anyone  willing  to  sacrifice  their  office  computer  or 
should  we  buy  a new  one  just  for  the  database? 

Obviously  this  depends  on  the  size  of  the  rough  estimate 
for  the  data  set  size.  As  a rule,  the  computer  we  use  for 
daily  work  may  not  be  the  best  choice  for  serious  database 
storage.  An  exception  to  this  situation  is  a small  data  set 
one  person  gathered,  transcribed,  and  analyzed.  The 
advantage  for  individual  researchers  is  that  they  can  retrieve 
data  for  quotes  or  revisit  the  data  to  refresh  their  memory 
as  they  write.  If  the  researcher  is  not  personally  building 
and  retrieving  the  data  (perhaps  a graduate  student  is  doing 
it,  for  example),  or  more  than  one  analyst  will  look  at  the 
data,  then  access  to  the  computer  and  office  is  an  issue. 

A computer  virus  is  more  than  just  annoying. 
Undetected,  a \irus  destroys  data  and  all  current  writing 
projects.  People  transcribing  interviews  may  use  infected 
computers  beyond  the  researcher's  ability  to  control.  It 


makes  sense  to  think  about  scheduling  a computer  (the 
computer  that  holds  the  database  is  fine  provided  we  invoke 
security  locks  to  limit  access  to  the  database)  for  transcribers 
to  use.  Supplying  the  computer  may  be  better  than 
contracting  the  transcription  work  out  to  unknown  computer 
environments.  Researchers  exercise  prudence  by  giving 
transcribers  new  clean  disks,  making  backup  copies,  and 
printing  one  hard  copy  of  the  transcript.  Also,  it  is  good  to 
install  virus-protection  software  in  any  computer  used  in 
the  research  project.  Besides  the  remote  possibility  of 
picking  up  a computer  virus  on  previously  used  disks, 
recycled  floppy  disks  fail  with  age,  weather  conditions,  and 
use. 

B)  Do  I need  a state-of-the-art  machine? 

The  answer  depends  on  many  things,  including  how  big 
the  database  is  likely  to  get.  Furthermore,  the  choice  of 
database  software  will  make  a difference.  For  example, 
IBM  machines  where  the  database  runs  in  a Windows 
environment  will  need  at  least  4 MB  and  probably  work 
better  with  16  MB  of  random  access  memory.  However,  if 
the  machine  is  used  to  store  only  the  database,  then  high 
processor  speed  is  not  essential.  Researchers  can  simply 
set  the  computer  to  work  on  a task  and  then  leave  it  to 
complete  it  while  they  get  on  with  other  things. 

C)  Do  we  all  need  the  same  type  of  computer ? 

If  the  researcher  dedicates  a single  computer,  then  there 
is  the  issue  of  whether  the  database  software  produces  files 
compatible  with  other  machines  used  by  people  on  the 
project.  Incompatibility  between  Apple  and  IBM  products 
is  disappearing  but  still  holds  surprises  for  those  trying  to 
exchange  files.  Translation  programs  between  different 
software  applications  add  another  step  and  time  and  money 
getting  the  data  to  other  researchers.  The  costs  increase 
because,  as  with  translations  between  different  foreign 
languages,  data  get  lost  and  garbled  in  the  translation. 

At  the  NCRTL  1 was  constantly  surprised  how  many 
versions  of  Disk  Operating  Systems,  RAM  resident 
programs,  and  strange  wordprocessing  systems  existed  in 
our  college  alone.  You  may  be  less  thrilled  when  people 
accuse  you  of  giving  them  incompatible  files  or  files  that 
retrieve  in  less  than  perfect  form.  Certain  hardware  types, 
software,  and  disk  interactions  produce  bizarre  and 
mysterious  results. 

Considerations  for  Computer  Database 
Construction  According  to  Purpose 

l)  Using  the  Computer  to  Store  and  Retrieve  Text 

1 assume  under  this  first  option  that  one  central  computer 
holds  all  the  interview  transcripts,  observation  write-ups, 
and  other  textual  material.  The  computer  is  like  a large 
filing  cabinet  with  many  similar  organizing  principles. 
Small  data  packets  are  retrieved  from  the  database  and  arc 
given  to  researchers  in  either  printed  or  floppy  disk  form. 


Data  entry.  Entering  data  is  a tedious  task  that,  like  its 
quantitative  counterpart,  requires  accuracy  and  care.  At 
the  NCRTL  we  set  up  a centralized  transcription  service 
which  takes  the  drudgery  out  of  producing  transcripts. 
Earlier  attempts  to  “contract  out"  this  work  resulted  in  hours 
of  extra  work  w'hcn  the  transcripts  arrived  in  less  than  perfect 
form  to  import  into  the  database.  We  found  it  very  difficult 
at  the  Center  to  get  people  to  “edit  and  review"  transcripts; 
this  task  was  a low  priority  on  many  researchers’  agendas. 
There  can  be  lively  debate  regarding  intonation,  pauses, 
and  whether  “Umm"  has  three  m’s  or  five;  yet  translating 
that  conversation  into  the  required  text  finds  few  volunteers. 

At  the  Center  we  spent  time  thinking  about  the  best 
format  for  the  transcribed  files.  Footnotes,  flying  headers, 
even  tabulation  conventions  can  add  hours  of  work  if 
something  has  to  be  stripped  from  the  transcription  to 
translate  the  interview'  file  into  the  database  software  format. 
Not  all  database  software  allows  the  full  range  of  fonts, 
highlighting,  and  other  special  characters  that  most 
wordprocessing  software  offers. 

Furthermore,  some  database  software  will  not  handle 
every  data  file  created  by  any  program.  One  NCRTL 
researcher  working  off-campus  had  a translation  program 
specially  written  on  a mainframe  to  convert  the  data  files 
produced  on  an  old  Apple  machine  and  its  outdated 
wordprocessor.  The  specific  problem  is  not  the  same  now, 
but  seven  years  ago  there  wrere  no  translation  programs  that 
worked  reliably.  1 dreaded  the  arrival  of  disks  that  I knew 
would  take  several  hours  to  prepare  before  I could  import 
them  into  the  database. 

Another  issue  that  requires  some  difficult  decisions  is 
the  record  size  in  the  database.  Different  database  programs 
place  restrictions  on  the  text  size  or  the  fields  in  a single 
entry.  This  is  the  old  unit  of  analysis  problem  in  computer 
form.  As  many  researchers  have  their  own  observation  or 
field  note  writing  styles,  this  needs  full  and  frank  discussion 
within  the  research  team.  Some  database  software  is  flexible 
in  working  with  various  data  formats;  other  software 
severely  restricts  the  format  to  increase  the  searching  and 
reporting  power  for  the  database  user.  A frank  discussion 
makes  public  individual  team  members’  misgivings  about 
the  inevitable  reduction  of  data  in  the  database.  The 
discovery  that  colleagues  disagree  with  the  data  reduction 
policy  is  best  made  before  the  data  are  collected.  Otherwise, 
the  data  entry  personnel  pul  up  with  the  disgruntled 
researcher’s  disagreement  or  outright  refusal  to  give  the 
data  in  the  required  form.  Entering  data  is  a mindless  and 
generally  a thankless  task,  but  never  has  the  computer  phrase 
“Garbage  In.  Garbage  Out"  been  so  literally  true. 

We  could  scan  documents  into  the  database.  It  is 
important  to  remember  that  scanners  and  the  software  to 
run  them  make  two  different  types  of  digital  (computer 
ready)  images.  Scanners  either  make  computer  graphic 
images  (pictures)  or  they  convert  the  written  text  into  the 
computer  standard  ASCII,  The  computer  cannot  read  text 
in  a graphic  image  scan  as  text.  This  easily  forgotten  fact 
causes  problems  when  a researcher  suggests  that  scanned 
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graphic  images  of  children's  work  and  other  handwritten 
documents  be  included  in  the  database.  These  computer 
pictures  are  not  treated  like  text  by  database  software,  so  it 
is  impossible  (now)  to  search  for  any  words  that  happen  to 
be  scanned  in  that  graphic  image.  Furthermore,  handwriting 
cannot  easily  be  scanned  and  converted  into  text,  only  stored 
as  an  image,  although  this  is  soon  becoming  possible. 

The  NCRTL  had  state-of-the-art  software  (SI, 200)  and 
a manual  one-sheet  feed  scanner.  A single-sheet  feeder 
allowed  us  to  adjust  the  page  correctly  before  scanning  the 
document.  Scanners  do  not  tolerate  misaligned  originals. 
A multisheet  feeder  cuts  down  handling  but  does  not 
significantly  improve  the  scanning  speed  for  the  average 
documents  researchers  bring  back  from  the  field.  Sheet 
feeders  require  staple  and  paper  clip  removal,  plus  clean 
and  flat  originals.  Just  think  how  often  the  sheet  feeder 
jams  or  misfeeds  on  a photocopy  machine.  As  a rule  of 
thumb,  20  laser-quality  printed  pages  take  two  hours  to 
transfer  into  the  database.  The  scanner,  like  a photocopier, 
is  very  sensitive  to  poor  document  quality.  The  time  spent 
in  correcting  errors  on  poorly-printed  material  rapidly 
increases  data  entry  time. 

Data  storing.  Database,  personal  information  manager, 
or  infobase  software  require  extra  hard  disk  space.  They 
need  that  space  for  backup  copies,  scratch  (working)  files, 
and  various  maintenance  programs.  As  a rule  of  thumb  I 
calculate  the  data  set  size  and  then  have  a hard  disk  at  least 
twice  as  big.  A reliable  commercial  backup  program  and  a 
regular  backup  schedule  during  the  database  building  are 
mandatory. 

Commercial  backup  programs  have  a hidden  advantage 
because  they  allow  easy  data  sharing  between  researchers 
in  the  database  s original  form  (with  the  codewords  etc.) 
via  the  backup  copy.  This  is  better  than  exporting  data  in 
ASCII  versions  where  the  codewords  and  formatting  for 
the  database  are  lost  in  the  exported  file.  Colleagues  can 
restore  the  backup  file  on  their  machine  using  the  same 
backup  program.  This  avoids  the  data  transfer  problems. 
If  we  all  use  the  same  commercially  available  backup 
program  on  the  different  computers,  we  can  exchange  data 
irrespective  of  the  DOS  versions  on  each  computer. 
Unfortunately,  the  DOS  software  backup  function  only 
restores  the  lost  data  to  a machine  using  the  same  DOS 
software  and  version  number.  Apple  machines  may  not 
have  backup  compatibility  problems  between  computer 
models,  but  this  merits  a thorough  investigation  before 
deciding  that  operating  system  backup  copies  arc  a good 
way  to  share  the  data. 

Data  retrieving.  The  key  issue  in  database  building  is 
how  well  we  can  search  and  retrieve  the  data  once  it  is 
built.  Data  reduction  decisions  could  return  to  haunt 
researchers  when  they  discover  that  the  data  retrieved  are 
no  good  for  their  proposed  analysis.  Sometimes  we  must 
choose  and  insert  the  codewords  for  the  data  as  they  arc 
entered  into  the  database.  1 think  of  these  sol)  ware  packages 


as  favoring  a “library  science"  design.  A library  science 
design  assumes  a largely  static  database  with  changes 
occurring  at  the  margins  as  new  book  titles  get  added  and 
other  titles  are  deleted.  A library  search  should  give  the 
required  book  or  books.  We  do  not  want  “false  hits"  which 
identify  books  we  are  not  interested  in.  This  means  that 
the  index  matches  how  people  will  want  to  search  the  data 
(just  like  the  labels  in  physical  file  cabinets).  The  library 
science  design  demands  clear  descriptive  category 
codewords  attached  to  each  individual  text.  For  example, 
clear  descriptive  coding  allows  us  to  retrieve  data  units  that 
were  coded  for  secondary  math  teachers  only.  Another 
possibility  is  creating  categories  that  distinguish  between 
different  data  collection  times  or  specific  interview 
questions. 

The  “library  science"  database  design  is  perfect  for 
research  data  sets  that  are  retrieved  in  small  packets  and 
analyzed  later.  Coding  categories  are  related  to  the  research 
questions  we  investigate.  It  helps  at  the  design  stage  to 
experiment  with  what  a search  for  the  required  data  will 
look  like  and  then  imagine  the  result  of  that  search.  1 spent 
several  weeks  using  the  database  software  and  some  pilot 
data  testing  different  size  data  units  and  running  searches. 
At  the  NCRTL,  the  research  questions  posed  concerned  two 
academic  subjects,  mathematics  and  writing;  thus 
suggesting  two  descriptive  categories.  We  had  research 
questions  that  asked  about  differences  in  views  about 
teaching  among  preservice,  inservice,  and  participants  in 
various  induction  programs.  These  research  questions 
suggest  a set  of  useful  descriptive  codewords  to  attach  to 
data  units7. 

The  database  software  choice  meant  that  we  reduce 
interview  data  into  a single  question  unit.  However,  the 
software  allowed  building  links  between  the  questions,  so 
wc  could  recreate  whole  interview  sections.  This  linking 
also  allowed  for  cases  where  informants  returned  to  earlier 
questions  in  a later  answer.  Most  observations  were  too 
large  for  the  software  to  handle  as  a unit,  so  we  used  the 
linking  strategy  again.  On  balance,  the  interview  data  unit 
made  sense;  but  the  decision  to  keep  the  observations  as 
units  which  were  too  large  for  the  database  to  handle  was 
poor.  Despite  the  links,  this  meant  in  practice  it  was  easy 
to  lose  whole  observation  sections  during  a search. 

The  “full  index"  database  design  favors  a research-style 
search.  In  the  library  science  search  we  zero  in  on  data 
with  precise  descriptive  code  categories  attached  to  them. 
In  a full  index  database  wc  can  search  for  analytic  coding 
categories  that  were  unknown  when  the  database  was 
designed.  Using  the  TFLT  database  as  an  example  there  is 
an  obvious  difference  between  searching  for  the  descriptive 
category  “question  C3"  and  identifying  the  text  that 
corresponds  to  the  analytic  category  “anxious  about 
teaching  math."  Question  C3  is  a description  that  applied 
to  a specific  piece  of  data,  whereas  the  analytic  code  is 
applied  to  different  texts  spread  throughout  the  interview. 

“Full  index"  database  software  indexes  all  words  in  the 
text.  Full  index  packages  give  frequency  counts,  and  the 
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user  can  preview  those  texts  that  have  certain  words  in  them. 
Indexing  every  word  eliminates  the  need  to  devise  the 
“perfect  codeword"  scheme  before  we  collect  the  data. 
a full  index  database  we  can  explore  emerging  themes  that 
come  from  familiarity  with  the  data.  A full  index  system 
gives  the  option  of  searching  groups  of  texts  to  find  multiple 
word  frequencies.  For  example,  a simple  word  search  for 
“empowerment"  might  produce  650  texts  (perhaps  over  a 
megabyte  of  information).  The  search  could  narrow  by 
looking  for  the  topic  “teacher  NOT  student  empowerment" 
in  the  database.  It  is  even  possible  to  run  multiple  word 
searches,  “teacher  empowerment"  and  “student 
empowerment,"  to  compare  the  results.  Most  full  index 
programs  can  reduce  the  search  to  trim  the  data  packet  size 
to  more  manageable  proportions  before  we  transfer  the 
search  results  onto  a disk  or  print  it. 

Database  software  has  sophisticated  word  searching 
capabilities  that  include:  and\or\but  statements,  wildcard 
or  fuzzy  (similar  to  brain-storming  sessions)  searches.  The 
key  benefit  here  is  that  the  software  will  report  the  search 
result  in  a form  that  is  in  accord  with  the  researchers 
planned  analysis.  Most  database  software  packages 
incorporate  library  science  and  full  index  design  elements. 
However,  there  are  differences,  and  thorough  pilot-testing 
will  pay  dividends  later.  Finally,  searching  and  transferring 
data  in  and  out  of  the  database  arc  decision  issues  that 
depend  on  the  combination  of  the  database  software  and 
the  computer  hardware.  Sophisticated  searches  and  large 
data  transfers  place  demands  on  the  computer.  These 
operations,  such  as  a complex  search  or  importing  large 
data  sets  into  full  index  design  databases,  can  take  the 
machine  several  hours  to  complete. 

Finally,  for  data  retrieval,  we  should  think  about  the 
form  researchers  in  our  project  want  the  data.  Sometimes 
the  database  software  allows  us  to  chop  the  data  into  floppy 
disk  sized  chunks  (360  KB.  720  KB,  or  1.2  MB).  Other 
software  comes  with  a separate  utility  (a  stand-alone 
program)  to  export  data  onto  several  disks.  A final 
alternative  is  to  rely  on  backup  programs  to  spread  data 
over  several  disks.  Several  database  programs  compress 
the  data  during  .he  export,  which,  while  it  saves  floppy 
disk  space,  adds  another  layer  of  complexity.  It  is  easy  to 
forget  that  the  person  receiving  the  data  does  not  ha\e  the 
file  to  decompress  the  data  or  that  the  result  of  these  two 
extra  operations  is  some  data  loss. 

If  you  want  your  data  in  printed  form  then  a fast  printer 
is  a consideration.  Four  60  page  interviews,  at  six  pages 
per  minute  on  the  LaserJet,  equals  45  minutes  of  printing 
and  refilling  the  paper  tray.  One  NCRTL.  researcher 
requested  data  based  on  every  mention  of  a word.  This 
investigator  asked  that  I conduct  a “fuzzy"  search  so  that  1 
identified  all  data  units  with  this  word\  1 carried  out  the 
search  looking  for  all  words  with  the  root  pattern  "teach" 
such  as  teaching  and  teacher.  The  search  produced  \ en- 
large text  files  (just  under  two  megabytes  in  all).  1 assumed 
the  researcher  would  read  the  files  from  the  screen  and 
discard  unnecessary  information.  Later.  1 learned  she 


printed  all  the  files,  about  one  thousand  pages,  which  tied 
up  that  shared  printer  for  about  three  hours.  The  lesson  1 
learned  is  to  ask  how'  the  data  are  to  be  analyzed  after  the 
search. 

2)  Using  the  Computer  to  Store  and  Retrieve  Graphics 
Graphic  files  are  very  different  from  files  that  store  text. 
The  most  visible  difference  is  that  we  may  edit  a graphic 
file  only  in  drawing  software,  not  wordprocessing  software. 
If  you  want  the  database  software  to  search  for  words,  they 
have  to  be  typed  as  text  and  then  linked  to  the  graphic  file, 
perhaps  as  a title  or  footnote.  A database  text  search  cannot 
look  in  a graphic  file  for  words  that  appear  in  the  picture. 
A proposed  database  filled  with  graphic  images  is  suited  to 
the  “library  science"  design  and  not  to  the  “full  index" 
design  which  is  more  suited  to  analytic  text  searches.  People 
who  are  transferring  their  photographs  onto  CD-ROM  disks 
face  the  same  search  problem  as  a researcher  who  has  100 
student  work  examples  stored  in  graphic  files.  Each  picture 
should  be  clearly  and  uniquely  identified  for  quick  retrieval. 

Scanning  images  (not  text)  is  very  useful  for  keeping 
records  like  student  handwriting.  Here  the  issue  is  whether 
the  database  software  we  use  allows  graphic  images  to  be 
imported  and  shown  on  a screen.  Sharing  graphic  images 
requires  special  drivers  (instructions  to  make  them  appear 
on  the  screen)  that  may  mean  purchasing  multiple  copies 
of  the  database  software.  Not  all  researchers  want  to  learn 
how  to  operate  the  database  software  that  allows  graphic 
image  display.  Wordprocessors  have  limited  graphic  display 
capacities. 

The  other  major  issue  is  the  size  of  graphic  files.  A 
child's  one-page  homework  could  produce  a file  over  100 
KB  in  size.  A few  seconds  of  video  can  involve  file  sizes 
beyond  the  floppy  disk  capacity.  CD-ROM  (laser  disk)  is 
then  an  options,  but  involves  extra  expense.  There  are 
compact  disks  that  allow  users  to  write  files,  but  they  are 
very  new  and  therefore  expensive.  The  alternative  is  to  get 
the  video  tape  commercially  transferred  onto  the  CD  disk. 

3)  Using  the  Computer  to  Analyze  Text 

When  we  move  beyond  using  the  computer  like  an 
electronic  filing  cabinet,  then  we  add  power,  complexity, 
and  costs  to  the  database.  Some  database  software  provide 
powerful  data  analysis  tools.  Several  researchers  at  the 
NCRTL  used  the  database  software  for  analysis.  There  arc 
other  researchers  who  used  separate  analysis  software.  In 
general,  database  software  suits  interpretive  and  descriptive 
research  styles  but  is  less  useful  for  theory  building  analysis 
styles.  Several  specialized  analysis  packages  are  more 
suited  to  constructing  hypotheses  and  then  testing  them  on 
the  data.  The  decision  to  use  different  qualitative  analysis 
software  raises  new  compatibility  issues  for  the  database 
output.  These  specialized  packages  restrict  the  file  sizes 
and  the  format  for  data  to  be  imported.  For  example,  the 
hthnograph  analysis  software  imports  ASCII  files  that  are 
less  than  40  characters  wide. 
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A major  task  in  analysis  is  inserting  analytic  categories 
into  the  data,  not  just  associating  simple  descriptive 
codewords  to  units  of  data.  Those  who  participated  in  or 
who  observed  the  coding  and  ‘‘chunking”  of  NCRTE*  data 
(splitting  interview  transcripts  into  meaningful  analysis 
units)  appreciated  the  effort  and  the  organization  adding 
analytic  coding  involved.  The  decision  required  people  to 
hold  lengthy  meetings  to  code  the  questions  and  sections. 
An  eight-person  team  inserted  those  analytic  codes  into 
the  interviews  using  over  300  keyboard  macros  developed 
to  minimize  typing  errors.  In  a few  sentences  1 have 
condensed  a two-year  effort.  My  conclusion  with  hindsight 
would  be  that  analytic  coding  has  to  be  idiosyncratic  to  the 
specific  analysis  purposes.  In  some  projects  general  analytic 
codes  might  make  sense,  but  each  analytic  code  added 
across  the  whole  database  increases  time  and  effort  costs 
dramatically. 

4)  Using  the  Computer  to  Analyze  Graphic  Materials 

Researchers  who  propose  to  use  the  computer  to  analyze 

graphic  materials  are  entering  a new  field.  Some  programs 
designed  for  hypermedia  or  multimedia  presentations  allow 
fine  control  of  visual,  audio  and  text  material.  With  effort 
and  time  these  programs  have  interesting  analytic 
possibilities.  For  example,  you  can  control  video  images 
from  a CD  disk  to  single  frames.  If  micro-analysis  of  visual 
material,  like  video,  is  a major  research  interest,  then  the 
new  software  will  allow  people  to  attach  text  coding  to 
small  pieces  of  observation.  However,  we  must  observe 
that  being  this  close  to  technology's  cutting  edge  carries 
the  risk  of  being  badly  wounded! 

5)  Using  Computers  to  Distribute  Data  Stored  on  One 
Machine  to  Others . 

Here  the  special  issue  is  the  link  between  the  computers. 
In  the  single  building  scenario,  networking  is  a workable 
possibility.  Maintaining  and  upgrading  the  network  is  the 
responsibility  of  the  college  computer  support  department. 
This  may  raise  some  data  control  or  security  issues.  If  the 
network  is  used  to  transfer  information  then  the  network 
must  be  reliable.  It  is  worth  asking  colleagues  how  often 
in  a week  the  network  denied  them  access.  Another 
possibility  with  networked  computers  is  to  get  the 
transcriptions  entered  directly  into  the  database  located  in 
the  network  server  from  the  “transcribing  factory.” 

In  sending  data  between  two  computers  you  enter  the 
world  of  modems,  mainframe  computers  and  ethcrnct 
connections.  Data  transfer  on  a modem  can  involve  hours 
of  fun  for  both  the  giving  and  receiving  parties.  The  larger 
the  files  the  more  fun  and  expense!  Communicating  among 
two  or  more  computers  that  can  be  radically  different  can 
be  a complex  task;  sometimes,  the  best  vou  can  produce  is 
a successful  “handshake”  (link). 

The  ethcrnct  connection  board  is  like  a super-fast  modem 
in  the  computer.  This  board  allows  almost  instantaneous 
communication  using  File  Transfer  Packets  (FTP).  Internet. 


w'hich  is  best  reached  through  ethernet  boards,  is  worldwide. 
Most  higher  education  institutions  provide  easy  ways  to 
enter  the  Internet  network.  However,,  the  Internet  system 
is  very  new  and  not  a friendly  environment  for  novice 
computer  users.  Researchers  soon  discover  that  the 
connection  of  personal  computers  through  ethernet  or  other 
wide  area  network  systems  is  not  a trivial  or  an  inexpensive 
task.  Suppose  we  keep  the  files  on  one  machine,  and 
colleagues  can  reach  all  the  files  on  that  computer's  disk 
and  transfer  (or  erase  or  alter)  those  files.  We  need  to 
remember  that  providing  access  to  a computer  opens  the 
possibility  of  access  for  anyone  else  on  the  Internet. 
Therefore,  giving  people  remote  access  to  a computer  raises 
security  and  data  integrity5 * 7  issues. 

6)  Using  the  Computer  to  Allow  Researchers  Access  to 
Data  From  Remote  Sites 

The  purpose  here  is  to  allow  researchers  to  explore  the 
database  from  their  computers.  Researchers  can  consider 
a network  version  of  the  database  software  that  allows 
different  access  levels  to  the  data.  Most  database  software 
has  a network  version.  This  requires  the  network  manager 
to  set  up  the  software  in  the  network  server  and  maintain 
security.  It  also  requires  consultation  and  planning  with  the 
college  computer  support  group.  There  is  a difference 
between  network  and  single-user  software.  Database 
software  for  single  machines  often  has  blocks  (and  a bug 
that  destroys  the  data)  to  discourage  “pirate”  network  use. 
To  network,  you  must  either  pay  for  the  more  expensive 
network  version  or  investigate  options  such  as  adapting 
existing  network  database  programs. 

Researchers  who  plan  to  establish  their  databases  on 
the  mainframe  certainly  allow  for  data  sharing  anywhere 
in  the  world.  I can  imagine  researchers  in  the  field  being 
able  to  enter  data  or  do  analysis  from  any  location.  However, 
anyone  involved  with  such  a project  would  be  a brave 
pioneer  in  education  research.  Mainframe  database 
programs  cost  thousands  of  dollars.  Reliability  is  a plus, 
while  the  less  friendly  mainframe  environment  is  a big 
minus.  Hiring  an  expert  on  the  particular  mainframe 
program  to  consult  for  the  database  design  is  a cost-saving 
decision. 

7)  Using  the  Computer  to  Provide  Innovative  Presentations 
of  Analysis 

1 can  imagine  some  interesting  uses  for  database 
software.  There  arc  presentation  programs  that  allow 
exciting  teaching  or  professional  data  presentations.  I would 
urge  people  to  think  about  distributing  research  resultacusing 
the  database  and  other  software  available.  Nowadays,  the 
programs  are  easier  to  use  and  multimedia  setups  are  more 
readily  available  at  professional  meetings.  However, 
problems  with  data  transfer,  computer  networks  and  special 
interest  listservers  (to  share  data  or  results  with  colleagues), 
are  possible  with  newly  developed  presentation  software. 
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Summary 

I hope  my  readers  now  agree  that  data  management 
before  analysis  is  an  important  step.  Although  I gave 
examples  based  on  large  data  sets  from  big  projects,  1 
employ  the  same  thinking  when  I help  others  or  when  I 
build  smaller  databases.  Whatever  analysis  we  want,  it  is 
crucial  that  it  is  organized  so  that  we  can  exploit  the  data 
we  carefully  gathered  to  its  fullest  extent. 

1 identified  two  database  designs,  library  science  and 
full-index,  which  do  not  represent  an  either-or  choice. 
Neither  would  l argue  that  one  design  is  better  than  another. 
The  choice  reflects  stylistic  differences.  With  your  research 
questions  and  your  research  style,  you  are  in  the  best 
position  to  know  what  variety  of  database  best  suits  your 
needs.  I introduced  seven  data  management  purposes  that 
form  a hierarchy  of  increasing  complexity. 

The  simplest  purposes  1 suggested  were  that  a computer 
is  no  more  than  a compact  and  an  efficient  electronic  filing 
cabinet.  Researchers  can  use  the  computer's  capability  to 
search  and  retrieve  data  that  represents  a great  improvement 
over  paper  and  tapes  thrown  into  a box.  Good  data 
management  results  in  better  analysis. 

A higher-level  purpose  adds  analysis  to  retrieval  and 
storage.  The  database  software  could  analyze  the  data, 
although  1 think  most  commercial  databases  have  significant 
limitations  as  analysis  tools.  Database  software  in  the 
library  science  style  restricts  the  search  and  therefore  is 
likely  to  make  the  analyst  miss  interesting  but  obscure 
relationships.  There  are  some  radically  different  database 
and  information  management  software  packages  available, 
so  it  pays  to  evaluate  several  and  not  rely  on  the 
recommendation  of  a converted  individual  who  uses  one 
package. 

At  the  highest  levels,  database  software  represents  some 
powerful  possibilities  to  share  data  among  colleagues  for 
either  analysis  or  presentation  purposes.  There  are  several 
database  packages  that  offer  the  possibility  to  share  data 
across  incompatible  computer  brands  (IBM  and  Macintosh, 
so-called  multiplatform  software)  and  share  the  data  across 
different  operating  systems  (for  example  UNIX,  DOS). 
Also,  many  commercial  database  packages  follow  the  SQL 
standard  (this  allows  network  users  to  find  information  in  a 
database  though  they  do  not  have  the  program  that  created 
it).  Several  database  packages  have  programming 
capabilities  that  allow  automatic  coding,  embedding  sound 
and  pictures  in  a text,  or  making  automatic  changes  in  the 
text's  presentation. 

It  is  possible  to  spend  too  much  time  perfecting  the  data 
management  scheme,  time  that  would  be  better  spent 
looking  at  the  data.  Also,  1 am  sympathetic  with  those  who 
argue  that  the  computer  is  a reductionist  tool  that  docs  great 
violence  to  data.  Building  a database  involves  decisions 
that  at  the  time  may  seem  insignificant  and  yet  can 
irrevocably  close  analytic  possibilities.  However,  that 
unsorted  box  of  tapes  docs  not  represent  unlimited  analytic 
possibilities  that  will  be  fully  explored  by  the  researcher. 


The  computer  and  the  box  both  reduce  the  analytic  options. 
Therefore,  we  are  left  with  deciding  whether  we  like  to 
control  that  reduction  or  simply  let  it  occur  through  our 
inactivity. 

FOOTNOTES 

1 The  author  would  like  to  thank  G.  W.  McDiarmid,  D.L.  Peterson,  and 
two  anonymous  rev  iewers  for  their  comments  on  earlier  drafts  of  this 
article.  Responsibility  for  any  remaining  mistakes  remain  the  authors. 

: Compression  programs  use  technical  tricks  that  squeeze  files  into 
smaller  spaces  or  that  enlarge  the  storage  space  available  on  the  hard 
disk.  Some  Disk  Operating  Systems  (c.g.,  MS-DOS  6.0)  come  with 
compression  programs.  An  example  of  a popular  stand-alone 
compression  program  is  Stacker  by  Stac  Electronics. 

' My  best  example  is  a seemingly  innocent  joystick  controller  card  that 
after  working  perfectly  suddenly  caused  WordPerfect  to  lock  the  whole 
machine  when  1 tried  to  preview  my  document  before  printing.  It  took 
several  weeks  and  numerous  consultations  to  identify  the  problem. 

4 A hard-disk  is  the  non-rcmovablc  drive(s)  in  the  computer.  A floppy 
disk  is  removable  although  the  3 l -2  inch  versions  are  hardly  flexible. 
Magnetic  back-up  tapes  use  the  same  technology  to  store  data.  CD- 
ROM  disks  on  which  users  can  store  data  are  expensive,  and  they  arc 
used  by  large  companies  to  store  legally  required  records. 

5 The  50,000  pages  or  95MB  estimate  was  wrong.  The  TELT  database 
was  70  MB.  However,  the  estimate  allowed  me  to  argue  for  a 1 50  MB 
disk  to  accomodate  other  software.  As  the  next  paragraph  describes, 
working  files  and  other  database  house  cleaning  files  required  140  MB 
to  effectively  run  the  database.  Therefore,  sheer  luck  allowed  me  to 
look  right  when  1 was  wrong. 

* A database  index  is  like  the  index  of  a book.  It  allows  the  reader  to 
search  for  topics  and  words.  However,  if  a database  loses  its  index,  you 
cannot  access  the  database.  In  the  book's  case,  although  it  takes  longer, 
you  can  still  look  thorugh  the  pages  to  find  things  without  an  index. 

For  those  interested  in  a full  description  of  the  descriptive  and  analytic 
codes  in  the  TELT  database,  sec  Mead.  J.  V (1993).  A guide  to  the 
Teacher  Education  and  Learning  To  Teach  Database.  (Technical  Scries 
93-2).  East  Lansing:  Michigan  State  University.  National  Center  for 
Research  on  Teacher  Learning. 

K I have  changed  the  word  1 searched  for  because  it  would  identify  a 
colleague  who  is  known  for  work  in  this  area. 

g The  National  Center  for  Research  on  Teacher  Learning  (NCRTL)  was 
known  during  the  TELT  study  as  the  National  Center  for  Research  on 
Teacher  Education  (NCRTE). 
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Tenure  and  Promotion:  Questions  to  Ask  and  Strategies  for  Success 

Orpha  K.  Duell,  Wichita  State  University 


Advice  is  provided  to  prospective  faculty  concerning  the  questions  they  should  ask  about  tenure  and  promotion 
procedures  when  they  arc  interviewing  for  a position.  This  is  followed  by  advice  on  strategies  to  adopt  as  a new 
faculty  member  to  enhance  the  likelihood  o f earning  tenure  and  promotion. 


Seeking  information  about  tenure  and  promotion  while 
interviewing  for  a position  may  help  you  select  a position 
that  matches  your  goals  and  strengths.  Policies  appear  in 
the  faculty  handbook  or  other  written  materials  provided 
by  the  institution.  Just  as  important  are  the  current  practices 
at  the  institution  as  they  establish  the  norm.  This  article 
provides  suggestions  for  gaining  information  regarding 
institutional  policies  and  norms,  as  well  as  strategies  that 
should  help  the  beginning  faculty. member  become 
successful  at  attaining  both  tenure  and  promotion. 

Find  out  when  probationary  faculty  (a  faculty  member 
in  a full-time  position  that  can  lead  to  tenure)  will  be 
considered  for  tenure.  Some  institutions  will  grant  early 
tenure;  some  will  not.  Additionally,  be  aware  that  norms 
regarding  the  granting  of  early  tenure  can  change  suddenly 
when  new  persons  assume  key  administrative  roles  in  the 
institution  (e.g.,  president,  chief  academic  officer).  Early 
tenure  refers  to  granting  tenure  to  a probationary  faculty 
member  before  his  or  her  seventh  year.  To  understand  why 
this  is  considered  early,  it  is  useful  to  know  the  time-line 
adopted  by  many  institutions.  This  time-line  is  congruent 
with  the  American  Association  of  University  Professors 
(A. A. U.P.)  policies  which  consider  a faculty  member  to 
have  been  tenured  by  an  institution  if  it  hires  the  person  for 
an  eighth  year  in  a full-time  faculty  position.  If  a 
probationary  faculty  member  will  not  be  rehired  and  he  or 
she  has  been  with  the  institution  two  or  more  years, 
institutions  usually  inform  the  faculty  member  at  least  1 2 
months  before  the  expiration  of  the  contract.  This  gives 
the  probationary  faculty  member  a year  in  which  to  find  a 
position  at  a different  institution.  This  also  means  the 
institution  must  make  its  tenure  decision  by  the  faculty 
members  sixth  year  of  service.  Therefore,  it  is  common 
for  untenured  faculty  to  submit  their  credentials  at  the 
beginning  of  their  sixth  year  so  that  final  decisions  may  be 
made  toward  the  end  of  that  year.  Decisions  made  before 
the  sixth  year  would  be  early  decisions. 

Determine  whether  tenure  and  promotion  arc  linked 
together.  The  tradition  at  some  institutions  is  to  tie  tenure 
with  promotion  (sometimes  called  “up  or  out").  In  these 
institutions  an  assistant  professor  who  is  tenured  is  promoted 
to  associate  professor;  an  assistant  professor  whose 
credentials  do  not  merit  promotion  is  not  tenured.  Other 


institutions  will,  on  occasion,  tenure  persons  they  do  not 
promote.  This  may  be  because  the  candidate  is  filling  a 
vital  need  for  the  institution  or  because  it  appears  the 
candidate  is  making  progress  toward  meeting  the  criteria 
for  promotion. 

Ask  if  the  institution  has  tenure  quotas  and  what 
percentage  of  the  faculty  in  the  department  you  will  be 
joining  is  tenured.  Tenure  quotas  arc  often  in  the  form  of  a 
maximum  percentage  of  the  faculty  within  a department 
who  may  be  tenured.  If  you  are  joining  a department  where 
all  faculty  arc  tenured  or  will  have  been  considered  for 
tenure  when  your  turn  comes,  you  should  know  that  from 
the  beginning.  Even  if  the  institution  does  not  have  stated 
tenure  quotas,  your  case  may  be  examined  more  closely, 
perhaps  with  slightly  higher  standards  purposefully  or 
unconsciously  applied  if  your  tenure  would  result  in  a very 
high  percent  of  tenured  faculty  within  the  department. 

Find  out  who  makes  the  tenure  and  promotion  decision. 
This  influences  how  accurately  you  and  others  providing 
guidance  (e.g.,  your  department  chair)  can  judge  the 
likelihood  that  you  will  be  tenured.  If  the  decision  is  based 
upon  a vote  of  the  department  faculty  and  the 
recommendation  of  the  department  chair,  it  is  easier  to  make 
accurate  predictions  than  if  the  decision  goes  through 
department,  college,  and  university  committees  in  addition 
to  the  administrators  at  each  level.  On  the  other  hand  when 
there  are  checks  and  balances  of  reviews  at  other  levels, 
you  may  have  some  protection  if  the  faculty  in  your 
department  happen  to  apply  higher  standards  than  those  in 
other  segments  of  campus.  Realistically,  without  the  support 
of  your  department  faculty,  it  is  very  unlikely  that  you  will 
be  given  tenure.  This  is  just  as  well  since  few  would  want 
to  work  daily  with  people  who  do  not  believe  you  belong 
in  the  department. 

Ask  for  the  institution's  criteria  for  earning  tenure  and 
promotion.  Detailed,  precise  statements  of  criteria  are  the 
exception,  not  the  rule,  and  have  not  always  proven  helpful 
when  available.  At  one  midwestern  institution  a college  of 
engineering  developed  a detailed  point  system  that  staled 
precisely  hew  many  points  could  be  earned  by  each  activity 
as  well  as  the  number  of  points  needed  for  tenure  and 
promotion.  Although  helpful  in  theory,  in  practice  it  was  a 
nightmare.  Faculty  evaluated  their  credentials  and  decided 
they  had  enough  points,  while  review  committees  arrived 
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at  different  conclusions.  The  system  created  more  problems 
than  it  solved. 

Determine  what  activities  are  considered  within  each 
area.  Statements  of  criteria  are  apt  to  cover  three  areas: 
(a)teaching,  (b)  scholarly  and/or  creative  activity,  and  (c) 
service.  For  example,  some  institutions  count  thesis 
supervision  under  teaching:  others  count  it  under  service. 
Knowing  what  is  considered  in  each  area  allows  you  to 
assess  more  accurately  how  you  are  dividing  your  efforts. 
Additionally,  find  out  what  kind  of  evidence  is  traditionally 
submitted  in  each  area.  Soon  after  you  arrive  on  campus, 
begin  files  for  each  area  into  which  you  drop  the  evidence 
as  it  accumulates  (e.g.,  a letter  informing  you  a manuscript 
has  been  accepted  for  publication,  records  of  service  on  a 
committee). 

Ask  for  the  relative  weights  given  to  the  three  areas. 
Answers  may  come  in  words  (e.g.,  above  average  in  two  of 
the  three  areas  and  average  in  the  third)  or  in  percentages 
(e.g.,  40%  teaching,  40%  research/scholarly  activity,  and 
20%  service).  Follow  up  by  asking  for  more  precise 
information  (e.g.,  how  many  journal  articles  constitutes 
above  average).  Expect  qualified  answers,  especially  if 
decisions  are  reviewed  by  committees  at  several  levels,  since 
no  one  can  say  ahead  of  time  precisely  what  a given 
committee  will  judge  as  above  average.  Also,  expect  the 
answer  to  be  qualified  in  terms  of  the  nature  of  the 
publications  or  service  (e.g.,  national  refereed  journal  as 
opposed  to  invited  state  publication).  Given  a choice  of 
areas  to  emphasize,  it  w'ould  be  wise  to  select  research  and 
scholarly  activity  as  an  area  of  emphasis.  This  area  is  easier 
to  document,  is  more  apt  to  be  valued  as  standards  change 
over  time,  and  is  more  apt  to  provide  flexibility  if  you  decide 
you  would  like  to  move  to  a different  institution.  Expect 
the  standards  and  relative  weights  to  change  with  time. 
Changes  usually  happen  gradually  but  can  occur  rapidly  as 
a result  of  new  persons  assuming  key  administrative 
positions  (e.g.,  the  chief  academic  officer  of  the  institution, 
the  dean  of  your  college,  and  even  perhaps  your  department 
chair). 

Ask  if  your  progress  is  reviewed  before  the  actual  time 
a tenure  decision  is  made.  At  my  institution,  probationary 
faculty  arc  reviewed  twice  their  first  year  and  once  each 
year  thereafter.  Probationary  faculty  compile  their  vitae, 
much  as  they  would  at  the  time  of  tenure  review,  and  submit 
it  to  the  department  chair.  The  department  chair  completes 
a form  that  evaluates  each  faculty  member’s  performance 
and  states  whether  the  department  faculty  would 
recommend  that  the  person  be  rchired.  The  chair  meets 
with  each  probationary  faculty  member  and  reviews  the 
evaluation.  The  faculty  member  signs  the  form  indicating 
that  lie  or  she  has  seen  the  completed  form.  Faculty  receive 
a copy  of  the  completed  form.  If  your  institution  follows  a 
similar  pattern,  use  developing  your  vita  and  annual  report 
as  an  opportunity  to  review  what  you  have  done.  Decide 
whether  you  need  to  adjust  how  you  spend  your  time. 
However,  if  your  institution  does  not  require  you  to  compile 
your  vita  each  year,  do  so  anyway.  This  provides  an 


opportunity  for  self-evaluation  and  provides  basic  materials 
that  you  can  use  when  developing  your  tenure  review 
portfolio. 

Read  carefully  any  suggestions  you  receive  in  your 
written  evaluation  asking  for  clarifications  as  necessary.  If 
you  have  a meeting  with  the  department/personnel  chair, 
record  any  oral  suggestions  regarding  how  you  should 
change  your  efforts.  If  the  report  is  completely  positive, 
ask  whether  if  you  continue  doing  the  same  things  in  the 
same  way,  you  can  expect  to  be  granted  tenure  when  the 
time  comes.  If  change  is  needed,  explore  ways  your 
teaching  and  service  assignments  might  be  adjusted  to 
support  the  needed  changes.  Leave  the  meeting  with  an 
agreement  on  how  you  should  divide  your  time  during  the 
next  year.  Return  to  this  agreement  any  time  you  are  asked 
to  accept  additional  assignments.  It  is  easier  to  turn  down 
a request  to  chair  a committee  if  you  can  say  that  your 
department  chair  has  asked  you  to  spend  less  time  on  service 
and  more  on  writing.  Listen  carefully  to  the  chairs 
suggestions  for  change.  This  is  critical  for  developing 
realistic  notions  about  whether  you  will  be  granted  tenure. 
For  example,  last  year  a probationary  faculty  member  in 
my  department  was  turned  down  for  tenure.  His  department 
chair  and  unit  coordinator  both  said  the  yearly  reviews 
should  have  prepared  hjm  for  that  decision:  still,  he  wa* 
shocked  by  it.  He  evidently  had  heard  only  the  positive 
comments. 

Ask  one  or  two  tenured  faculty  to  review  your 
credentials  about  halfway  through  your  probationary  period 
if  the  procedures  used  by  your  department  do  not  routinely 
provide  feedback  from  faculty  other  than  the  department 
chair.  Using  this  approach  you  will  not  count  on  only  one 
person  s opinion.  For  example,  in  my  department,  each 
year  all  tenured  faculty  read  the  credentials  of  probationary 
faculty  and  vote  on  whether  each  person  should  be  rehired. 
Their  votes  count,  and  their  advice  on  how  to  strengthen 
the  credentials  arc  shared  with  the  faculty  member.  This 
provides  the  probationary  faculty  member  with  a very  good 
idea  of  w'hat  the  tenure  vote  will  be.  These  early  reviews 
by  tenured  faculty  were  instituted  after  a probationary 
faculty  member  had  consistently  received  positive  yearly 
reviews  from  a department  chair  only  to  be  turned  down 
for  tenure  by  the  sixth-year  faculty  vote.  Usually,  a chair  s 
standards  are  congruent  with  those  of  the  faculty,  but  that 
is  not  always  the  case. 

Find  one  or  two  established  faculty  from  whom  you  can 
seek  advice  you  trust.  You  may  find  many  willing  to  give 
advice.  But,  you  should  choose  carefully  when  deciding 
to  whom  you  will  listen.  Evaluate  the  advice  you  arc  given 
in  terms  of  whether  it  is  based  upon  your  best  interests  or 
some  private  agenda  the  advisor  may  have.  Even 
department  chairs  sometimes  provide  advice  that  is  not 
congruent  with  college  and  university  standards.  Two 
assistant  professors  1 know  had  a department  chair  who 
stressed  the  importance  of  service  while  the  college  and 
university  were  stressing  the  importance  of  research  and 
writing.  Both  were  tenured  but  not  promoted.  Therefore. 


determine  what  is  being  stressed  by  your  dean  and  by  the 
university. 

Collecl  and  save  data  you  will  need  when  you  compile 
your  vita  for  tenure  review.  At  my  institution,  the  basic 
document  may  not  exceed  25  pages  but  may  be 
accompanied  by  supporting  materials.  Teaching  is  a 
difficult  area  to  document.  Research  institutions  may  pay 
little  if  any  attention  to  this  area  as  long  as  you  teach  your 
assigned  classes  and  no  horror  stories  emerge.  In  my 
department,  it  is  unlikely  that  a poor  teacher  will  receive  a 
positive  tenure  vote.  Therefore,  new  faculty  are  advised  to 
concentrate  initially  on  getting  their  teaching  ratings  in 
order,  in  the  first  semester  or  two,  and  then  concentrate  on 
research  and  writing. 

Find  out  what  other  faculty  typically  use  to  obtain 
student  evaluations  of  teaching.  You  will  need  to  submit 
student  evaluations  of  your  teaching.  Probationary  faculty 
are  wise  to  collect  this  information  for  every  class  they 
teach.  Since  it  is  not  mandated,  such  data  may  be  collected 
but  need  not  be  submitted  for  every  class  if  the  faculty 
member  chooses.  Adopt  a single  form  for  student 
evaluations  and  use  it  throughout  your  probationary  years. 
It  is  easiest  to  improve  your  ratings  during  those  early 
semesters,  and  that  improvement  can  only  be  seen  if  the 
same  instrument  is  used  semester  after  semester. 
Additionally,  an  evaluation  form  that  gives  normative  data 
comparing  your  student  ratings  with  those  of  other  faculty1 
provides  more  useful  information  to  you  and  those 
reviewing  your  vita.  U.S.  students  tend  to  be  kind  in  their 
ratings.  Experienced  faculty  and  administrators  know  this 
and  are  less  impressed  with  ratings  the  naive  faculty  member 
may  think  are  exceptional.  If  you  submit  student  comments 
for  a class,  include  all  comments  and  be  sure  readers  know 
you  have  submitted  all  of  them.  Any  teacher,  no  matter 
how'  bad,  can  find  a few  positive  student  comments  over  a 
period.  Exclusively  positive  comments  make  review 
committee  members  suspicious  since  it  is  generally 
impossible  to  please  all  students  in  a class. 

Be  judicious  in  terms  of  how  much  time  you  spend  on 
information  materials  about  the  courses  you  teach.  Course 
syllabi  sometimes  provide  useful  information  about  leaching 
if  they  indicate  how  current  the  course  content  is.  Generally 
weaker  candidates,  those  with  fewer  publications,  spend 
more  time  trying  to  convince  review  committees  they  are 
excellent  teachers. 

Be  aware  that  scholarly  and  creative  activity  is  the  area 
easiest  to  document  as  long  as  it  is  in  the  form  of 
publications.  As  with  most  evidence  of  scholarship, 
different  kinds  of  books  carry  different  weight.  A textbook 
for  undergraduate  or  graduate  students  is  less  prestigious 
than  a book  for  fellow  researchers  in  your  field.  Books 
published  by  reputable  publishing  houses  cany  more  weight 
than  those  published  by  local  publishers.  Likewise,  articles 
in  nationally  or  internationally  distributed  journals  carry 
more  weight  than  those  appearing  in  regional,  state,  or  local 
journals.  It  is  unlikely  several  publications  in  local  or  slate 
journals  will  count  as  much  as  a single  article  in  a more 


prestigious  journal.  University  and  college  review 
committees  cannot  be  familiar  with  the  journals  in  all 
disciplines.  They  may  depend  on  information  sucli  as 
whether  the  journal  is  refereed,  the  percent  of  the  submitted 
manuscripts  that  are  rejected  and  how  widely  the  journal 
is  distributed  as  indicators  of  the  quality  of  the  journal. 
Providing  this  kind  of  information  in  your  credentials 
conveys  the  idea  that  you  have  nothing  to  hide. 

Do  not  underestimate  the  amount  of  time  it  takes 
between  initial  submission  of  a manuscript  and  its 
acceptance.  Some  journals  publish  with  each  article  the 
date  they  received  and  accepted  the  manuscript.  Well-run 
prestigious  journals  in  my  discipline  frequently  report  lags 
of  four  to  six  months.  Other  journals  are  less  willing  to 
print  that  information.  One  hears  stories  of  much  longer 
delays. 

The  moral  of  this  story  is  to  hit  the  ground  running — 
submit  as  many  articles  as  soon  as  you  can.  Your  dissertation 
is  a good  starting  place.  If  a recent  review  of  the  literature 
on  your  topic  has  not  been  published,  you  may  be  able  to 
develop  at  least  two  articles  from  it — a review  of  the 
literature  and  the  experiment  you  ran.  For  any  manuscript 
develop  a list  of  possible  journals  rank-ordered  from  the 
most  to  least  prestigious.  Submit  the  manuscript  to  the 
most  prestigious  one  you  believe  might  publish  it.  If  it  is 
accepted,  keep  the  acceptance  letter  (it  can  be  a year  or 
more  between  acceptance  and  printing).  A copy  of  that 
letter  in  your  tenure  file  usually  counts  as  much  as  an  article 
already  in  print.  If  it  is  rejected,  read  the  reviews  carefully. 
If  they  point  out  something  you  can  easily  fix  and  you 
believe  it  makes  a major  improvement,  make  the  change 
and  resubmit  immediately  to  the  next  journal  on  your  list. 
Do  not  spend  time  making  minor  revisions  until  you  find  a 
journal  willing  to  accept  it  if  you  make  the  revisions  they 
request.  You  can  waste  time  making  revisions  that  would 
never  be  requested  by  the  journal  that  publishes  it.  Most 
importantly,  don't  give  up!  It  is  hard  to  read  negative 
reviews  of  your  work  and  too  easy  to  give  up. 

Two  true  stories  may  help  you  persist.  One  is  about  an 
article  submitted  to  the  top  journal  in  its  discipline  that 
was  torn  apart  and  rejected.  It  was  then  submitted  to  the 
second  journal  in  the  discipline,  published,  and  later  selected 
as  the  outstanding  article  published  that  year.  The  second 
story  is  about  a professor  who  had  published  almost  100 
journal  articles  and  23  books  before  his  untimely  death  at 
age  40.  To  drive  home  the  point  of  not  giving  up  he  told 
his  graduate  students  about  an  article  he  submitted  to  1 1 
different  journals  before  it  was  accepted. 

Negotiate  the  terms  of  your  employment,  if  you  are 
moving  from  one  institution  to  another,  so  that  your  service 
at  the  prior  institution  does  not  count  toward  your 
probationary  years  at  the  new  institution.  This  is  because 
it  takes  a long  time  to  have  manuscripts  accepted  for 
publication.  The  ethics  in  most  disciplines  dictate  that  a 
manuscript  be  submitted  to  only  one  journal  at  a time.  If 
you  have  some  publications  from  your  prior  service,  you 
m.  y want  to  count  that  prior  service.  If  you  have  very  few 
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or  none,  it  is  wise  to  give  yourself  the  maximum  amount  of 
time  to  build  the  necessary  publication  record. You  have 
little  to  lose,  especially  if  the  institution  gives  early  tenure. 
Persons  interviewing  at  my  institution  seem  to  suspect  that 
this  advice  is  given  to  them  because  it  is  better  for  the 
institution.  Yet,  I have  known  several  faculty  who  fought 
to  count  the  maximum  number  years  of  prior  service  at  the 
time  of  employment  only  to  regret  it  later  when  they 
discovered  they  would  have  profiled  from  having  more  time 
before  the  tenure  decision.  Do  not  overlook  the  fact  that 
many  hours  during  the  first  year  at  an  institution  are  spent 
preparing  course  materials  and  adjusting  to  the  kinds  of 
students  who  take  the  courses  assigned  to  you.  Reteaching 
a course  requires  much  less  time. 

Regularly  schedule  and  protect  your  time  for  doing 
research.  This  is  an  important  habit  to  establish  early  in 
your  career.  One  difficulty  in  conducting  research  is  that 
there  are  no  deadlines  except  those  you  establish  for 
yourself.  The  lecture  notes  for  tomorrow's  class  or  the 
exams  you  must  grade  do  have  deadlines.  Working  with 
colleagues  on  research  can  provide  structure  in  that  you 
establish  meetings  and  promise  to  do  certain  tasks  before 
each  meeting.  This  leads  to  publications  with  multiple 
authors.  Be  forewarned  that  review  committees  take 
different  views  of  coauthored  articles.  1 have  heard  it  used 
as  evidence  of  the  candidate's  willingness  to  share  his  or 
her  expertise  with  fellow  faculty — a strength.  I have  also 
heard  it  viewed  as  a red  flag  possibly  signaling  that  the 
candidate  is  unable  to  do  quality  work  independently. 
Perhaps  some  of  both  is  the  best  strategy,  especially  if  your 
campus  does  not  have  a dear,  established  way  of  viewing 
coauthored  works. 

Select  one  or  maybe  two  areas  for  your  research.  Be 
sure  the  specialty  is  something  you  value  and  are  genuinely 
interested  in  since  you  will  spend  much  time  with  it.  Tenure 
and  promotion  committees  arc  frequently  concerned  with 
how  much  impact  your  research  and  writing  has  had  on  the 
field  (faculty  at  other  institutions  who  review  your 
credentials  arc  often  as<ed  to  provide  such  information). 
A scries  of  studies  in  an  area  has  a greater  chance  of 
influencing  the  field.  Additionally,  the  journals  1 read  seem 
to  contain  more  and  more  articles  describing  a scries  of 
studios  on  a given  topic.  This  means  a single  study  that 
once  produced  an  article  now  has  less  chance  of  being 
published  by  itself. 

Request  joint  authorship  in  return  for  your  help  before 
you  become  involved,  when  asked  for  assistance  which 
appears  to  entail  a substantial  commitment.  This  way  you 
will  have  something  to  show  for  the  time  you  spend.  After 
all,  time  is  your  most  precious  resource.! f you  have  expertise 
valued  by  fellow  faculty,  for  example  knowledge  of  research 
design  and  data  analysis,  you  may  find  other  faculty  asking 
for  advice  and  help.  Don't  be  surprised  if  you  are  the  most 
up-to-date.  After  all,  you  have  just  completed  education 
that  allowed  you  to  devote  full  time  to  increasing  your 
knowledge  with  the  guidance  of  several  faculty  specialized 
in  different  areas.  Your  fellow  faculty  spend  considerable 


time  passing  on  to  students  what  they  know,  which  leaves 
them  less  time  for  reading  and  learning. 

Ask  your  colleagues  hew  they  document  their 
achievements.  Creative  work  generally  replaces  scholarly 
research  in  some  disciplines.  Authors  of  poetry  and  stories 
also  have  to  publish  their  work,  so  much  of  what  has  been 
said  earlier  still  applies  to  them.  Artists  and  performers  are 
expected  to  create  new  works  of  art  or  to  perform.  Giving 
shows  or  recitals,  being  invited  to  give  them,  and  receiving 
awards  in  competitions  become  the  evidence  that  the  faculty 
member's  work  is  respected  and/or  taken  seriously  by  peers. 
Documentation  is  more  difficult  for  faculty  in  these 
disciplines. 

Find  out  how  consulting,  especially  paid  consulting,  is 
viewed  on  your  campus.  Consultantships  may  count  as 
service  or  as  research.  Some  faculty  view  paid 
consultantships  as  adding  little  of  value  to  your  credentials; 
after  all.  you  have  received  your  reward  (money).  Others 
view  the  pay  as  an  indication  that  your  expertise  is  valued 
by  others.  Institutions  sometimes  put  limits  on  the  amount 
of  time  faculty  may  spend  consulting  for  other  agencies. 

Be  sure  to  keep  records  of  service  activities  (and 
documentation  if  required  by  your  institution),  as  they  are 
easily  forgotten — especially  if  they  are  one-time 
commitments.  Service  typically  includes  such  things  as 
working  on  university  committees,  work  within  the 
community  that  draws  upon  your  expertise,  working  on  a 
committee  or  serving  as  an  officer  of  a professional 
organization,  and  reviewing  or  editing  for  professional 
journals.  Serving  on  university  committees  provides  the 
opportunity  to  meet  faculty  in  other  colleges  and  helps  the 
faculty  member  become  “known"  on  campus.  Service  to 
professional  organizations  may  carry  more  weight, 
especially  when  it  signals  respect  of  fellow  professionals, 
as  does  editing  a journal.  These  opportunities  are  more  apt 
to  come  to  faculty  who  have  a record  of  research  and 
publication  within  their  discipline. 

Beware  of  traps  in  accepting  service  requests.  The 
availability  of  service  opportunities  and  the  degree  to  which 
service  is  expected  and  valued  varies  a great  deal.  Some 
departments  and  colleges  have  a policy  of  protecting  new 
faculty  from  service  activities  while  tenured  faculty  are 
expected  to  assume  the  necessary  service  activities. 
However,  one  full  professor  reports  that  early  in  his  career 
he  systematically  avoided  as  many  service  activities  as 
possible  and  only  accepted  those  he  could  turn  into  a 
publication  opportunity.  Another  faculty  member  who 
joined  the  same  department  simultaneously  accepted 
responsibility  for  administering  a program  for  the 
department.  The  tenure  and  promotion  review  committees 
concluded  she  was  performing  vital  service  for  the 
institution  in  an  exemplary  way  and  so  tenured  her  but 
judged  she  had  not  published  enough  to  warrant  promotion. 
She  was  bitter  about  the  decision,  since  she  believed  she 
had  been  placed  in  a situation  that  made  it  impossible  for 
her  to  develop  the  credentials  necessary  for  promotion. 
Some  believe  women  s tendency  to  be  nurturing  makes  them 
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more  vulnerable  to  accepting  service  roles,  contributing  to 
the  good  of  the  department,  that  decrease  their  likelihood 
of  developing  credentials  leading  to  tenure  and  promotion. 

When  preparing  your  credentials,  do  not  overlook  the 
fact  that  some  persons  reading  them  are  not  familiar  with 
the  traditions  in  your  discipline.  For  example,  if  first 
authorship  on  a coauthored  article  signals  that  person  has 
more  responsibility  for  the  work,  state  that  in  your 
credentials.  If  you  have  an  invited  paper  that  signals 
recognition  by  your  fellow  professionals,  clarify  this  so  that 
the  significance  of  the  event  is  not  lost  on  the  reader. 

Finally,  do  not  expect  your  life  to  change  dramatically 
after  you  are  granted  tenure  and  promotion.  Now  is  not  the 
time  to  relax  and  cease  to  be  productive.  Don’t  forget  how 
you  felt  about  tenured  faculty  you  viewed  as  unproductive 
and  yet  voted  on  whether  you  would  be  tenured  and 
promoted.  Habits  such  as  scheduling  time  for  research  and 
writing  should  be  seen  as  life-time  commitments.  If  your 
department  does  not  have  several  full  professors  you  may 
experience  increased  pressures  to  do  more  institutional 
service  once  tenured  and  promoted.  Do  “your  share”  as  it 
is  your  turn  to  protect  the  new  faculty,  but  do  not  lose  sight 
of  working  toward  that  next  promotion. 


Footnote 

lOnc  example  is  the  Instructional  Development  and  Effectiveness 
Assessment  (IDEA)  form  published  and  scored  by  the  Center  for  Faculty 
Evaluation  and  Development  in  Higher  Education.  1627  Anderson  Avenue. 
Kansas  State  University,  Manhattan.  KS  66502.  The  testing  center  at  my 
university  provides  the  forms  to  interested  faculty,  mails  them  in  for  scoring, 
and  returns  the  printout  of  the  results.  Additionally,  my  former  dean 
instituted  a mid-semester  evaluation  patterned  after  that  described  in  the 
following  article:  Scriven  ( 1981).  Summative  teacher  evaluation.  In  J. 
Millman  (Ed.).  Handbook  of  teacher  evaluation  (pp.  244-271 ).  Beverly 
Hills:  Sage. 

College  norms  arc  available  and  continually  updated  with  each  new 
semester's  data.  The  administration  and  scoring  arc  handled  by  personnel 
other  than  the  faculty  member  so  accusations  of  tampering  with  the  data  or 
threatening  students  concerning  their  grades  arc  out  of  the  question. 


Announcement 


MWERA  GOPHER 

A Gopher  server  is  under  construction  at  Ball  State 
University  that  will  serve  the  Mid-Western  Educational 
Research  Association.  The  Gopher  contains  the  CALL 
FOR  PROGRAM  PROPOSALS  and  will  include  the 
Annual  Meeting  Program,  the  Conference  Abstracts, 
and  various  announcements.  To  access: 
H O ST=gop he r.b su.edu  PORT=70  SELECTOR^/ 
gopher-services/mwera 


AERATEP/SIG  FORMING 

An  AERA  Special  Interest  Group  concerning  the 
teaching  of  educational  psychology  is  forming.  An 
organizational  meeting  was  held  at  AERA  on 
Wednesday  morning.  For  more  information  contact 
Greg  Marchant,  Educational  Psychology,  Ball  State 
University,  Muncie,  IN  47306-0595.  e-mail: 
00gjmarchant@bsuvc.bsu.edu 
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MID-WESTERN  EDUCATIONAL  RESEARCH  ASSOCIATION 

BUSINESS  SECTION 

L Summary'  of  Attendees9  Evaluation  of  the  1993  MV/ERA  Annual  Meeting 
Sharon  L Me  Neely,  Member-at-Large 

2.  Request  for  Study  Proposal 
Richard  C.  Pugh , President 

3.  1994  MWERA  Annual  Meeting  Announcements 
Gregory  J.  Marchant , Program  Chair 

4.  Request  for  Nominations 
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Summary  of  Attendees’  Evaluation  of  the  1993 
MWERA  Annual  Meeting 

Sharon  L.  McNeelv.  Member-at-Large 

I have  compiled  information  from  the  Annual  Meeting 
session  evaluation  forms  and  talked  with  attendees  to 
develop  recommendations  for  MWERA.  The  overall 
evaluation  concluded  that  Tom  Andre  and  his  various 
program  committees  did  an  outstanding  job  of  selecting 
speakers  and  topics  for  the  program.  John  Bransford  the 
opening  keynote  speaker,  and  Jcrc  Brophy,  the  luncheon 
keynote  speaker,  were  both  highly  rated  for  their 
presentations:  many  members  requested  that  they  be  invited 
again.  The  other  invited  speakers  were  also  highly  rated. 
We  hope  that  the  invited  speakers  will  consider  continuing 
their  involvement  with  MWERA  as  regular  members. 

Comments  from  attendees  about  our  invited  sessions 
suggest  that  we  consider  some  new  formats  with  invited 
speakers.  These  might  include  iongcr  sessions  for  selected 
invited  speakers,  follow-up  working  sessions  for  attendees 
interested  in  more  specific  information,  and  changes  in  the 
luncheon  speaker  format  so  that  the  speaker  presents  in  a 
room  more  conducive  to  presentation. 

It  seems  that  organizationally  MWERA  has  reached  a 
turning  point.  Our  membership  has  been  growing,  as  has 
conference  attendance.  We  must  now  face  choices  about  if 
and  when  and  how  we  set  limits.  If  we  continue  to  have  a 
program  which  seeks  to  maximize  members’  involvement 
and  permits  a number  of  presentations,  then  we  will  soon 
need  to  either  add  a day  to  our  program  or  add  to  the  number 
of  sessions  we  offer  at  one  time.  Interestingly  many  session 


evaluations  had  comments  to  limit  the  number  of  presenters 
and  the  number  of  sessions  and  to  try  to  insure  good  quality. 

Our  growth  was  also  felt  in  other  ways.  Many  members 
commented  that  the  hotel  is  becoming  too  small  for  our 
meeting.  The  costs  and  benefits  of  moving  to  another  hotel 
will  need  to  be  discussed  by  the  Board  of  Directors  and  the 
membership.  Some  speakers,  session  chairs,  and  session 
discussants  were  unable  to  attend  and  did  not  send 
alternates,  or  did  not  adequately  prepare  to  speak.  We  need 
to  recognize  our  obligation  to  have  our  papers  prepared 
and  duplicated  for  distribution,  to  time  our  presentations, 
to  get  papers  to  discussants  on  time,  to  have  a backup 
prcscntcr/discussant  if  we  cannot  make  it,  and  to  keep  in 
mind  that  we  are  interfacing  with  a diverse,  highly  educated 
group  of  professionals.  Many  members  expressed  a concern 
that  speakers  recognize  the  cultural  diversity  of  our 
attendees  and  be  considerate  of  global  issues  in  their 
presentations. 

In  1990  and  1991,  wc  had  few  Saturday  morning 
sessions.  They  generally  were  well-attended,  and  attendees 
requested  more  of  them.  In  1992  and  1993,  the  programs 
featured  more  Saturday  morning  presentations.  This  year, 
those  sessions  were  generally  not  well  attended  and  many 
were  canceled  or  combined  w ith  other  sessions.  Em  not 
sure  why  this  happened  and  1 hope  you  will  share  your 
ideas  with  the  program  chair,  Greg  Marchant.  as  the  1994 
Annual  Meeting  is  planned. 

Historically,  or  at  least  over  the  last  eleven  years  that 
1 \e  been  a MWERA  member.  MWERA  was  a starting  point 
or  a proving  ground.  For  many,  it  provided  a safe  passage 
as  students,  young  professionals,  and  professionals 
embarking  into  new  territory  used  our  sessions  to  develop 
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their  ideas  and  "try  out"  before  they  went  on  to  AERA  and 
other  national  forums.  Now,  many  of  our  members  do  not 
attend  AERA,  and  our  status  as  a professional  organization 
has  grown  to  the  point  that  more  and  more  of  our  members 
consider  MWERA  as  their  major  forum  for  professional 
exchange.  Somehow,  we  need  to  develop  a middle  ground, 
allowing  for  both  ends  of  the  spectrum  without  overloading 
our  members  with  sessions.  This  year  we  had  some  poster 
sessions  and  some  roundtable  sessions,  and  both  were  highly 
rated.  I’m  hopeful  that  we  will  continue  to  experiment  and 
find  ways  to  meet  the  diverse  needs  of  our  members,  and 
that  you  will  continue  to  share  your  ideas  with  your  elected 
officials. 


Request  for  Study  Proposal 


The  Board  of  Directors  of  the  Mid- Western  Educational 
Research  Association  (MWERA)  is  soliciting  proposals  to 
conduct  a historical  study  of  the  Mid- Western  Educational 
Research  Association.  At  its  mid-winter  meeting,  the  Board 
of  Directors  approved  an  appropriation  of  SI 000  for 
expenses  related  to  data  collection/analysis  during  the 
project. 

While  a historical  study  of  the  MWERA  will  take  on 
the  framework  and  form  of  the  author(s)  who  conduct  the 
study,  there  are  essential  elements  of  the  study  which  the 
Board  of  Directors  expect  in  any  proposal.  These  elements 
will  be  used  as  criteria  in  judging  the  proposals  and  in  a 
making  the  decision  to  have  the  study  conducted. 

A.  Defining  the  focus . The  proposal  should  include  a 
definition  of  the  subject  of  the  inquiry.  What  is  the 
organization?  Why  did  the  organization  evolve?  Beginning 
and  ending  points?  When?  Where?  Here  you  should 
describe  as  precisely  as  possible  what  you  will  and  will  not 
be  exploring  in  your  study,  leaving  open  the  possibility  of 
some  shifts  in  focus  as  your  study  proceeds. 

B . Providing  a rationale . The  proposal  should  contain  a 
justification  for  undertaking  the  study.  In  the  history  of  the 
MWERA,  one  must  ask  about  aims,  purposes,  and  intentions 
of  the  study.  For  example,  providing  an  information  base 
for  the  Association  for  future  directions  might  be  considered. 

C.  Scope  of  the  study . A description  of  the  kinds  of 
evidence  you  will  examine  in  conducting  the  study  should 
be  included  in  the  proposal.  Describe  the  method  of 
collection  and  verification  of  data,  major  events  and  themes, 
and  social/cultural  contexts.  If  you  expect  to  conduct  oral 
interviews,  indicate  how  you  will  go  about  the  task. 
Indicate,  for  example,  whether  you  will  use  a tape  recorder 
to  take  notes;  whether  you  will  give  the  interviewer  the 
chance  to  revise  answers;  procedures  you  will  use  to  comply 


with  standards  on  the  use  of  human  subjects.  It  would  be 
helpful  if  you  would  name  the  people  you  currently  expect 
to  interview  and  indicate  why  you  expect  them  to  be  able 
to  provide  relevant  information. 

D.  Analysis  and  interpretation . Describe  the  methodology 
which  you  will  use  in  the  study.  Justify  your  methodology 
in  terms  of  the  goals  of  the  study  and  the  availability  of 
data.  Indicate  the  limitations  of  the  methodology  and 
discuss  the  problems  you  might  encounter. 

You  should  limit  your  proposal  to  no  more  than  five 
double-spaced  typed  pages.  You  should  forward  your 
proposal  by  May  1,  1994,  to  Richard  C.  Pugh,  President  of 
the  MWERA,  at  the  Wendell  W.  Wright  Education  Building 
Room  2072,  Indiana  University,  Bloomington,  IN  47405. 
An  ad  hoc  committee  consisting  of  Ayres  D’Cosla,  Editor 
of  the  Mid-Western  Educational  Researcher;  Charles 
Anderson,  Executive  Officer  of  the  MWERA:  and  Richard 
Pugh,  President  of  the  MWERA,  will  review  the  proposals 
and  make  the  final  selection. 


MWERA  CALL  FOR  PROPOSALS, 
REVIEWERS , DISCUSSANTS,  AND  CHAIRS 

The  CALL  FOR  PROGRAM  PROPOSALS  appeared 
in  the  Winter  issue  of  the  MID-WESTERN 
EDUCATIONAL  RESEARCHER.  It  is  also  available 
on  the  MWERA  Gopher  (see  Announcement  on  p.  1 9), 
by  e-mail  (00gjmarchant@bsuvc.bsu.edu),  or  writing 
or  calling  Greg  Marchant.  The  Association  is  also 
looking  for  colleagues  to  review  proposals,  to  serve  as 
session  chairs  and  discussants,  and  to  consider  serving 
as  Division  Chairs.  Please  contact  the  appropriate 
current  Division  Chair  or  Greg  Marchant,  1 994  Program 
Chair,  Educational  Psychology,  Ball  State  University, 
Muncie,  IN  47306-0595. 


ANNOUNCEMENT 

The  Department  of  Leadership  and  Educational  Policy 
Studies,  College  of  Education,  Northern  Illinois  University 
and  Thresholds  in  Education  Foundation  are  planning  their 
Fourth  Annual  Research  Symposium,  Friday  and 
Saturday,  October  14  and  15,  1994,  at  the  NIU  campus. 
The  theme  will  focus  on  “Education  for  Unity  Within  a 
Diverse  Community:  New  Roles,  New  Relationships,  New 
Responsibilities."  Papers  arc  being  considered. 

To  submit  a proposal  or  for  more  information,  contact 
Byron  Radcbaugh,  Program  Chair.  LHPS  Department. 
NIU.  DcKAlb,  1L  601 15.  phone  815-753-9357:  or  815 
753-8750  (fax). 
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1994  MWERA  ASSOCIATION  ANNUAL  MEETING 

October  12-15,  1994 
Bismarck  Hotel,  Chicago,  Illinois 


An  Invitation 

Plan  now  on  being  part  of  the  1994  annual  meeting  of  WEDNESDAY,  OCTOBER  12 
the  Mid-Western  Educational  Research  Association  by  Workshop:  Standards  and  Practices  in  Qualitative  Research 
submitting  a proposal  for  a paper  presentation,  symposium.  Workshop:  Research  and  Supervision  in  Teacher  Education 
workshop,  or  alternative  format  presentation.  The  MWERA  Evening  Panel  Discussion:  Motivation  Issues  in  Education 
annual  meeting  has  been  described  as  one  of  the  most  Featuring:  Lyn  Corno,  Teachers  College-Columbia  U 
professional  and  collegial  conferences  of  its  kind.  You  Paul  Pintrich,  University  of  Michigan 

will  be  presenting  your  research  along  with  some  of  the  Dale  Schunk,  Purdue  University 

most  established  names  in  education,  as  well  as  beginning 

researchers  and  graduate  students.  The  conference  is  held  THURSDAY,  OCTOBER  13 

in  the  Bismarck  Hotel  in  downtown  Chicago  which  oilers  Divisions  C,  D,  & G Morning  Coffee  Meeting 

quality  accommodations  and  facilities  at  a reasonable  price.  Keynote:  Lyn  Corno,  Teachers  College-Columbia  U. 

This  makes  the  MWERA  conference  an  affordable  Concurrent  Sessions 

enjoyable  professional  experience.  Develop  a proposal  and  Panel:  Context  Considerations  in  Teacher  Education 
encourage  your  colleagues  and  students  to  participate  and  Including:  Martin  Haberman,  U.  of  Wisconsin- 

attend.  Milwaukee 

Thomas  Lasley,  University  of  Dayton 

CONFERENCE  HIGHLIGHTS  Evening  Social 

This  years  annual  meeting  is  shaping  up  to  be  a very 
special  event.  Wednesday  afternoon  workshops  will  be  FRIDAY,  OCTOBER  14 

followed  by  a very  special  evening  panel  discussion  on  Divisions  B,  E,  F,  I,  & K Morning  Coffee  Meetings 

motivation  issues  in  education.  One  member  of  that  panel,  MWERA  Business  Meeting 

Lyn  Corno,  will  be  delivering  the  keynote  address  on  Luncheon  Address:  Robert  Slavin  Johns  Hopkins  University 
Thursday  morning.  Thursday  will  also  include  a special  Exhibits 

panel  on  teacher  education  featuring  Martin  Haberman  and  Workshop:  Getting  and  Keeping  an  Academic  Position 
Thomas  Lasley.  Publishers  will  be  displaying  their  Panel  on  Minority  Issues  in  Research  and  Teacher  Education 
offerings  in  the  Friday  exhibits  hall.  Friday’s  luncheon  Including:  Jesus  Garcia,  University  of  Illinois 

speaker  is  Robert  Slavin.  Friday  afternoon  will  include  a Barbara  Shade.  University  of  Wis-Parksidc 

workshop  designed  for  graduate  students  on  getting  and  Panel:  Issues  in  the  Teaching  of  Educational  Statistics 
keeping  an  academic  position,  panel  discussions  on  Featuring:  Robert  S.  Barcikowski,  Ohio  University 

minority  issues  in  research  and  teacher  education,  and  on  Stephen  Jurs,  University  ofToledo 

issues  in  teaching  educational  statistics.  Rick  Pugh  will  John  Kennedy.  Ohio  State  University 

deliver  his  Presidential  Address  on  distance  education,  and  Joel  Levin,  University  of  Wisconsin 

a forum  for  education  deans  to  discuss  issues  related  to  Isadore  Newman.  University  of  Akron 

faculty  research  is  scheduled  for  Saturday  morning.  President's  Reception 
Morning  coffee,  division  meetings,  a social,  a fun  run.  and 

the  Presidents  reception  round  out  the  planned  activities.  SATURDAY,  OCTOBER  15 

MWERA  Fun  Run 

Divisions  A,  H.  & J Morning  Coffee  Meetings 
Presidential  Address:  Distance  Education 
Richard  Pugh.  Indiana  University 
Dean's  Forum:  Faculty  Research 
Paper  and  Symposium  Sessions  until  noon 
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Excerpts  From  “An  Analysis  of  the  Critiques  of  Multicultural 
Education ” by  Christine  Sleeter,  Invited  Speaker  for  MWERA  Divisions 

B and  G at  the  1993  Conference 


Rose  Mary  Scott,  University  of  Wisconsin-Parkside 
Joan  S.  Timm,  University  of  Wisconsin-Oshkosh 


Dr  Christine  Slcetcr,  a leading  scholar  in  multicultural 
education,  threw  a challenge  at  her  MWERA  audience  on 
Friday,  October  15,  1993:  A great  deal  of  research  and 
pedagogical  resources  have  been  developed  in  the  field  of 
multicultural  education  but  these  resources  have  yet  to  be 
connected  to  their  various  publics.  She  suggested  that 
emphasis  be  given  to  disseminating  these  resources  to 
receptive  publics,  such  as  the  various  organizations  within 
communities  of  color,  language  minority  publics,  and 
certain  feminist  organizations.  Because  most  multicultural 
education  literature  appears  in  scholarly  journals,  a 
concerted  effort  is  needed  to  educate  the  broader  public  so 
that  its  concept  is  not  distorted.  Scholars  and  activists  need 
to  engage  in  more  public  relations  work. 

Dr.  Sleeter  reviewed  the  critiques  of  US.  published 
books,  articles,  and  editorials  on  multicultural  education 
and  reported  that  critics  either  opposed  it  as  too  radical 
(the  conservative  position)  or  opposed  it  as  too  conservative 
(the  radical  leftist  position).  The  majority  of  the  critiques 
come  from  the  conservatives. 

The  conservatives  write  for  a popular  audience.  The 
targets  of  their  criticism  are  curricular  changes  and  policies 
being  instituted  in  schools  and  universities,  Afrocentrism 
in  general,  and  the  revisions  of  core  curricula  on  several 
university  campuses.  They  make  four  charges:  a)  A radical 
fringe  is  bringing  about  changes  in  education  and  foisting 
new'  policies  on  a public  they  do  not  represent,  b)  Excessive 
emphasis  on  race  and  ethnicity  is  divisive;  curriculum  is 
the  main  concern  of  these  conservatives,  c)  Much 
multicultural  curriculum  is  intellectually  wreak; 
Afrocentrism  is  the  main  target  of  these  conservatives,  d) 
Multicultural  education  offers  a poor  critique  of  minority 
student  achievement,  replacing  old-fashioned  work  with 
gimmicks  such  as  self-esteem  exercises. 

Dr.  Slcetcr  noted  that  the  conservative  critiques  arc  weak 
for  four  reasons:  a)  They  ignore  the  body  of  literature  on 
multicultural  education  as  well  as  a good  deal  of  research 
and  theory  upon  which  it  builds.  This  literature  is  produced 
largely  by  scholars  of  color,  feminist,  and  critical  scholars. 
b)Thcv  position  themselves  as  spokcspcoplc  and  advocates 
for  both  the  broad  American  public  in  general  and  racial 
minority  groups  in  particular,  c)  They  offer  little  analysis 
of  or  reference  to  inequality  today;  rather,  they  frame  their 
discussion  mainly  around  unity  \crsus  dissension,  instead 


of  justice.  They  define  equality  only  as  equal  rights  of 
individuals  before  the  law.  d)  They  assume  and  state  that 
their  own  viewpoints  arc  apolitical,  conceptualizing  them 
as  rooted  in  intellectual  training  that  enabled  them  to  rise 
above  their  own  particular  circumstances  in  order  to  make 
an  assessment. 

The  radical  left,  on  the  other  hand,  criticizes 
multicultural  education  for  embracing  individual  mobility 
within  an  economic  hierarchy  more  than  collective 
advancement  and  structural  equality,  and  for  reducing 
problems  in  the  larger  society  to  school  solutions.  They 
arc  particularly  concerned  about  an  emphasis  on  culture 
rather  than  on  systems  of  oppression.  Radical  critics  fault 
multicultural  education  for  putting  forth  psychological 
solutions  to  political  and  social  structural  problems  and  for 
advocating  reduction  of  teacher  prejudice  as  a major 
solution  to  inequality.  Also,  they  consider  multicultural 
education  to  be  a palliative  White  response  to  minority 
concerns  that  deflects  attention  away  from  structural  issues, 
especially  White  racism.  Dr.  Sleeter  reported  that  most  of 
these  radical  critics  write  from  outside  the  field  and  tend  to 
oversimplify  or  dismiss  the  work  of  U.S.  scholars  of  color. 
They  do,  however,  point  out  some  areas  in  w'hich  the  field 
of  multicultural  education  needs  improvement.  For 
example,  theory  and  practice  should  focus  on  relationships 
among  unequal  groups  in  the  U.S.,  and  racial  and  ethnic 
terms  should  not  be  used  interchangeably,  because  racial 
and  ethnic  theories  of  inequality  are  very  different. 

Dr.  Slcetcr  noted  that  multicultural  education  means  a 
shift  in  decision-making  power  over  schooling  awray  from 
dominant  groups  and  toward  oppressed  groups,  and  involves 
more  than  program  implementation.  The  potential  of  such 
a power  shift  to  effect  change  is  what  has  given  rise  to  the 
barrage  of  conservative  critiques.  The  complete  text  used 
for  ner  address  will  be  published  in  Handbook  of  Research 
on  Multicultural  Education  (Macmillan,  in  press),  edited 
by  James  A.  Banks  and  Cherry  A.  McGee  Banks. 
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The  Responsibility  Of  Higher  Education  In 
Providing  Leadership  In  The  Restructuring  And 
Renewal  Of  Public  Schools:  An  Invited  Address 
to  the  1993  MWERA  Conference 

W.  Gregory  Gerrick,  Ashland  University 


From  an  organizational  perspective,  public  schools 
have  evolved  throughout  our  history  by  adapting, 
compounding  and  proliferating  a corporate  bureaucratic 
superstructure  in  a heroic  effort  to  become  all  things  to  all 
students.  In  response,  principles  of  organizational  behavior 
are  often  interpreted  by  educators  as  methods  of  surviving 
within,  and  indeed  justifying,  this  established  organizational 
design.  Concepts  such  as  leadership,  empowerment,  site- 
based  management,  staff  development  and  evaluation  arc 
routinely  presented  in  college  educational  administration 
programs  in  terms  of  adapting  to  the  ‘Veal  world"  of  public 
schools  rather  than  as  opportunities  to  develop  a more 
effective  and  appropriate  institutional  framework. 

It  may  be  argued  that  the  organizational  restructuring 
of  schools  has,  in  many  ways,  begun,  and  will  continue  for 
decades  to  come.  It  is  likely  that  educators  entering  the 
profession  in  the  1990s  will  spend  their  entire  careers 
absorbed  in  the  ongoing  transition  inherent  within  the 
restructuring  process.  During  this  time  of  uncertainty  and 
instability,  educators  must  be  prepared  to  re-examinc  and 
re-evaluate  every  facet  of  the  bloated  and  dysfunctional 
bureaucratic  structure  which  currently  characterizes  the 
nation's  public  school  monopoly.  Consider  administrator 
and  teacher  preparation  institutions  in  relation  to  public 
school  reorganization.  Should  it  be  the  role  of  higher 
education  simply  to  react  to  the  mandates  of  state  and  local 
boards  of  education  or  should  they  chart  an  independent 
course  for  the  renewal  of  America's  public  schools? 

It  is  clearly  the  responsibility  of  undergraduate  and 
graduate  programs  in  teacher  education  to  prepare  students 
to  design  the  schools  of  the  future.  It  is  neither  acceptable 
nor  conscionable  for  colleges  of  education  to  promote  and 
institutionalize  the  status  quo  in  regard  to  curriculum, 
administration  and  leadership.  Goodlad  (1991)  observes 
that  teacher  education  programs  lack  a sense  of  mission 
and  vision,  and  that  educators  have  consistently  failed  to 
link  school  reform  and  teacher  education  both  conceptually 
as  well  as  in  policy  and  practice.  Representation  of 
institutions  of  teacher  education  is  conspicuously  absent 
from  restructuring  proposals  in  both  the  public  and  private 
sectors.  Colleges  of  education  arc  both  the  logical  and 
necessary  focus  for  the  clear  establishment  of  credible 
leadership  in  the  ongoing  process  of  school  restructuring. 
Educator  preparation  programs  must  orient  their  curriculum 
to  recognize  the  present  reality  of  the  organizational 
renovation  and  renewal  of  public  schools. 


Fundamental  to  the  notion  of  restructuring  public 
schools  is  the  understanding  that  piecemeal  efforts  at  reform 
will  have  no  lasting  impact.  By  themselves,  good  ideas 
such  as  site-based  management,  school  choice  and 
empowerment  do  little  to  change  the  current  organizational 
structure  of  public  schools.  As  Chubb  and  Moe  (1990) 
have  demonstrated,  it  is  only  when  the  traditional 
institutions  of  democratic  control  - - the  vested  interests 
and  multiple  owners  of  public  schools  - - arc  broken  down, 
that  the  subsequent  autonomy  of  schools  will  give  life  to 
concepts  such  as  choice,  school-based  management  and  the 
like.  Colleges  of  education  must  take  care  to  focus  on  the 
heart  of  the  restructuring  process  - - replacement  of  an 
organizational  structure  based  on  democratic  control  - - and 
not  attempt  to  promote  individual  programs,  policies  and 
models  as  panaceas  in  and  of  themselves.  For  many,  this 
will  require  a radical  change  in  the  way  public  education  is 
conceived  in  our  society.  Educator  preparation  programs 
can  no  longer  sell  remedies  and  quick  fixes  for  a dying 
system  and  pass  this  off  as  “educational  leadership." 

The  Teacher  as  Educational  Leader 

Definitions  of  educational  leadership  couched  in  the 
hierarchical  bureaucratic  framework  of  “command", 
“monitor"  and  “control"  are  anathema  to  schools  of  the 
future.  In  the  context  of  rebuilding  schools,  a definition  of 
educational  leadership  is  inherently  linked  to  the  tenets  of 
a professional  or  lateral  organizational  structure.  Such  a 
pluralistic  power  structure  is  broadly  based  throughout  the 
school  and  dependent  upon  the  expertise  of  individuals  with 
various  roles  in  the  educational  enterprise.  It  entails  a 
considerable  degree  of  autonomy  coupled  with  a deep  sense 
of  moral  and  ethical  commitment  to  the  profession.  In 
this  context,  leadership  becomes  the  responsibility  of  each 
professional  educator.  Scrgiovanni  (1992b)  talks  of 
substitutes  for  leadership.  Emphasizing  moral  authority, 
he  views  the  school  as  a community  in  which  a common 
culture  of  values  and  beliefs  becomes  the  ethical  authority 
for  action  on  the  part  of  professional  educators.  This 
focus  allows  teachers  to  become  more  committed  and  self- 
reliant.  Consequently,  principals  are  freed  from  what  he 
calls  the  burden  of  trying  to  control  people:  the  more 
professionalism  is  emphasized,  claims  Scrgiovanni.  the 
less  control  is  needed. 

It  is  clearly  the  mission  of  colleges  of  education  to 
recognize  that  the  process  of  restructuring  of  schools  has 
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begun  and  to  focus  on  the  emerging  and  essential  role  of 
the  teacher  as  educational  leader.  This  is  not  to  deny  the 
reality  of  the  presence  of  the  bureaucratic  structure  that 
continues  to  characterize  public  elementary  and  secondary 
education.  Colleges  of  education  need  to  accept  the 
transitional  nature  of  an  organization  in  flux,  with  one  foot 
locked  firmly  in  a corporate  and  political  superstructure, 
and  the  other  stepping  gingerly  into  the  professional 
experience  - - in  a sense,  the  already-but-not-yet. 

A leadership  model  designed  to  enable  educator 
preparation  institutions  to  facilitate  this  process  is  offered 
as  a potential  strategy  for  graduate  programs  in  educational 
administration  and  supervision.  It  is  conceived  essentially 
as  a statement  of  mission  and  purpose  relating  to  the 
rationale  and  philosophy  of  a graduate  program  in 
educational  leadership.  The  model  consists  of  the  following 
components. 

Leadership  as  a Vision 

There  is  a great  temptation  to  focus  on  skills  and 
techniques  of  leadership  to  deal  decisively  with  problems 
that  arise  in  professional  practice.  A “bottom-line"  society 
regularly  seeks  quick  and  uncomplicated  solutions  to 
complex  problems.  A program  which  focuses  only  on 
leadership  “training"  assumes  that,  for  every  situation  which 
arises  in  practice,  a pre-packaged  response  exists  which 
can  be  taught  to  the  beginning  administrator.  Often, 
programs  in  educational  leadership  unwittingly  create  the 
impression  in  students  that  there  is  a “right  way"  to  behave 
as  a principal  or  a superintendent.  Such  a narrow  focus 
ignores  the  essence  of  true  leadership:  its  vision  or  purpose 
provides  the  meaning  for  the  skills,  style  and  technique. 

University  programs  cannot  ignore  the  need  for  schools 
to  prepare  leaders  to  face  the  challenges  of  the  present  but. 
at  the  same  time,  they  must  play  the  leading  role  to  help 
mold  the  future.  They  must  prepare  leaders  who  recognize 
that  restructuring  has  indeed  begun,  leaders  who 
communicate  the  meaning  of  what  the  school  could  be  by 
establishing  opportunities  for  faculty  to  experience  and 
participate  in  a shared  vision  of  a particular  set  of  goals. 
Professionals  ultimately  will  not  accept  as  leader  an 
individual  who  is  unable  to  communicate  an  underlying 
rationale  and  purpose  for  his/her  leadership  agenda. 

Within  the  human  organization  of  the  school, 
interaction  among  professionals  is,  first  and  foremost, 
relational.  Scrgiovanni  (1992a)  believes  that  professional 
and  moral  authority  should  be  the  source  for  developing 
and  shaping  policy  instruments,  strategies  and  practices  in 
schools.  Authority  that  is  based  on  informed  knowledge 
and  personal  expertise,  and  is  derived  from  widely  shared 
values,  ideas  and  ideals,  implies  a vision  of  teaching  as  a 
collective  practice.  Leadership  would  then,  according  to 
Scrgiovanni,  emerge  from  within  educators  rather  than  be 
externally  imposed,  as  with  bureaucratic,  psychological  and 
technical-rational  (scientific-based)  authority. 

Viewing  the  teacher  as  educational  leader  implies  that 
educators  accept  a shared  and  common  vision  which  ft  cos 


teachers  to  serve  the  community  of  the  school  in  the  ways 
that  each  is  most  competent.  To  a great  extent,  this  vision 
is  limited  by  and,  in  essence,  incompatible  with  the 
current  organizational  structure  of  public  schools  in  that 
the  requisite  autonomy  essential  to  this  vision  is  severely 
compromised.  The  “vision"  communicated  by  colleges  of 
education  must  not  only  recognize  present  realities  in 
educational  settings,  but  also  prepare  reform-minded 
students  capable  of  influencing  future  possibilities  and 
contingencies. 

Professionally  Oriented  Organizational  Structure 

The  organizational  structure  of  public  schools  is  at  the 
heart  of  the  problem  of  their  institutional  effectiveness.  A 
leadership  model  for  educator  preparation  programs  must 
focus  on  the  logical  development  of  a professionally 
oriented  organizational  structure.  In  this  sense,  leadership 
is  conceived  as  the  domain  of  all  educational  professionals, 
from  classroom  to  boardroom.  This  form  of  lateral 
organizational  structure  necessitates  cultivating  leadership 
in  each  role  within  the  educational  process.  The 
empowerment  of  educators  as  professional  decision-makers 
is  a natural  consequence  of  this  pluralistic  power  structure. 

Since  schools  contain  both  bureaucratic  and  professional 
elements,  an  inherent  conflict  exists:  traditional  hierarchical 
authority  and  formal  rules  and  regulations  confound  and 
frustrate  efforts  toward  lateral  and  interdependent  leadership 
roles.  The  response  of  management  is  often  to  present 
empowerment  and  professionalism  as  panaceas,  suggesting 
that  if  only  schools  would  also  employ  these  principles, 
they  would  surely  become  effective  schools.  Consequently, 
implementation  takes  the  form  of  imposing  a watered-down 
version  of  these  concepts  on  top  of  the  existing  hierarchical 
structure.  Empowerment  becomes  delegating  some 
additional  authority,  and  professionalism  becomes  the  new' 
descriptor  for  the  way  administrators  and  teachers  get  along. 
Even  the  best  ideas  imposed  on  a faulty  structure  cannot 
produce  the  desired  effect. 

University  programs  must  go  one  step  further:  they  must 
stress  the  need  for  educators  to  challenge  the  overarching 
organizational  structure  of  public  schools  in  order  to 
successfully  implement  these  new  leadership  concepts.  It 
is  unlikely  that  individuals  who  benefit  from  positions  of 
security  and  power  within  the  organizational  structure  as  it 
now  exists  will  voluntarily  initiate  a fundamental  change 
in  the  system.  Such  a transformation,  if  it  is  to  occur,  will 
likely  begin  to  take  shape  from  the  bottom  up  - - from 
teachers,  supervisors  and  building  administrators  who  bring 
a different  mindset  to  the  workplace  - - one  which  will 
gently  but  firmly,  and  over  time,  challenge  traditional 
management  assumptions.  True  professionals  will  behave 
as  professionals,  identify  common  values  and  beliefs,  and 
empower  others  in  the  pursuit  of  their  common  goals.  A 
professional  organizational  structure  will  gradually  modify 
and  ultimately  replace  the  bureaucratic  rigidity  of  the  old 
order.  Graduate  and  undergraduate  programs  need  to 
integrate  this  mandate  of  renewal  into  every  fabric  of  the 
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curriculum,  no  longer  merely  adapting  or  imposing  change 
onto  the  existing  system.  Renewal  implies  the  creation  of 
a new  organizational  design,  even  if  it  is  to  evolve  slowly, 
one  program,  one  building  at  a time. 

Systemic  Renewal 

The  concepts  of  visionary  leaders  and  a professional 
organizational  structure  are  integral  to  any  discussion  of 
public  school  restructuring.  Unless  university  programs  in 
teacher  education  and  educational  leadership  critically 
examine  the  overarching  organizational  structure  of  public 
schools  - - the  “system"  itself,  any  discussion  of  or  attempt 
at  renewal  is  an  exercise  in  futility.  For  decades,  educators 
have  been  attempting  to  solve  the  problems  of  schools  by 
superimposing  every  great  idea  that  came  along  onto  the 
same  tired  system.  The  heart  of  the  problem  - - the  systemic 
cause  - - has  been  ignored. 

Holzman  (1993)  suggests  that  systemic  change  has  at 
least  five  interpretations  in  popular  usage.  One 
interpretation  defines  systemic  change  as  working  with 
school  systems,  district  bureaucracies  and  state  departments 
of  education  to  effect  change.  The  assumption  is  that  change 
must  begin  with  existing  bureaucratic  structures.  Systemic 
change,  notes  Holzman,  can  also  mean  working  with  every 
school  in  the  system  (horizontal  approach),  or  working  with 
every  aspect  of  the  school  system  (the  interrelationships  of 
all  facets  of  school  operations),  or  be  “systematic"  in  nature 
(including  both  vertical  and  hicrarchial  structures  as  well 
as  horizontal  facets).  Finally,  he  defines  systemic  change 
as  fundamental  change:  the  nature  of  the  present  system 
must  be  thoroughly  redesigned  recognizing  that  it  can  no 
longer  accommodate  necessary  improvements  in  education. 

O’Neil  (1993),  citing  Michael  Fullan  and  other  scholars, 
notes  that  "...  any  strategy  for  systemic  reform  must 
emphasize  the  capacity  of  schools  to  renew  themselves  . . 
."  (p.l  1).  Renewal  extends  beyond  instructional  and 
curricular  reform.  Renewal  includes  confronting  the 
organizational  aspects  of  the  present  system  that  inhibit 
the  autonomy  of  professionals  and  prevent  the  development 
of  programs  and  policies  which  truly  represent  the  learning 
organization.  It  is  one  thing  for  colleges  of  education  to 
promote  curricular  and  instructional  innovation  and 
redesign.  It  is  quite  another  for  these  institutions  to  provide 
leadership  in  examining  organizational  alternatives  to  the 
current  public  school  colossus. 

One  of  the  best  examples  centers  around  the  concept  of 
site-based  management  and  its  relationship  to  public  school 
organization.  University  programs  in  educational  leadership 
often  present  site-based  management  as  a reform  strategy 
designed  to  involve  teachers,  administrators,  parents, 
students  and  members  of  the  community  in  shared  decision- 
making  in  the  operation  of  a specific  school.  Research  on 
“effective  schools"  is  cited  as  the  justification  for  such  an 
approach.  To  promote  greater  autonomy  among 
professionals  and  thereby  empower  professional  staff,  site- 
based  management  plans  are  becoming  increasingly  popular 


at  the  school  district  level.  While  the  theory  behind  this 
practice  is  that  decentralization  is  preferable  to  centralized 
control,  and  that  a site-based  model  of  participatory 
management  would  enhance  the  freedom  of  teachers  and 
administrators  to  do  what  they  perceive  is  best  for  their 
student  population:  the  practice  itself,  within  the  context 
of  the  current  public  school  bureaucracy,  tends  not  to  bear 
out  the  promise  of  the  theory.  Here,  the  traditional 
institution  remains  intact.  Individual  schools  remain  under 
the  authority  of  the  local  Board  of  Education  of  the  State 
Board  of  Education  - - of  the  many  vested  interest  groups 
of  the  public  school  “organization."  To  assure  that  this 
new  autonomy  does  not  get  “out  of  control,"  boards  of 
education  need  to  monitor  how  schools  exercise  their  new’ 
freedom.  According  to  Chubb  and  Moe  (1990),  a host  of 
new  rules,  regulations  and  requirements  are  imposed  on 
buildings  operating  under  a site-based  management  plan. 
The  underlying  belief  is  that  “as  long  as  higher-level 
authority  exists,  it  will  eventually  get  used"  (p.  201 ).  Thus, 
management  within  a given  school  is  never  truly  site-based. 

In  practice,  then,  site-based  management  simply 
becomes  another  way  of  maintaining  control  over  schools 
within  the  same  public  school  organizational  structure. 
Spring  (1993)  notes  that,  in  fact,  site-based  management 
is  not  intended  to  give  any  real  power  to  teachers,  students 
and  members  of  the  community.  He  believes  that  the 
political  importance  of  site-based  management  would 
increase  if  individual  schools  w'ere  given  the  power  to  decide 
what  students  should  learn  and  what  the  content  of 
achievement  tests  should  be.  This  brings  us  full  circle  to 
the  original  problem:  if  individual  schools  were  truly 
autonomous,  as  Spring  suggests,  site-based  management 
would  become  a viable  and  effective  reform  strategy. 
Yet  without  systemic  change  in  the  current  public  school 
bureaucratic  superstructure,  even  the  most  well-intentioned 
reforms  amount  to  little  more  than  window-dressing. 

Unless  universities  confront  the  issues  of  systemic 
change  in  public  school  organization,  their  programs  serv  e 
to  do  little  more  than  perpetuate  the  status  quo  of  the  public 
school  monolith.  It  is  possible  that  the  close  relationships 
forged  between  universities  and  public  school  districts,  for 
the  purpose  of  maintaining  teacher  and  administrative  field 
experiences,  tend  to  discourage  serious  discussions  of 
alternative  public  school  designs.  It  is  also  possible  that 
relationships  between  teacher  and  administrator  preparation 
institutions  and  state  departments  of  education,  specifically 
in  the  areas  of  certification  and  requisite  college  courses, 
might  dampen  discussions  of  organizational  change.  As 
symbiotic  as  these  relationships  have  become,  their 
importance  and  significance  pales  when  compared  to  the 
responsibility  of  educator  preparation  programs  to  assume 
the  leadership  for  the  ongoing  redesign  and  renewal  of 
public  education:  nothing  less  than  a responsibility  to  the 
profession  itself. 

Design  and  support  of  charter  school  plans  arc 
examples  through  which  colleges  of  education  can  provide 
leadership  in  organizational  restructuring.  A state  grants 
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specific  charters  to  individual  schools.  In  turn,  these  schools 
are  allowed  to  determine  their  own  programs,  and  to 
maintain  control  over  curriculum,  personnel  and  specific 
goals.  Professionals  enjoy  autonomy  - - freedom  from 
most  state  and  local  rules  and  regulations.  In  exchange, 
schools  must  demonstrate  specific  improvements  over  the 
previous  system  within  which  they  were  forced  to  operate. 
The  potential  for  both  organizational  and  instructional 
renewal  is  limitless.  For  genuine  progress  to  be  made, 
traditional  power  brokers,  such  as  local  and  state  boards  of 
education,  state  legislators  and  state  departments  of 
education,  must  be  willing  to  surrender  control  and  thus 
empower  education  professionals  to  build  the  schools  of 
the  future. 

Conclusion 

University  educator  preparation  programs,  on  both  the 
graduate  and  the  undergraduate  levels,  owe  the  profession 
nothing  less  than  a leadership  role  in  the  redesign  of 
American  public  education.  The  first  step  in  this  process  is 
preparing  educational  leaders  with  a firm  understanding  of 
the  nature  of  the  public  school  organizational  structure  as 
it  now  exists.  The  potential  for  renewal  is  significantly 
enhanced  as  educators  come  to  understand  that  the  current 
bureaucracy  is  not  a good  organizational  fit  for  schools. 

Since  sweeping,  radical  top-down  organizational  change 
is  unlikely,  effective  efforts  at  institutional  redesign  will, 
in  all  probability,  be  implemented  from  the  bottom  up.  The 
educational  leaders  of  the  future  will  fashion  a professional 
organizational  power  structure  from  the  ruins  of  the 
corporate  model,  methodically  renewing  one  program,  one 
building,  one  system  at  a time.  They  will  define  the 
purposes  and  cultures  of  their  own  learning  communities, 
and  thus  enable  the  transformation  of  the  school  over  time 
through  a shared  vision  of  common  beliefs,  norms,  values 
and  aspirations.  Ultimately,  they  will  institutionalize  this 
vision  into  the  organizational  framework  of  the  educational 
enterprise. 
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Composition  Analysis 

Benjamin  D.  Wright,  University  of  Chicago 


Bookstein  s deduction  that  any  distribution  function  reducing  to  G(x  + y)  = G(y)  or  H(x  x y)  = H(x)  x H(y) 
will  be  resilient  to  aggregation  ambiguity  is  applied  to  performance  odds.  The  Rasch  model  application  to  three 
measurable  compositions  result . TEAMs  work  as  unions  of  perfect  agreement  doing  best  with  easy  problems.  PACKs 
work  as  collections  of  perfect  Disagreements  doing  best  with  intermediate  and  hard  problems.  CHAlNs  work  as 
connections  o f IMperfect  agreements  doing  better  than  TEAMs  with  hard  problems.  Four  problem/solution  necessities 
for  inference  are  reviewed:  uncertainty  met  by  probability ; distortion  met  by  additivity \ confusion  met  by  separability 
and  ambiguity  met  by  divisibility.  Connotations , properties  and  applications  of  TEAM,  PACK  and  CHAIN  groups  are 
ventured. 


Why  do  some  organizations  succeed  while  others 
fail?  Why  do  groups  of  a particular  kind  work  well  in  some 
situations  but  poorly  in  others?  The  psychology  of  group 
organization  is  rich  but  qualitative  (Freud  1921).  Questions 
about  how  groups  work  seem  non-mathematical. 
Nevertheless,  algebra  undertaken  to  obtain  hierarchically 
stable  measurement  leads  to  a mathematics  of  group 
productivity. 

Groups  are  composed  of  subgroups,  subgroups  of 
elements,  elements  of  parts.  Aggregations  separate  into 
sub-aggregations  and  come  together  into  super- 
aggregations. The  ‘-entities”  we  experience  become 
understood  and  useful  as  we  learn  how  to  see  down  into 
their  substructures  and  up  into  the  compositions  they 
construct. 

We  know  from  experience  that  the  way  group 
members  work  together  affects  group  success.  But  we  do 
not  know  how  to  measure  these  effects,  nor  how  to  calculate 
effective  group  organizations.  Quantification  requires 
models  which  measure  group  strength  as  functions  of 
member  strengths.  These  models  must  be  hierarchically 
robust.  They  must  maintain  their  metric  across  descending 
and  ascending  levels  of  composition.  Can  a mathematics 
be  developed  which  defines  the  different  ways  group 
members  might  work  -gether  such  that  their  individual 
measures  can  be  combined  mathematically  to  calculate  an 
expected  measure  for  the  group? 

Composition  Analysis 

'"Composition  analysis”  is  our  name  for  the 
mathematics  of  how  component  measures  combine  to 
produce  composite  measures.  Our  deliberations  will  lead 
to  measurement  models  which  are  infinitely  divisible  and, 
hence,  infcrcntially  stable.  The  models  will  compose  and 
decompose  smoothly  from  one  level  of  aggregation  to 
another.  When  the  models  work  for  groups  of  individuals, 
they  will  work  for  individuals  within  groups.  When  they 
work  for  individuals,  they  will  work  for  parts  within 


individuals.  Although  presented  here  as  groups  of  persons, 
these  models  apply  to  groups  of  any  kind:  ideas,  problems. 


cells. 


Composition  Rules 

Bookstein  (1992)  shows  that  any  distribution 
function  that  reduces  to 


Gfx  + y)  - G(v)  or  H(x  x y)  = H(x)  x H(y) 


will  be  indifferent  to  the  intervals  used  for  grouping  and 
hence  resilient  to  aggregation  ambiguity.  Bookstein’s 
functions  specify  the  divisibility  needed  for  composition 
analysis.  They  also  specify  the  arithmetic  needed  for 
quantitative  comparisons.  To  relate  these  functions  to  the 
procedures  of  measurement,  we  enlarge  the  + and  x 
arithmetic  inside  functions  G and  H to  include  “procedural” 
compositors  0 and  M . These  procedural  ""additions” 
and  “multiplications"represent  whatever  empirical 
procedures  are  discovered  to  operationalize  measurement, 
as  in  ‘"aligning  sticks  end-to-end”  to  ""add”  length,  and 
"‘piling  bricks  top-to-bottom”  to  “add”  weight. 

Two  composition  rules  follow: 


A procedural  Addition  rule:  G(x0y)  = G(x)  + G(y) 

A procedural  Multiplication  rule:  $ y)  = /f(x)  X /f (y) 


These  rules  compose  and  decompose  ad  infinitum,  as  in: 


G(x  + y + z)  = G(x  + y)  + G(z) 

= G(x  + z)  + G(y) 

= G(y  + z)  + G(x) 

= G(x)  + G(y) + G(z). 


To  discover  the  consequences  for  composition 
analysis,  wc  will  apply  each  rule  to  observation  probabilities. 
Observation  probabilities  arc  addressed  because  we  intend 
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to  use  these  rules  on  data  in  order  to  estimate  measures  for 
empirical  compositions.  These  probabilities  will  be 
expressed  as  odds  because  0 < P < 1 is  an  awkward 
measure,  while  0 < [P/(l  - P)]  < maintains  equal  ratios 
and  log  odds  maintain  equal  differences.  Our  application 
of  Bookstcin's  functions  to  odds  will  determine  what 
compositions  compositors  0 and  0 imply  and  hence 
what  compositions  are  quantifiable. 

Three  compositions  will  result: 

1.  a TEAM  union  of  perfect  agreement. 

2.  a PACK  collection  of  helpful  Disagreements. 
and 

3.  a CHAIN  connection  of  IMperfect  agreements. 

We  will  deduce  measurement  models  for  these 
compositions,  which,  because  of  their  divisibility,  are 
indifferent  to  composition  level  and  resilient  to  aggregation 
ambiguity.  The  resulting  models  will  be  the  stable  laws  of 
composition  analysis. 

Finally,  we  will  place  divisibility  in  the  theory  of 
inference  which  motivates  these  deductions,  and  will  venture 
some  interpretations  of  the  three  compositions. 


Three  Compositions 

Team  Union  Of  Perfect  Agreement 

Applying  procedural  multiplication  to  success  odds 
defines  group  success  odds,  when  group  members  work 
according  to  the  procedural  operator  0,  as  the  following 
product  of  group  member  success  odds: 


(i  - ?„)  (i  - pj 


The  group  composition  specified  by  this  first  law 
of  stable  measurement  can  be  seen  by  applying  probabilities 
Pn  and  P to  the  outcomes  possible  when  persons  n and  m 
work  on  a task  according  to  the  multiplication  of  their 
success  odds.  Figure  1 shows  the  two  outcomes  which  occur 
in  this  composition. 

Figure  l. 

Outcoues  Occurring  for  a TRAM, 


r loses 
0 


s wins 
1 


The  Measurement  Model 

In  order  to  apply  the  composition  rules,  we  need  a 
stochastic  measurement  model,  with  parameters  that  follow 
the  rules  of  arithmetic,  and  estimates  that  enable 
comparisons  between  strengths  Bn  and  Bm  of  objects  n and 
m which  are  invariant  with  respect  to  whatever  relevant  but 
necessarily  incidental  measuring  agents  are  used  to  manifest 
the  comparison. 

Measurement  means  quantitative  comparison. 
Quantitative  comparison  means  differences  or  ratios.  Since 
odds  are  ratios,  ratios  are  their  comparison.  The  procedural 
comparison  of  objects  n and  m is: 

H(n  @)  m)  ■ H(n)  /H(m) 

Defining  H as  odds  [P/(l  - P)]  gets: 

[f.g./d-p.eJi'ip./d-p.ii/ip./ii-yi 

Estimation  requires  that  strengths  Bn  and  Bm  be 
manifest  by  a relevant  measuring  agent  z of  difficulty  D. 
Inferential  stability  requires  that  the  comparison  (Bn  - BJ 
be  independent  of  task  difficulty 

The  necessary  and  sufficient  model  is: 


( p„,  < 1 -p„,>  ' c-p J] * 

= cxp(b„-bJ 

because  task  difficulty  D(  cancels  so  that  the  ti  © m 
comparison  maintains  the  same  difference  of  strengths 
regardless  of  which  tasks  arc  convenient  to  manifest  these 
strengths  (Raseh,  1%0). 


n wins 
1 


(1  -Pfl)  U - 

TEAM  00  loses 


Absent 


Absent 


V. 

TRAM  11  wins 


Agreement  (11)  wins  or  agreement  (00)  loses. 
Disagreements  (10)  and  (01)  are  absent  because  they  do  not 
occur  in  the  equation  which  defines  TEAM  composition. 
TEAMs  work  as  unions  of  perfect  agreement. 

Applying  Rasch  odds  to  TEAM  work  with  group 
strength  represented  by  gets: 


• MW  D) 1 MV  d]]  MV  D)1  5 expj(sD-  d)  t (bb-  d)] 

Taking  logs  and  generalizing  to  any  size  group 
defines  N-member  TEAM  strength  as: 

<Bt  - JD)  rn  • 


The  strengths  of  TEAM  members,  relative  to  task  difficulty 
(Bn  - D),  add  up  to  TEAM  strength,  relative  to  task  difficulty 
(B,  - D).  TEAMs  are  concatenations  of  relative  strengths, 
accumulated  in  linear  form. 

Pack  Collection  Of  Perfect  Disagreements 

Applying  procedural  addition  to  success  odds 
defines  group  success  odds,  when  group  members  work 
according  to  the  procedural  operator  0 , as  the  following 
addition  of  group  member  success  odds: 
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ft 

U-pJ  b-'.J 

1 li  - P„)  (i  - PJ 

The  group  composition  specified  by  this  second 
law  of  stable  measurement  can  be  seen  by  applying 
probabilities  Pn  and  Pm  to  the  outcomes  possible  when 
persons  n and  m work  on  a task  according  to  the  addition  of 
their  success  odds.  Figure  2 shows  the  three  outcomes  which 
occur  in  this  composition. 


The  perfect  disagreements  of  PACK  members 
collect  to  benefit  the  PACK.  As  PACK  size  increases  so 
does  PACK  strength.  Unlike  TEAMs,  PACK  strength  is 
independent  of  task  difficulty. 

Chain  Connections  Of  Imperfect  Agreements 

Applying  procedural  addition  to  failure  odds 
defines  group  failure  odds,  when  group  members  work 
according  to  the  procedural  operator  0 , as  the  following 
addition  of  group  member  failure  odds: 


Figure  2. 

Outcomes  Occurring  for  a PACK. 


a loses 
0 

® wins 
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n loses 
0 

a - pD)  (i  - p„ ) 

p.d  - pn) 

PACK  00  loses 

PACK  0 1 wins 

n wins 
1 

i 

V*  - P.) 

PACK  1 0 wins 

agreement 

Absent 

Helpful  disagreements  (10)  and  (01)  win. 
Unhelpful  disagreement  (00)  loses.  Agreement  (1 1)  is  absent 
because  it  does  not  occur  in  the  equation  which  defines 
PACK  composition.  PACKs  work  as  collections  of  perfect 
Disagreements. 

Aprfymg  Rasch  success  odds  to  PACK  work  gets: 

exp{i5nffio-  D)  = exp  (an-  D)  + exp  {B„-  D) 


■ 

t 

Jl-f,]  . P,U-Pfl)*P,(  1-PJ 

k i 

P 

**  i 

\ p.  1 p»p* 

The  group  composition  specified  by  this  third  law  of  stable 
measurement  can  be  seen  by  applying  probabilities  Pn  and 
Pm  to  the  outcomes  possible  when  persons  n and  m work  on 
a task  together  according  to  the  addition  of  their  failure 
odds.  Figure  3 shows  the  three  outcomes  which  occur  in 
this  composition. 
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Figure  3, 

Outcomes  Occurring  for  a CHAIN. 

m loses 

a wins 

0 

1 

n loses 
0 

More  than  one  loss 
Absent 

p.d  - p„) 

CHAIN  0 1 loses 

n wins 
1 

P„(l  - P.) 

v. 

CHAIN  1 0 loses 

CHAIN  U wins  ] 

or  exp(fln©„)  ■ exp(Bj  + exp(B„)  . 


This  is  also  a concatenation,  but  of  absolute  (not  relative 
to  problem  difficulty)  strengths,  accumulated  in  exponential 
form. 


Taking  logs  and  extending  to  a group  of  any  size 
defines  N-member  PACK  strength  Bp  as: 


Bp  ■ log 


V n 


£exp(Ba)  * £ * log(/W)  * B + log  W 


with  w - i + <** 
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(For  derivation  see  Appendix,  p.  38.) 

Log  (NW)  is  the  amount  PACK  strength  increases 
with  PACK  size  N and  member  heterogeneity  W.  W brings 
in  member  heterogeneity  through  member  strength  variance 
a \ skew  Yr  kurtosis  etc.  Positive  skew  and  kurtosis 
amplify  the  impact  of  stronger  PACK  members. 

The  homeostasis  of  most  groups  induces 
homogeneity.  When  heterogeneity  emerges,  members 
regroup  toward  homogeneity.  As  long  as  member  strength 
variance  (Tm:  stays  small,  so  that  (Tk  <.3  for  !<  W <1 .1  or 
cru  <.5  for  1<  W <1.2,  then  W &&  1 and  PACK  strength 
can  be  modelled  as:  — 

BpOGB  ♦ log  N , 


Perfect  agreement  (1 1)  wins.  Disagreements  (10) 
or  (01)  lose.  Outcome  (00)  is  absent  because  it  does  not 
occur  in  the  equation  that  defines  CHAIN  composition. 
CHAINs  work  as  connections  of  IM perfect  agreements. 

Applying  Rasch  failure  odds  to  CHAIN  work  gets: 

exp (D  - * exp(X)  - Ba)  * exp (D  - £m) 


or  exp(-  Ba9„)  * exp(-  s„)  + exp(-  Ba)  , 


a concatenation  of  absolute  weaknesses  in  exponential  form. 

Taking  logs  and  extending  to  a group  of  any  size 
defines  N-member  CHAIN  strength  B(.  as: 

Bc  ■ -log|  £exp{-B„)j  - £Bn///-  log  {NW')  - B - log(Arw') 


with  W'  - 1 


1 

2 


°aT  i + gfra 
6 24 


which  member  homogeneity  simplifies  to: 

Bco c"B  - log  N . 

The  imperfect  agreements  of  CHAIN  members  arc 

PACKs' CHAIN  strength  is  independent  of  problem 
difficulty.  Unlike  PACKs,  as  CHAIN  size  increases,  CHAIN 
strength  decreases. 
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Figure  4. 

Outcomes  for  Three  Member  Groupa. 
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Comparing  Compositions 

To  see  the  differences  among  TEAMs,  PACKs  and 
CHAINs  consider  the  possibilities  for  groups  of  three  in 
Figure  4 and  for  groups  of  any  size  in  Figure  5. 


Figure  5- 

Out acmes  for  Any  Size  Group. 
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TEAMs  are  united  in  perfect  agreement.  Win  or 
lose,  no  disagreement  can  occur.  PACKs  and  CHAINs 
distinguish  disagreement,  but  conversely.  PACKs  win  by  a 
single  winning  disagreement.  CHAINs  lose  by  a single 
losing  disagreement.  To  help  a TEAM,  a member’s  strength 
must  be  stronger  than  problem  difficulty.  Members  weaker 
than  problem  difficulty  decrease  TEAM  strength.  Adding 
to  a PACK  increases  PACK  strength.  Adding  to  a CHAIN 
decreases  CHAIN  strength. 


Figure  S. 

Measureient  Models  for  Coiposition  Analysis. 
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The  measurement  models  for  composition  analysis 
in  Figure  6 enable  us  to  deduce  which  of  these  compositions 
works  best  against  problems  of  different  difficulties. 

TEAMs  vs  PACKs.  When  is  one,  united  TEAM  agreement 
on  what  is  best  more  effective  than  a collection  of  PACK 
disagreements? 

Since  BT  = Bp  when  (B  - D)  = (+log  N ) / (N- 1 ) , 

BT  > Bp  requires  (B  - D)  > (+log  N)  / (N-l ). 

TEAMs  do  better  than  PACKs  when  average  group 
strength  is  greater  than  problem  difficulty  by  [(+log  N)/(N  - 
1 )].  This  defines  the  upper  curve  in  Figure  7. 

TEAMs  vs  CHAINs.  When  is  TEAM  organization  better 
than  CHAIN  organization? 

Since  BT  = Bc  when  (B  - D)  = (-log  N)  / (N-l ) , 

Br  > Bc.  requires  (B  - D)  > (-log  N)  / (N-l ). 

This  is  the  lower  curve  in  Figure  7. 


To  read  Figure  7,  find  group  size  N - 4 on  the 
horizontal  axis.  Go  up  to  the  upper  curve  and  left  to  the 
vertical  axis  to  read  that  a group  of  four  must  average  half  a 
logit  more  strength  than  problem  difficulty  to  do  better  as  a 
TEAM  than  a PACK. 

When  problem  D is  harder  than  [B  - (log  N)/(N-1 )]. 
PACK  disagreement  is  more  productive  than  TEAM 
agreement.  As  problem  difficulty  (D  - B)  increases,  the 
value  of  TEAM  work  declines.  The  turning  point  at  which 
PACKs  become  better  than  TEAMs  is  always  greater  than 
zero.  Below  (B  - D)  = (-log  N)/(N  - 1 ),  a TEAM  becomes 
the  least  productive  group  organization.  Figure  8 formulates 
the  relative  strengths  of  TEAMs,  PACKs  and  CHAINs. 
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Figure  8. 

Relative  Strengths  of  TORS,  Mis  CffiUHs. 
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Figure  9 uses  Figure  7 to  show  how  relationships 
between  problem  difficulty,  group  size  and  group 
organization  can  be  used  to  design  optimal  work  groups. 
The  upper  group  of  five,  averaging  .56  logits  more  able 
than  their  problem,  should  work  best  in  TEAM  agreement. 
The  middle  group  of  three,  averaging  only  .18  logits  more 
able  than  their  problem,  should  work  better  in  PACK 
disagreement.  The  bottom  group  of  seven,  averaging  .64 
less  able  than  their  problem,  however,  encounter  an 


additional  consideration.  Optimal  organization  for  this 
group  depends  on  the  cost/benefit  balance  between  success 
and  failure.  When  opportunity  invites,  PACK  disagreements 
should  be  more  productive.  When  danger  looms,  however, 
CHAIN  commitment  to  maintain  agreement  may  be  safer. 

Visualizing  Group  Mixtures. 

When  empirical  measures  B(.  are  estimated  from 
group  performance,  we  can  see  where  each  B(.  fits  on  the 
line  of  TEAM,  PACK  and  CHAIN  compositions  implied 
by  its  member  measures  { Bn  for  n - 1 ,N } by  plotting  B(i  at: 

X(j  ~ (Bu  - B)  / logN  and  Yti  = <BG  - BT)/  logN 


in  an  XY-plot  benchmarked  by  a TEAM,  PACK,  CHAFN 
line  with  intercept  (AND,  0),  slope  one  and  composition 
reference  points: 

XT  = (B-D)  [(N-l  )/log  N]  = Asd,  Yt  = (B1-BT)/log  N-0, 
Xp  = (Bp-B)/log  N=  +1,  Yp=(Bp-BT)/log  N = +1-AW 
X(.  = (Bc-BVlog  N=  -1,  Yc  = (Bc-BT)/log  N=  -1  - AND. 


Generalizing  The  Measurement  Model 

To  expand  probability  P = ^ [gF  *n  wr*te 


its  log  odds 


and  P()  for 


Ht^)  * £ 

°i%)  ‘ 
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*og|- 


a 


, a Rasch 


model  for  any  number  of  ordered  steps:  x - l,  2,  3, , , m-1, 
m,  ...  , oc  . This  model  constructs  additive  conjoint 
measurement  from  data  obtained  through  any  orderable 
categories:  dichotomies,  ratings,  grades,  partial  credits 
indexing  xj  and  Qn  to  item  /,  comparisons,  ranks,  counts, 
proportions,  percents... 

We  can  use  this  model  to  articulate  a variety  of 
frequently. encountered  facets.  To  represent  a measure  for 
person  n,  we  introduce  person  parameter  Bn.  To  produce 
an  observable  response  xnt,  we  provoke  person  n with  item  i 
designed  to  elicit  manifestations  of  the  intended  variable. 
To  calibrate  item  /,  and  so  construct  a quantitative  definition 
of  the  variable,  we  introduce  item  parameter  Dr  To  calibrate 
the  resistance  against  moving  up  in  item  i .from  category 
x-1  to  x,  we  add  item  step  parameter  F.x.  With  Dt  and  F.x  in 
place,  we  can  estimate  test- free  person  measures  which,  for 
data  which  follow  the  model,  are  stable  with  respect  to  item 
selection. 

When  person  n responds  directly  to  item  /, 
producing  response  xm,  we  can  collect  xm’s  over  persons 
and  items  and  construct  person  measures  on  the  item-defined 
variable.  But,  when  persons  are  observed  through 
performances  which  are  not  self-scoring,  then  we  need  a 
rater  j to  obtain  rating  xmj  of  person  n's  performance  on 
item  /.  But  we  know  that  even  the  best  trained  raters  vary 
in  the  way  they  use  rating  scales.  To  calibrate  raters,  we 
add  rater  parameter  C . With  C in  place,  we  can  estimate 
rater-free,  as  well  as  test-free,  person  measures  which,  for 
data  that  fit,  will  be  stable  with  respect  to  rater  selection  as 
well  as  item  selection. 

As  comprehension  of  the  measurement  context 
grows,  we  can  add  more  facets,  a task  parameter  Ak  for  the 
difficulty  of  the  task  on  which  person  n's  performance  is 
rated  by  rater  j on  item  i to  produce  xmjk  and  so  on. 

In  order  to  obtain  inferential  stability  [Fisher 
sufficiency  ( 1 920), Thurstone  invariance  ( 1 925),  a stochastic 
Guttman  scale  ( 1944),  Rasch  objectivity  (1960),  and  Luce 
andTukey  conjoint  additivity  ( 1964)]  we  need  only  combine 
these  parameters  additivelv  into  a many- facet  model 
(Linacre,  1989)  such  as: 

" Qntjk*  “ b-  * °>  ■ ci  ■ **  ■ f‘*  • 
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where  Bn  is  the  person  parameter,  D(  is  the  item  parameter, 
C is  the  rater  parameter,  Ak  is  the  task  parameter  and  Fjx  is 
the  item  step  parameter. 

Compositions  can  be  studied  in  any  facet  of  a many- 
facet  model.  Consider: 


Pnijkl 

Pnij*0 


Onijkl  “ Bn  Di  CJ  Ak  t 


Figure  10. 

Facet  Measures  for  5B JKs  and  BLOCKS. 
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rewritten  for  x = 0,1  to  simplify  presentation.  The 
measurement  models  for  TEAMs  of  animate  elements, 
persons  and  raters,  and  for  BLOCKs  of  inanimate  elements, 
items  and  tasks,  are  listed  in  Figure  10. 

For  TEAM  and  BLOCK  measures  to  increase  with 
group  size,  the  average  measure  of  the  grouped  facet  must 
exceed: 

1 > D + C + A D > B - C - A 

C > B - D - A A > B - D - C 

The  PACK  and  CHAIN  formulations  in  Figure  1 1 
arc  simpler.  For  PACKs  and  CHAINS  the  levels  of  other 
facets  do  not  matter.  More  persons  make  person  PACKs 
stronger,  but  person  CHAINS  weaker.  More  items,  raters 
or  tasks  make  PACKs  easier  to  satisfy,  but  CHAINs  more 
difficult. 


Figure  11. 

Facet  Measures  for  Konogeneous  WtfXs  and  CHAIfls. 
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Necessities  For  Inference 

Four  problems  interfere  with  inference: 

Uncertainty  is  the  motivation  for  inference.  We 
have  only  the  past  by  which  to  infer  the  uncertain  future. 
Our  solution  is  to  contain  uncertainty  in  probability 
distributions  which  regularize  the  irregularities  that  disrupt 
connections  between  what  seems  certain  now  but  must  be 
uncertain  later. 

Distortion  interferes  with  the  transition  from  data 
collection  to  meaning  representation.  Our  ability  to  figure 
out  comes  from  our  faculty  to  visualize.  Visualization 
evolved  from  the  survival  value  of  safe  body  navigation. 
Our  solution  to  distortion  is  to  represent  data  in  bilinear 
forms  that  make  the  data  look  like  the  space  in  front  of  us. 
To  ‘'see”  what  experience  “means”,  we  “map”  it. 

Confusion  is  caused  by  interdependency.  As  we 
look  for  tomorrow’s  probabilities  in  yesterday’s  lessons, 
interactions  intrude  and  confuse  us.  Our.  solution  is  to  force 
the  complexities  of  experience  into  few  enough  invented 
“dimensions”  to  make  room  for  clear  thinking.  The 
authority  of  these  fictions  is  their  utility.  We  will  never 
know  their  “truth”.  But,  when  our  fictions  “work”,  they 
are  usually  useful. 

The  logic  we  use  to  control  confusion  is  enforced 
singularity.  We  investigate  the  possibilities  for,  define  and 
measure  one  dimension  at  a time.  The  necessary 
mathematics  is  parameter  separability.  Models  which 
introduce  putative  “causes”  as  separately  estimable 
parameters  are  the  founding  laws  of  quantification.  They 
define  measurement.  They  determine  what  is  measurable. 
They  decide  which  data  are  useful,  and  which  are  not. 

Ambiguity  is  the  fourth  problem  for  inference.  We 
control  hierarchical  ambiguity  by  using  measurement 
models  which  embody  divisibility. 

Bookstein's  functions:  H(x  xy)  = H(x)  x H(y) 
and  G(x  + y)  = G(x)  + G (y)  for  resilience  to  aggregation 
ambiguity  contain  the  divisibility  necessary  to  stabilize 
quantitative  inference  (Feller,  1966).  They  also  contain  the 
parameter  separability  and  linearity  necessary  to  alleviate 
confusion  and  distortion.  Models  which  follow  from 
Bookstein’s  functions  implement: 

1 . the  concatenation  and  conjoint  additivity  which 

Norman  Campbell  (1920)  and  Luce  and  Tukey 

(1964)  require  for  fundamental  measurement. 

2.  the  exponential  linearity  which  Ronald  Fisher 

(1920)  requires  for  estimation  sufficiency  and 

3.  the  parameter  separability  which  Thurston e 

( 1 925)  and  Rasch  ( 1 960)  require  for  objectivity. 

The  measurable  compositions  are  TEAMs,  PACKs 
and  CHAINs.  The  measurement  models  necessary  and 
sufficient  for  quantitative  composition  analysis  arc  linear 
mixtures  of  the  Rasch  models  for  measuring  these 
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compositions.  Figure  12  summarizes  the  problems  of 
inference  and  their  current  solutions.  The  prevalence, 
history  and  logic  of  the  addition  and  multiplication  rules 
establish  the  Rasch  measurement  models  as  the  necessary 
and  sufficient  foundations  for  measurement.  Models  which 
contradict  the  inferential  necessities  of:  probability,  linearity, 
separability  and  divisibility,  cannot  survive  the  vicissitudes 
of  practice.  Only  data  which  can  be  understood  and 
organized  to  fit  a Rasch  model  can  be  useful  for  constructing 
measures. 


Figure  12 

Foundations  of  Inference 

PROBLEMS 

SOLUTIONS 

PARENTS 

UNCERTAINTY 
have  ->  want 
now  =>  later 
statistic  =>parameter 

PROBABILITY 

distribution 
regular  irregularity 
misfit  detection 

Bernoulli  1713 
De  Moivre  1733 
Laplace  1774 
Poisson  1837 

DISTORTION 

non-linearity 
unequeal  intervals 
incommensurability 

ADDITIVITY 

linearity 

arithmetic 

concatenation 

Luce/Tukey  1964 
Fechncr  1860 
Helmholtz  1887 
N.  Campbell  1970 

CONFUSION 

interdependence 

interaction 

confounding 

SEPARABILITY 

sufficiency 
invariance 
conjoint  order 

Rasch  1960 
R.  A.  Fisher  1920 
Thurstone  1925 
Guttman  1944 

AMBIGUITY 

arbitrary  grouping 
ambiguous  hierarchy 

DIVISIBILITY 

stability 

reproducibility 

Kolmogorov  1932 
Levy  1924 
Bookstein  1992 

For  Bernoulli,  Dc  Moivre,  Laplace  and  Poisson  see  Sttgler  (1986). 
For  Kolmogorov  and  Levy  see  Feller  (1966)*. 

Connotations,  Properties  And  Stories 

Mathematics  leads  to  three  reference  compositions 
which  empirical  composites  must  mix  to  be  measurable. 
We  can  use  group  member  measures  to  calculate  TEAM, 
PACK  and  CHAIN  expectations.  We  can  use  these 
expectations  and  empirical  group  measures  to  study  TEAM/ 
PACK/CHAIN  mixtures.  So  much  for  mathematics.  What 
can  TEAMs,  PACKs  and  CH AlNs  say  about  everyday  life? 
How  might  we  bring  these  mathematical  ideas  to  practice 
as  useful  formulations  for  better  living?  Can  these 
abstractions  help  us  manage  our  infinitely  complex 
experiences  with  living  compositions,  hierarchies  of 
functioning,  families  of  ideas  and  tasks?  Can  we  construct 
maps  by  which  to  “sec”  how  the  compositions  of  which  we 
are,  by  which  we  think  and  within  which  we  live,  might  be 
better  worked?  Figure  13  lists  some  connotations  which 
TEAMs,  PACKs  and  CHAINS  bring  to  mind.  Figure  14 
lists  some  properties  which  they  imply.  We  end  with  some 
stories  in  which  these  compositions  might  participate. 


Figure  13. 

Connotations  of  TKAX,  PACK  and  CHAIM. 


SAFE  DANGEROUS 

SURE  UNSURE 


TEAM 

govsrnrwnt 

formality 

convention 

CHAIN 

survival 

security 

discretion 

PACK 

science 

opportunity 

invention 

chaos 

anarchy 

TEA X PACK  CHAIN 


KIN 

virtue 

satisfaction 

justice 

pridi 

triuiph 

progress 

safety 

relief 

security 

guilt 

shsae 

fear 

LOSE 

indignation 

frustration 

recrimination 

worry 

disappointment 

despair 

Football.  When  a TEAM  of  players  huddle  to  call  a play, 
win  or  lose,  they  intend  to  act  united.  Should  one  of  them 
err,  this  will  hurt  the  TEAM.  TEAM  success  is  jeopardized 
by  weak  links  in  its  CHAIN  of  players. 


Lost  Keys.  What  is  the  best  way  to  look  for  a lost  key? 
Should  we  all  agree  to  look  in  the  same  place?  Or,  should 
we  all  agree  to  disagree  as  to  where  to  look  and  spread 
out?.  Each  in  a different  place  has  the  better  chance  of 
success.  PACK  work  is  the  way  to  look  for  lost  keys. 


Figure  14. 

Properties  Implied  by  TBAN,  PACK  and  CHAIM. 


TEAM  PACK  CHAIN 


unite 

collect 

connect 

consolidate 

accumulate 

protect 

evaluate 

exp 1 or® 

preserve 

unify 

discover 

secure 

agree 

attack 

defend 

uphold 

gain 

guard 

ground 

ground 

ground 

capitalize 

optimize 

survive 

consensus 

difference 

together 

play  saf« 

taka  chance 

hang  on  | 

smug 

daring 

cautious  | 

secure 

hopeful 

vorried  jj 

virtue 

pride 

safety 

disapproval 

shane 

danger  j 

usual 

rare 

dangerous 

events 

events 

events 

easy 

hard 

risky 

problems 

problems 

problems 

successful 

nissing 

mountain 

jury 

key 

climbing  | 
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Mountain  Climbing.  Climbers  rope  for  safety.  As  one 
climbs,  everyone  else  hangs  on.  Then,  should  a climber 
slip,  his  anchored  mates  may  be  able  to  save  him.  When, 
however,  a supposedly  anchored  mate  is  not  hanging  on  or 
moves  out  of  turn,  then  all  may  fall.  CHAIN  work  is  the 
way  to  climb  mountains. 

Cops  and  Robbers.  When  a crime  is  reported,  the  perpetrator 
is  often  unknown.  Solving  the  problem  begins  hard.  PACKs 
of  detective  TEAMs  fan  out  to  search  of  suspects.  As 
evidence  accumulates,  however,  deciding  who  is  guilty 
becomes  easier.  The  PACK  of  TEAMs  converges  in  their 
solutions  to  one  TEAM  agreement  and  detains  the  most 
likely  suspect. 

Should  the  suspect  go  to  trial,  judgement  will 
depend  on  a jury  TEAM  decision.  But,  if  a contrary  jurist 
holds  out,  the  jury  TEAM  may  become  a failing  CHAIN. 

A Common  Source  of  Misapprehension.  A weak  shooter, 
in  solitude,  misses  repeatedly.  But  then,  in  sudden  company, 
is  seen  to  hit  on  what  is  now  his  Nth  try.  His  PACK  ability: 
Bpn  = B + log  N =>  Bpl  = B'  + log  1 = B\  when  only  his 
finally  successful  shot  is  seen,  will  appear  to  be  the  ability 
B'  of  a stronger  shooter  who  hits  on  his  first  try. 

A strong  shooter,  in  solitude,  hits  repeatedly.  But 
then,  in  sudden  company,  is  seen  to  miss  on  what  is  now 
her  Nth  try.  Her  CHAIN  ability:  BCN  = B - log 

N =>  BC1  = B"  - log  I = B*'  , when  only  her  finally 
unsuccessful  shot  is  seen,  will  appear  to  be  the  ability  B"  of 
a weaker  shooter  who  misses  on  her  first  try. 

Solving  Problems.  When  problems  are  easy,  TEAMing 
ideas  into  one  course  of  action  should  work  best.  When 
problems  are  hard,  however,  putting  every  egg  in  a single 
basket  may  not  be  as  productive  as  deploying  a PACK  of 
diverse  undertakings.  When  a mistake  is  fatal,  however, 
then  PACK  diversity  risks  CHAIN  weakness. 

FOR  APPENDIX,  SEE  PAGE  38. 
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Book  Review 

by  Ayres  D’Costa,  The  Ohio  State  University 


Sato,  Takahiro  (1987).  Introduction  to  educational  information  technology.  Kanagawa,  Japan:  NEC 
Corporation. 


The  book  reviewed  here  is  an  English  language 
translation  of  this  1 987  publication  in  Japanese.  It  was  edited 
by  Delwyn  L.  Harnisch  (University  of  Illinois  at  Urbana- 
Champaign)  and  Michael  L.  Connell  (University  of  Utah 
at  Salt  Lake  City)  in  1990.  Currently  out  of  print,  it  will 
soon  be  available  from  NEC  Technical  College,  NEC 
Corporation.  1753  Shimonumabe,  Nakahara-ku,  Kawasaki, 
Kanagawa,  21 1 Japan.  Inquiries  may  be  directed  to  Delwyn 
Harnisch,  Dept,  of  Ed.  Psychology,  University  of  Illinois 
at  Urbana-Champaign,  5 1 Gerty  Dr.,  Champaign,  I L 6 1 820. 

Sato’s  book  is  divided  into  two  Parts,  with  Part  I 
presenting  four  chapters  dealing  with  the  history  and 
principles  of  educational  technology;  and  Part  II  focusing 
on  some  novel  Response-Analysis  techniques,  including 
Student-Problem  (S-P)  Chart  Analysis.  The  two  Parts  would 
appear  unrelated  to  most  readers,  and  the  whole  book 
somewhat  weak  in  format  because  Part  II  is  essentially  a 
compilation  of  relevant  papers  presented  by  Sato  on 
different  occasions. 

To  this  reviewer,  however,  this  book  presents  a life- 
long creative  effort  by  Sato  to  demonstrate  and  to  make 
available  to  classroom  teachers  the  information  management 
pow'er  of  computers.  He  compares  teachers  to  system 
engineers  who  must  make  consumer  needs  their  starting 
point,  and  then  “engineer”  available  materials  resources 
and  operational  techniques  to  serve  these  needs.  A teacher 
likewise  must  first  identify  her/his  students’  learning  needs 
and  then  adapt  instructional  content  and  the  educational 
resources  to  these  needs.  In  keeping  with  prevailing 
educational  technology  beliefs  in  the  U.S.,  Sato  recorded 
his  impassioned  plea  years  ago  in  Part  I that  the  computer 
be  utilized  as  an  instructional  tool  instead  of  as  a teacher 
substitute. 

Although  S-P  analysis  is  based  on  non-traditional 
psychometric  theory  and  an  adroit  use  of  computers,  the 
concepts  underlying  it  are  remarkably  simple  to  the  point 
of  appearing  simple-minded.  Sato  first  developed  a 
Response- Analyzer  for  teachers  in  1963.  This  system 
consisted  of  a keyboard  for  each  student  networked  to  a 
console  at  the  teachers  desk.  After  each  teaching  unit  the 
teacher  administers  a short  multiple-choice  test  to  the 
students.  They  respond  at  their  keyboards,  and  then  “the 
meters  and  the  digital  counters  at  the  teacher  s console 
indicate  what  percentage  of  the  class  is  responding  to  each 
of  possible  alternatives”.  The  S-P  Chart  Analysis  technique 
was  developed  to  help  teachers  use  these  types  of  data 
regarding  students  and  problems  to  improve  learning  and 
teaching. 

To  understand  the  S-P  Chart  Analysis  requires  one  to 


develop  a Matrix  (Students  X Problems)  with  Os  (indicating 
wrong  response)  and  Is  (indicating  correct  response).  The 
Students  are  arranged  by  descending  order  of  their  Total 
Score  in  the  rows  of  this  Matrix,  whereas  the  Problems 
(Items)  are  arranged  by  ascending  order  of  their  difficulty 
in  the  columns  of  the  Matrix.  The  Sato  Caution  Index  is 
then  computed  for  each  Student  and  Problem.  This  Index 
utilizes  a “Guttman-scaling”  concept.  The  student  is 
theoretically  expected  to  answer  correctly  the  first  T items 
in  this  Matrix,  where  T is  the  Total  Score  of  the  student  on 
the  test.  To  the  extent  that  the  Student  misses  (answers 
wrongly)  these  first  T problems,  or  answers  correctly 
problems  beyond  the  first  T,  then  Sato  postulates  that  the 
performance  is  “anomalous”  and  the  teacher  needs  to  be 
cautioned  about  this  student.  A similar  kind  of  thinking 
results  in  the  computing  of  the  Sato  Caution  Index  for  each 
Problem. 

The  S-P  Chart  analysis  techniques  developed  by  Sato 
have  been  introduced  in  the  United  States  by  Harnisch 
(1983)  who  developed  a special  computer  package  to  help 
teachers  use  the  S-P  Chart  technique.  Several  articles  have 
since  appeared  in  the  measurement  literature  justifying  its 
mathematical  premises  (Tatsuoka  & Linn,  1983); 
demonstrating  its  use  in  counseling  (Dinero  & Blixt,  1 988); 
applying  it  to  train  judges  engaged  in  a standards-setting 
task  (Jaeger,  1988);  and  extending  it  to  define  two  new 
caution  indexes  (D’Costa,  1993).  Sato  has  presented  his 
techniques  to  several  international  audiences.  However, 
what  is  a glaring  deficiency  to-date  is  the  lack  of  its 
discussion  in  current  measurement  text-books.  This  book 
will  serve  to  draw  attention  to  this  deficiency.  It  has  most 
of  the  ingredients  that  need  to  be  presented  in  an 
introductory  text.  This  reviewer  recommends  this  book  as 
a required  reading  for  prospective  classroom  teachers  in  an 
introductory  or  intermediate  educational  measurement 
course. 
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APPENDIX  to  Composition  Analysis  (Wright)  on  page  29. 


CHAIN  & PACK  DERIVATIONS 

Derivation  of  PACK,  and  CHAIN 
parameter  definition. 


from  their  exponential  (ratio; 


PMIC  definition: 


b?  - ^ b.-b  ]T  <V*» 


where  bp  - exp  (8,.)  b - exp (83  - exp<Bi  - B) 


so  that 


Bp  - B + log  £ expOj  - 8) 


Sxnce 


exp  - B)  - 1 + (£f  - B)  + (fli  - B)2/ 2 + (^  - B)  */6  ♦ 

u 

5£«xp(Bj  - B)  - J/[l  o|/2  ► Ojy3/6  + trjy2/ 24  + . . .]  - m 


pack  measure  becomes 

/ 

BP  - B * log  ( nw)  *•  B ♦ log(Wl  as  a,  - 0 . 


CHAIN  definition; 


so  that 


l/bc  . ^ (1/JbJ  - Cl/b)  ^(b/f>i 


Fc  - B - log  £ exp  (B  ~ 


Since 


exp  (B  - Bi)  - 1 ♦ (S  - Bj)  ♦ (B  - Si)®/2  + (8  - 8 ) 7 6 + . . . , 


49 

]jTexp(B  - Bj)  - N [l  + ctj/2  - CbYj^/6  + a*Ya/24  - . . .]  - J VW' 


CHAIN  measure  becomes 


tic  - B - log(JW')  - B - log(W)  as  oM  - 0 . 
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Voices  in  Education 

Marlene  Schommer 
Wichita  State  University 


! have  been  honored  to  take  over  the  VOICES  column  for1 
the  next  few  issues.  VOICES  was  originally  conceived  and  developed 
by  Greg  Marchant  and  1 thank  him  for  his  insightful  groundwork. 

As  a new  editor  of  this  column,  1 have  decided  to  develop 
the  potential  depth  that  VOICES  may  provide  for  the  MWER 
readership.  Veteran  leaders  of  education,  as  well  as  newer  leaders, 
have  been  asked  to  respond  to  timely  questions.  In  order  to  provide 
more  substantial  answers,  they  have  been  allowed  to  give  longer 
reactions  to  the  questions’  1 trust  that  you  will  appreciate  the  time  and 
thought  that  these  individuals  have  put  into  responding.  As  you  will 
see  from  their  responses,  the  advice  to  junior  faculty  is  diverse.  MWER 
indicates  a related  article  by  Orpha  Due  11  (p.  1 5)  and  welcomes  readers’ 
reactions. 


Leaders  in  education  were  asked  the  follow  ing  questions: 

a . What  are  the  most  common  mistakes  junior 
faculty  make? 

h.  What  suggestions  can  you  give  to  junior  faculty 
members  with  regard  to  balancing 
teaching,  research,  and  service? 

************************** 

The  most  common  mistake  of  junior  faculty  (and 
sometimes  of  the  people  who  evaluate  them!)  is  to  be  so 
concerned  about  doing  that  they  don’t  have  time  to  be 
concerned  about  thinking  about  what  they  are  going  to  do. 
Scientists  and  educators  are  evaluated  on  the  impact  of  their 
work.  Ultimately,  what  matters  is  how  much  of  a 
contribution  you  make  to  a field,  not  how  many  papers 
you’ve  published  or  how  many  classes  you’ve  taught.  Junior 
faculty  ought  to  concentrate  on  deciding  where  they  have 
the  greatest  contribution  to  make,  and  then  go  about  trying 
to  make  that  contribution. 

Robert  J.  Sternberg 
Yale  University • 

********** ****************** 

Some  junior  faculty  seem  to  believe  that  we  have 
an  expectation  that  they  will  not  qualify  for  tenure.  This  is 
not  true.  We  are  extremely  careful  in  screening  candidates 
we  hire,  and  beginning  assistant  professors  are  brought  in 
on  the  assumption  that  they  will  be  able  to  meet  conditions 
necessary  for  them  to  be  tenured  and  promoted.  1 wish 
there  were  some  way  to  diminish  what  1 perceive  to  be 
excessive  fears  on  the  part  of  untenured  new  faculty  about 
their  “survivability.”  Sometimes  these  worries  interfere  with 
their  work.  To  help  them  put  their  situations  in  perspective, 
we  now  assign  a senior  professor  to  work  as  a mentor  with 
our  new  people. 


A few  junior  faculty  seem  to  think  that  publications 
is  simply  a numbers  game.  We  are  interested  in  our  people 
developing  a line  of  inquiry  in  a fairly  focused  area.  When 
this  happens,  knowledge  agglutinates  and  has  potential  to 
influence  the  work  of  the  entire  community  of  scholars. 
We  are  much  more  interested  in  seeing  published  work 
reflecting  careful  thought  and  research  in  a single  area  than 
in  seeing  many  publications  on  disparate  topics  that  simply 
“fail  to  hang  together.” 

New  professors  need  to  understand  that  in  looking 
for  balance  among  teaching,  research,  and  service,  the  unit 
of  analysis  is  the  college,  not  the  individual  professor.  Some 
professors  have  more  strengths  in  some  of  the  areas  than  in 
others,  and  that  is  all  right.  In  our  institution,  it  sometimes 
has  been  the  case  that  newcomers  have  become  too  involved 
in  the  service  area.  Initially,  we  would  rather  have  them 
concentrate  on  developing  expertise  in  research  and 
teaching.  We  would  hope  for  more  service-oriented 
activities  after  they  have  qualified  for  tenure.  This  certainly 
does  not  mean  that  untenured  professors  should  not  engage 
in  service  work.  Rather,  we  simply  feel  that,  in  choosing 
to  allocate  their  time,  more  initially  should  go  to  research 
and  teaching. 

David  G\  Armstrong 
Texas  A&M  Un i versify 

********************** 

The  single  biggest  mistake  that  junior  faculty 
members  can  make  is  to  not  recognize  and  respect  the  goals 
of  the  institution  they  join.  For  example,  an  individual 
who  wants  to  develop  an  active  program  of  research  should 
go  to  an  institution  that  is  supportive  of  research.  Similarly, 
an  individual  who  wants  to  devote  all  of  his/her  energies  to 
excellence  in  teaching  should  go  to  an  institution  with  heavy 
teaching  loads  and  little  investment  in  research.  Obviously, 
any  faculty  member  must  strive  for  excellence  in  both 
teaching  and  research,  the  problem  is  one  of  relative 
emphasis. 

Andrew  C.  Porter ; Director 

Wisconsin  Center  for  Education  Research 

*********************** 

The  most  common  mistakes  junior  faculty  make 
arc  not  asking  useful  questions  about  priorities  at  their 
institutions  and  taking  on  too  much  at  the  request  of  various 
administrations.  Either  because  of  arrogance  or  naivete 
many  junior  faculty  feel  that  they  know  “all  the  answers” 
or  that  they  ought  to  know  them.  By  admitting  their 
ignorance,  they  feel  that  they  will  be  seen  as  poorly  prepared 
or  unprofessional.  Thus,  they  may  make  mistakes  that  may 
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cause  their  peers  to  indeed  view  them  as  poorly  prepared 
or  unprofessional. 

The  best  solutions  for  such  difficulties  is  the  use 
of  peer  mentors  — senior  faculty  who  can  provide  answers 
and  help  junior  faculty  in  the  setting  of  priorities.  Junior 
faculty  who  have  been  at  an  institution  a few  years  can  also 
be  useful  mentors  since  they  only  recently  were  in  need  of 
the  same  guidance  and  may  better  be  able  to  anticipate 
needs  and  questions. 

Only  senior  faculty,  however,  can  provide  credible 
guidance  in  the  tenure  and  promotion  process,  the  use  of 
institutional  memory,  and  insights  into  the  uses  of  power 
in  the  university.  Thus,  a mentoring  team  of  a senior  and 
“long  term”  tenure-track  junior  faculty  member  may  be 
the  best  solution  to  overcoming  the  common  mistakes  of 
junior  faculty. 

Murray  R.  Nelson 

The  Pennsylvania  State  University 

*************************** 

My  experience  as  a faculty  member  (8  1/2  years) 
does  not  allow  me  to  describe  what  I think  are  the  most 
common  mistakes  because  of  a lack  of  information.  As  a 
faculty  member  who  recently  shifted  from  junior  to  senior 
faculty  status,  now  being  a tenured  associate  faculty 
member,  I will  describe  some  of  the  mistakes  I made  that  l 
would  hope  other  faculty  would  avoid. 

1 .  Do  not  expect  to  receive  mentoring.  One  can 
wait  a long  time  in  hopes  that  a senior  faculty  member  will 
volunteer  to  serve  as  a mentor.  On  our  campus,  senior 
faculty  members  tend  to  be  heavily  involved  in  university 
service  activities  and  do  not  have  the  time  or  energy  for 
mentoring. 
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2.  Keep  your  research  focus.  Becoming  involved 
in  projects  initiated  by  senior  faculty  may  not  ultimately 
be  what  is  of  interest  and  may  not  provide  any  reward.  I 
expended  vast  amounts  of  time  and  energy  on  several 
projects  early  in  my  career  that  resulted  in  no  scholarly 
work. 

3.  Avoid  campus  politics.  Many  senior  faculty 
derive  their  professional  rewards  (and  perhaps  their  meaning 
in  life)  from  involvement  in  campus  politics.  Much  time 
and  energy  can  be  expended  in  this  domain  and  one 
ultimately  learns  that  universities  change  very  slowly,  so 
the  energy  seems  wasted. 

4.  If  you  are  productive  in  the  scholarly  domain, 
expect  to  encounter  jealousy  and  accusations  of  preferential 
treatment  by  senior  faculty. 

5.  Do  not  volunteer  to  teach  additional  loads  or 
take  on  unnecessary  new  course  preparation  until  your 
research  program  is  established.  Teach  well  within  your 
expertise  and  don't  broaden  your  teaching  repertoire  early 
in  your  career  unless  necessary  to  b ’p  your  department. 

6.  Establish  professional  contacts  within  the 
neighboring  communities.  They  help  one  maintain  a “real 
world”  perspective  and  are  extremely  helpful  with  research 
projects. 

7.  Request  monies  for  necessary  research 
materials.  Go  to  the  dean,  if  necessary. 

Chuck  Romig 
Wichita  State  University 
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Welcome  to  your  annual  meeting ! It  truly  is  your  annual  meeting  since  well  over  half  of  our  membership  wil  l be  convening 
in  Chicago.  The  Mid-Western  Educational  Research  Association  prides  itself  as  a professional  organization  that  is  collegial 
and  supportive  of  its  members.  The  annual  meeting  is  the  place  to  meet  respected  leaders,  see  new  faces,  and  hug  old  friends. 
This  year  will  be  no  different  as  well-known  leaders  from  across  the  country  join  students,  teachers,  administrators,  faculty, 
friends,  and  other  professionals  to  share  ideas  and  research.  As  you  page  through  this  program  I think  that  you  will  find  a good 
mix  of  invited  speakers  and  quality  presentations  from  your  colleagues. 

I want  to  thank  all  who  have  contributed  to  our  annual  meeting.  First,  I would  like  to  mention  my  gratitude  to  our  invited 
speakers.  These  well-known  eaders  in  education  epitomize  the  best  in  academia.  Keeping  our  Association  and  conference 
affordable  means  limited  finances  for  travel  and  speakers’  fees.  Our  speakers  are  serving  us  for  a fraction  of  what  they  deserve. 
Please  take  the  time  to  thank  them  for  being  friends  of  M WERA  and  sharing  their  time  and  expertise.  I want  to  express  my  personal 
thanks  to  Allyn  & Bacon  publishers  for  once  again  lending  me  a hand  and  for  supporting  MWERA.  Those  who  submitted 
proposals,  whether  accepted  and  not,  have  shaped  this  conference  and  have  put  the  process  to  the  test.  Tough  decisions 
needed  to  be  made  thisy  ear  in  selecting  proposals.  Our  Division  Chairs  and  reviewers  have  done  an  excellent  job.  The  Associate 
Program  Chairs  have  helped  put  this  conference  together  and  will  be  lending  a hand  along  the  way.  The  Board  of  Directors 
and  the  Editors  of  the  Mid-Western  Educational  Researcher  have  provided  support  and  displayed  patience  and  understanding 
in  the  development  of  this  program. 

The  most  important  element  necessary  to  the  success  of  this  year’ s Annual  Meeting  is  just  now  taking  shape;  that  involves 
you,  the  students,  the  teachers,  and  our  colleagues  who  will  be  registering  for  and  attending  this  year’s  conference.  You  will 
be  attending  workshops  and  sessions,  listening  to  and  making  presentations,  asking  questions  and  adding  insights,  providing 
support  and  direction  for  your  colleagues,  and  coming  together  as  the  Mid-Western  Educational  Research  Association. 

Greg  M archant 
MWERA  ’94  Program  Chair 
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How  to  Get  to  the  Conference 

When  coming  to  Chicago,  attendees  have  a variety  of 

transportation  options: 

O'Hare  Airport  to  the  Bismarck  Hotel  (3  options) 

1 . Take  a CTA  train  to  downtown  for  about  $2.00.  Catch 
the  train  in  the  basement  of  Terminal  3.  Take  an  A or  B 
line.  Get  off  at  the  Lake  Transfer  station.  This  is  in  the 
basement  of  the  State  of  Illinois  Building.  Climb  the 
stairs  and  proceed  to  the  Bismarck,  one  block.  This  is 
the  fastest  way  during  rush-hours,  and  the  cheapest. 

2.  Take  the  Continental  Bus  for  $ 1 2.50  one-way  or  $22.00 
round-trip.  No  reservations  are  required  from  the  airport. 
See  the  agent  at  the  booth  in  the  lower  level  baggage 
claim  area. 

3.  Take  a cab  for  around  $20.00.  Wait  in  the  cab  stand 
area.  In  off-hours  a ride  takes  about  30  minutes.  In  rush 
hours  (7-10  a.m.,  3-7  p.m.),  the  ride  could  take  an  hour 
or  more.  Tips  average  fifteen  percent. 

Midway  Airport  to  the  Bismarck  Hotel  (3  options) 

1 .  Take  a CTA  train  to  downtown  for  about  $2.00.  Catch 
the  train  at  the  east  end  of  the  airport.  Get  off  at  the 
Clark  & Lake  station.  Climb  down  the  stairs  and 
proceed  to  the  Bismarck,  one  block. 

2 Take  a Continental  Airport  Bus  for  $9.50  one-way  or 
$16,75  round  trip.  No  reservations  are  required  from  the 
airport.  See  the  agent  at  the  booth  for  tickets. 

3 Take  a cab  for  around  $1 8.00.  See  O'Hare  information 
above  regarding  time. 

Driving  But  NOT  Parking  Downtown  (3  options) 

From  the  North  or  West 

1.  Park  near  a Metra  station  and  take  a Metra  Train 
downtown.  From  the  Metra  station  you  will  need  to  lake 
a cab  to  the  hotel.  Depending  on  where  you  board  the 
train,  your  ride  can  be  inexpensive.  For  details  call  (3 12) 
836-7000.  Be  certain  to  find  out  about  return  trips, 
especially  on  weekends. 

2.  Park  at  O'Hare  remote  (follow  highway  signs  to  O'Hare), 
take  a shuttle  into  O'Hare  and  follow  any  of  the  O'Hare 
options.  Remote  parking  is  inexpensive. 

3 Park  at  Kiss  and  Ride  at  either  the  Cumberland  or  the 

Harlem  Avenue  exits  off  of  1-94  (the  Kennedy).  Take 
the  CTA  train  (See  O'Hare  option  1).  Parking  is 
inexpensive. 

From  the  South  or  East 

1.  Park  near  a Metra  station  and  take  a Metra  Train  . See 
#1  above. 


Driving  And  Parking  Downtown  (4  options) 

* Listen  to  the  Radio  (670  or  780  a.m.)  for  traffic  reports. 

* Remember,  rush  hours  are  7-10  a.m.,  3-7  p.m.  in  both 
directions.  Travel  in  the  city  takes  time.  There  is  a lot  of 
construction.  Plan  at  least  two  hours  from  the  near 
suburbs  to  downtown.  Plan  one-half  hour  (minimum)  in 
downtown  traffic. 

1 . Coming  in  on  1-94  from  the  North:  1-94  junctions  with 
the  Kennedy  at  Irving  Park  Road.  Continue  downtown. 
If  traffic  is  good,  it  should  take  40  minutes  from  the 
junction  as  the  Kennedy  is  under  construction.  Beyond 
the  Ohio  Street  exit,  get  in  the  right-hand  lane.  Exit  at 
Washington  Street  going  East.  At  LaSalle,  make  a left, 
go  one  block  and  make  a left  on  Randolph  to  the  hotel. 
After  you  drop  off  your  baggage,  you  can  park  your  car 
in  a self-park  (about  $15.00/day)  or  have  the  hotel  park 
it.  There  is  NO  street  parking. 

2.  Coming  in  on  1-90  from  the  Northwest:  Follow  1-90 
downtown.  This  becomes  the  Kennedy.  Follow 
directions  in  #1  above  for  exits  and  parking. 

3.  Coming  in  on  I-90/I-90  from  the  Southeast:  Take  the  I- 
90  (Skyway)  in.  The  toll  will  be  about  $2.00,  but  it  will 
save  you  a lot  of  time.  Get  in  the  Express  Lanes  to 
downtown.  When  you  approach  the  LOOP  follow  the 
signs  saying  1-94,  Kennedy  and  Wisconsin.  Exit  at 
Monroe  Street  and  head  east.  At  LaSalle,  take  a left, 
then  a left  on  Randolph  to  the  hotel.  After  you  drop  off 
your  baggage,  you  can  park  your  car  in  a self-park  (about 
$1 5/day)  or  have  the  hotel  park  it. 

4.  Coming  from  the  South  or  Southwest:  Take  the  1-57  in. 
This  junctions  with  1-94  and  1-90.  Read  #.  3 above. 

If  you  are  arriving  some  other  way,  or  have  any  questions,  please 

call  Sharon  McNeely  at  (3 1 2)  794-2788  before  your  trip.  She  will 

be  happy  to  help. 


The  Bismarck  Hotel  171  W.  Randolph  St.  Chicago, IL  60601 
(312)  236-0123 

The  Bismarck  Hotel  has  been  home  to  the  annual  meeting  of  the 
Mid- Western  Educational  Research  Association  for  several  years 
and  is  a friend  to  the  Association.  It  continues  to  offer  some  of  the 
most  reasonable  rates  in  Chicago.  A change  in  management  has 
brought  major  renovations  to  the  Hotel  as  well  as  additional 
services  and  activities.  Ballroom  dancing  returned  to  the 
Bismarck  last  year  and  this  year  the  Green  Room  becomes  the 
Green  Orchid  jazz  lounge.  The  Hotel  is  also  offering 
complimentary  shuttle  bus  service  to  many  of  the  sights  in 
Chicago  including  the  museums,  Art  Institute,  and  the  Water 
Tower  shopping  area. 
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Mid-Western  Educational  Research  Association  - Annual  Meeting  Registration  Form 


Please  print  or  type  all  information: 

Name 

Institution 

Complete  Mailing  Address 


Required  of  new  members  only: 

Highest  Degree ' 

MWERA  Division  Preference  _ 
Major  Area  of  Specialization 


E-mail Telephone:  Office  £ 1 

FAX Home  £ l 


Is  this  your  first  MWERA  conference?  Yes No 

Annual  Meeting  Registration  Fee: 

Student  (pre-registration  $30,  on-site  $35),  Regular/Professional  (pre  $45,  on-site  $55),  Non-member  (pre  $50,  on-site  $60) 


(Teachers  attending  Garcia  workshop  should  contact  Greg  Marchant  or  Sharon  McNoely) $ 


Membership  Dues: 

1994  Membership  dues  (required  for  all  participants  and  for  registration  discount  rate) 

- Regular  $18,  Student  $10 $ 

1995  Membership  dues  - Regular  $18,  Student  $10 $ 

Life  Membership  -$180 $ 


Conference  Workshops  (see  following  pages  for  details,  workshop  fees  are  $10  unless  noted) 

W.12.A  W.l.C  W.l.D  W.l.E  W.l.F  W.315.A  W.315.B 

F.9.Lin/F.5.Lin  ($5  total  for  both  parts)  (T.7.Med  and  F.915.Med  contact  Marchant  or  McNeely)..  $ 

MWERA  Materials  (all  materials  must  be  picked  up  at  the  registration  desk  at  the  conference,  prices  do  not  include  postage): 
Indicate  quantities  below: 

MWERA  Membership  Directory  $5 $ 

MWERA  94  Annual  Meeting  Abstracts  ( paper  $4)  ( IBM  $3)  ( Mac  $3) $ 

MWERA  mug  $3.50  each $ 


TOTAL $ 


* Registrants  requiring  special  dietary  needs  for  the  Friday  Luncheon  should  describe  those  needs  and  enclose  with  this  form. 
Please  make  your  check  payable  to:  Mid-Western  Educational  Research  Association  (MWERA) 

Mail  this  completed  registration  form  and  your  check  by  October  7,  1994  to:  Charles  C.  Anderson,  MWERA  Executive  Officer 

1332  Southwind  Drive 
Northbrook,  Illinois  60062 


HOTEL  RESERVATION  FORM  - Mid-Western  Educational  Research  Association  Conference  Oct  12-15,  1994 

Please  reserve: Single  room(s):  $60  Double  room(s)-Double  bed:  $75  Double  room(s)  -Twin  beds:  $75 

Date  and  Time  Arriving: Date  and  Time  Departing: 

Name(s) Affiliation __ 

Address  . _ : 

Hotel  Reservation  must  be  mailed  to  the  Bismarck  Hotel  (312)  236-0123  by  October  1,  1994: 

Bismarck  Hotel,  171  West  Randolph  Street,  Chicago,  IL  60601 
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EVENTS  AND  INFORMATION 


MWERA  94 


Special  Meetings  and  Events 

Division  Meetings  provide  colleagues  within  MWERA 
Divisions  an  opportunity  to  discuss  past  experiences 
and  plan  future  events.  Possible  invited  speakers  are 
discussed  as  well  as  the  Annual  Meeting  as  a whole. 
One  of  the  most  important  activities  is  to  gather  names 
of  those  interested  in  serving  as  Division  Chairs.  The  • 
Program  Chair  chooses  Chairs  to  head  each  Division 
for  the  next  year.  Often  a "junior"  Chair  becomes  the 
"senior"  Chair  for  the  next  year.  This  year's  Division 
Meetings  are  held  during  the  morning  hospitality  time 
so  that  coffee  and  rolls  will  be  available.  Check  each 
morning's  schedule  to  see  when  each  Division  meeting 
is  held  and  feel  free  to  attend  a different  one  each 
morning. 

The  Association  Council  is  the  governing  body  of 
MWERA.  It  includes  the  elected  members  of  the 
Association  Council  and  the  Board  of  Directors.  At  the 
Annual  Meeting  financial  reports  and  other  Association 
business  is  discussed.  This  year's  Association  Council 
meeting  is  Thursday  at  10:50. 

The  Cracker  Barrel  Social  is  an  informal  get  together 
to  wind  up  the  first  full  day  of  the  conference. 
Appetizers  and  a cash  bar  are  available  to  start  the 
evening  in  Chicago. 

The  General  Business  Meeting  is  open  to  all  those 
attending  the  Annual  Meeting.  It  is  the  only  activity 
scheduled  during  the  10:25-1 1 :45  time  slot  on  Friday, 
so  it  is  hoped  that  everyone  will  attend.  Information  is 
presented  and  Association  business  is  discussed.  The 
Graduate  student  award  drawing  is  also  held. 

The  Friday  Luncheon  is  included  in  the  conference 
registration  fee.  Announcements  are  made  and  an 
address  will  be  given  by  Robert  Slavin.  This  year  both 
the  keynote  speaker  and  the  luncheon  speaker  have 
agreed  to  be  available  after  their  presentations  for 
informal  discussion  and  questions  and  answers. 


The  Program  Committee  Meeting  will  take  a look  at 
the  positives  and  negatives  of  the  current  Annual 
Meeting  and  begin  preparations  for  next  year's. 
Comments,  criticisms,  and  volunteers  are  invited. 
Division  Chairs  are  expected  to  attend. 

The  President's  Reception  is  held  in  the  Regency 
Suite  of  the  Bismarck  beginning  at  9:00pm  on  Friday. 
Everyone  is  invited  to  relax  with  new  and  old  friends 
and  finish  discussions  or  start  new  ones. 

The  Road  to  Brown  video  documenting  the  legal 
crusade  for  civil  rights  that  culminated  with  Brown  v. 
Board  of  Education  will  be  shown  Saturday  morning. 

Rick  Pugh's  Presidential  Address  will  be  a media 
presentation  on  distance  education  on  Saturday 
morning. 


Suggestions  to  Presenters 

To  make  the  conference  sessions  as  helpful  and 

enjoyable  as  possible,  the  Board  of  Directors  ask. 

presenters  to  please  follow  these  guidelines: 

1.  Send  a completed  copy  of  your  paper  to  the 
Session  Chair  and  Discussant  so  that  it  is 
received  no  later  than  September  30,  1994. 
Discussants  are  not  obligated  to  discuss  papers 
received  after  this  date. 

2.  Bring  at  least  40  copies  of  your  paper  to  the 
conference.  People  interested  in  your  paper 
should  receive  a copy  at  the  conference. 

3.  Make  overheads  and  handouts  that  are 
attractive  and  readable.  Posters  should  be  firm 
enough  to  lean  or  lay  on  a table  and  should 
include  an  abstract  and  highlights  from  the 
paper. 

4.  Plan  to  present,  rather  than  read  your  paper  in 
the  time  allotted. 

5.  Session  chairs  should  divide  the  time  available 
equally  among  the  presenters,  discussants,  and 
the  audience. 

6.  Because  of  purchase  costs,  storage  space,  and 
maintenance  issues,  equipment  other  than 
overheads  will  not  be  provided. 


6 


MWERA  94 


55  f 


*\ 


EXPLANATION  OF  PROGRAM  AND  SESSION  FORMATS 


T.1050.C  Teacher  Attitudes  and  Beliefs  (Division  K-Paper 
Session) 

T = Session  is  held  on  Thursday 

1050  = Session  begins  at  1 0:50  in  the  morning 

C = Session  in  held  in  Parlor  C 

Followed  by  title  of  session.  Followed  by  sponsoring  Division. 
Followed  by  session  format. 


Evaluate  sessions  and  the  annual  meeting 

An  evaluation  form  for  the  conference  will  be  included 
in  your  registration  materials.  Session  Chairs  should 
distribute  evaluation  forms  for  each  session.  This  is 
vour  conference  and  your  comments  are  important  to  the 
improvement  of  the  MWERA  annual  meeting. 


General  Information 


Session  Formats 

Paper  sessions  provide  each  author  an  opportunity  to 
present  an  abbreviated  version  of  a paper.  The  presenter  usually 
has  between  1 5 and  20  minutes  for  the  presentation.  Although  a 
complete  paper  or  summary  should  be  available,  the  author 
should  not  read  the  paper  as  a form  of  presentation.  When  a 
discussant  is  included  in  the  session,  comments  should  be  made 
that  synthesize,  compare,  or  contrast  the  papers,  or  point  out  the 
strengths  and  weaknesses  of  the  studies.  The  discussant  should 
not  provide  a detailed  critical  review  of  the  paper,  but  rather 
should  focus  on  the  conceptual  and  methodological  nature  of  the 
paper  and  its  results. 

Poster-Tables  allow  the  author  an  opportunity  to 
interact  with  small  groups  of  interested  colleagues  for  a longer 
period  of  time  (usually  40  minutes  to  over  an  hour).  Posters 
placed  on  a table  or  propped  up  on  chairs  provide  an  overview  of 
the  paper.  The  poster  should  include  a brief  abstract  as  well  as 
highlights  or  significant  information  from  the  paper  presented  in 
large  type  font  for  easy  reading  from  a distance.  The  author 
should  have  copies  of  the  complete  paper  or  summary  and  should 
be  available  to  discuss  the  paper  during  the  entire  session.  Poster- 
Tables  are  abbreviated  P-T  on  the  matrix. 

Symposia  allow  a panel  of  presenters  with  a shared  topic 
an  opportunity  to  make  a presentation  and  share  views.  Symposia 
are  abbreviated  Sym  on  matrix. 

Invited  speakers  and  panels  have  been  invited  to  address 
the  conference.  They  are  recognized  leaders  in  education  and 
have  been  asked  to  share  their  experience  and  knowledge. 
Everyone  attending  the  conference  is  invited  to  attend  these 
sessions.  Invited  sessions  are  abbreviated  Inv  on  the  matrix  or  are 
simply  described  without  a format  designation. 

Alternative  formats  allow  presenters  to  experiment  or 
use  less  traditional  methods  to  convey  information.  Although  all 
sessions  should  allow  for  question  or  discussion  time,  most 
alternative  sessions  strive  for  increased  participation  by  those 
attending.  Alternative  sessions  are  abbreviated  Alt. 

Workshops  are  designed  to  allow  presenters  to  involve 
those  attending  in  the  active  development  of  new  skills  or 
knowledge.  They  are  scheduled  for  two  to  four  hours,  and  a small 
fee  is  charged. 


Registration 

Everyone  participating  in  or  attending  the  MWERA  annual 
meeting  must  be  registered.  Those  planning  on  attending  the 
annual  meeting  are  encouraged  to  pre-register  for  the  conference, 
any  workshops,  and  make  hotel  reservations  early  (pre-registration 
and  reservations  must  be  mailed  by  October  1.  1994. 

On-site  registration  and  packet  pickup  are  available  in  the  lobby 
of  the  Bismarck  at  the  following  times: 

Wednesday,  October  12  1 1 :30  am  - 4:30  pm 

Thursday,  October  13  8:00  am  - 4:00  pm 

Friday,  October  14  8:00  am  - 4:00  pm 

Saturday,  October  15  8:00  am  - 10:30am 

Name  tags  should  be  worn  to  all  sessions  and  must  be  worn  to  the 
conference  luncheon.  Teachers  registering  for  the  Garcia 
Workshop  and  sessions  should  contact  Greg  Marchant  (317  285- 
8500)  or  Sharon  McNeely  (312  794-2788) 


Membership  provides  reduced  conference  registration  fees  and  a 
subscription  to  the  MWERA  official  publication,  the  Mid-Western 
Educational  Researcher.  Those  attending  are  encouraged  to  join. 
Conference  presenters  must  be  1 994  members. 


Selected  MWERA  publications  are  available  through  pre- 
registration: 

Directory  of  MWERA  members  is  available  for  $5. 
MWERA  94  Meeting  Abstracts  is  available  for  $4  on 
paper  and  $3  on  computer  disk  (IBM  & Mac). 

These  publications  may  not  be  available  at  the  conference  unless 
ordered  through  pre-registration. 

A limited  number  of  copies  of  this  Program  Issue  may  be  available 
at  the  registration  desk  for  $4  each. 

MWERA  Mugs  are  available  at  this  year's  annual  meeting.  The 
cream  colored  mugs  hold  10  ounces  and  have  ’’MWERA"  printed 
on  one  side  and  "Mid-Western  Educational  Research  Association" 
printed  on  the  other  in  dark  green  lettering.  The  mugs  may  be 
ordered  through  pre-registration  for  $3.50  each  (quantities  are 
limited).  Publications  and  mugs  must  be  picked  up  during  the 
conference  at  the  registration  desk. 


An  expanded  Exhibit  Hall  will  feature  publishers  and  those 
providing  materials  and  services  to  educators  on  Friday  in  the 
Maximillian  Room.  Plan  on  stopping  by. 
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WEDNESDAY,  OCTOBER  12 


WORKSHOPS 


W.  1 2. A Creating  Learning  Opportunities  in 

Supervision 

12:00-3:00  (3  hour  workshop)  Parlor  A - Fee  $10 
PRESENTERS: 

Carmen  R.  Giebelhaus,  University  of  Dayton 
Linda  E.  Morrow , Muskingum  College 
Mary  K.  Bendixen-Noe,  Ohio  State  University-Newark 
The  purpose  of  this  workshop  is  to  explore  innovative 
supervisory  practices  designed  to  enhance  the  learning 
process  during  preservice  teacher  education  field 
experiences.  Topics  include  preparing  teacher  educators 
to  train  field-based  supervisors,  preparing  cooperating 
teachers  for  supervisory  leadership,  and  preparing 
teacher  candidates  to  be  observed  and  to  be  observers. 
The  workshop  will  guide  participants  through  three 
stations  designed  to  discuss  processes  and  provide 
materials  associated  with  effective  supervision, 
including:  the  mechanical  third  ear  device  (Bug-in-the- 
Ear);  orientation/training  materials  and  audio-tapes;  site- 
based  supervision  models/strategies;  and  student 
obs ervation/co nferenci ng  technique s . 

W.l.C  Focus  Group  Interviews  as  a Needs 

Assessment  Tool 

1 :00-5:00  (4  hour  workshop)  Parlor  C - Fee  $10 
PRESENTER: 

Thomas  M.  Archer , Ohio  State  University 
Originally  developed  as  a marketing  research  tool,  in 
recent  years  the  Focus  Group  Interview  (FGI)  technique 
has  also  gained  popularity  in  gathering  information  for 
decision  making  in  educational  and  other  social  science 
settings,  particularly  in  needs  assessment.  FGI  involves 
a trained  moderator  who  guides  a small  group  of 
participants  through  a pre-determined  questioning  route. 
The  information  gained  is  rich  in  detail  due  to  the 
discussion  interaction  and  qualitative  nature.  The 
workshop  will  introduce  the  FGI  technique,  outline  the 
advantages  and  disadvantages,  and  illustrate  examples  of 
how  it  can  be  used  in  needs  assessments  in  educational 
settings. 


MWERA  Workshops  offer  professional  training  by 
knowledgeable  experienced  experts  at  a fraction  of  the 
cost  of  similar  workshops  offered  elsewhere. 


W.  1 .D  Standards  and  Practices  in 

Qualitative  Research 

1 :00-5:00  (4  hour  workshop)  Parlor  D - Fee  $10 
PRESENTERS: 

James  Powell  and  Fran  Peterman  Gerhard, 

Ball  StateUniversity 

This  workshop  will  deal  with  the  accepted  standards  of 
practice  for  qualitative  research.  It  will  begin  with  a 
discussion  on  what  constitutes  validity  and  reliability  in 
qualitative  studies.  It  will  also  seek  to  address  such 
issues  as  researcher  role  and  responsibilities,  participant 
role  and  responsibilities,  data  collection  methods  and  the 
purpose  served  by  the  different  methods  (including 
triangulation),  data  analysis,  and  report  writing.  While 
this  is  a very  ambitious  schedule,  it  will  be  modified  to 
meet  the  needs  of  individuals  involved  in  the  workshop. 
If  you  have  a study  you  wish  to  discuss,  bring  it  along 
and  we  will  make  every  effort  to  answer  any  questions 
you  might  have. 


W.l.E  Many  Facet  Rasch  Measurement:  An 

Introduction  to  the  Model,  Computer 
Applications,  and  the  Development  of 
Performance  Task s 

1 :00-5 :00  (4  hour  workshop)  Parlor  E - Fee  $ 1 0 
PRESENTERS: 

Craig  W.  Deville  and  Mary  E.  Lunz, 

American  Society  of  Clinical  Pathologists; 
John  Michael  Li  nacre,  University  of  Chicago 
The  workshop  will  introduce  participants  to  the  many- 
facet  Rasch  measurement  model  (MFRM),  and  to 
provide  them  with  the  practical  knowledge  necessary  to 
use  the  model  and  to  conduct  MFRM  research.  The 
MFRM  is  an  extension  of  the  Rasch  model  and  is  used, 
for  example,  to  correct  examinee  measures  for  relatively 
difficulty  of  particular  tasks  undertaken  and  the  judge’s 
relative  severity  when  rating  examinee  performance  on 
these  tasks.  In  a context  involving  oerformance 
assessment,  the  MFRM  is  particularly  useful.  The 
history,  theoretical  underpinnings,  implications, 
computer  input  and  output,  and  a comprehensive 
example  will  be  presented. 
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W.  1 .F  An  Introduction  to  Correspondence 

Analysis 

1:00-5:00  (4  hour  workshop)  Parlor  F - Fee  $10 
PRESENTERS: 

Hak  Ping  Tam,  The  Univiversity  of  Maryland 
JohnJ.  Kennedy,  The  Ohio  State  University 
The  objective  is  to  introduce  the  history,  geometry, 
algebra,  computational  features,  and  computer 
applications  (e.g.,  BMDP)  of  correspondence  analysis 
(CA),  a relatively  new  technique  that  describes  complex 
categorical  variable  relations  through  graphical 
depictions.  The  workshop  is  designed  for  researchers 
who  possess  a working  knowledge  of  basic  contingency 
table  analysis  (e.g.,  chi-square),  but  who  currently 
possess  little  or  no  knowledge  of  CA.  Its  potential  for 
creative  descriptive  use  in  educational  research  and 
evaluation  is  unlimited.  However,  due  more  to  lack  of 
knowledge  than  complexity,  few  applications  of  CA  have 
been  observed  in  the  educational  literature.  Through 
lecture,  examples,  and  computer  illustrations,  the 
instructors  willattempt  to  promote  a conceptual 
understanding  of  CA  and  to  demonstrate  how  this 
exploratory-graphical  technique  can  be  used  to  great 
advantage  in  educational  inquiry. 

W.315.A  The  Use  of  Authentic  Assessments  in  the 

Preparation  of  Professional  Educators 
3:15-5:15  (2  hour  workshop)  Parlor  A - Fee  $10 
PRESENTER: 

Stanley  E.  Wigle  and  Charles  D.  Manges,  Wayne  State 
College 

In  order  to  meet  the  demands  for  an  "educated  work 
force"  educators  must  generate  real  world,  authentic 
tasks  that  exemplify  communication  skills,  problem- 
solving, invention,  and  other  forms  of  critical  thinking. 
This  workshop  will  focus  on  authentic  and  alternative 
assessments  which  provide  a method  of  not  only 
developing  stronger  assessment  tools,  but  utilizing  those 
tools  to  determine  instructional  decisions  while  assessing 
important  outcomes.  The  presentation  will  involve 
higher  education  faculty  and  K-12  educators  in  an  open 
exchange  of  ideas  leading  to  participant  creation  of 
examples  of  authentic  assessment  tasks  and  scoring 
rubies. 


MWERA  Offers  Special  Multicultural  Workshop 
for  Teachers 

Teachers  interested  in  attending  a workshop  presented 
by  Eugene  Garcia,  U.  S.  Dept,  of  Education  should 
contact  Greg  Marchant  (317-285-8505)  or  Sharon 
McNeely  (312  794-2788)  for  rates  and  a registration 
form. 


W.3 15.B  An  Introduction  to  Hierarchical  Linear 

Modeling 

3:15-5:15  (2  hour  workshop)  Parlor  B - Fee  $10 
PRESENTER: 

Randall  E.  Schumacher,  Univiversity  of  North  Texas 
Often  researchers  are  interested  in  examining  differences 
between  school  districts,  schools,  or  classroons  while 
examining  processes  within  these  organizational  units. 
The  workshop  will  provide  participants  with  an  applied 
and  practical  understanding  of  this  analytical  method. 
The  workshop  will  cover  the  types  of  research  questions 
addressed,  data  coding,  data  analysis,  presentation,  and 
imterpretation  of  results.  The  workshop  will  include  a 
computer  demonstration  and  a packet  of  materials  will  be 
distributed  that  includes:  sample  exercises,  computer 
printouts,  and  references. 


THURSDAY 


T.7.Med  Issues  in  Multicultural  Education 

7:00-9:30  (2  1/2  hour  workshop  for  teachers  only) 
Medill  -Special  Fee-  Contact  Drs.  Marchant  or  McNeely 
PRESENTER: 

Eugene  Garcia,  Director  of  the  Office  of  Bilingual 

Education  and  Minority  Language  Affairs,  U.S. 
Department  of  Education 
PARTICIPANTS: 

Classroom  teachers  only 

Will  present  information  on  issues  related  to  cultural 
diversity  and  how  to  make  classrooms  more  multicultural 
in  orientation.  The  focus  will  be  on  helping  classroom 
teachers  explore  issues  they  face  and  determine  ways  to 
address  them.  Teachers  of  all  grade  levels  are  strongly 
encouraged  to  attend  this  learning  session. 


FRIDAY 


F.915.Med  Issues  in  Multicultural  Education 

9:15-11:45  (2  1/2  hour  workshop  for  teachers  only) 
Medill  -Special  Fee-  Contact  Drs.  Marchant  or  McNeely 
PRESENTER:  Eugene  Garcia,  US.  Department  of  Ed. 
Other  information  is  same  as  above. 

F.9.Lin/F.5.Lin  Getting  and  Keeping  an  Academic  Position 
9:00-10:20  & 5:00-6:16  (2  part  workshop  for  graduate 
students)  Lincoln  - Fee  $5 
PRESENTERS: 

Jerry  Jinks,  Illinois  State  University 
Kim  Metcalf  Indiana  University 
Carolyn  Babione,  Emporia  State  University 
PARTICIPANTS: 

Graduate  students  seeking  new  position  and  new  hires 
Popular  workshop  presenting  honest  answers  to  job 
search  questions  and  about  how  to  stay  on  the  road  to 
promotion  and  tenure. 
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WEDNESDAY,  OCTOBER  12 


MWERA  94  SPECIAL  SESSION 


MOTIVATION  ISSUES  IN  EDUCATION 


Where  There's  a Way,  There's  a Will. 


Lyn  Como 


Lyn  Como,  Teachers  College,  Columbia  University,  is  credited  with  major  advancements  in 
research  on  self-regulation  and  motivation  reported  in  numerous  articles  and  book  chapters. 


Paul  R.  Pintrich,  University  of  Michigan 

Published  over  40  articles  and  book  chapters  on  issues  of 
motivation,  learning,  and  self-regulation.  He  has  edited  three 
books  on  motivation  and  has'a  textbook  forthcoming  on 
Motivation  and  Education, co-authored  with  Dale  Schunk. 


Dale  H.  Schunk,  Purdue  University 

Published  over  55  articles  and  book  chapters,  and  has 
co-edited:  Self-Regulation  of  Learning  and  Performance , 
Self-Regulated  Learning  and  Academic  Achievement , and 
Student  Perceptions  in  the  Classroom . 


Motivation  is  of  critical  importance  in  education  today.  Researchers  and  practitioners  are  concerned  about 
establishing  classroom  environments  that  help  to  develop  motivation  among  students  and  teachers  and  maintain 
it  at  an  optimal  level.  Dale  Schunk 


Maximillian  Room,  BISMARCK  HOTEL,  17 1 W.  Randolph,  CHICAGO,  IL 

Public  Invited  - 8:00  pm  - No  Charge 


Sponsored  by  the  Mid-Westem  Educational  Research  Association 


Please  duplicate,  distribute,  and  post  this  announcement 


WEDNESDAY  - MWERA  94 
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THURSDAY,  OCTOBER  13 


MWERA  94 


T.8.Max  Mid-Western  Hospitality 

(Complimentary  coffee  and  rolls)  8:00-9:00 
Maximillian 

T.8 1 0.Max  Division  Meetings 

(Discussion-bring  your  coffee  and  rolls  and  review 
past  and  plan  future  with  your  Division  colleagues) 
8:10-9:15  Maximillian  (Div  K in  Parlor  F) 
PARTICIPANTS:  Divisions  B,  G,  Ht  and  K 

T.845.Lin  New  Member  Welcome:  Old  Friends  and 

New  Faces 

(An  introduction  and  orientation  for  those  new  to 
MWERA  or  the  annual  meeting)  8:45-9:25  Lincoln 
CHAIR:  Carmen  Giebelhaus,  University  of  Dayton 
PARTICIPANTS:  MWERA  Officers  and  friends 


T.930.Max  Working  Toward  Foresight  and  Follow- 
through  (Keynote  Address) 

9:30-10:40  Maximillian 

CHAIR:  Gregory  J.  Marchant,  Ball  State  University 
SPEAKER:  Lyn  Como,  Teachers  College,  Columbia 
University 


T.  1 050.Med  Issues  in  Validity 

(Division  D-Paper  Session)  10:50-12:10  Medill 
CHAIR:  Laura  Barnes,  Oklahoma  State  University 
PARTICIPANTS: 

A Validation  Technique  Combining  Content  and 
Construct  Evidence. 

Craig  W.  Deville,  American  Society  of 
Clinical  Pathologists 

The  Use  of  Rasch  Analysis  to  Establish  the  Reliability 
and  Validity  of  a Paper  and  Pencil  Simulation. 

Christine  Fox,  University  of  Toledo;  Julie 
Gedeon , Kent  State  University ; Thomas  E. 
Dinero,  Kent  State  University 
DIF  of  Novices  and  Experts  on  a Practical  Knowledge 
Instrument. 

Julie  Gedeon,  Kent  State  University ; 
Christine  Fox,  University  of  Toledo;  Thomas 
E.  Dinero,  Kent  State  University 
Concurrent  Validity  Coefficients:  Eighth  Grade 
Science  Illinois  Goal  Assessment  Program  Test. 

David  Suddic.k,  Leon  J.  Zalewski,  and  John 
M.  Reid,  Governors  State  University 
DISCUSSANT:  Patricia  Klass,  Illinois  State 
University 


Lyn  Corno 

Professor  of  Education  and  Psychology 
at  Teachers  College-Columbia  University 
and  Editor  of  "Teaching,  Learning,  and 
Human  Development"  section  of  the 
American  Educational  Research  Journal , 
has  nearly  50  publications  including 
books,  book  chapters  and  articles  in  top 
educational  research  journals. 


Foresight,  prudence,  discretion— action  in  reference  to  the  future-have  shown  themselves  to  be  necessary 
qualities  for  social  evolution  throughout  time.  How  are  foresight  and  follow-through  reflected  in  the  social 
systems  we  create,  including  education?  How  are  they  learned  by  people  as  they  function  within  these  systems? 
With  knowledge  about  what  makes  communities  and  individuals  able  and  inclined  to  "take  the  long  view," 
educators,  parents,  and  counselors  might  be  belter  able  to  influence  future  generations  in  this  direction. 
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T.  1050. A Training  and  Retention  of  Administrators 

(Division  A-Paper  Session)  10:50-12:10  Parlor  A 
CHAIR:  Karen  Michaelis,  Illinois  State  University 
PARTICIPANTS: 

Linking  the  NPBEA  Competencies  to  Principalship 
Practicum. 

Edie  L.  Holcomb,  North  Central 
Association , Wisconsin 

Superintendent  Turnover:  Is  It  Worse  in  Financially 
Troubled  Districts? 

William  L.  Sharp , Southern  Illinois  University 
A Case  Study  Evaluation  of  the  Reflective  Process  in  a 
Preparation  Program  for  Educational 
Administrators. 

Ted  A.  Zigler,  University  of  Cincinnati 
DISCUSSANT:  Connie  Nolte,  Akron  Public  Schools 

T.1050.B  Student  Achievement  as  a Function  of 

Instructional  Practices  and  Curriculum 
Tracks 

(Division  B-Paper  Session)  10:50-12:10  Parlor  B 
CHAIR/DISCUSSANT:  Peter  Pereira,  DePaul  Univ. 
PARTICIPANTS: 

Student  Selected  Curriculum  Tracks  as  a Mediating 
Influence  on  Academic  Achievement. 

. LindaS . Behar,  University  of  Florida 
Thinking  Math  as  a Teaching  Tool. 

ScydoniaA.  Walls,  Chicago  State  University 
A Comparison  of  the  Effectiveness  of  CAI  and 
Programmed  Instructional  Delivery  Methods. 

Bonnie  L.  Cirignano  and  Isadore  Newman, 
University  of  Akron 

What  Teachers  Do  in  the  Classroom:  A Study  on  the 
Use  of  Research-Based  Instructional  Practices  in 
Reading. 

Virginia-Ellen  Goodman,  Chicago  State  Univ . 

T.1050.C  Teacher  Attitudes  and  Beliefs 

(Division  K-Paper  Session)  10:50-12:10  Parlor  C 
CHAIR:  SonjaJ.  Smith,  Mt.  Vernon  Nazarene  College 
PARTICIPANTS: 

Change  in  Teachers’  Conceptions  and  Practice. 

Roberta  A . Fuller,  Illinois  State  University 
Teacher  Perception  of  Student  Interest  in  Multicultural 
Tradebooks. 

Judy  C.  Lambert,  Univ.  ofWisconsin-Oshkosh 
Differences  in  Teachers’  Attitudes  toward  Student 
Behavior  Problems. 

Barbara  J.  Witteman,  Miami  University 
A Study  of  Prospective  Teachers'  Attitudes. 

Linda  H.  Chiang,  Anderson  University 


A special  thank  you  to  the  Chicago  Public  Schools  for 
the  use  of  the  overheads  and  their  continuing  support 
ofMWERA. 


T.  1 050.D  Teacher  Perceptions  and  Attitudes 

(Division  K-Paper  Session)  10:50-12:10  Parlor  D 
CHAIR:  Marilyn  K.  Urquhart,  Univ.  of  South  Dakota 
PARTICIPANTS: 

Interactive  Perceptual  Psychology:  The  Human 
Psychology  that  Mirrors  the  Naturalness  of  Our 
Total  Behavioral  System. 

Gary  F.  Russell,  Notre  Dame  College;  Linda 
Shoare,  The  Center  for  Prof  Advancement 
The  Effects  of  the  Focus  Model  on  TeacherPerception,  • 
Efficacy,  and  Application  in  the  Classroom. 

Gary  F.  Russell,  Notre  Dame  College 
Our  Beliefs  About  Their  Beliefs:  Educational  Beliefs 
of  Faculty  and  Teacher  Education  Students. 

Jean  W.  Pierce,  Northern  Illinois  University 
DISCUSSANT:  Louise  E.  Flemming,  Ashland  Univ. 

T.  1050.E  Parental  Training:  Influence  with  Children 

(Division E Paper  Session)  10:50-12:10  ParlorE 
CHAIR:  Larry  McNeal,  Illinois  State  University 
PARTICIPANTS: 

Effect  of  Parent  Training  for  Parents  of  Children  with 
Attention  Deficit  Hyperactivity  Disorder  on  Parent 
Stress. 

Michelle  Beabout  Viro,  Susan  Turetzky,  and 
Alison  Rifkin,  Indiana  State  University 
Age,  Socioeconomic  Status,  Type  of  School  Attended, 
and  Students'  Perception  of  Parental  Help  with  School 
Work. 

Jupian  J . Leung  and  Daniel  O.  Lynch, 
University  ofWisconsin-Oshkosh 
DISCUSSANT:  Sharon  Paulson,  Ball  State  University 

T.  1 050.F  The  Multistate  Paradigm:  Contributions 

from  Imagery,  Eastern  Psychology, 
Meditation,  Mysticism,  and  Psychodelics 
(Division  F- Alternative  Format-formal  presentation, 
experiential  exercises,  theoretical  positions, 
discussion) 

10:50-12:10  Parlor  F 

CHAIR:  Thomas  Roberts,  Northern  Illinois  University 
PARTICIPANTS: 

Imagery.  Kathleen  Best,  Northern  Illinois  University 
Meditation  and  Eastern  Psychology. 

Fred  Hannah,  Northern  Illinois  University 
Psychosynthesis  and  Unitive  Conscious. 

Paula  Hruby,  Northern  Illinois  University 
Multistate  Theory  and  Psychoactive  Drugs. 

Thomas  Roberts,  Northern  Illinois  University 

T.  1 050, Lin  Association  Council  Meeting 

(Business  Meeting)  10:50-12:10  Lincoln 
PARTICIPANTS:  MWERA  Association  Council  and 
Board  of  Directors 
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T.1050.  Max  Keynote  Follow-up 

(Informal  Discussion)  10:50-12:10  Maximillian 
CHAIR:  Jennifer  J.  Fager,  South  Dakota  State  Univ. 
SPEAKER:  Lyn  Como , Teachers  College,  Columbia 
What  kinds  of  research  would  inform  efforts  to 
document  what  is  known  about  the  socialization  of 
personal  qualities  like  foresight  and  follow-through? 
How  can  partnerships  between  schools,  youth 
organizations,  and  work  settings  function  to  better 
prepare  and  support  future  responsible  citizens? 

What  do  we  need  to  learn  about  the  political,  social, 
and  economic  arenas  in  which  such  interventions  take 
place? 

T. lOSO.Fifth  Perspectives  on  Values  in  Educational 
Leadership 

(Division  A-Symposium)  1 0: 50- 1 2: 1 0 
Fifth  Floor  Meeting  Room 

ORGANIZER:  Martin  H.  Jason,  Roosevelt  University 
CHAIR:  Charles  D.  Almo,  Roosevelt  University 
PARTICIPANTS: 

The  Role  of  Values  in  Leadership  Behavior. 

Charles  D.  Almo,  Roosevelt  University 
Value  Orientations  of  Educational  Leaders: 
Implications  for  Research. 

Martin  H.  Jason , Roosevelt  University 
Examining  Values  and  Ethics  in  Leadership  Education. 

Tom  Van  Dam,  Roosevelt  University 
Values  in  Curriculum  Supervision. 

Yiping  Wan,  Roosevelt  University 
DISCUSSANTS: 

Frances  Carroll,  Cook  County  Juvenile  Temporary 
Deletion  Center 

Richard  Smith , Dr.  Martin  Luther  King  High  School 
and  Roosevelt  University 


T.  1 220.Med  Supervising  Field  Experiences 

(Division  K-Paper  Session)  12:20-1:40  Medill 
CHAIR:  Cheryl  Didham,  Ohio  State  University 
PARTICIPANTS: 

The  State  of  the  Art  in  the  Supervision  of  Student 
Teaching. 

Laura  Lipsett,  Hema  Ramanathan,  Doug 
Smith,  and  Donald  Williams,  Ohio  State 
University 

A Model  for  Improving  the  Preservice 
Teacher/Cooperating  Teacher  Diad. 

John  A.  Grossman  and  Daniel  L.  Keller,  Ohio 
State  University 

The  Nature  and  Effectiveness  of  Feedback  Given  by 
Cooperating  Teachers  to  Student  Teachers. 

Elizabeth  A . Wilkins,  Southern  Illinois  Univ. 
Supervision  Models  for  Early  Field  Experiences:  A 
Three  Year  Summary. 

Dennis  E.  Potthoff  and  Frank  Kline,  Wichita 
State  University 


T.  1 220. A Leadership,  Organizational  Change,  and 

Minority  Student  Retention 

(Division  A-Paper  Session)  12:20-1:40  Parlor  A 
CHAIR:  William  L.  Sharp,  Southern  Illinois  Univ. 

The  Restructured  School:  What's  Principal  Efficacy  to 
Do  with  It? 

Jacqueline  K.  Mitchell  and  Edith  A.  Rusch, 
University  of  Toledo 

Positive  Factors  of  Systemic  Change  Identified  in  a 
Local  Board  of  Education. 

Barbara  A.  Steck,  Miami  University 
The  Lessons  of  Leadership  in  Collaborative  Schools: 
Practice  Informing  Theory  Informing  Practice. 

Edith  Rusch,  University  of  Toledo 
African  American  Student  Retention  at  Predominantly 
White  Colleges:  Perceptions  of  Minority/Student 
Affairs  Personnel. 

A.  William  Place,  University  of  Dayton;  Clint 
Kaufield \ Baptist  Bible  College 

T.1220.B  Faculty  Issues 

(Division  J-Paper  Session)  12:20-1 :40  Parlor  B 
CHAIR/DISCUSSANT:  Wayne  Van  Zomeren, 
Northwest  Missouri  State  University 
PARTICIPANTS: 

Multiple  Forms  of  Instructional  Feedback:  A 
Triangulated  Approach  and  Analysis. 

Neil  E.  Prokosch,  National-Louis  University 
Peer  Review  in  Promotion  and  Tenure  Decisions  in 
Higher  Education:  Court  Decisions  1984-1990, 

Linda  L.  Timm  and  Edward  R.  Hines,  ISU 
Reflections  of  a Productive  Faculty. 

Marcia  Summers,  Kirby  Koriath,  and  Carl  R. 
Summers,  Ball  State  University 

T.  1 220.C  Student  Recruitment,  Training,  and 

Perceptions 

(Division  H-Paper  Session)  12:20-1:40  Parlor  C 
CHAIR:  L.  Ruth  Struyk,  Northern  Illinois  University 
PARTICIPANTS: 

An  Evaluation  of  a Teriary  Prevention  Program: 
Students'  Perspectives. 

Carmen  Montecinos,  Univ.  of  Northern  Iowa 
Minimum  Math  Proficiency:  A Descriptive  Study  of 
the  Degree  of  Congruence  of  Perception  among 
Teachers  in  Different  Settings. 

lsadore  Newman,  Al  Al-Rubaiy,  and  Dianne 
Brown-Wright,  University  of  Akron ; Kathy  Ah 
Rubaiy,  Ashland  School  District;  Ellen 
Goggins,  Akron  City-Wide  Testing 
Issues  Involved  in  the  Recruitment  and  Retention  of 
Adult  Prrticipants  in  an  Even  Start  Family  Literacy 
Program. 

Mary  Ann  Robinson,  Dayton  Public  Schools 
Evaluating  Organizational  Training  Programs: 
Alternatives  & Criteria  for  Selection. 

Joseph  R.  Marth,  Southern  Ohio  College 
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T.  1 220. D Measurement  in  Medical/Dental  Education 

(Di  vi  sion  I-Paper  Session)  12:20-1 :40  Parlor  D 
CHAIR:  Kim  M.  Hutchinson,  Northern  Illinois  Univ . 
PARTICIPANTS: 

The  Dimensionality  of  Problem-Based  Learning. 

Hripsime  A.  Kalaian  and  Patricia  B.  Mullan, 
Michigan  State  University 

The  Historical  Development  of  Fit  and  Its  Assessment 
in  the  Computer  Adaptive  Testing  Environment. 

Gregory  Ethan  Stone,  National  Certification 
Corporation 

Confirming  the  Standard  on  Part  II  of  the  National 
Board  Dental  Examination. 

Gene  A.  Kramer,  American  Dental 
Association 

DISCUSSANT:  Kevin  Larkin,  American  Dental 
Association 

T.  1 220. E Assessment  of  African-American  Male 

Empowerment  and  Intervention  Strategies 
(Division  E-Altemative  Format)  12:20-1:40  Parlor  E 
CHAIR:  Thomas  E.  Midget  te,  University  of  Arkansas 
PARTICIPANTS: 

Thomas  E.  Midgette,  University  of  Arkansas 
Nudie  E.  Williams,  University  of  Arkansas 
Isaiah  Sessoms,  Clarion  University 
Terry  Shelton,  University  of  Akron 
DISCUSSANT:  Jerome  Tillman , Illinois  State 
University 


T.  1 220. F Family  Structure  and  Cross  Cultural 

Awareness 

(Division  G-Paper  Session)  12:20-1:40  Parlor  F 
CHAIR:  Joan  S.  Timm,  University  of  Wisconsin- 
Oshkosh 
PARTICIPANTS: 

Cross  Cultural  Analysis  of  the  Hurried  Child  Concept: 
United  States  and  Thailand. 

Marilyn  Moore  and  Patricia  H.  Klass,  Illinois 
State  University 

Cultural  Influences  on  Academic  Achievement  of 
Chinese  and  White  Americans. 

Gianna  M.  Gariglietti  and  Wei- Cheng  Mau, 
Wichita  State  University 
The  Effect  of  Family  Structure  and  Values  on 
Substance  Use. 

C.  Van  Nelson,  Larry  W.  Henriksen,  and  Jay 
C.  Thompson,  Ball  State  University;  and  Van 
C.  Cooley,  Westfield-  Washington  School 
Corporation 


Gene  V Glass 

College  of  Education,  Arizona  State  University; 
creator  of  meta-analysis  for  research  synthesis, 
former  President  of  AERA;  former  Editor  of  the 
American  Educational  Research  Journal , Review 
of  Educational  Research , and  the  Psychological 
Bulletin ; current  Editor  of  Education  Policy 
Analysis  Archives  (electronic  journal),  and 
keeper  of  AERA  LISTSERVs 


A pccr-reviewed  scholarly  electronic  journal  in  education 
policy  analysis  has  1,300  direct  subscribers  18  months 
after  its  creation;  it  is  free.  A competing  paper  journal  just 
saw  its  subscriptions  fall  below  200;  it  costs  $ 100  a year. 

It  is  no  mystery  what  is  going  on  here. 
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T.1220Lin  Solving  Measurement  Problems  with  the  T.145.A  Analyses  of  Program  Implementations 

Rasch  Model  (Division  H-Paper  Session)  1:45-3:05  Parlor  A 

(Division  D symposium)  12:20-1:40  Lincoln  CHAIR:  Cory  Cummings , Northern  Illinois  University 

CHAIR:  Betty  A.  Bergstrom,  Computer  Adaptive  PARTICIPANTS: 

Technologies,  Inc . Fundemental  Restructuring  of  a High  School  Program 

PARTICIPANTS:  in  the  21st  Century. 

How  Rasch  Fit  Statistics  Help  us  to  Measure  Changes  William  E.  Loadman,  Ohio  State  University 

in  Children’s  Ability  over  Time.  A Study  of  a Recreational  Reading  Program  for 

Tony  Pitruzzelo , Chicago  Public  Schools  Disadvantaged  Fifth  Grade  Students. 

Using  Facets  to  Investigate  Speech  Competency.  Lou  Anna  Moore,  Miami  University 

Donna  Surges  Tatum,  University  of  Chicago  Adapting  to  Mathematics  Teaching  Reform:  A Study 


A Procedure  for  Locating  any  Point  in  N-Dimensional 
Space  on  a Chosen  Dimension. 

Mark  H.  Moulton,  University  of  Chicago 
Rasch  Factor  Analysis. 

Benjamin  D.  Wright,  University  of  Chicago 

T.1220.Max  Papyrophiles  v.  Cybernauts:  Scholarly  Star 
Wars  and  the  Future  of  Electronic 
Publication 

(Invited  Address)  12:20-1:40  Maximillian 
CHAIR:  Richard  Pugh,  Indiana  University 
AUTHORS:  Gene  V Glass,  J.  Scott  Williams,  and 
William  J.  Brand,  Arizona  State  University 
SPEAKER:  Gene  V Glass,  Arizona  State  University 

T.1220.Fifth  C.  S.  Peirce  and  Interpretive  Research  in 
Education 

(Division  F-Altemative  Session)  12:20-1:40 
Fifth  Floor  Meeting  Room 

CHAIR:  Thomas  Liftendahl,  Northern  Illinois  Univ. 
PARTICIPANTS: 

Student  Commission  for  the  Use  of  Interpretive  Theory 
in  Education 

DISCUSSANT:  Gary  Shank,  Northern  Illinois  Univ. 


T.  145.Med  Field  Experiences  in  Teacher  Education 

(Division  K-Paper  Session)  1 :45-3:05  Medill 
CHAIR:  Mary  B.  Campbell,  Saint  Xavier  University 
PARTICIPANTS: 

Early  Field  Experience:  How  Well  Are  Students' 
Expectations  Met? 

Alexandria  J.  Rekkas,  Ball  State  University 
A Continuing  Study  of  the  Problems  of  Student 
Teachers 

Sonja  J.  Smith,  Mount  Vernon  Nazar ene 
College 

Structure  vs.  Unstructure  in  Field  Placements:  What 
Preservice  Teachers  Gain,  What  Preservice  Teachers 
Lose. 

Rosemary  F.  Schiavi,  University  of  Evansville 
Pre-Student  Teaching  Field-Based  Semester. 

Bernard  W.  Arenz  and  Michelle  Appel, 
Southwest  Missouri  State  University 


of  the  Constraint  Issues  in  Middle  Grade  Classrooms. 
Jane  M.  Keiser  and  Diana  V.  Lambdin, 
Indiana  University 

Making  "Connections":  A Frames  Analysis 
Perspective  on  the  Implementation  of  an  Innovative 
Pilot  Program. 

Nina  G.  Dorsch,  Miami  University 
DISCUSSANT:  Tom  Schrader,  Northern  Illinois 

University  and  Arthur  Anderson  & Company 

T.145.B  Services  to  Facilitate  Learning  in 

Postsecondary  Institutions 
(Division  J-Paper  Session)  1:45-3:05  Parlor  B 
CHAIR/DISCUSSANT:  Terri  Sandoval,  University  of 
Nevada-Las  Vegas 
PARTICIPANTS: 

Factors  Related  to  Learning  Occurring  in  an  Adult 
Education  Program. 

Daniel  Okoro  and  L.  E.  Miller,  Ohio  State 
University 

Support  Service  Needs  of  Adult  College  Students: 
Juniors  and  Seniors  vs.  Masters  Level  Students. 

Peggy  G.  Woodward,  Burton  A.  Collins,  and 
David  E.  Suddick,  Governors  State  University 
Mentoring  and  Tutoring  Support  for  Academically 
Challenged  Postsecondary  Students. 

Roger  Carlsen  and  Bea  Bedard,  University  of 
Dayton 


Nearly  100  different  institutions  were 
represented  by  those  presenting  at  the 
1 993  MWERA  Annual  Meeting 
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Sandra  Hollingsworth 

Michigan  State  University,  well  published  researcher 
in  literacy,  reading,  teacher  education  and  gender  issues. 


Anita  Woolfolk  Hoy 

Ohio  State  University,  former  Vice-President  of 
AERA  Division  K,  has  had  research  articles  on  the 
development  of  teachers’  beliefs  in  the  Journal  of 
Educational  Psychology , American  Educational 
Research  Journal , Elementary*  School  Journal, 
Teaching  and  Teacher  Education , and  Action  in 
Teacher  Education.  Her  text.  Educational 
Psychology , is  now  moving  into  its  6th  edition. 

Too  often  in  teacher  education  we  ignore  the  knowledge 
and  beliefs  our  students  bring  to  their  preparation  programs. 
Prospective  teachers  may  learn  new  words  to  describe 
education,  but  never  change  their  fundamental 
understanding  of  what  it  means  to  teach. 


Why  are  most  teaching  credential  candidates  white  women,  and 
most  administrative  credential  candidates  white  men?  Why  isn't  the 
social  construction  of  gender  part  of  the  "knowledge  base"  of 
teacher  education?  What  is  our  responsibility  toward  these  issues 
as  teacher  educators? 


Thomas  J.  Lasley 

University  of  Dayton,  former  Editor  of  the  Journal  of 
Teacher  Education , Editor  and  author  of  books  and 
articles  concerning  teaching  and  teacher  education 
including  Teaching  Peace:  Toward  Cultural 
Selflessness  which  is  in  press. 


Teacher  education  is  changing  as  a result  of  several  different  social 
and  political  forces.  Understanding  those  forces  sheds  light  on  how 
teacher  educators  need  to  develop  new  assumptions  to  undergird 
minorative  program  endeavors. 
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T.145.C  New  Teachers  in  the  Profession 

(Division  K-Paper  Session)  1:45-3:05  Parlor  C 
CHAIR:  Kathleen  Maury \ Mankato  State  University 
PARTICIPANTS: 

Collaboration  for  Mentoring  Beginning  Special 
Education  Teachers. 

Carol  B.  Furtwenger,  Dennis  Potthoff 
Frances  Clark,  Frank  Kline , Robert  Alley , 
and  Daniel  Wojogbeh,  Wichita  State 
University 

Teacher  Shortages  in  the  United  States:  Outlook  for 
the  Future. 

Cynthia  L.  Ve'lotta,  Ohio  State  University 
Personal  and  Family  Characteristics  Associated  with 
Teacher  Candidates'  Reasons  Given  for  Becoming 
Teachers  in  the  1990s. 

Ronald  N.  Mar  so  and  Fred  L.  Pigge,  Bowling 
Green  State  University 

The  Anatomy  of  a Mentoring  Program  for  Beginning 
Urban  Teachers. 

Melissa  R.  Freberg,  John  M Zbikowski , and 
Tom  Ganser , Uniersity.  of  Wisconsin - 
Whitewater 

T.145.D  Issues  of  Reliability 

(Division  D-Paper  Session)  1:45-3:05  Parlor  D 
CHAIR:  Ralph  Mueller,  George  Washington 
University 
PARTICIPANTS: 

An  Empirical  Investigation  into  the  Reliability  of  Gain 
Scores. 

Robert  E . Rachor  and  Gregory  J.  Cizek, 
University  of  Toledo 

Estimating  the  Reliability  of  Criterion  Referenced 
Tests  before  Administration. 

Clinton  I.  Chase , Indiana  University 
Assessing  Evidence  for  the  Reliability  and  Validity  of 
Ratings  of  Group  Performance. 

Bruce  G.  Rogers , University  of  Northern  Iowa 
DISCUSSANT:  Laura  Barnes,  Oklahoma  State 
University 

T.145.E  Full  Inclusion  of  Exceptional  Students: 

Three  Perspectives 

(Division  E-Altemative  Session)  1:45-3:05  Parlor  E 
PARTICIPANTS: 

Stanley  E.  Wigle , Wayne  State  College 
Charles  D.  Manges,  Wayne  State  College 
Daryl  J.  Wilcox . Wayne  State  College 


T.145.F  Education  of  a Diverse  Society' 

(Division  G-Paper  Session)  1 :45-3:05  Parlor  F 
CHAIR:  Mary  Ann  Flowers,  Cleveland  State 
University 
PARTICIPANTS: 

Individualism,  Diversity,  and  Pluralism  in  American 
Society:  The  American  Dilemma. 

JoanS.  Timm , University  of  Wisconsin- 
Oshkosh 

Creating  Multicultural  Contexts  to  Examine  Pre- 
Teachers'  Perspectives  of  Culturally  Different 
Behavior. 

Clara  A.  New,  University  of  Wisconsin- 
Parkside 

Educational  Claims-Making:  Construction  of  the  At- 
Risk  Students. 

Mary  K Finley,  Southern  Illinois  University 
Ethnicity  and  Gender  in  Children's  Literature  Used  by 
Elementary  Teachers. 

Holly  D.  Mackley  and  Anna  Bramfeld,  Saint 
Xavier  University 

T.  145. Lin  Teacher  Education  and  Case  Studies 

(Division  K-Paper  Session)  1:45-3:05  Lincoln 
CHAIR:  Jay  Price,  University  of  Wiscons in-Stevens 
Point 

PARTICIPANTS: 

Experience  is  the  Best  Teacher?  A Case  Study  of 
Learning  to  Teach. 

Sharon  J.  Jensen , Iowa  State  University 
Consequences  of  Preservice  Participation  in  a National 
Case  Competition. 

Mary  R.  Sudzina,  University  of  Dayton 
Cases  for  Teaching:  An  Analysis  of  Their  Levels  of 
Difficulty. 

Mark  P.  Mosert,  Moorhead  State  University 
DISCUSSANT:  Karen  M.  Dull,  Grinnell  College 

T.  1 45 .Max  Context  Considerations  in  Teacher 

Education 

(Division  K-Invited  Session)  1:45-3:05  Maximillian 
CHAIRS:  Deborah  Bainer,  Ohio  State  University  and 
Kim  Metcalf  Indiana  University 
PARTICIPANTS: 

I Wouldn't  Have  Seen  It  If  I Hadn't  Believed  It:  Prior 
Knowledge  and  Learning  to  Teach. 

Anita  E.  Woolf  oik  Hoy,  Ohio  State  University 
Teacher  Education:  New  Assumptions  and  Old 
Problems. 

Thomas  J.  Las  ley,  University  of  Dayton 
The  Problem  of  Gender  in  Teacher  Education 
Sandra  Hollingsworth,  Michigan  State 
University 


THURSDAY  - MWF.RA  94 


19 


T.145.Fifth  Research  Perspectives  on  Supervision: 
Preparation  and  Scope  of  the  First 
Handbook  of  Research  on  School 
Supervision 

(Division  Alternative  Format  Session) 

1 :45-3:05  Fifth  Floor  Meeting  Room 

CHAIR:  Joyce  E.  Killian , Southern  Illinois  University 

PARTICIPANTS: 

Bernard  Badioli,  Miami  University  of  Ohio 
Nancy  Hoffman,  West  Virginia  University 
Donna  M.  Post,  Southern  Illinois  University 


T.315.Med  The  Role  of  the  Public  School  Educator  in 
the  Investigation  and  Prosecution  of  Child 
Neglect  and  Abuse 

(Division  K-Alternative  Session)  3:15-4:45  Medill 
CHAIR:  Dick  Lipka,  Pittsburg  State  University 
PARTICIPANTS: 

Bradley  Cameron,  Pittsburg  State  University 
Rozanne  Sparks,  Pittsburg  State  University 
Kent  Runyan,  Pittsburg  State  University 

T.3 15. A Restructuring,  Development,  and  Academic 

Performance 

(Division  A-Paper  Session)  3:15-4:45  Parlor  A 
CHAIR:  William  B.  Thiel,  Thiel  Enterprises 
PARTICIPANTS: 

Teacher  Variables:  Predicting  Attitudes  During  High 
School  Restructuring. 

Michele  D.  Maki,  Illinois  State  University 
Administrative  Use  of  Staff  Development  Models: 
Teachers  and  Computers. 

Charles  E.  Kline,  Purdue  University ; Susan 
M.  Cox,  Penn-H arris  Madison  Schools 
The  Relationship  of  Work  Hours,  Credit  Hours,  and 
Study  Hours  with  Academic  Performance. 

Joseph  Migden,  Barbara  A.  Bucey,  and 
Sophie  T.  Kus-Patena,  University  of  Akron 
Complexity,  Organization  Adaptation,  Learning,  and 
Systemic  Restructuring. 

Grover  H.  Baldwin  and  Edith  Rusch, 
University  of  Toledo 

T.315.B  Postsecondary  Classroom  Instructional 

Issues 

(Division  J-Paper  Session)  3-15-4:45  Parlor  B 
CHAIR:  Roger  C arisen.  University  of  Dayton 
PARTICIPANTS: 

As  Students  Experience  A Qualitative  Research  Class: 
Themes,  Metaphors,  Syneldoche,  and  Paradoxes. 

John  W.  C res  well,  Sandy  Howard,  Doreen 
Gosmure,  Jeanne  Harrington.  Joan  Sullivan , 
Yvonne  Jacobs,  University  of  Nebraska 


Mystical  Experiences  and  Addiction  Beliefs  of 
Undergraduates. 

Paula  J.  Hruby  and  Thomas  E.  Roberts, 
Northern  Illinois  University 
Applying  Research:  An  Analysis  of  Texts  for 
Consumers  of  Research. 

R.  L.  Erion  and  Gary  Steinley,  South  Dakota 
State  University 

What's  Up  Doc?  An  Analysis  of  Grade  Inflation. 

Marcia  Summers,  James  E.  Green,  and  Carl 
Summers,  Ball  State  University 

T.3 1 5.C  Achievement  and  Attribution  Theory-  in  the 

Classroom 

(Division  C-Paper  Session)  3:15-4:45  Parlor  C 
CHAIR/DISCUSSANT:  Joan  Rankin,  U.  of  Nebraska 
PARTICIPANTS: 

Mathematical  Teaching  and  Learning  in  Kindergarten 
Classrooms. 

Kuei-Er  Chung  and  Susan  M.  Hegland,  Iowa 
State  University 

Comparing  Epistemological  Beliefs  about 
Mathematics  and  Social  Sciences. 

Marlene  A.  Schommer  and  Kiersten  Walker, 
Wichita  State  University 

School  Achievement,  Age,  and  Students'  Perception  of 
Parental  Concern  and  Support  for  Schoolwork. 

Jupian  J.  Leung  and  Daniel  O.  Lynch, 
University  of  Wiscons in-Oshkosh 
Attribution  Theory  and  the  High  School  Teacher. 

Lawrence  E.  Krengel,  Northern  Illinois  Univ. 

T.3 1 5 .D  Statistical  Modeling 

(Division  D-Paper  Session)  3 : 1 5-4:45  Parlor  D 
CHAIR/DISCUSSANT:  Jeffrey  B.  Hecht,  Illinois 
State  University 
PARTICIPANTS: 

Structural  Equation  Modeling:  The  (Almost)  Forgotten 
Basics. 

Ralph  O.  Mueller,  George  Washington  U. 
Exploratory  Versus  Confirmatory  Factor  Analysis  in 
Defining  Collegiate  Physical  Fitness. 

Tim  P.  Mead  and  David  L.  Legg.  U.  of  Toledo 
Application  of  the  Binomial  Test  of  Model  Fit:  What 
Research  Question  is  Being  Tested? 

Isadore  Newman , University  of  Akron;  John 
W.  Frass,  Ashland  University 
An  Empirical  Comparison  of  Certainty  and  Likert 
Scaling  Techniques. 

Kathleen  M . Lux  and  Rick  A . Petosa,  Ohio 
State  University 

Hierarchical  Latent  Trait  Approach  (IILTA)  in  Test 
Analysis. 

Di miter  M.  Dimitrov.  Southern  III  'ois  Univ . 
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T.315.E  Counseling 

(Division  E-Paper  Session)  3:15-4:45  Parlor  E 
CHAIR:  Nudie  Williams,  University  of  Arkansas- 
Fayetteville 
' PARTICIPANTS: 

A Comparative  Study  of  Crisis -Intervention 
Recommendations  Within  and  Across  Professional 
Groups. 

Jeannine  De  Rose  and  Ronald  R.  Morgan , 
Loyola  University  of  Chicago 
An  Exploration  of  the  Six  Dimensions  of  Wellness  in 
Graduate  Counseling  Students. 

Sandra  L.  Staffen,  Jane  Zimmerman , Annette 
Fuchs,  Laura  Bauhof  Angela  Evans,  Nancy 
Taylor,  and  Paula  Britton,  John  Carroll 
University 

Stress  Management  and  Biofeedback  with  Migraine 
Headache  Patients:  Predictors  of  Success. 

Michael  LeBlanc,  Nancy  McCajferty,  and 
Paula  Dupuy,  University  of  Toledo;  Angele 
McGrady,  Medical  College  of  Ohio 
On  the  Use  of  Reflection  and  Self-Evaluation  in 
Education  in  the  Education  of  Professional  Substance 
Abuse  Counselors. 

Kenneth  A.  Gleaves,  Moraine  Valley 
Community  College 

DISCUSSANT:  Thomas  Midgette,  University  of 
Arkansas-Fayetteville 

T.315.F  Evaluating  the  Dimensionality  of  Tests: 

Rasch  Measurement  and  Factor  Analytic 
Techniques 

(Division  I Symposium)  3:15-4:45  Parlor  F 
CHAIR:  Gene  A.  Kramer,  American  Dental 
Association 
PARTICIPANTS: 

Rasch  Factor  Analysis. . 

Benjamin  D.  Wright,  University  of  Chicago 
A Comparison  of  Methods  for  Determining 
Dimensionality  in  Rasch  Measurement. 

Richard  M.  Smith,  University  of  South  Florida 
Rasch  vs.  Factor  Analysis  of  a Multidimensional  Scale. 

Kathy  E.  Green,  University  of  Denver 
Identifying  Dimensions  in  the  MMP1-2. 

C hi  h -Hung  Chang,  University  of  Chicago 
DISCUSSANT:  John  Michael  Linacre,  University  of 
Chicago 


T.3 1 5. Lin  Teacher  Education  Alternatives 

(Division  K-Paper  Session)  .3:15-4:45  Lincoln 
CHAIR:  Rosemary  Schiavi,  University  of  Evansville 
PARTICIPANTS: 

Who  Should  Be  Responsible  for  Teacher  Education? 

Alice  L.  Young,  Southern  Illinois  University 
A Tale  of  Two  (Non-Traditional)  Teachers. 

Peggy  J.  Anderson  and  Dennis  E.  Potthojf, 
Wichita  State  University 

The  Analysis  of  the  Transition  to  Graduate  Level 
Teacher  Preparation  on  a Regional  Campus  of  a Major 
Research  University. 

Susan  I.  Kent,  Ohio  State  University-Newark 
Coping  and  Growing:  Peace  Corps  Fellows  in  the 
Urban  Classroom. 

Ruth  Bombaugh,  University  of  Michigan 
DISCUSSANT:  Joy  McCullough,  Trinity  Western 
University 

T.315.Max  Meet  the  Editors 

(Invited  Session)  3:15-4:45  Maximillian 
CHAIR:  Richard  Pugh,  Indiana  University 
PARTICIPANTS: 

Stephen  Benton,  Educational  Psychology  Review 
Lyn  Como,  American  Educational  Research  Journal 
Ayres  DCosta,  Mid-Western  Educational  Researcher 
Gene  V Glass,  American  Educational  Research 

Journal,  Education  Policy  Analysis  Archives, 
Psychological  Bulletin,  Review  of 
Educational  Research 

Frank  Lester,  Journal  of  Research  in  Mathematics 
Education 

Bill  Reese,  Histoiy  of  Education  Quarterly 
Randall  Schumacher,  Structural  Equation  Modeling:  A 
Multidisciplinary  Journal 

T.3 1 S.Fifth  School  Based/University  Collaborative 
Effort 

(Division  K-Altemative  Format  Session)  3:15-4:45 

Fifth  Floor  Meeting  Room 

PARTICIPANTS: 

Janet  T Bercik,  Northeastern  Illinois  University 
Judith  Hennig,  Illinois  School  District  63 
Ray  Kuper,  Twain  School 
Linda  Rageb,  Nelson  School 
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T.450.Med  Ecological  Issues  in  Education 

(Division  G-Paper  Session)  4:50-6:00  Medill 
CHAIR:  Roger  Carls  en.  University  of  Dayton 
PARTICIPANTS: 

Social  Constructivism  and  Active  Learning 
Environments:  The  Development  of  an  Instrument. 
Elizabeth  J.  Oyer  and  Curtis  Jay  Bonk, 

Indiana  University 

An  Ontological  Analysis  of  an  Eighth-grade  Science 
Classroom. 

Ruth  Bombaugh,  University  of  Michigan 
Curriculum-Based  Measurement:  Cultural  Bias  in 
Testing. 

Susan  M.  Wilczynski , Indiana  State  University 

T.450.A  Applied  Research  in  the  Professions 

(Division  I-Paper  Session)  4:50-6:00  Parlor  A 
CHAIR:  Kim  M.  Hutchinson,  Northern  Illinois 
University 
PARTICIPANTS: 

Enhar:ing  Learning  in  Training  and  Adult  Education: 
A Description  of  an  On-Going  Research  Program. 
Ronald  R.  Morgan,  Loyola  University  of 
Chicago ; Edward  E.  Gordon,  North  American 
Institute  for  Training  and  Educational 
Research;  Judy  J.  Ponticell,  Texas  Tech 
University 

A Case  Study:  Using  Functional  Assessment  Staging 
for  Clinical  Diagnosis  and  for  Understanding 
Progression  within  the  Moderately  Severe  Stage  of 
Alzheimer’s  Disease. 

Peggy  F.  Oakerson,  Ball  State  University 
A Preliminary  Investigation  of  a Theoretical  Model  of 
Perceived  Pediatric  Nursing  Self-Efficacy. 

Debra  D . Buchman  and  Beth  McBurney, 
University  of  Toledo 

DISCUSSANT:  Kevin  Larkin,  American  Dental 
Association 

T.450.B  Innovative  Curriculum  Perspectives 

(Division  B-Poster/Table  Session)  4:50-6:00  Parlor  B 
PARTICIPANTS: 

A.  Curriculum  Development  and  the  GED  Test:  An 
Interactive  Workshop. 

James  E.  Hawkings , Chicago  State  University 

B.  Integrating  Critical  Thinking  Across  Correctional 
Education  Curriculum. 

Bonnie  Kirkpatrick,  Ball  State  University 

C.  Campus-Based  Project  in  Multicultural  Literacy 
Education. 

Rose  Mary  Scott,  U.  of  Wise  o ns  in-Parks  ide 

D.  Outcome-Based  Education:  Findings  and 
Implications  for  Wisconsin. 

Annette  R . Smith  and  Susan  Cramer, 
University  of  Wise ons in-Oshkosh 


T450.C  Issues  in  Cognition 

(Division  C-Poster/Table  Session)  4:50-6:00  Parlor  C 
PARTICIPANTS: 

A.  Influence  of  a Before  or  After  Computer 
Simulation  or  Game  on  Learning  From  a Physics  Text. 

Thomas  Andre  and  Charlotte  Haselhuhn , 

Iowa  State  University 

B.  Relationships  among  Three-Dimensional 
Laboratory  Models,  Spatial  Visualization  Ability, 
Gender,  and  Earth  Science  Achievement. 

Michael  Odell,  University  of  Idaho 

C.  The  Effect  of  Matching  Test  Condition  to  Modality 
Preference  During  the  Solution  of  Deductive 
Reasoning  Items. 

Cynthia  Campbell,  Southern  Illinois  Univ. 

T450.D  Qualitative  Methodologies 

(Division  D-Poster/Table  Session)  4:50-6:00  Parlor  D 
PARTICIPANTS: 

A.  Getting  Started  with  the  Basics  of  Coding  Textual 
Information. 

Rich  Hoffman,  Miami  University;  Michael  H. 
Romanowski,  Ohio  Northern  University; 
Thomas  Oldenski , University  of  Dayton  . 

B.  VTLOGANL:  Analyzing  Video  Taped  Data. 

Jeffrey  B.  Hecht,  Nicole  K.  Roberts,  Perry  L. 
Schoon,  and  David  J.  Dwyer,  Illinois  State 
University 

C.  State  Mandated  Change:  A Qualitative  Analysis  of 
Responses. 

Nancy  P.  Gibson,  Illinois  State  University 

T.4.50.E  Assessments  of  Behavioral  and  Cognitive 

Functioning  in  Clients  and  Students  with 
Learning  Disabilities 

(Division  E-Paper  Session)  4:50-6:00  Parlor  E 
CHAIR/DISCUSSANT:  Eddie  Glenn,  U.  of  Arkansas 
PARTICIPANTS: 

Behavioral  Assessment  of  Vocational  Rehabilitation 
Clients  with  Learning  Disabilities:  Development  of 
Roller  Adolescent  and  Adult  Behavior  Scale. 

Karen  D.  Mult  on,  James  R . Koller,  and 
Gregory  A.  Holliday,  University  of  Missouri 
Levels  of  Processing  and  Encoding  Specificity  in  Mild 
Disabilities. 

Yasser  Al-Hilawani,  James  A.  Poteet,  and 
Gregory  J.  Marchant,  Ball  State  University 

T.450.F  The  Legitimization  of  African  American 

English  in  Educational  Organization 

(Division  G-Altemative  Session)  4:50-6:00  Parlor  F 
CHAIR:  Raquel  L.  Farmer,  University  of  Illinois 
PARTICIPANTS: 

Raquel  L.  Farmer,  University  of  Illinois 
Gail  D.  Gordon,  University  of  Illinois 
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T.450.Lin  Teacher  Education  Goals  and  Expectations 
(Division  K-Paper  Session)  4:50-6:00  Lincoln 
CHAIR:  Timothy  E.  Miller,  Morehead  State 
University 
PARTICIPANTS: 

State  and  National  Goals:  Are  They  Aligned? 

Susan  R.  Cramer,  U.  of  Wiscons in-Oshkosh 
Prospective  Teacher  Educators'  Motives  for  Becoming 
Teacher  Educators  and  the  Potential  Impact  on  the 
Preparation  of  Future  Teachers. 

Joy  D,  McCullough,  Trinity  Western  Univ. 
Consultation  in  Teacher  Education:  A Survey  of 
Training,  Expectations,  and  Preferences. 

Wendy  L.  Combs  and  Lisa  A.  Bischoff 
Indiana  State  University 


T.7.Medill  Issues  in  Multicultural  Education 

(Workshop  for  teachers,  see  p.  10)7:00-9:30  Medill 
CHAIR:  Sharon  McNeely,  Northeastern  Illinois 
University 

SPEAKER:  Eugene  Garcia,  U.S.  Department  of 
Education 


T.450. Fifth  Research  Relating  to  Cultural  and 
Multicultural  Contexts 

(Alternative  Format  Session-Town  Meeting) 

4:50-6:00  Fifth  Floor  Meeting  Room 

CHAIR:  Jacqueline  Rickman,  Chicago  Public  Schools 

PARTICIPANTS: 

Mentoring  for  Ethnic,  Physical,  and  Gender  Equity. 

Jacqueline  Rickman,  Chicago  Public  Schools 
Gender  and  Ethnic  Equity  in  the  Workplace. 

Carolyn  Bohlen,  Northern  Illinois  University 
and  EPA 

Hispanic  Early  Childhood  Intervention. 

Myriam  Classen,  Loyola  University  and 
Chicago  Lighthouse  for  the  Blind 
Special  Education  and  Street  Culture. 

Marva  Bean  Christian,  Northern  Illinois 
University  and  Chicago  Public  Schools 
Philosophical  Perspectives. 

Sharonjoy  Jackson,  Northern  Illinois 
University  and  Chicago  Public  Schools 
Technology  and  Foundational  Barriers. 

Leon  Liddell,  Northern  Illinois  University  and 
Chicago  Public  Schools 

Response  to  Cultural  Diversity:  Conceptual  Change  in 
Teacher  Education  Students 

Carla  Shaw,  Northern  Illinois  University 
Special  Education  and  State  of  Illinois  Parent  Initiative 
SanDee  Stroncak,  Northern  Illinois  University 
and  the  Illinois  State  Board  of  Education 

T.6.Max  Cracker  Barrel  Social 

(Hors  d'oeuvres,  cash  bar,  and  friendly  conversation) 
6:00-7:00  Maximillian 
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F.8.Lin  Mid-Western  Hospitality 

(Complimentary  coffee  and  rolls)  8:00-9:00  Lincoln 

F.805.E  Coffee  with  Eugene  Garcia 

(Bring  your  coffee  and  roll  and  join  an  Informal 
Conversation)  8:05-8:55  Parlor  E 
CHAIR:  Sharon  McNeely,  Northeastern  Illinois  Univ. 
CONVERSATIONALIST:  Eugene  Garcia,  Director 
of  Bilingual  Education  and  Minority 
Language  Affairs , U.  S.  Dept,  of  Education 

F.810.F  Division  Meetings 

(Bring  your  coffee  and  roll,  review  past  and  plan  future 
with  your  Division  colleagues)  8:10-8:50  Parlor  F 
DIVISIONS:  C,  D,  F,  I 


F.820.C  From  E-Mail  to  the  Bible:  Dilemmas  in 

Measuring  Scaffolded  Learning  and  Social 
Interaction 

(Division  C-Symposium)  8:20-10:20  Parlor  C 
CHAIR:  Jay  Bonk,  Indiana  University 
PARTICIPANTS: 

Forms  of  Assistance  and  Degree  of  Collaboration  in 
World  Forum  Electronics  Interactions. 

William  A.  Sugar  and  Curtis  Jay  Bonk, 
Indiana  University 

E-Mail  Communication  in  Graduate  School  Courses: 
Two  Illustrations  of  Teacher  and  Student  Interactions. 
E.  Sonny  Kirkley  and  John  R.  Save  ry, Indiana 
University 

Time  to  "Connect" : Synchronous  and  Asynchronous 
Case-Based  Dialogue  Among  Preservice  Teachers. 

Melissa  M.  Grabner , Edmund  J.  Hansen , and 
Curtis  Jay  Bonk,  Indiana  University 
The  Electronic  Classroom  as  an  Arena  for 
Collaborative  Learning, 

Siat-Moy  Chong,  Indiana  University 
The  Teaching  of  Jesus  as  Re-examined  Through  a 
Vygotskian  Framework  of  Social  Interaction. 

Matthew  P.  Nussbaum,  Indiana  University 
Emerging  Intersubjectivity  among  Agencies  Preparing 
for  Emergency  Disaster  Respondence. 

Russell  H.  Kushigian,  Indiana  University 
Cutting  to  the  Heart:  A Coding  of  Medical  Students’ 
Interactions  in  Problem-Based  Learning  Courses, 

Yuxi  Charles  Wang,  Indiana  University 
New  Pictures  of  an  Art  Room:  Observing  Peer 
Interactions  and  Artistic  Development. 

Julia  M.  Matuga,  Indiana  University 
DISCUSSANTS:  John  Kun-Han  and  Curtis  Jay 
Rank.  Indiana  University 


F.845.D  Testing  Issues 

(Division  D-Paper  Session)  8:45- 10:20  Parlor  D 
CHAIR/DISCUSSANT:  I sadore  Newman,  University 
of  Akron 
PARTICIPANTS: 

Group  Ability  Test  Versus  Teacher  Ratings  for 
Predicting  Achievement:  Where’s  the  Bias? 

Brian  J.  Stone , Wichita  State  University 
Using  Neural  Net  Technology  to  Enhance  the 
Efficiency  of  a Computer  Adaptive  Testing 
Application. 

C.  Van  Nelson  and  L.  W.  Henrikson,  Ball 
State  University 

The  Effects  of  Test  Format  and  Locus  of  Control  on 
Test  Anxiety, 

Namok  Choi  Bryant  and  Laura  L . B.  Barnes, 
Oklahoma  State  University 
Non-Functioning  Options  in  Multiple-Choice  Tests: 
Another  Look. 

Gregory  J.  Cizek  and  Robert  E.  Rachor, 
University  of  Toledo 

Cheating  Detection:  A Legal  Perspective. 

David  J.  Dwyer,  Illinois  State  University 

F.9.Med  Multicultural  Issues  in  the  Classroom 

(Workshop  for  classroom  teachers  only,  see  p.  10) 
9:00-11:45  Medill 

CHAIR:  Sharon  McNeely,  Northeastern  Illinois 
University 

PRESENTER:  Eugene  Garcia,  U.S.  Dept  of 
Education 

F.9.A  Analysis  of  an  Educational  Administration 

Field-Based,  Field-Supported  Doctoral 
Program  (Division  A Symposium) 
9:00-10:20  Parlor  A 

CHAIR:  Willis  J.  Furtwengler,  Wichita  State 
University 
PARTICIPANTS: 

Willis  J.  Furtwengler,  Wichita  State  University 
Carol  B.  Furtwengler,  Wichita  State  University 
Edie  Holcomb,  Wichita  State  University 
David  Hurst,  Wichita  State  University 
Melva  Owens,  Derby  School  District 
DISCUSSANT:  James  Carroll,  Wichita  State 
University 
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F.9.B  Issues  in  History  and  Diversity 

(Division  F-Paper  Session)  9:00-10:20  Parlor  B 
CHAIR/DISCUSSANT:  Donald  Castle,  Ashland 
University 
PARTICIPANTS: 

Promoting  Cultural  Diversity  in  the  University 
Classroom. 

Jennifer  N.  Humphries  and  Louise  E. 
Fleming , Ashland  University 
From  Open-Air  Classroom  to  Household  Employee: 
One  Woman's  Stoty. 

Louise  E.  Fleming , Ashland  University 
Jenny  May  Kohler,  Schoolteacher. 

Louise  E.  Fleming,  Ashland  University 


F.9.E  Developing  Effective  Instruction  Through 

Teacher  Education 

(Division  K-Paper  Session)  9:00-10:20  Parlor  E 
CHAIR/DISCUSSANT:  Gary  Russell , Notre  Dame 
College 

PARTICIPANTS: 

Instructional  Change  through  Self-Reflection:  Coming 
to  Terms  with  Classroom  Practices  and  Beliefs. 

Mary  Ann  Whaml  University  of  Wisconsin - 
Whitewater;  Susan  Davis,  Illinois  State 
University 

The  Effect  of  Preservice  Laserdisc  Presentation  of 
Question  Types  and  Wait-Time  Use  on  Questioning 
and  Wait-Time  Use  in  Clinical  Experiences. 

Stephen  R.  Wallace , Thomas  E.  Thompson , 
and  Beth  A.  Wiegmann,  Northern  Illinois 
University 

The  Effect  of  Changing  the  Criteria  for  STAD  Team 
Awards. 

William  J.  Gnagey  and  Nora  Y.  Navarro, 
Illinois  State  University 

An  Analysis  of  Instruction  Under  Traditional  and 
Holistic  Language  Models. 

Pamela  A.  Kahlich,  PRC,  Inc. 


ROBERT  E.  SLAVIN 

John  Hopkins  University,  Director  of  the  Early 
and  Elementary  School  Program  at  the  Center 
for  Research  on  Effective  Schooling  for 
Disadvantaged  Students.  Authored  over  140 
articles  and  14  books,  including  Educational 
Psychology:  Theory  into  Practice  (published  by 
Allyn  & Bacon  who  are  co-sponsoring  Dr. 
Slavin's  address). 


How  can  elementary  schools  ensure  that  all 
students  succeed  in  reading  and  other  skills? 

This  presentation  will  review  research  on 
Success  for  All,  a comprehensive  restructuring 
program  for  elementary  schools  serving  many  at- 
risk  students. 
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Improving  Education  for  African 
American  Students:  Being  Part  of  the 
Solutions 

(Division  G-Altemative  Session-Town  Meeting) 
9:00-10:20  Parlor  F 

CHAIR:  Linda  D.  Hayes , Cleveland  State  University 
PARTICIPANTS: 

Education  of  African  American  Students:  An 
Educational  Administrative  Perspective. 

Daniel  D . Drake,  Cleveland  State  University 
Getting  a Head  Start:  Early  Childhood  and  the  Head 
Start  Perspective.  Head  Start,  Cleveland 
African  American  Students  and  Counseling:  A 
Multicultural  Approach  to  Service. 

Thomas  E.  Midgette,  University  of  Arkansas 
Exceptionalities:  The  Physically  Challenged  African 
American  Students. 

Patricia  Bettis-Eddie,  Beachwood  High 
School 

Comer  Schools  and  African  American  Children. 

Hinsdale  Bernard , Cleveland  State  University 
ANALYSTS: 

Nelson  T.  Strobert,  Lutheran  Theological  Seminary 
Mary  Ann  Flowers , Cleveland  State  University 

F.9.Lin  Getting  and  Keeping  an  Academic 

Position:  Part  1 -Getting  a Position 
(Workshop-must  be  registered  to  attend,  pre-register  or 
see  registration  desk,  see  p.  10)  9:00-10:20  Lincoln 
PARTICIPANTS: 

Kim  Metcalf  Indiana  University 
Jerry  Jinks,  Illinois  State  University' 

Carolyn  Babione,  Emporia  State  University 

F.9.Max  Exhibit  Hall 

(Publisher  and  materials  showroom) 

9:00-10:20  Maximillian 

COORDINATOR:  Sharon  McNeely,  NE  III.  Univ. 

F.  1025. Lin  Business  Meeting 

(General  business  meeting  for  all  to  attend- 
information,  input,  and  graduate  student  awards) 
10:25-1 1:45  Lincoln 

CHAIR:  Richard  Pugh , Indiana  University 
PARTICIPANTS:  All  MWERA  Members 


F.l  155. Wal  Lunch  and  announcements 

O'  .unch  is  included  with  registration,  please  wear 
MWERA  name  tag) 

1 1:55-12:40  Walnut  Dining  Room 
CHAIR:  Richard  Pugh.  Indiana  University 
F.  1 240. Wal  Success  for  All 

(Luncheon  Address)  12:40-1:50  Walnut  Dining  Room 
CHAIR:  Rick  Pugh , Indiana  University 
SPEAKER:  Robert  E . Slavin , Johns  Hopkins  U. 

Co-Sponsored  by  Allyn  & Bacon  Publishers 


F.2.Med  Just  Wait  Until  Next  Year 

(1994/95  Program  Meeting-Review  and  Planning 

Session)  2:00-3:20  Medill 

CO-CHAIRS: 

Gregory  J.  Marchant y Ball  State  University 
Sharon  McNeely,  Northeastern  Illinois  Univ. 
PARTICIPANTS: 

Associate  Program  Chairs,  Division  Co-Chairs , those 
wishing  to  make  comments  or  suggestions  concerning 
this  year’s  meeting,  and  those  interested  in  serving  as 
Division  Chairs  or  volunteering  next  year  are  invited 

F.2.A  Challenges  to  School  Administrators 

(Division  A-Paper  Session)  2:00-3:20  Parlor  A 
CHAIR:  Marcia  Salner,  Sangamon  State  University 
PARTICIPANTS: 

Interagency  Collaboration  for  At-Risk  Children  & 
Families:  A View  from  the  Principal's  Chair. 

Louise  E.  Esveld , Univ . of  Northern  Iowa 
Religion  and  Education:  An  Administrator’s  Dilemma. 

William  R . Hughes,  Ashland  University 
The  Educational  and  Economic  Impact  of  the  Ninth 
Grade  Proficiency  Test  in  Selected  Ohio  School 
Districts:  An  Exploratory  Implementation  Study. 

Randy  A.  Continenza,  Chardon  Local 
Schools;  A.  Al-Rubaiy  and  Reene  Alley,  Univ. 
of  Akron 

DISCUSSANT:  Mark  Myers 

F.2.B  Success  and  More 

(Informal  Follow-up  Discussion)  2:00-3:20  Parlor  B 
DISCUSSANT:  Robert  E.  Slavin,  Johns  Hopkins  U. 
POSSIBLE  TOPICS: 

New  Developments  in  Success  for  All 

Roots  and  Wings,  Math  Wings 

Word  Lab  (Social  Studies  & Science),  Middle  Schools 

F.2.C  Psychology  and  Assessment  in  Education 

(Division  K Paper  Session)  2:00-3:20  Parlor 
CHAIR:  Mary  Ann  Wham,  Univ.  of  Wis. -Whitewater 
PARTICIPANTS: 

Teaching  Educational  Psychology  Using  Primary 
Sources  vs.  a Textbook:  What  Do  Students  Say? 

Karen  M.  Dutt , Gretchen  Zuege,  and  Jana 
Murchison , Indiana  State  University 
Use  of  Informal  Medical  Assessments  to  Document 
Deficits. 

Elaine  Traynelis-Yurek,  Univ.  of  Richmond; 
Mary  W.  Strong,  Iowa  State  University 
Interactive  Perceptual  Psychology:  The  Human 
Psychology  that  Mirrors  the  Naturalness  of  Our  Total 
Behavioral  System. 

Gary  Russell,  Notre  Dame  College;  Linda 
Shoare,  Center  for  Professional  Advancement 
DISCUSSANT:  Thomas  Ganse r,  U.  of  W. -Whitewater 
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F.2.D  Choosing  the  Right  Method 

(Division  D-Paper  Session)  2:00-3:20  Parlor  D 
CHAIR:  Patricia  Elmore , Southern  Illinois  University 
PARTICIPANTS: 

Choosing  a Test  Statistic  Based  on  Simultaneous  Test 
Procedures:  Monte  Carlo  Study  of  MANOVA  with 
Covariance  Inequalities. 

7.  Mark  Beasley,  St.  John's  University ; Jan 
Sheehan,  Southern  Illinois  University 
Comparison  of  ANOVA,  McSweeney,  Bradley, 
Harwell-Serlin,  and  Blair-Sawilowsky  Tests  in  the 
Balanced  2x2x2  Layout. 

Lynn  D.  Kelly,  Shlomo  S.  Sawilowsky,  and  R. 
C.  Blair,  Madonna  University 
The  Application  of  Gibbs  Sampling  to  Nested 
Variance  Components  Models  with  Heterogenious 
Within  Group  Variance. 

Rafa  M.  Kasim,  Michigan  State  University 
DISCUSSANT:  Ralph  Mueller,  George  Washington 
University 

F.2.E  Special  Education  Teaching  and  Training 

(Division  E-Paper  Session)  2:00-3:20  Parlor  E 
CHAIR:  Isaiah  Sessoms,  Clarion  University 
PARTICIPANTS: 

Effectiveness  of  Categorical  Versus  Cross-Categorical 
Programming  in  Special  Education. 

Robert  G.  Harrington  and  Dick  B.  Tracy, 
University  of  Kansas 

Voices  in  Special  Education:  A Collaborative 
Investigation  of  Beginning  Teaching. 

Mark  P.  Mosert,  Moorhead  State  University 
How  Effective  is  Special  Education?  Parents  and 
Teachers  Report. 

Dick  B.  Tracy  and  Robert  G.  Harrington, 
University  of  Kansas 

A Comparative  Investigation  of  Reciprocal  Teaching 
and  Teacher  Directed  Strategies  Designed  to  Enhance 
Social  Skills. 

Debra  Dandeles  and  Ronald  R.  Morgan , 
Loyola  University  of  Chicago 
DISCUSSANT:  Richard  Allen,  University  of 
Arkansas/Cherokee  Nation 


MWERA  93  Annual  Meeting  Fact 

Colleagues  from  27  states,  Canada,  Germany,  South 
Africa,  and  Taiwan  attended.  Approximately  one-third 
of  those  attending  were  graduate  students. 


F.2.F  Supporting  Curricular  Change  in  Science 

(Division  B-Symposium)  2:00-3:20  Parlor  F 
CHAIR:  MarkJenness,  Western  Michigan  University 
PARTICIPANTS: 

Enhancing  Science  Resources  to  Support  Change. 

Mark  Jenness,  Western  Michigan  University 
The  Impact  of  Science  Inservices  on  Teachers. 

Antonio  N.  Rubino,  Western  Michigan 
University 

The  Role  of  Administrators  in  Supporting  Science 
Curricular  Change. 

Nancy  B.  Mansberger,  Western  Michigan 
University 

DISCUSSANT:  Zoe  A.  Barley,  Western  Michigan 
University 

F.2.Lin  Teaching  Educational  Psychology  to 

Undergraduates  (or  It's  9:00  O’Clock 
Monday  Morning:  What  Do  We  Know  and 
What  Do  We  Do?) 

(Division  C-Symposium)  2:00-3:20  Lincoln 
MODERATOR/DISCUSS ANT : Joel  Levin, 

University  of  Wisconsin 
PARTICIPANTS: 

Stephen  Benton,  Kansas  State  University 
Nelson  DuBois,  SUNY-Oneonta 
Ken  Kiewra,  University  of  Nebraska 
Jack  Snowman,  Southern  Illinois  University 
Richard  Staley,  ( ORGANIZER ) SUNY-Oneonta 

F.2.Max  Exhibit  Hall 

(Publisher  and  materials  showroom) 

2:00-3:20  Maximillian 

COORDINATOR:  Sharon  McNeely,  Northeastern 
Illinois  University 


F.325.Med  Multicultural  Issues  in  Research  and 
Teacher  Education. 

(Division  G-Invited  Panel)  3:25-4:55  Medill 
CHAIR:  Mary  Ann  Flowers,  Cleveland  State 
University 
PARTICIPANTS: 

Linking  Theory  and  Practice  in  Diversity. 

Kenneth  Addison,  Northeastern  Illinois 
University 

A Further  Commentary  on  Increasing  Minority  Faculty 
Representation  in  Schools  of  Education. 

Jesus  Garcia,  University  of  Illinois 
Confronting  the  "Rumor  of  Inferiority." 

Barbara  J.  Shade,  University  of  Wisconsin- 
Parkside 
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Until  we  understand  the  vestiges  of  our  own  cultures,  we  cannot 

begin  to  assume  to  understand  those  of  others.  Kenneth  Addison,  Northeastern  Illinois  University 


Jesus  Garcia 

University  of  Illinois  at  Urbana- Champaign,  authored 
numerous  articles  on  multicultural  and  minority  issues 
including  articles  in  the  Kappan  and  a book  review  in 
the  Mid-Western  Educational  Researcher . 

In  the  past  three  decades,  it  appears  that  while  few  academics  have 
argued  against  minority  recruitment,  most  have  been  reticent  to 
assume  a leadership  role  in  this  area.  Most  education 
administrators  and  faculty  have  continued  to  accept  the  argument  of 
cultural  diversity  for  a minority  perspective  over  cultural  pluralism 
for  intellectual  diversity. 


Far  too  much  attention  has  been  given  to  the  perceived  deficits  of 
children  of  color.  The  challenge  is  to  identify  the  strengths  of  these 

children  which  can  help  them  achieve.  Barbara  J.  Shade,  Dean  of  the  School  of  Education, 

University  of  Wisconsin-Parkside 


F.325.A  Systemic  Reform  Strategies:  Critical  Issues 

in  Effectiveness. 

(Division  H-Symposium)  3:25-4:55  Parlor  A 
CHAIR:  Zoe  A.  Barley , Western  Michigan  University 
PARTICIPANTS: 

Zoe  A.  Barkley , Western  Michigan  University 
Nancy  B.  Mansberger , Western  Michigan  University 
Mary  E.  Piontek ; Western  Michigan  University 
Margaret  R . Fritz , Western  Michigan  University 
DISCUSSANT:  Mark  Jenness,  Western  Michigan 
University 

F.325.B  Issues  in  the  Professional  Preparation  of 

Curricularists 

(Division  B-Paper  Session)  3:25-4:55  Parlor  B 
CHAIR:  Virginia  Ellen  Goodman , Chicago  State 
University 
PARTICIPANTS: 

Program  Requirements  in  Masters  Degree  Granting 
Curriculum  Programs. 

Linda  Behar,  University  of  Florida 
A Survey  of  the  Impressions  of  Economics 
Departments  of  the  Qualitative  Courses  Required  of 
Economics  Majors. 

Victoia  E.  Young  and  C.  Van  Nelson , Ball 
State  University' 


Problem  Solving  Strategies  of  Fifth  Grade  Students  in 
the  Classroom  Setting. 

William  J.  Neumeier,  Miami  University 
DISCUSSANT:  Donald  J.  Reyes , Northern  Illinois  U. 

F.325.C  Ability  Grouping  and  Curricular  Decisions 

(Division  C-Paper  Session)  3:25-4:55  Parlor  C 
CHAIR/DISCUSSANT:  Jennifer  Fager,  University 
of  New  Hampshire 
PARTICIPANTS: 

Suggestopedia  and  Its  Effects  in  the  Bilingual 
Classroom. 

Mary  Assel,  Dearborn  High  School 
Individual  Differences  in  Learning  Style  and  Recall  of 
Classroom  Instruction. 

Jacqueline  A.  Specht,  Huron  College;  Jack 
Martin,  Simon  Fraser  University 
Instructional  Preferences  of  Academically  Talented 
High  School  and  College  Students. 

Charles  E.  Skipper , Miami  University 
To  Group  or  Not  To  Group:  Is  That  the  Question. 
Kathleen  B . Mecoli , Miami  University 
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F.325.D  Alternative  Clinical  Experiences  in 

Teacher  Education 

(Division  K-Symposium)  3:25-4:55  Parlor  D 
CHAIR:  Kim  Metcalf,  Indiana  University 
PARTICIPANTS: 

A Qualitative  Study  of  a Visually  Impaired  Preservice 
Teacher  Participating  in  a Teacher  Education 
Laboratory. 

JaDora  Sailes,  Indiana  University 
The  Relationship  between  Personality  Type  and 
Reflectivity  following  On-Campus  Laboratory 
Activities. 

Amy  Baum , Indiana  University 
The  Effects  of  On-  and  Off-Campus  Clinical 
Experiences  on  the  Reflective  Ability  of  Preservice 
Teachers. 

Russell  Kushigan,  Indiana  University 
The  Relationship  between  Preservice  Teachers* 
Experience  and  Appreciation  for  an  On-Campus 
Laboratory  Program. 

Julie  Hutchins,  Indiana  University 
Instructor  Behavior  during  Debriefing  in  an  On- 
Campus  Teacher  Education  Laboratory. 

Aaron  Hutchins,  Indiana  University 

F.325.E  Policies  and  Problems 

(Division  F-Paper  Session)  3:25-4:55  Parlor  E 
CHAIR:  Sanda  Stroncak,  Northern  Illinois  University 
PARTICIPANTS: 

Student  Violence  Against  Teachers:  Iconic  Case 
Studies  of  Hercules,  Alexander  the  Great,  Jesus  of 
Nazareth,  and  the  Schoolmaster  of  Faleria. 

Ayers  Bagley,  University  of  Minnesota 
The  National  University  1787-1825. 

Kenny  O . McDougle , Pittsburg  State  Univ. 
Effects  of  U.S.  Educational  Policy  from  1819-1934  on 
American  Indian  Identity. 

Maureen  Smith , University  of  Wis.-Oshkosh 
Separating  Foundations  from  Fundamentals:  Finding 
the  Focus  in  Teaching  Foundations  Classes. 

Jeffrey  Winter,  National- Louis  University 


F.325.F  Professional  Development  Schools: 

Developing  and  Sharing  a Knowledge  Base 
(Division  K-Altemative  Format  Symposium) 

3:25-4:55  Parlor  F 

CHAIR:  Carol  Muskin,  National-Louis  University 
PARTICIPANTS: 

Pat  Hulsebosch,  National-Louis  University 
Wendy  Stack , Northeastern  Illinois  University 
Mary  Daly  Lewis,  Roosevelt  University 
George  Olson , Roosevelt  University 

F.325.Lin  Impediments  in  the  Teaching  of  Research 

Design  and  Statistics 

(Division  D-Invited  Panel-Brief  presentations  and 
open  discussion)  3:25-4:55  Lincoln 
MODERATOR:  John  J.  Kennedy , Ohio  State 
University 

PANEL: 

Robert  S.  Barcikowski,  Ohio  University 
Joel  R.  Levin,  University  ofWisconsin-Madison 
Stephen  G.  Jurs,  University  of  Toledo 
Isadore  Newman,  University  of  Akron 

F.325.Max  Exhibit  Hail 

(Publisher  and  materials  showroom) 

3:25-4:00  Maximillian 

COORDINATOR:  Sharon  McNeely , Northeastern 
Illinois  University 


Despite  all  the  flash  and  fanfare  of  recent  alternative  attempts  to  make  statistics  and  research  methodology  palatable  to  graduate 
students  in  education,  this  presenter  prefers  to  teach  such  content  the  old-fashioned  way:  through  hard  work  at  developing  both 
conceptual  and  computational  knowledge.  Joel  Levin,  University  of  Wisconsin 

Life  is  multivariate!  Robert  Barcikowski,  Ohio  University 

Many  people  use  multivariate  staitsics  for  the  strangest  reasons.  The  link  between  motivation  and  mathematics  needs  to  be 
explored.  Stephen  Jurs,  University  of  Toledo 

One  of  the  major  problems  l see  is  the  increased  misuse  of  statistics  due  to  the  availability  and  ease  of  access  sophisticated 
statistical  programs.  This  tends  to  exacerbate  the  misalignment  between  the  research  question  of  interest  and  the  statistical 
procedure  used:  A Type  VI  Error.  Isadore  Newman,  University  of  Akron 
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F.5.Med 


F.5.A 


F.5.B 


Self-Concept  and  Student  Attitudes 

(Division  G-Paper  Session)  5:00-6:00  Medill 
CHAIR:  Thomas  S.  Parish , Kansas  State  University 
PARTICIPANTS: 

The  Importance  of  Peers  in  Forming  Students’  Actions 
and/or  Attitudes. 

Thomas  S.  Parish , Kansas  State  University; 

James  R.  Necessary , Ball  State  University 
Are  We  As  We  Act,  or  As  We  Perceive  Ourselves. 

James  R.  Necessary,  Ball  State  University ; 

Thomas  S.  Parish , Kansas  State  University 
How  do  Teachers’  and  Professors'  Self-Concepts 
Relate  to  Their  Actions  and  the  Actions  of  Others. 

Thomas  S.  Parish , Kansas  State  University; 

James  R.  Necessary ; Ball  State  University 

Developmental!}7  Appropriate  Practice  and  F.5  .D 

Whole  Language  Transformed  by  Teacher 
Belief:  What  Do  Poor  Children  Need? 

(Division  K-Altemative  Format  Session)  5:00-6:15 
Parlor  A 

CHAIR:  Harriet  Fayne,  Otterbein  College 
PARTICIPANTS: 

Harriet  R.  Fayne , Otterbein  College 
Karen  S.  Robinson , Otterbein  College 
DISCUSSANT:  Lenore  Wineberg,  University  of 
Wiscons  in-  Oshkosh 

Assessing  Preservice  Teachers 
(Division  K-Paper  Session)  5:00-6:10  Parlor  B 
CHAIR:  Ervin  Sparaponi,  Saginaw  Valley  State  Univ 
PARTICIPANTS: 

Using  Writing  in  Mathematics  to  Foster  Student 
Reflection. 

Patri cia  A . Pokay,  Easte rn  Michigan  Un i v. ; F. 5 .E 

Carla  Tayeh,  Eastern  Michigan  University 
Needs  Assessment  to  Train  Preservice  Teachers:  Using 
A Factor  Analytic  Study  to  Refine  A Teacher  Needs 
Assessment  Instrument. 

Charles  K.  Runyan , Rozanne  H.  Sparks,  and 
Richard  Lipka,  Pittsburg  State  University 
Preservice  and  Inservice  Teacher  Journals:  What  Do 
They  Reveal? 

Susan  R.  Cramer,  University  of  Wisconsin-  F.5.F 

Oshkosh;  Ruth  A . Koskela,  University  of 
Wisconsin-Whitewater 


F.5.C  Issues  in  Cognition 

(Division  C Paper  Session))  5:00-6:00  Parlor  C 
CHAIR:  Jennifer  J.  Fager,  South  Dakota  State  Univ . 
PARTICIPANTS: 

A Preliminary  Investigation  of  Retention  Test 
Performance  as  a Function  of  Condensed  vs.  Extended 
Course  Formats. 

Alice  Corkill  Dempster  and  Frank  Dempster, 
University  ofNevada-Las  Vegas 
Do  Everyday  Reading  Activities  Promote  Adults’ 
Cognitive  Development. 

M.  Cecil  Smith,  Kenneth  Elliot,  and  Kim 
Hutchinson,  Northern  Illinois  University 
What  Do  Adults  Read  and  Why  Does  it  Matter? 

M.  Cecil  Smith,  Northern  Illinois  Uni\  rsity 

Topics  in  Education 

(Division  D Paper  Session)  5:00-6: 15  Parlor  D 
CHAIR:  T.  Mark  Beasley,  St.  John's  University 
PARTICIPANTS : 

Analysis  of  Social  and  Professional  Networks. 

Hildrun  Kretschmer,  Free  Univ.  of  Berlin 
The  Lighthouse  Parenting  Scale:  An  Application  of  the 
Circumplex  Model  of  Parenting. 

Elmer  A.  Lemke  and  James  J.  Johnson, 

Illinois  State  University 

Technologists  vs.  Educators:  Resolving  Conflicts  in 
Creating  an  Interactive  Classroom  for  Teaching 
Introductory  Statistics  Via  Distance  Education. 

Perry  L.  Schoon  and  Nicole  K.  Roberts, 
Illinois  State  University 

DISCUSSANT:  Dennis  Leitner,  Southern  Illinois 
University 

The  Second-Order  Factor  Structure  of  the 
16PF:  A Four  Factor  Solution 

(Division  E-Paper  Session)  5:00-6:00  Parlor  E 
CHAIR/DISCUSSANT:  Jerome  Tillman,  Illinois 
State  University 
PARTICIPANTS: 

Joseph  Marth,  Southern  Ohio  College 
Isadore  Newman,  University  of  Akron 

The  Natural  History  of  Mental  Mapping 
(Division  F-Invited  Address)  5:00-6:00  Parlor  F 
CHAIR/DISCUSSANT:  Gary  Shank,  Northern 
Illinois  University 

PRESENTER:  Donald  J.  Cunningham,  Indiana 
University 
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F.5.Lin  Getting  and  Keeping  an  Academic 

Position:  Part  2-Keeping  a Position 

(Workshop-must  be  registered  to  attend,  pre-register  or 
see  registration  desk)  5:00-6:15  Lincoln 
PARTICIPANTS: 

Jerry  Jinks,  Illinois  State  University' 

Kim  Metcalf,  Indiana  University 
Carolyn  Babione,  Emporia  State  University 

F.5.Max  Social  Context  of  Education 

(Division  G Paper  Session)  5:00-6:10  Maximillian 
CHAIR  '.Paula  McMurray , Iowa  State  University 
PARTICIPANTS: 

Contextualized  Self-Concepts  of  Musically  Talented 
Students  in  a Comparative  Study. 

Rich  Hofman  and  Larry  Sherman , Miami 
University 

Daring  to  Air  Dirty  Laundry:  International  Students 
and  School  of  Education  Policy. 

Nancy  Lien  & Relebohile  Moletsane,  Indiana 
University 

Exploring  Teacher  and  Students'  Perspectives  in  an 
Early  Childhood  Classroom  Through  an  Ethnographic 
Lens. 

Paula  McMurray , Tricia  Windschitl,  and  Lina 
Bawarshi , Iowa  State  University 


F.9.Reg  President’s  Reception 

(President's  reception-everyone  is  invited  to  a casual 
get-together)  9:00-?  Regency  Suite,  18th  Floor 
COORDINATOR:  Adria  Karle-Weiss , Murray  State 
University 

HOST:  Richard  Pugh,  Indiana  University 


MWERA  94 

Over  450  authors,  co-authors,  session  chairs,  and 
discussants  make  up  this  year’s  annual  meeting. 
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Saturday,  October  15 


MWERA  94 


5.7. Lob  Fun  Run,  Walk,  Crawl  Along  the 

Lakeshore 

(Light  exercise  route  near  the  Chicago  Yacht 
Club)  7:00-8:00  Bismarck  Lobby 
ORGANIZER/RUNNER: 

Kenneth  A.  Kiewra , University  of  Nebraska 

5.8. Max  Mid-Western  Hospitality 

(Complimentary  coffee  and  rolls) 

8:00-9:00  Maximillian 

S.805.Lin  The  Road  to  Brown 

(Video  Presentation)  8:05-9:05  Lincoln 
In  recognition  of  the  fortieth  anniversary  of 
Brown  vs.  the  Board  of  Education,  a 
documentary  will  be  shown  highlighting  the 
Civil  Rights  movement  and  Charles  Hamilton 
Houston's  legal  assualt  on  Jim  Crow. 

S.8 1 0.Max  Division  Meetings 

(Discussion-bring  your  coffee  and  rolls  and 
review  past  and  plan  future  with  your 
Division  colleagues)  8:10-9:05  Maximillian 
PARTICIPANTS:  Divisions  A,  E,  J 


S.910.Lin  Research  on  Distance  Education 

(Presidential  Address)  9:10-10:20  Lincoln 
CHAIR:  Thomas  Andre,  Iowa  State  Univ. 
PRESENTER:  Richard  C . Pugh , Indiana 
University 


S.  1030.Med  Human  Development  Relations 
and  Measures 

(Division  E-Poster/Table  Session) 

10:30-1 1: 10  Medill 

A.  Influence  of  Mood,  Reason,  and 
Consequences  of  Transgression  on  Moral 
Judgment. 

Changming  Duan,  University  of 
Missouri 

B.  A Confirmatory  Factor  Analysis  of  the 
Child  Behavior  Checklist:  An  Exploration  of 
Age  and  Sex  Differences. 

Paula  J.  Britton,  John  Carroll 
University;  Isadore  Newman, 
University  of  Akron;  Sharon 
Latkovich,  Ashland  University; 
Ronald  F.  Bobner,  Akron  Child 
Guidance  Center;  Erica  Meyers, 

John  Carroll  University ■ 

C.  The  Relation  Between  Adjustment  of 
First- Year  College  Students  and  Weight  Gain: 
An  Investigation  of  the  "Freshman  15." 

Caryn  S.  Smith  and  Paula  J.  Britton, 
John  Carroll  University' 

D.  Sex  Role  Identity  and  Career  Indecision  as 
Predictors  of  Holland's  Congruence. 

Gregory  T.  Eells  and  John  S.  C. 
Romans,  Oklahoma  State  University 


Richard  C.  Pugh 

Indiana  University,  President  of  the  Mid-Western 
Educational  Research  Association  1993-1994. 


Engaging  students  at  the  remote  site  in  interaction  with 
students  at  the  origination  site  is  only  a dream— reality 
suggests  "talking  heads"  is  the  dominate  teaching  style 
in  distance  education. 
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S.  1030. A National  Database:  Revising  the 

Teacher  Follow-up  Instrument 

(Div.  K-Symposium)  10:30-1 1:15  Parlor  A 
CHAIR:  William  E '.  Loadman , Ohio  State  U. 
PARTICIPANTS: 

Content  Validity. 

William  E.  Loadman,  Ohio  State  U. 
Reliability. 

Susan  M.  Brookhart,  Duquesne  U. 
Discussion  and  Implications. 

Beverly  Klecker,  Ohio  State  JJniv. 

S.1030.B  Current  Issues  in  the  Lives  of 

Teachers 

(Division  K-Poster/Table  Session) 

10:30-11:15  Parlor  B 
PARTICIPANTS: 

A.  Foundational  Studies  in  the  Teacher 
Education  Curriculum. 

Richard  J.  Reynolds.  Eastern 
Connecticut  State  University 

B.  Teachers’  Grading  Practices:  Who’s  Doing 
What  and  Why? 

Robert  E.  Rachor , Univ.  of  Toledo 

C.  Hidden  Cost  of  Education:  A Study  of  Out 
of  Pocket  Annual  Financial  Expenditures  of 
Teachers. 

William  Olszewski  and  Kathleen 
Maury , Mankato  State  University 

D.  Are  Preservice  Teachers  Acquiring  Skills 
in  Educational  Technology,  How  and  Where? 

Carol  L.  Bentley,  Chicago  State  U 

S.  1 030. C Information  Processing  and  Study 

Skills 

(Division  C-Paper  Session) 
CHAIR/DISCUSSANT:  Marlene  Schomer, 
Wichita  State  University 
PARTICIPANTS: 

Writing  a Review  Paper:  Investigating  Three 
Formats  for  Organizing  Data. 

Kenneth  A.  Kiewra,  University  of 
Nebraska-Lincoln 

How  Graphic  Organizers  Affect  Text 
Learning:  Factual,  Relational,  and  Transfer 
Effects. 

Kenneth  A.  Kiewra,  University  of 
Nebraska-Lincoln 

An  Analysis  of  the  Measurement  of  Study 
Strategy. 

Wayne  I.  Gordon,  Western  Illinois 
University 

Validating  Information-Processing  Models  of 
Cognitive  Flexibility  and  Learning. 

Rodney  J.  Greer  and  Ronna  F. 

Dillon , Southern  Illinois  University 


S.  1030.D  Professional  Preparation:  A 

Symposium  for  Graduate  Students 
(Division  D-Symposium) 

10:30-12:30  Parlor  D 

CHAIR:  Dennis  W.  Leitner,  Southern  Illinois 
University 
PARTICIPANTS: 

Professional  Preparation  for  a Measurement 
Statistician  at  Educational  Testing  Service. 
Anna  Kubiak,  Educational 
Testing  Sendee 

Professional  Preparation  for  an  Evaluation, 
Research,  and  Assessment  Director  at 
Northern  Illinois  University. 

Tianqi  Han,  Northern  Illinois 
University 

Professional  Preparation  for  a Research 
Statistician  at  A.C.  Nielson  Company. 

Malgorzata  Seaman,  A.C.  Nielson 
Company 

Professional  Preparation  for  an  Evaluation 
Specialist  with  Arthur  Andersen  & Co. 

Terry  L.  Shoemaker,  Arthur 
Andersen  & Co.  and  IMPACT 
Consulting 

Professional  Preparation  to  Become  a 
University  Professor  at  the  University  of 
North  Texas. 

Randall  Schumacker,  University  of 
North  Texas 

DISCUSSANT:  Patricia  Elmore,  Southern 
Illinois  University 

S . 1 030.E  Establishing  Community  Between 

Higher  Education,  Public  Ed.,  and 
Self:  An  Effort  of  Compromise  in 
Infusing  Multiculturalism 

(Division  J-Altemative  Sesssion-Conversation 
Session)  10:30-12:00  Parlor  E 
CHAIR:  Larry  McNeal,  Illinois  State  Univ. 
PARTICIPANTS: 

Joseph  R.  Higlam  and  Mary  Ann  Bard, 

Illinois  State  University 
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Mentoring  and  Mediation  in  a 
Multicultural  Society 

(Division  G-Altemative  Session-Discussion) 
10:30-12:00  Parlor  F 
MODERATOR:  Carla  Shaw,  Northern 
Illinois  University 
PARTICIPANTS: 

Response  to  Cultural  Diversity:  Conceptual 
Change  in  Teacher  Education. 

Carla  Shaw,  Northern  Illinois  Univ . 
Mentoring  for  Ethnic,  Physical,  and  Gender 
Equality. 

Jacqueline  Rickman,  Chicago  Public 
Schools 

Gender  and  Ethnic  Equity  in  the  Workplace. 
Carolyn  Bohlen,  Northern  Illinois 
University  and  E.P.A. 

Hispanic  Early  Childhood  Intervention. 

Myriam  Classen,  Loyola  University 
and  Chicago  Lighthouse  for  the 
Blind 

Special  Education  and  Street  Culture. 

Marva  Bean  Christian,  Northern 
Illinois  University  and  Chicago 
Public  Schools 
Philosophical  Perspectives. 

Sharonjoy  Jackson,  Northern  Illinois 
Univ.  and  Chicago  Public  Schools 
Technology  and  Foundational  Barriers. 

Leon  Liddell,  Northern  Illinois  Univ. 
and  Chicago  Public  Schools 
Special  Education  and  State  of  Illinois  Parent 
Initiative. 

SanDee  Stroncak,  Northern  Illinois 
University  and  Illinois  State  Board 
of  Education 


S. 1030. Max  Deans*  Forum  on  Research, 

Faculty 

Roles,  and  Rewards 

(Open  Discussion  among  deans,  faculty,  and 
future  faculty)  10:30-12:00  Maximillian 
CHAIR:  Roy  A Weaver,  Ball  State  University 
PARTICIPANTS: 

Genevieve  Lopardo,  Dean,  College  of 

Education,  Chicago  State  University 
Charles  E.  Stegman , Dean,  College  of 
Education,  Northern  Illinois 
University 

Roy  A.  Weaver,  Dean,  Teachers  College,  Ball 
State  University 


S.  1 1 .Lin  Group  Assessment  in  a Large  Scale 

Science  Assessment:  First  Year 
Results 

(Division  H-Symposium) 

11:00-12:00  Lincoln 

CHAIR:  Lori  J.  Nebelsick-Gullett,  University 
of  Kansas 
PARTICIPANTS: 

Mark  R.  Pomplun,  University  of  Kansas 
Kim  Veverka,  University  of  Kansas 
DISCUSSANT:  Larry  Lyman,  Emporia  State 
University 


Roy  A,  Weaver 

Received  his  undergraduate  degree  from 
Ball  State  University  and  currently  serves 
as  the  Dean  of  Ball  State’s  Teachers  College. 


Is  the  production  of  faculty  research  meaningful  or 
simply  a ritual  for  promotion  and  tenure  decisions? 
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S.l  120. Med  Early  Adolescence 

(Division  G-Poster-Table  Session) 

11:20-12:00  Medill 
PARTICIPANTS: 

A.  Attitudes  of  Middle-School  Students  and 
Their  Parents  about  Education  in  Physical 
Science,  Biological  Science,  and 
Mathematics. 

Charlotte  Haselhuhn,  Thomas  Andre , 
Myrna  Whigham,  Iowa  State 
University;  G.  Henry  Veldhuis, 
Northwestern  College 

B.  An  Examination  of  the  Attributional 
Styles  of  Ninth-Grade  Students  Who  Dropped 
Out. 

Carmen  Montecinos,  University  of 
Northern  Iowa 

C.  Barriers  to  Caring:  Early  Adolescents' 
Perspective. 

Maria  M.  Ferreira  and  Kris 
Bosworth,  Indiana  University 

S.  1 1 20.B  Poster-Table  Session 

(Poster/Table  Session)  11:20-12:00  Parlor  B 
PARTICIPANTS: 

A.  MANOVA  and  Discriminant  and 
Canonical  Analyses:  Selected  Problems  and 
Suggestions  Relative  to  How  to  Deal  with 
Them. 

Kenneth  H.  Strand \ Illinois  State 
University;  Bernard  Cahill  and 
Nancy  Smith,  University  of  Illinois 
College  of  Medicine  at  Peoria; 
Douglas  Dirks,  West  40  Educational 
Service  Center  No . 5 

B.  The  Effects  of  the  FOCUS  Model  on 
Teacher  Perception,  Efficacy,  and  Application 
in  the  Classrcom. 

Gary  F.  Russell  and  Kathy  Mrsnik, 
Notre  Dame  College 

C.  Removal  of  Computer  Anxiety. 

Mian  M.  Yusuf  University  of 
Wisconsin-Parkside 

D.  Constructs  Underlying  Student 
Perceptions 

of  Parents,  Teachers,  and  Schools. 

Sharon  Paulson,  Gregory  J. 
Marchant,  Barbara  Rothlisberg,  Ball 
State  University 


MWERA  95  may  be  a year  away 

but  preparations  have  already  begun.  With  your  help 
we  can  make  next  year's  annual  meeting  a great  one. 

Contact: 

Sharon  McNeely 
Northeastern  Illinois  University 
EDFN,  5500  N.  St.  Louis  Ave. 
Chicago,  IL  60625 
(312)  794-2788 
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Addison,  Kenneth  - F.325.Med 
Adler,  Jay  - T.845.Lin  - F.1025.Lin 
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Andre,  Thomas  - T.845.Lin  - T.450.C  - 
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S. 9 10. Lin  - S.  1 1 20.Med 
Appel,  Michelle  - T.  145. Med 
Archer,  Thomas  M.  - W.  1 .C 
Arenz,  Bernard  W.  - T.l 45. Med 
Assel,  Mary  - F.325.C 

Babione,  Carolyn  - F.9.Lin  - F.5.Lin 
Badioli,  Bernard  - T.l 45 .Fifth 
Bagley,  Ayers  - F.325.E 
Bainer,  Deborah  L.  - T.8 10. Max  - 

T. l  45.  Max 

Bakken,  Linda  -T.845.Lin  -F.1025.Lin 
Baldwin,  Grover  H.  - T.3 1 5. A 
Barcikowski,  Robert  - T.845.Lin  - 
F.1025.Lin-F.325.Lin 
Bard,  Mary  Ann  - S.  1030. E 
Barley,  Zoe  A.  - F.9.B  - F.325.A 


Program  Additions  and 
Corrections 

Although  efforts  have  been  made  to 
make  the  information  in  this 
program  accurate  and  complete, 
errors  and  omissions  unfortunately 
occur.  Please  contact  Greg 
Marchant  no  later  than  October  1st 
with  any  necessary  changes  and 
additions.  They  will  be  included  in 
an  addendum  sheet  included  in  the 
registration  packet: 

Greg  Marchant 
Educational  Psychology 
Ball  State  University 
Muncie,  FN  47306 
(317)285-8505 
00gjmarchant@bsuvc.bsu.edu 
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Barnes,  Laura  L.B.  - T.1050.Med  - 

T.145.D-  F.810.F  - F.845.D  - 
F.2.Med 

Bauhof,  Laura  - T.3 1 5.E 

Baum,  Amy  - F.325.D 

Bawarshi,  Lina  - F.5.Max 

Beasley,  T.  Mark  - F.2.D  - F.5.D 

Bedard,  Bea  - T.  145.B 

Behar,  Linda  S.  - T.8  lO.Max  - T.1050.B 

- F.2.Med  - F.325.B 
Bendixen-Noe,  Mary  - W.12.A- 

F.2.Med 

Bentley,  Carol  L.  - S.1030.B 
Benton,  Stephen  - T.845.Lin  - .3 15. Max 

- F.  1025. Lin  - F.2.Lin 
Bercik,  Janet  T.  - T.3 15.Fifth 
Bergstrom,  Betty  - T.1220.Lin 
Bernard,  Hinsdale  - F.2.F 
Best,  Kathleen  - T.  1050.F 
Bettis-Eddie,  Patricia  - F.2.F 
Bischoff,  Lisa  A.  - T.450.Lin 
Blair,  R.  C.  - F.2.D 

Bobner,  Ronald  F.  - S.  1030. Med 
Bohlen,  Carolyn  - T.450.Fifth  - S.1030.F 
Bombaugh,  Ruth  - T.315.Lin  - 
T.450.Med 

Bonk,  Curtis  Jay  - T.450.Med  - F.820.C 
Bosworth,  Kris  - S.l  120.Med 
Bramfeld,  Anna  - T.145.F 
Brand,  William  J.  - T.1220.Max 
Britton,  Paula  J.  - T.315.E  - S.l 030. Med 
Brookhart,  Susan  M.  - T.845.Lin  - 
T.6.Max  - F.l025.Lin  - 

S.  1030. A 

Brown-Wright,  Dianne  - T.l 220. C 
Bryant,  Namok  Choi  - F.845.D 
Bucey,  Barbara  A.  - T.3 15. A 
Buchman,  Debra  D.  - T.450.A 
Cahill,  Bernard  - S.l  120.B 
Cameron,  Bradley  - T.3 15. Med 
Campbell,  Cynthia  - T.450.C 
Campbell,  Mary  B,  - T.  145. Med 
Carlsen,  Roger  - T.  145.B  - T.3 1 5. B - 

T. 450.Med 

Carroll,  Frances  - T.1050.Fifth 
Carroll,  James  - F.9.A 
Castle,  Donald  - T.845.Lin  - F.810.F  - 
F.9.F  - F.  1025. Lin  - F.2.Med 
Chang,  Chih-Hung  - T.315.F 
Chase,  Clinton  - T.145.D 
Chiang,  Linda  H.  -T.1050.C 
Chong,  Siat-Moy  - F.820.C 


Christian,  Marva  Bean  - T.450.Fifth  - 
S.1030.F 

Chung,  Kuei-Er  - T.3 1 5.C 
Cirignano,  Bonnie  L.  - T.1050.B 
Cizek,  Gregory  J.  - T.145.D  - F.845.D 
Clark,  Frances  - T.145.C 
Classen,  Myriam  - T.450. Fifth  - 

S. 1030.F 

Collins,  Burton  A.  - T.145.B 
Combs,  Wendy  L.  - T.450. Lin 
Continenza,  Randy  A,  - F.2.A 
Cooley,  Van  C.  - T.  1220.F 
Como,  Lyn  - W.8.Max,  T.930.Max, 

T. l 050. Max,  T.315.Max 
Cox,  Susan  M.  - T.3 1 5. A 

Cramer,  Susan  R.  - T.50.B  - T.450. Lin  - 
F.5.B 

Creswell,  John  W.  - T.3 1 5.B 
Cummings,  Corenna  C.  - T.8 10. Max  - 
T.145.A  - F.2.Med 
Cunningham,  Donald  J.  - F.5.F 
D’Costa,  Ayres  G.  - T.845.Lin  - 
T.3 1 5. Max  - T.6.Max  - 
F.1025.Lin 

Dam,  Tom  Van  - T,1050.Fifth 
Dandeles,  Debra  - F.2.E 
Davis,  Susan  - F.9.E 
De  Rose,  Jeannine  - T.3 1 5.E 
Dempster  , Alice  Corkill  - F.5.C 
Dempster,  Frank  - F.5.C 
Deville,  Craig  W,  - W.  1 .E  - T.  1050.Med 
Didham,  Cheryl  - T.1220.Med 
Dillon,  Ronna  F.  - S.1030.C 
Dimitrov,  Dimiter  M.  - T.3 15. D 
Dinero,  Thomas  E.  - T.l 050. Med 
Dirks,  Douglas  - S.l  120.B 
Dorsch,  Nina  - T.145.A 
Drake,  Daniel  D.  - F.2.F 
Duan,  Changming  - S.  1030. Med 
DuBois,  Nelson  - F.2.Lin 
Dult,  Karen  M.  - T.l 45 .Lin 
Dupuy,  Paula  - T.845.Lin  - T.3 15.E 
Dutt,  Karen  M.  - F.2.C 
Dwyer,  David  J.  - T.450.D  - F.845.D 
Eells,  Gregory  T.  -S.  1030. Med 
Elliot,  Kenneth  - F.5.C 
Elmore,  Patricia  - F.2.D  - S.1030.D 
Erion,  R.L.  - T.315.B 
Esveld,  Louise  E.  - F.2.A 
Evans,  Angela  - T.3 15. E 
Eager,  Jennifer  - T,845.Lin  -F.810.F- 
F.  1025. Lin  - F.2.Med 
Farmer,  Raquel  L.  - T.450.F 
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Fayne,  Harriet  R.  - F.5.A 
Ferreira,  Maria  M.  - S.l 120.Med 
Finley,  Mary  K.  - T.145.F 
Fleming,  Louise  E.  - T.1050.D  - F.9.F 
Flowers,  Mary  Ann  - T.810.Max  - 
T.145.F  - F.2.F  - F.2.Med 
Fox,  Christine  - T.1050.Med 
Frass,  John  W.-T.315.D 
Freiberg,  Melissa  R.  - T.  145.C 
Fritz,  Margaret  R.  - F.325.A 
Fuchs,  Annette  - T.3 15.E 
Fuller,  Roberta  - T.  1050.C 
Furtwengler,  Carol  B.  - T.145.C  - F.9.A 
- F.2.Med  - S.810.F 
Furtwengler,  Willis  J.  - F.9.A 
Ganser,  Thomas  M.  - T.  I45.C  - F.2.C 
Garcia,  Eugene  - T.7.Med  - F.805.E  - 
F.9.Med 

Garcia,  Jesus  - F.325.Med 
Gariglietti,  Gianna  M.  - T.1220.F 
Gedeon,  Julie  - T.  1 050. Med 
Gerhard,  Fran  Peterman  - W.  1 .D 
Gibson,  Nancy  P.  - T.450.D 
Giebelhaus,  Carmen  R.  - W.12.A  - 
T.845.Lin  - F.2.Med 
Glass,  Gene  V - T.  1 220.Max  - 
T.315.Max 

Gleaves,  Kenneth  A.  - T.315.E 
Glenn,  Eddie  - T.450.E  - F.2.Med  - 

S. 810.F 

Gnagey,  William  J.  - F.9.E 
Goggins,  Ellen  - T.1220.C 
Goodman,  Virginia  Ellen  - 
Goodman,  Virginia  E.  - T.810.Max  - 

T. 1050.B  - F.2.Med  * F.325.B 
Gordon,  Edward  E.  - T.450.A 
Gordon,  Gail  D.  - T.450.F 

Gordon,  Wayne  I.  - S.1030.C 
Gosmure,  Doreen  -T.315.B 
Grabner,  Melissa  M.  - F.820.C 
Green,  James  E.  - T.315.B 
Green,  Kathy  E.  - T.3 15.F 
Greer,  Rodney  J.  - S.1030.C 
Grossman,  John  A.  - T.  1220. Med 
Han,Tianqi  - S.1030.D 
Hannah,  Fred  - T.1050.F 
Hansen,  Edmund  J.  - F.820.C 
Harrington,  Jeanne  - T.3 15, B 
Harrington,  Robert  G.  - T.2.E 
Haselhuhn,  Charlotte-  T.450.C  - 
S.l  120,Med 

Hawking,  James  - T.450.B 
Hayes,  Linda  D.  - T.810.Max  - F.2.Mcd 
- F.2.F 

Hecht,  Jeffery  B.  - T.3 15.D  - T.450.D  - 
F.810.F-  F.2.Mcd 


Hegland,  Susan  M.  - T.315.C 
Hennig,  Judith  - T.315.Fifth 
Henriksen,  L.W.  - T.  1220.F  - F.845.D 
Higlam,  Joseph  R.  - S.  1030.E 
Hines,  Edward  R.  - T.1220.B 
Hoffman,  Nancy  - T.  145 .Fifth 
Hofmann,  Rich  - T.450.D  - F.5.Max 
Holcomb,  Edie  L.  - T.  1050.A  - F.9.A 
Holliday,  Gregory  A.  - T.450.E 
Hollingsworth,  Sandra  -T.  145. Max 
Howard,  Sandy  - T.3 15.B 
Hruby,  Paula  Jo  - T.1050.F  - T.315.B 
Hughes,  William  R.  - F.2.A 
Hulsebosch,  Pat  - F.325.F 
Humphries,  Jennifer  N.  - F.9.F 
Hurst,  David  - F.9.A 
Hutchins,  Aaron  - F.325.C 
Hutchins,  Julie  - F.325.C 
Hutchinson,  Kim  M.  - T.1220.D  - 

T.450.A  - F.810.F  - F.2.Med  - 
F.5.C 

Jackson,  Sharonjoy  - T.450.Fifth  - 

S. 1030.F 

Jacobs,  Yvonne  - T.3 15. B 
Jason,  Martin  H.  - T.1050.Fifth 
Jenness,  Mark  - F.9.B  - F.325.A 
Jensen,  Sharon  J.  - T.  145.Lin 
Jinks,  Jerry  - F.9.Lin  - F.5.Lin 
Johnson,  James  J.  - F.5.D 
Jurs,  Stephen  - T.845.Lin  - F.1025.Lin  - 
F.325.Lin 

Kahlich,  Pamela  A.  - F.9.E 
Kalaian,  Hripsime  A.  - T.1220.D 
Kardash,  Carolanne  - T. 845. Lin  - 
F.  1025. Lin 

Karle- Weiss,  Adria  - T.845.Lin  - 

T. 6.Max  - F.9.Reg 
Kasim,  Rafa  M.  - F.2.D 
Kaufield,  Clint  - T.  1220. A 
Keiser,  Jane  M.  - T.145.A 
Keller,  Daniel  L.  - T.1220.Med 
Kelley,  D.  Lynn  - F.2.D 
Kennedy,  John  J.  - W.  1 .F  - F.325.Lin 
Kent,  Susan  - T.3 15. Lin 

Kiewra,  Kenneth  A.  - T.845.Lin  - 

T.6.Max  - F.  1025. Lin  - F.2.Lin 
- S.7.Lob  - S.1030.C 
Killian,  Joyce  E.  - T.  145. Fifth 
Kirkley,  E.  Sonny  - F.820.C 
Kirkpatrick,  Bonnie  - T.450.B 
Klass,  Patricia  H,  - T.1050,Med  - 
T.1220.F 

Klecker,  Beverly  - S.1030.A 
Kline,  Charles  E.  - T.3 15. A 
Kline,  Frank  - T.1220.Med  - T.145.C 


Knapp,  Thomas  - T.845.Lin  - 
F.  1025. Lin 

Koller,  James  R.  - T.450.E 
Koriath,  Kirby  -T.1220.B 
Koskela,  Ruth  A.  - F.5.B 
Kramer,  Gene  A.-  T.1220.D  - T.315.F 
Krengel,  Lawrence  E.  - T.315.C 
Kretschmer,  Hildrun  - F.5.D 
Kubiak,  Anna  - S.1030.D 
Kun-Han,  John  - F.820.C' 

Kuper,  Ray  - T.315.Fifth 
Kus-Patena,  Sophie  T.  - T.3 15. A 
Kushigian,  Russell  H.  - F.820.C  - 
F.325.C 

Lambdin,  Diana  V.  - T.  145.A 
Lambert,  Judy  C.  -T.1050.C 
Larkin,  Kevin  - T.1220.D  - T.450.A  - 
F.810.F  - F.2.Med 
Lasley,  Thomas  J.  - T.3 15. Max 
Latkovich,  Sharon  - S.1030.Med 
LeBlanc,  Michael  - T.315.E 
Legg,  David  L.  - T.3 15.D 
Leitner.  Dennis  W.  - F.5.D  - S.  1030.D 
Lemke,  Elmer  A.  - F.5.D 
Lester,  Frank  - T.  145. Max 
Leung,  Jupian  J.  - T.  1 050.E  - T.3 1 5.C 
Levin,  Joel  R.  - F.2.Lin  - F.325.Lin 
Lewis,  Mary  Daly  - F.325.F 
Liddell,  Leon  - T.450.Fifth  - S.1030.F 
Lien,  Nancy  - F.5.Max 
Liftendahl,  Thomas  - T.1220.Fifth 
Linacre,  John  Michael  - W.l.E  - T.315.F 
Lipka,  Richard  - T.845.Lin  - T.315.Med 

- F.1025.Lin  - F.5.B 
Lipsett,  Laura  - T.  1220.Med 
Loadman,  William  E.  - T.  145. A - 

S. l  030.  A 

Lopardo,  Genevieve-  S.  1030. Max 
Lukin,  Leslie  E.  - T.845.Lin  - 
F.  1025.Lin 

Lunz,  Mary  E.  - W.l.E 

Lux,  Kathleen  M.  - T.315.D 

Lyman,  Larry  - S.  1 1 .Lin 

Lynch,  Daniel  O.  - T.1050.E  - T.315.C 

Mackley,  Holly  D.  - T.145.F 

Maki,  Michele  D.  - T.3 15. A 

Manges,  Charles  D.  - W.315.A  - T.145.E 

Mansberger,  Nancy  B.  - F.9.B  - F.325.A 

Marchant,  Gregory'  J.  - W.8.Max  - 

T. 845.Lin  - T.930.Max  - 
T.6.Max  - T.450.E  - F.1025.Lin 

- F.2.Med  - S.l  120. B 
Marso,  Ronald  N.  - T.145.C 
Marlh,  Joseph  R.  -T.1220.C  - F.5.E 
Martin,  Jack  - F.325.C 

Matuga,  Julia  M.  - F.820.C 
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Mau,  Wei-Cheng  - T.1220.F 
Maury,  Kathleen  -T.145.C  - S.1030.B 
McBumey,  Beth  - T.450.A 
McCafferty,  Nancy  - T.3 1 5.E 
McCullough,  Joy  - T.845.Lin  - 
T.315.Lin 

- T.450.Lin  - F.  1 025. Lin  - 
F.2.Med 

McDougle,  Kenny  O.  - F.325.E 
McGrady,  Angele  - T.3 1 5.E 
McMurray,  Paula  - F.5.Max 
McNeal,  Larry  - T.1050.E  - S.1030.E 
McNeely,  Sharon  - T.845.Lin  - T.6.Max 

- T.7.Med  - F.805.E  - F.9.Med  - 
F.1025.Lin-F.2.Med- 

F. 325. Max 

Mead,  Tim  P.-T.315.D 
Mecoli,  Kathleen  B.  - F.325.C 
Metcalf,  Kim  - T.810.Max  - T.845.Lin 

- T.315.Max  - F.9.Lin  - F.5.Lin 

- F. 1025. Lin  - F.325.D 
Meyers,  Erica  - S.1030.Med 
Michaelis,  Karen  - T.  1 050.A 
Midgette,  Thomas  - T.845.Lin  - 

T.1220.E-  T.315.E  - 
F.  1025. Lin  - F.2.F 
Migden,  Joseph  - T.3 1 5 .A 
Miller,  Timothy  E.  - T.450.Lin 
Miller,  L.  E.-T.145.B 
Mitchell,  Jacqueline  - T,  1220. A 
Moletsane,  Relebohile  - F.5.Max 
Montecinos,  Carmen  - T.1220.C  - 
S.l  120-Med 

Moore,  Lou  Anna  - T.145.A 
Moore,  Marilyn  - T.1220.F 
Morgan,  Ronald  R - T.3 15.E  - T.450.A 

- F.2.E 

Morrow,  Linda  E.  - W.12.A  - F.2.Med 
Mostert,  Mark  P.  - T.145.Lin  - F.2.E 
Moulton,  Mark  H.  - T,1220.Lin 
Mrsnik,  Kathy  - S.l  120.B 
Mueller,  Ralph  O.  - T.845.Lin  - T.145.D 

- T.315.D  - T.6.Max  - 
F,  1025. Lin -F.2.D 

Mullan,  Patricia  B.  - T.1220.D 
Multon,  Karen  D.  - T.450.E 
Murchison,  Jana  - F.2.C 
Muskin,  Carol  - F.325.F 
Myers,  Mark  - F.2.A 
Navarro,  Nora  Y.  - F.9.E 
Nebelsick-Gullett,  Lori  - T.845.Lin 

- F.1025.Lin  - S.l  1. Lin 
Necessary',  James  R.  - F.5.Med 
Nelson,  C.  Van  - T.1220.F  - F.845.D 

- F.325.B 

Neumeier,  William  J.  - F.325.B 
New,  Clara  A.-T.145.F 


Newman,  Isadore  - T.810.Max 

- T. 845. Lin  - T.1220.C  - 
T.315.D  - F.845.D  - F.1025.Lin 

- F.2.Med  - F,325.Lin  - F.5.E  - 

S.  1030. Med 

Nolte,  Connie  - T.  1050. A 
Nussbaum,  Matthew  P.  - F.820.C 
Oakerson,  Peggy  F,  - T.450.A 
Odell,  Michael  - T.450.C 
Okoro,  Daniel  -T.145.B 
Oldenski,  Thomas  - T.450.D 
Olson,  George  - F.325.F 
Olszewski,  William  -S.1030.B 
Owens,  Melva  - F.9.A 
Oyer,  Elizabeth  J.  - T.450.Med 
Parish,  Thomas  S.  - F.5.Med 
Paulson,  Sharon  E.  - S.810.F  - T.1050.E 

- F.2.Med  - S.l  120.B 
Pereira,  Peter  - T.1050.B 
Petosa,  Rick  A.  - T.315.D 
Pierce,  Jean  W.  - T.1050.D 
Pigge,  Fred  L.  - T.145.C 
Pintrich,  Paul  - W.8.Max 
Piontek,  Mary  E.  - F.325.A 
Pitruzzelo,  Tony  -T.1220.Lin 
Place,  A.  Will  - T.  1220 .A  - F.2.Med 

- S.810.F 

Pokay,  Patricia  A.  - F.5.B 
Pomplun,  Mark  R.  - S.  1 1 .Lin 
Ponticell,  Judy  J.  -T.450.A 
Post,  Donna  M.  - T.145.Fifth 
Poteet,  James  A.  - T.450.E 
Potthoff,  Dennis  E.  ~T.1220.Med 

- T.145.C  - T. 315. Lin 
Powell,  James  - W.l.D 
Price,  Jay  -T.145.Lin 
Prokosch,  Neil  E.  -T.1220.B 
Pugh,  Richard  C.  - T.845.Lin 

- T. 1220. Max  - T.315.Max  - 

T. 6.Max  - F.1025.Lin  - 
F.l  125.Wal  - F1240.Wal  - 
F.9.Reg  - S.910.Lin 

Rachor,  Robert  E.  - T.145.D  - F.845.D 

- S.1030.B 

Rageb,  Linda  - T.3 1 5.Fifth 
Ramanathan,  Hema  - T.  1220. Med 
Rankin,  Joan  - T.315.C 
Reese,  Bill  - T.  145. Max 
Reid,  John  M.  - T.1050.Med 
Rekkas,  Alexandria  - T.  1 45. Med 
Reyes,  Donald  J.  - F.325.3 
Reynolds,  Richard  J.  -S.1030.B 
Rickman,  Jacqueline  - T.450.Fifth 

- S.1030.F 

Rifkin,  Alison  - T.  1 050.E 
Roberts,  Nicole  K.  - T.450.D  - F.5.D 
Roberts,  Thomas  E.  - T.1050.F  - 


T.315.B 

Robinson,  Mary  Ann  - T.1220.C 
Robinson,  Karen  S.  - F.5.A 
Rogers,  Bruce  G.  - T.145.D 
Romanowski,  Michael  H.  - T.450.D 
Romans,  John  S.  C.  - S.1030.Med 
Rothlisberg,  Barbara  -S.1120.B 
Rubino,  Antonio  N.  - F.9.B 
Runyan,  Charles  Kent  - T.3 1 5. Med 
-F.5.B 

Rusch,  Edith  A.  - T.1220.A  - T.315.A 
Russell,  Gary  F.  - T.1050.D  - F.9.E 

- F.2.C  - S.l  120. B 
Sailes,  JaDora  -F.325.D 
Salner,  Marcia  - F.2.A 
Sandoval,  Terri  - T.145.B 
Savery,  John  R.  - F.820.C 
Sawilowsky,  Shlomo  S.  - F.2.D 
Schiavi,  Rosemary  F.  -T.145.Med 

- T.3 15. Lin 

Schommer,  Marlene  - T. 845. Lin 

- T.3 15. C - F.1025.Lin  - 

S. 1030.C 

Schoon,  Perry  L.  - T.450.D  - F.5.D 
Schrader,  Tom  -T.145.A 
Schraw,  Gregory  - T.845.Lin  - 
F.1025.Lin 

Schumacker,  Randall  E.  - W.315.B 

- T.31 5.Max  - S.1030.D 
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This  issue  of  MWER  offers  a variety  of  articles.  Two  articles  study  aspects  of  teaching.  Manaf  uses  factor 
analysis  to  explore  the  latent  dimensions  of  teaching  behavior  among  preschool  student  teachers.  Briscoe  uses 
qualitative  methods  and  a single  case,  an  exemplary  science  teacher,  to  explore  classroom  assessment  practices. 
Two  articles  consider  methodological  issues.  McNeil  and  Newman  explain  the  principles  of  meta-analysis  for 
summarizing  reviews  of  literature.  Elliott  and  Barcikowski  examine  the  power  of  F approximations  for  two 
multivariate  statistical  tests,  Hotelling’s  trace  and  Pillai's  trace.  We  are  pleased  to  present  this  variety  in  the  journal . 
We  hope  it  reflects  the  variety  of  research  interests  among  MWERA  members.  We  also  encourage  authors  to  submit 
manuscripts  from  various  perspectives.  We  work  hard  to  find  appropriate  reviewers  for  each  submission. 

— - Ayres  G,  D ’ Costa 
— Susan  M.  Brookhart 
— John  R.  Surber 
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Wendell  W.  Wright  Education  Building  in  Bloomington,  which  contains  the  most  ad- 
vanced technological  infra-structure  available,  featuring  a world-class  distance  educa- 
tion studio/classroom,  multimedia  laboratories,  computer  classrooms,  and  other  special- 
ized educational  settings.  Shown  (bottom-right)  is  the  modern  Education/Social  Work 
Building  located  in  the  heart  of  Indianapolis. 

The  School  of  Education  offers  nationally  recognized  programs  leading  to  the 
degrees  of  Bachelor  of  Science  in  Education,  Master  of  Science  in  Education,  Specialist 
in  Education,  Doctor  of  Education,  and  Doctor  of  Philosophy.  The  Bloomington  campus 
is  a major  research  center  for  national  and  international  scholars.  The  Indianapolis 
campus  provides  a policy  center  and  the  opportunity  to  work  in  diverse  school  settings. 
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The  Mid-Western  Educational  Rescracher  accepts  research-based  manuscripts  that  would  appeal  to  a 
wide  range  of  readers.  All  materials  submitted  for  publication  must  conform  to  the  language,  style,  and  format  of  the 
Publication  Manual  of  the  American  Psychological  Association,  3rd  ed.,  1983 
(available  from  Order  Department,  American  Psychological  Association,  P.O.  Box  27 10,  Hyattsvillc,  MD  20784). 

Three  copies  of  the  manuscript  should  be  submitted  typed  double-spaced  (including  quotations  and  references)  on 
8l/2  x 1 1 paper.  Only  words  to  be  italicized  should  be  underlined.  Abbreviations  and  acronyms  should  be  spelled  out  when  first 
mentioned.  Pages  should  be  numbered  consecutively,  beginning  with  the  page  after  the  title  page. 

Manuscripts  should  be  less  than  20  pages  long.  An  abstract  of  less  than  100  words  should  accompany  the  manuscript 

The  manuscript  will  receive  blind  review  from  at  least  two  professionals  with  expertise  in  the  area  of  the  manuscript 
The  author’s  name,  affiliation,  etc.,  should  appear  on  the  title  page  only.  Efforts  will  be  made  to  keep  the  review  process  to 
less  than  two  months.  The  editors  reserve  the  right  to  make  minor  changes  in  order  to  produce  a concise  and  clear  article. 

The  authors  will  be  consulted  if  any  major  changes  are  necessary. 

Manuscripts  should  be  sent  with  a cover  letter  to: 
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Investigation  of  Power  Using  F Approximations  for  the 
Hotelling-Law  ley  Trace  and  PillaVs  Trace 

Ronald  S.  Elliott  and  Robert  S.  Barcikow'ski,  Ohio  University 


Abstract 

Differences  among  treatment  groups  in  terms  of  which  variable  or  linear  combination  of  vari- 
ables causes  a significant  multivariate  analysis  of  variance  (MAN OVA)  are  ofien  difficult  to  determine . 
This  study  is  an  attempt  to  develop  a means  by  which  a significant  MAN  OVA  can  be  followed  by  a 
discriminant  analysis  for  the  purpose  of  finding  a significant  contrast  which  can  determine  which 
variable  or  linear  combination  of  variables  is  causing  differences  in  which  treatment  groups. 

Significance  of  the  contrast  was  tested  using  Roy-Bose  simultaneous  confidence  intervals . 
These  inter\>als  traditionally  have  been  considered  conservative  as  a hypothesis-testing  procedure.  Of 
concern  in  any  hypothesis-testing  pwcedure  is  type  I error  and  power.  This  study  investigated  type  I 
error  and  power  of  the  procedure  in  numerous  situations  which  used  many  combinations  of  number  of 
groups , number  of  variables , nominal  alpha,  andgivup  size.  Included  are  situations  which  involved  no 
violation  of  MAN  OVA  assumptions,  as  well  as  situations  involving  a violation  of normality  or  a violation 
of  the  assumption  of  a homogeneous  covariance  structure. 

Results  show  that  the  proposed  procedure  needs  great  improvement  when  the  assumptions  of 
MANOVA  are  not  met.  When  the  assumptions  are  met,  the  procedure  \vorks  fairly  well  in  terms  of  power 
and  type  I error  for  a small  number  of  groups  or  variables.  As  the  number  of  groups  or  variables 
reaches  six,  the  procedure  begins  to  lose  power,  but  type  I error  is  acceptable. 


Objectives 

In  the  traditional  use  of  multivariate  analysis  of 
variance  (MANOVA),  authors  and  researchers  have  used 
one  of  four  possible  multivariate  statistics  in  testing  the  over- 
all null  hypothesis:  Pillai’s  trace  ( V );  the  Hotelling-Lawley 
trace  (7),  Roy's  largest  root  (R)y  or  Wilks'  lambda  (a).  The 
ability  of  a test  to  reject  the  null  hypothesis  when  it,  in  fact, 
is  false,  is  called  the  power  of  the  test.  A rejection  of  the 
null  hypothesis  when  it  is  true  is  an  error  and  is  called  a 
type  I error.  Olson  (1973,  p.  Ill)  recommended  Vto  be 
“the  most  robust  of  the  MANOVA  tests,  with  adequate  power 
to  detect  true  differences  in  a variety  of  situations".  Olson 
compared  I r with  T,  /?,  and  Ws  among  other  multivariate 
statistics,  in  terms  of  power  and  type  I error  in  a number  of 
situations  involving  the  violation  of  the  assumptions  upon 
which  MANOVA  is  assumed  to  be  a valid  procedure. 

Commonly  used  statistical  packages  such  as  SAS, 
SPSS,  and  SYSTAT  use  an  F distribution  to  approximate 
the  probabilities  associated  with  the  V,  W,  and  T test  statis- 
tics in  using  them  for  hypothesis  testing.  Elliott  and 
Barcikowski  ( 1993)  found  that  when  the  subjcct-to -variable 
ratio  was  small  in  a one-way  equal  group  size  MANOVA, 
the  F approximations  provided  by  Pillai  (1960)  and  used  by 
most  canned  computer  packages  (c.g.,  SAS,  SPSS,  and 
SYSTAT)  for  Uand  T produced  type  I error  rates  w hich  did 
not  always  meet  Bradley’s  (1978,  p.  146)  stringent  criterion 
for  robustness.  That  is,  under  many  conditions  encoun- 
tered by  practitioners.  I was  found  to  be  conservative  and  T 
was  found  to  be  liberal  when  compared  to  a nominal  level 
of  significance  of  .05. 


Bradley’s  stringent  criterion  for  robustness  is  that 
the  actual  level  of  significance  be  within  ±.  la:  of  the  nomi- 
nal level  of  significance  (a: ).  For  example,  if  a:  = .05,  then 
the  approximation  method  should  yield  a nominal  value  that 
falls  between  .045  and  .055.  Such  a level  of  precision  would 
be  necessary'  for  an  approximation  method  found  in  a sta- 
tistical package  which  is  meant  to  be  used  in  a wide  variety 
of  research  situations. 

Elliott  and  Barcikow'ski  (1993)  considered  type  I 
error  rates  for  situations  involving  3 treatment  levels  with 
2,  3,  and  6 variables,  and  6 treatment  levels  with  3 and  6 
variables.  This  study  extends  the  previous  study  by  includ- 
ing type  I error  rates  for  the  situation  involving  6 treat- 
ments and  2 variables.  However,  the  primary-'  focus  of  this 
study  is  on  the  power  of  the  F approximation  methods  for  T 
and  V when  the  assumptions  of  MANOVA  are  met. 

Perspectives 

Data  sets  were  found  w'here  using  SPSS  program 
MANOVA  (or  SAS  program  GLM)  a significant  omnibus 
multivariate  F wras  found  based  on  T.  but  a nonsignificant 
result  for  this  same  statistic  was  found  w'hcn  using  BMDP’s 
4V  program.  The  difference  between  the  two  results  was 
caused  by  the  different  approximation  methods  used  by  the 
programs  to  arrive  at  their  probability  values.  Table  1 gives 
a situation  comparing  results  from  SPSS  and  BMDP.  The 
same  T statistic  of  2.78697  was  obtained  by  both  packages 
doing  a MANOVA  on  a data  set.  However,  SPSS  and  BMDP 
produce  a different  significance  associated  with  this  same 
statistic  because  they  use  a different  approximation  method 
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used  to  produce  the  probability. 

In  the  SPSS  output,  a probability  of  .044  is  ob- 
tained while  the  output  from  BMDP  ' ows  a probability  of 
.0654  associated  with  the  same  statistic.  This  led  to  a study 
(Elliott  & Barcikowski,  1993)  that  used  Bradley’s  (1978,  p. 
146)  criterion  for  examining  the  type  I error  rates  of  the 
approximation  methods  under  a variety  of  conditions. 

An  F approximation  is  not  used  for  Roy’s  largest 
root  and  is  based  on  Harris  (1975)  in  BMDP  and  Pillai  ( 1 965) 
for  SPSS  and  SAS;  for  T,  BMDP’s  chi-square  approxima- 
tion is  based  on  Tiku  (1971)  and  SAS  and  SPSS  F approxi- 
mation is  based  on  Pillai  (1960);  Wilks’  lambda  F approxi- 
mation for  all  programs  is  based  on  Rao  (1973);  the  F ap- 
proximation for  V is  based  on  Pillai  (1960)  for  SAS  and 
SPSS. 

Table! 

One-Way  MANOVA 

(6  Treatments,  6 Dependent  Variables,  5 Subjects  Per  Treatment' 
Output  From  SPSS 


Multivariate  Tests  of  Significance  (S  5, 

M - 0.  n r 

8 12) 

Test  Name  Value 

Approx.  F 

Hvp.  df 

Error  df 

Sia.  of  1' 

Pillai  1.11157 

1.09582 

30.00 

115.00 

0.354 

Hotelling  2.78697 

1.61645 

30.00 

87.00 

0.044* 

Wilks  0.19299 

Roy  0.69570 

1.32274 

30.00 

78.00 

0.164 

One-Way  MANOVA 

(6  Treatments,  6 Dependent  Variables,  5 Subjects  Per  Treatment; 

Output  From  BMDP4V 

Statistic  _F  df  Prob 

L RATIO  - 0.192990  1.32  30.00  78.00  0.1638 

TRACE  -=  2.78697 

TZSQ  - 64.1004 

CHISQ  19.43  30.226  0.0654* 

MXROOT  -=  0.695699  0.0197 

*Notc.  In  the  BMDP4V  output,  the  chi-square  probability  is 
.0654  for  the  same  Hotclling-Lawlcy  (TRACE  in  BMDP) 
statistic  for  which  SPSS  reports  a probability  of  .044. 

Olson  (1976)  urged  researchers  to  provide  infor- 
mation concerning  the  approximation  method  used  for  re- 
ported statistics  in  their  research  reports  when  he  indicated: 
In  view  of  the  differing  robustness  perfor- 
mances of  the  test  criteria , researchers  who  use 
the  expression  multivariate  F should  include  a 
footnote  specifying  whose  approximation  to  which 
criterion  was  employed,  (p.  584) 

Methods/Data  Source 

A Monte  Carlo  study  was  undertaken  based  on  a 
format  developed  by  Olson  (1973).  A Fortran  program  (run 
on  a Cray  Y-MP  Supercomputer)  was  written  to  generate 
discriminant  score  data  to  meet  the  conditions  to  be  investi- 
gated. The  program  used  the  International  Mathematical 
and  Statistical  Libraries  (IMSL)  random  number  generator, 
RNMVN,  to  generate  random  score  vectors  from  a multi- 


variate normal  distribution.  This  particular  generator  pro- 
duces scores  from  a normal(0,l)  distribution.  That  is,  the 
variables  used  in  the  study  initially  have  a mean  of  zero  and 
a variance  of  one.  The  investigation  included  ali  combina- 
tions of  the  following:  2,  3,  6 dependent  variables;  3 and  6 
treatment  levels;  and  4 (1)  20  sample  sizes  (equal  n per 
treatment  level). 

Type  I error 

Type  I error  rates  for  Roy’s  largest  root  based  on 
Harris  (1975),  T based  on  Tiku  (1971)  and  Pillai  (1960), 
Wilks'  lambda  based  on  Rao  (1973),  and  Kbased  on  Pillai 
(1960)  were  estimated  based  on  100,000  random  samples 
per  situation  for  the  two-variable  and  six-group  situation 
to  add  to  the  previous  study  by  Elliott  and  Barcikowski 
(1993).  Robey  and  Barcikowski  (1992)  indicated  that 
100.000  samples  arc  necessary'  to  yield  a power  of  more 
than  90%  of  detecting  (a  = .05)  a departure  of  .la  from  a 
nominal  alpha  of  .05. 

Power 

Power  was  investigated  for  each  of  the  above  lex  - 
els  of  variables  and  groups.  Only  one  group  size  was  used  - 
- the  group  size  where  T and  Kwere  found  to  vary’  the  most 
from  Bradley’s  stringent  criterion  when  considering  type  I 
error.  Data  sets  were  generated,  and  the  mean  vectors  were 
altered  to  produce  a certain  noncentrality  structure  as  de- 
fined by  Olson  (1973).  Nonccntrality  refers  to  a difference 
in  mean  vectors  among  the  groups.  If  the  noncentrality  is 
iarge  enough,  a significant  MANOVA  result  is  expected. 
In  order  to  investigate  power,  the  values  of  a certain  vari- 
able or  variables  in  certain  groups  were  made  larger  to  arti- 
ficially produce  a certain  expected  power  in  situations.  This 
alteration  of  mean  vectors  produces  an  effect  in  what  is 
known  as  the  nonccntrality  parameter  X.  This  parameter  is 
used  as  a measure  of  the  distance  between  group  means  in 
the  population. 

Two  different  nonccntrality'  structures  were  used. 
One  is  considered  a concentrated  structure  (Olson,  1973) 
while  the  other  is  considered  a diffuse  structure.  The  con- 
centrated structure  was  created  by  making  the  mean  vector 
for  group  one  (for,  kc, ...).  kc  is  a certain  constant  computed 
by  using  k,  the  number  of  groups,  and  a constant  c (sec 
Appendix)  defined  by  Olson  (1973)  to  produce  a certain 
value  for  the  nonccntrality  parameter.  The  mean  vectors 
for  all  other  groups  were  kept  at  zero  as  generated  by  the 
random  number  generator.  This  means  that  the  mean  vec- 
tor for  group  one  differed  significantly  from  the  other  groups 
on  all  variables  involved. 

The  diffuse  structure  was  produced  by  setting  all 
elements  of  each  group  mean  vector  to  zero,  except  the  ;th 
clement  of  the  /th  group  mean  vector  which  is  set  to  kc  for 
all  values  of  / from  l to  the  mi n(pf\  where  k is  the  number 
of  groups  and  p is  the  number  of  variables  measured  on 
each  group.  Again  c is  a constant  defined  by  Olson  (1973) 
(sec  Appendix)  to  produce  a certain  value  for  the 
nonccntrality  parameter.  This  means  that  group  one  dif- 
fered from  other  groups  on  variable  one,  group  two  differed 
from  other  groups  on  variable  two,  etc. 
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For  both  nonccntrality  structures  the  constant,  c, 
was  computed  to  produce  a noncentrality  parameter  large 
enough  to  give  power  levels  of  approximately  ,8  for  T.  Table 
3,  which  shows  the  power  values  obtained,  shows  power  for 
this  statistic  to  range  from  approximately  .7  to  .9.  If  a larger 
noncentrality  parameter  were  used  in  an  attempt  to  get  the 
power  of  Kto  .8  the  power  of  T would  reach  1 . This  ceiling 
effect  would  make  the  comparisons  wanted  impossible. 

To  investigate  power,  critical  values  for  the  situa- 
tions involved  could  not  be  obtained  from  existing  tables 
(Pillai,  1960;  Timm,  1975).  A method  was  needed  to  arrive 
at  the  necessary  critical  value  for  each  of  the  above  men- 
tioned situations.  In  the  investigation  of  type  I error  the 
canned  software  package,  IMSL,  was  used  to  find  the  sig- 
nificance of  a test  statistic.  Thus  the  actual  critical  value 
associated  with  an  alpha  of  .05  was  not  known. 

The  method  used  involved  arriving  at  a Monte  Carlo 
critical  value  derived  by  generating  50,000  data  sets  where  no 
difference  on  the  mean  vectors  existed.  For  each  of  the  50,000 
data  sets,  V and  T were  computed.  For  each  of  these  statistics 
the  minimum  of  all  those  statistics  where  a rejection  of  the 
null  hypothesis  occurred  (that  is,  when  a type  I error  occurred) 
was  taken  as  the  critical  value  associated  with  each  situation. 
This  critical  value  was  then  used  to  compute  power  for  the 
two  different  noncentrality  structures  used.  The  power  ob- 
tained using  this  Monte  Carlo  critical  value  was  then  com- 
pared to  power  obtained  by  using  the  F approximation. 

Results 

Type  l error 

In  the  two-variable,  six-group  situation  the  results 
were  similar  to  those  found  by  Elliott  and  Barcikowski  (1993) 
for  the  other  situations.  The  type  I error  rates  for  Roy’s 
largest  root  and  those  based  on  the  F approximations  for 
Wilks’  lambda  as  well  as  the  chi-square  approximation  for 
T met  Bradley’s  stringent  criterion  in  all  cases.  However, 
the  F approximations  found  for  T and  for  V failed  to  meet 
Bradley’s  stringent  criterion  when  the  subject-variable  ra- 
tio was  at  5 to  1 or  less.  The  effect  on  type  I error  rates 
caused  concern  for  the  power  of  these  statistics  computed 
using  the  F approximations  when  the  assumptions  of 
MANOVA  were  met. 

In  Figures  1 and  2 the  actual  levels  of  significance 
(labeled  probability)  and  the  treatment  sample  sizes  (labeled 
group  size)  are  plotted  based  on  the  F approximations  for 
Roy’s  root,  Pillai’s  trace,  Wilks’  lambda,  the  Hotclling- 
Lawlcy  trace  and  Tiku’s  chi-square  approximation  for  the 
Hotelling-Lawlcy  trace.  Graphs  for  only  the  three  variables, 
three  groups  and  six  variables,  six  groups  situations  are 
shown.  The  other  situations  produced  similar  results.  In 
these  figures  Bradley’s  stringent  criterion  for  robustness  is 
identified  by  lines  at  probability  values  of  .045  and  .055, 
and  the  nominal  level  of  significance  is  identified  by  a line 
at  .05.  The  F approximations  for  Roy’s  root,  Wilks’  lambda, 
and  Tiku’s  chi-square  approximation  for  7’yieldcd  estimates 
of  the  nominal  levels  of  significance  that  fall  between  the 
lines  at  .045  and  .055. 

However,  all  six  situations  considered  also  con- 


tained treatment  sample  sizes  where  estimates  of  the  nomi- 
nal levels  of  significance  provided  by  the  F approximations 
of  V are  below  .045  and  the  estimates  of  the  nominal  levels 
of  significance  for  T are  above  .055,  i.e.,  fail  to  meet  Bradley’s 
stringent  criterion. 

Table  2 gives  the  conditions  and  treatment  sample 
sizes  prior  to  the  sample  size  where  the  estimates  of  the 
nominal  levels  of  significance  based  on  the  F for  T and  for 
V meet  Bradley’s  stringent  criterion. 


For  example,  given  two  dependent  variables  and 
three  treatment  levels,  the  F approximation  for  the  T yielded 
an  estimate  of  the  level  of  significance  that  fails  to  meet 
Bradley’s  criterion  when  the  sample  size  is  6 or  less  (see 
Table  2),  but  would  yield  an  estimate  of  significance  that 
does  meet  Bradley’s  criterion  when  the  sample  size  is  7 or 
larger.  For  the  same  conditions  the  F approximation  for  V 
yielded  an  estimate  of  the  level  of  significance  that  fails  to 
meet  Bradley’s  criterion  when  the  sample  size  is  10  or  less 
(see  Table  2),  but  would  yield  an  estimate  of  significance 
that  does  meet  Bradley’s  criterion  when  the  sample  size  is 
1 1 or  larger. 

Power 

Table  3 summarizes  the  results  of  the  study  in  terms 
of  power.  With  the  conservatism  of  V,  its  power  was  ex- 
pected to  suffer  The  F approximation  for  the  T previously 
produced  an  inflated  type  I error  rate  in  situations  where 
the  subject-variable  ratio  was  small.  However,  the  power  of 
V and  T computed  using  the  usual  F approximation  was 
very  near  that  computed  using  a critical  value  found  through 
Monte  Carlo  methods.  The  effect  of  the  small  subject  to 
variable  ratio  on  type  I error  did  not  affect  power  as  shown 
by  Table  3 (next  page). 

Conclusions 

The  results  indicate  that  in  multivariate  analysis 
of  variance  studies  (using  MANOVA),  with  relatively  small 
numbers  of  subjects  of  around  1 5 per  treatment  level  or  less, 
the  current  probability  values  reported  by  SAS  (GLM)  and 
SPSS  (MANOVA)  arc  conservative  for  the  F approxima- 
tions based  on  V and  liberal  for  the  F approximations  based 
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Table  3 

Comparison  of  Power  Using  Monte  Carlo  Critical 
Value  and  F Approximation 


Concentrated  Nonccntralitv  Diffuse  Nonccntralitv 


k_ 

F ApDrox. 
0 T V 

Monte  Carlo 
T V 

F Annrox. 
T V 

Monte  Carlo 
T V 

3 

2 .9166 

.7287 

.9166 

.7277 

.9350 

.9313 

.9349 

.9310 

3 

3 .8096 

.4246 

.8093 

.4246 

.8524 

.8983 

.8524 

.8983 

3 

6 .7037 

.3597 

.7036 

.3595 

.7430 

.8243 

.7429 

.8242 

6 

2 .9966 

.9656 

.9966 

.9655 

.9978 

.9983 

.9978 

.9983 

6 

3 .9865 

.7702 

.9865 

.7701 

.9935 

.9957 

.9935 

.9957 

6 

6.9041 

.3583 

.9041 

.3583 

.9437 

.9676 

.9437 

.9676 

Note.  T is  the  Hotelling-Lawley  trace  and  V is  Pillai ’s 
trace,  k is  the  number  of  groups,  p is  the  number  of 
variables. 


on  T.  The  BMDP4  V program  does  not  report  V and  reports 
accurate  probability  values  for  T using  a chi-square  distri- 
bution rather  than  a F.  All  of  these  programs  report  accu- 
rate values  for  the  F approximation  based  on  Wilks’  lambda 
and  for  probabilities  associated  with  Roy’s  largest  root  (ex- 
cept SPSS  which  does  not  report  a probability  value  for  Roy’s 
largest  root).  Unfortunately,  many  MANOVA  studies  with 
small  subject-variable  ratios  exist  in  the  social  science  lit- 
erature (Olson,  1976).  It  would  be  unfortunate  if  the  au- 
thors of  these  studies  used  Kand  found  no  significant  result 
when  one  existed  or  used  T and  found  a significant  result 
when  none  existed.  In  the  case  of  power,  there  seems  to  be 
no  problem  with  the  use  of  the  F approximations. 

It  is  important  to  emphasis  that  the  results  con- 
tained in  this  study  apply  to  studies  where  the  subjcct-to- 
variable  ratio  is  small.  In  general,  the  authors  agree  with 
results  reported  by  Olson  (1973)  that  Pillai’s  trace  is  a ro- 
bust statistic  with  suitable  power  for  most  situations  apply- 
ing MANOVA. 

APPENDIX 

To  produce  nonccntrality  for  the  investigation  of 
power,  the  constant,  c,  was  computed  using  the  formulas 
below  which  came  from  Olson  (1973).  In  the  following 
definitions  of  c the  following  variables  are  used: 

X - the  noncentrality  parameter 
n - group  size 
k - number  of  groups 
p - number  of  dependent  variables 

For  the  concentrated  structure,  c is  found  by  using: 
C = V{/./(pn-k-(k-l))} 

For  the  diffuse  structure  c is  found  by  using- 
C = ^T/((p-l)nk:  + (k-p)-nk)} 


In  both  formulas  the  value  for  X is  found  by  a trial 

artd  error  method  which  simply  alters  X until  the  power  de- 
sired is  obtained  in  doing  the  computer  simulations. 
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The  Identification  of  a Model  of  Teaching  Behaviors 
of  Preschool  Student  Teachers 

Zulkifli  A.  Manaf.  University  of  Malaya 
Abstract 

Ratings  from  a previous  study  of  nine  teaching  behaviors  of  112  preschool  student  teachers  were  analyzed  using 
exploratory  factor  analysis.  These  teaching  behaxdors  were  observed  and  recorded  using  the  Observer  Rating  Scales. 
Preschool  student  teachers  in  the  study  exhibited  these  teaching  behaviors  in  their  teaching  performance  in  a labo- 
ratory school  setting.  Four  latent  variables  were  found  to  underlie  these  nine  teaching  behaviors:  facilitating , 
interpersonal \ interactive , and  flexibility.  These  latent  variables  were  positively  correlated  with  each  other.  A path 
diagram  of  the  student  teaching  behavior  model  showing  the  relationships  among  the  teaching  behaviors  and  latent 
variables  is  presented. 


X eaching  behaviors  have  been  studied  by  research- 
ers for  over  three  decades  (Gage,  1963;  Roscnshine,  1971; 
Rosenshinc  & Furst,  1971;  Wright  & Nuthali,  1970:  Tobin, 
1986;  Ouzts,  1986;  Brophy,  1987a;  Brophy,  1987b;  Joyce, 
1988;  Walbcrg,  1988;  Porter  & Brophy,  1988;  Myers,  1990; 
Cangelosi,  1986).  Manning  (1990)  reviewed  Five  syntheses 
of  research  on  teaching,  highlighted  findings  relevant  to 
middle-level  teaching,  and  presented  implications  for  teacher 
education.  The  topics  discussed  included  preservicc  Field 
experiences,  adolescent  student  motivation,  effective  use  of 
class  time,  effective  teaching  behaviors  and  student  achieve- 
ment. The  research  literature  abounds  in  studies  of  teach- 
ing behaviors  that  make  a difference  in  student  achieve- 
ment (Clark,  Steele,  Nicmec  & Walbcrg,  1992;  Brophy  & 
Good,  1986;  Harris,  Rosenthal  & Snodgrass,  1986;  Lcder, 
1987).  Gage  and  Ncedcls  (1989)  focused  on  the  relation 
between  teaching  processes  and  student  learning  outcomes. 

A sampling  of  the  studies  on  teaching  behaviors 
reviewed  is  presented  in  Table  1.  The  variables  used  in  the 
instrument  utilized  in  the  current  study  reflect  promising 
variables  used  in  previous  studies  of  teaching  behaviors. 

This  study  identifies  a conceptual  model  to  explain 
the  relationship  between  observed  teaching  behaviors  and 
latent  variables  that  appear  to  govern  them.  The  following 
nine  variables  were  used  to  rate  teaching  behaviors: 

Warmth  — the  extent  to  which  the  teacher  is  relaxed,  com- 
fortable. and  maintains  positive  interpersonal  relationships 
with  children. 

Enthusiasm  — the  interest  level  shown  by  the  teacher  and 
children  during  nursery'  school  activities. 

Clarity  - the  clarity'  of  instructions  and  expectations  con- 
veyed to  the  children. 

Variety  — the  extent  to  which  the  teacher  uses  a variety  of 
materials  and  activities. 

Individualization  — the  degree  to  which  the  teacher  pro- 
vides children  w'ith  different  levels  of  work  suited  to  their 
particular  needs,  interests,  and  abilities;  and  the  amount  of 
individual  assistance  provided. 

Feedback  — the  extent  of  information  given  to  the  children 
about  the  adequacy,  acceptability,  completeness,  and  cor- 
rectness of  their  responses. 


Table  1 

Teaching  behaviors  studies  reviewed 

Researcher 

Variables  used 

Rosenshine  & Furst  (1971) 

Enthusiasm,  Variability 
(Variety),  Clarity,  Businesslike 
Behaviors,  (On-task),  Warmth 

Bushetal.  (1977) 

Teacher  Clarity'  (Clarity) 

Hines  etal.  (1985) 

Teacher  Clarity 

Cruickshank  &Kcnncdy  ( 1986)  Teacher  Clarity 

Hamilton  (1988) 

Teacher  Clarity' 

Clark  etal.  (1992) 

Teacher  Questioning 
Interaction,  Feedback 

Harris  ct  al.  (1986);  Ouzls  (1986); 

Brophy  & Good  (1 974); 
Cooper  (1979);  Dunkin  & 
Biddle  (1974);  Elijah  (1980) 

Teacher  Expectation 
(Cognitive  Demand) 

Brigham  et  al.  (1992) 

Enthusiasm 

Lcdcr(1987) 

Feedback 

(Teacher  Interaction) 

Marshall  & Weinstein  ( 1986) 

Teacher  Interaction 

Brophy  (1986b) 

Teachers  Managerial 
Behavior 

Teacher  Instructional 
Behavior 

Waxman  & Walbcrg  ( 1 99 1 ) 

Teaching  Styles 

McCutchcon  ct  al.  ( 1 99 1 ) 

Personality  Variables 
Stixlent  Teaching  Behaviors 

Cognitive  Demand-  the  level  of  intellectual  activity'  that  the 
teacher  expects  of  the  children. 

Frcedom-the  degree  to  which  the  teacher  provides  class- 
room arrangements  which  facilitate  independence  and  in- 
dividual freedom  for  children. 

On-Task  /Jr//v/7y— the  amount  of  child  activity  that  is  di- 
rected toward  the  accomplishment  of  instructional  objec- 
tives (Briggs,  1982) 
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There  is  sufficient  research  evidence  to  suggest  that 
teacher ‘warmth5  (Rosenshine  & Furst,  1971),  ‘enthusiasm1 
(Rosenshine  & Furst,  1971;  Brigham,  Scruggs  & 
Mastropieri,  1992),  ‘variety1  or  ‘variability1  (Rosenshine 
& Furst,  1971),  and  ‘clarity1  (Bush,  Kennedy  & 
Cruickshank,  1977;  Hines,  Cruickshank  & Kennedy,  1985; 
Cruickshank,  1985;  Cruickshank  & Kennedy,  1986; 
Hamilton,  1988)  promote  student  achievement.  Other  re- 
searchers (Brown  & McIntyre,  1993;  Stones,  1992)  have 
identified  other  variables  that  are  similar  in  content  to  those 
used  in  this  study 

The  variable  ‘cognitive  demand1  used  in  this  study 
is  related  to  teacher  expectations.  Having  appropriate  ex- 
pectations is  an  important  teaching  behavior  to  learn  (Harris 
et  al.,  1986).  Ouzts  (1986)  pointed  out  that  the  effects  of 
teacher  expectations  on  student  achievement  can  be  boffi 
positive  and  negative.  Teacher  expectations  can  become 
self-fulfilling  prophecies  over  time  (Brophy  & Good,  1986; 
Cooper,  1979;  Dunkin  & Biddle,  1974).  Elijah  (1980) 
stated  that  teacher  expectation  is  an  influential  factor  in 
determining  how  much  is  learned  in  the  primary  school 
classroom. 

Teacher  enthusiasm  and  its  effect  on  student 
achievement  has  been  studied  by  Rosenshine  and  Furst 
(1971)  and  Brigham,  Scruggs  and  Mastropieri  (1992). 
Csikszentmihalyi  and  McCormick  (1986)  stress  the  in- 
fluence of  teachers  in  shaping  the  behavior  patterns  of 
youth.  Enthusiastic  and  dedicated  teachers  are  able  to 
transform  the  classroom  into  a place  where  good  values, 
habits  and  patterns  of  behavior  are  passed  on  to  the  future 
generation. 

‘Feedback1  is  related  to  teacher  interaction  with 
students.  Leder  (1987)  examined  the  differences  in  the  in- 
teraction patterns  between  teachers  with  high  and  low 
achieving  students.  It  was  found  that  teachers  tend  to  inter- 
act most  frequently  with  high  achieving  and  high  expect- 
ancy students,  particularly  at  grade  six  level.  However,  they 
consistently  spent  more  time  waiting  to  interact  with  low 
achieving  and  low  expectancy  students.  In  another  study, 
Marshall  and  Weinstein  (1986)  found  positive 
teacher-student  interactions  in  low-differential  treatment 
classrooms  compared  with  high-differential  treatment  class- 
rooms for  grade  five.  Interestingly,  they  found  the  opposite 
pattern  for  grade  seven. 

Another  teacher  behavior  that  has  been  extensively 
researched  is  teacher  clarity.  It  has  been  found  that  clear 
teachers  affect  student  achievement  positively  (Bush, 
Kennedy,  & Cruickshank,  1977;  Hines,  Cruickshank  & 
Kennedy,  1985;  Cruickshank  & Kennedy,  1986).  However, 
a recent  study  conducted  by  Hamilton  (1988)  did  not  sup- 
port this  finding. 

There  are  numerous  reasons  for  identifying  and 
measuring  teaching  behavior  variables.  These  variables  are 
relevant  in  teacher  education  research,  for  feedback  on  teach- 
ing effectiveness,  and  in  teacher  employment  decisions 
(Tobin,  1986). 

Teaching  behaviors  impact  student  achievement. 


Brophy  (1987b)  presents  an  excellent  review  of  teacher  ef- 
fects research  and  teacher  quality.  He  indicated  that  teach- 
ers1 managerial  and  instructional  behaviors  were  instrumen- 
tal in  bringing  about  student  achievement  gains.  Waxman 
(1988)  cites  research  to  identify  effective  lesson  introduc- 
tion and  pre-instructional  activities  (commonly  known  as 
set  induction)  and  their  effects  on  student  achievement. 
Teachers  who  present  “advance  organizers11  in  the  class  help 
students  to  focus  their  attention  and  thus  increase  retention 
and  learning. 

In  a more  recent  review,  Waxman  and  Walberg 
(1991)  point  out  that  among  effective  teaching  behaviors 
are  teaching  styles  which  are  individualistic.  It  is  therefore 
difficult  to  specify  a set  of  ideal  teaching  behaviors.  Begin- 
ning teachers  can  be  taught  many  different  approaches  to 
effective  teaching,  but  it  must  be  noted  that  these  approaches 
can  interact  with  a teacher’s  personality  and  natural  ability. 
Teaching  style  is  a composite  of  personality  and  philoso- 
phy, evidenced  by  the  teacher’s  behavior  and  attitude,  what 
the  teacher  emphasizes,  and  how  he  or  she  reacts  to  differ- 
ent situations.  The  relationship  between  teacher  personal- 
ity variables  and  student  teaching  behavior  has  also  been 
studied  by  McCutcheon  and  his  colleagues  (1991).  Accord- 
ing to  Waxman  and  Walberg  (1991),  teaching  style  involves 
choosing  among  teaching  alternatives,  and  the  choices  teach- 
ers make  denote  their  perceived  images  and  roles.  Through 
their  style,  teachers  integrate  the  theories  they  believe  in 
with  the  practices  they  adopt  in  the  classroom.  Just  like  life 
styles,  teaching  styles  can  make  a difference  in  teaching 
behaviors,  and  between  success  and  failure  in  the  classroom. 

Brown  and  McIntyre  (1993)  present  an  extensive 
perspective  on  good  teaching  from  the  students1  and  teach- 
ers1 points  of  view.  The  perceptions  of  students  and  teach- 
ers regarding  good  teaching  behaviors  are  complementary 
and  relate  in  content  to  the  variables  proposed  in  the  cur- 
rent investigation.  Students  perceive  good  teaching  to  in- 
clude: 1)  creating  a relaxed  and  enjoyable  atmosphere  in 
the  classroom,  i.c.,  ‘warmth1;  2)  retaining  control  in  the 
classroom,  i.e.,  ‘on-task  activity1;  3)  presenting  tasks  in 
ways  that  interest  and  motivate  pupils,  i.e.,  ‘variety1;  4)  pro- 
viding for  pupil  understanding  or  helping  with  difficulties, 
i.e.,  ‘individualization1;  5)  making  clear  what  pupils  are  to 
do  and  achieve,  i.e.,  ‘clarity1;  6)  judging  expectations,  i.e., 
‘cognitive  demand’;  7)  encouraging  pupils  to  raise  their  ex- 
pectations of  themselves,  i.e.,  ‘cognitive  demand1;  (8)  de- 
veloping personal,  mature  relationships  with  pupils,  i.c., 
‘warmth1;  and  (9)  utilizing  personal  talents,  including  ‘en- 
thusiasm1 for  the  subject  matter  or  related  areas. 

This  study  develops  a basic  conceptual  model  of 
teaching  behaviors  using  the  path  analysis  conventions  pre- 
sented in  Jorcskog  and  Sorbom  (1989).  Experimental  stud- 
ies and  synthesis  of  research  on  teaching  during  recent  years 
have  provided  specific  and  descriptive  information  on  ef- 
fective teaching  behaviors  and  models  of  teaching  (Man- 
ning, 1990;  Joyce,  1988;  Joyce,  Weil  & Showers,  1992; 
Brophy,  1987b;  Walberg,  1988;  Porter  & Brophy,  1988; 
Brophy  & Good,  1986). 


The  research  questions  for  this  investigation  are: 

1.  How  many  latent  variables  govern  the  relationships 
among  the  nine  measures  of  teaching  behaviors? 

2.  Are  these  latent  variables  correlated  with  each  other? 

3 . How  are  the  nine  teaching  behaviors  associated  with  each 
other  when  subjected  to  exploratory  factor  analysis? 

4.  Are  these  teaching  behaviors  good  indicators  of  the  latent 
variables? 

Method  and  Results 

This  study  utilized  data  from  a study  concerning 
the  teaching  behaviors  of  preschool  teachers  by  Briggs  and 
Dickerscheid  (1985).  Ratings  (6-point  scale)  of  teaching 
behaviors  of  preschool  student  teachers  using  the  Observer 
Rating  Scales  (McDaniel,  Lohmann,  & Little,  1974)  were 
conducted  concurrently  at  two  higher  education  institutions 
located  in  the  Midwest. 

One  hundred  and  twelve  student  teachers  were 
observed  for  approximately  30  minutes.  Their  teaching 
behaviors  were  rated  by  trained  observers  in  classroom  set- 
tings. All  the  observations  occurred  during  “free  play”  situ- 
ations in  which  several  classroom  activities  were  occurring 
simultaneously  and  children  were  moving  freely  from  one 
activity  to  another  according  to  their  interests. 

These  observations  were  done  in  the  respective 
laboratory  school  located  within  each  institution.  The  Ob- 
server Rating  Scales  (ORS)  have  a “relatively  high  degree 
of  construct  validity”  and  the  inter-rater  reliability  was  esti- 
mated to  be  .83  (Briggs  & Dickerscheid,  1985,  p.  59). 

An  exploratory  factor  analysis  technique  was  used 
to  analyze  the  correlation  matrix  based  on  the  ratings  of 
112  student  teachers  on  the  nine  teaching  behaviors.  The 
upper  triangular  matrix  without  the  diagonal  is  presented 
in  Table  2. 


Table  2 

Correlation  Matrix  of  the  Nine  Measured  Variables 
(N=112) 

Variable  2 3 

4 

5 

6 

7 

8 

9 

I Warmth  .72*  .53* 

.33* 

.45* 

.39* 

.26* 

.40* 

.42* 

2 Enthusiasm  .59* 

.41* 

.41* 

.50* 

.28* 

.30* 

.39* 

3 Clarity 

.55* 

.66* 

.55* 

.51* 

.37* 

.48* 

4 Variety 

.49* 

.36* 

.37* 

.51* 

.45* 

5 Individualization 

.26* 

.42* 

.33* 

.39* 

6 Feedback 

.11 

.20 

.39* 

7 Cognitive  demand 

.40* 

.20 

8 Freedom 

.30* 

9 On-task  activity 

*p<.001 

The  unweighted  least  squares  (ULS)  method  of 
factor  extraction  was  employed  because  of  the  occurrence 
of  Heywood  cases  in  the  data.  Hcywood  cases  are  referred 
to  instances  where  some  communality  values  in  the  correla- 


tion matrix  are  greater  than  one.  Four  factors  were  re- 
tained, based  on  the  scree  plot  of  eigenvalues.  These  first 
four  eigenvalues  appear  to  be  the  only  ones  significant 
enough  to  be  retained.  The  fifth  and  subsequent  eigenval- 
ues are  too  small  to  be  of  importance.  The  Scree  plot  is 
presented  in  Figure  1 (next  page). 

The  four  factors  w'ere  obliquely  rotated  to  achieve 
simple  structure  and  enhance  interpretation.  The  rotated 
factor  pattern  (F*  Matrix)  is  presented  in  Table  3.  Note  the 
teaching  behaviors  (correlations  shown  in  bold  type)  asso- 
ciated with  each  factor  or  latent  variable. 


Table  3 

Obliquely  Rotated  (Promax)  Factor 
Matrix  (F*)  from  ULS  Solution 


Factor  l Factor2  Factor3  Factor4 
(Interactive)  (Facilitating)  (Interpersonal)  (Flexible) 

Elating  Scale 


: 

Feedback 

0.8806 

-0.2471 

0.0164 

0.0119 

On-task  activity 

0.4156 

-0.0377 

0.0775 

0.2522 

Clarity 

0.4092 

0.7948 

-0.0743 

-0.0154 

Cognitive  demand 

0.3851 

0.7858 

0.0076 

0.1761 

Individualization 

0.0032 

0.5768 

0.0711 

0.1212 

Warmth 

-0.0109 

0.0056 

1.0000 

-0.0044 

Enthusiasm 

0.3803 

0.0204 

0.4770 

0.0034 

Variety 

0.2921 

0.0505 

-0.1679 

0.7184 

Freedom 

-0.1799 

0.1883 

0.1565 

0.5508 

Note:  Numbers  in  bold  type  indicate  significant 
correlations 


Table  4 shows  that  the  latent  variables  are  corre- 
lated with  each  other,  with  correlations  varying  from  .43  to 
.72.  This  implies  that  persons  who  are  high  on  Factor  1 are 
also  likely  to  be  high  on  the  other  three  factors. 


Table  4 

Phi  Matrix  - Inter-Factor  Correlations 


Factor  1 

Factor2 

Factor3 

Factor4 

1.0000 

. 

0.7224 

1.0000 

0.5892 

0.5382 

0.4787 

0.5841 

0.4319 

1.0000 

Factor  1=  Interactive  Behavior 
Factor2=  Facilitating  Behavior 
Factor  Inter-Personal  Behavior 
Factor4=  Flexible  Behavior 
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Eigenvalues 


Figure  1 . SCREE  PLOT  OF  EIGENVALUES 

Criteria  for  Factor  Selection 


Number  of  Factors 


nUrpersonal\  / Ftexfcfe 

Behavior 


Feedback  On-Task  Cterty  CognWve  Demand  IndMdualzatton  Warmth  Enthusiasm  Variety  Freedom 
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Discussion  and  Interpretation 

The  nine  teaching  behaviors  used  in  this  investi- 
gation (feedback,  on-task  activity,  clarity,  cognitive  demand, 
individualization,  warmth,  enthusiasm,  variety  and  freedom) 
are  similar  in  nature  to  those  used  in  other  studies  of  teach- 
ing behaviors  (Rosenshine  & Furst,  1971;  Harris  et  al.,  1986; 
Leder,  1987;  Brigham  et  al.,  1992;  Bush,  Kennedy  & 
Cruickshank,  1977;  Cruickshank,  1985;  Cruickshank  & 
Kennedy,  1986;  Hines,  Cruickshank  & Kennedy,  1985; 
Ouzts,  1986;  Leder,  1987;  McCutcheon  et  al,,  1991;  Brown 
& McIntyre,  1993)  even  though  only  some  or  only  subsets 
of  the  variables  were  used  in  each  of  these  studies.  At  times, 
these  variables  are  referred  to  by  different  names  in  other 
studies.  For  example,  ‘on-  task  activity’  is  referred  to  as 
‘business-like  behavior’,  and  ‘variety’  is  called  ‘vari- 
ability’ (Rosenshine  & Furst,  1971). 

The  four  latent  factors  identified  by  this  study  un- 
derlie the  nine  measures  of  teaching  behaviors.  The  latent 
factors,  labeled  ‘facilitating’,  ‘interactive’,  ‘flexible’,  and 
‘interpersonal’,  are  sometimes  referred  to  as  constructs  in 
psychological  measurement.  They  represent  the  cluster  of 
measured  teaching  behaviors  that  loaded  on  them.  The  four 
latent  factors  identify  the  important  components  of  the  model 
of  teaching  behaviors  among  preschool  student  teachers. 
The  nine  measured  teaching  behaviors  represent  significant 
measures  of  the  basic  model.  Their  importance  is  reflected 
by  their  high  loadings  that  vary  from  0.41  to  1.00  on  the 
respective  latent  factors. 

Using  the  conventions  developed  by  Joreskog  and 
Sorbom  (1989),  the  teaching  behaviors  are  measured  vari- 
ables (MVs)  which  are  represented  by  rectangular  or  square 
boxes,  while  the  factors  are  latent  variables  (LVs)  repre- 
sented by  circles.  Error  variances  are  shown  in  the  diagram 
but  they  are  not  enclosed.  The  influence  of  LVs  on  MVs  is 
represented  by  straight  one-way  arrows  from  the  LVs  to  the 
respective  MVs.  The  number  on  each  arrow  is  the  Lambda 
(X)  value  representing  this  influence.  Inter-factor  correla- 
tions are  denoted  by  curved  two-way  arrows  between  the 
factors,  and  their  value  is  usually  denoted  by  Phi  (<(>).  Error 
variances,  denoted  by  delta  (d),  are  shown  in  the  model  dia- 
gram with  arrows  pointing  toward  the  respective  MVs.  The 
model  of  teaching  behaviors  of  preschool  student  teachers 
developed  by  this  study  is  presented  in  Figure  2. 

Four  latent  dimensions  were  identified  and  given 
labels  based  upon  the  common  features  of  the  teaching  be- 
haviors that  loaded  highly  on  them.  These  latent  dimen- 
sions of  teaching  behaviors  are  described  as  follows: 

• Interactive  behavior  as  measured  by  Feedback  (0.88) 
and  On-task  activity  (0.42). 

• ‘Facilitating  beha\’ior  ’--  as  measured  by  Clarity  (0.79), 
Cognitive  demand  (0.79),  and  Individualization  (0.58). 

• ‘Interpersonal  behavior  as  measured  by  Warmth  ( 1 .00) 
and  Enthusiasm  (0.48). 

• ‘ Flexible  behavior '--  as  measured  by  Variety  (0.72)  and 
Freedom  (0.55). 


These  four  latent  dimensions  accounted  for  78  per- 
cent of  the  common  variance  shared  by  the  nine  measures. 
The  latent  dimensions  are  also  intcrcorrelated,  illustrating 
the  complexity  of  teaching  behavior.  The  nine  measures  of 
teaching  behaviors  were  all  found  to  be  important  elements 
of  this  four-factor  model.  This  model  provides  a new  ap- 
proach to  explaining  the  complex  relationships  among  the 
teaching  behaviors.  It  should  help  generate  new  hypoth- 
eses and  research. 

The  four  latent  variables  identified  in  this  study 
are  similar  in  meaning  to  ‘teaching  style’  and  ‘teacher  per- 
sonality’ mentioned  earlier  (Waxman  & Walberg,  1991). 
‘Interpersonal  behavior’,  as  measured  by  ‘warmth’  and  ‘en- 
thusiasm’ , is  related  to  teacher  personality.  It  is  something 
inherent  and  personal  to  the  teacher.  It  is  what  the  teacher 
brings  into  the  classroom,  namely,  the  teacher  “presage” 
variables  referred  to  in  an  earlier  model  of  research  in  class- 
room teaching  (Dunkin  & Biddle,  1974).  ‘Interactive  be- 
havior’, ‘facilitating  behavior’  and  ‘flexible  behavior’  de- 
note teaching  behaviors  that  constitute  ‘teaching  style’  or 
what  teachers  exhibit  during  the  “process”  of  teaching. 
Teaching  style  varies  from  teacher  to  teacher.  As  presented 
in  Butler  (1984),  teaching  styles  can  be  categorized  as  con- 
crete random,  concrete  sequential,  abstract  ^udom,  and 
abstract  sequential.  However,  most  teachers  do  not  exhibit 
‘pure’  teaching  style.  They  tend  to  incorporate  features  from 
other  categories,  which  contributes  to  the  complexity  of 
teaching  behaviors. 

One  may  conclude  that  preschool  student  teachers 
exhibit  four  major  categories  of  teaching  behaviors  in  class- 
room performance.  Their  teaching  behaviors  were  demon- 
strated in  various  ways  and  in  varying  amounts,  but  these 
variations  might  be  explained  by  the  four  latent  factors  iden- 
tified in  this  study. 

Since  the  latent  variables  are  correlated  with  each 
other,  one  cannot  partition  the  variance  of  their  performance 
in  terms  of  the  latent  variables  identified  in  this  investiga- 
tion. In  other  words,  persons  who  manifest  the  characteris- 
tic governed  by  one  factor  tend  to  also  possess  characteris- 
tics that  are  attributed  to  the  other  three  factors.  Specifi- 
cally, in  this  study,  student  teachers  who  exhibit  a high  de- 
gree of  ‘facilitating’  behavior  also  tend  to  be  highly  en- 
dowed in  ‘interpersonal’,  ‘interactive’,  and  ‘flexible’  be- 
haviors. 

Given  that  each  factor  is  related  to  a unique  set 
of  teaching  behaviors  (See  Table  3),  a teacher  rated  high 
on  a certain  behavior  is  also  likely  to  be  rated  high  on 
related  behaviors  within  the  factor.  Thus,  teachers  rated 
high  on  Feedback  arc  likely  to  be  rated  high  on  ‘On-task 
activity’.  The  teaching  behaviors  associated  with  each 
factor  appear  to  be  logically  related.  Most  of  them  ap- 
pear to  be  good  indicators  of  the  latent  factor  or  con- 
struct. High  loading  values  in  the  upper  .40s  and  above 
are  indicative  of  this  quality.  This  is  also  shown  by  their 
final  communality  values  (h2),  which  vary  from  .36  to 
1.00  with  a median  value  of  .60. 
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Limitations  and  Recommendations 
This  model  needs  to  be  confirmed  with  another  data 
set.  Factor  stability  is  a major  concern  in  factor  analytic  stud- 
ies. When  confirmed,  this  model  would  provide  a theoretical 
framewoik  for  future  research  on  teacher  behaviors. 

Since  the  sample  used  in  the  study  came  from  a popu- 
lation of  preschool  student  teachers  from  two  institutions  of 
higher  learning  located  in  the  midwest,  these  findings  cannot 
at  this  time  be  generalized  beyond  this  population. 

Future  studies  should  employ  confirmatory  factor 
analysis  using  new  data.  Confirmatory  factor  analysis  could 
be  done  to  yield  measures  of  goodness  of  fit  of  the  hypoth- 
esized model  to  the  data,  if  this  model  is  plausible,  then  a 
parsimonious  diagram  could  be  drawn  to  represent  the  re- 
lationships among  the  variables  in  the  population.  Thus, 
this  model  could  provide  a theoretical  framework  for  future 
research,  especially  for  validation  studies  of  measures  of 
teaching  behaviors. 

Other  research  questions  that  need  to  be  addressed 
in  future  studies  should  include  the  following: 

1.  Do  preschool  teachers  who  possess  these  teaching  be- 
haviors contribute  to  significant  learning  among 
pre-schoolers? 

2.  Are  these  teaching  behaviors  exhibited  by  preschool  teach- 
ers in  other  cultures?  (Cross-cultural  validation  studies)? 

3.  How  different  are  the  teaching  behaviors  of  teachers  in 
different  grade  levels  (Elementary  vs.  Secondary)? 

4.  Are  teaching  behaviors  the  same  among  teachers  of  dif- 
ferent subject  areas? 
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ERRATUM 

In  Volume  7,  Number  2 (Spring,  1994),  a formula  was  misprinted  in  Benjamin  D.  Wright's  article,  "Composition 
Analysis,"  on  page  29.  In  the  abstract  and  in  the  second  column  of  text,  the  formula  G(x+y)  = G(y)  should  read 
G(x+y)  = G(x)  + G(y). 

We  apologize  for  the  error. 
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Making  the  Grade:  Perspectives  on  a 
Teacher's  Assessment  Practices 

Carol  Briscoe,  University  of  West  Florida 

Abstract 

This  study  analyzes  one  teacher's  attempts  at  innovative  assessment  practices,  and  the  struggle  to 
implement  a meaningful  science  curriculum  in  the  face  of  traditional  assessment  expectations. 
The  interpretations  presented  focus  on  three  dilemmas  influencing  teaching  practice:  maintaining 
individual  student  accountability  when  cooperative  group  learning  is  prescribed  by  the  curricu- 
lum, evaluating  lower-ability  students  on  fixed  standards  while  maintaining  a low  failure  rate,  and 
providing  summative  grades  with  limited  data  on  student  knowledge.  The  study  highlights  the  need 
to  provide  support  for  teachers  attempting  innovative  change  in  teaching  pr  active,  and  especially, 
for  restructuring  current  beliefs  about  the  purposes  of  assessment  and  grading. 


Science  educators  have  long  recognized  the  im- 
portant role  that  assessment  plays  in  driving  the  implemen- 
tation of  curriculum  in  individual  classrooms  (Tucker,  1991 , 
Kulm  & Stuessy,  1991).  Teachers,  held  accountable  for  what 
students  learn,  tend  toward  planning  and  implementing  a 
curriculum  in  accord  with  external  tests  (Tobin  &Gallagher, 
1987). 

Although  a goal  of  science  teaching  is  that  stu- 
dents learn  science  concepts  in  a meaningful  way  and  apply 
them  to  solving  real  problems,  teachers’  assessment  prac- 
tices, perceived  as  consistent  with  external  assessments,  are 
often  counterproductive  to  this  goal  (Haertel,  1991;  Lovitts 
& Champagne,  1990).  Traditional  testing  procedures  (i.  e., 
multiple  choice,  matching,  Fill  in  the  blank)  which  empha- 
size facts  and  algorithms  rather  than  higher  level  thinking 
or  problem-solving  encourage  students  to  seek  facts  and  rules 
to  memorize  rather  than  to  engage  in  learning  with  under- 
standing, Getting  the  highest  grade  on  the  test  supplants 
meaningful  learning  as  a goal  (Briscoe  & Ulerick-LaMaster, 
1991). 

How  teachers  perceive  assessment  interacting  with 
other  components  of  the  curriculum  influences  whether 
classroom  assessment  becomes  a tool  which  encourages  stu- 
dents to  learn  meaningfully  or  produces  less  desirable  out- 
comes. Teachers  do  what  makes  sense  within  a given  con- 
text (Tobin,  Kahlc,  & Fraser,  1990).  Beliefs  and  images 
constructed  as  a result  of  experiences  (Clandinin,  1986; 
Gallagher,  1989;  Tobin,  1991;  Tobin  and  Gallagher,  1987) 
as  well  as  beliefs  associated  with  personal  epistemologies 
(Briscoe,  Lorsbach,  Tobin  & La  master,  1990)  influence  how 
teachers  view  their  roles  as  assessors  and  the  place  of  as- 
sessment in  the  curriculum.  Additionally,  beliefs  affecting 
assessment  practices  may  be  grounded  in  perceived  customs 
and  taboos  related  to  the  school  culture  (Britzman,  1986, 
1 989).  Implementing  assessment  practices  to  be  consistent 
with  teaching  science  for  meaningful  learning  may,  not  only, 
require  teachers  to  learn  how  to  assess  students  in  ways  al- 
ternative to  those  exemplified  by  external  testing  programs, 
but  to  reconstruct  the  cognitive  frameworks  by  which  they 
make  sense  of  assessment  and  their  roles  as  assessors  as 
well. 


Theoretical  Framework 

The  knowledge  teachers  use  to  make  sense  of  their 
practices  is  constructed  from  their  experiences.  As  teach- 
ers implement  various  classroom  practices,  the  knowledge 
they  have  about  teaching  and  learning  is  tested,  and  the 
meanings  of  various  practices  are  negotiated  through  the 
interactions  of  the  teacher  and  others  in  the  school  commu- 
nity (von  Glasersfeld,  1989).  Knowledge  frameworks  sup- 
ported by  practices  which  are  observed  to  work,  make  sense 
and  are  maintained,  while  those  which  suggest  practices 
which  do  not  work  in  the  classroom  and  culture  are  either 
modified  or  rejected.  Each  day,  new  experiences  are  inter- 
preted in  light  of  the  set  of  referents  already  constructed 
and  knowledge  about  teaching  and  learning  is  reconstructed 

There  are  also  aspects  of  teachers’  knowledge 
which  are  socially  negotiated  and  represent  how  schooling 
is  interpreted  and  understood  by  parents,  students,  school 
administrators  and  other  members  of  the  school  culture 
(Feiman-Nemser  & Floden,  1986).  As  teachers  make  sense 
of  their  assessment  practices,  these  culturally  shared,  nor- 
mative knowledge  constructions  serve  as  referents  to  which 
they  refer  other  beliefs  and  their  actions. 

Explicating  the  nature  of  referents  teachers  use  to 
make  sense  of  their  assessment  practices  is  a step  toward 
developing  an  understanding  of  how  they  perceive  their  roles 
as  assessors  and  how  those  perceptions  impact  on  curricu- 
lum. Accordingly,  this  study,  was  designed  to  identify  cog- 
nitive constructs  that  one  teacher  used  to  make  sense  of 
assessment.  The  study  provides  an  in  depth  look  at  the 
complexity  of  one  teacher’s  thinking  about  classroom  as- 
sessment processes  as  he  struggled  to  implement  changes 
in  his  practices. 

Purpose 

The  purpose  of  this  study  was  to  investigate  the 
assessment  practices  of  one  high  school  teacher  and  the 
forces  which  influenced  what  was  assessed  and  the  way  as- 
sessment was  implemented.  The  extent  to  which  the  teacher 
changed  his  assessment  practices  in  conjunction  with 
changes  in  other  classroom  practices  is  described.  The  in- 


14 


Kfid-H’eitern  Educational  Researcher 


Volume  7.  Number  4 • Fall  1994 


terprctations  presented  here  focus  on  three  dilemmas  iden- 
tified by  the  teacher  as  influencing  his  practices. 

• Implementing  a curriculum  in  which  cooperative  group 
activity  was  fundamental  to  learning,  yet  maintaining 
individual  accountability  for  each  students1  participa- 
tion and  performance. 

• Evaluating  lower  ability  chemistry  students  on  the  basis 
of  fixed  performance  standards,  yet  maintaining  a low 
failure  rate. 

• Evaluating  student  performance  and  assigning 
summative  grades,  yet  having  limited  data  upon  which 
to  make  a judgment  of  the  extent  of  students’  knowl- 
edge. 

Method 

The  teacher,  Brad,  is  a member  of  the  faculty  of 
Southern  High,  a public  high  school  in  an  urban  area.  The 
school  draws  approximately  60%  of  its  student  body  from 
low  socio-economic  urban  minority  neighborhoods.  Brad 
is  the  chcmistiy  teacher,  one  of  ten  teachers  in  the  science 
department  which  he  chairs.  Brad  began  his  teaching  ca- 
reer at  Southern  High  shortly  after  earning  a masters  de- 
gree in  science  education.  He  has  taught  there  for  16  years 
and  is  highly  regarded  by  his  peers  and  administrators.  He 
received  recognition  from  the  school  system  four  years  prior 
to  the  initiation  of  this  study  when  was  honored  as  teacher 
of  the  year.  When  Brad  was  consulted  about  participating 
in  the  project,  he  readily  agreed,  viewing  the  proposed  re- 
search as  an  opportunity  to  examine  the  relationship  be- 
tween the  way  he  was  teaching  and  what  his  students  were 
learning. 

Data  collection  took  place  over  the  course  of  a 
school  year.  Transcripts  from  biweekly  meetings  with  Brad 
and  field  notes  from  weekly  classroom  observations  served 
as  primary  data  sources.  Discussions  during  the  meetings 
were  informal  and  open-ended  providing  Brad  an  opportu- 
nity to  express  his  thoughts  and  concerns  in  a number  of 
areas  relating  to  his  experiences.  Frequent  topics  were  what 
was  happening  in  the  classroom,  why  Brad  chose  certain 
lessons  and  assessments,  what  worked  and  what  did  not 
work.  We  also  discussed  theoretical  issues  relating  to  epis- 
temology, particularly  the  implications  of  positivism  and 
constructivism  for  teaching  practices  and  assessment.  As 
the  study  progressed,  transcripts  served  as  foci  for  reflec- 
tion and  Brad  added  his  comments  upon  reading  them. 
Additional  sources  of  data  included  copies  of  formal  assess- 
ments and  students’  responses  to  questions  as  well  as  Brad’s 
evaluations  of  them. 

Data  were  analyzed  on  a continuous  basis  through- 
out the  study.  Research  questions  generated  from  review  of 
the  data  sources  served  as  a basis  for  discussions  with  Brad 
as  the  study  progressed.  As  patterns  representing  Brad’s 
thoughts  and  actions  were  constructed  from  the  data,  asser- 
tions were  generated  (Erickson,  1986).  All  assertions  and 
the  supporting  and  refuting  data  were  discussed  with  Brad. 
Attempts  were  made  to  refute  the  assertions  and  to  explain 
all  data  that  did  not  support  assertions.  Through  this  itera- 
tive process  assertions  were  generated  that  represent  what 


Brad  and  the  researcher  agree  best  encompass  the  data  and 
arc  credible  explanations  of  Brad’s  assessment  beliefs  and 
practices. 

Interpretations 

At  the  beginning  of  the  school  year  Brad  was  com- 
mitted to  implementing  two  major  changes  in  his  practices. 
First,  because  he  believed  that  science  learning  might  best 
occur  if  he  provided  students  with  opportunities  to  work 
through  problems  themselves  interacting  with  one  another 
in  small  groups,  he  decided  to  emphasize  cooperative  learn- 
ing activities  in  his  classes.  Brad  wanted  to  increase  stu- 
dent involvement  in  laboratory  activities  and  assist  them  to 
understand  science  as  a process  of  consensus  building. 

Brad’s  second  major  change  was  focused  on  as- 
sessment. Historically,  multiple  choice  tests  had  been  the 
mainstay  of  his  evaluation  procedures.  However,  as  he  re- 
flected on  his  own  learning  he  began  to  make  sense  of  an 
idea  that  students’  understandings  of  science  knowledge 
and  the  manner  in  which  they  applied  it  in  new  contexts 
might  vaiy  from  student  to  student.  He  wanted  to  develop 
assessment  activities  which  would  take  into  account  the 
varied  nature  of  understandings  students  might  construct 
as  an  outcome  of  problem-centered  science  activities.  He 
decided  to  use  alternative  assessment  tasks  which  included 
both  open-ended  problem-solving  questions  and  closed  ques- 
tions and  permitted  students  to  use  their  notes  from  group 
investigations  as  resources  while  taking  the  tests.  Tests 
were  marked  on  the  basis  of  whether  students  were  able  to 
demonstrate  use  of  these  resources  in  reasoning  about  new 
situations  as  well  as  recall  information  presented  in  class. 

For  Brad,  making  the  commitment  to  change  his 
practices  was  not  difficult.  He  perceived  that  implement- 
ing a traditional  chemistry  curriculum  and  using  multiple- 
choice  examinations  to  evaluate  students  had  not  resulted 
in  meaningful  learning  for  his  students.  The  failure  rate  on 
his  tests  had  always  been  high  and  few  students  seemed  to 
remember  chcmistiy  concepts  from  one  day  to  the  next. 

On  the  basis  of  his  experiences  as  a teacher  at 
Southern  High,  Brad  constructed  assessment  as  having  sev- 
eral functions  within  his  implemented  curriculum;  how- 
ever, a major  concern  for  him  was  integrating  various  as- 
sessment activities  into  a systematic  process  he  could  use  to 
determine  students’  grades.  Brad’s  assessment  beliefs  cen- 
tered around  two  interactive  areas  of  practice:  a)  day-to- 
day  assessment  that  he  believed  served  to  motivate  students 
to  engage  in  learning  activities  and  demonstrate  account- 
ability for  their  work  and  learning;  and  b)  formal  assess- 
ment that  measured  academic  performance.  Interpretations 
of  the  meanings  Brad  had  constructed  for  each  of  these  ar- 
eas and  how  he  constructed  their  relationship  to  the  grad- 
ing process  follows. 

Assertion  I:  Implementation  of  a daily  assessment  routine 
which  rewarded  motivation  and  task  completion  undermined 
Brad's  attempt  to  successfully  implement  cooperative  learn- 
ing in  his  classroom. 

Early  in  the  study  Brad  noted  that  students  in  his 
classes  rarely  demonstrated  a desire  to  learn  chemistry.  He 
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explained  that  students  tended  to  enroll  in  chemistry  be- 
cause it  was  a college  preparatory  course;  however,  his  ob- 
servations of  their  work  and  attitudes  tended  to  indicate  to 
him  that  they  were  not  motivated  to  succeed  academically. 
As  he  described  it: 

(12/15/89)  If  you  ask  everybody  in  my  class  you 
might  find  a couple  in  each  class  that  say  they 
weren  t sure  about  going  to  college.  Most  of  them 
say  they  plan  to , but  in  terms  of  doing  the  things 
that  they  really  would  need  to  do  to  go  to  college, 
it’s  not  there  for  a lot  of  them.  ...  I mean,  I 
honestly  believe  about  75%  of  these  kids  would 
be  perfectly  happy  if  they  came  in  class  every  day 
and  just  sat  around  and  talked  and  left.  Just  did 
that  every  day  - had  kind  of  a free  period. 

Development  of  a daily  assessment  routine  that 
held  students  accountable  for  class  participation  through  a 
grading  process  was  Brad’s  approach  to  solving  the  prob- 
lem. Making  a passing  grade  was  important  to  these  stu- 
dents; however,  they  were  not  motivated  to  participate  in 
learning  activities  unless  grade  rewards  were  associated  with 
them.  As  Brad  noted: 

(5/15/90)  One  of  the  first  questions  they  'll  often 
ask  is,  “ do  1 get  credit  for  it?  If  not,  then  1 don  It 
want  to  do  it.  ” That 's  been  my  experience  any - 
way. 

Accordingly  the  meanings  for  assessment  that 
Brad  had  constructed  were  connected  with  how  he  made 
sense  of  his  role  in  motivating  students.  He  operationalized 
his  understanding  of  assessment  in  this  context  by  asking 
students  to  complete  written  assignments  as  part  of  each 
class  activity.  Students  were  then  assigned  a mark  for  their 
products  at  the  end  of  class.  These  marks  served  as  a record 
of  each  students’  accountability  for  completing  the  tasks. 
As  Brad  described  his  thinking: 

(9/11/89)  1 do  want  to  make  them  accountable  for 
doing  the  things  that  l ask  them  to  do  because 
there  is  a tendency  for  some  of  them  sometimes  to 
just  sit  back  and  let  things  slide  and  this  way  1 
have  some  accountability. 

Brad’s  emphasis  on  accountability  for  work 
completion  as  part  of  his  assessment  plan  is  representative 
of  a view  of  schooling  that  Marshall  (1988,  1990)  has 
termed,  school-as-workplace.  Consistent  with  this  meta- 
phor the  school  is  depicted  as  a factoiy-typc  workplace  where 
productivity  is  the  primary  goal  and  grades  are  payment 
for  work  well  done.  Within  the  work  setting,  students/work- 
ers are  supervised  by  teachers/managers  who  have  the  re- 
sponsibility to  hold  each  individual  accountable  for  task 
completion.  As  Brad  reflected  on  the  difficulty  he  experi- 
enced in  revising  his  assessment  practices,  he  also  referred 
to  the  workplace  metaphor: 

( 7/4/89 ) It's  the  history  of  my  education.  UTiat 
1 ’ m comfortable  with  - which  has  all  been  school 
is  work.  We  give  you  this,  you  give  us  this  back . 

. . I've  always  kind  of  fallen  back  on  the  work 
mode  as  what  1 do. 

Generally,  when  classroom  settings  arc  perceived 


as  workplace-like  settings,  emphasis  is  not  necessarily  placed 
on  learning.  Yet,  for  Brad,  students’  participation  in  activi- 
ties and  completion  of  tasks  was  more  than  a means  to  main- 
tain accountability  and  ensure  on-task  orientation  in  the 
classroom.  He  believed  that  students  doing  the  work  was 
integrally  related  to  students’  learning  as  is  exemplified  in 
his  statement: 

(6/22/89)  If  they  work  on  the  problems  and  go 
through  the  process  of figuring  the  stuff  out,  hav- 
ing to  do  it  themselves  they  would  learn  better. 

(9/7/89)  1 hope  that  by  working  on  it  they  'll  learn 
something  from  it,  as  opposed  to  not  doing  it  and 
not  getting  anything  from  it. 

Brad  also  considered  providing  feedback  to  stu- 
dents an  important  contributor  to  their  learning  from  the 
work  they  did.  Therefore,  he  reviewed  each  paper  and  made 
comments  or  put  question  marks  next  to  statements  which 
he  viewed  as  representing  insufficient  or  questionable  knowl- 
edge claims.  However,  Brad  was  frustrated  by  the  fact  that 
students  seemed  interested  primarily  in  obtaining  credit  for 
the  work,  rather  than  learning  from  his  feedback.  He  stated: 
(9/11/89)  I wasn  t satisfied  with  what  the  people 
in  groups  did  with  them  when  they  got  them  back. 

One  or  two  would  work  on  it  and  the  others  didn  t 
5/2/90)  It 's  frustrating.  1 want  them  to  approach 
it  as  a learning  experience,  but  they're  so  condi- 
tioned to  just  getting  stuff  done  to  get  a grade. 

As  the  weeks  progressed  and  the  quantity  of  paper 
work  increased,  Brad  decided  to  provide  feedback  to  stu- 
dents on  a single  product  from  the  group;  however,  he  con- 
tinued to  collect  and  keep  records  of  individual  papers  com- 
pleted by  each  group  member.  Although  Brad  was  always 
overwhelmed  by  his  perceived  responsibility  to  check  each 
student’s  work  on  a daily  basis,  it  made  sense  to  him  to  do 
so  in  order  to  hold  each  student  accountable  for  classwork 
and  presumed  learning. 

A second  area  of  concern  for  Brad  as  he  worked 
with  students  whom  he  perceived  as  unmotivated  or  unable 
to  achieve  academically  was  that  most  of  the  students  in  his 
classes  did  not  show  substantial  achievement  on  formal 
chemistry  assessments.  He  perceived  his  implementation 
of  a daily  assessment  routine  as  much  a solution  to  this  di- 
lemma, as  it  was  to  dilemmas  associated  with  accountability. 

Brad  believed  that  a ftmetion  of  schools  was  to  help 
people  to  succeed,  to  achieve  their  goals.  He  perceived  one 
way  to  help  students  do  that  was  to  provide  contingencies 
for  them  that  would  allow  success  without  their  having  to 
demonstrate  specific  academic  achievement.  Brad  believed 
that  for  students  who  were  academically  unmotivated,  pro- 
viding a reward  for  effort  was  important.  He  described  how 
he  made  sense  of  daily  assessment  as  a means  to  assist  these 
students  the  following  way: 

(5/15/90)  There  are  two  areas  [of  assessment]  one 
is  to  figure  out  what  they  know  about  the  stuff 
we  ‘ve  been  working  on.  And  secondly , some  ele- 
ment of  measuring  how  much  effort  they  put  into 
it.  How  hard  they  work  . ...  / do  it  more  because 
of  what  1 think  is  fair  to  kids . ...  If  1 did  [assess 
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MWERA  Annual  Meeting  has  Something  for  Everyone 


From  training  workshops  and  invited  speakers,  to 
symposia  and  paper  presentations,  MWERA  is  offering  a 
complete  program  with  the  best  that  educational  research 
has  to  offer  at  this  year’s  annual  meeting  to  be  held  in  the 
Bismarck  Hotel,  Chicago,  on  October  12-15,  1994. 

Invited  Speakers  to  Address  MWERA  ’94 

The  following  are  some  of  the  leaders  in  education 
that  will  be  making  presentations  individually  or  as  mem- 
bers of  panels: 

Kenneth  Addison , Northeastern  Illinois  University 
Lyn  Como , Teachers  College,  Columbia  University 
Donald  Cunningham , Indiana  University 
Gene  Glass , Arizona  State  University 
Sandra  Hollingsworth , Michigan  State  University 
Anita  WoolfoUc-Hoy , Ohio  State  University 
Thomas  Lasley , University  of  Dayton 
Joel  Levin , University  of  Wisconsin-Madison 
Paul  Pintrich , University  of  Michigan 
Richard  Pugh , Indiana  University 
Dale  Schunk,  Purdue  University 
Barbara  Shade , University  of  Wisconsin-Plarkside 
Robert  Slavin , Johns  Hopkins  University 
(< co-sponsored  by  Allyn  & Bacon) 

Training  Workshops  Offered 

You  will  not  only  be  learning  what's  new , but  also 
how.  Economical  workshops  offered  by  experts  will  be  avail- 
able on  the  following  topics: 

Creating  Learning  Opportunities  in  Supervision 
Focus  Group  Interviews  as  a Needs  Assessment  Tool 
Standards  and  Practices  in  Qualitative  Research 
Many-Facet  Rasch  Measurement 
An  Introduction  to  Correspondence  Analysis 
Authentic  Assessment  in  the  Preparation  of  Educators 
An  Introduction  to  Hierarchical  Linear  Modeling 
Getting  and  Keeping  an  Academic  Position 

Teacher  Workshops  on  Multicultural  Education  Offered 
Eugene  Garcia  is  Director  of  the  Office  of  Bilin- 
gual Education  and  Minority  Languages  Affairs  of  the  U.S. 
Department  of  Education  in  Washington,  DC,  and  has 
authored  over  100  journal  articles  and  book  chapters.  He  is 
presenting  two  workshops  for  Chicago  area  teachers  in  con- 
junction with  MWERA.  Teachers  will  choose  between 
Thursday  evening  and  Friday  morning  sessions  that  will 
include  an  opportunity  to  attend  selected  MWERA  sessions. 
Interested  teachers  should  contact  Greg  Marchant  at  (317) 
285-8505  (Office)  or  (317)  841-3456  (Home);  or  Sharon 
McNeely  (312)  794-2788  for  registration  materials. 

For  MWERA  94  registration  information  contact: 

Greg  Marchant,  MWERA  V.P.  & Program  Chair 
Department  of  Educational  Psychology 
Teachers  College,  Ball  State  University 
Muncie,  IN  47306  (317)  285-8505 
E-mail;  OOgjmarchant0bsuvc.bsu.cdu 


Euguent  Garcia , U.S.  Department  of  Education 


Selected  Sessions  (from  over  100  sessions  offered) 

Motivation  Issues  in  Education 

Issues  in  Validity 

Teacher  Attitudes  and  Beliefs 

The  Future  of  Electronic  Publications 

Full  Inclusion  of  Exceptional  Students: Three  Perspectives 

Context  Considerations  in  Teacher  Education 

Statistical  Modeling 

Meet  the  Editors  (with  seven  journal  editors) 

Research  on  Cultural  and  Multicultural  Contexts 
Testing  Issues 

Challenges  to  School  Administrators 
Success  for  All 

Multicultural  Issues  in  Research  & Teacher  Education 
Teaching  Educational  Psychology  (panel  session) 
Impediments  in  the  Teaching  of  Research  Design  & 

Statistics 

The  Natural  History  of  Mental  Mapping 

Deans’  Rjrum  on  Research  Faculty  Roles  & Rewards 

What  If  You  Could  Only  Attend  One  Conference  This 
Year? 

The  answer  might  very  well  be  this  year’s  annual 
meeting  of  the  Mid- Western  Educational  Research  Associa- 
tion. With  the  affordable  rates  at  the  Bismarck  Hotel  in 
convenient  downtown  Chicago,  and  with  the  reasonable 
conference  registration  fee  that  includes  Friday’s  lunch, 
MWERA  is  a bargain.  With  high  standards  for  proposals, 
leaders  in  education  as  invited  speakers,  and  timely  work- 
shops, this  year’s  annual  meeting  will  be  of  the  highest  pro- 
fessional quality.  Add  to  this  the  friendly  collegial  atmo- 
sphere that  MWERA  is  known  for,  and  you  have  a great  and 
enjoyable  professional  meeting. 

TEACH  ‘EM  TAPES  to  be  available  this  year...  a first 
for  MWERA  t 

MWERA  has  arranged  with  Teach’ein  Tapes,  an  orga- 
nization which  has  been  recording  major  sessions  at  several  na- 
tional professional  conferences  and  making  them  available  at  rea- 
sonable rates  to  members,  to  provide  a similar  service  for  our 
annual  meeting  this  year.  Selected  major  sessions  will  be  tape- 
recorded  and  the  tapes  sold  at  reasonable  prices.  Order  blanks 
will  be  available  at  the  MWERA  conference  registration  desk. 


MWERA  Election  Results 

1994  Ballot 

The  Secretary  of  the  Association,  Ralph  O.  Mueller,  who  also  serves  as  Chair  of  the  Tellers 
Committee,  reported  the  results  of  the  Spring  ’94  membership  mail  ballot  as  follows: 


Vice-President: 


Sharon  McNeely,  Northeastern  Illinois  University 


Secretary: 


E.  Jane  Williams,  Columbus  Public  Schools 


Council: 


Jay  Adler,  Cary  School  District 
Donald  Castle,  Ashland  University 
Richard  Lipka,  Pittsburg  State  University 
Joy  McCullough,  Trinity  Western  University 
Lori  Nebelsick-Gullett,  University  of  Nebraska 
Gregory  Schraw,  University  of  Nebraska 
M.  Cecil  Smith,  Northern  Illinois  University 


The  above  winners  assume  office  as  of  October  1994.  VP  McNeely  is  responsible  for  the  1995 
MWERA  Conference.  She  will  move  on  to  President-Elect,  President,  and  Past-President  in 
subsequent  years.  The  other  officers  serve  two-year  terms. 

We  welcome  these  dedicated  members  of  MWERA  and  congratulate  them  on  their  success  as 
elected  officers. 


Historical  Study  of  MWERA  Underway 

The  Board  of  Directors  of  the  Mid- Western  Educational  Research  Association  (MWERA)  has  ac- 
cepted a proposal  to  conduct  a historical  study  of  MWERA.  The  proposal  was  authored  by  Theresa  Strand 
and  MWERA  Executive  Officer  Charles  C.  Anderson.  The  authors,  both  charter  members  of  MWERA  which 
became  operational  in  1977-78,  were  colleagues  for  many  years  at  the  Midwest  Field  Office  of  Educational 
Testing  Service  (ETS)  in  Evanston,  Illinois.  Their  extensive  professional  backgrounds  provide  a broad  base 
of  experience  from  which  the  study  will  be  conducted. 

The  purpose  of  the  study  is  to:  (1)  provide  a narrative  history  of  MWERA,  from  the  early  planning 
stages  to  the  present  within  the  broad  context  of  education  and  educational  research  events  and  issues;  (2) 
assemble  and  systematically  present  the  details  of  MWERA’s  history  from  a chronological  perspective;  and 
(3)  systematically  organize  and  assemble  the  association’s  archives. 

The  study  will  explore  various  facets  of  MWERA’s  stability  and  growth,  and  their  enabling  factors. 
Primary  and  secondary  data  sources  will  be  utilized,  including  available  documentation  and  a series  of  inter- 
views with  persons  who  played  leading  administrative  and/or  innovative  roles  in  MWERA’s  development. 

Specific  areas  of  interest  will  include  MWERA’s  mission  and  goals,  constitutional  development, 
administrative  structure  and  leadership,  association  policies  and  their  perceived  impact,  milestone  events, 
annual  meetings,  journals  and  other  publications,  continuing  eduction  workshops,  electronic  network,  liai- 
sons with  other  professional  associations,  and  long-range  planning. 


A Life  Membership  is  open  to  all  members 
of  MWERA,  currently  for  $180.  Members 
who  have  already  paid  their  1994  dues, 
will  receive  credit  for  amount  paid. 


Instituting 

Southern  Illinois  University 
The  Ohio  State  University 
University  ofNebraska-Lincoln 
Murray  State  University 
DeKalb  Schools 
Wichita  State  University 
Roosevelt  University 
Northern  Illinois  University 
Chicago  Medical  School 
Chicago  State  University 
Univ . of  Northern  Iowa 
Duquesne  University 
Ball  State  University 
Cleveland  State  University 
George  Washington  Univ. 
AWemo  College 


Dennis  W.Leitner 
Ayres  G.  D 'Costa 
Kenneth  A.  Kiewra 
Adria  Karle-Weiss 
Jack  K-  Barshinger 
OrphaKLDuell 
Richard  G Smith 
Corenna  G Cummings 
Linda  K Gunzburger 
Bobbie  M.  Anthony 
Bruce  G.  Rogers 
Susan  M Brookhart 
Gregory  J.  Marchant 
Mary  Ann  Flowers 
Ralph  O.  Mueller 
Marcia  L Mentkowski 


The  Mid-Western  Educational  Research 
Association  (MWERA)  is  a nonprofit  organi- 
zation of  professional  educational  researchers 
primarily  from  states  and  provinces  located  in 
the  midwestem  region  of  the  United  States 
and  Canada.  Membership  is  open  to  faculty, 
students,  and  administrators  from  any  univer- 
sity, college,  and  school.  College  students 
engaged  in  educational  research  are  especially 
encouraged  to  join  as  members.  Also  any 
educational  researchers  in  business  and  indus- 
try, as  well  as  those  in  national,  state,  local  and 
private  agencies  and  organizations  are  wel- 
come. The  Association  promotes  and  dissemi- 
nates educational  research  through  its  publi- 
cations, its  scholarship  program,  and  its  An- 
nual Meeting. 


MWERA  Membership  Application 


Name  (first,  middle  initial,  last) 


Mailing  address 


i puonc  ( ) 


Office  phone  ( ) 


Highest  degree: 


Area  of  specialization: 


The  1994  dues  of  SI  0 for  students  and  SI  8 for 
professional  membership  include  a subscrip- 
tion to  the  Mid-Western  Educational  Re- 
searcher and  a reduced  registration  fee  for  the 
Annual  Meeting.  Address  membership  corre- 
spondence to:  Charles  C.  Anderson,  Jr., 

MWERA  Executive  Officer,  1332  Southwind 
Drive,  Northbrook,  II,  60062;  phone  (708) 
564-4796. 


Institution/Employer: 


MWERA  division  preferences: 


E-mail  address: 


AERA  member? 


Division(s): 


If  applying  for  student  membership,  please  include  a copy  of  your  student  ID. 


Mid-Western  Educational  Research  Association  - Annual  Meeting  Registration  Form 


Please  print  or  type  all  information: 

Name 

Institution 

Complete  Mailing  Address 


Required  of  new  members  only : 

Highest  Degree 

MWERA  Division  Preference  _ 
Major  Area  of  Specialization 


E-mail Telephone:  Office  ( 1 

FAX Home  { I 


Is  this  your  first  MWERA  conference?  Yes No 

Annual  Meeting  Registration  Fee: 

Student  (pre-registration  $30,  on-site  $35),  Regular/Professional  (pre  $45,  on-site  $55),  Non-member  (pre  $50,  on-site  $60) 


(Teachers  attending  Garcia  workshop  should  contact  Greg  Marchant  or  Sharon  McNeely) $ 


Membership  Dues: 

1994  Membership  dues  (required  for  all  participants  and  for  registration  discount  rate) 

- Regular  $18,  Student  $10 $ 

1995  Membership  dues  - Regular  $18,  Student  $10 $ 

Life  Membership  - $ 1 80 $ 

Conference  Workshops  (see  following  pages  for  details,  workshop  fees  are  $10  unless  noted) 

W.12.A  W.l.C  W.l.D  W.l.E  W.l.F  W.315.A  W.315.B 

F.9.Lin/F.5.Lin  ($5  total  for  both  parts)  (T.7.Med  and  F.9 15.Med  contact  Marchant  or  McNeely)..  $ 

MWERA  Materials  (all  materials  must  be  picked  up  at  the  registration  desk  at  the  conference,  prices  do  not  include  postage): 
Indicate  quantities  below: 

MWERA  Membership  Directory  $5 $ 

MWERA  94  Annual  Meeting  Abstracts  ( paper  $4)  ( IBM  $3)  ( Mac) $ 

MWERA  mug  $3.50  each $ 

TOTAL $ 


* Registrants  requiring  special  dietary  needs  for  the  Friday  Luncheon  should  describe  those  needs  and  enclose  with  this  form. 
Please  make  your  check  payable  to:  Mid- Western  Educational  Research  Association  (MWERA) 

Mail  this  cl  .npleted  registration  form  and  your  check  by  October  ),  1994  to:  Charles  C.  Anderson,  MWERA  Executive  Officer 

1332  Southwind  Drive 
Northbrook,  Illinois  60062 


HOTEL  RESERVATION  FORM  - Mid- Western  Educational  Research  Association  Conference  Oct  12-15,  1994 

Please  reserve: Single  room(s):  $60  Double  room(s)-Double  bed:  $75  Double  room(s)  -Twin  beds:  $75 

Date  and  Time  Arriving: Date  and  Time  Departing: 

Name(s) Affiliation 

Address 

Hotel  Reservation  must  be  mailed  to  the  Bismarck  Hotel  (312)  236-0123  by  October  1,  1994: 

Bismarck  Hotel,  171  West  Randolph  Street,  Chicago,  LL  60601 


MWERA  94 


( Making  the  Grade  : continued  from  page  16) 

solely  on  achievement]  there  would  be  a tremen- 
dous failure  rate . 

By  choosing  to  let  the  completion  of  daily  assign- 
ments count  for  50%  of  the  students’  summative  grades, 
Brad  lowered  the  overall  failure  rate  in  his  classes.  Fur- 
thermore, establishing  grades  in  this  way  made  sense  to  him 
as  a means  of  preparing  students  for  future  life  roles  in  which  . 
they  might  only  be  rewarded  for  hard  work. 

Brad’s  use  of  daily  individual  assessment  within 
his  curriculum  influenced  students’  construction  of  the 
meaning  of  curriculum  changes  he  was  attempting.  His 
focus  on  task  completion  as  part  of  the  assessment  process 
was  interpreted  by  students  as  a message  that  learning  wasn’t 
as  important  as  getting  things  done.  Within  their  groups, 
students  were  frequently  observed  to  divide  the  work  among 
themselves,  each  student  answering  a set  number  of  ques- 
tions, then  giving  those  answers  to  the  group.  Less-able 
students  simply  copied  from  other,  more-able,  students  in 
the  group.  Although  Brad  believed  using  grades  as  a re^ 
ward  for  completion  of  tasks  would  hold  students  account- 
able for  learning,  students  were  adept  at  figuring  out  means 
of  completing  the  work  and  getting  a satisfactory  grade  with- 
out significantly  engaging  in  processes  of  science  inquiry. 
As  one  student  noted:  ‘Til  learn  just  as  much  by  turning  in 
a copied  paper  as  I will  with  a blank  paper,  and  I won’t  get 
a zero”  (Field  notes,  1/24/90) 

Brad  recognized  that  the  outcomes  of  cooperative 
learning,  as  he  envisioned  them,  were  not  the  outcomes  he 
was  experiencing;  however,  his  long  held  beliefs  regarding 
the  nature  of  his  students  and  the  perceived  need  to  provide 
external  motivation  for  them  to  engage  in  class  activities, 
constrained  him  from  making  changes  in  the  way  he  imple- 
mented daily  assessment  practices. 

The  fact  that  students  continued  to  work  as  individu- 
als, even  in  groups,  maintaining  traditional  behavior  patterns, 
rather  than  engaging  in  cooperative  activities,  only  confirmed 
Brad’s  beliefs  that  daily  assessment  was  necessary  in  order  for 
students  to  engage  in  learning  activities  at  all. 

Assertion  11:  Viewing  his  assessment  role  from  an  objectiv- 
ist  perspective , Brad  saw  little  value  in  alternative  assess- 
ments as  measures  of  students  ’ actual  knowledge. 

Brad  perceived  that  he  had  an  externally  mandated 
responsibility  to  numerically  rank  students  to  be  consistent 
with  the  grading  policies  set  by  his  district.  He  considered 
formal  assessment  the  most  important  indicator  of  students’ 
achievement  and  believed  that  testing  procedures  which 
would  report  numerical  scores  were  necessarily  required 
for  formal  assessment.  As  he  noted: 

(9/1 1/89)  There 's  a bit  of  apprehension  there  about 
not  having  that  test  score  there  to  show  somebody 
who  wants  to  come  and  see  how  their  kid 's  doing . 

. . an  apprehension  from  the  point  of  view  of  ex- 
ternal forces  looking  at  me  and  saying  that  you 
should  be  giving  tests  to  assess  performance  stan- 
dards. 

(5/15/90)  If  you  have  to  assign  a grade , you  have 
to  have  some  basis  for  it  so  that  means  you  have 
to  do  some  kind  of  a test . 


The  perceived  need  to  obtain  test  scores  in  order  to 
support  his  grade  decisions  undermined  Brad’s  sense  of  ef- 
fectiveness as  a teacher.  As  he  implemented  alternative  as- 
sessment procedure  that  allowed  students  the  freedom  to 
express  learning  in  their  own  way,  he  perceived  that  stu- 
dents did  not  provide  sufficient  information  for  him  to  judge 
exactly  what  they  did  know.  As  he  read  their  responses,  he 
gained  little  insight  as  to  whether  there  existed  a relation- 
ship between  the  curricular  changes  he  implemented  and 
student  learning  as  represented  in  his  statement: 

(5/15/90)  1 don  1 know  if  they  ’ re  learning  any  more 
or  less  or  the  same  or  whatever.  1 sometimes  think 
that  that's  too  complicated  for  us  to  even  know. 

You  just  hope  for  the  best.  Give  them  some  expe- 
riences and  hope  that  they  learn  as  much  as  they 
can  from  them. 

Brad’s  ability  to  evaluate  students’  learning  of 
chemistry  concepts  was  also  complicated  by  the  fact  that 
students’  responses  to  open  ended  questions  often  did  not 
reflect  a substantial  amount  of  factual  knowledge.  He  was 
concerned  that  grade  decisions  he  made  based  on  limited 
data  from  alternative  forms  of  assessment  might  be  unfair 
or  biased.  This  concern  was  associated  with  Brad’s  strong 
objectivist  epistemological  view  of  his  role  as  assessor. 

Within  Western  cultures,  objectivism  has  had  a 
major  impact  on  how  individuals  believe  they  experience, 
or  learn  and  think,  about  the  world,  particularly  in  the  sci- 
ences. Objectivism  views  the  mind  functioning  as  a mirror 
of  nature.  From  the  standpoint  of  objectivism,  knowledge 
is  viewed  as  truths  derived  from  direct  observation,  unin- 
fluenced by  human  perception  or  values  (Guba  & Lincoln, 
1989).  Learning  takes  place  as  individuals  directly  per- 
ceive reality. 

Consistent  with  objectivism,  one  can  view  the  func- 
tion of  assessment  to  be  to  determine  the  extent  to  which 
students’  mental  constructs  match  these  truths.  Further- 
more, the  role  of  the  assessor  is  viewed  as  comparable  to 
that  of  a scientist  interpreting  nature  in  that,  he  or  she  evalu- 
ates students’  knowledge  by  direct  observation,  uninfluenced 
by  human  perception  or  values. 

When  Brad  made  the  decision  to  allow  students  to 
use  their  own  ideas  and  language  to  express  themselves  on 
the  tests  he  gave,  he  found  that  in  order  to  make  marking 
decisions  he  had  to  interpret  students’  responses  and  make 
subjective  decisions  regarding  what  kinds  of  answers  to  ac- 
cept and  credit.  Since  data  forjudging  students’  competen- 
cies were  generally  limited  to  their  voluntary  responses  to 
questions,  Brad  found  that  he  was  unable  to  objectively  iden- 
tifying single  correct  answers.  Faced  with  the  dilemma  of 
evaluating  the  viability,  of  a student’s  knowledge  and  as- 
signing a mark  on  the  basis  of  incomplete  information,  he 
described  how  he  felt: 

(5/15/90)  As  you  ’ re  reading  through  these  things, 
you  go  crazy  trying  to  interpret  what  they  've  said 
in  terms  of  the  criterion  that  you  've  set  down.  A 
lot  of  times  the  ideas  are  there  but  they're  not 
clearly  expressed  and  you  have  to  take  a lot  of 
time  to  think  about  exactly  what  they ' re  trying  to 
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say  in  their  answer.  For  me  it  becomes  a very 
excruciating  thing  to  do  that. 

You  know  to  look  at  an  answer  that  somebody  wrote 
and  try  to  say  OK,  is  this  an  A,  B,  C,  or  whatever?  It’s 
tough.  . . Some  people  seem  to  be  able  to  do  that  quite  eas- 
ily, but  I have  a real  hard  time  with  that. 

Brad's  objectivist  perspective  is  also  evident  in  his 
concern  that  as  he  graded  students'  responses  he  might  not 
remain  consistent  from  the  first  paper  to  the  last  or  that  he 
might  allow  his  personal  feelings  about  a student  to  inter- 
fere with  his  evaluation.  He  stated: 

(1/25/90)  [The  potential  inconsistency  in  assign- 
ing marks ] concerns  ,.:e,  bull 'm  not  sure  how  vali d 
the  concern  is.  I ve  never  really  analyzed  to  see 
whether  that  s really  the  case  or  not.  I ’m  afraid 
that  may  be  happening , but  I 'm  not  sure.  1 don  t 
know  how  you  would  go  about  evaluating  to  see 
whether  or  not  I was  actually  biased  against  some 
kids  or  not,  grading  that  type  of  question. 

Because  he  believed  fair  and  unbiased  marking  de- 
cisions could  be  achieved  only  when  evaluation  was  ap- 
proached objectively  he  viewed  his  marking  decisions  as 
having  questionable  reliability. 

Brad  struggled  to  come  to  terms  with  this  dilemma. 
He  valued  alternative  assessment  procedures  as  a means  for 
students  to  demonstrate  success  in  learning  from  problem- 
centered  chemistry  activities.  At  the  same  time,  he  valued 
numerical  reports  of  achievement  because  he  perceived  them 
as  valued  by  the  culture  in  which  he  worked.  Brad's  solu- 
tion was  to  invent,  what  he  believed  to  be,  a criterion  based 
form  of  grading.  In  this  way  he  believed  he  reduced  the 
subjectivity  of  the  alternative  assessment  procedures  he  was 
using;  yet,  he  was  able  to  construct  a numerical  score  for 
each  student’s  test  responses. 

Brad's  rationalization  of  how  he  assigned  point  val- 
ues to  students’  responses  on  tests  is  represented  in  the  fol- 
lowing transcriptions: 

(10/2/89)  I tried  to  envision  in  my  mind  what  l 
would  think  of  as  a pretty  good  answer,  and  then 
relate  it  in  comparison  to  that  ...  If  they  had 
some  information  that  was  providing  some  answer 
to  the  question,  even  though  it  may  not  have  been 
correct,  some  were  all  messed  up  about  the  ac- 
tual concept,  that  wasn  l very  clear,  you  could  see 
that.  I didn  t feel  I should  give  them  a zero  for 
that  because  they  had  in  a sense  done  what  I asked 
them  to  do  in  terms  of  trying  to  solve  that  prob- 
lem to  the  best  of  their  ability. 

(12/15/89)  If  somebody  came  up  with  a response 
that  in  any  way,  had  some  reasonable  chemistry 
in  it  in  relation  to  what  the  question  was,  right  or 
wrong,  they  got  at  least  a one.  There  were  some 
that  I gave  zeroes  who  just  apparently  put  some- 
thing down  that  had  nothing  to  do  with  what  the 
question  was  about.  It  was  like  they  found  a line 
in  their  notes  and  copied  that  down  or  something 
like  that.  And  then  from  there  on  up  fours  were 


ones  who  came  pretty  close  to  a good  correct  ex- 
planation or  whose  explanation,  if  it  wasn  t right 
was  really  well  thought  out,  showed  some  good 
thinking. 

(1/25/90)  I sit  down  and  try  to  think  through  an 
answer  that  seems  reasonable  to  me.  And  then  I 
start  looking  at  some  of  theirs  and  read  over  a 
bunch  of  them  and  get  an  idea  of  what  they  have 
produced  and  then  try  to  come  to  some  balance 
between  the  two. 

Clearly,  Brad  faced  uncertainty  with  each  grading 
decision.  Tversky  and  Kahneman  ( 1 974, 1 982)  suggest  that 
individuals,  faced  with  making  decisions  in  situations  of 
uncertainty,  employ  heuristic  rules  upon  which  they  base 
their  judgments.  An  analysis  of  the  method  Brad  invented 
to  score  his  students’  assessments,  in  light  of  the  theory 
proposed  by  Kahneman  and  Tversky  (1982),  indicates  that 
the  heuristic  rules  suggested  by  their  research  might  also 
have  been  the  basis  of  Brad’s  marking  decisions.  Repre- 
sentativeness, or  judging  the  viability  of  the  outcome  based 
on  its  similarity  to  recognized  viable  outcomes  of  similar 
activities  is  seen  in  the  entry  from  10/2/89  . The  entry  on 
12/15/89  is  an  example  cf  Availability,  or  judging  the  vi- 
ability of  the  outcome  based  on  the  frequency  with  which 
similar  outcomes  have  been  observed  in  the  past.  Adjust- 
ment and  Anchoring,  or  making  estimations  of  viable  out- 
comes of  events  based  on  the  available  data  is  represented 
in  the  entry  on  1/25/90.  By  using  heuristic  rules  in  assign- 
ing marks  on  tests,  Brad  rationalized  that  his  grading  scheme 
was  less  subjective.  He  believed  that  using  these  rules  was 
a viable  solution  to  his  dilemma.  Furthermore,  through  the 
use  of  heuristic  rules  Brad  was  able  to  construct  numerical 
scores  which  he  could  use  to  support  his  grading  decisions 
as  he  conferred  with  students,  parents  and  others  in  the 
school  community.  . 

Assertion  III;  Conflicting  beliefs  about  assessment  and  his 
role  as  assessor  constrained  the  extent  to  which  Brad  was 
able  io  maintain  assessment  practices  that  matched  his  cur- 
riculum goals. 

Conflicts  among  Brad’s  long  held  beliefs  about  as- 
sessment constucted  in  social  and  cutural  contexts,  and  his 
newly  evolving  assessment  beliefs  are  evident  in  Brad’s  case. 
On  the  one  hand,  Brad  wanted  his  students  to  have  an  op- 
portunity to  demonstrate  their  knowledge  of  chemistry  con- 
cepts in  their  own  way  because  he  recognized  that  the  knowl- 
edge constructs  of  students  varied  on  the  basis  of  their  ex- 
periences. On  the  other  hand  he  was  concerned  that  the 
manner  in  which  he  held  his  students  accountable  for  their 
learning  in  chemistry  would  not  be  acceptable  to  others, 
including  his  principal  who  was  a former  chemistry  teacher 
and  described  by  Brad  as  “my  model  of  the  person  I wanted 
to  try  and  be  like”  (3/20/90).  He  believed  that  if  he  did  not 
hold  his  students  accountable  for  the  factual  content  of  a 
traditional  chemistry  curriculum,  the  quality  of  his  teach- 
ing would  be  questioned  also  by  other  chemistry  teachers  in 
the  district  and  by  parents.  The  following  comments  repre- 
sent the  conflict  Brad  was  experiencing: 
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(3/20/90)  I'm  so  really  tied  into  what  other 
people  think ...  as  opposed  to  the  specific  task 
here  of  trying  to  look  at  how  I teach.  It  s really 
hard  for  me  to  overcome  that  problem  of  know- 
ing that  there  are  going  to  be  people  who  look 
at  what  1 7w  doing,  and  disagree  with  it  and  say 
hey,  you  're  supposed  to  be  up  in  front  of  that 
classroom  putting  on  a big  show  here  for  these 
kids  and  your  not  doing  that.  Therefore,  I don  \ 
think  you  're  doing  a very  good  job.  And  I have 
to  be  able  to  say,  well,  you  know , I'm  sorry,  I 'm 
doing  what  I think  is  right.  But  I 'm  having  a 
hard  time  with  that. 

In  response  to  the  cognitive  conflict  he  was  expe- 
riencing, Brad  began  to  introduce  multiple-choice  ques- 
tions back  into  his  assessment  practices.  For  him  it  seemed 
reasonable  to  do  so  in  order  to  resolve  his  concern  that  he 
could  not  demonstrate  how  much  his  students  were  learn- 
ing on  the  basis  of  alternative  assessments  alone.  He  noted: 
(9/9/90)  I felt  that  I needed  some  sort  of  mea- 
sure of  what  they  learned.  Or  at  least  some  way 
of  doing  it.  Besides,  they  [alternative  forms  of 
assessment]  took  a long  time  to  grade. 

For  Brad,  multiple-choice  tests  met  the  need  he 
felt  for  administering  a “real  assessment”  which  would 
measure  what  students  knew  and  at  the  same  time  provide 
him  an  objective  and  rapid  means  for  reporting  scores.  Such 
tests  are  clearly  part  and  parcel  of  what  Wolf,  et,  al.  (1991) 
term  the  “testing  culture”  in  American  education.  Since 
their  development  in  the  early  1900’s,  standardized  mul- 
tiple-choice national  and  state  science  tests  have  been  in- 
creasingly used  to  evaluate  student  progress.  As  a member 
of  a test  development  team  for  chemistry  in  his  own  state, 
Brad  learned  that  only  multiple-choice  questions  were  con- 
sidered appropriate  for  that  test.  Furthermore,  multiple 
choice  unit  tests  were  provided  by  the  publisher  of  the  chem- 
istry text  Brad’s  district  had  adopted.  Finally,  when  stu- 
dents from  Brad’s  classes  participated  in  the  American 
Chemical  Society  “Chemathon”  competition,  they  took 
multiple-choice  tests  to  demonstrate  their  knowledge  of  facts 
and  principles.  Accordingly,  as  Brad  struggled  to  make 
sense  of  the  role  assessment  should  play  in  his  own  class- 
room he  tended  toward  accepting  multiple-choice  assess- 
ment as  a necessary  and  appropriate  solution  to  his  dilemma 
despite  his  earlier  expressed  beliefs  to  the  contrary. 

Discussion  and  Implications 

The  purpose  of  this  study  was  to  describe  one 
teacher’s  personal  struggle  to  change  his  assessment  prac- 
tices and  explicate  the  beliefs  that  influenced  the  assess- 
ment process.  Brad’s  case  is  particularly  salient  in  that, 
although  among  his  peers,  his  teaching  and  assessment  prac- 
tices were  viewed  as  exemplary  within  his  school  culture, 
he  had  observed  that  his  “exemplary  practice”  was  not  meet- 
ing students’  needs.  This  study,  which  relates  Brad’s  re- 
flections on  the  outcomes  of  his  personal  decision  to  change 
his  curriculum  and  correspondingly,  his  assessment  prac- 
tices, provides  an  individual  and  perhaps  unique  perspec- 


tive on  the  change  process.  However,  examination  of  cases 
such  as  Brad’s  provides  an  opportunity  for  us  to  develop  an 
understanding  of  some  factors  that  may  drive  teachers’  as- 
sessment decisions  and  a starting  point  for  understanding 
how  personal  and  cultural  constraints  may  impact  on  teach- 
ers’ responses  to  recent  demands  for  change  in  science  as- 
sessment practices. 

Represented  in  Brad’s  story  are  common  assess- 
ment concerns  expressed  by  teachers.  For  instance,  “Do 
my  assessment  practices  show  my  students  are  accountable 
for  learning  and  at  the  same  time  allow  them  to  be  success- 
ful within  the  parameters  of  schooling?”  “Are  my  assess- 
ment practices  reliable  and  my  grade  decisions  fair?”  “Can 
I ensure  that  my  students’  learning  is  represented  by  their 
grades?”  (Barron,  1991;  Haertel,  1991).  As  Brad  changed 
his  assessment  practices,  rejecting  commonly  accepted  test- 
ing procedures  in  favor  of  alternative  assessments,  these  con- 
cerns weighed  heavily  on  his  assessment  decision  making. 
Long  term  acceptance  of  single-choice-answer  tests  within 
the  culture  of  schooling  has  led  teachers,  like  Brad,  to  take 
for  granted  their  acceptability  as  reliable  instruments  for 
gathering  data  to  assign  grades.  In  rejecting  this  taken  for 
granted  position  on  testing,  Brad  found  himself  having  to 
think  more  carefully  about  what  he  was  doing  and  why  he 
was  doing  it  when  he  made  assessment  decisions.  Further- 
more, since  he  had  a great  deal  of  positive  public  opinion 
supporting  his  existing  practices,  he  was  risking  criticism 
from  others  in  the  school  community  as  he  moved  away 
from  practices  that  had  been  recognized  as  exemplary. 

Calls  for  reform  in  science  education  suggest  that 
assessment  must  be  matched  to  the  specific  curriculum  de- 
livered within  a given  classroom  setting  and  take  into  ac- 
count the  variability  of  students’  approaches  to  learning  and 
the  outcomes  that  each  student  may  achieve.  However,  the 
historical  use  of  objective  testing  from  grade  school  through 
college  to  rank  children  has  encouraged  stakeholders  in  the 
educational  process  to  value  the  kind  of  data  these  tests  pro- 
duce. The  development  and  use  of  imaginative  assessments 
that  probe  higher  level  thinking  and  science  problem  solv- 
ing skills  is,  therefore,  unlkely  to  be  a process  that  teachers 
can  easily  accomplish  on  their  own. 

According  to  Shavelson  (1983),  teachers  believe 
that  they  must  use  scientific  methods  to  determine  grades 
because  scientific  methods  produce  outcomes  that  are  reli- 
able or  “fair.”  Furthermore,  teachers  tend  to  believe  that 
their  grading  practices  produce  grades  that  have  a validity 
arising  from  the  methods  which  they  use  to  determine  them. 
Problems  arise,  as  in  Brad’s  case,  because  teachers  feel  strong 
conflicts  when  the  demands  of  grading  systems  which  they 
believe  have  a scientific  basis  are  perceived  to  be  in  opposi- 
tion with  the  personal,  developmental  and  learning  needs 
of  the  students  they  teach  (Manke  & Lloyd,  1990). 

Moss  (1994)  notes  that  insurance  of  reliability  is  a 
key  to  good  measurement,  but  argues  that  common  psycho- 
metric definitions  of  reliability  based  on  objectivist  episte- 
mology are  inadequate  when  non  standardized  or  alterna- 
tive forms  of  assessment  arc  being  used.  Moss  suggests 
that  reliability  of  assessment  procedures  should  be  exam- 
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ined  from  a hermeneutic  perspective  which  would  allow  “the 
voices  of  those  who  are  most  knowledgeable  about  the  con- 
text and  those  who  are  most  directly  affected  by  the  results’’ 
(students  and  teachers)  to  be  heard  (p.  10).  Moss  argues 
that,  although  neither  a psychometric  nor  hermeneutic  ap- 
proach guarantees  fairness,  consideration  of  both  approaches 
will  lead  to  more  informed  understanding  of  assessment 
practices  and  the  marking  decisions  that  emanate  from  them. 

Lakoff  (1987)  has  also  proposed  that  objectivism, 
or  the  claim  that  there  is  only  one  correct  way  to  view  the 
world,  should  be  rejected  as  an  epistemology.  He  argues 
that  because  individuals  are  a part  of  reality,  “it  is  impos- 
sible for  us  to  ever  stand  outside  it  and  take  the  stance  of  an 
observer  with  perfect  knowledge  (p  26 1 ).”  Rather,  we  should 
acknowledge  that  our  knowledge  is  constructed  from  a 
particluar  point  of  view.  Lakoff  further  points  out  that  from 
this  perspective,  “To  be  objective,  we  must  be  aware  that  we 
have  a particular  conceptual  system,  we  must  know  what  it 
is  like,  and  we  must  be  able  to  entertain  alternatives.  . . . 
Acknowledging  alternative  conceptual  schemes  docs  not 
abandon  objectivity;  on  the  contrary,  it  makes  objectivity 
possible,  (p,  264) 

Lakoff  (1987)  and  Moss  (1994)  clearly  reject  ob- 
jectivism as  an  epistemology  in  favor  of  an  account  of  ob- 
jectivity which  takes  into  account  human  experience  and 
our  inability  to  detach  ourselves  from  that  experience  as  we 
build  conceptual  schemes.  Yet,  teachers,  as  is  represented 
in  Brad’s  case,  may  have  difficulty  restructuring  long  held 
epistemological  views.  As  a result  of  their  biographical 
school  experiences,  teachers  have  likely  constructed  deep 
seated  and  complex  systems  of  beliefs  about  what  it  means 
for  an  assessment  “to  be  fair”.  The  importance  of  impar- 
tiality and  rationality  in  assessment  processes  is  reempha- 
sized in  preservice  teacher  education.  Textbooks  (i.e.  Howe 
& Jones,  1993)  caution  teachers  to  be  systematic  in  estab- 
lishing grades  so  as  to  avoid  “unconscious  bias  and 
unexamined  expectations  that  can  cloud  judgment”  (p.  372). 
Finally,  practicing  teachers  may  be  held  accountable  to  oth- 
ers, outside  their  classroom,  whose  views  of  knowledge  and 
assessment  are  grounded  in  objectivism.  Thus,  grades  de- 
termined through  this  process  are  easily  defended  and  ra- 
tionalized. The  pressure  on  teachers  to  implement  assess- 
ment procedures  that  are  characterized  as  reliable,  unbiased, 
fair,  objective,  uninfluenced  by  values  and  beliefs  etc.,  is  an 
important  factor  in  influencing  decisions  teachers  may  make 
about  how  to  assess  and  how  to  establish  criterion  for  grad- 
ing.. 

Brad’s  case  is  particularly  telling  because  his  de- 
cision to  implement  change  in  his  curriculum  and  in  his 
assessment  practices  was  seif  initiated,  rather  than  an  out- 
come of  institutionalized  efforts  for  school  change.  He  was 
personally  committed  to  change;  yet,  he  was  unable  to  re- 
construct his  beliefs  about  assessment  in  a way  that  would 
allow  him  to  implement  assessment  practices  that  supported 
the  curriculum  innovations  he  wanted  to  attain.  In  the  first 
place,  the  embeddedness  of  Brad’s  daily  assessment  prac- 
tices in  a concept  of  the  school  as  workplace  led  to  a signifi- 


cant proportion  of  a student’s  grade  being  attributable  to 
factors  other  than  what  the  students  knew.  Under  these  cir- 
cumstances, students  had  little  reason  to  learn  chemistry 
concepts  with  understanding  in  spite  of  the  changes  Brad 
had  made  in  the  way  curriculum  was  implemented.  Hence, 
alternative  forms  of  testing  seemed  no  more  effective  in 
meeting  students  needs  to  demonstrate  their  knowledge  than 
were  multiple  choice  tests.  Secondly,  Brad’s  objectivist  epis- 
temological perspective  clearly  constrained  his  confidence 
in  alternative  assessment  as  a means  for  obtaining  data  he 
considered  valid  for  reporting  students’  achievement  even 
in  cases  where  students  did  demonstrate  substantial  under- 
standing of  chemistry  concepts. 

If  we  want  to  change  the  face  of  science  education, 
to  promote  cooperative,  problem-centered  learning  in  the 
curriculum,  we  must  find  ways  to  help  teachers  to  restruc- 
ture their  beliefs  about  the  purposes  of  assessment  and  grad- 
ing within  classroom  contexts.  As  long  as  objectivism  is 
considered  the  basis  of  fair  and  unbiased  marking  proce- 
dures, teachers  will  have  difficulty  in  quantifying  their  evalu- 
ations of  students’  learning  when  alternative  assessment  is 
attempted.  Likewise,  as  long  as  teachers  are  unable  to  con- 
struct tests  that  allow  students  to  demonstrate  success  in 
learning  in  multiple  ways,  rather  than  in  terms  of  a single 
numerical  score,  teachers  will  continue  to  make  sense  of 
assessment  procedures  that  reward  non-academic  aspects 
of  classroom  achievement  such  as  participation  and  hard 
work. 

We  must  find  ways  to  support  individual  teachers 
in  their  attempts  to  make  changes  in  their  curriculum  and 
to  develop  alternative  means  of  assessing  students’  under- 
standing of  concepts  and  skills.  Certainly,  there  is  a great 
deal  of  pressure  from  parents,  students,  and  others  who  have 
succeeded  in  traditional  assessment  contexts  to  maintain 
these  practices.  The  resistance  of  stakeholders  in  the  cul- 
ture to  make  sense  of  schooling  in  alternative  ways  con- 
strains creation  of  a new  culture  where  learning  rather  than 
work  is  a central  goal  of  classroom  activity.  Before  we  place 
demands  on  teachers  to  change  their  curriculum  and  as- 
sessment practices,  further  research  is  needed  which  involves 
members  of  a school  culture  working  trogether  to  explicate 
and  analyze  relationships  that  exist  among  culturally  de- 
rived and  individually  constructed  referents  for  assessment. 
Perhaps  through  these  kinds  of  activities  members  of  a school 
community  may  come  to  question  the  rationale  for  their  as- 
sessment practices  rather  than  take  for  granted  that  no 
change  is  needed  or  that  change  is  impossible. 
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Summarizing  the  Literature  Review  with  Meta-analysis 

Keith  McNeil,  New  Mexico  State  University 
Isadorc  Newman,  University  of  Akron 

Abstract 

Meta-analysis  can  be  used  as  an  adjunct  to  the  traditional  review  of  literature  to  summarize  what  has 
been  previously  found . Meta-analysis  employs  the  study  as  the  unit  of  analysis , and  transforms  the  results  into 
a common  metric,  the  effect  size . The  effect  size  can  be  reported  as  either  a correlation,  or  the  difference 
between  means , divided  by  the  standard  deviation.  All  statistical  tests  can  be  transformed  into  an  effect  size. 


History  of  Meta-analysis 
Since  there  are  relevant  studies  with  which  any 
study  can  be  compared,  no  single  piece  of  research  stands 
by  itself.  Traditional  literature  reviews  provide  a narrative 
summary  of  the  studies,  possibly  providing  a count  of  those 
studies  which  provided  confirming  results  and  a count  of 
those  studies  that  provided  disconfirming  results.  Studies 
which  did  neither  are  often  excluded  from  the  literature  re- 
view and  from  the  litcratureas  well.  More  importantly,  the 
extent  of  confirmation  or  discontinuation  will  not  usually 
be  considered.  In  addition,  the  number  of  subjects  analyzed 
in  the  study  is  usually  ignored.  Finally,  studies  using  dif- 
ferent statistical  techniques  are  seldom  considered  on  a com- 
mon scale.  Meta-analysis  is  an  attempt  to  synthesize  the 
relevant  research  considering  three  major  factors  of  (a) 
sample  size,  (b)  magnitude  of  significance,  and  (c)  statisti- 
cal test  used. 

These  three  factors  result  in  an  effect  size,  which 
can  then  be  analyzed  as  a dependent  variable  investigating 
the  relationship  of  various  independent  variables  on  this 
dependent  variable  of  effect  size.  The  exciting  and  poten- 
tially valuable  aspect  of  meta-analysis  is  that  these  investi- 
gated independent  variables  likely  were  not  the  focus  of  any 
one  study,  but  since  they  do  vary  from  study  to  study  they 
may  account  for  the  discrepant  results. 

There  were  two  independent  efforts  which  devel- 
oped synthesizing  approaches,  one  by  Glass  (1976,  1977) 
using  the  difference  between  means  approach,  and  the  sec- 
ond one  by  Rosenthal  (1978,  1979)  using  the  correlational 
approach.  (See  Rosenthal  (1980)  for  earlier  approaches  to 
the  problem.) 

Effect  Size  in  Terms  of  Differences  Bebveen  Means 

Glass  quantified  the  idea  of  effect  size  proposed  by 
Cohen  (1969).  Cohen's  effect  size  is  the  ratio  of  variance 
accountedfor  divided  by  the  variance  unaccounted  for,  which 
is  similar  to  the  F-tcst— only  degrees  of  freedom  are  not  con- 
sidered. When  the  r2  is  small,  Cohen’s  effect  size  is  propor- 
tional to  r.  Glass’s  index,  A,  is  conceptually  similar  to  a z 
score  and  is  simply  the  difference  between  the  treatment 
mean  and  the  control  mean,  divided  by  the  standard  devia- 
tion of  the  control  group: 

*„■  = (Yt-Yc)/SDc  (1) 

Glass’  effect  size  is  a scalc-frcc  measure  since  the 
difference  between  means  in  the  Treatment  and  Control 


groups  is  divided  by  the  standard  deviation.  Thus,  results 
on  different  measures  can  be  readily  compared. 

If  a researcher  is  planning  on  conducting  a meta- 
analysis, there  are  various  caveats  and  decisions  that  must 
be  made  that  are  beyond  the  scope  of  this  paper.  The  three 
most  readable  references  are  Light  and  Pillemcr  (1984), 
Glass  (1980),  and  Glass,  McGaw,  and  Smith  (1981). 

The  example  in  Table  1 provides  further  under- 
standing. Suppose  that  four  relevant  studies  exist  in  the 
literature,  with  the  results  and  study  characteristics  as  in 
Table  1. 


Table  1 

Development  and  Use  of  Effect  Size  in  Terms  of  A 


Level  of 

Dependent 

Means 

Standard 

Study 

Stress 

Variable 

T C 

Deviation 

^T-C 

1 

High 

A 

62.1  60.5 

8.0 

.20 

2 

High 

A 

58.1  56.3 

9.0 

.20 

3 

Low 

A 

59.0  55.0 

8.0 

.50 

4 

Low 

B 

31.0  27.7 

5.5 

.60 

Mean  Effect  for  all  studies:  A =.375 

Mean  Effect  for  High  Stress  studies  1 & 2:  A = .20 

Mean  Effect  for  Low  Stress  studies  3 & 4:  A = .55 


As  indicated  in  Table  1,  studies  utilizing  different 
levels  of  stress,  studies  employing  different  dependent  vari- 
ables, and  studies  having  different  standard  deviations  can 
be  combined  to  produce  a total  effect  size.  The  calculated 
A on  each  study  eliminates  the  impact  of  different  means 
and  different  standard  deviations.  The  A does  not  elimi- 
nate the  potential  differences  in  treatments,  but  facilitates 
analysis  of  that  potential  difference.  While  the  four  studies 
support  the  notion  that  treatment  is  effective  in  increasing 
the  criterion,  (mean  A of  .375),  the  specific  level  of  stress  in 
the  situation  seems  critical  ( mean  A for  high  stress  is  .20 
while  the  mean  A for  low  stress  is  .55).  If  more  than  these 
four  studies  were  available,  the  differential  effects  of  high 
stress  and  low  stress  could  be  tested  for  significance. 

Since  A is  usually  not  reported  by  researchers,  A 
must  be  calculated  by  the  meta-analyst.  Appendix  A (modi- 
fied from  Light  and  Pillemcr  (1984)),  provides  short -cut 
procedures  for  various  situations. 
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Effect  Size  in  Terms  of  Correlation 
Rosenthal  pursued  the  idea  of  aggregating  study 
results  from  the  correlational  viewpoint,  translating  all  re- 
sults into  a common  correlation  coefficient.  (The  reader 
aware  of  the  General  Linear  Model  and  its  ability  to  deal 
with  both  “ANOVA”  and  “correlational”  types  of  designs 
will  not  be  surprised  that  either  approach  can  be  used.)  One 
can  transform  any  statistical  test  into  a correlation  coeffi- 
cient (r)  value  using,  as  a guide,  the  formulae  in  Appendix 
B (modified  from  Rosenthal,  1984). 


Table  2 

Development  & Use  of  Effect  Size  in  Terms  of  Correlation 


Study 

Means 
T C 

Standard 

Deviation 

\.c 

r 

i 

62.1  60.5 

8.0 

.20 

.10 

2 

58.1  56.3 

9.0 

.20 

.10 

3 

59.0  55.0 

8.0 

.50 

.24 

4 

31.0  27.7 

5.5 

.60 

.28 

MeanEffect  for  all  studies:  A = .375;  r = .18 

Mean  Effect  for  studies  1 & 2:  A = .200;  r = . 10 
Mean  Effect  for  studies  3 & 4:  A = .550;  r = .26 


The  results  in  Table  1,  analyzed  with  r would  ap- 
pear as  in  Table  2.  The  r value  is  obtained  from: 

r = A/(  A2  + (1/pq))1'2  (2) 

where  p and  q are  the  proportion  of  subjects  in  each  group. 
If  the  number  of  subjects  in  the  two  groups  is  the  same,  as  is 
assumed  for  this  example,  i.e.,  p = q = 1/2,  then: 

r = A/  ( A2  + 4)m  (3) 

The  mean  r value  is  computed  on  the  Fisher  z transformed 
r value,  which  is  then  transformed  back  to  the  r value. 

Major  Uses 

Now  that  the  general  procedures  for  calculating 
an  effect  size  are  known,  we  can  go  to  the  most  valuable 
part  of  meta-analysis,  using  effect  size  to  aggregate  and 
understand  the  existing  literature . If  all  previous  studies 
produce  the  same  effect  size,  then  the  interpretation  is  fairly 
straight-forward.  Irrespective  of  differences  in  the  studies 
(differences  in  type  of  lest  used,  way  data  analyzed,  level  of 
stress,  length  of  treatment,  size  of  sample,  or  characteristic 
of  sample  includingethnicity,  sex,  age,  sophistication,  prior 
exposure,  etc.),  no  study  characteristic  makes  a difference. 

However,  studies  in  most  content  areas  do  not  pro- 
duce the  same  level  of  effect  size.  A valuable  research  ac- 
tivity can  be  to  figure  out  why  the  various  studies  do  not 
produce  the  same  effect  size.  The  research  question  be- 
comes, “What  is  il  that  is  related  to  (and  eventually,  causes) 
different  effect  sizes?” 

There  are  four  general  ways  to  use  effect  size  when 
the  results  arc  not  consistent: 

1.  Similarly  labeled  treatments  or  programs  may 


differ  in  important  ways  that  can  be  identified.  Although  a 
researcher  may  refer  to  a set  of  treatments  as  similar,  the 
treatments  usually  differ  in  terms  of  some  attribute,  either 
in  the  level  of  another  variable,  or  in  some  aspect  of  the 
treatment. 

2.  Setting  by  treatment  interactions  may  exist.  A 
setting  by  treatment  interaction  is  often  common  in  educa- 
tional research,  and  can  provide  valuable  insight  to  a disci- 
pline. One  should  not  expect  a given  treatment  to  work 
equally  well  in  all  settings.  Therefore  one  should  not  ag- 
gregate results  from  the  settings  which  produce  different 
results. 

3.  The  type  of  research  design  employed  in  a study 
can  strongly  influence  the  outcome.  Different  results  can 
occur  as  a function  of  how  the  researcher  designed  the  study. 
For  instance,  studies  in  most  research  areas  document  that 
volunteers  react  differently  than  subjects  randomly  selected. 
Well-trained  interviewers  will  obtain  different  information 
than  will  untrained  interviewers.  An  experimental  study 
with  a posttest  obtained  six  months  after  treatment  will  prob- 
ably produce  different  results  than  will  one  with  an  imme- 
diate posttest. 

4.  The  particular  analysis  procedures  that  are  used 
may  be  related  to  outcomes.  For  instance,  one  of  the  con- 
tinuing concerns  is  the  unit  of  analysis  problem.  Should  an 
educational  researcher  use  the  individual  subject  as  the  unit 
of  analysis,  or  should  the  classroom  mean  be  used  as  the 
unit  of  analysis?  If  the  teacher  effect  is  potent,  then  using 
the  classroom  as  the  unit  of  analysis  makes  sense  since  all 
of  those  students  in  the  one  classroom  were  taught  by  the 
same  teacher.  If  the  treatment  and  dependent  variable  can 
be  influenced  by  the  entire  school-a  school  effect-then  it 
makes  sense  to  use  the  school  as  the  unit  of  analysis.  Which 
level  a researcher  uses  can  influence  heavily  the  magnitude 
of  effect  size. 

Meta-analysis  actually  empowers  the  researcher  to 
understand  discrepant  results.  That  is,  if  some  studies  re- 
port positive  results  and  others  report  negative  results,  there 
must  be  a reason  (or  set  of  reasons)  for  these  discrepant 
results.  Meta-analysis  provides  the  researcher  with  the  in- 
formation needed  to  do  the  detective  work  to  uncover  the 
reason(s). 

Concerns  about  Meta-analysis 

As  with  all  analysis  techniques,  some  applied  re- 
searchers have  inappropriately  implemented  meta-analysis, 
while  some  methodologists  have  identified  concerns  with 
the  technique.  While  articles  such  as  this  one  attempt  to 
inform  researchers,  we  cannot  guarantee  that  all  research- 
ers will  use  the  technique  properly.  We  can,  though,  alert 
the  reader  to  the  four  major  concerns  that  have  been  raised, 
and  evaluate  those  concerns. 

The  Apples  and  Oranges  Problem 

Most  meta-analysis  researchers  combine  studies 
which  have  used  .various  research  methodologies,  various 
dependent  measures,  various  kinds  of  subjects,  etc.  One 
can  test  to  determine  if  such  aggregation  is  prudent.  If  there 
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are  significant  differences,  then  those  results  should  not  be 
combined. 

Use  of  Data  from  Poorly  Conceived  or  Poorly  Executed 
Studies 

The  quality  of  any  piece  of  research  is  in  the  eyes 
of  the  beholder.  Indeed,  almost  any  piece  of  research  can  be 
critiqued  by  another  researcher.  But  if  numerous  “low  qual- 
ity” studies,  each  erring  on  only  one  quality  component, 
show  a substantial  effect  size,  then  the  conclusion  should  be 
that  there  is  an  effect  size. 

The  bottom  line  is  that  the  quality  of  the  study  can 
be  investigated  as  an  independent  variable.  Smith  and  Glass 
(1977)  investigated  “good”  and  “bad”  psychotherapy  stud- 
ies and  found  that  there  was  no  difference  in  effect  size  due 
to  the  quality  of  the  study.  On  the  other  hand,  when  these 
same  researchers  looked  at  the  effect  of  class  size  on  achieve- 
ment, they  found  a significant  difference  between  studies 
which  used  randomly  assigned  students  as  compared  to  those 
studies  which  looked  at  classes  with  students  who  were  not 
randomly  assigned.  As  a result,  they  limited  their  subse- 
quent analyses  to  the  higher  quality  studies-those  which 
employed  random  assignment. 

Bias  as  to  vMch  Articles  Get  Published 

Most  researchers  know  that  it  is  difficult  to  pub- 
lish non-significant  results.  So,  when  a researcher  obtains 
such  results,  there  may  be  a tendency  not  to  write  up  those 
results.  If  the  article  is  submitted  for  publication,  journal 
reviewers  are  often  inclined  to  review  unfavorably  “non- 
significant results,”  and  some  journal  editors  also  have  been 
known  not  to  look  favorably  on  such  research  results.  There- 
fore, some  researchers  believe  that  the  published  research 
is  biased  toward  larger  effect  sizes.  Since  research  neither 
written  nor  submitted  nor  accepted  for  publication  is  ex- 
tremely difficult  to  obtain  and  analyze  in  a meta-analysis, 
there  are  two  procedures  that  meta-analysts  have  used  to 
respond  to  this  criticism. 

The  first  method  is  to  compare  research  that  is 
published  in  referred  journals  with  research  that  is  avail- 
able in  non-referred  sources,  such  as  dissertations.  The 
notion  here  is  that  dissertations  will  be  completed  irrespec- 
tive of  whether  significance  is  obtained.  Glass,  McGaw, 
and  Smith  (1981)  reported  on  nine  meta-analyses  which 
compared  the  effect  size  reported  in  journals  with  the  effect 
size  reported  in  dissertations.  They  found  a substantial  bias, 
with  a larger  effect  size  reported  in  the  journals  (.64  vs. 
.48).  The  results  in  the  journals  are  one-third  standard  de- 
viation more  disposed  toward  the  favored  hypotheses  of  the 
investigators  than  findings  reported  in  dissertations.  There 
are  a variety  of  possible  explanations  for  such  results.  For 
instance,  dissertation  committees  may  impose  more  rigor, 
may  require  the  research  to  be  “more  on  the  fringe,”  or  may 
foster  a committee  approach  to  the  design  and  conduct  of 
the  research.  All  of  the  above  reasons  could  yield  a lower 
effect  size. 

The  second  method  for  dealing  with  “fugitive  lit- 
erature” was  proposed  by  Rosenthal  (1984). 


The  fundamental  idea  in  coping  with  the  "file 
drawer"  problem  is  simply  to  calculate  the  num- 
ber of  studies  averaging  null  results  that  must 
be  in  the  file  drawers  before  the  overall  prob- 
ability of  a type  I error  rate  can  be  just  brought 
down  to  any  desired  level  of  significance , say  p 
= . 05.  This  number  of  filed  studies,  or  the  toler- 
ance for  future  null  results , is  then  evaluated 
for  whether  such  a tolerance  level  is  small 
enough  to  threaten  the  overall  conclusion  drawn 
by  the  reviewer,  (p.108) 

Rosenthal  and  Rubin  (1978)  provide  an  illustra- 
tion with  their  meta-analysis  of  345  studies  of  the  self-ful- 
filling prophecy.  The  mean  effect  size  reported  was  1.22, 
and  it  would  require  65,000  unreported  studies  of  effect  size 
of  .00  in  the  file  drawers  to  pull  this  effect  size  down  to 
where  it  wasn’t  significant.  It  is  extremely  unlikely  that 
65,000  studies  finding  non-significant  results  on  the  self- 
fulfilling  prophecy  have  been  conducted  and  not  published 
because  of  lack  of  significance.  Therefore  we  can  feel  se- 
cure that  there  really  is  an  effect  size  due  to  the  self-fulfill- 
ing prophecy.  We  might  not  be  as  sure  of  the  non-published 
results  in  an  area  that  is  less  well-documented  as  the  self- 
fulfilling  prophecy. 

Non-independent  Data  when  Several  Results  from  One 
Study  are  Included 

This  fourth  concern  seems  to  the  present  authors 
to  be  the  only  real  concern,  but  a major  concern.  One  study, 
with  its  attendant  aspects,  may  provide  numerous  effect  sizes 
to  the  meta-analysis.  For  instance,  one  study  may  have  in- 
cluded nine  different,  but  highly  correlated,  dependent  vari- 
ables. Therefore,  all  of  the  unique  aspects  (including  lack 
of  internal  validity)  of  that  one  study  will  impact  on  each  of 
the  nine  dependent  measures.  A reasonable  solution  to  this 
problem  has  been  proposed  by  Tracz,  Newman,  and  McNeil 
(1986)  who  extended  the  analysis  technique  of  repeated 
measures  to  this  non-independent  data. 

Summary 

For  research  results  to  make  any  sense,  they  should 
be  linked  to  aggregated  results  from  previous  studies.  A 
common  index  such  as  r or  A facilitates  aggregation.  Re- 
searchers are  strongly  urged  to  include  effect  size  in  their 
reports.  The  discussed  concerns  do  not  seem  to  question 
the  value  of  reporting  effect  sizes.  If  effect  sizes  are  not 
consistent,  then  further  analyses  should  be  undertaken  to 
determine  why  the  effect  sizes  are  different. 
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APPENDIX  A 

Calculation  of  Effect  Size  in  terms  of  A 
from  Various  Statistical  Procedures 


Test  of 
Significance 

Effect  Size 
A 

t (equal  n) 

2t/(  df)v‘ 

t (unequal  n) 

(t*(nI  + n2))/((df)y,*(n,  + nJ)Vi) 

r 

2r  / (1  - r2),/' 

F 

r = (F*df  / (F*df  + dfj))'/‘ 

(then  use  r to  change  to  A) 

z 

r = z/n'/l 

(then  use  r to  change  to  A) 

APPENDIX  B 

Calculation  of  Effect  Size  in  terms  of 

Correlation  from  Various  Statistical  Procedures 

Test  of 

Effect  Size 

Significance 

r 

( X2  / ( x2  + N ))* 

Z 

z / N* 

t 

( t2  / ( t2  + ( n,  + n,  - 2 ) ) )* 

F 

(F*df  / (F*df  + df,))'4 

IN  MEMORIAM 
DONALD  R.  CASTLE 

Donald  Castle  passed  away  suddenly  on  July  9,  1994.  Don  was  an  active  member  of  MWERA  for  many  years, 
Co-Chair  ofDivision  F (History  and  Philosophy  of  Education),  and  newly  elected  member-at-large  of  the  MWERA 
Board  of  Directors.  He  was  an  associate  professor  of  education  at  Ashland  University,  in  Ashland,  Ohio.  Like 
most  of  us,  he  taught  and  advised  graduate  and  undergraduate  students,  and  served  as  advisor  to  student  groups. 

Don  was  also  active  in  other  professional  groups,  notably  ASCD,  OASCD,  Ohio  and  national  middle  school 
associations,  and  the  national  association  for  at-risk  students.  He  was  a scholar  as  well  as  a teacher,  publishing  and 
presenting  nationally  in  his  fields  of  at-risk  students  and  urban  education.  He  served  as  a reviewer  for  Allyn  & 
Bacon.  He  was  in  the  middle  of  editing  his  first  book.  Affirming  Middle  Grades  Education. 

MWERA  will  miss  his  tireless  and  enthusiastic  service.  The  faculty  at  Ashland  University  will  miss  his  wit,  his 
candor,  and  his  wisdom.  We  take  this  opportunity  to  extend  our  sympathies  to  his  wife,  Judith,  and  their  two  sons. 

(Credit  for  providing  this  In  Mcmoriam  text  is  given  to  Louise  E.  Fleming,  Ashland  University.  Ed.) 
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Research  Alive:  All  Our  Children  Learning 

Jack  Snowman,  Southern  Illinois  University,  Carbondale 


T he  title  of  this  column  was,  as  I’m  sure  many 
of  you  recognize,  taken  verbatim  from  the  title  of  a 
book  written  by  Ben  Bloom  and  published  in  1981.  I 
chose  this  title  for  two  reasons.  First,  each  of  the  six 
recently  published  articles  that  are  summarized  below 
deals  with  one  aspect  or  another  of  children’s  class- 
room learning.  The  children  who  participated  in  these 
studies  ranged  from  about  five  years  of  age  (kinder- 
garten) to  roughly  thirteen  years  of  age  (eighth-grade). 
Second,  and  more  importantly,  each  of  these  studies  is 
consistent  with  the  basic  reason  why  Bloom  wrote  All 
Our  Children  Learning.  On  page  1 of  the  Introduc- 
tion, Bloom  states  that  as  a result  of  research  on  what 
he  called  alterable  variables , “student  learning  can 
be  improved  greatly,  and  it  is  possible  to  describe  the 
favorable  learning  conditions  which  can  enable  virtu- 
ally all  students  to  learn  to  a high  standard.  In  their 
own  way,  each  of  the  following  studies  describes  those 
learning  conditions. 

How  to  Grow  a Vocabulary : Read  to  Children  Early 
and  Often 

In  volume  86,  number  1 (1994)  of  the  Jour- 
nal of  Educational  Psychology , Claudia  Robbins  and 
Linnea  Ehri  make  the  argument  that  because  vocabu- 
lary size  is  strongly  correlated  with  children’s  overall 
school  achievement,  it  is  important  to  understand  how 
young  children  achieve  their  vocabulary  growth. 
While  it  might  be  reasonable  to  expect  most  of  this 
growth  to  come  from  structured  classroom  lessons,  pre- 
vious research  suggests  that  direct  instruction  has  a 
negligible  effect.  In  one  study  cited  by  these  authors, 
27  fourth  graders  learned  an  average  of  only  85  tar- 
geted words  in  19  weeks.  Other  research  suggests  that 
listening  to  stories  has  a much  stronger  impact  on  vo- 
cabulary growth  than  docs  direct  instruction.  But  be- 
cause of  shortcomings  of  one  sort  or  another  in  these 
earlier  studies,  a definitive  conclusion  about  story  read- 
ing as  a direct  cause  of  vocabulary  growth  in  young 
children  could  not  be  made. 

In  the  Robbins  and  Ehri  study,  thirty-three 
non-reading  kindergarten  children  were  given  the 
Peabody  Picture  Vocabulary  Test-Revised  (PPVT-R) 
and  classified  as  having  cither  low,  medium,  or  high 
levels  of  vocabulary  knowledge.  Children  in  each 
group  were  randomly  assigned  to  hear  cither  A 
Crocodile  s Tale  or  The  Little  Boy  Who  Cried  Wolf 
Eleven  target  words  thought  to  be  unfamiliar  to  the 
children  were  substituted  for  familiar  words  or  phrases 
in  each  story.  Although  these  words  were  not  defined, 
their  meanings  could  be  obtained  from  cues  in  the  sur- 
rounding context.  Each  story  was  heard  twice  in  the 
space  of  anywhere  from  two  to  four  days.  After  listen- 


ing to  the  story,  children  took  a 22-itcm  multiple-choice 
vocabulary  test.  Eleven  of  the  items  came  from  the  story 
they  heard  and  1 1 came  from  the  story  they  did  not  hear. 
For  each  item,  there  were  four  picture  choices  and  a 
“don’t  know”  option. 

Children’s  performance  on  the  unfamiliar  words 
heard  in  the  story  reliably  exceeded  performance  on  the 
words  not  heard,  indicating  that  listening  to  stories  was 
an  effective  means  of  expanding  word  knowledge.  But 
the  size  of  the  difference  varied  as  a function  of  PPVT-R 
score:  children  who  possessed  larger  vocabularies  to  start 
with  learned  more  new  vocabulary  words  than  did  chil- 
dren with  smaller  vocabularies. 

Although  the  effect  of  hearing  stories  on  recog- 
nition of  the  meanings  of  unfamiliar  words  was  not  large 
(children  recognized  an  average  of  1 .24,  or  1 1 .3%,  more 
definitions  of  words  from  the  story'  they  heard  than  from 
the  story  they  did  not  hear), two  things  should  be  pointed 
out.  First,  the  11  target  words  were  rather  difficult.  They 
included  such  words  as  decrepit,  procure,  query,  abode, 
and  chortle.  Second,  the  cost  of  obtaining  this  result 
was  almost  nil.  How  much  time  and  effort  does  it  take 
to  read  a story  or  two  to  a child  each  day? 

/ Get  By  With  a Little  Help  From  My  Friends 

Recently,  I asked  my  computer  to  search  the 
ERIC  database  for  articles  dealing  with  cooperative 
learning  for  the  years  1966  through  1993.  Not  to  my 
great  surprise  it  found  a total  of  2,712  articles.  With 
such  a large  research  base,  one  would  think  that  all  of 
the  significant  questions  concerning  cooperative  learn- 
ing have  at  least  been  asked,  if  not  answered.  Not  so 
according  to  Amalya  Nattiv  of  Eastern  New  Mexico 
University.  In  volume  94,  number  3 (1994)  of  The  El- 
ementary School  Journal , she  reports  on  a study  that 
sought  to  determine  (a)  if  the  known  relationship  be- 
tween helping  behaviors  in  cooperative  groups  and 
achievement  gains  exists  among  third-,  fourth-,  and 
fifth-grade  math  students,  (b)  if  gender,  grade  level,  or 
ability  level  of  the  students  relate  to  gains  in  achieve- 
ment, (c)  if  all  helping  behaviors  relate  to  gains  in 
achievement,  and  (d)  if  all  students  exhibit  taught  help- 
ing behaviors. 

Each  cooperative  learning  group  included  stu- 
dents of  both  genders,  three  math  ability  levels  (based 
on  standardized  test  scores),  and  various  ethnic  back- 
grounds. All  students  were  given  three  weeks  of  instruc- 
tion in  how  to  help  their  team  members  work  through 
math  problems  via  direct  instruction,  role  playing,  mod- 
eling. calling  attention  to  appropriate  helping  behaviors, 
and  giving  points  to  groups  whose  members  exhibited 
helping  behaviors. 

Amalya  used  the  cooperative  learning  format 
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known  as  Student  Teams-Achicvcment  Divisions 
(STAD).  The  STAD  format  includes  direct  instruction 
of  new  material,  the  formation  of  diverse  student  teams 
whose  purpose  is  to  prepare  its  members  to  do  well  on 
exams,  individual  improvement  scores,  and  team  recog- 
nition. Additional  components  for  this  study  were  ini- 
tial team  building,  instruction  on  helping  behaviors,  and 
rotating  students  through  different  roles  (e.g.,  solving 
problems,  checking,  coaching).  Each  team  was  video- 
taped an  average  of  twice  a week  for  five  minutes  each 
time. 

The  data  analysis  allowed  Amalya  to  draw  the 
following  conclusions:  (a)  There  is  a positive  and  statis- 
tically significant  relationship  between  helping  behav- 
iors in  cooperative  groups  and  subsequent  math  achieve- 
ment for  3rd-,  4th-,  and  5th-grade  males  and  females. 
(2)  Different  helping  behaviors  have  different  effects  on 
achievement.  Of  the  eight  helping  behaviors  that  were 
examined  (“received  no  help  after  requesting  it,"  “gives 
explanations,”  “receives  explanations,”  “receives  other 
help,”  “gives  other  help,”  “asks  for  help  and  receives 
it,”  “gives  answers  only,”  “receives  answers  only”),  “re- 
ceives no  help  after  requesting  it”  was  the  most  influen- 
tial, accounting  for  9.4%  of  the  variance  in  the  math 
achievement  measure,  and  was  negatively  related  to 
achievement.  The  next  most  influential  behaviors  were 
“gives  explanations”  (3.9%  of  the  variance),  and  “re- 
ceives explanations”  (2.6%  of  the  variance).  “Receives 
other  help”  and  “gives  other  help”  taken  together  ex- 
plained less  than  1%  of  the  variance  in  the  dependent 
measure.  The  last  three  behaviors  were  unrelated  to  math 
achievement.  (3)  Neither  gender  nor  grade  level  was 
related  to  helping  behavior,  but  ability  was  related.  Stu- 
dents classified  as  high  ability'  gave  more  explanations, 
other  help,  and  more  answers  than  did  low  ability  stu- 
dents. (4)  Although  all  students  exhibited  the  helping 
behaviors  they  were  taught,  the  more  desired  behaviors, 
such  as  “gives  explanations,”  “receives  explanations,” 
and  “asks  for  help  and  receives  it,”  occurred  more  often 
than  the  less  desired  “receives  no  help  after  requesting 
it.”  “gives  answers  only,”  and  “receives  answers  only.” 

The  Elusive  Transfer  Effect 

Past  research  tells  us  that  learning  disabled  (LD) 
students  do  not  perform  as  well  in  school  as  non-learning 
disabled  students  because  of  deficits  in  such  processes 
as  encoding,  conscious  use  of  tactics  and  strategics,  and 
transfer  of  learned  information  and  skill.  To  some  de- 
gree, these  deficits  can  be  remediated  by  teaching  LD 
students  techniques  for  enhancing  incaningfuincss,  dis- 
tinctiveness of  encoding,  and  retrieval  of  desired  infor- 
mation. For  tasks  that  involve  learning  to  associate  one 
fact  or  idea  with  another,  the  keyword  mnemonic  is  a 
particularly  effective  device.  As  1 have  indicated  in  a 
previous  column,  and  as  Barbara  Fulk,  Margo 
Mastropicri,  and  Thomas  Scruggs  point  out  in  volume 
7,  number  2 (1992)  of  Learning  Disabilities  Research 


and  Practice , students  quickly  become  proficient  users 
of  the  keyword  technique  and  significantly  improve  their 
memory  performance  in  comparison  to  a variety'  of  other 
instructional  treatments.  About  the  only  desired  out- 
come of  keyword  instruction  that  has  largely  escaped  re- 
searchers is  spontaneous  transfer  (also  known  as  gener- 
alization). In  fact,  in  an  article  titled  “Mnemonic  Strat- 
egies and  Classroom  Learning:  A Twenty-Year  Report 
Card  ( Elementary  School  Journal , volume  94,  number 
2).  Joel  Levin  awards  this  area  of  mnemonics  research  a 
grade  of  D.  In  their  study,  Fulk  et  al.  examined  how 
well  keyword  instruction  and  attribution  training  helped 
LD  students  learn  the  meanings  of  unfamiliar  terms  from 
different  content  areas  and  then  transfer  that  skill  to  new 
word  lists  one  day  and  two  weeks  after  the  end  of  train- 
ing. 

Fifty-six  sixth-,  seventh-,  and  eighth-grade  LD 
students  were  randomly  assigned  to  either  a mnemonic 
generalization  training  condition,  a mnemonic  gener- 
alization plus  attribution  training  condition,  or  a re- 
hearsal condition.  The  experiment  consisted  of  three 
phases.  Phase  1 involved  one  day  of  training  with  12 
words  from  different  subject  matter  areas  (e.g.,  social 
studies  and  science)  and  an  immediate  recall  test.  Phase 
2 involved  two  da}  of  practice  with  10  words  from  dif- 
ferent subject  matter  areas.  Phase  3 was  an  unprompted 
generalization  task  that  was  administered  one  day  and 
two  weeks  after  the  end  of  Phase  2. 

During  Phase  1 (Day  1),  the  mnemonic  gener- 
alization training  group  was  given  explicit  instructions 
in  how  to  use  the  keyword  mnemonic  and  was  shown  a 
set  of  12  cards,  each  of  which  contained  a target  word 
(e.g.,  vituperation),  a keyword  (e.g.,  viper),  and  an  il- 
lustration that  incorporated  the  keyword  and  the  defini- 
tion (e.g.,  a viper  speaking  abusively  to  someone).  The 
mnemonic  generalization  plus  attribution  training  group 
received  the  same  instructions  and  materials  as  did  the 
mnemonic  generalization  training  group.  In  addition, 
they  saw  two  cartoon  drawings,  each  of  which  was  fol- 
lowed by  a positive  attribution  message.  The  first  car- 
toon depicted  a student  who  had  experienced  success  on 
a school  task.  This  was  followed  by  an  index  card  which 
read:  “Two  main  reasons  why  students  usually  do  well 
on  school  tasks  arc  these:  ( 1 ) because  they  know  a good 
way  to  remember  important  information,  and  (2)  because 
they  try  hard  as  they  use  that  method.”  The  second  car- 
toon depicted  a student  who  had  experienced  failure  and 
was  followed  by  the  message,  “Two  main  reasons  why 
students  usually  don't  do  well  on  school  tasks  arc  these: 
(1)  because  they  don't  know  a good  way  to  remember 
important  information,  and  (2)  because  they  don't  try 
hard.”  Students  in  the  rehearsal  condition  received  the 
same  set  of  learning  materials  for  Phase  1 as  did  the 
other  two  groups.  But  instead  of  keyword  instructions 
and  illustrations,  they  received  instructions  in  how  to 
use  a rehearsal  tactic  and  simpler  illustrations.  For  ex- 
ample. the  card  for  “vituperation”  depicted  one  person 
telling  another,  “Don't  speak  so  abusively  to  me.”  with 
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the  words  “vituperation”  and  “scolding”  on  the  top. 
During  Phase  2,  students  received  (along  with  the  set  of 
10  practice  words)  a printed  card  that  read,  “1)  repeat 
the  word,  2)  study  the  picture  of  the  answer  informa- 
tion, and  3)  say  the  word  and  definition  together.”  At 
the  end  of  Phase  1,  each  group  was  tested  for  recall  with 
production  items  (e.g.,  What  does  vituperation  mean?) 
and  matching  items. 

During  Phase  2 (Days  2 and  3),  each  group  re- 
viewed the  steps  involved  in  implementing  its  particu- 
lar technique,  was  told  the  purpose  of  the  training,  was 
reminded  of  the  type  of  task  for  which  the  technique  was 
appropriate,  and  was  tested  for  recall  with  production 
items  and  matching  items.  The  mnemonic  generaliza- 
tion subjects  received  a set  of  10  cards,  each  of  which 
contained  a target  word,  a definition,  and  the  prompt, 
“Did  you  use  the  strategy?”  Although  the  students  had 
to  generate  their  own  keywords  and  interactive  illustra- 
tions during  this  phase,  one  card  listed  the  steps  they 
had  been  trained  to  use  and  another  card  listed  the  crite- 
ria for  an  appropriate  keyword.  The  mnemonic  gener- 
alization plus  attribution  training  subjects  also  practiced 
the  keyword  mnemonic  on  a set  of  10  words,  but  received 
strategy  use  and  attribution  prompts  (e.g.,  “Did  you  try 
hard  and  use  the  strategy?”).  Students  in  the  rehearsal 
group  were  given  explicit  explanations,  prompting,  and 
feedback  of  the  rehearsal  technique. 

For  Phase  3,  the  generalization  testing,  students 
were  given  new  lists  and  told  to  study  them  with  “the 
method  that  would  best  help  them  prepare”  for  the  quiz 
that  would  follow. 

The  results  of  the  training  regimen  described 
above  can  be  fairly  described  as  mixed.  No  differences 
were  found  among  the  groups  for  either  of  the  Phase  1 
recall  scores.  For  the  matching  test  administered  after 
the  first  day  of  Phase  2 training,  only  the  mnemonic  gen- 
eralization training  group  significantly  outscorcd  the  re- 
hearsal group.  For  the  production  test,  both  the  mne- 
monic generalization  training  group  and  the  mnemonic 
generalization  plus  attribution  training  group  signifi- 
cantly outscored  the  rehearsal  group.  The  scores  of  the 
two  training  groups  did  not  differ  significantly  from  each 
other.  This  last  finding  was  replicated  for  both  the 
matching  and  production  tests  administered  after  the 
second  day  of  Phase  2 training.  The  one -day  delayed 
transfer  test  produced  no  significant  differences  among 
the  three  groups.  The  two-week  delayed  transfer  test 
produced  no  significant  differences  for  the  production 
test.  On  the  matching  test,  however,  the  two  training 
groups  significantly  outscored  the  rehearsal  group. 

Want  to  Learn  More?  It's  a Question  of  Elaboration 

Current  cognitive  conceptions  of  learning  sug- 
gest that  students  learn  more  of  a body  of  knowledge  as 
they  construct  relationships  among  the  ideas  that  make 
up  that  knowledge  base  and  relate  those  ideas  to  what 
they  already  know.  This  phenomenon,  which  is  gener- 


ally known  as  generative  learning , has  a broad  base  of 
research  support  that  stretches  back  over  several  decades. 

One  technique  that  has  proven  effective  in  in- 
ducing generative  learning  is  elaborative  interrogation. 
Previous  research  has  shown  that  elaborative  interroga- 
tion, the  act  of  generating  inferences  while  asking  why 
questions,  increases  associations  among  and  retention 
for  facts  from  a reading  passage  for  learners  from 
4th~grade  through  college.  But,  as  Timothy  Seifert  points 
out  in  volume  85,  number  4 (1993)  of  the  Journal  of 
Educational  Psychology , these  effects  were  obtained  from 
materials  (sentences  and  paragraphs,  for  the  most  part) 
that  were  easily  reduced  to  a list  of  equally  important 
facts  because  they  lacked  the  superordinatc-subordinate 
structure  so  typical  of  academic  prose.  The  study  re- 
ported on  by  Seifert  was  designed  to  investigate  whether 
the  elaborative  interrogation  effect  would  be  as  strong 
when  it  was  directed  only  at  the  main  idea  of  a standard 
paragraph.  Because  a main  idea  is  naturally  elaborated 
by  supporting  subordinate  ideas,  and  because  these  sup- 
porting ideas  may  activate  relevant  prior  knowledge,  ad- 
ditional elaboration  may  be  largely  superfluous.  A sec- 
ond concern  driving  Seifert’s  study  was  that  the  specific 
characteristics  of  the  elaboration  itself  may  influence 
memory  for  the  target  information.  Data  from  a small 
number  of  previous  studies  suggest  that  why  questions 
that  lead  to  a correct  explanation  of  some  fact  are  more 
likely  to  improve  recall  of  that  information  than  ques- 
tions that  lead  to  nonexplanatory  or  incorrect  explana- 
tions. For  example,  in  response  to  the  question,  “Why 
would  American  woodcocks  need  to  be  fast  and  unpre- 
dictable?,” a correct  explanation  would  mention  that 
some  animals  protect  themselves  by  their  ability  to  es- 
cape from  enemies.  An  incorrect  explanation  would 
sound  plausible  (e.g.,  to  catch  prey),  but  be  wrong.  A 
nonexplanatory  response  would  be  vague  or  incorrect 
(e.g.,  to  fly  over  lakes  and  rivers). 

To  test  these  two  hypotheses,  sixth-  and 
seventh-grade  students  read  two  passages,  performed 
either  an  elaborative  or  non-elaborative  activity  while 
reading  the  second  passage,  and  were  tested  for  associa- 
tive memory  and  memory  for  details.  The  first  reading 
passage  provided  students  with  general  knowledge  of  how 
animals  adapt  to  their  environment,  and  was  intended 
to  serve  as  a basis  for  the  elaborative  activity  they  would 
be  asked  to  perform  while  reading  the  second  passage. 
The  second  passage  described  the  characteristics  and 
behaviors  of  three  animals. 

Students  assigned  to  the  underline -only  group 
found  alongside  each  paragraph  the  prompt,  “Underline 
the  most  important  idea  in  this  paragraph.”  Students 
assigned  to  the  underline-with-elaboration  group  were 
also  directed  to  underline  the  most  important  idea  from 
each  paragraph.  But  the  paragraphs  in  their  passage 
contained  an  extra  sentence  that  linked  the  underlined 
information  to  a particular  principle  of  adaptation  men- 
tioned in  the  first  passage.  Students  in  the  generate- 
elaboration  group  were  instructed  to  answer  the  why 


question  that  appeared  alongside  each  paragraph  (e.g., 
“Why  would  the  snowshoe  hare  need  to  be  white  in  color 
during  winter?”).  Students  in  the  elaborate-with-study- 
sheet  group  answered  the  same  questions  as  did  those  in 
the  generate-claboration  group,  but  were  also  given  the 
written  summaries  they  had  made  of  the  first  passage  to 
use  as  a reference. 

Because  Seifert  was  interested  in  the  effect  of 
elaboration  versus  non-elaboration,  his  analysis  com- 
pared the  performance  of  the  three  elaboration  groups 
with  the  performance  of  the  underline-only  group.  Dif- 
ferences among  the  three  elaboration  groups  were  not 
examined.  Only  the  generate-elaboration  group  (those 
who  answered  why  questions)  significantly  outperformed 
the  underline-only  group  on  the  associative  memory  test, 
and  this  was  entirely  due,  as  expected,  to  this  elabora- 
tion group’s  performance  on  main  idea  questions.  There 
were  no  statistically  significant  differences  between  a y 
of  the  elaboration  groups  and  the  underline-only  group 
on  memory  for  details.  As  far  as  how  well  each  group 
was  able  to  relate  the  specific  information  from  the  sec- 
ond passage  to  the  more  general  information  from  the 
first  passage,  all  three  elaboration  groups  significantly 
outperformed  the  underline-only  group.  Moreover,  the 
effect  sizes  were  moderately  strong  (ES  = .85,  .65,  and 
.74  for  the  generate-elaboration,  elaboratc-with-study- 
sheet,  and  underline-with-elaboration  groups,  respec- 
tively). In  order  to  determine  whether  correct  explana- 
tions given  in  response  to  why  questions  improved 
memory  for  factual  information,  a conditional  probabil- 
ity analysis  was  conducted.  This  analysis  did  not  find  a 
statistically  significant  difference  between  the  elabora- 
tion-with-study-shcet  and  generate-elaboration  groups 
and  the  underline-only  group. 

These  findings  support  the  hypothesis  that  stu- 
dents who  engage  in  interrogative  elaborative  activity 
while  they  read  learn  more  main  idea  information  than 
students  who  engage  in  non-elaborative  activities,  and 
that  such  activity  is  more  likely  to  stimulate  recall  of 
relevant  prior  information.  Additionally,  such  activity 
does  not  appear  to  interfere  with  recall  of  supporting 
details. 

Retaining  Students  in  Grade  Gets  a Failing  Grade 
(Again) 

In  an  earlier  Research  Alive  column  (Summer, 
1992),  1 pointed  out  that  the  practice  of  requiring  stu- 
dents to  repeat  a grade  because  of  unsatisfactory  achieve- 
ment continues  to  be  a popular  one  despite  an  almost 
unbroken  stream  of  negative  effects  that  have  appeared 
in  the  research  literature  over  the  past  20  years.  Samuel 
J.  Mciscls  and  Fong-Rucy  Liaw  provide  yet  another  piece 
of  damning  evidence  in  volume  87,  number  2 (1993)  of 
the  Journal  of  Educational  Research.  Mciscls  and  Liaw 
undertook  their  analysis  because  much  of  the  prior  re- 
search was  conducted  on  relatively  small  samples  and 
there  was  little  data  on  the  issue  of  early  retention  (grades 


K-3)  versus  late  retention  (grades  4-8).  Both  of  these 
problems  were  addressed  by  analyzing  a subset  of  data 
from  the  large,  representative  National  Education  Lon- 
gitudinal Study  of  1988  (NELS:  88),  a government  spon- 
sored longitudinal  study  of  student  outcomes.  The 
sample  analyzed  by  Meiscls  and  Liaw  consisted  of  16,623 
eighth-grade  students,  2,075  of  whom  were  retained  in 
grades  K-3  and  1, 128  of  whom  were  retained  in  grades  4-8. 

In  response  to  the  question.  Who  gets  retained?, 
Meisels  and  Liaw  found  w'ide  discrepancies  on  the  basis 
of  racial/ethnic  background,  gender,  and  social  class. 
Thirty  percent  of  all  Black  students,  25%  of  all  Hispanic 
students,  and  17%  of  all  White  students  were  retained  at 
some  point  between  kindergarten  and  eighth-grade. 
Twenty-five  percent  of  males  were  retained  as  compared 
to  15%  of  females.  Thirty-four  percent  of  students  from 
the  lowest  SES  quartile  were  retained  as  compared  to 
9%  of  students  .Torn  the  highest  SES  quartile.  Although 
the  overall  retention  rate  was  greater  for  Blacks  and 
males,  early  retainees  were  more  likely  to  be  White  and 
female  (despite  the  fact  that  early  retention  has  a stron- 
ger negative  impact  on  females  than  it  does  on  males). 
The  timing  of  the  retention  did  not  produce  consistent 
effects.  Early  retainees  outscored  later  retainees  on  some 
cognitive,  emotional,  and  behavioral  measures,  but  not 
on  other  measures. 

Meisels  and  Liaw  were  also  interested  in  know- 
ing whether  retention  produces  any  academic  benefits 
for  students  since  this  is  an  oft-cited  rationale  for  invok- 
ing the  practice.  After  controlling  for  students’  gender, 
racial/ethnic  background,  SES,  and  maternal  education, 
retained  students  had  significantly  lower  grades  and  test 
scores  by  eighth-grade  than  did  non-retained  students. 
Also,  retained  students  were  about  six  times  more  likely 
than  non-retained  students  to  have  learning  problems 
and  be  assigned  to  special  education  classes,  and  were 
about  twice  as  likely  to  have  emotional  or  behavioral 
problems.  But  because  the  NELS:  88  data-set  did  not 
include  scores  on  intellectual  ability,  Meisels  and  Liaw 
were  unable  to  statistically  control  for  that  factor,  and 
could  not  draw  a definitive  conclusion  about  the  subse- 
quent negative  effects  of  retention.  But  analyses  of  other, 
albeit  smaller  and  less  representative,  data  sets  that  have 
controlled  for  initial  ability,  have  reported  negative  ef- 
fects on  subsequent  academic  performance  as  a result  of 
retention.  The  overall  message  from  20  years  of  research 
seems  clear:  grade  retention  is  a practice  that  is  incon- 
sistent with,  if  not  antithetical  to,  the  philosophy  of  maxi- 
mizing classroom  learning. 

Adolescents  in  the  Classroom:  Better  Management 
Through  Behavioral  Engineering 

As  if  the  negative  findings  reported  by  Mciscls 
and  Liaw  on  the  effect  of  retention  aren’t  bad  enough, 
there  is  at  least  one  other  undesirable  consequence  of 
the  practice;  students  who  arc  a year  or  two  older  than 
their  classmates  tend  to  become  behavior  problems.  This 
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was  the  situation  in  which  educators  from  the  Charles- 
ton (MD)  County  School  District  found  themselves  in 
the  mid-1980s.  As  standards  for  promotion  were  in- 
creased because  of  a state-wide  reform  effort,  the  per- 
centage of  eighth-grade  students  who  were  at  least  one 
year  behind  grade  level  increased  from  34%  in  1983  to 
48%  in  1988.  Indices  of  student  misconduct  rose  in  con- 
cert with  the  retention  rate.  To  help  teachers  deal  with 
and  reduce  student  misbehavior,  Denise  Gottfredson, 
Gary  Gottfredson,  and  Lois  Hybl  designed  a behavior 
management  program  that  drew  heavily  from  operant 
conditioning  principles.  (Despite  being  either  ignored 
or  maligned  as  the  “empty  organism”  theory,  this  writer 
believes  it  offers  sound  and  useful  guidelines  for  help- 
ing students  acquire  a variety  of  new  behaviors.)  The 
program  was  evaluated  in  eight  middle  schools  over  a 
three-year  period.  The  results  of  their  evaluation  were 
reported  in  volume  30,  number  1 (1993)  of  the  Ameri- 
can Educational  Research  Journal. 

The  program  was  composed  of  four  components: 
establishment  of  a school  discipline  policy,  a behavior 
tracking  system,  teacher  training  in  classroom  organi- 
zation and  management,  and  teacher  training  in  the  ad- 
ministration of  positive  reinforcement.  The  school  dis- 
cipline policy  that  each  school  adopted  had  to  clearly 
state  rules  for  conduct,  specify  the  punishing  conse- 
quences for  infractions  of  the  rules,  and  specify  positive 
consequences  for  exhibiting  desired  behavior.  The  be- 
havior tracking  system  was  a computer-based  record  of 
each  student’s  positive  and  negative  behaviors.  Parents 
were  kept  informed  of  the  status  of  their  child’s  record 
and  encouraged  to  follow  through  at  home  on  whatever 
actions  were  taken  at  school.  Teachers  were  shown  how- 
to improve  their  classroom  organization  and  manage- 
ment practices  by  keeping  high  traffic  areas  free  of  con- 
gestion, making  sure  that  all  students  could  be  seen  by 
the  teacher,  making  frequently  used  materials  readily 
available,  and  clearly  stating  rules  for  behavior.  (Read- 
ers who  are  familiar  with  the  classroom  management 
literature  may  recognize  that  this  component  was  taken 
directly  from  the  work  of  Emmer,  Evertson,  Sanford, 
Clements,  and  Worsham.)  Lastly,  teachers  were  trained 


in  the  appropriate  use  of  positive  reinforcement. 

Because  of  differences  in  how  the  program  was 
communicated  to  teaching  staff  by  school  administra- 
tors, transfers  of  administrative  staff  out  of  the  target 
school,  and  differences  in  attitude  toward  the  program 
on  the  part  of  key  administrators,  the  researchers  divided 
the  eight  schools  into  high,  medium,  and  low  implemen- 
tation categories,  with  the  latter  category  serving  as  a 
control  group.  The  effect  of  the  program  was  evaluated 
by  comparing  how  students  and  teachers  responded  to 
several  sets  of  rating  scales  administered  at  the  begin- 
ning of  the  1987  school  year  and  at  the  end  of  the  1989 
school  year.  These  included  the  Classroom  Environment 
Assessment  (CEA),  teachers’  ratings  of  students  in-class 
behavior,  and  the  Effective  School  Battery  (ESB). 

Significant  changes  appeared  in  four  of  the  five 
CEA  ratings  and,  with  one  exception,  only  in  the  high 
implementation  schools.  Students  (but,  interestingly,  not 
teachers)  reported  an  increase  in  perceived  classroom 
order  (effect  size  = .62).  Classroom  organization,  rule 
clarity,  and  teacher  support  were  also  judged  as  having 
increased  (effect  sizes  of  0.53,  0.55,  and  0.35,  respec- 
tively). Rule  clarity  was  also  felt  to  have  increased  in 
the  medium  implementation  school. 

When  teachers  rated  students’  on-task  behav- 
iors, only  teachers  in  the  high  implementation  schools 
felt  that  students  paid  more  attention  to  their  academic 
work  and  disrupted  the  classroom  less  frequently  (effect 
sizes  = 0.09  and  -0. 12,  respectively). 

The  statistically  significant  changes  in  ratings 
by  students  of  their  own  misbehavior  and  of  the  rewards 
and  punishments  they  received  were  more  broad-based. 
Increases  in  self-reported  rebellious  behavior  and  receiv- 
ing rewards  were  reported  by  students  in  all  schools,  al- 
though the  increase  in  rebellious  behavior  was  smallest 
in  the  high  implementation  schools.  Only  students  in 
the  high  implementation  schools  reported  receiving  fewer 
punishments. 

Finally,  only  students  in  the  high  implementa- 
tion schools  reported  an  increase  in  the  fairness  of  rules 
(effect  size  = 0.52). 
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Voices  in  Education 


Marlene  Schommer,  Wichita  State  University 


Veteran  leaders  of  education,  as  well  as  newer  leaders,  have 
been  asked  to  respond  to  the  following  scries  of  questions: 

L Is  qualitative  research  accepted  as  legitimate  on 
your  campus? 

2.  How  do  you  view  the  trend  toward  qualitative 
resea  'ch  ? 

3.  Is  the  'e  an  increase  in  hostility  toward  those  who 
use  quantitative  research  methods? 

******************  ********* 

Qualitative  research  is  one  way,  among  many,  of 
gathering  information  and  interpreting  it.  If  one  views 
qualitative  research  as  sustained,  reflective  observation  and 
interpretation,  it  is  unquestionably  the  foundation  of  all 
science. 

Unfortunately,  like  “authentic  assessment”  it  has 
come  to  mean  much  more.  For  example,  one  leading  pro- 
ponent recently  praised  qualitative  research,  hailing  it  as 
an  alternative  to  research  methods  that  are  theory -driven, 
hypothesis-testing,  and  generalization-producing.  That’s 
nuts.  If  research  doesn’t  relate  to  anything  we  currently 
know  (i.e.,  theory-driven),  doesn’t  address  a question  of 
interest  (i.e.,  hypothesis-testing)  or  produce  knowledge  that 
others  can  use  (i.e.,  gcneralizable),  then  how  can  it  even  be 
called  research?  Dada  science,  maybe. 

The  biggest  problem  with  qualitative  research  isn’t 
that  it  isn’t  informative,  necessary,  and  rigorous — it  is  all 
of  these — but  that  it  has  devolved  from  a methodological 
approach  into  a social  and  political  ideology.  For  example, 
it  seems  as  though  qualitative  research  has  become  inextri- 
cably linked  with  feminist  pedagogy,  multiculturalism,  cco- 
sensitivity,  human  rights,  iab-animal  welfare,  gay/lesbian 
advocacy,  Democratic  politics,  and  so  on.  This  association 
with  unnecessary  political  and  social  baggage  causes  many 
scientists  to  regard  it  with  markedly  greater  suspicion  than 
one  would  view,  say,  ANOVA.  This  is  unfortunate. 

Another  problem  is  that  qualitative  researchers  and 
philosophers  of  science  have  not  maintained  the  kind  of 
critical  dialogue  that  would  help  consumers  of  the  research 
to  make  sense  out  of  it.  For  example,  is  qualitative  re- 
search falsifiable?  That  is,  if  one  accepts  the  notion  that 
ail  understanding  is  contextualized,  if  all  experience  is 
embedded  in  culture,  and  if  all  knowledge  is  personalized 
construction,  etc.,  then  can  any  interpretivist  claims  be  re- 
jected? If  so,  we  are  not  only  post-structuralist,  post- 
constructivist, and  post-modernist,  but  probably  post-sci- 
entific as  well.  That  would  be  a shame. 

Gregory  J.  Cizek 
The  University  of  Toledo t Toledo > Ohio 
*************************** 

Arc  qualitative  research  methods  legitimate?  Re- 
search is  a creative  act  that  can  be  done  in  many  ways. 


Science,  however,  is  a process  with  social  norms  designed 
to  produce  knowledge.  The  appropriate  question,  there- 
fore, is  w'hether  qualitative  methods  effectively  contribute 
to  this  process;  one  which,  as  I point  out  in  my  research 
methods  book,  turns  research  findings  into  knowledge. 

In  this  operation,  a series  of  individual  judgements 
of  the  research  must  result  in  a consensus.  These  are  judge- 
ments about  the  acceptability  of  the  researcher’s  interpre- 
tation of  the  data,  and  the  quality  and  representativeness  of 
the  data  in  relation  to  the  constructs  involved.  As  a con- 
sensus of  approving  judgments  develops  those  judgments 
are  made  by  those  closest  to  the  research  topic.  If  these 
judgments  are  positive,  those  further  from  that  field  either 
judge  for  themselves  or,  respecting  the  expertise  of  others, 
include  the  findings  as  knowledge  in  their  writing,  and 
eventually  their  textbooks.  But  the  experts  must  agree-is 
the  globe  warming?  The  process  is  the  same  for  qualita- 
tive and  quantitative  methods,  and  social  and  natural  sci- 
ences. 

Qualitative  research’s  legitimacy  derives  from  its 
contributions  to  this  process.  Qualitative  researchers  can 
create  a consensus  about  their  findings  and  do  contribute 
to  knowledge  building.  When  Becker  insightfully  concludes 
the  dependency  of  handicapped  persons  may  indirectly  re- 
sult from  the  expectancy  of  others  instead  of  directly  from 
their  handicap,  such  findings  change  the  typically  perceived 
view.  For  acceptance,  some  qualitative  research  findings 
may  require  validation  on  a scale  feasible  only  with  quan- 
titative methods.  But,  either  way,  qualitative  methods  con- 
tribute to  knowledge. 

So  are  qualitative  methods  legitimate?  Certainly, 
so  long  as  they  present  evidence  meeting  the  approving 
judgments  of  intelligent  researchers  of  any  orientation  as 
presenting  a strong  chain  of  reasoning  supporting  their  find- 
ings. 

David  R.  Krathwohl 
Hannah  Hammond  Professor  of  Education 
Emeritus , Syracuse  University 
*************************** 

A wide  variety  of  data  collection  methods  has  al- 
ways been  acceptable.  The  issue  is  not  how  the  data  are 
collected,  but  instead  what  view  of  knowledge  is  held  by 
the  researcher.  The  hostility  is  toward  logical  positivism 
rather  than  toward  quantification.  Observational  and  in- 
terview data,  for  example,  arc  often  summarized  quantita- 
tively by  qualitatively-oriented  researchers. 

Jason  Millman 
Cornell  University , Ithaca , New  York 
*************************** 
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Qualitative  research  is  not  only  accepted  in  my 
circle  of  professional  associates,  it  is  regarded  as  a very 
powerful  research  option.  I have  experienced  two  very  im- 
portant, nationally  recognized  research  breakthroughs  as  a 
direct  result  of  turning  to  qualitative  research  methods — 
one  in  the  arena  of  teacher  evaluation  and  the  other  in  un- 
derstanding the  state  and  status  of  current  classroom  as- 


sessment practices  of  teachers.  I regard  it  as  an  immense 
powerful  alternative.  I sense  no  increase  in  hostility  among 
my  professional  associates. 

Richard  J.  Stiggins,  Director 
Assessment  Training  Institute,  Portland,  Oregon 
* *** ** * * * ** ** * ************ * 
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In  this  Issue 


This  Issue  demarcates  a MWERA  era  characterized  by  retiring  Executive  Officer,  Charles  C.  Anderson  Jr.,  affection- 
ately known  to  MWERA  insiders  as  “Andy”.  Charles  completed  his  final  3-year  term  as  “the  keeper  of  our  books  and 
archives”  as  of  December  1994.  The  new  Executive  Officer  is  Jean  W.  Pierce,  who  is  professor  and  chair  of  educational 
psychology  at  Northern  Illinois  University.  Like  Andy,  Jean  has  had  a long-standing  association  with  MWERA.  She  served  on 
the  editorial  team  in  1980  when  this  Journal  was  first  launched  at  Northern  Illinois  University.  She  has  also  served  as  Secre- 
tary and  later  as  President  of  MWERA.  The  Cover  photo  for  this  Issue  honors  Northern  Illinois  University  because  of  its 
historic  role  in  nurturing  MWERA. 

This  Issue  presents  our  annual  CALL  FOR  PROPOSALS  from  our  VP  and  1995  Program  Chair,  Sharon  McNeely, 
Northeastern  Illinois  University.  We  also  introduce  our  journal  Features  and  our  Feature  Editors.  In  keeping  with  our  philoso- 
phy of  sharing  the  responsibility  for  this  Journal  we  identify  desired  new  Features  and  the  need  for  new  Feature  Editors.  See 
Association  News  (middle  blue  pages). 

Ayres  D’Costa,  Susan  Brookhart,  and  John  Surber 


ON  THE  COVER 

Volume  1 , Number  1 of  the  Mid- Western  Educational  Researcher  was  printed  in  October, 
1980.  Leonard  K.  Kise  and  Jean  W.  Pierce,  colleagues  in  the  Educational  Psychology  Faculty  at 
Northern  Illinois  University,  were  the  first  editors.  A shoestring  budget  forced  production  sim- 
plicity, and  made  reading  the  journal  a challenge.  Readers  found  a calendar  of  state  association 
meetings,  four  articles,  abstracts  of  five  other  articles,  and  an  abstract  of  a concept  paper  written 
by  a researcher  who  was  looking  for  others  with  whom  to  collaborate. 

The  photograph  on  the  cover  shows  "Le  Baron,"  a stabile  by  Alexander  Calder.  The 
sculpture  is  located  on  the  Northern  Illinois  University  campus  in  DeKalb,  Illinois. 

Northern  Illinois  University  enrolls  approximately  25,000  students  and  offers  programs 
in  the  basic  disciplines,  the  arts,  and  the  professions.  NIU  is  organized  into  colleges  of  Business, 
Education,  Law,  Liberal  Arts  and  Sciences,  Professional  Studies,  and  Visual  and  Performing  Arts. 
Programs  of  study  are  offered  in  130  contact  areas  in  37  academic  departments. 

The  Educational  Psychology  Department  offers  programs  leading  to  the  degrees:  Master 
of  Science  in  Education  and  Doctor  of  Education.  Areas  of  study  include  Human  Learning  and 
Development,  Research  Design  and  Data  Analysis,  Measurement  and  Assessment,  Program  Evalu- 
ation, Consciousness  Studies,  and  Gifted  Education. 
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Three  copies  of  the  manuscript  should  be  submitted  typed  double-spaced  (including  quotations  and  references)  on 
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Working  Toward  Foresight  and  Follow-through1 

Lyn  Como2,  Teachers  College,  Columbia  University 


Abstiact 

This  article  considers  recent  investigations  of  the  conditions  that  promote  forward-thinking 
in  young  people , and  the  realization  of  personal  goals.  Five  conditions  are  discussed:  environmental 
affordance  and  press,  mediational  strategies,  consequence  management , and  resources  for  coping.  Al- 
though the  potential  for  foresight  and  follow-through  may  exist  in  all  of  us,  individuals  have  different 
learning  experiences  with  respect  to  these  qualities,  depending  on  inequities  in  preparation  and  support. 
The  article  raises  critical  questions  about  these  inequities  and  suggests  ways  that  educators  might  help 
overcome  them. 


Bin  Watterson’s  syndicated  cartoon  strip,  “Calvin 
and  Hobbes,"  is  a virtual  compendium  of  psychological 
insights  into  childhood.  In  one  strip,  little  Calvin  asks  his 
“indispensiblc"  pal,  Hobbes  the  cat,  “What  do  you  think  is 
the  best  way  to  get  what  you  want?  Is  it  better  to  hold  fast 
and  never  back  down,  or  to  compromise?"  Hobbes  replies, 
“I  suppose  it’s  best  to  hold  fast  when  you  can,  and  compro- 
mise when  you  need  to."  Calvin's  response  is  “That's  a lot 
more  mature  than  I think  I care  to  be." 

Most  people  are  short-sighted  about  personal  goals, 
and  less  than  steadfast  in  their  pursuits.  Foresight  involves 
action  in  reference  to  the  future,  and  it's  easier  to  live  day- 
to-day.  But  foresight,  prudence,  or  discretion-and  the 
method  of  follow-through  that  accompanies  it— have  shown 
themselves  to  be  necessary  qualities  for  social  evolution 
throughout  history.  The  welfare  of  societies  has  always 
benefitted  from  human  foresight  and  follow-through. 

How  are  personal  qualities  like  these  given  force 
in  the  social  systems  we  create,  particularly  in  education? 
How  are  they  learned  or  enhanced  by  the  people  function- 
ing in  these  systems?  If  we  could  clarify  what  makes  com- 
munities and  individuals  inclined  to  “take  the  long  view." 
and  sec  their  work  as  instrumental  to  long-term  goals,  then 
education  might  better  influence  future  generations  in  this 
direction. 

Some  may  say  it's  naive  to  imagine  that  education 
could  help  students  plan  out  their  lives,  envision  possible 
futures  and  their  place  in  them,  and  give  up  the  easier  path 
of  living  day-to-day.  Taking  sustained  action  toward  long- 
term goals  instead,  is  particularly  problcinmatic  for  increas- 
ing numbers  of  young  people,  who  daily  confront  the  most 
serious  kinds  of  socio-economic  constraints.  But  it  might 
he  submitted  that  good  educators  help  students  work  toward 
foresight  and  follow-through  all  the  time-always  have.  And 
that  whatever  explanatory  concepts  have  evolved  about  the 
practice  of  doing  this  ought  to  be  more  widely  understood, 
as  we've  come  to  understand  concepts  that  undeiiy  the  prac- 
tice of  other  things,  e.g..  conducting  research. 


I.  Keynote  Address  to  MWISRA  Conference  1994 


According  to  the  dominant  conceptual  frameworks 
in  modem  psychology,  motivational  and  volitional  quali- 
ties like  foresight  and  follow-through  are  “socially  influ- 
enced" and  “cognitively  mediated"  (Day,  French,  & Hall, 
1985).  In  English,  w'c  say  that  people  help  to  shape  their 
own  destinies,  within  the  context  of  various  personal  and 
societal  resources  and  constraints.  Potentialities  develop. 
And  society  doesn't  mold  people  all  by  itself.  Some  living 
situations  afford  better  opportunities  for  particular  poten- 
tials to  develop,  and  press  people  toward  them.  People,  in 
turn,  are  more  or  less  inclined  to  note  and  seize  opportuni- 
ties at  different  points  in  their  own  developmental  cycles. 

These  two  empirical  observations— that  environ- 
ments vary  in  affording  opportunities  (or  affordance)  and 
press,  and  that  cognitive  mediation  is  partly  developmen- 
tal—imply  inevitable  diversity  in  the  arenas  of  human  moti- 
vation and  volition.  And  so  the  statement  that  “most  people 
are  shortsighted"  will  probably  always  be  accurate.  How- 
ever, wc  know  something  now*  about  the  directions  in  which 
environments  and  people  must  move  if  they  are  to  prepare 
and  support  individuals  as  they  work  toward  greater  fore- 
sight and  become  more  volitional.  Research  in  educational 
psychology  has  taught  us  some  things  about  how  people 
acquire  a “future  perspective"  and  learn  to  use  available 
resources  to  accomplish  long-term  goals  (Snow,  Corno,  & 
Jackson,  in  press).  This  research  has  also  provided  models 
of  productive  resource  management. 

Goal  coordination  and  resource  management  are 
two  of  the  intentional  systems  that  psychologists  believe 
underly  broad  constructs  like  foresight  and  follow-through. 
And  the  good  news  is  that  the  functioning  of  each  of  these 
systems  appears  susceptible  to  intervention  (see  e.g..  Sehunk 
& Zimmerman,  1994).  Strategic  self-management  can  be 
taught,  and  it  may  allow  some  people  to  gain  control  over 
potentially  problematic  aspects  of  temperament  such  as 
impulsivity  or  slow  response  to  change.  Individuals  can 
also  use  strategic  self-management  to  function  more  suc- 
cessfully in  resource-limited  environments. 


2.  Author  acknowledges  helpful  comments  by  Celia  Gcnishi 
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So,  any  parent  or  teacher  who  might  be  able  to 
intervene  at  the  process  level  with  children  could  have  in- 
fluence in  critically  important  ways.  The  Big  IF — if  enough 
parents  and  teachers,  counselors  and  social  workers,  did 
this  for  enough  children  in  enough  communities  and  insti- 
tutional contexts-may  be  v^orth  speculation  yet.  Perhaps 
over  the  long  run  vve  can  increase  the  mean  of  this  hypo- 
thetical “foresight/follow-through  distribution,"  even  if  we 
cannot  reduce  its  variance. 

Overview 

This  article  discusses  some  conditions  that  promote  fore- 
sight and  follow-through.  In  what  ways  can  these  motiva- 
tional and  volitional  qualities  be  developed;  in  what  ways 
are  they  being  developed,  socialized,  or  fostered  in  some 
places  and  with  some  young  people  right  now? 

In  writings  over  the  past  few  years  I've  tried  to 
make  the  case  for  bringing  volition  into  perspective  with 
motivation  in  educational  theory  and  research  (sec  e.g., 
Como,  1986:  1989;  1993;  1994).  Emerging  theory  and  evi- 
dence does  support  the  role  of  volition  in  various  aspects  of 
learning  and  performance.  But  what  is  this  modern  infor- 
mation processing  view  of  volition? 

Theory  from  Heinz  Heckhauscn  and  Julius  Kuhl 
(1985)  suggests  a “commitment  pathway"  connecting  moti- 
vation and  volition.  Motivation  establishes  goals,  while 
volition  implements  them.  Motivation  promotes  goals  w'hilc 
volition  protects  them.  Motivation  involves  individual  think- 
ing about  goals;  while  volition  involves  the  initiation  of  pro- 
cesses for  accomplishing  goals.  Motivation  embraces  fore- 
sight. while  volition  embraces  follow-through.  To  bring 
important  long-term  projects  to  completion,  individuals  must 
regulate  and  coordinate  the  many  instrumental  steps  neces- 
sary along  the  way.  pv»th  motivation  and  volition  are  im- 
portant psychological  components  involved  in  getting,  as 
Calvin  says,  “what  you  want." 

My  intent  here  is  to  offer  a somewhat  more  practi- 
cal agenda,  as  any  search  for  supporting  conditions  is  said 
to  be.  However,  it  will  be  clear  that  new  research  issues 
accompany  these  ideas  as  well. 

The  evidence  to  which  Til  refer  is  varied.  The 
research  is  not  always  conventional,  but  there  is  a lot  to 
draw  on.  Volumes  from  specialized  publishers  such  as 
Erlbaum.  dedicated  issues  of  archival  journals,  government- 
sponsored  conferences,  and  research  handbooks  can  all  be 
used  to  sift  out  recurring  findings  regarding  the  relevant 
conditions  that  promote  motivation  and  volition.  The  dan- 
ger is  to  trivialize  in  reaching  for  general  concepts;  this 
field  is  extremely  complex.  Also,  in  this  post-modern, 
deconstructivist  era.  certain  research  findings  need  to  be 
greeted  with  skepticism;  even  the  most  concrete  potential 
lessons  benefit  from  a critical  historical  lens. 

I shall  quote  several  points  made  previously  by  Lee 
J.  Cronbach.  It  was  almost  exactly  20  years  ago  now  that 
Cronhach  (1975)  delivered  his  Distinguished  Scientific  Con- 
tribution Award  address  to  the  American  Psychological  As- 
sociation on  new  possibilities  for  educational  research  (“Be- 
yond the  Two  Disciplines  of  Scientific  Psychology").  Many 
points  in  that  address  bear  repeating  today. 


The  Context  for  Selecting  Concepts 

I have  five,  general  explanatory  concepts  to  dis- 
cuss-abstract  concepts  that  have  been  objectified  in  vari- 
ous ways.  I'll  try  to  exemplify  the  nature  of  the  evidence  for 
each.  These  five  general  concepts  recur  in  research-based 
efforts  on  the  development  of  individual  foresight  and  fol- 
low-through w'ithin  various  social  settings  and  systems. 
They  are:  Environmental  affo rdance  and  press,  mediational 
strategies,  management  of  consequences , and  resources  for 
coping , respectively.  Each  concept  has  been  given  recent 
and  historical  attention  in  empirical  research;  each  also  has 
a legacy  in  educational  practice. 

Affordance  and  press  are  long-standing  concepts 
in  ecological  psychology,  reified  recently  in  the  growing  lit- 
eratures of  social  constructivism,  school,  and  curricular  re- 
form (see  e.g.,  Liebsnnan.  Saxl,  & Miles,  1988).  Mediational 
strategies  have  been  the  focus  of  much  correlational  and 
experimental  research  in  educational  psychology  and  sub- 
ject matter  learning  over  the  past  decade.  Of  course  conse- 
quence management  is  behaviorism's  soul;  but  how  this  plays 
into  the  more  complex  agendas  of  information-processing 
theories  of  motivation  and  volition  is  less  widely  known. 
Finally,  resources  for  coping  or  restoring  well-being  are  also 
fronted  in  modem  theories  of  volition,  w’hich  I shall  try  to 
explicate  again  today. 

1 will  come  in  the  end  to  the  critical  proposition 
that,  like  other  presumably  favorable  dispositional  tenden- 
cies, foresight  and  follow-through  require  opportunities  to 
develop.  The  potential  for  forward-thinking  and  follow- 
through  exists  in  all  of  us;  but  the  experience  of  learning 
not  to  be  short-sighted  in  life,  and  of  pressing  ahead  to  make 
things  work  for  you.  often  appears  fundamentally  different 
depending  on  the  circumstances  in  which  it  is  learned.  Not 
only  does  current  educational  practice  potentially  disadvan- 
tage individual  foresight  and  follow-through  along  status 
characteristic  lines,  even  within  status  groups,  many  of  us 
do  not  learn  to  display  these  qualities  along  anything  like  a 
“normative"  developmental  trajectory  (cf.  Scarr,  1988). 

The  development  of  foresight  and  follow  -through  has 
sociological  as  well  as  psychological  significance  for  individu- 
als and  societies,  because  these  personal  qualities  predict  per- 
formance outcomes  in  school  and  the  workplace,  and  they  do 
so  over  and  above  scholastic  aptitude  as  conventionally  mea- 
sured by  standardized  tests  (Willingham.  1985).  As  David 
Berliner  (1992)  has  noted,  employees  arc  more  frequently  dis- 
missed because  of  a failure  to  take  personal  responsibility  than 
they  are  for  poor  skills  in  algebra.  Misdirected  or  inappropri- 
ate effort  on  the  part  of  individuals  is  judged  to  put  the  whole 
corporate  enterprise  at  risk  (Weiner,  1994). 

Thus,  any  remarks  1 might  make  about  ways  to 
help  children  or  youth  toward  foresight  and  follow-through 
must  necessarily  distinguish  the  critical  features  of  contexts 
in  which  such  learning  takes  place.  Such  suggestions  can- 
not be  quick  fixes  for  social  failings.  In  the  same  spirit  of 
Kozofs  Savage  Inequalities  (1991 ).  perhaps  one  of  the  con- 
tributions this  work  might  make  is  to  further  expose  these 
differential  opportunities  to  learn,  in  hopes  that  they  might 
somehow  be  rectified  by  some  generation  some  day. 


The  Five  Concepts 

Let's  look  first  at  the  ecological  concepts  of  envi- 
ronmental affordance  and  press,  and  consider  them  together. 
They  situate  the  other  three  psychological  concepts  within 
the  larger  socio-political  arena  for  learning  about  foresight 
and  follow-through. 

Environmental  Affordance  and  Press 

Environmental  affordance  for  and  press  toward 
personal  responsibility  may  well  be  necessary  conditions  for 
volitional  self-control.  The  evidence  is  now  textbook  that 
forward-thinking  is  learned,  in  part  through  exposure  and 
the  experience  of  forward-thinking  in  life,  in  the  vicarious 
and  enactive  modeling  that  teaches  by  example  and  appro- 
priation, as  well  as  in  the  expressed  values  and  expecta- 
tions of  people  who  provide  support  along  the  way  (see  e.g, 
Bandura,  1986).  From  their  extensive  review  of  research  on 
children  of  poverty,  Knapp  and  Shields  (1991)  concluded 
that,  without  daily  living  environments  conducive  to  initi- 
ating and  sustaining  forward-thinking  in  learning  and  be- 
havior. conventional  successes  are  hard  won— in  school  and 
other  effortful  tasks. 

The  introduction  of  competing  environmental  mod- 
els can  help;  emergent  literacy  programs  for  high-risk 
preschoolers  have  received  significant  support  in  longitudi- 
nal, experimental  research  (Campbell  & Ramey,  in  press). 
A variety  of  school-based  programs  - Accelerated  Schools, 
“Success-for-All,”  and  Comer's  child  development  model- 
are  similarly  anchored  by  favorable  evaluation  studies  (see 
e.g..  Comer,  1988;  Levin,  1992;  Madden  et  al.,  1992).  But 
this  research  strongly  suggests  that  even  high-quality  com- 
peting models  must  be  given  increased  rather  than  reduced 
exposure  over  time,  and  must  be  accompanied  by  social, 
economic,  and  political  pressure  demands,  or  offered  assis- 
tance. As  sociologist  Robert  Merton  (1968)  once  observed, 
supports  and  opportunities  tend  to  spiral  upward  or  down- 
ward from  wherever  one  begins.  Thus,  from  Eliza  Doolittle 
to  Albert  Bandura,  we  learn  that  without  directed  affordance 
and  press,  it’s  just  too  hard  to  gather  and  sustain  the  mo- 
mentum necessary  to  internalize  competing  models. 

Psychologist  Robert  Eisenberger  (1992)  has  shown 
through  a number  of  experiments  that  effortful  behavior  is 
experienced  by  most  people  as  aversive.  To  get  people  to  do 
things  that  don't  come  easily,  the  experience  has  to  have  sec- 
ondary rewards.  It  may  then  be  viewed  as  valuable,  meaning- 
ful, or  at  least  useful  if  not  pleasurable  in  some  personal  way. 
And  it  is  now  recognized  that  these  secondary  rewards  often 
aren't  the  usual  idiosyncratic  extrinsic  rcinforcers.  For  many 
adolescents,  secondary  rewards  for  motivated  behavior  involve 
the  very  kind  of  social  interchange  and  peer  support  that  seems 
so  hard  to  come  by  in  their  everyday  environments. 

Now,  let  me  illustrate  more  specifically  the  par- 
ticular kinds  of  affordances  and  demands  to  which  this  lit- 
erature refers.  I submit  two  cases  in  point,  but  need  to  com- 
ment on  the  research. 

The  typical  educational  research  study  is  no  longer 
the  two-group  experiment  noted  by  Cronbach  tw-o  decades 
ago.  Over  the  past  three  years  of  editing  AERJ  (which  re- 
ceives over  200  manuscripts  a year  from  authors  represent- 


ing the  broad  constituency  of  AERA),  we  have  seen  increas- 
ing numbers  of  educational  interventions  supported  by  eth- 
nographic or  descriptive  accounts  of  contextualized  effects, 
rather  than  ‘‘true"  experimental  designs. 

We  seem  to  have  come  to  an  age  that  Cronbach 
(1975)  and  others  ushered  in,  where;  “observers  arc  more 
like  journalists  than  pure  scientists,  collecting  data  in  one 
particular  situation  and  appraising  a practice  or  proposi- 
tion in  that  setting,  observing  effects  in  context"  (p.  124). 
Research  has  progressed  to  the  generation  of  knowlege  use- 
ful for  practice  because  it  has  examined  practice  in  particu- 
lar education  arenas.  Cronbach  said  that;  “Intensive  local 
observation  goes  beyond  discipline  to  an  open-eyed,  open- 
minded  appreciation  of  the  surprises  Nature  deposits  in  the 
investigative  net.  This  kind  of  interpretation  is  historical 
more  than  scientific..."  (p.  125). 

One  example  of  this  kind  of  work  is  a unique  in- 
vestigation of  the  ways  in  which  both  formal  and  informal 
community  organizations  influence  inner-city  youth,  con- 
ducted by  Shirley  Brice  Heath  and  Milbrey  McLaughlin  in 
1993.  These  authors  used  anthropological  field  methods  to 
penetrate  previously  inaccessible  community  organizations 
in  the  hearts  of  urban  centers.  There  Heath  and 
McLaughlin's  team  found  so-called  “hopeful"  youth  who 
broke  away  from  strong  peer  groups  to  make  better  lives 
real  possibilities.  Without  leaving  the  inner  city,  these  youth 
responded  productively  to  competing  environments  that 
helped  them  take  the  long  view  on  enabling  actions  and 
events.  Notably,  there  were  a handful  of  people,  dubbed 
“wizards",  who  helped  the  hopefuls  along. 

Wizards  were  rarely  official  teachers  or  coaches; 
they  were  more  often  counselors  or  group  leaders  at  local, 
informal  youth  organizations  established  vithin  the  inner- 
cities  as  safe  houses  for  troubled  teens.  Some  of  these  orga- 
nizations were  rule-breaking  YMCAs;  but  more  commonly, 
they  were  unaffiliated  with  organized  groups.  They  were 
founded  and  sustained  by  informal  groups  of  formerly 
troubled  youth  or  particularly  dedicated  adults  whose  own 
personal  experiences  led  them  to  this  kind  of  work. 

According  to  McLaughlin  and  Heath  (1994),  the 
wizardry  worked  on  inner-city  kids  came  about  through 
affordance  and  press.  The  wizards  created  new  opportuni- 
ties, both  literally  and  figuratively,  for  these  youth  to  have 
different  lives.  They  secured  meeting  places,  recruited  as- 
sistants from  the  ranks  of  gangs,  and  solicited  donations  of 
computers,  tutors,  and  books.  Capitalizing  on  the  interests 
of  the  kids  they  served,  they  orchestrated  productions  of  films 
and  theatrics,  art  shows  and  concerts  for  community  dis- 
play-each of  which  developed  self-management  skills 
through  a process  of  creation  and  performance.  Because 
these  activities  put  participants  in  touch  with  schooled  con- 
cepts at  the  same  time  that  they  provided  experiential  feed- 
back and  rewards,  they  allowed  the  youth  to  see  that  experi- 
ences somewhere  in-between  school  and  games  can  serve 
these  functions  (Henderson  & Cunningham,  1994.  p.  266). 

The  youth  centers  stayed  open  after  hours  and  on 
weekends;  many  youth  spent  most  of  their  free  time  at  the 
centers,  in  hopes  of  protecting  themselves  from  peer  oppo- 


kfi,L  UVw< 


<1  /?/'!»*/ 1 i 


i/>r 


Vnlnmr  K Miimhta'r  I l Winlrr  I QOS 


sition.  The  adults  who  administered  programs  became  cen- 
trally involved  in  these  adolescents’  lives.  Through  their 
mediation  and  guidance,  the  wizards  served  as  examples  of 
how  increased  opportunities  could  be  seized  with  favorable 
consequences.  But  they  also  actively  pushed,  cajoled,  and 
pestered  these  youth  in  new  directions,  at  the  same  time 
that  they  buffered  them  from  peer  pressure  to  return  to  un- 
productive modes  of  thinking  and  behavior. 

Similar  results  can  be  found  in  research  on  the  topic 
of  “resilience”  among  inner-city  students  recently  catalogued 
by  Wang  and  Gordon  (1994).  Together,  studies  such  as  these 
identify  affordances  and  demands  for  foresight  and  follow- 
through  that  have  been  brought  successfully  into  adoles- 
cents* everyday  lives  under  quite  oppositional  socioeconomic 
conditions.  But  affordance  and  press  are  also  key  influ- 
ences on  foresight  and  follow-through  in  school  learning. 

Which  brings  me  to  my  second  case-and  that  is 
the  research  on  “achievement  goal  orientations”  associated 
primarily  with  Carol  Ames,  Carol  Dweck.  and  John  Nicholls 
(sec  e.g.,  Ames,  1985;  Dweck,  1988;  Nicholls,  1984).  Vari- 
ous correlational  and  experimental  investigations  of  stu- 
dents* developing  orientations  towards  school  have  now  care- 
fully uncovered  a variety  of  threats  to  their  long-term  aca- 
demic success.  Lepper  (1988)  annotated  these:  compara- 
tive performance  evaluation,  presentation  of  activity  as  test, 
expectation  of  potential  failure,  punishments,  and  unneces- 
sarily close  surveillance. 

Apparently,  there  are  many  identifiably  “perfor- 
mance-oriented structures”  in  the  average  student’s  school 
experience.  Beyond  the  controversial  matter  of  competition, 
schools  commonly  reflect  authoritarian  teaching  methods  that 
discourage  multiple  paths  to  goals,  and  inflexible  grouping 
and  tracking  arrangements.  Indeed,  performance-oriented 
structures  are  so  locked  into  schools  and  so  pervasive  that 
they  too  are  affordances  for  student  learning  (Maehr  & Midgley, 
199 1 ).  Unfortunately,  they  afford  opportunities  for  students  to 
learn  the  value  of  a performance  orientation-that  is.  the  ten- 
dency to  view  learning  as  simply  completing  a task  or  getting 
a grade  to  gain  favorable  judgments  of  competence.  This  is 
not  the  orientation  most  conducive  to  long-term  success  in 
education.  To  teach  students  the  relative  value  of  a mastery 
orientation  instead  (where  learning  is  viewed  primarily  as  con- 
structing meaning-as  an  interpretive  process  of  understand- 
ing reality),  we  must,  this  work  suggests,  significantly  reform 
many  of  the  things  we  conventionally  do  in  schools. 

And  so  Central  Park  East  High  School  in  New  York 
City,  and  other  schools  influenced  by  this  reform  perspective, 
now  emphasize  the  value  of  curricular  activities  that  promote 
knowledge  construction  between  teachers  and  students;  that 
is.  “instructional  conversations”  in  which  teachers  and  stu- 
dents confront  challenging  topics  over  extended  time-periods 
(see  e.g.,  Henderson  & Cunningham,  1994;  Meier.  1992).  Simi- 
lar “co-constructivist”  interventions  implemented  systemati- 
cally by  teams  of  motivation  researchers  (e.g.,  Blumenfcld,  et 
ul.,  1994)  also  find  that,  when  teachers  (a)  work  with  students 
instead  of  talk  to  them,  (b)  balance  intervention,  withdrawal, 
critique,  and  encouragement  in  student  interactions,  and  (e) 
structure  reward  systems  to  reduce  the  threat  of  failure,  then 


deep  learning  and  progressive  master)'  tends  to  occur  (see  also 
Ames,  1985;  Csikszentmihalyi  & Larsen,  1984;  Moll,  Amanli. 
Neff,  & Gonzalez,  1992;  Xu,  1994).  Students,  in  turn,  feel 
good  about  themselves  as  learners  and  become  more  likely  to 
persist  in  school.  Thus,  in  schools,  affordance  and  press  for 
foresight  and  follow-through  can  be  defined  to  comprise  a 
range  of  progressive  mastery  variables  that  may  have  func- 
tionally equivalent  effects  — increased  learning  opportunities 
and  time  to  improve,  choices  within  limits,  establishing  sen- 
sible work-schedules,  and  discussion  of  tasks  to  do  first.  The 
staple  progress  charts  of  most  textbook  assessments  are  used 
to  inform  individual  students  of  their  growing  mastery  of  a 
subject,  not  to  display  competence  relative  to  others.  As  Judith 
Meece  (1994)  writes,  in  “high  mastery”  classrooms,  “teachers 
modify  lessons  to  increase  their  personal  relevance,  provide 
opportunities  for  peer  collaboration....  and  emphasize  the  in- 
trinsic value  of  the  learning  material.  Grades  and  other  ex- 
trinsic incentives  are  rarely  used  to  motivate  students”  (p.  36). 
Again,  under  conditions  such  as  these,  students  expend  more 
effort,  report  deeper  processing  of  material,  and  more  readily 
resist  distractions  in  completing  their  work  (see  Pintrich  & 
Schrauben.  1989).  Research  on  schools  that  have  been  par- 
ticularly successful  with  racial/  ethnic  minority  students  sup- 
ports the  emphasis  on  a mastery  orientation  as  well  (e.g., 
Goodwin  & Carter.  1993;  Lucas,  Henze.  & Donato,  1990;  Moll, 
et  al..  1992).  Unfortunately,  as  Linda  Darling-Hammond  has 
pointed  out  repeatedly  (see  e.g.,  1994),  with  few  exceptions, 
these  kinds  of  reforms  are  not  in  place  in  inner-city  schools. 

Given  growing  evidence  that  expertise  of  all  kinds 
is  learned  through  extended  and  supervised  practice  on  tasks 
like  those  to  be  performed  in  the  future  (Ericsson  & Chamess. 
1994),  expertise  in  “studenting”  ought  to  be  no  different. 
Thus,  unconventional  youth  organizations  run  by  wizards 
for  hopeful  and  “rcsilent”  students,  and  progressive  mas- 
tery school  environments,  are  two  complementary  forms  of 
affordance  and  press  for  developing  foresight  and  follow- 
through  within  the  experiences  that  young  people  encoun- 
ter every  day.  Common  sense  suggests  synchronizing  these 
two  different  strands  of  research  in  future  efforts  to  help  all 
children  work  toward  foresight  and  follow-through. 

Median  ona!  St  rat  eg  i es 

Beyond  the  ecological  influences  arc  the  underlying 
motivational  and  volitional  processes  in  which  human  beings 
engage.  Mcdiational  processes  of  various  forms-mostly  cog- 
nitive and  meta-cognitive  —have  been  the  focus  of  over  20 
years  of  cognitive  and  social -cognitive  research.  As.  Cronbach 
said  in  1974,  “We  expect  a close  scrutiny  of  cognitive  pro- 
cesses to  be  a profitable  next  phase  of  work...  ”,  and  it  was. 

Non-cognitive  processes  are  increasingly  given  the 
same  scrutiny.  There  is,  for  example,  strong  evidence  that  it 
helps  people  to  define  the  strategies  they  can  use  to  set  and 
pursue  goals,  as  well  as  the  procedures  that  support  commit- 
ments to  the  point  ol  accomplishment.  Much  of  this  work  1 
reviewed  with  Ruth  Kunfcr  in  1993  (see  also  Schunk  & 
Zimmerman,  1994).  Environmental  affordance  and  press  may 
he  necessary,  hut  they  arc  insufficient  conditions  for  some  per- 
centage of  individuals  who  seem  to  need  explicit  instruction 
in  strategic  procedures.  Being  taught  ways  to  manage  people 


and  tasks,  as  well  as  one's  own  (personal)  motivations  and 
thoughts,  helps  persistence  and  performance  to  improve. 

One  example  comes  from  a series  of  Air  Force  re- 
cruit. studies  on  air-traffic  control  conducted  by  Ruth  Kanfer 
and  Philip  Ackerman  (1989).  These  researchers  found  that 
with  adult  learners,  complex  learning  can  be  well-supported 
by  even  minimal  discussion  of  strategies  for  motivation  and 
emotion  control.  Simply  instructing  the  recruits  to  be  con- 
scious of  what  they  were  telling  themselves  about  this  task, 
and  about  ways  to  control  excessive  rumination  proved  suf- 
ficient to  produce  performance  gains.  The  researchers’  in- 
structions to  these  subjects  eliminated  what  has  been  la- 
beled a “production  deficiency"  in  the  area  of  volitional  con- 
trol. With  children  as  subjects,  on  the  other  hand,  the  prob- 
lem often  appears  more  complicated. 

Children  seem  to  need  more  explicit  instruction  in 
how  to  use  relatively  abstract  motivation-  and  emotion-man- 
agement strategies.  They  also  need  discussions  of  why  it 
matters  to  set  subgoals,  and  how  they  can  productively  bud- 
get time  and  energy  in  school,  on  homework,  and  on  other 
challenging  tasks.  The  deficiency  in  children-or,  in  better 
terms,  the  missing  opportunity-is  in  “mediation"  rather  than 
in  "‘production."  That  is.  they  actually  need  to  learn  the 
self- regulatory  tactics  and  how  to  use  them.  Knowledge  of 
strategies  related  to  foresight  and  follow-through-how  to 
control  information  processing,  motivation,  and  emotion- 
normally  develops  after  age  7,  with  wide  individual  differ- 
ences marking  this  trajectory  (Kuhl  & Kraska.  1989). 

An  important  observation  from  classroom-oriented 
research  is  that  this  “explicit  instruction"  finding  tends  to 
run  along  status  characteristics  as  well  as  developmental 
lines  (McCaslin  & Good,  1994).  Cmnbach  reported  in  1975 
that  lower-performing,  minority,  and  lower-SES  children 
tend  to  benefit  from  explicit  instruction  more  than  other 
children  {p.  121 ).  The  “benefits"  of  explicit  instruction  to 
which  he  refers  are  of  course  conventionally  defined  as  in- 
creased standardized  test  scores.  Although  limited  oppor- 
tunities may  indeed  exist  for  early  exposure  to  volitional 
strategies  in  some  home  environments  within  this  society, 
it  needs  to  be  said  clearly  that  there  are  dominant  cultural 
values  implicit  in  findings  such  as  this.  And  only  recently 
have  research  methods  evolved  to  the  point  of  penetrating 
homo  settings  in  a way  that  might  challenge  these  claims. 
These  findings  have  too  often  been  misinterpreted  as  ratio- 
nale for  compensatory  practices  and  imposed  control  in 
schools  that  serve  large  numbers  of  minority  children. 

As  a result  of  notable  efforts  by  Michael  Pressley  and  Karen 
Harris,  explicit  strategy  instruction  is  now  becoming  better 
known  to  educational  researchers  (see  e.g.,  Pressley.  Har- 
ris. & Marks,  1992).  Experimental  instructional  interven- 
tions have  begun  to  demonstrate  fa\orablo  results.  But  lon- 
gitudinal studies  are  rare,  and  many  such  efforts  continue 
to  meet  with  implementation  problems.  Most  teachers  don't 
currently  teach  cognitive  or  volitional  strategies  directly, 
and  doing  this  well  has  proved  challenging  even  for  supe- 
rior teachers  (Pressley,  et  al.,  1989).  1 would  also  question 
the  curious  nature  of  these  (and  other)  educational  programs 
that  locate  the  implementation  burden  solely  in  the  hands 
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of  teachers.  Parents,  coaches,  and  school  psychologists  also 
need  to  learn  ways  to  inculcate  and  reinforce  strategic  self- 
regulation in  children,  because  even  the  best  instructional 
programs  are  short-lived  and  fade  in  appeal. 

Moreover,  directly  addressing  the  motivational  and 
volitional  strategies  that  underly  foresight  and  follow- 
through  is  the  exception  rather  than  the  rule  in  published 
strategy  induction  studies  (Dole,  et  al.,  1991).  And  yet,  we 
know  from  correlational  research  that  students  believe  they 
are  better  able  to  reach  their  goals  in  the  long  run  when 
they  have  these  strategies  available.  When  they  are  able  to 
deliberately  prioritize  and  coordinate  multiple  goals,  to  ef- 
fectively manage  their  time,  to  monitor  progress,  and  to 
control  intrusive  motivational  or  emotional  states  as  they 
work,  students  tend  to  feel  better  about  their  potential  for 
academic  success  (Britton  & Tcsscr,  1991;  Karabenick  & 
Knapp,  1988;  Macan  et  al.,  1990;  Pintrich  & DeGroot,  1990). 
Again,  it  seems  tremendously  important  to  pursue  alterna- 
tive interventions  for  children  from  diverse  backgrounds  who 
might  be  assisted  to  learn  these  mediational  strategies  in 
ways  that  avoid  rigidly  prescribing  procedures. 

Another  unconventional  study  illustrates  this  kind 
of  work.  In  1992,  Luis  Moll  and  his  colleagues  entered 
working-class  Mexican  and  Mexican-American  communi- 
ties in  Arizona  to  develop  teaching  innovations  that  drew 
upon  what  they  called  home-based  “funds  of  knowledge." 
Overturning  the  prevailing  view  that  working-class  fami- 
lies are  somehow  as  intellectually  impoverished  as  they  are 
economically,  these  researchers  identified  household  and 
community  resources  used  by  extended  families  to  develop 
in  their  children  the  essential  knowledge  and  skills  for  au- 
tonomous functioning  on  culturally  necessary  tasks.  Infor- 
mation about  farming  and  animal  management,  knowledge 
about  construction  and  building,  and  related  business  mat- 
ters were  historically  endemic  to  the  Mexican-American 
border  populations  that  Moll  and  his  group  studied.  In  con- 
trast to  some  other  research  on  “culturally  sensitive  or  re- 
sponsive curricula."  the  emphasis  of  this  research  was  on 
strategic  knowledge  and  activities  essential  for  household 
functioning  and  regional  productivity,  rather  than  on  cul- 
tural artifacts  such  as  story-telling,  crafts,  or  dance. 

The  children's  classroom  teachers  collaborated  in 
the  ethnographic  research,  and  used  the  data  collected  in 
homes  to  generate  academically  rigorous  instructional  in- 
novations that  bridged  between  the  students'  worlds  and 
their  classrooms.  There  were  units  on  cooking  candy,  equip- 
ment maintenance,  ranching,  farming,  and  masonry.  These 
topics  were  used  by  teachers  to  instruct  students  in  “inquiry 
processes,  becoming  active  learners,  and  on  strategically 
using  their  social  contacts  outside  the  classroom  to  access 
new  know  ledge  for  the  de\  elopment  of  their  studies"  (p.  158). 

These  researchers  established  what  1 view  as  a new 
definition  of  “homew  ork."  w here  “work  at  home"  is  brought 
into  the  classroom  to  further  the  agenda  for  foresight  and 
follow-through  (Hill.  I992>.  The  importance  of  their  work 
lies  in  ihc  observation  of  the  teachers  involved  that  their 
classroom  instiuction  prior  to  this  ethnographic  research 
tended  to  preclude  these  students  using  much  of  the  knowl- 
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edge  they  already  had,  and  to  position  the  students  as  devi- 
ant in  relation  to  the  norms  of  the  larger  school  community. 

Managing  Consequences  . 

If  knowledge  gained  from  the  first  three  sources  or 
conditions  I've  discussed  is  to  be  sustained  over  time,  there 
needs  to  be  palpable  and  valued  payoff  for  the  efforts.  Be- 
cause people  self-monitor  and  self-evaluate  (that  is,  they 
seek  feedback),  they  also  look  for  reasons  to  persist  or  not 
(Mithaug,  1992).  Social-cognitive  theory  provides  many 
explanations  for  persistence  beyond  extrinsic  rewards. 
Among  the  most  critical,  according  to  supporting  research 
by  Bandura  (1986)  and  Schunk  (1994),  are  positive  feedback 
on  personal  performances  and  other  evidence  of  progress. 

Some  still  believe  that  education  is  all  about  manag- 
ing consequences  to  reinforce  effort;  the  “exchange  of  perfor- 
mance for  grades"  metaphor  has  been  in  the  literature  for  thirty 
years  (Becker,  Geer,  & Hughes,  1968).  But,  to  work  toward 
foresight  and  follow-through,  children  need  to  begin  to  man- 
age their  own  consequences.  As  Deci  and  Ryan  (1987)  have 
argued,  it's  hard  to  learn  to  do  that  in  conventional  classrooms 
where  consequences  are  managed  prodigiously  on  students' 
behalf.  Theorists  agree  that  self-regulation  of  effort  involves 
a gradual  removal  of  the  scaffold  and  a press  to  fly  solo  (Bereiter 
& Scardamalia,  1982;  Brown,  Collins  & Diguid,  1989;  Mithaug, 
1992;  Rogoff,  1993).  So  why  don't  more  adults  who  work  with 
children  do  this  as  a matter  of  course? 

A study  of  parent-child  interactions  around  home- 
work, recently  conducted  at  Teachers  College  (Xu,  1994),  found 
that  co-dependency  is  less  risky  emotionally  for  some  parents. 
Other  parents-again,  many  in  distressed  urban  areas-have 
legitimate  survival  motives  for  remaining  “in  charge"  beyond 
conventional  points  in  their  children’s  functioning.  Research 
on  teacher  beliefs  about  their  own  effectiveness  has  also  found 
that  control  of  reinforcement  is  something  teachers  won't  eas- 
ily yield  in  classrooms  where  compliance  is  valued  (see  e.g., 
Bandura,  1992:  McCaslin  & Good,  1992;  Pajares,  1992). 

Beyond  the  need  for  a better  understanding  of  the 
extent  to  which  home  and  school  systems  really  do  much  to 
instill  personal  consequence-management  in  children,  we 
can’t  forget  that  communities  also  institutionalize  ways  of 
reinforcing  attitudes  and  collectively  valued  behavior.  In- 
stead of  local  news  plaudits,  however,  new  opportunities 
need  to  arise  for  students  who  increase  their  efforts.  We 
cannot  continue  to  punish  effortful  behavior.  When  com- 
munities begin  to  ensure  that  doors  will  open  to  jobs,  col- 
leges, and  related  positions  of  authority,  then  students  will 
have  palpable  signs  of  progress  in  working  tow  ard  foresight 
and  follow-through.  Schunk  (1994)  calls  this  “direct"  evi- 
dence of  progress.  This  is  as  true  broadly  within  society  as 
it  is  within  particular  school  systems. 

Unfortunately,  it  was  recently  noted  in  a New  York 
Times  article  that  persistent  students  are  more  commonly 
rewarded  upon  graduation  from  high  school  with  jobs  at 
waiting  tables.  The  structural  problems  of  society  ought 
not  to  be  overlooked  in  attempts  to  teach  strategies.  John 
Buckner  of  the  Better  Homes  Foundation  in  Massachusetts, 
recently  likened  the  problem  of  homelessness  to  a game  of 
musical  chairs. 


I think  his  analogy  stretches  to  the  problem  of  job- 
lessness, as  well  as  many  other  apparently  “individual"  prob- 
lems. Buckner  puts  it  this  way,  “Let’s  say  that  the  musical 
chairs  represent  the  amount  of  affordable  housing  available 
for  the  poor.  And  let's  say  there  are  ten  people  and  eight 
chairs.  Two  people  in  particular  are  especially  likely  to  be 
left  standing  w'hen  the  music  stops,  because  they’re  less 
quick,  more  polite,  less  aggressive,  or  whatever.  Then  let's 
say  we  created  an  intervention  to  help  those  people  get  chairs. 
You'd  still  end  up  with  two  people  who  don't  have  chairs" 
(Buckner  quoted  in  DeAngelis,  1994,  p.  39).  Education  that 
better  equips  a generation  for  jobs  by  fostering  foresight 
and  follow-through  in  its  students  still  leaves  many  of  them 
without  jobs  when  jobs  are  too  scarce. 

Until  there  is  social  and  economic  progress  on  such 
fronts,  educators  should  do  more  to  support  students  who 
have  to  meet  with  life  after  high  school.  Wc  can  help  them 
to  direct  their  developing  foresight  and  follow'-through  in 
ways  that  are  productive,  partly  by  increasing  their  under- 
standing of  relevant  psychological  processes. 

Resources  for  Coping 

One  of  the  things  that  modern  theory  and  research 
on  volition  rather  uniquely  emphasizes  is  the  need  to  learn 
to  find  and  use  resources  for  coping.  Clinical-psychologi- 
cal research  long  ago  established  that  there  are  significant 
advantages  when  individuals  can  cope  cognitively  and  emo- 
tionally in  the  face  of  both  real  and  imagined  adversity.  The 
new  work  on  coping  in  volitional  psychology  includes  the 
notion  that  education  can  assist,  individuals  and  the  com- 
munities that  comprise  them,  in  learning  to  move  forward 
despite  real  obstacles  (Corno,  1992;  Wang  & Gordon. 1994). 
Education  in  coping  may  be  another  necessary  condition, 
in  particular  for  youth  to  whom  the  college  or  employment 
doors  do  not  readily  open. 

The  most  relevant  studies  are  of  self-reported  strat- 
egics. Paul  Pintrich  (Pintrich  & DeGroot,  1990)  and  Claire 
Weinstein  (Weinstein  & Mayer,  1986),  and  various  person- 
ality/social psychologists  (e.g..  Cantor  & Kihlstrom,  1987) 
have  studied  academic  coping  in  college  and  pre-college 
students  (see  also  Boekaerts.  1993).  We  know  that  many 
young  people  develop  coping  strategies  that  work  exceed- 
ingly well.  Unfortunately,  these  are  often  of  the  defensive, 
“tighten-up  and  turn  away"  (or  self-handicapping)  variety, 
rather  than  the  more  “open  up,  turn  toward"  (or  self-sus- 
taining) variety  that  modern  volition  theory  advocates. 
Avoiding  the  investment  of  effort  in  learning  and  achieve- 
ment is  a mindful,  volitional  activity  with  alternative  moti- 
vational roots  (Covington  & Beery.  1976;  Rollctl,  1987). 

It  is  not  uncommon,  for  example,  to  read  studies 
which  demonstrate  that  young  people  often  set  unrealistic 
goals,  fail  to  learn  from  failures,  and  avoid  success  instead 
(see  Eccles,  ct  al.,  1983:  Rohrkcmpcr  & Como,  1988).  Or 
that  they  procrastinate  in  their  work,  blame  others  for  mis- 
takes. or  display  worse  “social"  pathologies  when  confront- 
ing disappointment.  Some  developmental  research  (Rollett. 
1987)  links  unsupporlivc.  restrictive  intervention  styles  of 
parents  and  teachers  with  the  emergence  of  effort-avoid- 
ance in  children.  The  more  teachers  or  parents  use  pres- 


sure  to  motivate  in  such  cases,  the  quicker  effort -avoidance 
appears. 

Again,  we  have  with  this  research  the  noteworthy 
situation  in  which  less-effective  coping  mechanisms  are  most 
often  reportedly  observed  in  younger  students  and  students 
who  have  had  the  fewest  opportunities  to  learn  some  other 
way  (see  e.g..  Boekaerts,  1993).  As  David  Berliner  (1993) 
said  recently.  “Where  we  see  (such  problems  in)  schools, 
we  also  see  poverty,  inadequate  health-care,  dysfunctional 
families,  and. ..neighborhoods../'  (p.  640). 

Modern  theories  of  volition  also  distinguish  be- 
tween debilitating  and  intelligent  effort-avoidance;  that  is, 
intelligent  budgeting  of  minimal  effort  to  reach  desired  goals 
(Simon's,  1982,  concept  of  “satisficing").  Intelligent  effort- 
avoidance  or  “disengagement"  can  be  a healthy  reaction  to 
extremely  demanding  situations  (Kuhl.  1984).  Discontinu- 
ing work  or  temporarily  reducing  performance  standards 
(little  Calvin's  strategy  of  "compromise")  needs  further  study 
as  an  adaptive  device  that  helps  students  to  "restore  well- 
being" (Boekhaerts.  1993). 

This  is  one  among  several  "resource  management 
strategics"  that  volition  theory  suggests-that  is.  teaching 
students  ways  to  use  their  own  internal  resources  to  cope 
with  difficult  situations,  as  well  as  ways  to  locate  luird-to- 
find  external  resources  for  coping  with  challenging  events. 
Resourcefulness  in  finding  sources  of  support  is  a talent 
that  needs  to  be  developed.  It  often  involves  pausing  to 
assess  situations,  reflecting  on  goals,  and  ruling  out  options; 
careful  monitoring  and  pointed  effort  to  alter  perceived  stres- 
sors. or  to  seek  out  sources  of  support  (see  also  Suls& 
Fletcher,  1986).  Envisioning  oneself  carrying  out  \arious 
plans  of  attack  and  compromising  have  now  become  staple 
recommendations  of  self-help  programs,  as  have  attempts 
to  regulate  negative  emotions  and  regain  self-control 
(Boekaerts.  1993). 

Beyond  the  difficulties  of  students'  external  (liv- 
ing) conditions,  they  must  also  learn  to  cope  with  the  well- 
documented  hidden  curricula  of  schools— repetitive  tasks, 
passive  lessons,  and  preferential  treatment  by  teachers  to 
name  just  a few  . Coping  is  necessary  for  both  motivational 
stress,  such  as  boredom:  and  emotional  distress,  such  as 
frustration. 

Most  of  the  literature  that  guides  interventions  in 
this  area  is  based  on  clinical  or  cognitive-behavioral  mod- 
els (see  e.g..  Watson  & Tharp's.  1993).  A recent  doctoral 
dissertation  by  l.aVergne  Trawick  (1991 ) at  Teachers  Col- 
lege tried  a short-term  cognitive-behavioral  intervention  as 
part  of  a study-skills  course  for  inner-city  junior  college  stu- 
dents. Trawick  found  that  introducing  truly  enhancing  vo- 
litional strategics  in  the  complicated  lives  of  these  students 
w as  easier  said  than  done,  even  for  an  insider  who  knew  the 
culture  well  (see  aKo  Trawick  Cornu,  in  press). 

Because  I've  been  interested  in  this  area.  I'm  al- 
ways seeking  new  research  to  shed  light  on  critical  issues. 
A recent  study  conducted  In  Gotlman.  Moovcn.  and  Kat/ 
tioni  the  University  of  Washington  caught  my  eye  in  a press 
report  (Chita.  1994 1.  The  study  was  hilled  as  useful  for  help- 
ing parents  teach  their  children  liovv  to  manage  emotions. 


These  researchers  interviewed  more-lo-less  pur- 
portedly “happv"middle-class  families,  over  a period  of  a 
few  years,  about  emotional  issues  in  the  family  and  with  the 
children.  They  also  observed  parents  as  they  worked  with 
children  to  complete  iw'o  developmental!)'  challenging 
school-likc  tasks.  Their  diverse  set  of  outcome  measures 
included  stress  hormone  levels  in  the  children's  blood  and 
heart-rates  as  well  as  attention-span,  behavior,  and  academic 
achievement.  Scores  were  more  positive  on  all  these  mea- 
sures at  age  8 when  "parents  paid  attention  to  their  own 
emotions  and  could  teach  their  children  self-awareness  and 
self-control  beginning  at  age  4 or  5 (Chira,  1994;  p.  8)." 
Results  like  these  are  consistent  wuth  other  research  on  self- 
control.  much  of  which  also  happens  to  be  conducted  on 
middle-class  families  (MischeL  Shoda.  & Rodriguez,  1989). 

The  University  of  Washington  team  concluded  their 
w ork  w'ith  a list  of  "principles  for  parents  on  how  to  coach 
their  children's  emotions."  including  things  like  "explore 
the  emotion,  don't  ignore  it,"  "validate  and  emphathize," 
and  “consider  alternative  ways  of  dealing  with  the  emo- 
tion." They  also  described  examples  of  situations,  in  which 
the  parents  did  this  well  and  poorly,  for  use  as  reference 
points.  Many  clinically  based  interventions,  including 
LaVergne  Trawick's.  follow  this  logic. 

But  post-modernism  has  taught  us  to  reflect  criti- 
cally on  recommendations  like  these.  And  doing  that  sug- 
gests that  general  recommendations  are  often  naive  or  even 
unfounded.  U v ~d  to  be  that  the  criteria  for  offering  rec- 
ommendations for  practice  were  considered  satisfied  if  re- 
search findings  were  educationally  or  psychologically  sound, 
and  buttressed  by  sufficient  evidence.  Well,  we've  learned 
from  the  past  20  years  of  educational  research,  that  effect- 
ing change  in  the  psychosocial  functioning  of  children  won't 
be  accomplished  by  dispensing  lists  of  principles  based  on 
middle-class  data. 

Even  if  the  evidence  were  truly  "sufficient"-  gen- 
erated. for  example,  on  diverse  and  representative  samples- 
- lists  of  principles,  offered  to  imagined  audiences  on  re- 
search-studded platters,  are  still  symbolic  of  a kind  of  sci- 
entific elitism.  Principles  have  been  deconstructed  in  the 
1990s— and  not  just  politically.  Karen  Zumwalt  said  much 
the  same  thing  about  providing  teachers  with  lists  of  in- 
structional principles  derived  from  process-product  research 
on  teaching  in  1982.  The  kind  of  work  we  do-in  diverse 
schools  and  with  many  different  student  populations— has 
raised  consciousness  and  humbled  psychologists,  perhaps 
in  particular  about  what  really  can  be  accomplished  in  edu- 
cational practice  through  research. 

It  has  now  become  almost  an  old  saw  that  many  of 
the  phenomena  observed  in  education  are  so  subtle  and 
multi  layered,  and  so  situated  locally,  that— as  Cronbacli 
wrote  twenty  years  ago— general  principles  lack  meaning. 
Findings  don't  "ring  true"  for  all  kinds  of  people  and  all 
conditions.  This  is  not  to  say  that  families  below  the  pov- 
erty line,  or  those  in  the  upper  socio-economic  lev  els  of  so- 
ciety. would  not  benefit  from  research  on  coaching  children 
in  emotion  control.  It  is  that  all  general  principles  need  to 
he  tailoied  to  contexts  in  which  they're  used. 


Cronbach  said,  "As  a researcher  goes  from  situa- 
tion to  situation,  the  first  task  is  to  describe  and  interpret  an 
effect  anew  in  each  locale,  perhaps  taking  into  account  fac- 
tors that  were  unique  to  that  locale  or  series  of  events.  As 
results  accumulate,  a person  who  seeks  understanding  will 
do  his  (sic)  best  to  trace  how  the  uncontrolled  factors  could 
have  caused  local  departures  from  a modal  effect.  That  is, 
generalization  comes  late,  and  the  exception  is  taken  as  seri- 
ously as  the  rule... every  community  needs  its  own  local  evalu- 
ation of  any  program  for  change”  (p.  124-125).  This  was 
certainly  true  of  what  Trawick  learned  in  trying  to  teach  cop- 
ing skills  to  New  York  City  junior  college  students,  and  I sus- 
pect it's  true  for  interventions  with  younger  children  as  well. 

Summary  and  Conclusion 

To  sum  up,  a forward-looking  perspective  on  realistic 
goals  facilitates  the  effectiveness  with  which  individuals 
actually  realize  their  long-term  goals  (Lens  & Gailly,  1980). 
But  people  work  toward  foresight  and  follow-through  in 
different  ways,  depending  on  the  societal,  community,  and 
familial  opportunities  they  experience  and  begin  to  appro- 
priate. More  societal,  community,  and  familial  opportuni- 
ties of  longer  duration  force  a kind  of  osmosis  upon  young 
people.  A bombardment  of  models,  high  adult  expectations, 
and  preparation  and  support  for  motivational  and  volitional 
mediation  in  the  context  of  recurring  school-like  events  pro- 
duces one  kind  of  learning  about  foresight  and  follow- 
through.  This  is  what  Salomon  and  Perkins  (1989)  have 
called  “low-road  learn  ing”-at  its  best.  For  most  students 
so  exposed,  it  does  not  take  a lot  of  deliberate  thinking  about 
what  is  being  taught  for  the  transfer  of  knowledge  to  occur. 

Along  the  margins  of  society,  on  the  other  hand, 
youth  work  toward  these  qualities  under  very  different  sets 
of  conditions.  Here  they  must  take  the  "high  road”  (Salomon 
& Perkins,  1989).  Either  they  capitalize  intelligently  on  the 
all-too-few  similar  opportunities  that  might  easily  be  missed: 
or.  they  resiliently  "pull  themselves  up  by  the  bootstraps.” 
That  is,  these  students  have  to  learn  to  actively  structure 
and  restructure  unfavorable  circumstances  and  events,  and 
to  view  even  activities  that  are  not  "school-like”  as  oppor- 
tunities for  learning  volitional  skills.  Hopeful  students  seize 
opportunities  as  they  arise:  and  resilient  students  create 
opportunities  that  might  not  otherwise  exist.  Some  have 
called  this  purposive  striving:  others  have  really  swung  out 
and  called  it  "will”  (Farrell,  1994).  Whatever  it's  called,  it 
involves  using  resources  wherever  they  occur  in  a highly 
deliberate  and  determined  way.  Taking  the  high  road  is  a 
much  harder  way  to  learn  foresight  and  follow-through. 

For  such  individuals,  -in  some  youth  organizations, 
early  childhood  programs,  community  centers,  and  schools- 
thcre  tire  some  teachers,  social  workers,  and  counselors,  who 
offer  new  possibilities  for  moving  down  this  road  that  can  be 
built  into  their  present  realities.  As  Milbrey  McLaughlin  (1993) 
said,  “(wizards)  did  whatever  was  necessary  to  respond  it)  needs 
as  evident— not  imagined-and  to  create  the  confidence  and 
context  of  positive  futures  for  these  youngsters”  (p.  (>4)  But 
there  cannot  be  enough  wizards  around.  And,  as  Fve  tried  to 
argue  today,  even  the  advantages  of  looking  forward  to  what 
one  might  become  have  to  be  learned.  'Flic  advantages  of  fore- 


sight are  not  automatically  apparent  in  all  too  many  young 
people's  daily  living  situations. 

Perhaps  one  thing  that  those  of  us  in  the  educating 
and  helping  professions  can  do  is  to  find  ways  to  encourage 
our  youth  to  view*  themselves,  in  Albert  Bandura's  (1974)  words, 
as  "partial  architects  of  their  own  destinies”  (p.  867).  If  we 
can  model  and  promote  adaptive-seeking  after  resources,  and 
active  use  of  these  resources  in  ways  that  will  help  realize 
individual  visions-perhaps  we  can  help  to  make  "possible 
selves”  probable  (Markus  & Nurius,  1986).  Anger  and  hope- 
lessness, in  contrast,  clearly  relate  negatively  to  the  kinds  of 
outcomes  I've  described  (Pekrun,  1992).  In  the  end,  suc- 
cess in  this  endeavor  comes  dow-n  to  both  preparation  and 
support.  We  need  to  learn  the  lessons  of  decades  of  research 
on  teaching  and  similar  research  in  other  professions;  that  to 
become  effective,  productive,  or  accomplished-whether  the 
goal  is  teacher,  lawyer,  orsalesperson-requires  adequate  prepa- 
ration and  support  (see  e.g.,  Darling-Hammond,  1994).  And 
so  it  goes  w'ith  academic  achievement  and  other  forms  of  rec- 
ognized accomplishment.  To  effectively  practice  achieving- 
complete  with  foresight  and  follow-through-individuals  must 
be  accompanied  towards  foresight  and  follow-through.  This 
is  both  the  answer  and  the  challenge. 

There  is  a telling  analysis  by  curriculum  theorist 
Hugh  Socket!  (1988)  of  elite  private  boarding  sehools-his- 
torically.  the  training  grounds  for  upwardly  mobile  adoles- 
cents. Sockett  finds  these  schools  to  have  long-standing  tra- 
ditions, formal  policies  and  stated  missions,  that  involve  cen- 
tering their  curricula  on  ways  to  instill  the  qualities  of  "per- 
sonal responsibility”  in  students.  He  lists  among  these  "quali- 
ties of  endeavor  such  as  determination,”  “qualities  of  heed 
such  as  carefulness,  concentration,  and  conscientiousness,” 
and  "qualities  of  control  such  as  self-restraint  and  endurance.” 
In  this  country,  most  public  schools  also  include  behavior  re- 
lated to  these  qualities  among  their  benchmarks  for  student 
evaluation.  Many  elementary  students  receive  grades  in  "par- 
ticipation” and  "effort”  measured  largely  by  impression  or 
anecdote.  And  yet.  activities  and  evaluation  procedures  that 
teach  participation  and  good  work-habits  arc  rarely  part  of  the 
explicit  curriculum  agenda  of  the  modem  public  school,  w hich 
tends  instead  to  emphasize  cognitive  academic  goals. 

In  defense  of  the  value  of  general  explantory  con- 
cepts such  as  the  five  I've  outlined  today,  let  me  quote,  fi- 
nally, from  Lee  Cronbach  (1975): 

A reasonable  aspiration  (for  science)  is. ..to 
develop  explanatory  concepts,  concepts  that  will 
help  people  use  their  heads. ...To  give  a wide  reach 
to  our  (scientific)  explanations,  we  make  experi- 
ence cumulative  by  abstracting  from  it.  The  ex- 
planatory constructs  that  we  find  fruitful  (then) 
combine  into  a view  of  man  (sic),  his  institutions, 
and, ..behavior.  The  informed  public  projects  each 
new  circumstance  against  that  backgioimd,  aiul 
so  is  able  to  react  more  intelligently  (p.  126). 

Perhaps  Hobbes  should  tell  Calvin  that  it's  time  he  become 
part  of  a better  informed  public? 
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Abstract 

This  study  examined  the  one-year  stability  of  a measure  of  children's  attitudes  toward  reading.  Two 
hundred  and  eighty- nine  students  in  grades  one  through  five  completed  the  Elementary  Reading  Atti- 
tude Suri'e v (ERAS)  at  the  beginning  of  two  consecutive  academic  years.  For  both  years,  reading 
attitudes  were  normally  distributed  across  recreational  and  academic  subscales  as  well  as  the  total 
reading  attitude  score  of  the  ERAS.  Substantial  test-retest  correlations  were  found  both  for  the  subscales 
and  for  the  total  score,  reflecting  good  stability  for  the  instrument.  Nonsignificant  grade  differences 
were  absented,  however  females  consistently  expressed  more  positive  attitudes  toward  reading  than  did 
males.  Implications  for  the  classroom  and  directions  for  future  research  are  provided. 


W ithout  doubt,  improvement  of  children's  read- 
ing in  the  public  school  setting  remains  one  of  the  most 
important  functions  of  contemporary  education.  Attitudes 
about  reading  are,  arguably,  formed  as  a result  of  repeated 
success  or  failure  with  the  task  of  reading.  While  students 
with  good  reading  ability  may  have  positive  attitudes  to- 
ward reading,  students  who  are  poor  readers  often  have  to 
overcome  negative  reading  attitudes  in  order  to  improve  their 
reading  skills  (Johnson,  1981). 

Teacher  perceptions  of  student  attitudes  toward 
reading  do  not  always  match  attitudes  held  by  their  stu- 
dents, and  may  be  based  to  a greater  degree  on  reading 
achievement  (Swanson,  1985).  Even  though  student  read- 
ing attitude  is  commonly  identified  as  an  important  area  for 
student  growth  (Quinn  & Jadav,  1987),  very  little  time  is 
devoted  to  fostering  favorable  attitudes  to  reading  in  the 
schools  (Greaney.  1991;  Heathington  & Alexander,  1984). 
This  may  be  due  to  teacher  pressures  to  focus  on  basic  skills, 
or  from  the  belief  that  improving  reading  achievement  will 
indirectly  improve  students'  attitudes. 

Young  students  seem  to  hold  positive  reading  atti- 
tudes early  in  the  development  of  their  academic  skills 
(Guthrie  & Greaney,  1991),  but  with  repeated  failure  may 
begin  to  view  reading  in  a more  negative  light  (Swanson, 
1985).  Good  readers  generally  have  more  positive  attitudes 
toward  reading  than  poor  readers  (Wigfield  & Asher,  1984), 
although  only  moderate  correlations  (.20  to  .40)  are  typi- 
cally found  between  reading  attitude  and  achievement  (Dock 
& Barnette,  1976;  Rocttger,  S/.ymc/uk.  & Millard,  1979). 
As  Mickelson  concluded  (1990),  research  on  attitude-be- 
havior relationships  has  yielded  contradictory  and  uncer- 
tain outcomes  (p.  48). 


The  uncertainty  regarding  the  longitudinal  stabil- 
ity of  reading  attitudes  has  resulted,  in  part,  from  the  use  of 
inadequate  attitude  scales  (Marjoribanks.  1992,  p.  945).  Be- 
fore questions  concerning  predictive  validity  can  be  an- 
swered, the  short-  and  long-term  reliability  of  the  measures 
used  to  assess  reading  attitude  must  be  established.  Class- 
room teachers  who  wish  to  monitor  changes  in  student  read- 
ing attitudes  from  the  beginning  to  the  end  of  the  school 
year  will  want  to  avoid  scales  which  do  not  provide  consis- 
tent, reliable  measurement.  Similarly,  the  effects  of  educa- 
tional interventions  targeted  towards  at-risk  students  can 
be  evaluated  only  if  the  scales  used  to  measure  reading  atti- 
tudes reflect  true  changes  in  reading  attitudes,  rather  than 
random  score  variation.  Therefore,  this  study  examined  the 
one-year  stability  of  a measure  of  reading  attitude,  the  El- 
ementary Reading  Attitude  Survey  (McKenna  & Kear. 
1990). 

Obviously,  a one-year  test-retest  interval  will  be 
dependent  upon  both  the  psychometric  properties  of  the 
ERAS  and  the  stability  of  the  reading  attitude  construct. 
Typical  test-retest  correlation  coefficients  are  based  on 
shorter  intervals,  normally  between  several  weeks  and  few 
months.  Certainly,  a one-year  stability  coefficient  will  he 
moderately  decreased  as  a function  of  both  the  time  interval 
between  the  first  and  second  administration  of  the  test  and 
as  a function  of  the  childrens'  development.  Since  physi- 
cal. maturational.  psychological  and  situational  factors  will 
all  serve  to  affect  the  temporal  stability  of  the  ERAS  scores, 
the  purpose  of  the  present  study  is  to  determine  to  what 
extent  this  will  occur.  Because  real-life  instruction  and  aca- 
demic interventions  arc  typically  measured  in  intervals  closer 
to  a year  in  length,  rather  than  the  shorter  periods  of  time 


for  which  test-retest  reliabilities  are  normally  calculated, 
this  study  reflects  an  important  addition  to  the  existing  body 
of  knowledge  concerning  the  reading  attitudes  of  children. 

Method 

Participants 

Two  hundred  eighty-nine  students  (139  male,  150 
female)  enrolled  in  grades  one  through  five  of  a southwest- 
ern, suburban  school  district  served  as  subjects.  Students 
were  randomly  assigned  to  teachers  in  one  of  seventeen  class- 
rooms. Ethnic  status,  as  reported  in  school  records  com- 
pleted by  parents,  was:  949 'c  White,  49c  Hispanic,  19 \ Black 
and  19 f Asian.  The  socioeconomic  level  of  the  school  was 
judged  to  be  middle-class,  based  upon  the  proxy  measure  of 
percentage  of  students  ( 109r  or  less)  participating  in  free  or 
reduced-cost  lunch  programs  (Peng,  Wang.  & Walberg, 
1992).  Single-family  homes  comprised  76%  of  the  hous- 
ing. and  more  than  50 9c  of  the  parents  had  some  college 
education. 

Instrument 

The  Elementary  Reading  Attitude  Survey  (ERAS) 
(McKenna  & Kear,  1990)  is  a 20  item  public-domain  ques- 
tionnaire developed  for  use  in  grades  one  through  six.  Pic- 
torial representations  of  the  comic  strip  character,  Garfield 
the  cat,  are  presented  on  a 4-point  scale  which  asks  chil- 
dren to  rate  how  much  they  like  to  read.  Each  item  presents 
a brief,  simply- worded  statement  about  reading,  followed 
by  four  pictures  of  Garfield.  Each  Garfield  pose  shows  a 
different  emotional  state  ranging  from  Very  Happy  to  Very 
Upset.  Children  circle  the  picture  that  reflects  how  they 
feel  about  the  particular  statement.  Responses  are  summed 
and  transformed  into  percentile  ranks  via  national  norms 
tables.  Percentile  ranks  are  obtained  for  total  reading  atti- 
tude and  two  component  subscales:  Recreational  reading 
attitude  and  Academic  reading  attitude. 

The  ERAS  was  normed  on  over  1 8.000  students  in 
Grades  1-6.  Children  were  drawn  from  95  schools  across 
38  states.  Internal-consistency  coefficients  ranged  from  .74 
(Recreational  subscalc  at  first  grade  le\el)  to  .89  (Total  scale 
at  grades  4-6).  The  intersubscale  correlation  was  .64  and  a 
factor  analysis  of  the  normative  sample  provided  construct 
validity  evidence  supportive  of  the  claim  that  the  measure's 
two  subscalcs  reflect  discrete  aspects  of  reading  attitude. 
Comparable  internal-consistency  estimates  have  been  re- 
ported for  the  ERAS  when  it  was  applied  to  a small,  inde- 
pendent sample  of  children  (Allen.  Cipielewski  & 
Stanovieh,  1992):  and  concurrent  validity  with  other  mea- 
sures of  reading  attitude  has  been  shown  as  well  (Estes. 
Estes,  Richards.  & Roettgcr.  1981:  Marjc ribanks,  1992). 

Procedure 

Students  completed  the  ERAS  in  the  fall  semester 
of  two  consecutive  school  years.  Administration  was  given 
to  intact  classrooms.  Teachers  read  the  directions  aloud 


while  the  students  read  along  silently.  Following  several 
practice  items,  students  completed  the  20  items  of  the  ques- 
tionnaire. 

Completed  ERAS  forms  were  scored  by  the  experi- 
menters according  to  standardized  instructions  provided  by 
McKenna  and  Kear  (1990).  Raw  scores  were  converted  to 
standard  scores  (M  = 100,  SD  = 15)  by  a computer  program 
(Watkins,  1992)  which  were  used  in  all  subsequent  analysis. 

Results 

Table  1 presents  descriptive  statistics  for  the  Total 
sample  and  for  males  and  females  for  both  administrations 
of  the  ERAS.  Responses  for  the  Recreational,  Academic 
and  Total  scores  w-ere  relatively  normally  distributed  with 
mean  for  all  scales  near  100  and  standard  deviation  near 
15.  Score  ranges  varied  approximately  two  standard  devia- 
tions above  and  below  the  standard  score  means. 

Table  1 


Means,  Standard  Deviations,  and  Ranges  of  the 
Elementary  Reading  Attitude  Survey  for  the 
Total  Sample  and  by  Gender 


Mean 

SD  Minimum 

Maximum 

Recreational  (Test) 

100,80 

14.89 

54 

128 

Male 

96.79 

15.41 

54 

127 

Female 

104.51 

13.41 

68 

128 

Academic  (Test) 

100.69 

15.12 

58 

134 

Male 

97.38 

14.96 

58 

131 

Female 

103.76 

14.67 

67 

134 

Total  (Test) 

100.80 

15,04 

60 

135 

Male 

96.78 

15.11 

60 

131 

Female 

104.51 

14.02 

70 

135 

Recreational  (Retest) 

98.89 

16.27 

55 

127 

Male 

93.31 

16.49 

57 

127 

Female 

104.05 

14.28 

55 

127 

Academic  (Retest) 

100.99 

15.12 

61 

i 27 

Male 

96.64 

15.19 

65 

126 

Female 

105.01 

13.92 

61 

127 

Total  (Retest) 

99.94 

15.72 

53 

128 

Male 

94.37 

15.63 

57 

128 

Female 

105.11 

13,98 

53 

128 

Table  2 presents  correlation  coefficients  for  the 
Total  sample  and  for  males  and  females  for  both  adminis- 
trations of  the  ERAS.  All  correlations  exceeded  the  .001 
significance  level.  Intersubscale  correlations  were  .65  and 
.63  for  test  and  retest  administrations,  respectively.  These 
results  are  almost  identical  to  the  intersubscale  correlation 
of  .64  reported  for  the  normative  sample.  The  test -retest 
reliability  for  the  Total  ERAS  scale,  following  a one  year 
interval,  was  .43.  A series  of  Fisher  r to  /.  transformations 
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indicated  non-significant  gender  differences  across  all  cor- 
relations. That  is,  test-retest  correlations  were  of  equal  mag- 
nitude for  boys  and  girls. 

Tabled 

Test-Retest  Correlations  for  the  Elementary  Reading 
Attitude  Survey  for  the 
Total  Sample  and  by  Gender 


Academic 

(Test) 

Total 

(Test) 

Recreational 

(Retest) 

Academic 

(Retest) 

Total 

(Retest) 

Recreational  (Test)  .65 

.89 

.43 

.31 

.41 

Male  .63 

.89 

.34 

.27 

.35 

Female  .63 

.88 

.41 

.25 

.37 

Academic  (Test) 

.92 

.32 

.34 

.37 

Male 

.91 

.24 

.29 

.30 

Female 

.92 

.32 

.32 

.36 

Total  (Test) 

.41 

.36 

.43 

Male 

.32 

.31 

.36 

Female 

.40 

.32 

.4! 

Recreational  (Retest) 

.63 

.90 

Male 

.58 

.89 

Female 

.61 

.89 

Academic  (Retest) 

.90 

Male 

.89 

Female 

.90 

Note:  All  correlations  p < .001. 

A series  of  three  factorial  ANOVAs,  2 (gender)  x 5 
(grade)  were  performed  on  ERAS-Recreational.  Academic 
and  Total  scores,  with  scores  for  both  administrations  serv- 
ing as  repeated  measures  (Huberty  & Morris,  1989).  Sig- 
nificant gender  differences  were  found  for  the  Academic 
(F(  1,279')  = 28.50,  p < .0001);  Recreational  (F  (1,279)  = 
44.68,  p<  .0001 );  and  Total  ERAS  scores  (F(  1,279)  = 44. 16, 
p < .0001).  Nonsignificant  grade  effects  were  evidenced 
for  all  three  scales,  however,  significant  gender  by  grade 
interactions  were  found  for  the  Recreational  (F(4.279)  = 
4.21,  p < .01)  and  Total  scales  (F  (4,279)  = 2.96.  p < .05). 
Post-hoc  examinations  indicated  that  for  both  administra- 
tions of  the  ERAS,  and  across  all  grade  levels  except  sec- 
ond. girls  exhibited  significant!)  higher  Recreational  and 
Total  attitude  ratings  than  did  boys.  Only  at  the  second 
grade  level  were  males  and  females  found  not  to  be  signifi- 
cantly different. 

Discussion 

Results  of  the  present  study  indicate  moderate  one- 
year  stability  of  children’s  attitudes  toward  reading  as  mea- 
sured by  the  Elementary  Reading  Altitude  Survey.  Signifi- 


cant test-retest  reliabilities  wjere  evidenced  for  the  Recre- 
ational and  Academic  subscales  of  the  ERAS  as  well  as  for 
the  Total  Score  of  that  measure.  ERAS  stability  was  also 
demonstrated  across  grade  levels  one  through  five. 

Additionally,  the  ERAS  was  found  to  be  an  equally 
reliable  measure  of  reading  attitudes  for  both  boys  and  girls, 
even  though  girls  consistently  expressed  more  positive  atti- 
tudes toward  reading  than  did  hoys.  This  result  is  consis- 
tent with  previous  research  which  suggests  that  girls  tend 
to  have  more  favorable  attitudes  to  reading  than  boys 
(Greaney  & Hegarty,  1987;  Guthrie  & Greaney.  1991 ; Smith, 
1990).  In  the  present  study,  the  single  exception  to  this 
trend  occurred  for  beginning  second-grade  students,  where 
girls  and  boys  had  similar  reading  attitudes.  It  is  conjec- 
tured that  this  outcome  can  be  attributed  to  a unique  inter- 
action between  personal  characteristics  of  these  students  and 
teachers,  since  boys'  attitudes  declined  again  the  following 
year,  although  neither  specific  instructional  program  nor 
method  could  be  identified  which  was  unique  to  that  grade 
level.  The  developmental  pattern  for  girls  was  much  more 
consistent,  showing  better  developed  reading  attitudes  than 
boys  at  both  younger  and  older  grade  levels.  Although  un- 
fortunate that  the  improvement  in  reading  attitude  shown 
by  boys  was  temporary  and  not  maintained  for  any  extended 
period  of  time,  we  know'  that  teachers  can  impact  the  atti- 
tudes that  their  students  develop  through  the  use  of  specific 
classroom  techniques  (Barnett  & Iru'in,  1994;  Lehr.  1982; 
Wigficid  & Asher.  1984).  Future  research  should  examine 
these  strategics  and  techniques  in  greater  detail. 

In  the  early  grades,  boys  tend  to  be  identified  more 
frequently  than  girls  as  problem  readers  (Tittle,  1986).  and, 
on  the  whole,  do  not  achieve  as  well  as  girls  in  reading 
(Bank.  Biddle.  & Good,  1980)  and  spelling  (Allred.  1990). 
This  convergence  of  evidence  regarding  young  boys’  diffi- 
culties in  reading  attitude  and  achievement  is  as  problem- 
atic as  the  information  concerning  older  girls’  adversity  in 
mathematics  and  science  (Tittle,  1986).  While  the  reading 
attitudes  of  girls,  of  course,  should  not  be  neglected,  results 
of  the  present  study  suggest  that  educational  attention  should 
be  focused  on  boys  w ho  appear  to  begin  school  with  poorer 
attitudes  toward  reading  and  subsequently  progress  through 
school  without  showing  any  sustained  improvement  (Na- 
tional Center  for  Education  Statistics.  1992). 

As  predicted,  the  finding  of  a significant,  but 
moderate  one-vear,  test- retest  correlation  of  .43  reflects  a 
rather  substantial  drop  from  the  typical  short-term,  test-rc- 
test  range  (.70  - .90)  found  with  most  reading  attitude  mea- 
sures. but  is  consistent  w ith  long-term  trends  for  reading 
attitudes  (Smith.  1990).  Current  results  demonstrated  high 
subscale  correlations  at  each  of  the  five  grade  levels,  which 
did  not  vary  significantly  across  time.  On  the  whole,  the 
ERAS  appears  to  be  a reliable  measure  of  children’s  overall 
attitudes  toward  reading,  as  well  as  their  specific  attitudes 
toward  Academic  and  Recreational  reading.  Reading  teach- 
ers who  utilize  the  ERAS  may  feel  comfortable  that  the  scale 
will  provide  consistent  scores  out  periods  of  up  to  one  year. 
Future  research,  however,  should  examine  the  stability  of 


reading  attitudes  over  a longer  time  interval.  Although  the 
present  findings  indicated  relative  equality  across  five  grade 
levels,  a longitudinal  design  which  follows  the  same  cohort 
of  students  over  a longer  period  of  time,  with  a particular 
focus  on  possible  developmental  differences  for  boys  and 
girls,  would  better  address  this  question.  Additionally,  fu- 
ture research  should  investigate  the  differential  predictabil- 
ity of  the  ERAS  subscales  and  reading  achievement.  Spe- 
cifically, research  should  explore  the  predictive  utility  of 
both  the  Recreational  and  Academic  subscales  of  the  ERAS, 
and  the  stability  of  these  subscales  for  both  boys  and  girls 
across  several  grade  levels. 
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MWER  Feature  Editors 


At  the  annual  meeting  of  MWER  Editors,  Editorial  Board  Members  and  MWERA  Directors  in  Chicago, 
various  suggestions  and  new  ideas  were  presented  for  the  Journal.  This  Issue  launches  the  eighth  volume  of  MWER. 

It  is  therefore  appropriate  to  announce  our  new  Book  Review  section  and  introduce  Dennis  Leitner  as  the  new  Feature 
Editor  responsible  for  this  section. 

An  informal  survey  of  MWERA  members  was  conducted  and  it  indicated  very  strong  support  for  this  new 
section.  Members  would  like  to  see  reviews  of  professional  level  books.  There  was  also  some  support  for  reviews  of 
textbooks  and  tests,  but  no  support  for  reviews  of  educational  software  and  media.  Dennis  Leitner  is  a Past  president 
who  has  been  very  active  in  MWERA  affairs  and  now  serves  on  the  MWER  Editorial  Board.  He  teaches  in  the  depart- 
ment of  educational  psychology  at  Southern  Illinois  University. 

This  is  also  an  opportunity  for  us  to  introduce  our  other  Feature  Editors.  Jack  Snowman  serves  as  the  Feature 
Editor  of  the  popular  “Research  in  Action”  review  article  which  appears  twice  a year  in  MWER.  Jack  was  elected  to 
serve  a two-year  term  on  the  MWERA  Board  as  Member-at-Large.  He  teaches  in  the  same  department  as  Dennis.  Also 
continuing  as  Feature  Editor  is  Marlene  Schommer  who  writes  our  VOICES  article  also  on  a twice  a year  cycle.  Marlene 
teaches  at  Wichita  State  University. 

We  need  Feature  Editors  to  develop  other  sections  for  MWER.  One  feature  that  needs  coordination  is  our 
Prominent  Educator  Interview  section.  Your  challenge,  should  you  accept  it,  is  to  identify  a prominent  educator,  run 
your  choice  by  the  editorial  team,  conduct  an  interview,  and  write  it  up  for  MWER  in  a manner  that  is  useful  to  mem- 
bers. This  could  be  like  inducting  your  favorite  “big  name  educator”  to  our  informal  Hall  of  Fame,  although  we  have 
never  spoken  of  it  that  way. 

Also  under  development  are  ways  of  making  MWER  available  through  the  electronic  medium.  This  new 
superhighway  has  been  acclaimed  as  the  futuristic  way  to  go.  But  we  are  not  quite  sure  how  best  to  get  on  it,  and  once 
on  it,  how  to  do  well  by  our  members.  We  think  we  should  only  enter  abstracts  of  articles  published  in  the  journal,  not 
tne  article  itself,  because  we  worry  that  the  latter  might  result  in  losing  our  dues-paying  members.  After  all,  the  Journal 
is  supported  by  membership  dues,  and  it  is  one  of  the  major  benefits  of  membership.  The  argument  goes  as  follows: 
Why  should  anyone  pay  for  the  Journal  when  one  can  get  it  free  through  the  electronic  medium?  Perhaps  this  is  the 
challenge  thrown  at  us  by  this  increasingly  popular  medium  of  the  future.  Most  members,  80%  of  those  who  responded 
to  our  informal  Survey  in  Chicago,  appear  to  be  able  to  use  E-Mail  and  have  access  to  it. 

Greg  Marchant  has  developed  a GOPHER  for  MWERA  which  is  currently  operating  at  Ball  State  University. 
He  indicates  that  abstracts  can  be  placed  here  and  that  this  might  become  an  exchange  medium  featuring  reactions  to  the 
research  presented  therein.  John  Surber  is  working  with  Greg  to  develop  this  idea  further.  But  we  could  use  help  from 
others  able  and  willing  to  push  us  up  this  path.  Several  years  ago,  Jean  Pierce  developed  a LISTSERVER  for  MWERA, 
which  has  now  become  a national  system  for  AERA  and  its  divisions,  currently  operated  by  Gene  Glass  at  Arizona  State 
University. 

We  solicit  your  advice  on  these  and  other  Journal  matters.  Selected  letters  to  the  Editor  may  be  published  in 
this  Journal. 
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Images  of  the  Conference... 

(Photography  by  John  Surber,  University  of  Wisconsin  - Milwaukee) 

Meet  the  Editors 


(L  to  R)  Stephen  Benton,  Educational  Psychology  Review 

Ayres  D'Costa,  Mid-  Western  Educational  Researcher 

Frank  Lester,  Journal  of  Research  in  Mathematics  Education 

Bill  Reese.  History  of  Education  Quarterly 

Lyn  Como,  American  Educational  Research  Journal  (not  seen) 

Gene  V.  Glass.  Review  of  Educational  Research  (not  seen) 

Randall  Schumacker,  Structural  Equation  Modelling  : A multidisciplinary  journal  (not  seen) 


.... and  some  of  the  Speakers. 


Charles  C.  Anderson , Jr. 

MWERA’s  retiring  Executive  Officer 


“Andy”’s  link  with  MWERA  dates  back  to  its  very  “exorbitant11  charges  we  officers  presented  to  him  for  reim- 
roots,  and  then  some.  “Andy”  was  an  administrator  for  the  bursement. 
midwestem  region  of  ETS  on  May  12,  1978  when  he  met 

with  a group  of  about  50  educators  at  Indian  Lakes  MWERA  was  his  child  as  it  were,  and  he  wanted 

(Bloomingdale,  IL)  for  what  is  now  known  as  MWERA’s  the  best  for  ?t.  I know  he  negotiated  hard  to  get  us  favorable 
Founding/Charter  meeting.  These  educators  wanted  more  rates  at  the  Bismarck  Hotel,  including  a diligent  compari- 
of  what  the  Northern  Illinois  Association  for  Educational  son  of  menu  prices  for  the  conference  luncheon.  Charles 
Research,  Evaluation  and  Development  was  giving  them,  had  a nifty  formula  for  earning  MWERA  some  money  on 
They  wanted  a broader  regional  association  covering  all  the  luncheon.  We  had  to  provide  the  hotel  a firm  figure  for 
midwestem  states.  So  they  obtained  244  signatures,  wrote  the  conference  luncheon  meeting.  Every  conference  regis- 
up  a non-profit  organization  charter,  and  MWERA  was  bom.  trant  was  required  to  pay  for  lunch,  but  not  all  would  at- 
tend. So  “Andy”  figured  that  there  was  money  to  be  made  if 
In  1 979,  Charles  ran  for  the  MWERA  Association  he  could  figure  out  exactly  how  many  would  show  up.  Well, 
Council  office  and  was  duly  elected.  The  following  year  he  he  discovered  that  the  number  of  conference  pre-regislra - 
became  the  Treasurer  for  the  newly  founded  organization,  tions  somehow  approximated  the  number  who  showed  up 
He  told  me  that  he  “inherited”  some  $700  and  a fistful  of  for  the  lunch.  As  President  I tried  to  remind  members  that 
bills  that  had  to  be  paid.  Today,  thanks  to  his  watch,  our  they  had  a free  lunch  to  attend,  and  “Andy”  would  whisper 
balance  is  close  to  $20,000.  to  me:  “1  know  you  are  trying  to  mess  me  up  this  year!’1. 

But  he  never  really  meant  to  object. ...he  was  just  so  dam 
While  all  the  other  officers  were  elected  for  fixed  anxious  to  protect  MWERA,  and  so  anxious  to  make  his 
terms,  Charles  was  continued  in  office  as  Treasurer  by  ev-  formula  work.  And  it  did,  and  continues  to  do  so.  As  he 
ery  incoming  Board  without  the  formalities  of  elections.  This  would  say  to  me:  Why  give  away  our  members1  hard-  earned 
practice  continued  until  1988,  when  someone  pointed  out  money  to  the  hotel? 
that  all  MWERA  officers  had  to  be  duly  elected  by  member- 
ship. The  Association’s  leadeiship  kept  in  mind  what  was  Charles  made  sure  each  year  that  the  President  and 

good  for  the  organization.  Rather  than  risk  losing  our  “trusty  Past-President  were  housed  at  no  cost  (a  MWERA  perk  de- 
custodian of  the  exchequer”  in  an  election,  we  decided  to  signed  to  say  thanks  for  servitude  rendered)  in  the  Hotel’s 
change  our  Bylaws.  Charles  would  become  an  appointed  best  suite  (The  Regency),  that  the  meeting-rooms  were 
Executive  Officer  with  a three-year  term  of  office.  We  even  strictly  set  aside  by  the  hotel  staff  for  our  conference  use  as 
decided  on  a small  honorarium  to  cover  his  phone  bills  (while  needed,  and  that  the  myriads  of  other  minute  arrangements 
in  office  I received  phone  calls  quite  regularly  from  “Andy”),  were  taken  care  of.  But  Charles  also  believed  in  fairness  to 

all  parties.  I remember  getting  a polite  earful  from  him 
Charles  thus  became  the  steadfast  pillar  support-  when  as  Program  Chair  I allowed  a huge  box  of  subs  to  be 
ing  the  MWERA  organization.  As  some  of  us  would  tell  smuggled  into  the  Cracker  Barrel  Social  meeting.  That  was 
each  other,  “Presidents  come  and  Presidents  go,  but  there  is  in  violation  of  hotel  policy.  Wh.I*:  Charles  fought  for 
always  “Andy”  guarding  our  treasury”.  Charles  diligently  MWERA  needs  with  the  hotel,  lie  also  insisted  that  we  kept 
billed  members  for  their  annual  dues,  (he  would  curse  the  our  side  of  the  bargain  relative  to  the  hotel.  Charles  also 
post  office  when  he  could  not  track  his  lost  members),  he  made  sure  that  the  nice  Presidential  Receptions  organized 
scrutinized  non-paying  members  and  conference  gate-crash-  by  Adriu  in  the  last  several  years  were  properly  approved  by 
crs.  and  he  was  known  to  sigh  aloud  and  comment  on  the  hotel  management. 

(continued  on  /*.  22 1 
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CHICAGO,  OCTOBER  11-14,  1995 
DEADLINE  FOR  SUBMISSION: 
MAY  7,  1995 


Submissions  must  be  postmarked  no  later  than  May  7,  1995.  No  submissions  will  be  accepted  by 
FAX  or  email.  Mail  submissions  to:  Dr.  Sharon  McNeely,  P.O.  Box  34421/  Chicago,  IL  60634 
USA.  Phone:  312.794.2788.  One  submission  per  cover  sheet.  One  submission  per  envelope.  See 
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The  Seventeenth  annual  meeting  of  the  Mid-Western  Educational  Research  Association  (MWERA)  will 
feature  a presentation  by  David  Berliner,  a presidential  address  by  Thomas  Andre,  professional 
developmental  workshops,  graduate  student  workshops,  school  teacher  and  administrator  workshops, 
professional  publications  exhibits,  and  a multitude  of  various  presentations.  Proposals  may  include, 
but  are  not  limited  to,  symposia,  papers,. discussion  groups,  poster  papers,  and  alternative  format 
sessions. 


The  Mid-Western  Educational  Research  Association  (MWERA)  is  a nonprofit  organization  of 
professional  educational  researchers  primarily  from  states  and  provinces  located  in  the  mid-western 
region  of  the  United  States  and  Canada.  Membership  is  open  to  educational  researchers,  college 
students  and  educators  engaged  in  any  aspect  of  disseminating  information. 

MWERA  is  organized  by  Divisions.  The  DIVISIONS  of  MWERA  include: 


A.  Administration:  Concerned  with  research,  theory, 
development,  and  improvement  of  practice  in  the 
organization  and  administration  of  education. 

B.  Curriculum  and  Studies:  Concerned  with  curriculum 
and  instructional  practice,  theory,  and  research. 

C.  Learning  and  Cognition:  Concerned  with  theory  and 
research  on  human  abilities,  learning  styles,  individual 
differences,  problem  solving,  and  other  cognitive  factors. 

D.  Measurement  and  Research:  Concerned  with 
measurement,  statistical  methods,  and  research  design 
applied  to  educational  research. 

E.  Counseling,  Human  Development  and  Special 
Education:  Concerned  with  the  understanding  of  human 
development,  special  education,  and  the  application  and 
improvement  of  counseling  theories,  techniques,  and 
training  strategies. 

F.  History  and  Philosophy  of  Education:  Concerned  with 
the  findings  and  methodologies  of  historical  research  in 
education. 


G.  Social  Context  of  Education  and  Motivation: 
Concerned  with  theory,  practice,  and  research  on  social, 
moral,  affective,  and  motivational  characteristics  and 
development,  especially  multicultural  perspectives. 

H.  School  and  Program  Evaluation:  Concerned  with 
research  and  evaluation  to  improve  school  practice, 
including  program  planning  and  implementation. 

I.  Professional  and  Medical:  Concerned  with  educational 
practice,  research,  and  evaluation  in  the  professions  (e.g, 
medicine,  nursing,  public  health,  business,  law,  and 
engineering). 

J.  Postsecondary  Education:  Concerned  with  a broad 
range  of  issues  related  to  two-year,  four-year,  and  graduate 
education. 

K.  Teaching  and  Teacher  Education:  Concerned  with 
theory,  practice,  and  research  related  to  teaching  at  all 
levels  and  in-service  and  pre-service  teacher  education. 
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GENERAL  INFORMATION: 


1.  All  persons  attending  the  Annual  Meeting,  including 
participants  and  presenters  are  required  to  register  for  this 
meeting  and  join  MWERA  prior  to  the  start  of  this  program.  All 
sessions  listed  in  the  program  will  be  open  to  anyone  registered 
for  the  meeting.  A small  fee  will  be  charged,  and  enrollment  may 
be  limited  for  some  workshops.  Materials  for  registering  for  the 
Annual  Meeting  will  be  published  in  the  Mid-Western 
Educational  Researcher. 

2.  MWERA  strives  to  make  the  meeting  accessible  to  all 
individuals.  Presentations  must  be  made  in  the  English  language. 
Presenters  are  expected  to  act  in  a professional  and  ethical 
manner. 

3.  All  presenters  are  expected  to  have  a written  paper  available 
two  weeks  prior  to  the  Annual  Meeting  for  the  Session  Chair  and 
Discussant  (if  applicable)  to  review.  Presenters  at  paper  and 
symposia  sessions  must  distribute  handouts  related  to  their 
presentation  to  attendees  at  their  sessions.  ERIC  registration  forms 
wiU  be  available  at  the  meeting  for  presenters  wishing  to  submit 
to  this  system.  This  does  not  preclude  formal  publication  in  a 
journal. 


GUIDELINES  FOR  SUBMISSIONS: 

1.  Only  Proposals  not  previously  presented  or  published  are 
eligible. 

2.  Proposals  will  be  peer-reviewed.  To  faciliate  review  and 
program  placement,  the  proposal  cover  sheet  must  be  included. 
The  proposal  should  be  categorized  into  one  of  the  following 
categories: 

A.  Oral  Presentation:  1 5-minute  format  before  an  audience.  Any 
proposal  submitted  in  this  category  may  be  allocated  to  a poster 
session  at  the  discretion  of  the  Program  Committee. 

B.  Poster  Session:  The  presenter  prepares  materials  for  easy 
viewing  and  reviewing  by  audience.  These  materials  are  posted 
on  corkboard  or  poster  board.  The  presenter  interacts  one-on-one 
and  in  small  groups. 

C.  Symposium:  A symposium  is  intended  to  provide  an 

opportunity  for  examination  of  specific  problems  or  topics  from 
a variety  of  perspectives.  Symposia  should  provide  presentation 
of  diverse  opinions,  interpretations,  and  suggest  alternative  ways 
of  thinking  about  a problem.  The  organizer  is  expected  to 
suggest  topics  and  solicit  speakers  and  discussants,  and  to  notify 
participants  of  acceptance  or  rejection  once  so  notified  by  the 
Program  Chair. 

D.  Discussion  Group:  This  is  intended  to  provide  an  opportunity 
for  people  to  participate  in  the  discussion  of  a set  topic.  The 
organizer  is  expected  to  suggest  the  topic,  prepare  materials,  and 
act  as  a moderator. 

E.  Workshop:  A session  of  1 and  1/2  or  3 hours,  which  helps 
the  professional  development  of  MWERA  members.  Presenters 
may  receive  an  honorarium  based  on  the  number  of  participants 
attending  the  workshop.  Workshops  will  occur  both  prior  to  and 
during  the  conference. 

F.  Alternative  Format  Session:  The  presenter  may  suggest  a 
different  type  of  session.  Detailed  information  should  be 
included. 

3.  Each  proposal  will  be  blindly  peer-reviewed  by  members  of 
the  Division  to  which  the  proposal  is  submitted.  No  proposal 
should  be  made  to  more  than  one  Division.  No  more  than  three 
proposals  will  be  considered  from  any  one  author. 


4.  MWERA  will  attempt  to  have  overhead  projectors  available 
for  use  by  presenters.  Presenters  who  need  other  audio-visual 
equipment  will  have  to  provide  their  own  equipment  at  their 
own  expense. 

5.  MWERA  reserves  the  right  to  reproduce  and  distribute 
summaries  and  abstracts  of  all  accepted  proposals.  Unless 
expressly  prohibited  in  writing  by  the  author(s),  summaries  may 
also  be  made  available  to  the  press  or  other  interested  parties 
upon  request.  Such  limited  distribution  does  not  preclude 
subsequent  publication  of  a summary  or  complete  paper  by  the 
author(s). 

6.  By  submitting  a proposal,  the  presenting  author  assumes 
responsibility  to  appear  at  the  Annual  Meeting  to  present  the 
paper.  If  circumstances  arise  which  preclude  the  author 
presenting,  it  is  his/her  responsibility  to  arrange  for  a suitable 
substitute  to  make  the  presentation  and  to  notify  the  Program 
Chair:  Dr.  Sharon  McNeely  at  312.794.2788. 


4.  The  Program  Committee  will  group  proposals  into  sessions, 
organized  by  topics  of  interest  to  the  conference.  A discussant 
may  be  included  to  discuss  the  overall  themes  and  issues  related 
to  a session. 

5.  MWERA/WERA  presents  up  to  3 student  research  incentive 
awards  at  the  MWERA  Business  Meeting,  Any  graduate  student 
who  has  authored/co-authored  a research  paper,  is  pre-registered 
for  the  1995  Annual  meeting,  and  is  present  at  the  MWERA 
Business  Meeting  will  qualitfy  for  an  award.  Receipients  will  be 
selected  by  a random  drawing  at  the  Business  Meeting.  No 
application  procedure  is  required. 

6.  Each  Proposal  must  include  the  following: 

• Three  copies  of  one  completed  Presentation  Proposal 
Cover  Sheet; 

• Six  copies  of  a Summary.  The  summary  should  be  a 
maximum  of  3 typed,  single-spaced  pages.  The 
Summary  will  be  used  in  judging  the  merits  of  the 
proposal.  It  should  include  the  Title,  Objectives, 
Perspectives  and/or  Methods,  Data  Source  (as 
appropriate).  Results,  Conclusions,  and/or  Point  of 
View. 

• Three  copies  of  a 200  word  Abstract.  The  abstract 
should  be  typed,  single  spaced,  and  prepared  for 
publication  in  the  Annual  Meeting  Abstrads.Do  not 
use  abbreviations  in  the  text  of  the  Abstract.  Abstracts 
longer  than  200  words  will  not  be  published. 

• One  additional  copy  of  the  Abstract.  This  copy  should 
show  the  title  and  names  of  the  author(s)  and  the 
affiliated  instiiution(s)  typed  at  the  top  left  margin  of 
the  page. 

• Three  self-adddressed,  stamped  business-size 
envelopes.  These  will  be  used  to  inform  you  of  (1)  the 
receipt  of  the  proposal,  (2)  the  reviewers'  decision, 
and  (3)  the  scheduled  session  lime. 

• Three  copies  of  a sheet  of  paper  with  the  following 
infotmalion,  typed:  title  of  the  proposal,  a list  of  all 
authors,  institutional  affiliationis),  complete 
address(cs),  telephone  numbers),  email  address(es). 
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PRESENTATION  PROPOSAL  COVER  SHEET 
1995  MWERA  ANNUAL  MEETING 
October  11-14,  1995,  Chicago 


Complete  this  form.  Include  three  copies  with  your  submission. 


1.  Type  of  presentation: 

Paper:  15  minutes 

Symposia 

Workshop:  90  minutes 

Alternative  session: 


Poster 

Discussion  Group 
Workshop:  3 hours 


2.  Primary  Division  for  peer-review: 

3.  Title  of  presentation: 


4. 


Name  of  Principal  Presenter/Organizer: 


Affiliation 


Degree: 


5.  Co-authors,  Symposia  members,  etc. 


6.  Have  you  ever  presented  a similar  paper  at  another  professional  meeting? 

No  Yes  If  so,  how  will  this  differ? 

7.  Is  this  a student  presentation? No  Yes 

8.  Are  you  a MWERA  member?  No  Yes 

Please  note  that  all  presenters  must  be  current  members  of  MWERA  at  the  time  of  presentation  and 
must  pay  registration  for  the  Annual  Meeting. 

9.  Permission  is  given  to  MWERA  to  record  my/our  presentation  and  to  make  it  available  for  sale  for  the 

benefit  of  MWERA.  Initial  here  is  you  wish  to  withhold  this  permission. 

I hereby  certify  that  if  this  proposal  is  accepted  and  placed  on  the  Annual  Meeting  Program,  I will  join  MWERA, 
register  for  the  Annual  Meeting,  appear,  and  deliver  the  presentation.  If  I am  unable  to  attend,  1 will  make 
arrangements  for  the  presentation  to  be  made  on  my  behalf. 

Signature: Date: 

Mail  this  no  later  than  May  7,  1995,  to:  Sharon  McNeely,  Ph.D.,  MWERA  Program  Chair,  P.O.  Box  34421, 
Chicago,  IL  60634 

Checklist:  Did  you  enclose: 

3 copies  of  this  proposal  cover  sheet 

6 copies  of  the  summary 

3 copies  of  the  abstract 

1 copy  of  abstract  with  author  information 

3 self-addressed,  stamped  envelopes 

3 author  information  sheets 
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( Anderson . con  id.) 

I remember  one  night  receiving  a phone  call  from 
“Andy”  after  I had  returned  home  from  a conference.  He 
came  immediately  to  the  point:  “ Did  you  pay  your  confer- 
ence registration  fee  this  year?”,  he  asked.  I thought  I had. 
Several  weeks  before,  I had  written  a check  and  given  it  to 
my  secretary  to  mail  to  “Andy”.  Moreover,  when  I went  to 
the  registration  desk,  my  name  tag  and  conference  packet 
were  there  for  me  as  usual  as  though  I had  pre- registered. 
So  I did  not  think  twice  about  any  problem  I might  have 
caused  “Andy”.  Apparently  my  check  had  never  reached 
“Andy”,  but  he  knew  that  as  past-president  I’d  be  there,  and 
he  did  not  want  to  embarrass  me  at  the  registration  desk. 

We  are  going  to  miss  “Andy”  guarding  the  trea- 
sury for  us,  but  I am  sure  he  will  be  there,  solicitous  as  ever, 
asking  the  right  questions  even  if  he  has  to  do  this  from  his 


easy-chair  at  home.  I know  our  MWERA  members  join  me 
in  wishing  “Andy”  a long,  happy  and  healthy  retirement 
from  his  Executive  Officer  job  with  us.  It  was  fitting  that 
the  Association  honored  him  in  a special  manner  at  our 
conference  luncheon,  and  also  voted  unanimously  to  name 
the  Graduate  Student  Scholarship  fund  after  him.  Charles 
C.  Anderson  Jr.  made  it  possible  for  us  to  have  the  funds  to 
be  able  to  help  our  graduate  students.  Thank  you,  “Andy” 
for  a job  well-done! 

Ayres  D 'Costa 
Past  President  and  MWER  Editor 


MWERA  Reception  at  AERA 

As  usual,  MWERA  will  host  a Reception  for  its  members  attending  the  1995  Annua . AERA/NCME  Confer- 
ence in  San  Francisco.  Jack  Snowman,  our  Member-at-large,  has  asked  for  a hotel  reservation,  but  does  not  have  a 
confirmation  as  of  this  date.  We  expect  the  Reception  to  be  held  either  on  Tuesday,  April  18  or  Wednesday,  April  19, 
from  6:30  to  8:30  p.m.  Please  check  your  AERA  PROGRAM  for  specific  information. 

Do  come  and  bring  an  AERA/NCME  colleague  or  two  with  you.  You  could  help  MWERA  by  giving  a 
complimentary  copy  of  our  Journal  to  selected  colleagues  who  might  join  us  and  become  potential  authors.  Copies  of 
he  Spring'  95  Issue  and  of  our  CALL  FOR  PAPERS  will  be  available  from  M vVERA  Officers  attending  the  conference. 


The  Mid-Western  Educational  Research 
Association  (MWERA)  is  a nonprofit  organi- 
zation of  professional  education  researchers 
primarily  from  states  and  provinces  located  in 
the  midwestem  region  of  the  United  States 
and  Canada.  Membership  is  open  to  faculty, 
students,  and  administrators  from  any  univer- 
sity, college,  and  school.  College  students 
engaged  in  educational  research  are  especially 
encouraged  to  join  as  members.  Also,  educa- 
tion researchers  in  business  and  industry,  as 
well  as  those  in  national,  state,  local  and 
private  agencies  and  organizations  are  wel- 
come. The  Association  promotes  and  dissemi- 
nates cducaiional  research  through  its  publi- 
cations. its  scholarship  program,  and  its  An- 
nual Meeting. 


MWERA  Membership  Application 


Name  (first,  middle  initial,  last) 


Mailing  address 


Home  phone  ( ) 


Highest  degree: 


Of/icc  phone  ( ) 


Area  of  specialization: 


The  1995  dues  of  $10  for  student  and  $18  for 
professional  membership  include  a subscrip 
lion  to  the  Mid  Western  Educational  Re- 
scan her  and  a reduced  registration  fee  for  the 
Annual  Meeting.  Address  membership  corre- 
spondence to:  Jean  W.  Pierce,  Dept.  Hi*  SE. 
Northern lllinoislhiivtTsity.PcKalb.IL'  Ji  15. 
phone-  815-753-8470. 


Instituition/Employcr: 


MWERA  division  preferences: 


F.-mail  address: 


AERA  member? 


Diviston(s): 


It  applying  for  student  membership,  please  include  a copy  of  your  student  ID. 


Going  Beyond  the  Literature  Review  with  Meta-analysis 

Keith  McNeil,  New  Mexico  State  University 
Isadore  Newman,The  University  of  Akron 

Abstract 

Meta-analysis  is  a procedure  that  transforms  research  results  into  a common  metric-called  the  effect 
size . This  effect  size  can  be  aggregated  if  consistent  across  studies . If  the  effect  size  is  not  consis- 
tent, study  characteristics  can  be  used  to  ascertain  why  the  effects  are  not  consistent.  The  focus  of 
this  paper  is  on  encouraging  linear,  curvilinear,  and  interactive  investigations  of  the  relationship 


between  study  characteristics  and  effect  size. 

In  a previous  paper  (McNeil  & Newman,  1994), 

we  reviewed  how  one  can  obtain  an  Effect  Size  in  order  to 
aggregate  the  results  of  several  similar  studies,  (See  Glass, 
McGaw,  & Smith,  1981;  Light  & Pillemer,  1984;  and 
Rosenthal,  1984  for  more  details.)  If  the  Effect  Sizes  are 
fairly  similar,  they  can  be  aggregated  to  produce  an  average 
effect  size.  In  many  instances.  Effect  Sizes  will  vary.  These 
discrepant  results  may  be  due  to  problems  with  internal  va- 
lidity, problems  with  external  validity,  or  to  random  errors. 
We  present  a number  of  situations  in  which  the  researcher 
can  uncover  the  reasons  for  the  discrepant  results.  We  rely 
on  the  General  Linear  Model  to  do  the  detective  work  to 
uncover  the  reason(s),  because  of  its  wide  applicability. 

Similarly  labeled  treatments  or 
participants  may  differ  in  important  ways 

Although  a researcher  may  refer  to  a set  of  treat- 
ments as  similar,  the  researcher  may  find  that  the  treatments 
differ  in  terms  of  some  attribute,  as  depicted  by  Class  Size 
in  Table  1.  Although  the  total  mean  Effect  Size  in  Table  1 
is  .4 1 8.  one  could  easily  test  the  difference  between  the  small 
Class  Size  studies  (mean  of  .488)  and  the  large  Class  Size 
studies  (mean  of  .348),  producing  a t value  of  1.85  with  an 
associated  directional  probability  of  .051.  These  results 
(given  an  alpha  of  .05)  would  not  lead  the  researcher  to 
conclude  that  the  treatment  (however  defined  and  however 
tested)  is  more  effective  with  small  classes  than  with  large 
classes. 

The  above  test  could  be  accomplished  with  a t- test 
of  the  difference  between  two  independent  means,  or  with 
the  comparison  of  two  regression  models.  The  research 
hypothesis  in  this  case  is:  “Small  classes  produce  larger 
Effect  Sizes  than  do  larger  classes."  The  criterion  is  Effect 
Size,  and  the  information  known  about  the  subjects  is 
whether  the  results  come  from  large  classes  or  small  classes. 
Therefore  the  Full  Model,  containing  the  full  amount 
of  information,  is;  Effect  Size  = a* U + b*S/L+  El  (where 
S/L  = I,  if  small  Class  Size.  0 if  large  Class  Size). 

Since  this  is  a directional  research  hypothesis,  we 
want  the  weighting  eoefficicnt  to  be  greater  than  0.  which 
means  that  the  restriction  on  the  Full  Model  is:  b = 0.  re- 
sulting in  the  following  Restricted  Model:  Effect  Size  = a*U 
+ E2.  The  R:  of  the  Full  Model  (itself  an  effect  size  of  large 


versus  small  class  size)  is  .30.  When  compared  to  the  R2  of 
0.00  of  the  Restricted  Model,  this  results  in  a p value  of 
.051,  the  same  as  that  for  the  /-test.  (See  McNeil,  Kelly,  & 
McNeil,  1975  or  McNeil,  Newman,  & Kelly,  in  press , for 
extended  discussion  of  testing  research  hypotheses  with  the 
General  Linear  Model.)  Using  an  alpha  of  .05,  we  would 
not  have  obtained  significance. 


Table  1 

A meta-analysis  investigating  class  size 
differences  in  effect  size 

Small  (S)  or 

Study 

A 

Class  Size  Large  (L)  Class  Size 

1 

.35 

36 

L 

2 

.45 

25 

S 

3 

.60 

15 

S 

4 

.40 

30 

s 

5 

.70 

8 

s 

6 

.30 

40 

L 

7 

.31 

45 

L 

1 8 

.29 

35 

S 

9 

.40 

40 

L 

10 

.38 

43 

L 

Mean  Effect  for  all  studies:  = .418 

Mean  Effect  for  studies  with  large  classes: 

= .348 

Mean  Effect  for  studies  with  small  classes: 

= .488 

One  also  could  look  at  Class  Size  as  a continu- 
ous variable  rather  than  as  an  artificially  dichotomized 
variable.  The  data  in  Table  1 have  been  plotted  in  Fig- 
ure 1,  treating  Class  Size  as  a continuous  variable.  The 
linear  correlation  between  Class  Size  and  Effect  Size 
yields  a correlation  of  .91  and  an  R:  of  .83.  While  the 
difference  in  Effect  Size  between  large  and  small  classes 
was  not  significant,  the  correlation  between  Class  Size 
and  Effect  Size  is  sienificant. 


Figure  I.  Relationship  between  Class  Size  as  a continuous 
variable  and  Effect  Size.  Fictitious  data  from  Tables  I and  3. 

The  above  correlation  can  be  obtained  and  tested 
for  significance  with  GLM.  The  research  hypothesis  is: 
“There  is  a negative  linear  relationship  between  Class  Size 
and  Effect  Size,"  resulting  in  the  following  Full  Model:  Ef- 
fect Size  = a*U  + b*Ciass  Size  + El  (where  Class  Size  is  a 
continuous  variable).  Since  there  is  expected  to  be  a nega- 
tive relationship,  the  expectation  is  that  the  weight,  b,  is 
less  than  0,  resulting  in  the  restriction  on  the  Full  Model  of 
b=0.  When  the  restriction  is  placed  on  the  Full  Model,  the 
following  Restricted  Model  obtains:  Effect  Size  = a*U  + 
E2.  Comparing  the  two  models  results  in  a p value  of  .0002, 
less  than  the  a priori  alpha  of  .05.  Thus  there  is  a signifi- 
cant negative  relationship  between  Class  Size  and  Effect 
Size. 

Early  discussions  o.'  effect  size  focused  on  differ- 
ences between  groups  and  linear  relationships.  Rosenthal 
(1980)  and  Light  and  Pillcmer  (1984)  emphasized  plotting 
the  data  to  look  for  non-linear  and  interacting  relationships 
in  the  data.  The  advantage  of  the  General  Linear  Model  is 
that  non-linear  and  interactive  relationships  can  easily  be 
tested  empirically.  Inspection  of  Figure  1 supports  the  in- 
vestigation of  a second-degree  curve. 

The  above  assertions  were  based  on  the  testing  of 
the  following  research  hypothesis:  “There  is  a second-de- 
gree relationship  between  Class  Size  and  Effect  Size,  over 
and  above  the  linear  fit.”  In  order  to  allow  for  a second- 
degree  curve,  a second-degree  component  of  Class  Size  must 
be  added  to  the  previous  straight-line  model,  resulting  in 
the  Full  Model:  Effect  Size  = a*U  + b*Ciass  Size  + c*Class 


Treatments  may  be  more  or  less  effective  depending 
upon  who  the  subjects  are , the  setting  in  which  the 
treatment  occurs , or  other  situational  variables 
An  aptitude-by-treatment  interaction  is  often  com- 
mon in  educational  research,  and  can  provide  valuable  in- 
sight to  a discipline  (Cronbach  & Snow,  1 977;  Tobias,  1 976). 
One  should  not  expect  a given  treatment  to  work  equally 
well  for  all  types  of  subjects.  Therefore,  one  should  not 
aggregate  results  from  studies  that  produce  different  results, 
as  those  in  Table  2 do. 


Table  2 

A meta-analysis  identifying  class  size  differences 
interacting  with  major  on  effect  size 


Major  (M)  or 

Study  A Class  Size  Non-major  (N) 


1 

.10 

5 

N 

2 

.10 

10 

N 

3 

.10 

15 

N 

4 

.20 

20 

N 

5 

.30 

30 

N 

6 

.50 

50 

N 

7 

.75 

75 

N 

8 

.80 

80 

N 

9 

.80 

20 

M 

10 

.75 

25 

M 

11 

.50 

50 

M 

12 

.70 

30 

M 

13 

.25 

75 

M 

14 

.20 

80 

M 

15 

.15 

80 

M 

16 

.25 

80 

M 

Mean  Effect  for  all  studies:  = .403 

Mean  Effect  for  studies  with  majors:  = .450 

Mean  Effect  for  studies  with  non-majors:  = .356 

Testing  the  research  hypothesis:  “Majors  produce 
a larger  Effect  Size  than  do  Non-Majors”  would  require  the 
same  analysis  as  in  Table  1.  The  Full  Model  would  be: 
Effect  Size  = a*U  + b*M/M  + El  (where  M/M  = I if  Major, 
0 if  Non-major).  The  Restricted  Model  would  be:  Effect 
Size  = a*U  + E2.  The  R:  of  the  Full  Model  is  .03.  resulting 


Size-'  + E3,  where  Class  Size-'  is  simply  the  squared  value  of 
Class  Size.  Since  the  research  hypothesis  specifies  a non- 
directional  second-degree  relationship,  the  expectation  is 
that  the  weight  for  the  second-degree  component  be  not  equal 
to  0,  resulting  in  the  restriction  that  the  weight  is  equal  to  0. 
If  the  weight,  c,  is  forced  to  be  equal  to  0,  the  Full  Model 
becomes  the  following  Restricted  Model:  Effect  Size  = a*U 
+ b*Class  Size  + E4.  Comparing  the  R'  of  the  two  models 
(.91  and  .83)  results  in  a p value  of  .036,  indicati’  l a sig- 
nificant second-degree  relationship. 


in  a p value  of  .5 1 58-no  significant  difference  between  major 
and  non-major. 

It  may  be  that  the  apparent  inconsistency  in  re- 
sults is  due  to  the  nature  of  the  treatment  (instruction).  While 
there  is  no  overall  difference  between  Majors  and  Non-ma- 
jors. the  results  arc  clearer  when  the  interaction  between 
whether  the  course  is  restricted  to  Majors  and  Size  of  the 
classroom  is  considered,  as  indicated  in  Figure  2.  Why  this 
is  the  case  is  not  known  at  this  time,  but  one  possibility  is 
that  learning  requires  some  content  literacy,  and  content 


Table  3 


literacy  is  facilitated  by  small  classes  and  debilitated  by  large 
classes.  This  finding  would  help  the  researcher  in  identify- 
ing a moderator  variable  which  could  be  tested  in  future 
research. 


Figure  2.  Relationship  between  Class  Size  as  a continu- 
ous variable  and  Effect  Size  for  Majors  (I ) and  Non- 
majors  (2).  using  Fictitious  data  from  Table  2. 


The  above  discussion  relates  to  testing  the  research 
hypothesis:  "There  is  an  interact  ion  between  Class  Size  and 
Major/Non-major  in  the  prediction  of  Effect  Size."  The 
Full  Mudel  needed  to  reflect  all  the  information  in  the  re- 
search hypothesis  is:  Effect  Size  = a*U  + b*Class  Size  + 
c*M/M  + d*(Class  Sizc*M/M ) + E 1 (where  Class  Size*M/ 
M is  simply  the  product  of  Class  Size  and  M/M).  If  there  is 
the  expected  interaction,  then  the  weight,  d,  will  be  non- 
zero. If  there  is  no  interaction,  then  the  weight,  d,  will  be 
zero,  resulting  in  the  Restricted  Model:  Effect  Size  = a*U  + 
b*Class  Size -f  c*M/M  + E2.  The  R:  of  the  Full  Model  is 
.99,  while  the  R:  of  the  Restricted  Model  is  .03.  The  f'-test 
of  these  two  models  results  in  a p value  of  .0001,  and  since 
this  value  is  less  than  our  alpha  of  .05,  we  can  conclude  that 
there  is  an  interaction  between  Class  Size  and  Major/Non- 
major. 

The  type  of  research  design  employed  in  a study  can 
strongly  influence  the  outcome 
Different  results  can  occur  as  a function  of  how 
the  researcher  designed  the  study.  For  instance,  studies  in 
most  research  areas  document  that  Volunteers  react  differ- 
ently than  Non-volunteers.  Rosenthal  and  Rosnow  (1975) 
reviewed  the  research  on  the  differences  between  Volun- 
teers and  Non -volunteers.  Some  of  the  differences  arc  that 
Volunteers  tend  to  (a)  be  better  educated,  ( b ) have  highet 
social  class,  (c)  be  more  intelligent,  and  (d)  have  a higher 
need  for  social  approval.  Suppose  that  the  studies  in  Table 
I were  conducted  with  college  sophomores,  half  were  con- 
ducted w ith  Volunteers  while  the  other  half  were  conducted 
with  Non- volunteers  (Non- volunteer  subjects  were  randomly 
assigned  to  experimental  groups  as  part  of  their  course  re- 
quirements). as  indicated  in  Table  3. 


A meta-analvsis  identifying  volunteer  differences  in 


SJnutv 

A 

— Effect  -Site  - 

C\’.i«  <si  /f* 

Volunutcer  (V)  or 

Mivv-Vnlimt^r  /NO 

1 

.35 

36 

N 

2 

.45 

25 

V 

3 

.60 

15 

V 

4 

.40 

30 

V 

5 

.70 

8 

V 

! ^ 

.30 

40 

N 

7 

.31 

45 

N 

8 

.29 

35 

N 

9 

.40 

40 

V 

10 

.38 

43 

N 

Mean  Effect  for  all  studies:  =.418 

Mean  Effect  for  studies  with  non-volunteers:  = .326 

Mean  Effect  for  studies  with  volunteers:  =.510 


Now  the  apparent  consistency  in  the  results  is  due  to 
whether  the  subjects  volunteered  for  the  study.  Indeed,  the 
Volunteer  Effect  is  (.510  - .326)  = .184.  Why  this  is  so  can 
only  be  conjectured  at  this  time,  although  there  is  much  in  the 
research  design  literature  about  demand  characteristics.  Vol- 
unteers usually  want  the  researcher  to  succeed,  are  extremely 
willing  to  do  whatever  requested,  try  to  figure  out  what  the 
researcher  wants  to  do,  attend  to  cues  diligently,  etc. 

The  research  hypothesis  tested  here  would  be  of 
the  same  structure  as  the  ones  in  Tabic  1 and  Table  2:  "Vol- 
unteers produce  a larger  Effect  Size  than  do  Non-volun- 
teers.” This  research  hypothesis  results  in  the  following 
Full  Model:  Effect  Size  = a*U  + b*V/NV  + El.  Since  this 
is  a directional  Research  Hypothesis,  w e want  b to  be  greater 
than  0.  The  Full  Model  R:  is  .51,  and  the  Restricted  Model 
R:  is  0.00,  resulting  in  a p value  of  .018.  For  these  fabri- 
cated data.  Volunteers  produce  a larger  effect  size,  than  do 
Non -volunteers. 

The  particular  analysis  procedure  that  is  used  may  be 
related  to  outcomes 

One  of  the  continuing  concerns  is  the  unit  of  analy- 
sis problem.  For  instance,  should  an  educational  researcher 
use  the  individual  subject  as  the  unit  of  analysis,  or  should 
the  classroom  mean  be  used  as  the  unit  of  analysis?  If  the 
teacher  effect  is  potent,  then  using  ihe  classroom  as  the  unit 
of  analysis  makes  sense  since  all  of  those  students  in  the 
one  classroom  were  taught  by  the  same  teacher,  if  the  treat- 
ment and  dependent  variable  can  he  inPucnccd  by  the  en- 
tire school— a school  effect— then  it  makes  sense  to  use  the 
school  as  the  unit  of  analysis.  Which  level  a researcher 
uses  can  influence  heavily  the  magnitude  of  Effect  Si/e. 
Pillcmer  and  Light  (1980)  staled  that  the  more  highly  aggre- 
gated the  unit  of  annly  sis.  the  stronger  the  relationship  w ill  be. 


Proposed  solution  when  several  results  from  one  study 
are  analyzed 

One  study  might  contribute  more  than  one  Effect 
Size  in  any  one  meta-analysis.  This  could  occur  if  multiple 
dependent  variables  were  used,  if  multiple  populations  were 
investigated,  or  if  multiple  treatments  or  multiple  compari- 
son groups  were  used.  In  these  cases,  the  unique  aspects  of 
the  study  impinge,  to  some  extent,  on  each  of  the  Effect 
Sizes  collected  from  that  one  study.  To  avoid  the  problems 
of  non-independent  data,  one  can  extend  the  analysis  of  re- 
peated measures  to  such  study-results  (Tracz,  Newman,  & 
McNeil,  1986). 

Suppose  the  1 0 Effect  Sizes  in  Table  3 actually  came 
from  six  different  studies.  The  analysis  would  need  to  take 
into  consideration  the  fact  that  there  is  non-independence 
in  the  data-some  of  the  studies  supplied  more  than  one  Ef- 
fect Size.  The  proposed  solution  is  to  include  "study  vec- 
tors," analogous  to  "person  vectors"  in  repeated  measures 
analysis.  The  study  vectors  are  presented  in  Table  4.  The 
research  hypothesis  tested  is  "Small  classes  produce  larger 
Effect  Sizes  than  do  Larger  classes,  over  and  above  the  in- 
dividual differences  due  to  each  study."  The  Full  Model 
would  need  to  have  not  only  information  about  size  of  class 
(S/L),  but  also  which  of  the  six  studies  the  results  were  from 
(S 1 , S2,  etc.).  We  thus  have  as  the  Full  Model:  Effect  Size 
= a*U  + b*S/L  + c*SI  + d*S2  + e*S3  + f*S6  + g*S8  + 
h*S9  + E!  (where  Si  = 1 if  Effect  Size  is  from  study  l,  0 
otherwise,  etc.).  If  there  is  no  difference  between  large  and 
small  Class  Sizes  (over  and  above  study  differences),  then 
the  weight,  b,  will  be  equal  to  0,  resulting  in  the  Restricted 
Model:  Effect  Size  = a*U  + c*Sl  + d*S2  + e*S3  + f*S6  + 
g*S8  + h*S9  + E2.  The  R:  of  the  Full  Model  is  .7 1 and  the 
R:  of  the  Restricted  Model  is  .67,  resulting  in  a p value  of 
.4929-small  classes  do  not  produce  larger  Effect  Sizes  than 
do  Larger  classes,  over  and  above  study  differences. 


Table  4 

A meta-analysis  investigating  class  size 
differences  in  effect  size,  considering 
multiple  results  from  several  studies 

Study 

A 

Small  (S) 
Large  (L) 

SI 

S2 

S3 

S6  S8 

S9 

1 

.35 

L 

1 

0 

0 

0 0 

0 

2 

.45 

S 

0 

1 

0 

0 0 

0 

3 

.60 

S 

0 

0 

1 

0 0 

0 

3 

.40 

s 

0 

0 

1 

0 0 

0 

3 

.70 

s 

0 

0 

1 

0 0 

0 

6 

.30 

L 

0 

0 

0 

1 0 

0 

6 

.31 

L 

0 

0 

0 

1 0 

0 

8 

.29 

S 

0 

0 

0 

0 I 

0 

9 

.40 

L 

0 

0 

0 

0 0 

1 

9 

.38 

L 

0 

0 

0 

0 0 

1 

Summary 

Since  the  study  characteristic  is  constant  for  any 
one  study,  none  of  the  original  researchers  could  have  tested 
any  of  the  research  hypotheses  discussed  in  this  paper. 
Analyzing  Effect  Size  facilitates  the  explanation  for  why 
different  Effect  Sizes  are  obtained  from  different  studies. 
Such  information  is  invaluable  for  understanding  and  ex- 
tending the  knowledge  base  in  any  field. 
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Mean  Effect  for  all  studies:  =.418 

Mean  Effect  for  studies  with  large  classes:  = .348 

Mean  Effect  for  studies  with  small  classes:  = .488 


Factors  Underlying  Effective  College  Teaching: 
What  Students  Tell  Us 

Carolyn  Benz  and  Stephen  J.  Blatt,  University  of  Dayton 

Abstract 

The  researchers  analyzed  28,000  student  evaluations  of  faculty  across  46  departments  for  one  aca- 
demic term.  A 27-item  instrument  on  which  students  rated  faculty  was  used.  One  global  item  assessing 
overall  instructor  effectiveness  was  predicted  most  strongly  by  three  items:  namely ; students'  percep- 
tion that  the  instructor  was  prepared , presented  subject  matter  clearly,  and  was  interesting.  The  predic- 
tors of  students'  perceiving  that  they  " learned  a lot"  were  the  ratings  on  three  items:  the  instructor  was 
interesting,  the  course  met  the  objectives,  and  the  instructor  was  well-prepared.  Being  prepared  and 
being  interesting  seem  to  be  critical  characteristics  for  university  faculty'  in  the  classroom. 


Other  than  the  routine  reports  for  individual  pro- 
fessors there  had  never  been  a systematic  study  of  the  stu- 
dent evaluations  of  faculty  at  our  institution.  We  decided  to 
examine  the  aggregate  of  evaluations  for  one  semester  in 
ways  that  could  reveal  the  underlying  dimensions  of  stu- 
dent ratings.  This  became  our  first  line  of  inquiry.  Results 
would  add  to  faculty’s  understanding  of  the  validity  of  a 
measuring  tool  that  has  been  used  for  many  years,  and  one 
that  impacts  seriously  on  their  pay  and  promotion.  A com- 
mon administrative  use  of  only  one  item  ("Overall  rating  of 
the  instructor’*),  to  the  exclusion  of  26  other  items  on  which 
data  were  routinely  collected,  posed  a second  intriguing  ques- 
tion for  us;  namely.  Which  of  the  other  items  weighted 
most  heavily  in  predicting  the  rating  of  "Overall  effective- 
ness*' of  the  instructor?  And,  thirdly.  Which  of  the  items 
were  the  most  important  predictors  of  students’  reporting 
that  they  "learned  a lot?” 

Research  on  student  evaluation  of  faculty  seems  to 
adopt  one  of  two  perspectives:  either  teaching  effectiveness 
can  be  assessed  globally,  using  a single  overall  measure;  or 
teaching  is  multidimensional  and  assessment  must  address 
many  individual  dimensions  (Blatt  & Benz,  1993;Ryan, 
Harrison,  & Zia,  1993).  Ryan  and  colleagues  conducted  an 
extensive  review  of  published  studies  and  found  a lack  of 
research  that  examined  individual  teaching  behaviors  that 
relate  to  a one-item  global  evaluation.  While  a void  exists 
for  that  particular  type  of  study,  the  field  in  general  is  well- 
researched.  Marsh  and  Bailey  (1993)  report  that  literally 
thousands  of  studies  have  been  conducted  and  they  concluded 
that  the  process  itself  seems  supportable  in  assessing  teach- 
ing effeciivcncNS. 

Procedures 

At  the  conclusion  of  each  term  at  the  University  of 
Dayton  undergraduate  students  are  asked  to  fill  out  a for- 
mal evaluation  form  in  each  course.  In  addition  to  demo- 
graphic items  (gender,  year  in  school.  GPA.  whether  the 
course  is  required  or  not,  etc.)  there  are  items  that  relate  to 
quality  of  the  instruction  and  the  course.  The  students  re- 
spond to  the  items  anonymously  on  bubble-scan  sheets  which 


are  collected  by  one  member  of  the  class  and  sent  to  the 
computer  center.  Results  for  each  course  are  returned  to  each 
instructor  from  the  computer  center,  via  each  department 
chair. 

The  data  from  student  evaluations  of  the  January- 
April  1992  term  were  aggregated  and  analyzed.  Data  from 
46  departments,  university-wide,  were  analyzed  separately. 
All  were  then  aggregated  to  form  a data-set  of  approximately 
28,800.  There  was  one  limitation  in  the  design  of  the  study: 
the  analyses  violated  the  assumption  of  independence  of 
measures.  There  were  not  28,800  separate  student  evalua- 
tions. A student  would  typically  enroll  in  four  or  five  courses, 
therefore,  completing  four  or  five  evaluation  forms  at  the 
end  of  the  term.  Because  the  students  complete  the  evalua- 
tion forms  anonymously  there  was  no  way  to  correct  for 
non-independence  of  the  data. 

Results 

Question  #1:  Underlying  dimensions  of  the  evaluation 
instrument 

A factor  analysis  of  the  data  was  conducted  to  re- 
veal the  underlj  ng  structure  of  the  evaluation  instrument. 
A principal  components  solution  with  varimax  rotation,  with 
an  eigenvalue  cutoff  of  1.00,  was  used.  Selecting  this  type 
of  factor  analysis  grew  from  the  traditional  notion  of  factor 
analysis  as  a way  to  map  an  unfamiliar  terrain,  as  Rummcl 
( 1970)  puts  it,  and  our  desire  to  reveal  the  clearest  and  sim- 
plest structure  underlying  faculty  evaluation,  i.e.. 
uncorrelatcd  factors. 

A three-factor  solution  resulted  and  Table  l reports 
the  results.  The  first  factor  defines  a dimension  interpreted 
as  "Instruction.”  Items  originally  designed  to  relate  to  both 
the  instructor  and  the  course  loaded  on  this  factor.  This  fac- 
tor includes  the  global  or  "overall”  items  that  call  for  as- 
sessing the  course  and  assessing  the  instructor  (items  #7 
and  #8). 

Factor  Two  was  interpreted  to  be  an  "Affective” 
dimension.  Four  items  addressing  such  issues  as  student’s 
expressiveness,  instructor's  willingness  to  help,  etc.  loaded 


highly  on  this  factor.  The  third  factor,  named  "Materials", 
was  interpreted  as  a dimension  clearly  related  to  materials 
and  scheduling. 

In  sum,  these  results  would  suggest  that  the  items 
on  the  evaluation  instrument  group  around  three  dimen- 
sions: "Instruction",  "Affect",  and  "Materials." 

Question  #2:  Predictors  of  overall  instructor  rating 

Item  #8  stales:  "Everything  considered,  how  would 
you  rate  this  instructor?"  This  global  evaluation  item  is  the 
most  important  item  for  faculty  concern.  In  some  depart- 
ments this  item  is  the  exclusive  means  of  evaluation.  Wc 
were  interested  in  which  specific  teaching  behaviors  and 
attitudes  related  most  strongly  to  it.  In  order  to  answer  this 
question  a regression  analysis  was  done.  The  items  catego- 
rized by  the  university  as  "instructor  items"  (#10  through 
#17)  were  used  as  predictor  variables  against  the  criterion 
of  item  #8:  Overall  instructor  rating.  These  items  accounted 
for  .65  of  the  variance  of  the  overall  instructor  perception: 
the  regression  weights  appear  on  Table  2.  Tentatively,  the 
three  items  contributing  most  to  the  perceptions  of  the  in- 
structor were  item  10  "The  instructor  was  prepared  well", 
item  #12,  "The  subject  matter  was  clearly  presented...",  and 
item  #13  "The  instructor  put  material  across  in  an  interest- 
ing way."  The  other  teaching  behavior  and  attitude  items 
contributed  little  to  the  overall  ratings  of  instructor  com- 
pared to  these  three  items. 

Because  regresssion  weights  are  unstable  from 
sample  to  sample  and  one  can  conclude  little  from  just  one 
data-set.  a cross-validation  study  was  done.  The  results  sup- 
ported the  pattern  of  weights.  We  have  confidence  the  three 
items  are.  in  fact,  significant  characteristics  related  to  over- 
all instructor  ratings. 

Question  #3:  Predictors  of  students ' perception  of 
“ having  learned  a lot?" 

Item  #9:  "1  learned  a great  deal  from  this  course" 
is  all  but  forgotten  in  faculty  evaluations  at  this  institution. 
Responses  to  this  item  seemed  to  us  to  be  the  most  relevant 
one  of  all  as  far  as  our  goals  as  faculty  are  concerned.  A 
legitimate  case  could  be  made  foi  the  fact  that  students  re- 
porting a sense  of  having  learned  a lot  is  even  more  power- 
ful effectiveness  indicator  than  a global  assessment  item 
like  #7  or  #8.  That  a student  may  rate  an  instructor  in  a less 
than  positive  way  "overall"  is  relatively  unimportant,  one 
might  assert,  compared  to  whether  or  not  the  student  re- 
ported having  learned. 

This  item,  item  #9,  is  not  part  of  the  “overall"  rat- 
ings of  course  and  instructor.  It  is  never  used  in  the  typical 
departmental  review  of  faculty. 

In  order  to  determine  which  items  on  the  instru- 
ment were  most  predictive  of  students*  having  reported  a 
feeling  of  learning  a lot.  all  the  items  (#10  through  #25) 
were  regressed  on  item  #0  as  a criterion  variable.  Table  3 
presents  the  results. 

The  16  items  accounted  for  .53  of  the  variance  in 
the  students*  reported  sense  ol  learning.  The  most  contribu- 
tory items  were  #13:  "The  instructor  put  material  across  in 


an  interesting  way",  item  #19:"Thc  course  effectively  met 
these  objectives",  and  item  #10:  “The  instructor  w*as  pre- 
pared well  for  classes." 

Three  items  were  negatively  related  to  the  crite- 
rion, #11:  "The  instructor  spoke  clearly  and  audibly", 
#16:"The  instructor  respected  students  as  persons"  #25:"Ex- 
aminations  and  assignments  were  graded  and  returned 
within  a reasonable  time." 

Cross-validation  studies  supported  this  pattern  of 
importance  among  the  variables. 

Discussion 

This  study  of  student  evaluations  at  our  institution 
was  born  out  of  faculty  self-interest:  promotion  and  pay  are 
strongly  linked  to  the  student  evaluation  system.  We  felt 
that  to  assist  ourselves  and  our  colleagues  to  become  ac- 
quainted with  the  student  evaluation  process,  we  would  ex- 
amine the  data  generated  from  our  own  students  for  insights 
into  the  constructs  being  measured  and  how  the  global  (or 
"overall")  items  relate  to  items  on  specific  teacher  behav- 
iors and  attitudes.  In  many  departments,  these  "overall** 
items.  #7  and  #8,  are  used  to  the  exclusion  of  all  other  items. 
Most  frequently,  as  a matter  of  fact,  only  #8  is  used.  Addi- 
tionally, wc  wanted  to  explore  the  relationships  between  the 
other  items  and  item  #9,  the  students'  perception  of  having 
learned  a lot. 

Wc  drew  several  conclusions  from  the  data  analy- 
sis and  presented  them  to  the  faculty  during  an  Inservice- 
Day  shortly  after  the  research  was  completed.  Discussion 
begun  during  that  meeting  continued  informally  for  several 
weeks  after. 

The  conclusions  are  clear.  First  of  all.  students 
seem  to  be  attending  to  behavioral  factors  rather  than  affec- 
tive factors  in  their  overall  evaluation  of  faculty  (item  #8). 
This  conclusion  is  warranted  by  our  finding  that  the  follow- 
ing items  w'ere  predictive  of  overall  instructor  rating: 

The  instructor  prepared  well 

The  subject  matter  was  clearly  presented 

The  instructor  put  material  across  in  an 
interesting  way. 

On  the  other  hand,  the  items  more  reflective  of 
"affect**  were  not  strongly  predictive  of  instructor  ratings. 
Examples  of  these  items  are  those  that  address  "respect  for 
students"  and  "fairness."  This  is  particularly  meaningful 
because  departments  often  use  only  item  #8  for  personnel 
decisions.  It  may  well  be  that  being  "nice**  and  supportive 
with  students  is  not  a sure  pathway  toward  high  teaching 
ratings.  Students  may  be  telling  us  "Be  interesting  and  pre- 
pared; nice  ness  won't  cut  it!" 

Secondly,  item  #9:  "1  learned  a lot"  provided  an 
interesting  parallel  lo  item  #8.  Our  perception  that  this  item 
is  mostly  ignored  was  confirmed  w hen  we  discovered  that  a 
number  of  faculty  had  forgotten  it  vs  as  even  on  the  form. 
The  responses  to  this  item  may  he  more  important  than  re 
spouses  to  item  #8  w here  the  instructor  overall  is  rated.  That 
students*  perceptions  about  learning  may  be  solid  evidence 
of  effeethc  teaching.  We  found  that  students'  feelings  that 


Table  I 


Factor  Analysis  Results:  Student  Evaluation  of  Faculty  Form 
(Data  from  January  1992  term) 


hem  Question 

Instruction 

Affective 

Materials 

7 Everything  considered,  how  would  you  rate  this  course? 

.74443 

8 Everthing  considered,  how  would  you  rate  this  instructor? 

.76032 

9 I learned  a great  deal  from  this  course. 

.73990 

10  The  instructor  prepared  well  for  classes. 

.70493 

1 1 The  instructor  spoke  clearly  and  audibly. 

.56769 

12  The  subject  matter  was  clearly  presented  by  the  instructor. 

.75327 

13  The  instructor  put  material  across  in  an  interesting  way. 

.71228 

14  Students  were  able  to  exDress  themselves  freely  as  a result  of 

the  instructor's  openness  to  their  ideas. 

.76411 

15  The  instructor  was  willing  to  help  students  who  experienced 

difficulty  in  the  course. 

.73469 

1 6 The  instructor  respected  students  as  persons. 

.79901 

17  The  instructor  was  fair  in  grading  examinations 

and  assignments. 

.56227 

1 8 The  goals  and  objectives  of  this  course  well  defined. 

.66159 

19  This  course  effectively  met  these  objectives. 

.70905 

20  This  course  was  well  coordinated  and  well  organized. 

.74749 

2 1 Supplemental  course  material,  such  as  handouts,  visual  aids. 

bibliographies,  etc.,  enriched  this  course. 

.47011 

22  The  textbook  was  an  asset  to  this  course. 

.79282 

23  Assignments  were  relevant  to  course  content. 

.63402 

24  Examinations  related  w'ell  to  the  material  emphasized  in  the 

course. 

.55747 

25  Examinations  and  assignments  were  graded  and  returned  within 

a reasonable  time  to  students. 

.44881 

Eigenvalue 

5.970 

3.328 

2.674 

Trace  Variance 

.31 

.17 

.14 

{62^  trace  variance} 

Table  2 

/terns  #10  through  #17  as  Predictor 
Variables  of  Overall  Rating  of  Instructor  (#8) 

Item 

Question 

partial  regression 

weight 

t 

p>t 

10 

The  instructor  prepared  well  for  classes. 

.2110 

36.35 

.0001 

.2332  ( 1 ) 

28.16  (1) 

.1906  (3) 

23.39  (2) 

11 

The  instructor  spoke  clearly  and  audibly. 

.0256 

4.51 

.0001 

.0295  ( I ) 

3.46(1) 

.0238  (2) 

3.102  (2) 

12 

The  subject  matter  was  clearly  presented  h\  the  instructor. 

.2267 

41.01 

.0001 

.2237  1 1 ) 

28.67  ( 1 ) 

.2285  (2) 

29.16(2) 

13 

The  instructor  put  material  across  in  an  interesting  way. 

.2851 

59.80 

.0001 

.2781  (1) 

41.85  (1) 

.2913  (20) 

42.52  (2) 

14 

Students  were  able  to  express  themsehes  freely  as  a result 

.0389 

7.218 

.0001 

of  the  instructor's  openness  to  their  ideas. 

.0473  ( 1 ) 

6.17  (1) 

.0321  (2) 

4.236  (2) 

15 

The  instructor  was  willing  to  help  students  who  experienced 

.0619 

11.481 

.0001 

difficulty  in  the  course. 

.0612  (1) 

8.04  (I) 

.0643  (2) 

8.387  (2) 

16 

The  instructor  respected  students  as  persons. 

.0977 

14.95 

.0001 

.0859  (1) 

9.301  (I) 

.1080  (2) 

11.66  (2) 

17 

The  instiuetoi  was  lair  in  guiding  examinations  and 

,0982 

20.743 

.0001 

assignments. 

.1056  (!) 

16.31  (1) 

.0X85  (2) 

12.71  (2) 

Note:  R = .6546  df  = S/27734 

R‘  cross  validation  - 

.6392 

Table  3 


All  items  (#10-#25)  as  predictor  variables  of  students'  perceptions  of  "learning  a lot"  (#9) 


Item  Question 

partial  regression 
weight 

t 

t>P 

10  The  instnjetor  prepared  well  for  classes. 

.1598 

21.53 

.0001 

.1721  (1) 

15.87  (1) 

.1489  (2) 

14.63  (2) 

1 1 The  instructor  spoke  clearly  and  audibly. 

-.0347 

-5.20 

.0001 

-.0332  (!) 

-3.27  (1) 

-.0366  (2) 

-4.112  (2) 

1 2 The  subject  matter  was  clearly  presented  by  the  instructor. 

.0910 

13.32 

.0001 

.0712  (1) 

7.31  (1) 

.1115  (2) 

11.62  (2) 

13  The  instructor  put  material  across  in  an  interesting  way. 

.2150 

37.62 

.2400  (1) 

29.67  ( 1 ) 

.1898  (2) 

23.47  (2) 

14  Students  were  able  to  express  themselves  freely  as  a result  of 

.0058 

0.92 

.3575 

the  instructor's  openness  to  their  ideas. 

-.0121  (1) 

-1.33  (1) 

.0225  (2) 

2.52  (2) 

15  The  instructor  was  willing  to  help  students  who  experienced 

.0109 

1.72 

.0848 

difficulty  in  the  course. 

-.0007  (1) 

-.077  (1) 

.0234  (2) 

2.63  (2) 

16  The  instructor  respected  students  as  persons. 

-.0151 

-1.98 

.0472 

-.0169  (1) 

-1.54  (1) 

-.0117  (2) 

-1.10(2) 

1 7 The  instructor  was  fair  in  grading  examinations  and 

.0223 

3.82 

.0001 

assignments. 

.0281(1) 

3.49  ( 1 ) 

.0145 

1.71  (2) 

1 8 The  goals  and  objectives  of  this  course  were  well  defined. 

.0079 

0.97 

.3297 

-.0067  ( 1 ) 

-0.56  ( i ) 

.0213  (2) 

1.88  (2) 

19  This  course  effectively  met  its  objectives. 

.2209 

24.89 

.0001 

.2218  (1) 

16.84  (1) 

.2184  (2) 

18.17  (2) 

20  This  course  was  well  coordinated  and  well  organized. 

.0736 

9.40 

.0001 

.0850  ( 1 ) 

7.53  (1) 

.0612  (2) 

5.63  (2) 

2 1 Supplemental  course  material,  such  as  handouts,  visual  aids. 

.0574 

11.05 

.0001 

bibliographies,  etc.,  enriched  this  course. 

.0424  ( 1 ) 

5.84  (1) 

.0736  (2) 

9.86  (2) 

22  The  textbook  was  an  asset  to  this  course. 

.0460 

11.68 

.0001 

.0412(1) 

7.52  (1) 

.0499  (2) 

8.76(2) 

23  Assignments  were  relevant  to  course  content. 

.0517 

7.98 

.0001 

.0748  (1) 

7.62  ( 1 ) 

.0333  (2) 

3.85  (2) 

24  Examinations  related  well  to  the  material  emphasized  in  the 

.0488 

8.35 

.0001 

course. 

.0485  ( 1 ) 

5.81  (1) 

.0479(2) 

5.84  (2) 

25  Examinations  and  assignments  were  graded  and  returned 

-.0328 

-5.99 

.0001 

within  a reasonable  lime  to  students. 

-.0288  (1) 

-3.73  (1) 

-.0392  (2) 

-5.00  (2) 

Note:  R:  = .5380  df  = 16/25660 

R;  cross  \alidation  = .5385 
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the  instructor  prepared  well 
the  instructor  put  material  across  in  an 
interesting  way 

the  course  effectively  met  these  objectives 
were  predictive  of  student's  perception  of  “having  learned." 
The  first  two  of  these  behaviors  arc  the  same  behaviors  that 
predicted  responses  to  item  #8.  Clearly,  being  interesting 
and  having  prepared  are  crucial  for  both  being  perceived  as 
a good  teacher  and  for  students'  feelings  of  learning. 

Beyond  the  results  reported  here,  it  is  interesting 
that  we  found  no  gender  difference  in  the  evaluation  of  fac- 
ulty; however,  female  students  rated  faculty  characteristics 
higher  on  all  items  than  did  male  students.  Whether  the 
student  viewed  the  course  as  required  or  not  required  made 
no  significant  difference  in  their  responses  to  course  evalu- 
ation. Surprisingly,  the  instructor  rating/course  rating,  items 
#7  and  #8,  and  the  “amount  student  learned"  item,  #9,  had 
higher  means  when  the  course  was  not  required. 

Finally,  we  return  to  our  original  interest  - the  un- 
derlying dimensions  of  what  is  being  measured.  The  stu- 
dent evaluation  form  appears  to  be  measuring  “instruction", 
“affect",  and  “materials."  The  two  “overall"  ratings  (#7  and 
#8)  loaded  heavily  on  the  “instruction"  factor.  This  sug- 
gests that  administrators  can  use  these  items  with  confi- 
dence in  assessing  overall  faculty  proficiency  in  instruction. 
The  underlying  dimensions  of  “instruction"  and  “course" 
overlap,  according  to  our  factor  analysis,  evidence  that  in 
students*  minds  the  two  are  inextricably  linked.  While  this 
raises  other  questions,  (Does  subject  matter  preference  bias 
student  ratings?),  it  seems  to  confirm  that  what  one  per- 
ceives about  the  course  is  also  likely  to  be  what  one  per- 
ceives about  the  instructor. 

The  need  for  systematic  institutional  studies 

Following  discussion  of  these  findings  with  fac- 
ulty during  In-Service  day,  findings  were  also  printed  in  the 
campus  newspaper.  Feedback  from  faculty  overwhelmingly 
supported  this  line  of  inquiry.  They  have  asked  for  more 
study  of  the  instrument  and  student  responses,  and  also  of 
the  ways  in  which  the  results  are  used  from  department  to 
department.  Many  professors  raised  issues  of  specific  rol- 
es ancc:  i.e..  Is  a universal  form  the  best  tool?  For  example, 
do  laboratory  courses  and  performance  courses  in  the  line 
arts  present  a different  set  of  dynamics  for  students  to  as- 
sess than  classroom  lecture  courses?  Some  of  these  same 
faculty  suggested  an  additional  response  option  of  “Does 
not  apply."  Some  qualities  queried  on  the  form  were  con- 
sidered irrelevant  to  some  courses. 

A few  faculty  spoke  to  a need  for  opportunity  for 
faculty  feedback  to  student  evaluations.  When  or  how  do 
faculty  hav  e a voice  in  their  use?  Others  were  interested  in 
whether  or  not  students*  evaluations  were  related  t o course 
grades  they  received.  Some  recommended  open-ended  re- 
sponse options  for  students.  While  some  dcpaitments  have 
added  room  for  comments  under  each  item,  many  faculty 
pressed  lor  requiring  students  to  write  reasons  why  they  gave 
the  numerical  rating  that  they  did.  The  possible  relation- 
ship between  students'  personal  investment  in  the  course  to 


how^  they  evaluate  it  was  discussed.  In  other  words,  might 
there  be  value  in  asking  students  how  many  classes  they 
missed  and  how  much  study -time  they  put  in  per  week  on 
the  course  material?  Also,  some  asked  for  inclusion  of  items 
on  gender-sensitive  and  ethnicity-sensitive  language  and  at- 
titudes on  the  part  of  faculty. 

Finally,  the  order  of  items  on  the  Student  Evalua- 
tion Form  has  been  questioned.  The  overall,  global,  assess- 
ment items  are  currently  #7  and  #8  and,  as  such,  precede 
the  items  on  specific  teaching  behaviors  and  attitudes. 
Whether  or  not  this  order  encourages  the  appropriate  re- 
sponse-set among  students  is  a concern.  In  the  past,  these 
two  global  items  were  at  the  end  of  the  list  of  all  other  items. 
The  resulting  dynamic  of  both  strategies  needs  to  be  as- 
sessed, according  to  some  faculty. 

Our  intent  is  to  continue  this  research  in  a variety 
of  ways.  The  immediate  plan  is  to  ask  students  to  record  the 
“meaning"  of  their  numerical  responses  in  a randomly  se- 
lected set  of  classrooms.  In  other  w'ords,  w'hat  does  it  mean 
to  students  to:  “put  material  across  in  an  interesting  way?" 
Further  policy  studies  of  administrative  use  of  the  process 
are  also  planned.  A more  systematic  study  of  faculty  views 
is  required.  We  plan  to  interview  faculty,  as  well  as  stu- 
dents, to  get  more  in-depth  interpretations  of  this  process. 
How  do  faculty  relate  to  the  process  personally  and  profes- 
sionally? What  impact  does  it  have  or  not  have  on  their 
teaching? 

At  the  present  time  a replication  of  this  study  as 
well  as  an  examination  of  the  communication  competen- 
cies that  correlate  with  these  items  currently  underway.  We 
strongly  believe  that  continuing  broad-based  institutional 
examination  of  the  process  of  student  evaluation  is  abso- 
lutely essential  for  a positive  climate  of  optimal  teaching 
and  learning  at  our  university  to  flourish. 
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MWER  Feature:  Research  in  Action 
Computer-Based  Education:  More  Hype  Than  Help? 

Jack  Snowman,  Southern  Illinois  University,  Carbondale 


The  current  educational  and  psychological  literature 

is  replete  with  suggestions  for  improving  the  quality  of  both 
classroom  instruction  and  student  achievement  with  this  or 
that  technological  innovation.  A cursory  survey  of  my 
library's  most  recent  ERIC  listings  turned  up  the  following: 
the  use  of  a computer-based  simulation  by  second-graders 
to  "reconstruct"  extinct  or  endangered  animals  from  recy- 
clable materials;  the  use  of  a supercomputer  to  create  3- 
dimensional  images  of  scientific  concepts  in  high  school 
chemistry  and  physics  classes;  the  use  of  an  information 
network  by  Florida  schoolchildren  to  exchange  electronic 
mail,  conduct  online  conferences,  and  access  various  data- 
bases; the  use  of  computerized  speech  and  graphics  to  help 
poor  readers  improve  their  decoding  and  comprehension 
skills:  the  use  of  a computerized  spelling  program  designed 
to  improve  children’s  spelling  and  phonological  skills;  and 
the  use  of  a CD-ROM  to  develop  students'  listening  skills. 

Needless  to  say,  most  of  the  people  who  write  about 
technology  in  the  classroom  are  anywhere  from  moderately 
to  wildly  enthusiastic  about  its  prospects  for  improving  the 
quality  of  teaching  and  learning.  Although  B.  F.  Skinner 
(1986)  was  referring  to  the  teaching  machines  of  the  1960s 
when  he  said  that  students  who  were  taught  with  such  de- 
vices could  learn  twice  as  much  in  the  same  time  and  with 
the  same  effort  as  students  taught  conventionally  ( Phi  Delta 
Kappan , volume  68.  number  2),  he  left  no  doubt  that  he  felt 
the  same  way  about  the  potential  of  today’s  computer-based 
technologies  (provided,  of  course,  that  the  software  is  de- 
signed around  basic  operant  conditioning  principles). 

While  it  is  fine  to  be  enthusiastic  about  ideas  and  prod- 
ucts that  may  improve  classroom  instruction  and  achieve- 
ment. at  some  point  we  need  to  turn  to  the  empirical  litera- 
ture to  get  some  idea  of  how  well  the  innovation  fulfills  the 
claims  that  have  been  made  for  it.  One  problem  with  trying 
to  gauge  the  effectiveness  of  such  new  technologies  as 
telecomputing,  CD-ROM.  interactive  compact  disks  (CD- 
1),  and  hypermedia  is  the  lack  of  a broad  research  base.  But 
the  research  literature  on  computer-based  education  (CBE), 
which  involves  using  the  computer  to  teach  students  new 
information  and  skills  as  well  as  to  help  the  teacher  manage 
various  aspects  of  instruction,  is  more  extensive  owing  to 
its  longer  history.  Consequently,  we  can  draw  some  general 
conclusions  about  the  effectiveness  of  CAI  by  looking  at  a 
few  of  the  meta-analyses  that  have  been  published  since 
1980. 

l;or  those  readers  who  have  only  a passing  familiarity 
with  meta*  analysis,  it  is  a quantitative  method  of  reviewing 
literature  whose  primary  statistic  is  the  effect  si/e  (ES). 
Basically,  an  KS  indicates  how-  far  apart  in  standard  devia- 
tion units  the  average  student  in  a treatment  group  is  from 


the  average  student  in  a control  group.  So,  an  ES  of  .23 
indicates  that  the  average  student  in  the  treatment  group 
scored  one-fourth  of  a standard  deviation  higher  than  the 
average  student  in  the  control  group  on  the  outcome  mea- 
sure that  was  used. 

The  Effect  vf  CBE  on  Elementary  School 
Students  ’ Achievement 

In  volume  1 of  Computers  in  Human  Behavior  ( 1985). 
James  Kulik,  Chcn-Lin  Kulik.  and  Robert  Bangert-Drowns 
describe  the  results  of  a meta-analysis  of  32  studies  that  met 
four  basic  criteria:  (a)  Each  study  had  to  take  place  in  an 
actual  First-  through  sixth-grade  classroom,  (b)  Each  study 
had  to  provide  quantitative  results  from  both  a computer- 
taught  class  and  a conventionally  instructed  class,  (c)  Each 
study  had  to  be  free  of  such  major  methodological  flaw's  as 
substantial  differences  in  aptitude  of  treatment  and  control 
groups,  unfair  leaching  of  the  criterion  test  to  one  of  the 
comparison  groups,  and  differential  rates  of  attrition  from 
the  treatment  and  control  groups,  (d)  Each  study  had  to  be 
obtainable  from  library  holdings  and  data-bases  like  ERIC. 

Tw'enty-eight  of  the  studies  represented  one  of  two  va- 
rieties of  computer-assisted  instruction  (CAI),  The  com- 
puter was  used  to  either  help  students  consolidate  recently 
acquired  skills  through  drill-and-practice  exercises  or  to 
teach  new'  knowledge  and  skills  through  tutorials.  In  the 
remaining  four  studies,  the  computer  was  used  to  evaluate 
student  performance,  guide  students  to  appropriate  instruc- 
tional resources,  and  keep  records  of  student  progress.  This 
latter  type  of  use  is  typically  referred  to  as  computer-man- 
aged instruction  (CM1). 

For  the  four  CM  I studies,  the  average  ES  for  achieve- 
ment was  a trivial  .07.  Thus,  using  the  computer  in  the 
manner  described  above  conferred  almost  no  advantage  on 
those  students  in  comparison  to  conventionally  taught  stu- 
dents. 

By  contrast,  the  average  ES  for  achievement  for  the 
CAI  studies  was  .47.  This  means  that  the  typical  student  in 
the  CAI  classes  scored  at  the  68th  percentile  whereas  the 
typical  student  in  the  conventionally  taught  classes  scored 
at  the  30th  percentile.  Another  way  of  saying  the  same 
thing  is  that  68  percent  of  the  students  from  the  CAI  classes 
outseored  the  average  student  from  the  control  l lasses. 
Regardless  of  how  you  look  at  it.  this  represents  a positive 
effect  for  CAI  that  the  Kuliks  characterize  as  moderate.  But 
what  makes  this  effect  more  impressive  is  that  it  was  ob- 
tained with  a relatively  modest  input.  On  average,  students 
received  only  26  hours  of  CAI  over  a 26- week  span.  If  you 
break  that  down  into  equal  segments,  it  works  out  to  12 
minutes  per  school-day. 


Five  studies  examined  the  effect  of  CAI  on  both  highl- 
and low-aptitude  students.  Although  the  achievement  test 
scores  of  the  low-aptitude  students  increased  by  .41  stan- 
dard deviations  versus  .08  standard  deviations  for  the  high- 
apt  itude  students,  this  difference  was  not  statistically  sig- 
nificant. 

For  the  five  studies  that  administered  retention  tests, 
the  CAl-taught  students  scored  slightly  higher.  The  aver- 
age ES  was  .27. 

Finally,  only  one  study  examined  changes  in  attitude 
toward  the  subject  (math).  The  ES  of  .10  indicated  essen- 
tially no  change  in  attitude. 

The  Effect  of  CBE  on  Secondary  School 

Students’  Achievement 

A meta-analysis  of  CAI  effects  among  junior  and  se- 
nior high  school  students  was  conducted  by  Robert  Bangert- 
Drowns.  James  Kulik,  and  Chen-Lin  Kulik  ( 1 985)  and  pub- 
lished in  volume  1 2,  number  3 of  the  Journal  of  Computer- 
Based  Inst  ruction.  The  authors  located  42  studies  that  met 
the  same  criteria  as  those  mentioned  above,  and  that  as- 
sessed the  effects  of  CAI,  CMI,  and  something  called  com- 
puter-enriched instruction  (CEl).  In  the  17  CAI  studies, 
the  computer  was  used  either  for  drill-and-practice  or  tuto- 
rial purposes.  In  the  16  CMI  studies,  the  computer  evalu- 
ated student  performance,  guided  students  to  appropriate 
instructional  resources,  and  kept  records  of  student  progress. 
In  the  9 CEI  studies,  the  computer  either  generated  data  at 
the  student's  request  or  ran  programs  developed  by  the  stu- 
dent (as  in  LOGO).  The  average  ES  for  achievement  (mea- 
sured either  with  locally  constructed  or  standardized  tests) 
for  all  42  studies  was  .26.  Thus,  the  typical  student  in  a 
computer-based  class  scored  at  the  60th  percentile  while 
the  typical  student  in  a conventionally  taught  class  scored 
at  the  50th  percentile.  An  effect  of  this  size  would  typically 
be  characterized  as  small. 

Because  the  individual  effect  sizes  ranged  from  -.60  to 
1.44,  various  study  features  (e.g.,  duration  of  instruction, 
assignment  of  subjects  to  treatments,  course  content)  were 
examined  to  try  to  account  for  this  variability.  Of  the  15 
features  examined,  only  three  — type  of  computer  use,  year 
of  publication,  and  ability  level  of  the  students  — were  sig- 
nificantly related  to  variability  in  achievement.  As  noted 
above,  the  computer  was  used  either  to  assist  instruction, 
manage  instruction,  or  enrich  instruction.  Small  effect  sizes 
were  found  when  the  computer  was  used  to  assist  or  man- 
age instruction  (.36  and  .40,  respectively).  But  when  the 
computer  was  used  to  enrich  instruction,  the  effect  size  was 
a negligible  .07.  For  studies  published  prior  to  1975,  the 
average  ES  was . 1 2.  a negligible  effect.  But  for  studies  pub- 
lished between  1975  and  1984.  the  average  ES  was  an  al- 
most moderate  .45.  At  first  blush,  this  finding  may  seem 
inexplicable.  But  Bangcrt-Drowns  ct  al.  offer  the  reason- 
able speculation  that  the  effect  is  attributable  to  improve- 
ments in  the  quality  of  programs  and  to  teachers  learning 
how  to  more  appropriately  use  computer-based  technology. 
Finally,  effect  sizes  varied  significantly  as  a result  of  stu- 


dent ability  level.  The  effect  of  computer-based  instruction 
on  low  ability  students  approached  the  moderate  level  (av- 
erage ES  = .46),  was  negligible  for  mixed  ability  groups 
(average  ES  = .13),  and  was  weak  for  high  ability  students 
(average  ES  = .24).  This  type  of  finding,  by  the  way,  is  not 
terribly  unusual.  Structured  educational  programs  typically 
benefit  low  ability  students  more  than  average  or  high  abil- 
ity students  because  they  provide  such  students  with  the 
knowledge  and  skills  they  lack. 

Although  achievement  was  the  only  outcome  assessed 
by  most  of  the  studies.a  few  looked  at  such  other  outcomes 
as  attitudes  towards  computers,  quality  of  instruction,  atti- 
tudes toward  subject,  and  class  attendance.  For  the  four 
studies  that  measured  attitudes  towards  computers,  the  av- 
erage ES  was  a moderate  .62.  For  the  two  studies  that  had 
students  rate  the  quality  of  instruction  they  received,  the 
average  ES  was  a small  .24,  For  the  1 1 studies  that  exam- 
ined student  attitudes  towards  the  subject  matter,  the  aver- 
age ES  was  a negligible  .09.  For  the  four  studies  that  looked 
at  attendance,  the  average  ES  was  also  a negligible  .10. 
Because  of  the  relatively  small  number  of  studies  on  which 
these  effects  are  based,  one  should  be  careful  about  drawing 
conclusions  about  the  effect  of  computer-based  education 
on  other-than-achievement  outcomes.  With  that  caveat  in 
mind,  I would  characterize  these  findings  as  reflecting  a 
sort  of  “good  news  - bad  news"  story.  On  the  one  hand, 
students  see  computer-based  learning  as  being  of  higher 
quality  than  conventional  instruction  and  walk  away  from  a 
computer-based  learning  experience  feeling  considerably 
more  positive  about  the  computer  as  a learning  tool.  On  the 
other  hand,  attitudes  towards  the  subject  arc  not  markedly 
different  from  the  attitudes  expressed  by  students  taught 
conventionally  and  student  cut  both  types  of  classes  about 
equally  often.  Apparently,  if  students  don't  like  a subject, 
the  format  in  which  it  is  presented  is  not  likely  to  make  a 
major  difference. 

The  Effect  of  CBE  on  College  Students 9 
Achievement 

This  meta-analysis,  conducted  by  James  Kulik.  Chen- 
Lin  Kulik,  and  Peter  Cohen  (1980)  and  published  in  vol- 
ume 50,  number  4 of  Review  of  Educational  Research , was, 
as  far  as  I know,  the  first  to  be  published  on  CBE  research. 
Starting  with  an  initial  pool  of  over  500  titles,  the  Kuliks 
ended  up  with  a final  group  of  59  studies  by  specifying  that 
each  study  had  to  take  place  in  an  actual  college  classroom, 
had  to  report  on  quantitatively  measured  outcomes  for  both 
computer-based  and  conventional  classrooms,  and  had  to 
be  free  of  crippling  methodological  flaws. 

As  with  the  two  meta-analyses  summarized  above,  this 
group  of  59  studies  represented  different  categories  of  com- 
puter use.  About  two-thirds  of  the  studies  looked  at  the 
effects  of  computer-assisted  instruction  (simulations  and 
tutorials).  The  second  category  included  13  studies  of  the 
effects  of  computer-managed  instruction.  The  third  and 
smallest  category  was  composed  of  five  studies  that  investi- 
gated the  effects  of  computer-enriched  instruction  (program- 


ming  the  computer  to  solve  problems  in  the  academic  field 
the  students  were  studying).  Unlike  the  1985  meta-analy- 
ses, the  Kuliks  did  not  calculate  separate  effect  sizes  for 
each  category  and  so  the  following  results  are  an  amalgam 
of  the  three  types  of  computer-based  education. 

Fifty-four  studies  looked  at  the  effect  of  computer-based 
instruction  on  achievement.  The  average  ES  for  these  stud- 
ies was  a small  .25.  Thus,  a computerized  approach  to  col- 
lege classroom  instruction  raised  a student's  exam  seorc  by 
1/4  of  a standard  deviation,  or  from  the  50th  percentile  to 
the  60th  percentile. 

Because  of  the  variability  in  effect  sizes  (-1.5  to  3.0), 
the  Kuliks  examined  the  relationship  between  effect  size 
and  study  characteristics.  Only  one  characteristic  — con- 
trol for  instructor  — was  significantly  related  to  effect  size. 
For  those  studies  in  which  different  teachers  taught  the  com- 
puter-based section  and  the  conventional  section,  the  ES 
was  a moderate  .51.  But  for  those  studies  in  which  the 
same  teacher  taught  both  sections,  the  ES  was  a negligible 
.13.  The  Kuliks  reasoned  that  teaching  the  computer-based 
class  may  have  induced  teachers  to  do  a better  job  of  outlin- 
ing objectives,  constructing  lessons,  and  preparing  evalua- 
tion materials.  If  so.  then  one  can  reasonably  expect  a 
spillover  effect  when  the  same  person  teaches  both  the  com- 
puter-based and  conventional  sections,  thereby  decreasing 
the  size  of  the  effect.  But  before  deciding  that  the  effect  of 
CBE  is  always  significantly  reduced  when  the  same  person 
teaches  both  computer-based  and  non-computcr-based  sec- 
tions. bear  in  mind  that  in  the  two  1985  meta-analvses  cited 
above  there  was  no  difference  in  ES  for  studies  that  did  and 
did  not  control  for  effect  of  instructor. 

The  effect  of  computer-based  instruction  on  student 
withdrawal  rates  was  essentially  nil.  About  27U  of  stu- 
dents in  the  computer-based  classes  withdrew  before  the  end 
of  the  semester  versus  27.6'>r  of  students  in  the  conven- 
tional classes. 

Several  studies  examined  student  attitudes  about  qual- 
ity of  instruction  and  subject  matter.  On  a 5-point  scale 
where  1 is  the  lowest  rating,  the  average  rating  of  course 
quality  in  the  computer-based  classes  was  3.77  versus  3.5 
for  the  conventional  classes.  This  difference  translates  to  a 
small  ES  (4'  .24.  For  attitude  toward  the  subject,  the  effect 
was  also  a small  .18. 

The  Effect  of  CAl  on  Students'  Cognitive  Skills 

Writing  in  volume  24.  number  3 of  the  Journal  of  Re- 
search on  Computing  in  Education , Yuen-Kuang  Liao 
( 1992).  pointed  out  that  while  several  meta-analyses  of  the 
effect  of  CA!  on  achievement  have  been  conducted,  no  one 
had  as  yet  synthesized  the  research  on  the  effect  of  CAl  on 
such  cognitive  skills  as  planning,  reasoning,  critical  think- 
ing, and  problem-solving.  Given  the  growing  use  of  com- 
puters in  the  classroom,  the  claims  that  such  use  can  pro- 
mote the  development  ot  various  cognitive  skills  more  ef- 
fective!) than  can  traditional  instructional  methods,  and  the 


inconsistent  findings  among  studies  that  have  investigated 
this  issue,  Liao  decided  that  the  time  was  right  to  conduct  a 
meta-analysis  of  this  literature. 

Liao  located  31  studies  that  assessed  the  relationship 
between  CAl  and  the  cognitive  skills  mentioned  above  and 
that  took  place  either  in  elementary,  secondary,  or  college 
classrooms.  The  effect  sizes  for  these  studies  ranged  from  - 
.91  to  3.31  and  averaged  .48.  Thus,  the  average  student  in 
a CAl  class  scored  at  the  68th  percentile  on  some  measure 
of  cognitive  skill  while  the  average  student  in  a non-CAl 
class  scared  at  the  50th  percentile. 

Each  study  was  coded  for  the  presence  or  absence  of  29 
characteristics,  five  of  which  proved  to  be  significantly  re- 
lated to  effect  size.  These  were  type  of  publication,  type  of 
statistic,  type  of  computer,  duration  of  treatment,  and  type 
of  program.  The  first  three  have  no  practical  value  and  so  1 
won't  describe  them  further.  The  duration  of  treatment  vari- 
able. while  potentially  useful,  unfortunately  hid  as  much  as 
it  revealed.  Liao  sorted  the  studies  into  one  of  five  dura- 
tions (0-3  months.  4-6  months.  7-12  months,  more  than  12 
months,  unspecified)  and  found  no  statistically  significant 
differences  in  average  ES  among  the  first  four  categories 
(.29,  .42,  .03.  .09.  respectively).  The  statistical  significance 
was  due  to  a single  study  that  reported  an  incredibly  large 
effect  of  3.31  but  did  not  (just  as  incredibly)  mention  how 
long  the  treatment  lasted.  That  leaves  type  of  program. 
Liao  classified  the  programs  used  in  each  of  the  31  studies 
as  either  drill-and-praetiec.  simulation,  problem-solving,  or 
tutorial.  The  effect  sizes  for  the  first  three  were  small  and 
statistically  equivalent  (.15.  .3 Land  .20.  respectively).  The 
ES  for  tutorials,  on  the  other  hand,  was  quite  large  at  2.38 
and  was  statistically  different  from  the  other  three.  But  since 
this  effect  was  based  on  only  three  studies,  its  reliability  is 
open  to  question. 

Has  Computer-Based  Education  Fulfilled  Its 
Promise? 

This  answer  to  this  question  is.  “Not  entirely",  but  there 
are  indications  that  it  may  in  the  future.  On  the  one  hand, 
the  small  to  moderate  overall  effect  sizes  reported  in  each 
mcta-analysis  indicate  that  computer-based  education  pro- 
duces higher  levels  of  learning  and  cognitive  skill  than  does 
conventional  instruction,  although  the  size  of  the  effects 
would  doubtless  disappoint  CBE’s  most  ardent  supporters. 
On  the  other  hand,  the  occasional  but  dramatically  large 
effects  reported  by  some  researchers  suggest  that  under  the 
right  circumstances.  CBE  can  consistently  produce  substan- 
tially higher  cognitive  and  ITective  outcomes  than  conven- 
tional instruction.  In  other  wordv  researchers  may  come 
closer  to  fulfilling  the  promise  ol  v BE  when  they  stop  ask- 
ing the  unrealistic  main  effect  question.  Is  CBE  better  than 
XYZ  instruction  \ and  start  asking  such  pointed  and  inter- 
action-oriented questions  as.  For  w hom  is  CBE  most  likely 
to  be  effective  .7  For  w hich  kinds  of  outcomes?  For  what 
kinds  of  learning  material?  Under  what  kinds  of  condi- 
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lions?  With  what  types  of  programs?  This  argument  has, 
of  course,  been  made  by  many  others,  Mark  Lepper  and 
Jean-Luc  Gurtner  (1989),  for  example,  wrote  in  volume  44, 
number  2 of  the  American  Psychologist , that  “the  expected 
cognitive  consequences  of  different  forms  of  computer  use 
seem  likely  to  depend  on  the  direction  and  intensity  of  the 
student's  attention  to  different  aspects  of  the  program,  the 
depih  of  involvement  or  ‘mindfulness'  of  the  student,  and 
the  types  of  learning  strategies  that  the  student  employs. 
Likely  motivational  consequences  may  similarly  depend  on 
the  student's  level  of  intrinsic  interest,  perceptions  of  per- 
sonal competence  and  self-efficacy,  and  goals  in  undertak- 
ing the  activity.” 

On  the  basis  of  the  meta-analysis  evidence  reviewed 
here,  it  seems  clear  that  the  effectiveness  of  CBE  varies  as  a 
function  of  age,  ability,  type  of  program  and,  quite  possibly, 
quality  of  program.  You  may  have  noticed  that  the  average 
ES  decreased  as  the  age/grade  level  of  the  students  increased 
from  elementary  (ES  = .47)  to  secondary  (ES  = .36)  to  col- 
lege (ES  = .25).  The  most  likely  explanation  of  this  gradual 
reduction  is  that  as  the  students  become  more  skilled  at  cog- 
nitive self-regulation  and  as  the  population  becomes  more 
homogeneous  in  ability  (at  the  college  level),  the  support 
that  CBE  provides  through  such  features  as  sequencing  of 
material,  small  steps,  and  corrective  feedback  becomes  more 
and  more  superfluous.  The  same  explanation  applies  to  the 
finding  that  the  ES  for  low-ability  students  (.46)  was  sig- 
nificantly higher  than  for  high-ability  students  (.24).  As 
for  type  of  program,  Liao  ( 1 992)  found  a substantially  larger 
ES  for  tutorial  programs  than  for  drill-and-practice,  simu- 
lation, or  problem-solving  programs.  Although  Liao  would 
have  had  no  way  of  knowing,  this  last  effect  may  have  been 
due  to  differences  in  program  quality.  It’s  possible  that  the 
tutorial  programs  were  of  significantly  higher  quality  than 
the  other  types  of  programs. 

The  reason  why  Liao  would  have  been  unable  to  sys- 
tematically test  for  differences  in  program  quality  is  because 
the  meta-anaiyst  is  basically  limited  to  the  published  infor- 
mation that  is  provided  by  the  researchers.  And  in  the  case 
of  studies  that  test  the  efficacy  of  instructional  materials, 
researchers  almost  never  offer  an  evaluation  of  their  quality 
nor  are  the  materials  available  to  the  reviewer  for  indepen- 
dent analysis.  In  effect,  program  quality  is  a “hidden”  char- 
acteristic in  these  types  of  meta-analyses.  Yet  there  are  good 
reasons  for  suspecting  that  the  small  to  modest  overall  ef- 
fect sizes  reported  above  as  well  as  their  wide  range  arc  due 
to  programs  whose  quality  leaves  much  to  be  desired. 

In  1984,  P.  Kenneth  Komoski  pointed  out  in  volume 
66.  number  4 of  Phi  Delta  Kappan  that  there  was  a paucity 
of  good  CAI  software.  According  to  the  Educational  Prod- 
ucts Information  Exchange  (EP1E),  a non-profit  organiza- 
tion that  specializes  in  the  evaluation  of  instructional  mate- 
rials. 6 {Y/<  of  CAI  programs  were  judged  “Not  Recom- 
mended” or  “Do  Not  Consider.”  359;  were  rated  “Recom- 
mended?1 and  only  5r/r  were  judged  good  enough  to  be  placed 
in  the  “Highly  Recommended”  category.  Komoski  attrib- 
uted tin's  shortage  of  good  quality  software  to  developers 


being  unaware  of  basic  learning  principles  and  taking  short- 
cuts ir  the  development  process.  The  step  most  often  omit- 
ted was,  unfortunately,  one  of  the  most  critical  in  the  devel- 
opment of  a good  quality  program:  the  field  test. 

Komoski 's  findings  were  echoed  almost  two  years  later 
by  Julie  Vargas  (1986).  Writing  in  volume  67.  number  10 
of  Phi  Delta  Kappan.  Vargas  noted  that  the  following  four 
basic  learning  principles  are  routine^  violated  or  ignored 
in  the  development  of  CAI  programs:  a high  rate  of  rel- 
evant overt  responding,  appropriate  stimulus  control  (learn- 
ing to  recognize  the  stimulus  to  which  a particular  response 
must  be  made),  immediate  feedback,  and  gradually  shaping 
new  responses  through  prompting  and  corrective  feedback. 
When  Vargas  evaluated  a variety  of  CAI  programs  for  their 
adherence  to  these  principles,  the  results  were  mixed.  Most 
drill-and-practice  programs,  which  are  designed  to  increase 
the  speed  and/or  accuracy  of  an  already  learned  skill,  were 
judged  to  have  adequately  incorporated  the  first  three  prin- 
ciples. Because  these  programs  do  not  teach  new'  knowl- 
edge and  skill,  the  criterion  of  shaping  was  not  applied. 
Most  simulations,  w'hich  arc  designed  to  provide  opportu- 
nities for  application  of  previously  learned  knowledge,  fell 
short  in  allowing  for  overt  relevant  responses,  w'ere  judged 
acceptable  in  bringing  about  appropriate  stimulus  control 
and  in  providing  feedback,  but  were  judged  deficient  in  shap- 
ing new  behavior.  Tutorials  fared  worst  of  all.  Vargas  judged 
many  of  these  programs  to  be  deficient  in  adhering  to  all 
four  principles. 

So  until  the  software  quality  picture  improves,  what's  a 
concerned  educator  to  do?  Is  there  a relatively  easy  w ay  to 
insure  that  students  are  exposed  to  the  best  available  drill- 
and-practice.  simulation,  and  tutorial  programs?  Yes,  and 
it  can  be  done  in  one  of  two  ways.  First,  one  can  find  in  a 
good  college  or  university  library  several  accurate  and  use- 
ful reviews  of  instructional  programs.  Shirley  Bocs  Neill 
and  George  W.  Neill  are  the  authors  of  an  annual  guide 
called  Only  the  Best:  Preschool  -Grade  12.  Each  program 
in  their  guide  has  been  judged  to  be  of  high  quality  by  two 
or  more  educational  organizations.  T.E.S.S.  The  Educa- 
tional Software  Selector  is  a comprehensive  guide  that  con- 
tains over  7,700  descriptions  of  programs  in  more  than  100 
subject  areas  and  is  published  by  EPIE.  Hundreds  o*'  these 
descriptions  include  a rating  from  a trained  analyst.  Soft- 
ware Reports . which  is  published  by  Trade  Service  Corpo- 
ration. provides  program  evaluations  in  20  subject  areas  and 
for  every  grade  level.  Second,  there  is  the  do-it-yourself 
route.  Julie  Vargas,  in  the  article  cited  above,  provides  a 
list  of  eight  criteria  to  consider  when  choosing  a CAI  pro- 
gram. Volume  13,  number  3 ( 1990)  of  another  EPIE  publi- 
cation. EPIEgram.  describes  the  12  criteria  used  by  EPIE 
analysts  to  evaluate  the  quality  of  educational  software.  And 
finally.  Howard  N.  Sloanc,  Hope  Myers  Gordon.  Carolce 
Gunn,  and  Vicki  Mickelsen  (1989)  provide  an  extensi\e 
checklist  with  which  to  evaluate  educational  software  in 
Evaluating  Educational  Software:  A Guide  for  Teachers. 
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The  “ Problem ” of  Gender  in  Teacher  Education1 

Sandra  Hollingsworth 
Michigan  State  University 

Abstract 

Sari  Knapp  Biklen  and  Diane  Pollard , editors  of  the  1992  Yearbook  of  the  National  Society  for 
the  Study  of  Education  (NSSE),  began  their  introductory  chapter  with  this  definition  of  gender: 

Put  very  simply,  we  might  say  that  one  5?  sex  is  involved  in  every  activity  connected  to 
education . Since  every  interaction  involves  a male  or  a female , sex  is  everywhere;  we 
must  take  it  into  account  When  to  take  it  into  account  looms  as  a big  question  because  it 
may  be  central  even  when  it  seems  to  have  no  relation  to  what  is  going  on.  [While]  being 
male  or  female  carries  few  meanings  in  and  of  itself;  its  most  potent  meanings  come  from 
the  social  and  cultural  meanings  attributed  to  it  These  meanings  we  call  gender,  the 
social  construction  of  sex.  (1993,  p.  1). 


While  sex  physically  describes  either  male  or  fe- 
male, gender  describes  the  way  that  particular  characteris- 
tics, behaviors,  attitudes,  values  and  emotions  are  assigned 
and  reassigned  culturally  to  a particular  sex  through  social- 
ization processes,  including  education.  The  feminist  au- 
thors of  that  NSSE  Yearbook,  like  most  feminists,  do  not 
see  attention  to  gender  as  a male  versus  female  issue,  but 
rather  as  an  issue  that  embraces  social  justice  for  all  people; 
the  freedom  of  both  men  and  women  to  adopt  the  character- 
istics assigned  culturally  (and/or  stereotypically)  to  either 
sex  in  any  life  position.  Further,  most  feminists  do  not  think 
about  gender  in  isolation  of  other  identifying  characteris- 
tics of  those  engaged  in  education — like  race,  class,  gen- 
eration, and  so  forth.  And  most  of  those  other  categories 
are  appropriate  for  research  analyses  in  teacher  education. 
Attention  to  gender,  for  the  most  part,  seems  to  be  “taboo/* 
perhaps  because  it  is  not  clearly  distinguished  from  sex. 

Although  there  is  a wealth  of  research  available 
which  documents  both  recent  changes  in  the  social  con- 
struction of  gender  and  the  intricate  relations  between  the 
dynamics  of  gender  and  education,  it  is  noticeably  absent  in 
teacher  education.  A quick  perusal  of  the  Handbook  of  Re- 
search on  Teacher  Education  (Houston,  1990),  for  example, 
or  American  Educational  Research  Association  (AERA) 
publications,  or  teacher  education  journals,  shows  that  re- 
searchers and  scholars  are  either  silent  or  minimally  atten- 
tive toward  the  impact  of  gender  on  learning  to  teach.  The 
major  exceptions  are  in  the  areas  of  critical  sociology  and 
the  histoiy  of  teacher  education  (see,  for  example,  Zeichner 
& Gore,  1990;  and  Herbst,  1990).  In  other  words,  gendered 
relationships  do  not  seem  to  be  an  important  part  of  “the 
knowledge  base*’  for  teachers. 

On  the  other  hand,  the  literature  clearly  stresses 
the  importance  between  relationships  of  roles,  beliefs,  and 
opportunities  to  reflect  and  acquire  knowledge  as  part  of 
what  teachers  and  teacher  educators  must  know  in  order  to 
participate  powerfully  in  education  (Richardson,  Anders, 
Tidwell,  & Lloyd,  1991;  Woolfolk,  1994)  Yet,  teacher  cdu- 

1 Based  on  an  Invited  Address  at  the  1994  conference 
of  the  Mid  We  seem  Educational  Research  Asooctathm, Chicago. 


cators  often  disregard  the  role  of  gender  in  educational  par- 
ticipation. Perhaps  that  is  why  opportunities  to  participate 
in  specific  educational  roles  are  still  distributed  according 
to  gender.  Men,  for  example,  are  routinely  discouraged  from 
teaching  af  the  primary  level,  while  they  make  up  95  per- 
cent of  school  superintendents  (Campbell  and  Lam,  1993). 
Perhaps,  if  we  traced  some  of  the  origins  of  those  distribu- 
tions to  teacher  education,  we  could  help  reverse  the  imbal- 
ances. 

Even  if  skeptical  about  the  power  of  teacher  edu- 
cation to  make  a difference  in  such  societally  conditioned 
life  roles,  teacher  educators  should  still  consciously  attend 
to  the  gendered  nature  of  our  profession.  Since  we  are  con- 
cerned with  teachers’  knowledge  development  and  articu- 
lation, and  since  so  many  females  are  involved  in  educa- 
tion, we  need  to  know  and  act  upon  the  ways  that  knowl- 
edge is  constructed  with  respect  to  gender.  Yet  few  of  us  are 
familiar  with  feminist  literature.  Thus,  the  central  ques- 
tions addressed  in  this  article  are:  (1)  Why  do  we  fail  to 
attend  to  the  " problem  ” of  gender  in  teacher  education? 
and  (2)  What  can  be  done  to  address  the  problem ?.  To  find 
out,  I drewf  some  hypotheses  from  extensive  literature  re- 
views, engaged  a random  sample  of  my  teacher  education 
colleagues  in  an  open-ended  electronic  mail  conversation, 
and  conducted  personal  conversations  with  others  willing 
to  talk  about  gender  and  teacher  education. 

Why  we  fail  to  attend  to  the  “Problem” 

Hypothesis  1 

uIt 's  women  'swork:  ” The  normative  position  of  the 
teacher . Susan  Laird  (1988)  suggests  that  one  predomi- 
nant view  of  teaching  is  that  it  is  “a  woman’s  profession” 
and  therefore  the  positioning  of  women  close  to  children  is 
both  normal  (needing  no  analysis)  and  acceptable  (needing 
no  critique).  In  other  words,  many  educators  may  feci  that 
positioning  women  in  occupational  roles  which  enable  close 
contact  with  children  (while  discouraging  men  from  taking 
such  jobs),  and  positioning  men  and  others  with  the  author- 
ity to  establish  educational  policy  far  away  from  children 
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and  their  teachers  is  simply  part  of  the  normative  social 
order.  However,  when  I asked  my  colleagues  in  teacher  edu- 
cation about  the  lack  of  explicit  attention  to  gendered  rela- 
tionships in  our  profession,  most  had  not  given  the  issue 
any  serious  thought.  Several  of  my  male  colleagues  did 
write  about  the  personal  rejection  they  felt  from  their  pro- 
fessors and  peers  when  they  announced  they  were  going 
into  elementary  education.  Until  fairly  recently,  men  have 
even  stayed  away  from  research  on  teaching  practice — his- 
torically seen  as  an  “activity  of  low  prestige,  suitable  chiefly 
for  women”  (Clifford  & Guthrie,  1988,  p.  116) — and  have, 
instead,  professed  allegiance  to  scientific  and  disciplinary 
problems  and  methods.  Henry  Holmes,  Dean  of  the  Harvard 
School  of  Education  from  1919  to  1940,  in  fact  believed 
that  the  school’s  “reputation  and  success  within  Harvard 
was  directly  proportional  to  its  dominance  by  males”  (Powell, 
1980,  p.  154). 

Some  of  my  colleagues  agree  that,  while  biology  and 
society  have  predetermined  gendered  roles  in  education,  the 
amount  of  space  that  women  take  up  is,  nonetheless,  an 
embarrassment  to  the  profession.  One  commented:  “The 
daily  practice  of  teacher  preparation  is  largely  unexamined 
territory  because  examining  it  closely  would  prove  to  be 
awkward  and  embarrassing  in  various  ways  that  tend  to  be 
incompatible  with  the  status  and  standing  that  teacher  edu- 
cators have  or  would  like  to  have;  gender  is  just  one  of  those 
embarrassments.”  Another  brave  male  colleague  wrote  to 
me  that  discussing  gender  would  call  attention  to  the  fact 
that  we  teach  mostly  women  who  work  with  children  and 
“that  ain’t  exactly  a high  status  thing.”  Still  another  male 
faculty  member  says  he  purposely  speaks  of  his  “students” 
in  order  to  gloss  over  the  fact  that  most  of  them  are  women. 
Some  of  my  male  faculty  partners  talked  of  the  difficulty  of 
male  teacher  educators  raising  women’s  issues  in  class. 
Here’s  an  example: 

I remember  in  my  summer  course  that  I [used]  a 
passage  from  Annie  Rogers’  essay  on  “voice,  play 
and  the  practice  of  ordinary  courage  in  girls  * and 
women 's  lives. " The  passage  is  about  adolescent 
girls ' loss  of  voice,  or  “ordinary  courage. " I asked 
my  class  (mostly  women)  to  read  and  discuss  the 
passage  with  me,  to  talk  about  what  it  might  mean 
for  teachers.  Ordinarily,  I am  fairly  good  at  getting 
discussions  going,  and  am  not  usually  shy  about  vio- 
lating norms for  good  reasons.  In  this  instance,  how- 
ever, I remember  feeling  that  conducting  the  discus- 
sion was  like  pulling  teeth,  and  that  I felt  like  I had 
just  broken  some  important  rule.  I don  t know  what 
to  make  of  that  event,  but  I suspect  it  is  somehow 
related  to  my  tendency  not  to  use  explicitly  feminine 
analyses . 

Other  colleagues  remarked  that  discussing  the  “nor- 
mative” hypothesis  about  teaching  as  “women’s  work”  with 
our  male  and  female  credential  candidates  might  make  our 


students  feel  disempowered,  angry  and  hopeless.  One 
woman  mentioned  having  to  drop  a passage  by  SaraRuddick 
on  “maternal  thinking”  (1990)  because  it  made  both  stu- 
dents and  faculty  uncomfortable.  Another  of  my  female 
colleagues  offered  this  provocative  explanation: 

Teacher  education  entered  the  academy  [wanting] 

to  be  seen  as  a body  of  professional  knowledge it 

was  a scientific  knowledge — not  what  any  mother  or 
care-giver  would  know  just from  being  alive  and junc- 
tional in  the  world.  . . .If  we  explore  either  adult 
development  or  what  gender  adds  to  the  knowledge 
base,  we  fear  our  status  as  a special  knowledge  will 
vanish.  Looking  at  how  gender  has  guided  research, 
problem  framing,  questions  that  are  rewarded  if 
asked— this  could  be  BAD  news.  We  might  find  out 
that  women ’s  ways  of  thinking  parallel  the  knowl- 
edge base  and  then  we  might  have  to  discount  any 
pieces  of  that  knowledge  base  that  have  crept  in  be- 
cause women  were  involved!  If  we  find  that  there 
has  been  no  parallel , that  women  have  been  excluded 
from  the  development  of  the  knowledge  base,  that ’s 
worse.  Then  we ’d  have  to  ask  whether  teaching  in- 
volves something  valuable  and  as  yet  unexplored.  If 
so,  we  ’re  right  back  to  the  awful  space  where  teach- 
ing and  the  minds  of  women  are  linked  in  some  way. 
Where  does  that  leave  us  as  a profession?  A sci- 
ence? If  teaching  has  a decidedly  female  compo- 
nent, then  any  mother  could  teach — the  slippery  slope 
to  avoid  at  all  costs. 

For  Maxine  Greene,  our  obligation,  as  profession- 
als, is  to  measure  and  describe  that  slope:  naming  the  ob- 
stacles in  front  of  us  is  the  first  step  in  overcoming  them 
(1979).  To  Susan  Laird,  it  means  to  challenge  what  we 
mean  by  “normative”  in  the  teaching  profession,  and  re- 
construct it  through  instruction. 

7b  take  “ woman ’s  true  profession  ” seriously  at  last 
and  begin  this  immense  critical  project  of 
reconceptualization , I urge  the  importance  of  philo- 
sophical inquiry  concerning  the  meaning  of  feminist 
pedagogy,  its  implicit  challenge  to  the  dominant  and 
so-called  gender-neutral  concept  of teaching  that  the 
Holmes  Group  and  the  Carnegie  Forum  do  not  chal- 
lenge, and  the  as  yet  unimagined  practical  possi- 
bilities it  may  suggest  for  actually  educating — not 
simply  training— schoolteachers  (1988,  p.  463). 

Hypothesis  2 

“ There ’s  no  time  in  teacher  education  programs 
to  address  gender The  focus  on  subject  matter  and  ge- 
neric “ reflection  Some  of  my  colleagues  reminded  me 

that  the  establishment  of  schooling  around  the  “structure  of 
the  disciplines”  and  the  parallel  focus  of  research  on  teacher 
education  being  primarily  subject-matter  oriented  doesn’t 
leave  much  room  for  cross-disciplinary  issues  such  as  gen- 


der  (seeBorrowman,  1965;  Reynolds,  1989;  Shulman,  1986; 
1987).  Further,  increasing  credential  requirements  (winch 
do  not  include  attention  to  gender)  make  space  for  it  prob- 
lematic. We  must  also  note  that  talking  about  disciplinary 
knowledge  is  much  less  political  and  provocative  than  talk- 
ing about  whose  knowledge  is  privileged  through  the  pre- 
scribed disciplinary  study. 

Led  by  the  work  of  Donald  Schon  (1983,1987), 
however,  many  scholars  are  not  only  attending  to  what  teach- 
ers ought  to  know,  but  how  they  ought  to  think  about  it. 
Indeed,  program  committees  deliberating  the  design  of  new 
teacher  education  programs,  give  increased  attention  to  the 
structural  spaces  and  practices  of  reflection,  but  not  to  gen- 
der. The  mission  or  agenda  of  major  funding  agencies  has 
been  around  the  “big  ideas”  in  subject  matter  and  teachers’ 
thoughts  about  them.  Teachers’  own  political,  gendered 
and  epistemological  positions  relative  to  the  knowledge, 
however,  are  not  typically  topics  for  reflection.  Yet  some 
scholars  of  teacher  education  are  now  arguing  that  reflec- 
tion without  attention  to  the  social  context  of  knowledge 
and  schooling — including  gender — is  insufficient  (see 
Gitiin,  Bringhurst,  Bums,  Cooley,  Myers,  Price,  Russell,  & 
Tiess,  1990;  Liston  & Zeichner,  1991). 

Hypothesis  3 

“I'm  doing  it,  already!”  The  Inclusiveness  of 
Multicultural  Education . Many  researchers  and  teacher 
educators  are  including  diversity  and  multicultural  issues 
in  their  current  work,  and  believe  they  are  also  attending  to 
“gender”  as  part  of  that  category.  Several  colleagues  wrote 
that  they  spent  “a  day”  on  gender  in  their  multicultural 
courses.  Another  colleague  said  that,  at  some  deep  level, 
there  is  cognizance  about  the  feminization  of  schooling — 
’’and  it  must  come  out  somehow  in  our  program,  although 
it  would  be  hard  to  say  exactly  where.” 

Such  arguments  about  “theoretical  inclusiveness” 
regarding  issues  of  diversity  have  been  heavily  critiqued  in 
teacher  education  programs  for  their  lack  of  breadth  and 
vigor.  Caroline  Sherritt’s  scathing  attack  on  multicultural 
research,  for  example,  speaks  straightforwardly  to  educa- 
tors’ failure  to  adequately  understand  and  address  sensitive 
issues. 

Don't  presume  that  you  can  become  multicultural 
without  addressing  issues  of  oppression  and  discrimi- 
nation. Don 't  focus  on  cultural  plurality  if  you  are 
unwilling  to  deal  with  sensitive  issues,  such  as  reli- 
gion, gender  roles,  standardized  testing,  poverty,  and 
politics  (1990,  pp.  215-16). 

Conversations  on  how  well  we  arc  addressing  di- 
versity in  our  programs  could  reveal  similar  critiques  of 
teacher  education  research  and  practice. 

Hypothesis  4 

“There's  no  need”:  The  gender-blind  nature  of  edu- 


cational research.  The  dominant  methodological  paradigm 
which  has  been  used  to  study  teacher  education  in  this  cen- 
tury has  stressed  objectivity  and  neutrality.  Therefore,  a 
good  research  design  is  expected  to  account  for  personal 
differences,  rendering  gender  non-significant  (Reinharz, 
1992).  As  we  know,  however,  there  are  many  postmodern 
and  poststructural  critiques  of  the  myth  of  objectivity  (e.g., 
Harding,  1991;Lather,  1991;  Smith,  1987).  Those  critiques 
state  that  societally  positioned  differences — such  as  race, 
class  and  gender — powerfully  biases  not  only  the  results  of 
educational  research  but  authors  its  design.  Such  critiques 
have  led  to  an  increased  awareness  of  bias  in  research. 
However,  the  category  of  gender  is  still  the  most  likely  to  be 
ignored  or  under-researched  in  teacher  education. 

Funding  opportunities  for  studies  on  women  and 
girls  in  education  have  been  historically  limited.  Not  only 
has  the  U.S.  Department  of  Education  failed  to  widely  sup- 
port specific  programs,  but  gendered  relationships  are  not  a 
significant  part  of  any  study  within  major  government 
funded  research  centers,  such  as  the  National  Center  for 
Research  on  Teacher  Learning  at  Michigan  State  Univer- 
sity (Campbell,  1989;  Campbell  and  Greenberg,  1993). 
While  attention  to  gender  is  increasingly  questioning  such 
practices,  change  in  this  area  is  slow. 

Some  of  my  colleagues  wondered  whether  research 
agendas  might  have  shifted  to  include  more  gendered  at- 
tention with  recent  increases  in  both  numbers  of  women  in 
educational  research — and  a correlational  acceptance  of 
qualitative  research  designs.  That  has  not  proven  to  be  the 
case.  Although  the  balance  is  clearly  changing  following 
the  civil  rights  and  women’s  movements  of  the  1970s  and 
1980s,  most  researchers  in  education  are  still  white  and  male 
(AERA,  1989),  and  white  men  have  traditionally  been  the 
population  studied  (quantitatively)  for  educational  theory 
and  practice  (Campbell,  1981;  Klein,  Ortman,  Campbell, 
Greenberg  Hollingsworth,  Jacobs,  Kachuck,  McClelland, 
Pollard,  Sadker,  Sadker,  Schmuck,  Scott,  & Wiggins,  1994). 
One  of  my  colleagues  suggested  that  even  though  the  man/ 
woman  ratio  in  AERA  is  now  approaching  50  percent,  and 
many  researchers — both  male  and  female — are  acknowl- 
edging the  problematic  nature  of  “objective”  research  and 
exploring  alternatives,  these  inequities  will  remain  unless 
we  adopt  a consciousness  and  commitment  toward  explor- 
ing gendered  relations. 

Hypothesis  5 

“It's  taboo.  ” Emotion  and  controversy . Attention 
to  gender  is  clearly  minimized  in  teacher  education  because 
of  its  emotional,  controversial  and  sensitive  nature 
(Britzman,  1991;  Miller,  1990).  Over  and  over  again  my 
colleagues  told  me  they  were  not  comfortable  with  sensitive 
issues  such  as  gender,  and — as  a result — could  hardly  ex- 
pect their  student  to  react  positively.  Therefore,  they  stick 
to  safer  areas  of  diversity,  such  as  “other  people’s”  race  and 
social  class. 
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Some  of  my  colleagues  and  many  of  my  students 
suggest  that  research  on  girls  as  women  is  purposely  ig- 
nored by  both  women  and  men,  because  men  might  find  it 
threatening  and  offensive.  Taking  a different  angle,  one  of 
my  colleagues  courageously  told  me  about  the  unspoken 
practice  of  males  teaching  young  adult  females  while  strug- 
gling with  (often  uninvited)  thoughts  about  sexual  relations. 
He  also  lamented  that  there  is  no  forum  for  addressing  his 
confusion  and  concern  over  gendered  roles  and  relations, 
because  that  part  of  his  practice  “goes  without  the  disci- 
pline that  might  be  afforded  by  conversation.” 

Additionally,  because  of  the  “backlash”  against 
feminist  critiques  of  society  led  by  the  popular  press  (Faludi, 
1990)  and  the  perceived  radical  nature  of  a unified  feminist 
movement,  scholars  of  teacher  education  are  less  likely  to 
have  read  or  engaged  in  conversation  about  feminist  analy- 
ses of  education.  Yet  ideally,  feminism  and  education  liave 
much  in  common — both  aim  to  empower  all  people,  and  to 
provide  opportunities  for  the  full  expression  of  human  po- 
tential (Gaskell  & McLaren,  1991).  See  the  National 
Women’s  Studies  Association  16th  Annual  Conference  pro- 
gram, 1994;  Britzman,  1992;  and  Liston &Zeichner,  1991, 
for  a discussion  of  contributions  of  feminism  to  teacher  edu- 
cation. Feminist  literature  has  impacted  so  many  areas  of 
life  in  recent  generations  that,  as  teacher  educators,  we  can 
no  longer  afford  to  ignore  it — no  matter  how  uncomfort- 
able we  may  be  with  gendered  issues.  Deborah  Britzman 
(1993)  tells  us: 

The  category  of  gender  becomes  even  more  contro- 
versial when  we  consider  how  gendered  selves  are 
tied  to  specific  histories  of  social justice,  civil  rights, 
colonialism,  economic  struggles,  social  positions  and 
to  the  emotional  commitments  that  are  built  because 
of  these  histories.  Exploring  the  contradictory  mean - 
ings  of  gender  requires  a second  and  more  complex 
look  at  how  received  discourse,  stereotypes,  and  so- 
cial practices  make  gender  a significant  site  of  iden- 
tity struggle..  . .To  become  open  to  topics  routinely 
considered  “taboo,”  “political,”  or  “too  controver- 
sial” for  classrooms,  educators  must  come  to  terms 
with  the  messiness  of  emotional  commitments  as  they 
work  through  their  own  fear  that  inviting  controver- 
sies means  not  being  in  control  (p.  28) 

Nonetheless,  a few  of  my  colleagues  even  told  me 
that  they  could  not  address  issues  of  gender  (or  race  and 
class  either)  in  research  forums  or  in  classrooms  because 
they  felt  “silenced”  by  the  need  to  be  “politically  correct.” 
William  Tierney  helps  us  understand  such  a position  as  con- 
servative. 

[ Conservatives]  contend  that  demands  for  ideologi- 
cal conformity \ or  "political  correctness,  ” have  en- 
croached on  basic  academic  freedom  to  such  extent 


that  the  free  expression  of  ideas  no  longer  exists  on 
college  campuses.  Indeed,  the  conservatives  believe 
that  the  curtailment  of  free  speech  has  so  poisoned 
the  atmosphere  in  the  academy  that  if  one  disagrees 
with  a “politically  correct”  position,  one  will  not 
merely  be  labeled  a racist,  sexist,  or  some  other  epi- 
thet; the  recalcitrant  will  also  face  sever  reprimands, 
such  as  administrative  sanctions.  (1993,  pp.  143- 
144). 

Perhaps  the  best  place  to  start  exploring  these  is- 
sues is  among  ourselves. 

What  Can  be  Done? 

While  we  may  not  be  able  to  experiment  with  these 
hypotheses  in  our  classrooms  immediately,  we  can,  as  teacher 
educators,  educate  ourselves  about  the  many  feminist  points 
of  view,  review  some  of  the  major  contributions  of  feminist 
scholarship  to  education,  build  a case  for  the  importance  of 
addressing  problems  of  gender — and  perhaps  demystify 
some  of  the  controversy.  In  this  section  I will  attempt  a 
beginning  by  calling  for  a conscious  interruption  of  the  ste- 
reotypical notion  that  feminist  scholarship  is  radically  uni- 
fied and  inaccessible  to  teacher  educators.  I will  briefly 
describe  the  three  major  periods  of  feminist  scholarship  since 
the  1960s  and  their  critiques  of  education.  In  each  period,  I 
will  give  an  example  of  the  impact  of  that  scholarship  on 
particular  teacher  education  courses. 

Unequal  Access  to  Knowledge  and  Schooling: 

Liberal  Feminism  of  the  1960s  and  1970s. 

Feminist  scholarship  which  accompanied  the  rise 
of  the  Civil  Rights  and  Women’s  Movements  of  the  1960s 
and  1970s  was  based  upon  the  idea  that  women  should  have 
the  same  opportunities  to  education  and  the  professions  that 
men  have.  Many  studies  pointed  out,  however,  that  girls’ 
opportunities  were  limited  in  schools  because  of  texts,  cur- 
riculum, and  instructional  programs  that  discriminated  on 
the  basis  of  gender  (Klein,  1985;  Sadker  & Sadker,  1985). 
The  most  salient  contributions  of  this  scholarship  were  in 
the  areas  of  sex  equity  with  goals  of  reducing  gender  biases 
and  stereotyping  (Klein,  ct  al,  1994).  Legislation,  in  the 
form  of  Title  IX  of  the  Education  Amendment  ( 1 972),  helped 
educators  address  gender  equity  in  athletics  and  career  coun- 
seling. Special  programs  for  girls  in  math  and  science  also 
w ere  a product  of  this  period.  One  colleague  informed  me 
there  is  surprisingly  little  attention  to  gender  and  mathemat- 
ics in  teacher  preparation  “given  what  we  understand  about 
our  students  who  are  almost  all  women  and  their  likely  past 
experiences  with  mathematics!”  Perhaps  because  such  in- 
equities were  fairly  easy  to  document  and  address,  some  of 
the  “equal  access”  scholarship  of  the  liberal  feminist  period 
has  been  included  in  many  teacher  education  programs — 
especially  in  social  foundations  or  multicultural  couracwork 
(Britzman,  1992).  Yet  simply  acknowledging  historical 


gendered  inequities,  as  if  they  were  a product  of  the  past,  is 
not  enough. 

When  I address  gendered  relations  in  my  teach- 
ing, I also  begin  with  questions  about  equity  and  access,  as 
most  credential  candidates  do  not  come  into  teacher  educa- 
tion programs  aware  of  this  history.  I talk  to  them  about  my 
own  personal  school  experiences  where  I was  treated  ineq- 
uitably. I tell  them  how  I was  barred  from  higher  levels  of 
mathematics  in  high  school  because  “girls  don’t  need  that 
level  of  mathematics.”  I draw  upon  their  own  experiences 
of  exclusion.  I then  ask  them  to  participate  in  action  re- 
search projects  on  immediate  as  well  as  historical  questions 
of  access  and  equity.  In  a preservice  course  which  inte- 
grates social  studies,  literacy,  math  and  science,  for  example, 

I ask  my  students  to  conduct  two  research  projects.  One  is 
to  review  texts  used  in  elementary  classrooms  for  gender 
and  other  biases,  and  the  second  is  to  interview  children 
about  their  thoughts  about  their  own  gendered  socialization 
in  school  with  regard  to  subject  matter  study. 

The  results  are  routinely  surprising  to  the  students. 
Not  only  do  they  discover  that  the  content  of  texts  used  in 
schools  today  is  very  similar  to  that  of  their  parents  ’ or  their 
own  school  experiences — with  the  exception  of  boxed  add- 
ons to  include  famous  women  and  ethnic  minorities — but 
that  most  children  are  still  separately  socialized  into  boys’ 
studies  (math  and  science)  and  girls’  studies  (humanities). 
Since  rewriting  texts  or  societal  patterns  are  beyond  what 
most  credential  candidates  feel  they  can  do,  we  spend  a major 
part  of  the  class  determining  what  their  responsibilities  will 
be  as  teachers  to  address  these  findings,  and  what  action 
they  can  take  to  increase  opportunities  for  equal  access  to 
knowledge.  We  learn,  for  example,  how  to  supplement  in- 
adequate texts  with  their  own  and  student-based  research 
into  these  issues  (see  McCormick,  1994).  Whether  they 
will  or  not  actually  do  so  as  practicing  teachers,  however, 
seems  to  depend  on  their  knowledge,  their  sources  of  bup- 
port  and  their  commitments  (see  Hollingswortii,  1994b). 

Whose  Knowledge  gets  Represented? 

Cultural  or  Difference  Feminism  of  the  1980s . 

The  scholarship  in  this  period  of  feminist  critique 
focused  on  epistemological  and  moral  assumptions  which 
underpinned  knowledge  and  its  use  in  educational  research 
and  practice.  The  potential  impact  of  this  work  is  to  inter- 
rupt the  socialized  concepts  of  justice,  knowledge,  research 
and  education  as  we  now  know  them.  Since  this  work  is 
more  controversial  than  the  agendas  of  the  liberal  feminist 
scholars,  these  studies — reporting  on  women’s  different  ways 
of  knowing,  moralizing,  and  acting — have  had  less  accep- 
tance in  teacher  education.  Groundbreaking  work  by  Carol 
Gilligan  (1982)  on  girls’  moral  development,  by  Nell 
Noddings  in  the  ethic  of  care  (1984)  and  by  Belenky,  Clinchy. 
Goldberger,  and  Tarulc  (1986)  on  women’s  ways  of  know- 
ing— suggests  that  schools  should  value  traditional  femi- 


nine values  of  “care”  as  well  as  the  typically  masculine  val- 
ues of  “rights.”  The  research  also  suggests  that  schools 
should  take  care  to  value  women’s  voices  in  classrooms — 
voices  which  are  often  silenced  because  of  their  gendered 
differences  (Lewis  & Simon,  1986).  Very  little  of  this  “dif- 
ference” feminist  scholarship  is  addressed  in  teacher  edu- 
cation programs,  again  unless  it  is  weakly  attached  to  the 
concept  of  multicultural  education.  Perhaps,  as  the  examples 
from  my  colleagues  showed,  that  is  because  it  is  difficult  to 
do.  However,  see  a recent  case-book  on  gendered  differ- 
ences in  school  by  Judith  Kleinfeld  and  Suzanne  Yerian 
(1994)  might  provide  an  excellent  vehicle  into  this  area. 

Another  reason  this  work  is  ignored  in  classrooms 
may  be  because  the  critique  of  cultural  feminism  scholar- 
ship resonates  with  too  many  educators’  experiences.  We, 
as  college-educated  people,  socialized  to  believe  in  hege- 
mony— or  the  dominant  ideology  in  society  which  leads  us 
to  ratify  the  “status  quo”  as  best  for  most  Americans  (and  to 
have  personally  benefited  because  of  it) — have  a hard  time 
feeling  “voiceless”  or  marginalized.  Further,  particular 
groups  of  women  (e.g.,  African-Americans)  do  not  feel  si- 
lenced in  the  same  way  that  the  Gilligan,  Belenky  and 
Noddings  work  might  suggest  (see  Crichlow,  Goodwin, 
Shakes,  & Swartz,  1990;  Mohanty,  Russo,  & Torres,  1991). 
I have  certainly  found  resistance  to  cultural  feminism  schol- 
arship when  I have  tried  to  teach  from  the  “difference”  per- 
spective. Let  me  give  an  example. 

In  a graduate  course  for  teacher  educators  at  U.C.  Berkeley, 
I asked  the  students  to  read  critiques  of  teaching  as  a 
“women’s  profession”  (see  Laird,  1988),  then  to  analyze 
graduate  curriculum,  teacher  exams,  teacher  evaluation  pro- 
tocols, and  teaching  reward  structures  to  get  a sense  of  the 
values  they  represented.  Routinely,  the  values  generically 
attributed  to  “women” — such  as  care,  inclusion,  compas- 
sion, and  multiple  perspectives  were  underrepresented  when 
compared  to  values  generically  attributed  to  “men”  such  as 
detachment,  independence,  consistency,  principled  knowl- 
edge and  leadership.  Even  though  the  bias  inherent  in 
teacher  education,  evaluation  and  reward  structures  became 
clear  in  these  studies,  class  members  were  reluctant  to  con- 
clude that  gendered  relations  were  problematic.  One  stu- 
dent wrote: 

A fler  reading  Laird  }s  article , I found  I did  not  relate 
to  it  at  all  ;n  terms  of  the  theses  thu.  underlie  the 
whole  thing— like  that  [teaching  is]  demeaning  be- 
cause it ’s  woman ’s  work . I just  didn  t resonate  with 
that  at  all.  I guess  as  a teacher,  I never  thought  of 
myself  as  a woman.  I thought  of  myself  as  a human 
being  who  had  a real  interest  in  kids  and  learning.  I 
always  felt  respected  and  treated  very  profession- 
ally by  men  and  women.  The  only  [feminist  issue ] 1 
can  connect  to  is  the  pay  difference.  I don  think 
differential  pay  for  “ men  $ jobs  " and  "women  'sjobs  " 
is  right  at  all. 
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Without  resonating  experiences,  exposure  to  infor- 
mation about  cultural  feminism  does  not  appear  to  lead  to 
action.  Further,  I am  now  much  more  sensitive  to  the  fact 
that  my  students  and  I do  not  automatically  share  similar 
experiences;  therefore  I now  treat  cultural  feminism  as  a 
“problem.”  I continue  to  give  my  own  personal  stories 
about  how  I have  been  treated  similarly  (when  I conform) 
and  differently  (when  I step  outside  of  societal  norms).  I 
talk  to  them  about  my  biography  which  has  led  me  to  be  so 
critical  of  discriminatory  treatment  based  on  gender.  I tell 
them  of  my  grandmother,  named  before  the  turn  of  the  cen- 
tury after  a famous  early  feminist — Frances  Willard — and 
the  history  of  strong  women  in  my  family  which  leads  me  to 
view  the  world  as  I do. 

Beyond  Equity  and  Difference: 

Postmodern  Feminisms  of  the  1990s. 

Rather  than  focus  on  equity  or  difference,  feminist 
scholars  in  the  current  decade  have  tried  to  “deconstruct” 
the  notions  of  “man”  and  “woman”  to  situate  them  prob- 
lematically in  relation  to  experience.  Those  scholars  (e.g., 
Britzman,  1993;  Ellsworth,  1989;  Fine,  1992;  Lather,  1991; 
Weiler,  1988)  might  understand  my  Berkeley  student  who 
“never  thought  of  [herself]  as  a woman”  on  the  grounds  of 
conflicting  conceptions  of  what  the  category  of  “woman” 
includes.  They  would  point  out  that  the  social  construct  of 
“woman”  is  not  universal — nor  is  it  the  identifying  charac- 
teristic that  makes  all  women  feel  invisible  in  school  (see 
Hollingsworth  & Miller,  1994).  Perhaps  my  student — in 
her  position  as  a white  woman  teacher  in  an  affluent  school 
district,  teaching  with  values  which  approximated  those  of 
the  school  community — did  not  experience  the 
marginalization  that  other  women  and  men  teaching  in  dif- 
ferent circumstances  often  do.  Sometimes  men  in  my  courses 
feel  more  marginalized  in  education  than  women.  Other 
teacher  educators  have  discovered  similar  patterns.  Liston 
and  Zeichner,  for  example,  talk  about  their  gendered  par- 
ticipation as  men  in  elementary  education  in  marginalizing 
terms. 

As  male  elementary  teachers  and  now  as  (male) 
teachers  of  (predominantly  female)  prospective 
teachers , we  have  observed  subtle  and  overt  reac- 
tions to  men  \ s participation  in  " women  *s  work . " 
Many  of  our  prospective  women  teachers  express 
surprise  that  a man  would  want  to  be  an  elementary 
teacher.  Many  of  our  male  college  mentors  thought 
we  should  choose  more  appropriate  careers.  And \ 
more  recently,  many  of  our  colleagues  have  advised 
us  to  focus  on  matters  other  than  teacher  education. 
Somehow  teaching , especially  at  the  elementary 
level , is  not  a job  for  a man.  (1991,  p.  111). 

Untangling  the  intersecting  identities  of  man, 
woman,  social  position,  community,  values,  educational 
background,  parenting,  sexuality,  race,  generation  and  other 
descriptors  in  understanding  and  guiding  teachers’  learn- 


ing may  seem  an  overwhelming  responsibility  for  teacher 
educators.  On  the  other  hand,  our  commitment  to  indi- 
vidual differences  and  student  responses  in  educational  prac- 
tices, as  a colleague  wrote  to  me,  is  grounds  for  attending  to 
this  literature.  It  is  in  the  area  of  postmodern  feminism 
that  the  most  controversy  has  arisen  and  the  least  applica- 
tion to  teacher  education  has  been  made,  perhaps  because  it 
is  the  most  complex  and  the  least  prescriptive.  Yet,  for  me, 
it  holds  the  most  promise  for  transforming  how  we,  as 
teacher  educators,  * can  include  gendered  and  other  social 
relations  as  part  of  the  knowledge  base.  And  though  we  are 
without  prescriptions  about  how  to  accomplish  this  task, 
we  are  not  without  guidance. 

We  know  that  our  teacher-students  must  attend  to 
their  own  beliefs  and  biographies  to  understand  how  to 
overcome  traditional  and  out-moded  ways  of  teaching  which 
are  familiar  to  them  (Britzman,  1987;  Gitlin,  et  al.,  1992), 
We  know  that,  as  teacher-educators,  we  must  examine  our 
own  philosophical  and  political  constructs  as  we  ask  teach- 
ers to  examine  theirs  (Connelly  & Clandinin,  1988; 
Kilpatrick,  1992).  We  know  we  must  come  to  know  our- 
selves in  relation  to  others  (Greene,  1979;  Jersild,  1955). 
We  must  withhold  immediate  judgment  (Hollingsworth, 
1994b)  to  allow  the  uncertainty  necessary  for  knowledge 
transformation  while  modeling  both  epistemological  and 
instructional  change  (Belenky,  et  al.,  1986).  We  must  help 
teachers  analyze,  deconstruct  and  reconstruct  their  beliefs 
about  themselves  and  their  students  (Guskey,  1986).  We 
must  be  brave  and  courageous  in  our  efforts  to  transform 
teacher  education  (Sockett,  1992). 

I’ve  recently  helped  design  a master’s  program  in 
curriculum  and  teaching  at  Michigan  State  University  based 
not  only  on  these  guidelines,  but  a belief  in  an  inquiry  ap- 
proach to  continuing  teacher  education,  a commitment  to 
tackling  gendered  relations  from  the  perspective  of 
postmodern  feminists  and  others  who  think  similarly,  and 
some  research  on  my  own  preparation  of  teacher  educators 
at  UC  Berkeley.  We  begin  the  first  course  in  the  program — 
Professional  Development  and  Inquiry— by  deconstructing 
the  notions  of  “woman,”  “man,”  “teacher,”  “knowledge,” 
and  “research.”  We  learn  to  see  those  concepts  differently. 
Wc  explore  our  own  biographies  to  determine  the  narrative 
construction  and  reconstructions  of  our  own  values,  pre- 
ferred paradigms,  teaching  and  learning  styles,  identities 
relative  but  not  uniformly  connected  to  gendered  notions 
on  morals  and  values,  or  to  various  learning  and  teaching 
paradigms.  We  do  all  of  this  conversationally,  in  small 
groups,  where  we  can  come  to  know  each  other  and  build 
intimate  learning  communities  before  we  read  what  other 
experts  have  to  say  about  teaching,  research,  reflections  and 
learning.  To  keep  my  views  from  being  the  most  valuable 
in  the  course,  I let  go  of  my  power  as  sole  evaluator  of  stu- 
dents’knowledge.  We  treat  course  evaluation  as  problem- 
atic. I name  what  we’re  doing  as  an  example  of  feminist 
pedagogy,  and  I explain  that  I hope  such  naming  will  give 


all  /i  us  the  license  to  chart  our  own  progress.  For  more 
specific  details  on  this  course,  see  Hollingsworth  (1994a, 
1994b). 

Through  such  introductory  and  exploratory  pro- 
cesses, we  come  to  see  that,  even  though  we  have  partici- 
pated in  similar  education  programs  and  were  taught  a simi- 
lar “truth”  or  knowledge  base,  that  our  own  experiences 
and  ways  of  making  sense  of  the  world  led  us  to  construct 
or  give  meaning  to  that  truth  in  different  ways — and  that 
we  continue  to  reconstruct  our  knowledge  given  our  shift- 
ing positions  across  personal  histories.  Next  we  engage  in 
teacher  or  action  research  projects  to  look  at  our  own  prac- 
tices with  personal  or  meaningful  questions.  We  design 
ways  of  researching  those  practices  which  are  consummate 
with  our  own  personal  epistemologies  of  knowledge  and 
our  particular  work  environments.  Some  of  our  research 
projects  specifically  deal  with  gender  in  the  classroom;  all 
of  diem,  however,  deal  directly  with  the  gendered  (and  other) 
nature  of  self  and  teacher  as  those  concepts  change  over 
time.  In  fact,  we  push  each  other  if  our  topics  and  our  lives 
seem  too  disconnected.  At  the  beginning  of  our  work,  we 
are  more  interested  in  how  we  personally  construct  projects 
for  educational  research  rather  than  their  results.  As  a re- 
sult of  this  introductory  course,  we  begin  to  see  ourselves 
as  “teachers”  and  our  students  as  “learners”  in  different 
ways,  then  to  act  on  those  understandings  through  the  re- 
mainder of  the  Master’s  program  and  into  our  various  class- 
rooms. To  incorporate  similar  features  into  other  courses, 
I would  encourage  teacher  educators  to  engage  in  similar 
processes  themselves,  either  by  auditing  courses  taught  in 
this  style,  or  through  informal  conversation/study  groups 
organized  around  feminist  literature.  One  teacher  educa- 
tor who  visited  my  course  at  U.  C.  Berkeley  had  this  to  say 
about  the  experience  two  years  after  it  had  ended: 

To  have  the  opportunity  to  come  together  with  oth- 
ers whose  life  work  is  to  enhance  the  development  of 
teachers  and  engage  in  the  construction  of  knowl- 
edge was  transforming  and  emancipatory.  Letting 
go  of  my  conceptions  of  the  ' official ' occupational 
role  of  teacher  educator,  I was  able  to  move  from  a 
notion  of  myself  as  intermediary  between  the  knowl- 
edge base  and  the  novice  teacher  to  an  appreciation 
for  the  power  of  biography  and  the  function  of  the 
self  in  teaching  and  learning  to  teach.  . . .(see 
Gallagher,  1992).  . . . 

Stephen  Swidler,  a doctoral  student  who  co-taught 
classes  at  MSU  with  me  foi  several  years  from  this  perspec- 
tive wrote  to  me  about  his  future  as  a teacher  educator:  “This 
is  the  only  way  to  teach  that  makes  sense.... to  let  go  of  what 
students  are  learning.  To  push  for  having  them  learn  about 
themselves  as  gendered  and  other  identified  human  beings 
searching  for  their  own  interests  and  methods.  Otherwise, 
we’re  fooling  ourselves.” 


In  short,  courses  which  look  at  gendered  and  positional 
relations  of  teaching  and  learning  seem  to  hold  promise  for 
developing  knowing,  critical,  action-oriented,  reflective 
teachers  of  all  students.  I challenge  us  as  a field  not  to 
ignore  a body  of  scholarship — based  on  critiques  of  gendered 
notions  of  sex — which  has  led  to  more  societal  changes  in 
the  last  30  years  than  in  the  previous  200 — and  to  move 
beyond  the  stereotypical  notions  of  feminist  scholarship  and 
to  find  out  which  interpretation  validates  our  own  life  expe- 
riences— then  use  that  scholarship  to  rethink  both  our  re- 
search and  our  teaching. 
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Mwera  Conference  Survey  Results 


The  MWERA  Board  of  Directors  (BOD)  conducted  an  important  membership 
survey  at  the  time  of  the  1995  Elections  Ballot.  BOD  is  exploring  alternatives  for  the 
annual  conference  site,  hotel,  costs,  and  dates.  The  Bismarck  Hotel  is  under  new  manage- 
ment, and  our  costs  are  increasing  sharply. 

About  200  members  who  responded  to  the  1995  Election  Ballot  also  responded  to 
the  Survey.  All  responses  were  anonymously  sent  to  the  Tellers’  Committee  (E.  Jane 
Williams,  Chair)  who  compiled  the  data  and  developed  the  Summaiy  Table  presented 
below. 


Note  that  the  Survey  asked  members  to  respond  to  10  factors,  9 of  which  re- 
quired a 5-point  Likert  Scale  rating  ranging  from  1 = Strongly  negative,  to  3 = Neutral, 
to  5 = Strongly  positive.  Factor  #9,  which  utilized  a different  response  format,  asked:  How 
much  of  a room-rate  increase  could  you  tolerate  and  still  attend  the  Conference?  Nine 
room-rate  increase  levels,  ranging  from  $5  to  $50  (in  incremental  steps  of  $5)  were  listed. 


Factor 

Mean 

Std  Dev 

N 

1. 

The  Bismarck  hotel? 

3.14 

1.12 

199 

2. 

Location:  downtown  Chicago? 

4.12 

1.05 

199 

3. 

Conference  time:  October? 

3.81 

0.96 

199 

4. 

Lowest  possible  room-rates? 

3.84 

0.98 

195 

5. 

Quality  of  conference  speakers? 

4.16 

0.87 

199 

6. 

Quality  of  paper-sessions? 

4.26 

0.76 

201 

7. 

Opportunity  to  interact  with  colleagues? 

4.53 

0.69 

197 

8. 

Move  conference  from  Bismarck 
if  it  costs  more? 

2.83 

1.26 

196 

9.  Room-rate  increase  tolerable? 

The  modal  increase  in  cost  tolerable  is  $15,  however  the  frequency  of  response  for 
this  increase  is  39;  while  the  frequency  for  a $10  increase  is  3 1,  and  for  $20  it  is  36. 
The  mean  response  is  for  a 15.88  increase;  while  the  SD  is  10.78 

10.  If  conference  moved  to  suburbs, 

would  you  attend?  3.51  1.38  197 


The  MWERA  Board  of  Directors  invites  your  comments  to  these  Survey 
responses.  Please  direct  your  comments  to  MWERA  President  Tom  Andre.  Note  that 
Tom’s  address  and  phone  # information  are  published  under  the  CALL  for  Nominations 
in  this  Issue  of  MWER.  See  page  30. 


Voices  in  Education 
On  Authentic  Assessment 

Marlene  Schommer 
Wichita  State  University 


Leaders  of  education  were  asked  to  respond  to  the  follow- 
ing questions: 

1.  What  are  the  roadblocks  toward  quality  authentic  as- 
sessment? 

2.  Do  you  think  authentic  assessment  is  feasible  at  the  na- 
tional level? 

********************************* 

Roadblocks  & Feasibility:  We  are  making  the  same  mis- 
take with  so-called  “authentic  assessment”  that  we  made 
with  traditional  assessments:  believing  that  there  is  a single 
“correct”  form  of  assessment.  Educators  are  consummate 
followers  of  bandwagons.  For  years,  the  bandwagon  was 
multiple-choice  assessment,  and  the  prevailing  but  false 
belief  was  that  IQ,  or  SAT  scores,  or  ACT  scores,  or  what- 
ever somehow  told  you  a person’s  true  abilities.  Now,  of 
course,  people  recognize  how  wrong  they  were,  the  true  pana- 
cea is  authentic  assessment,  so  let’s  fool  ourselves  into  be- 
lieving that  such  measures  tell  you  a person’s  true  abilities 
or  achievements.  Psychologists  have  long  recognized  that 
the  best  assessments  use  “converging  operations”  ; multiple 
assessments  of  the  same  construct.  An  ideal  assessment 
battery  would  therefore  involve  a variety  of  types  of  assess- 
ments, including  both  conventional  and  modem  ones.  Any 
single  kind  of  assessment  benefits  some  students  unfairly 
over  others.  Certain  learning  styles,  certain  ability  patterns 
profit  from  one  type,  but  not  another.  Ideally,  then,  we  need 
to  use  many  different  types  of  assessments  to  average  over 
measurement  error  caused  by  single  methods.  The  ques- 
tion is  not  therefore  “what  are  the  roadblocks,”  but  are  we 
going  to  make  the  same  mistake  again  of  believing  that  there 
is  a single  answer,  and  it’s  this  year’s  (or  decade’s)  fad. 
Robert  J.  Sternberg 
Yale  University 

******************************** 
Roadblocks  & Feasibility:  Performance  assessment,  as 
one  type  of  authentic  assessment,  holds  great  promise  for 
leading  much  needed  curriculum  reform.  The  tasks  that 
make  up  performance  assessment  are  designed  to  mirror 
good  instruction  and  to  elicit  from  students  the  types  of  ac- 
complishments that  are  necessary  to  be  successful  in  the 
world  of  work  and  in  subsequent  education.  For  perfor- 
mance assessments  to  realize  tlieir  full  potential  for  increas- 
ing both  the  quantity  and  quality  of  student  learning,  sev- 
eral difficulties  must  be  overcome.  First,  like  any  type  of 
assessment,  performance  assessment  must  begin  with  well- 
defined  domains  of  desired  student  accomplishments.  The 
domains  are  the  targets  for  instruction,  not  the  specific  tasks 
on  a performance  assessment.  Second,  performance  assess- 
ment tasks  take  considerable  time;  few  tasks  can  be  used  in 
any  one  assessment.  Thus,  problems  of  task  stability  must 
be  solved.  Third,  if  performance  assessments  are  to  yield 


useful  information  for  external  accountability,  problems  of 
equating  over  time  will  need  to  be  solved.  If  these  difficul- 
ties are  resolved,  performance  assessment  is  as  feasible  at  a 
national  level  as  it  is  at  a state  or  district  level.” 

Andrew  C.  Porter,  Director 
Wisconsin  Center  for  Education  Research 
************************** 

Roadblocks:  Roadblock  Number  One  is  that  the  term  “au- 
thentic assessment”  has  no  definition.  It  might  mean  as- 
sessments that  are  relevant  to  students,  engage  them  in  learn- 
ing, assess  meaningful  complex  outcomes,  and  provide  op- 
portunities to  demonstrate  highly  valued  knowledge  and 
skills.  Who  knows?  These  same  characteristics  could  ap- 
ply to  well-conceived  traditional  assessment  formats  as  well. 

Roadblock  Number  Two  is  that  many  people  are 
proceeding  under  the  incorrect  assumption  that  any  authentic 
assessment  is  automatically  quality  authentic  assessment. 
Fortunately,  many  will  also  wake  up  on  the  morning  after 
and  realize  that  authentic  assessments  can  be  poorly  con- 
structed, lead  to  incorrect  decisions,  be  biased,  unreliable, 
invalid,  drive  curriculum,  lead  to  rote  learning,  and  so  on. 
We  must  first  understand  that  it  is  not  the  format  of  the 
assessment  but  the  consequences  associated  with  its  use  that 
bring  about  all  of  the  unwanted  effects  many  have  come  to 
associate  with  multiple-choice  formats. 

Roadblock  Number  Three  is  the  widespread  belief 
that  nearly  anyone  can  create,  administer,  and  score  a high- 
quality  authentic  assessment.  “I’ve  been  doing  this  for 
years,”  is  a commonly  heard  reaction  to  authentic  assess- 
ment. Unfortunately,  in  many  cases  what  people  have  been 
doing  for  years  is  poor  practice. 

Feasibility:  It  depends  on  what  is  meant  by  authentic  as- 
sessment, and  as  I noted  earlier,  no  one  knows  for  sure. 
Some  types  of  assessment  alternatives  are  desperately  needed 
at  the  national  level.  For  example,  more  challenging,  com- 
plex, application-oriented  tasks  would  be  a welcome  addi- 
tion to  textbooks,  national  examinations,  curriculum  mate- 
rials, etc. 

On  the  other  hand,  assessment  alternatives  like 
portfolios  would  be  a disastrous  direction  for  national-level 
applications.  It  is  easy  to  see  that  this  is  the  case  once  the 
proper  uses  of  portfolios  are  understood.  Portfolios  are  un- 
surpassed as  documentation  of  individual  development  in 
circumscribed  areas;  for  example,  in  viewing  a student’s 
development  in  use  of  descriptive  language  in  compositions. 
They  are  ill-advised  as  measures  of  discrete  skill  attainment, 
as  monitors  of  general  academic  achievement,  or  as  account- 
ability instruments.  The  issue  has  been  well  stated  by  Rick 
Stiggins  who  has  urged  that  we  pay  closer  attention  to  match- 
ing assessment  strategies  with  the  assessment  “targets”  we 
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want  to  hit. 

In  sum,  the  real  value  of  the  emerging  alternatives 
will  be  seen  in  whether  they  result  in  more  attention  to  sound 
assessment  practice,  in  more  teacher  involvement  in  design- 
ing high-quality  assessment  systems  that  respond  to  the  in- 
dividual needs  of  students,  and  in  increased  attention  to  the 
relationship  between  assessment  and  instruction.  If  these 
things  occur,  then  the  move  toward  assessment  alternatives 
will  be  a tremendous  benefit  to  American  education. 
Gregory  J.  Cizek 
The  University  of  Tbledo 

*************************** 

Roadblocks:  Two  major  roadblocks  are  worthy  of  our  at- 
tention. The  first  roadblock  to  the  development  of  quality 
assessments  of  all  kinds  is  our  almost  complete  lack  of  as- 
sessment literacy  throughout  our  school  culture  and  our  so- 
ciety. Those  who  do  not  understand  the  basic  principles  of 
sound  assessment  cannot  hope  to  meet  those  standards  of 
quality. 

The  second  roadblock  may  be  our  lack  of  willing- 
ness to  spend  the  money  needed  to  assess  well.  We  have 
spent  the  last  60  years  convincing  society  that  assessment  is 
cheap,  that  one  can  assess  student  achievement  for  $2.50 
per  student  per  year-the  cost  of  a once-per-year  standard- 
ized test.  Now  we  acknowledge  that  this  definition  of  aca- 
demic success  is  not  now  and  never  was  acceptable  as  a sole 
criterion  of  school  effectiveness  due  to  the  narrowness  of 
the  definition  of  academic  success  it  represents.  Instead, 
we  advocate  the  use  of  far  more  complete  and  more  expen- 
sive assessment  methods.  That  leaves  us  with  60  years  of 
convincing  to  undo. 

Feasibility:  Not  only  is  national  performance  assessment 
not  feasible  due  to  the  immense  cost,  but  it  is  a very  bad 
idea  at  this  time.  We  have  spent  the  last  60  years  building 
layer  upon  layer  of  ever  more  centralized,  ever  more  stan- 
dardized testing  into  our  educational  system  with  little  dis- 
cernible impact.  We  started  with  local  testing  in  the  1960s, 
added  statewide  testing  in  the  1970s,  national  and  interna- 
tional testing  in  the  1980s,  and  faced  the  prospect  of  a na- 
tional every  pupil  exam  in  the  1990s  with  little  evidence  of 
any  enhancement  of  the  American  educational  system.  The 
cost  for  these  layers  of  testing  now  exceeds  a billion  dollars 
per  year,  every  year.  More  will  not  help. 

The  reason  is  that  these  testing  programs  operate 
on  the  assumption  that  the  quality  of  schools  is  determined 
by  policy-level  decision-makers  at  district,  state  or  national 
levels.  Give  the  right  information  about  student  achieve- 
ment, we  arc  told,  policy-makers  will  make  the  informed 
judgments  required  to  make  schools  work. 

The  fact  is  that  these  arc  not  the  decision-makers 
that  make  schools  work.  Three  groups  of  decision-makers 
make  the  decisions  that  determine  the  effectiveness  of  schools 
for  each  individual  student  and  for  students  considered  col- 
lectively. In  order  of  importance  for  student  well-being, 
they  are  students  themselves,  their  teachers,  and  their  par- 
ents-all  of  whom  rely  on  the  teachers’  day-to-day  class- 
room assessments  to  inform  their  decisions.  Until  we  can 


assure  the  quality  of  those  classroom  assessments  by  offer- 
ing teachers  and  principals  the  kind  of  professional  devel- 
opment that  is  still  totally  absent  from  their  training  pro- 
grams, more  and  more  standardized  testing  will  represent 
even  more  wasted  money.  If  assessment  is  not  working  ef- 
fectively for  day-to-day  needs  in  the  classroom,  centralized 
standardized  testing  represents  wasted  effort  and  money. 
Richard  J.  Stiggins,  Director 
Assessment  Training  Institute 

********************** 

Roadblocks:  Lead-footed  tradition  slows  the  embrace  of 
authentic  assessment.  Rightly  or  wrongly,  many  adults, 
supported  by  unremittingly  negative  press  coverage  of  the 
schools,  believe  that  what  they  experienced  in  school  was 
“good”  and  that  proposals  for  change  represent  an  assault 
on  the  “quality”  they  knew  when  they  were  students.  Indi- 
viduals subscribing  to  this  perspective  are  particularly  sus- 
picious of  reform  efforts  that  make  school-to-school  com- 
parison more  difficult.  Clearly  standardized  test  results, 
that  boil  down  student  performances  to  a few  numbers,  are 
easy  to  report.  Despite  a rich  measurement  literature  de- 
crying the  use  of  such  gross  summary  judgments  to  make 
broad  qualitative  statements  about  individual  school  pro- 
grams, many  citizens  believe  that  is  exactly  what  standard- 
ized tests  can  do.  Authentic  assessment  is  so  time-consum- 
ing that  large  numbers  of  measures  can  be  taken  only  on  a 
sample  of  the  total  school  population.  The  general  public  is 
going  to  have  an  extremely  difficult  time  understanding  why 
the  “tried  and  true”  practice  of  administering  standardized 
tests  to  every  student  should  be  abandoned  for  this  “untested” 
new  system.  The  most  likely  scenario,  from  a political  per- 
spective, is  that  information  generated  from  some  standard- 
ized measures  will  have  to  be  provided  as  a “political  price” 
the  public  will  exact  for  authorizing  the  use  of  some  au- 
thentic assessment  approaches. 

Feasibility:  Authentic  assessment  at  the  national  level  will 
be  feasible  only  when  the  public  is  convinced  that  assess- 
ment of  a sample  of  the  student  population  will  suffice.  Time 
and  resources  simply  will  not  allow  for  large  numbers  of 
authentic  assessments  of  all  students.  A public  conditioned 
to  standardized  test  score  averages  based  on  performances 
of  the  total  population  of  students  may  not  be  enthusiastic 
about  a wholesale  change  to  authentic  assessment. 

David  G.  Armstrong 
Texas  A&M  University 

******************************** 

Roadblocks:  A major  roadblock  is  task  specificity,  which 
means  that  how  an  individual  performs  depends  heavily  on 
the  specific  task  that  is  administered.  It  follows  that  valid 
assessment  requires  the  use  of  many  tasks,  which  leads  to  a 
heavy  use  of  resources. 

Feasibility:  Yes,  especially  when  the  assessment  is  of  groups 
or  programs  rather  than  of  individuals. 

Jason  Millman 
Cornell  University 
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UPDATE:  THE  1995  MWERA  ANNUAL  MEETING 

Sharon  McNeely,  Program  Chair 
Vice-President,  M-WERA 

The  1995  M-WERA  Annual  Meeting  program,  set  for  October  11-14,  is  starting  to  take  shape. 
The  dealine  for  the  Call  for  Papers  is  May  7,  In  the  meantime,  the  Division  Co-Chairs  and  I have  been 
planning  some  invited  speakers  and  some  workshops. 

Some  of  the  planned  highlights  include: 

* Wednesday  late  p.m.  pre-conference  “debate”  on  the  crisis  in  education  featuring  Dr.  David 
Berliner  and  others. 

* Opening  keynote  address  by  Dr.  David  Berliner  on  manufactured  crisis  in  education  and  what 
we  have  learned  from  research  in  the  schools. 

* Presidential  Address  by  Dr.  Thomas  Andre  on  technology,  gender,  and  the  thinking  school. 

* Friday  luncheon  address  by  Dr.  Gerald  Bracey  on  new  directions  for  schools  to  deal  with  “aistf ’. 

* Workshop  and  address  by  Dr.  Barbara  McCombs  on  implementing  learner-centered  principles 
in  the  classroom. 

* Address  by  Dr.  Barbara  Shade  on  developing  culturally  responsible  teachers. 

* Address  by  Dr.  Nancy  Zimpher  on  developing  professional  relationships  between  schools  and 
universities. 

* Professional  development  workshops  on  obtaining  federal  monies  for  educational  support. 

* Exhibits  by  various  publishing  companies 

All  educators,  educational  researchers,  graduate  students,  educational  administrators,  and  others  as- 
sociated with  education  are  encouraged  to  submit  papers.  These  will  be  blind  reviewed.  Division  Co- 
Chairs  are  identifying  reviewers  and  are  planning  their  programs.  The  Division  Co-Chairs  are: 

A:  Will  Place  and  Larry  McNeal 
B:  Virginia  Goodman  and  Jay  Thompson 
C:  Jennifer  Fager  and  Steve  Benton 
D:  Laura  Barnes  and  Susan  Holmes 
E:  Sharon  Paulson  and  Paula  Britton 
F:  Louise  Fleming  and  Michael  Penrod 
G:  Deborah  Bainer  and  Clara  New 
H:  Isadore  Newman  and  John  Fraas 
I:  Gene  Kramer  and  Richard  M.  Smith 
J:  Wayne  \hn  Zomeren  and  Gloria  Sandoval 
K:  Carmen  Giebelhaus  and  Mary  Bendixon-Noe 

The  workshops  for  professional  development  are  being  coordinated  by  Linda  Morrow.  Cecil  Smith 
and  Jay  Adler  are  developing  workshops  for  teachers  and  school  administrators.  Eddie  Glenn  is  coordi- 
nating special  needs  issues  of  our  participants.  Connie  Bohman  is  coordinating  our  New  Member 
welcome.  Adria  Karle- Weiss  is  the  Social  Director.  Exhibits  are  being  coordinated  by  Nancy  Fellows 
and  Ellen  Fiedler. 

The  meeting  will  be  held  at  the  Bismarck  Hotel  in  beautiful,  windy,  downtown  Chicago.  The  hotel  is 
currently  being  remodelled,  and  some  guests  will  enjoy  newly  designed  rooms  and  new  furniture.  The 
hotel  has  promised  an  office  center  for  our  conference  use,  and  some  other  nice  amenities.  The  city  has 
expanded  train  service  from  Midway  Airport  to  downtown,  making  the  expanded  Midway  an  additional 
option  for  getting  to  downtown  Chicago. 

If  you  have  some  program  suggestions  or  questions,  please  contact  me  directly  at  (312)  794-2788,  or 
email  at:  usmcncel@uxa.ecn.bgu.edu.  I look  forward  to  seeing  you  in  October. 


PRESENTATION  PROPOSAL  COVER  SHEET 
1995  MWERA  ANNUAL  MEETING 
October  11-14,  1995,  Chicago 


Complete  this  form.  Include  three  copies  with  your  submission. 

1 . Type  of  presentation: 

Paper:  15  minutes 

Symposia 

Workshop:  90  minutes 

Alternative  session: 

2.  Primary  Division  for  peer-review:  _ 

3.  Title  of  presentation: 


Poster 

Discussion  Croup 
Workshop:  3 hours 


4. 


Name  of  Principal  Presenter/Organizer: 


Affiliation 


Degree: 


5.  Co-authors,  Symposia  members,  etc. 


6.  Have  you  ever  presented  a similar  paper  at  another  professional  meeting? 

No  Yes  If  so,  how  will  this  differ? 

7.  Is  this  a student  presentation? No  Yes 

8.  Are  you  a MWERA  member?  No  Yes 

Please  note  that  all  presenters  must  be  current  members  of  MWERA  at  the  time  of  presentation  and 
must  pay  registration  for  the  Annual  Meeting. 

9.  Permission  is  given  to  MWERA  to  record  my/our  presentation  and  to  make  it  available  for  sale  for  the 

benefit  of  MWERA.  Initial  here  is  you  wish  to  withhold  this  permission. 

i hereby  certify  that  if  this  proposal  is  accepted  and  placed  on  the  Annual  Meeting  Program,  l will  join  MWERA, 
register  for  the  Annual  Meeting,  appear,  and  deliver  the  presentation.  If  I am  unable  to  attend,  I will  make 
arrangements  for  the  presentation  to  be  made  on  my  behalf. 

Signature: Date: 

Mail  this  no  later  than  May  7,  1995,  to:  Sharon  McNeely,  Ph.D,,  MWERA  Program  Chair,  P.O.  Box  34421, 
Chicago,  IL  60634 

Checklist:  Did  you  enclose: 

3 copies  of  this  proposal  cover  sheet 

6 copies  of  the  summary 

3 copies  of  the  abstract 

1 copy  of  abstract  with  author  information 

3 self-addressed,  stamped  envelopes 

3 author  information  sheets 


MWERA  Election  Results 

1995  Ballot 

The  Secretary  of  the  Association,  who  also  serves  as  Chair  of  the  Tellers*  Committee,  reported  the 
results  of  the  Spring  *95  membership  mail  ballot  as  follows: 


Vice-President: 


Member-At-Large: 


Association  Council: 


Kim  K.  Metcalf,  Indiana  University 

Linda  Bakken,  Wichita  State  University 

Deborah  L.  Bainer,  OSU-Mansfield 
Linda  S.  Behar,  University  of  Florida 
Mary  Ann  Flowers,  Cleveland  State  University 
Jeffrey  B.  Hecht,  Illinois  State  University 
Daniel  J.  Mueller,  Indiana  University 
Sarah  E.  Peterson,  Northern  Illinois  University 
Bruce  G.  Rogers,  University  of  Northern  Iowa 
Joan  S.  Timm,  University  of  Wi  scons  in-Oshkosh 


The  above  winners  assume  office  as  of  October  1995.  VP  Metcalf  is  responsible  for  the  1996 
MWERA  Conference.  He  will  move  on  to  President-Elect,  President,  and  Past-President  in 
subsequent  years.  The  other  officers  serve  two-year  terms. 

We  welcome  these  dedicated  members  of  MWERA  and  congratulate  them  on  their  success  as 
elected  officers. 


The  Mid-We*tern  Educational  Research 
Association  (MWERA)  is  a nonprofit  organi- 
zation of  professional  education  researchers 
primarily  from  states  and  provinces  located  in 
the  midwestem  region  of  the  United  States 
and  Canada.  Membership  is  open  to  faculty, 
students,  and  administrators  from  any  univer- 
sity, college,  and  school.  College  students 
engaged  in  educational  research  are  especially 
encouraged  to  join  as  members.  Also,  educa- 
tion researchers  in  business  and  industry,  as 
well  as  those  in  national,  state,  local  and 
private  agencies  and  organizations  are  wel- 
come. The  Association  promotes  and  dissemi- 
nates educational  research  through  its  publi- 
cations, its  scholarship  program,  and  its  An- 
nual Meeting. 

The  1995  dues  of  $10  for  student  and  $18  for 
professional  membership  include  a subscrip- 
tion to  the  Mid-Western  Educational  Re- 
searcher and  a reduced  registration  fee  for  the 
Annual  Meeting.  Address  membership  corre- 
spondence to:  Jean  W.  Pierce,  Dept  EPCSE, 
Northern  Illinois  University, DcKalb,IL  60115, 
phone:  815-753-8470. 


MWERA  Membership  Application 


Name  (first  middle  initial,  last) 


Mailing  address 


Home  phone  ( ) 


Highest  degree: 


In  stituition/Em  ploycr: 


Office  phone  ( ) 


Area  of  specialization: 


MWERA  division  preferences: 


E-mail  address: 


AERA  member? 


Division(s): 


If  applying  for  student  membership,  please  include  a copy  of  your  student  ID. 


706 


Mid-Western 
Educational 
Researcher 

Call  for  Proposals  for  Editor(s) 

The  Mid-Western  Educational  Researcher  is  the  official  publication  of  the  Mid-Western  Educational 
Research  Association  (MWERA).  The  journal  contains  research  based  articles,  features,  interviews, 
and  news  of  the  Association,  and  it  is  published  quarterly  with  one  issue  serving  as  the  annual  meeting 
program.  The  editorship  of  the  journal  is  a three  year  term  appointed  by  the  Association  President. 
Although  the  new  editors)  will  not  begin  the  term  until  the  Winter,  1997  issue,  a great  deal  of 
preparation  is  necessary  to  produce  the  first  issue,  therefore  an  appointment  one  year  prior  to  the  first 
issue  is  desirable. 

Those  interested  should  send  a cover  letter  outlining  the  following: 

1.  Name(s)  and  qualifications  of  those  included  in  the  proposal  (emphasize  skills  related 
to  the  editorsliip).  Teams  that  would  include  co-editorships  or  associate  editors  are 
welcome,  however  please  include  a description  of  anticipated  roles  and  responsibilities 
of  each  person.  Attach  complete  vitae  for  all  those  involved. 

2.  Any  institutional  support  that  would  facilitate  the  editor(s)  efforts  (printing,  mailing, 
and  related  costs  of  the  journal  are  paid  for  by  MWERA). 

3.  Strengths  and  weaknesses  of  current  journal  and  possible  ideas  for  the  future. 


Although  the  editorship  is  not  a paid  position,  it  offers  a creative 
professional  opportunity  with  high  visibility.  The  new  editor(s)- 
will  continue  to  shape  the  future  of  a journal  that  is  receiving 
national  recognition. 

Proposals  and  supporting  materials  must  be 
received  by  October  1 , 1 995 


Mail  proposals  to: 

Greg  Marchant 
MWERA  President-Elect 
Educational  Psychology 
Ball  State  University 
Muncie,  IN  47306 
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Setting  An  Agenda  for  Educational  Renewal : 

A Conversation  with  John  Goodlad,University  of  Washington 

Mary  & Sudzina,  The  University  of  Dayton 


John  Goodlad  is  Professor  of  Education  and  Director  of  the  Center  for  Educational  Renewal  at  the  Univer- 
sity of  Washington,  and  President,  Institute  for  Educational  Inquiry,  in  Seattle.  He  received  the  1984 
Outstanding  Book  of  the  Year  Award  from  AERA  for  A Place  Called  School , the  1990  Outstanding  Writing 
Award  from  AACTE  for  Teachers  for  Our  Nation  Schools , and  the  1993  AERA  Award  for  Distinguished 
Contributions  to  Educational  Research. 


MS-  In  your  latest  book,  Educational  Renewal:  Better 
Teachers , Better  Schools ; teacher  education  is  con- 
ceptualized as  occurring  in  a Center  of  Pedagogy, 
involving  teachers  in  schools  of  arts  and  sciences, 
schools  of  education,  and  school  districts.  How  do 
you  envision  these  groups,  whose  relationships  have 
often  been  adversarial,  working  together? 

JG-  In  our  case,  we  have  an  agenda  [See  Table  1].  So 
they  are  not  coming  together,  wondering  why  they 
are  coming  together.  They  are  coming  together  to 
address  the  agenda  and  the  point  I make  is,  if  you 
just  say,  “Let’s  come  together  and  talk”,  it’s  probably 
not  going  to  go  anywhere.  You’ve  got  to  come  to- 
gether and  say,  “All  right,  there’s  a part  of  this  agenda 
that  really  involves  us.  Let’s  talk  about  it.” 

So  you’ve  got  to  get  them  around  the  table  together, 
otherwise  they  keep  postponing  the  conversation.  The 
agenda  is  really  that  the  university  role  in  teacher 
education  involves  the  general  education  of  the 
teacher  in  the  arts  and  sciences  as  well  as  in  the  col- 
lege of  education  and  partner  schools. 

MS-  So,  what  you  are  proposing  is  a well-rounded,  well- 
educated  future  teacher. 

JG-  Sure.  But  I still  think  that  you  need  something  very 
specific  to  talk  about.  For  example,  we  found  that 
my  book,  Teachers  For  Our  Nation 's  Schools x stirred 
up  a lot  of  people  who  focused  on  the  research  and 
[the  attitude  was],  “OK,  another  research  report”. 
Educational  Renewal  is  different  because  the  role  of 
the  various  parties  is  spelled  out  there. 

MS-  In  addition  to  a lack  of  a specific  agenda,  do  you 
think  many  well-intended  reform  efforts  fall  by  the 
wayside  because  the  process  is  so  laborious? 


JG-  You  cannot  do  this  by  university  rules.  You  can’t  do 
this  at  faculty  meetings.  You’ve  got  to  get  taskforces, 
you’ve  got  to  say  what  it  is  you’re  going  to  come  out 
with,  where  you’re  going  to  be  three  months  from 
now,  and  what  we  have  to  do  to  be  there. 

Some  of  us  at  the  University  of  Washington  de- 
cided that  our  program  for  preparing  principals  was 
not  good  enough.  We  said,  let’s  design  a new  one. 
Let’s  design  it  so  we  can  have  a cohort  group  here 
this  summer.  It  was  already  February.  So  we  simply 
went  down  the  list.  We  want  a group  here  by  a cer- 
tain date  in  this  summer.  When  do  we  have  to  re- 
cruit them?  And  we  backed  up  from  that  and  deter- 
mined what  the  tasks  were  and  then  said  we’ve  got 
to  meet  once  a week.  And  then  we  said,  rather  than 
all  struggling  with  our  schedules,  this  week  we’re 
meeting  Monday.  Next  week,  it’s  Tuesday.  The  next 
week  it’s  Wednesday.  The  next  w'eek  it’s  Thursday. 
Monday,  Tuesday,  Wednesday,  Thursday.  You  can’t 
come?  It’s  your  responsibility  to  find  out  what  went 
on.  There  was  always  a core  team  that  carried  the 
work  forward.  But  if  we  said  let’s  do  it  at  the  faculty 
meeting,  it  would  take  us  three  years.  We  did  it  in 
three  months. 

MS-  John,  you’re  very  much  in  favor  of  people  taking  ac- 
tion. You  suggest  that  if  we  wait  for  Ed  Schools  to 
agree  on  what  should  be  done,  we  could  be  waiting 
forever.  You  advocate  trying  new  ideas,  even  if  they 
don’t  work  out,  rather  than  arguing  about  whether 
we  ought  to  try  something  new  or  not. 

JG-  We  want  somehow  or  other  to  turn  everything  into, 
“Let’s  see  if  we  can  agree  on  the  fundamental  prin- 
ciples.” You  don’t  all  have  to  agree  on  fundamental 
principles  to  decide  to  lake  action.  You’ve  got  to  gel 
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those  folks  out  in  the  schools  involved.  So  the  thing 
to  say,  and  this  has  face  validity,  ‘‘Sending  our  stu- 
dents out  ail  over  the  place  as  student  teachers  doe  't 
make  any  sense.  We’re  going  to  place  them  as  co- 
horts in  partner  schools.”  You  have  to  argue  about 
that  forever?  Go  do  it. 

MS-  A thread  that  runs  through  all  of  your  writing  is  that 
teaching  is  a moral  enterprise.  How  do  we  gain  the 
trust,  or  how  do  we  involve  school  people  in  legiti- 
mate educational  partnerships?  We  really  can’t  man- 
date sweeping  reforms. 

JG-  Too  often  people  in  the  university  want  to  talk,  make 
decisions,  and  then  say,  “We’ll  go  tell  these  school 
people  what  we’ve  decided.”  You’ve  got  to  involve 
the  school  people  in  the  conversation  from  the  be- 
ginning. Get  the  people  around  the  table  who  ulti- 
mately are  going  to  suffer  the  consequences  of  the 
decisions  to  be  made. 

If  they  get  involved  in  a discussion  about  the  mis- 
sion of  our  teacher  education  program,  they’ll  fall 
into  discussing  the  moral  dimensions  as  easily  as  the 
university  people  will.  We  have  18  people  in  a co- 
hort group  in  our  leadership  program  - professors  of 
education,  professors  in  the  arts  and  sciences,  and 
people  in  the  schools.  After  the  third  day,  you  can’t 
tell  who’s  who. 

MS-  You  are  seen  by  many  as  a champion  of  public  edu- 
cation. Do  you  agree  with  that  assessment? 

JG-  Well,  I’d  be  delighted  to  be  so  designated  because  I 
do  believe  very  strongly  in  public  education  as  a ba- 
sis for  our  society,  and  public  education  is  threatened 
right  now.  Very  seriously  threatened,  because  many 
people  don’t  understand  its  public  purpose.  They 
think  it’s  something  for  them. 

MS-  What  do  you  mean? 

JG-  Well,  let  me  throw  out  a little  proposition  to  you. 
You  pay  taxes  that  support  the  roads,  support  the 
parks,  provide  water,  provide  sewage  disposal,  pro- 
vide schools.  Now,  did  anyone  in  your  city  ever  claim 
that  this  part  of  this  road  is  mine,  it’s  private?  Did 
anybody  say  this  comer  of  the  park  is  mine,  it’s  pri- 
vate? Did  anyone  ever  say  I want  to  take  my  taxes 
back  and  have  my  own  water  system,  my  own  sew- 
age system?  What  do  they  do  about  the  schools?  I 
want  the  school  to  be  my  school,  my  private  school, 
and  I want  my  vouchers,  my  money  back  for  my 
school.  It’s  the  only  area  in  society  where  we  do  that. 
Not  only  that,  you  can’t  drive  on  those  public  roads 
that  you  paid  for  any  old  way  you  want  to.  You’ve 
got  to  observe  green  lights,  red  lights  and  a speed 
limit. 


People  think,  however,  they  can  do  anything  they 
want  with  their  schools.  They  can  send  their  kids  or 
not  send  their  kids.  They  can  send  them  on  time, 
they  can  send  them  to  swear  at  the  teacher  or  what 
not.  We’ve  got  to  have  a compact  with  the  people  on 
the  way  io  behave  about,  their  schools  the  same  way 
they  behave  with  their  parks  and  their  roads,  and  so 
on.  If  you  want  to  take  your  child  out,  be  my  guest. 
But  you  can’t  take  your  taxes  out.  Your  taxes  serve 
the  public  purpose  of  schooling.  That’s  why  the 
householders  in  Massachusetts  in  the  17th  century 
created  public  schools.  They  didn’t  need  to  because 
the  householders  were  the  wealthy  folks.  But  they 
said,  if  we  don’t  educate  our  people,  we’ll  destroy 
our  way  of  life. 

Somebody  who  says,  “I  don’t  want  to  use  the 
schools,”  should  not  have  the  choice  of  deciding  I’m 
not  going  to  pay  my  taxes  for  the  schools.  Our  soci- 
ety has  decided  we  want  educated  people,  and  we 
will  always  have  some  ignorant  people  who  don’t 
want  ail  people  to  be  educated.  And,  of  course,  citi- 
zens should  play  an  active  role  in  decisions  about 
our  schools. 

MS-  Do  you  think  that  government  should  intervene  and 
support  schools  that  have  very  low  tax  bases  and  are 
very  impoverished?  Do  we  have  a moral  responsi- 
bility? 

JG-  We  have  a moral  responsibility.  The  trouble  is,  there 
are  communities  with  better  roads,  better  parks,  bet- 
ter museums,  better  everything.  So  in  New  York  City, 
the  people  pay  about  $7,00C  per  year  per  pupil.  In 
Long  Island  communities,  it’s  about  $15,000  per 
pupil.  Then  you  look  at  the  educational  differences. 
There  are  children  who  go  through  the  New  York 
and  Chicago  and  Philadelphia  schools  who  never 
have  a full-time  teacher.  They  just  have  a series  of 
substitutes.  There  are  people  who  go  through  and 
never  have  a fully-qualified  teacher.  That  doesn’t 
occur  in  affluent  communities. 

MS-  But  doesn’t  that  conflict  with  what  you  just  said? 

JG-  It  creates  unfinished  business.  So  far  we  have  not 
been  able  to  provide  equity  and  we  are  not  in  a mood 
right  now  as  a nation  to  do  it.  I suppose  that  there 
always  will  be  inequities  but  we  cannot  morally  or 
economically  afford  inequities  in  regard  to  access  to 
education. 

MS-  Do  you  think  that  educators  are  too  entrenched  in 
the  current  system  to  be  effective  change  agents? 

JG-  Sure,  they’ re  entrenched,  but  there’s  no  one  else  who 
can  do  it.  There  are  always  people  who  won’t  accept 
change.  I want  to  come  back  to  my  point,  and  it’s 


veiy  hard  to  get  this  across.  There  must  be  an  agenda. 
People  buy  into  that  agenda.  There  are  19  proposi- 
tions in  our  agenda.  There  are  about  90  conditions 
that  have  to  be  in  place.  They  agree  to  do  that.  That’s 
what  they  are  working  on.  To  effect  change,  those 
involved  must  have  a mission  and  an  agenda. 

MS-  If  you  could  synthesize  your  agenda  to  the  three  or 
four  of  the  most  important  tenets,  what  would  they 
be? 

JG-  You  have  to  have  all  of  them.  They  are  a package. 
It’s  silly  to  think  you  can  do  it  without  all  of  them. 
There’s  a wonderful  study  out  by  an  organization  in 
New  York.  They  studied  four  cities  that  had  money, 
enthusiasm  and  the  desire  to  change.  They  don’t  name 
them  because  it  was  a complete  disaster.  The  people 
all  sat  down,  they  had  money  and  they  said  what  are 
we  going  to  do?  And  after  a few  meetings  they  were 
fighting  with  one  other.  They  never  got  anything 
done  because  they  did  not  have  an  agenda. 

There’s  not  one  successful  education  program  in  this 
country  that  doesn’t  have  an  agenda.  Ted  Sizer  has 
an  agenda.  Jim  Comer  has  an  agenda.  Howard 
Gardner  has  an  agenda.  Hank  Levin  has  an  agenda. 
We  have  an  agenda.  These  are  the  only  successful 
programs  in  the  U.S.  All  of  this  other  floundering 
around  without  an  agenda  is  a waste  of  time. 

MS-  What  do  you  think  are  the  most  overwhelming  is- 
sues in  education  today?  If  you  could  change  one 
thing  about  the  current  educational  system,  what 
would  that  be? 

JG-  The  most  overwhelming  educational  issue  is  a con- 
text; it’s  a social  context  in  which  we  are  living  to- 
day in  a democracy  that  has  given  us  permission  to 
be  greedy,  divisive,  and  selfish,  and  little  of  our  lead- 
ership is  telling  us  otherwise.  That’s  a little  harsh, 
maybe,  but  everything  that  was  done  for  a period  of 
time  was  really  built  around,  “I’ll  get  mine  first,  then 
I’ll  take  care  of  my  neighbor”.  That  is  the  most  seri- 
ous thing  because  it  is  now  invading  the  schools  and 
it  is  very  difficult  for  schools  to  achieve  their  public 
purpose  when  everybody  views  schools  as  their  pri- 
vate domain,  their  private  park,  their  private  road, 
their  private  water  system,  their  private  sewage  sys- 
tem. That  is  our  major  problem. 

Related  to  that  is  the  misbegotten  idea  that  the  suc- 
cess and  failure  of  this  country  is  directly  related  to 
our  schools  when  some  of  the  most  schooled  people 
in  the  U.S.  have  made  the  most  stupid  decisions.  Did 
we  fall  behind  Japan  in  the  automobile  industry  be- 
cause of  our  school  system  or  because  of  the  people 
running  General  Motors  and  Ford  who  went  on  build- 
ing  those  big  cars  when  it  was  obvious  tliat  the  Ameri- 
can people  weren’t  buying  them?  It  wasn’t  until  the 


CEO’s  looked  down  at  the  parking  lots  of  their  own 
workers  and  saw  more  Japanese  cars  than  American 
cars  that  they  began  to  wake  up.  So,  now  we’re  build- 
ing automobiles  as  good  as  the  Japanese  are. 

Five  or  six  years  ago  there  was  a survey  of  the 
American  people,  and  the  survey  asked  a couple  of 
critical  questions.  One,  “Which  country  is  the  num- 
ber one  economic  power  in  the  world?”  Japan  came 
out  first.  The  second  question:  “Is  this  situation  going 
to  change  in  the  foreseeable  future?”  No.  They  gave 
the  same  questionnaire  last  year.  Which  is  the  most 
powerful,  potent  economic  force  in  the  world?  The 
United  States,  Is  it  going  to  remain  so?  Yes.  Now, 
were  there  any  newspaper  headlines  saying  the 
schools  must  be  good  because  now  we  have  a good 
economic  system  and  we  believe  in  it?  No,  not  one 
news  headline. 

So,  the  point  is,  that  didn’t  have  anything  to  do 
with  anything.  Test  scores  didn’t  go  up  much  enough 
to  affect  anything.  Whoever  got  the  idea  that  SAT 
scores  had  anything  whatsoever  to  do  with  economic 
competition?  In  the  long,  long  run,  uneducated 
people  will  do  their  work  well,  but  a good  society  has 
good  schools,  not  the  other  way  around.  I do  not 
know  one  society  that  became  good  because  of  its 
schools.  But  I know  lots  of  societies  with  good  schools 
because  they  were  good  societies.  That’s  the  way  we 
were,  and  now  we  are  in  very  serious  danger  of  be- 
coming a not  very  nice  society  and  we  won’t  have 
good  schools. 

MS-  Any  last  thoughts  about  the  teaching  profession? 

JG-  What  differs  teaching  from  every  other  profession  in 
the  world  is  that  everything  you  have  and  know,  you’re 
giving  away.  It’s  the  only  profession  that  does  that. 
You  teach  it,  you  give  it  away.  The  others  are  all  prac- 
ticing their  techniques  and  skills  on  a patient  or  a 
car.  With  us,  we’re  giving  it  away  like  we  have  all 
the  time.  So,  you’ve  got  to  recharge  your  battery. 
You’ve  got  to  renew  yourself  all  the  time. 

Education  is  really  at  the  root  of  everything.  People 
in  education  are  the  kind  of  people  that  I want  to  be 
associated  with.  I want  to  be  thoughtful,  I want  to 
read,  and  I want  to  learn.  I hope  that  you  realize 
every  morning  when  you  wake  up  you  can  say,  “I’m 
in  the  best  job  on  earth.” 

Tiblel 

Nineteen  Postulates  Necessary  for  the  Simultaneous 
Renewal  of  Schools  and  the  Education  of  Educators 

Postulate  One.  Programs  for  the  education  of  the  nation’s 
educators  must  be  viewed  by  the  institutions  offering  them 
as  a major  responsibility  to  society  and  be  adequately  sup- 
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ported  and  promoted  and  vigorously  advanced  by  the 
institution’s  top  leadership. 

Postulate  Two.  Programs  for  the  education  of  educators 
must  enjoy  parity  with  other  professional  education  pro- 
grams, full  legitimacy  and  institutional  commitment,  and 
rewards  to  faculty  geared  to  the  nature  of  the  field. 

Postulate  Three.  Programs  for  the  education  of  educators 
must  be  autonomous  and  secure  in  their  borders,  with  clear 
organizational  identity,  constancy  of  budget  and  personnel, 
and  decision-making  authority  similar  to  that  enjoyed  by 
the  major  professional  schools. 

Postulate  Four.  There  must  exist  a clearly  identifiable  group 
of  academic  and  clinical  faculty  members  for  whom  teacher 
education  is  the  top  priority;  the  group  must  be  responsible 
and  accountable  for  selecting  diverse  groups  of  students  and 
monitoring  their  progress,  planning  and  maintaining  the 
full  scope  and  sequence  of  the  curriculum,  continuously 
evaluating  and  improving  programs,  and  facilitating  the 
entry  of  graduates  into  teaching  careers. 

Postulate  Five.  The  responsible  group  of  academic  and  clini- 
cal faculty  members  described  above  must  have  a compre- 
hensive understanding  of  the  aims  of  education  and  the  role 
of  schools  in  our  society  and  be  fully  committed  to  selecting 
and  preparing  teachers  to  assume  the  full  range  of  educa- 
tional responsibilities  required. 

Postulate  Six.  The  responsible  gToup  of  academic  and  clini- 
cal faculty  members  must  seek  out  and  select  for  a predeter- 
mined number  of  student  places  in  the  program  those  can- 
didates who  reveal  an  initial  commitment  to  the  moral,  ethi- 
cal, and  enculturating  responsibilities  to  be  assumed,  and 
to  make  clear  to  them  that  preparing  for  these  responsibili- 
ties is  central  to  this  program. 

Postulate  Seven.  Programs  for  the  education  of  educators, 
whether  elementary  or  secondary,  must  carry  the  responsi- 
bility to  ensure  that  all  candidates  progressing  through  them 
possess  or  acquire  the  literacy  and  critical-thinking  abili- 
ties associated  with  the  concept  of  an  educated  person. 

Postulate  Eight.  Programs  for  the  education  of  educators 
must  provide  extensive  opportunities  for  future  teachers  to 
move  beyond  being  students  of  organized  knowledge  to  be- 
come teachers  who  inquire  into  both  knowledge  and  its 
teaching. 

Postulate  Nine.  Programs  for  the  eduction  of  educators 
must  be  characterized  by  a socialization  process  through 
which  candidates  transcend  their  self-oriented  student  pre- 
occupations to  become  more  other-oriented  in  identifying 
with  a culture  of  teaching. 

Postulate  Ten.  Programs  for  the  education  of  educators 
must  be  characterized  in  all  respects  by  the  conditions  for 
learning  that  future  teachers  arc  to  establish  in  their  own 
schools  and  classrooms. 


Postulate  Eleven.  Programs  for  the  education  of  educators 
must  be  conducted  in  such  a way  that  future  teachers  in- 
quire into  the  nature  of  teaching  and  schooling  and  assume 
that  they  will  do  so  as  a natural  aspect  of  their  careers. 

Postulate  Twelve.  Programs  for  the  education  of  educators 
must  involve  future  teachers  in  the  issues  and  dilemmas 
that  emerge  out  of  the  never-ending  tension  between  the 
rights  and  interests  of  individual  parents  and  interest  groups 
and  the  role  of  schools  in  transcending  parochialism  and 
advancing  community  in  a democratic  society. 

Postulate  Thirteen,  Programs  for  the  education  of  educa- 
tors must  be  infused  with  understanding  of  and  commit- 
ment to  the  moral  obligation  of  teachers  to  ensure  equitable 
access  to  and  engagement  in  the  best  possible  K-12  educa- 
tion for  all  children  and  youths. 

Postulate  Fourteen.  Programs  for  the  education  of  educa- 
tors must  involve  future  teachers  not  only  in  understanding 
schools  as  they  are  but  in  alternatives,  the  assumptions  un- 
derlying alternatives,  and  how  to  effect  needed  changes  in 
school  organization,  pupil  grouping,  curriculum,  and  more. 

Postulate  Fifteen.  Programs  for  the  education  of  educators 
must  assure  for  each  candidate  the  availability  of  a wide 
array  of  laboratory  settings  for  simulation,  observation, 
hands-on  experiences,  and  exemplary  schools  for  intern- 
ships and  residencies;  they  must  admit  no  more  students  to 
their  program  than  can  be  assured  these  quality  experiences. 

Postulate  Sixteen.  Programs  for  the  education  of  educa- 
tors must  engage  future  teachers  in  the  problems  and  di- 
lemmas arising  out  of  the  inevitable  conflicts  and  incon- 
gruities between  what  is  perceived  to  work  in  practice  and 
the  research  and  theory  supporting  other  options. 

Postulate  Seventeen. 

Programs  for  the  education  of  educators  must  establish  link- 
ages with  graduates  for  the  purposes  to  both  evaluating  and 
revising  these  programs  and  easing  the  critical  early  years 
of  transition  and  teaching. 

Postulate  Eighteen. 

Programs  for  the  education  of  educators  require  a regula- 
tory context  with  respect  to  licensing,  certifying,  and  ac- 
crediting that  ensures  at  all  times  the  presenceof  the  necessary 
conditions  embraced  by  the  seventeen  preceding  postulates. 

Postulate  Nineteen.  Programs  for  the  education  of  educa- 
tors must  compete  in  an  arena  that  rewards  efforts  to  con- 
tinuously improve  on  the  conditions  embedded  in  all  of  the 
postulates  and  tolerates  no  shortcuts  intended  to  ensure  a 
supply  of  teachers. 
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Abstract 

The  purpose  of  this  research  was  to  investigate  the  relationship  of  selected  variables  to 
student  achievement  Data  on  instructional  leadership,  involvement , order,  instruction,  expecta- 
tion, collaboration , environment,  socioeconomic  status  level,  and  student  achievement  were  col- 
lected from  27  schools.  The  instrumentation  used  to  collect  the  data  were  the  Tennessee  School 
Climate  Inventory  (which  yields  a school  climate  score),  the  California  Test  of  Basic  Skills  (CTBS), 
and  a student  free  and  reduced  lunch  count. 

A significant  positive  correlation  (r(25)  = .52,  p < .01)  was  found  between  school  climate 
and  student  achievement  and  between  student  achievement  and  the  socioeconomic  status  of  students 
(r(25)  - .41,  p < .05).  . A significant  positive  correlation  (r(25)  = .49,  p < .01)  was  also  found 
between  the  involvement  subscale  of  the  climate  instrument  and  student  achievement.  Of  all  the 
variables  investigated,  it  would  appear  that  the  involvement  of  parents  and  the  community  has  the 
strongest  relationship  to  student  achievement. 

We  concluded  that  school  climate  scores  can  be  just  as  helpful  as  the  socioeconomic  status 
of  students  in  predicting  student  achievement.  Further,  high  achievement  is  possible  in  elementary 
schools  that  have  a large  number  of  students  of  low  socioeconomic  status.  Finally,  our  data  support 
the  notion  that  schools  with  a high  proportion  of  students  of  low  socioeconomic  status  can  have  a 
healthy  school  climate. 


The  cause  for  varying  levels  of  achievement  in 
schools  has  frequently  been  the  subject  of  investigation.  The 
Coleman  (1966)  report,  which  stated  that  the  best  predictor 
of  student  achievement  is  the  socioeconomic  status  of  the 
parents,  led  to  a fluny  of  investigations  on  student  achieve- 
ment. The  effective  schools  research  and  school  climate 
research  came  on  the  heels  of  the  Coleman  report  because 
researchers  refused  to  accept  its  findings.  Of  course,  not 
everyone  agreed  with  the  results  or  interpretations  of  this 
research.  Houlihan  (1988)  believed  that  researchers  have 
overanalyzed  and  victimized  schools  by  ridiculous  statisti- 
cal interpretation.  He  stated,  “Statistical  data  have  been 
carried  to  the  ultimate  in  silliness”  (p.  10).  Many  educa- 
tors would  agree  with  Houlihan,  particularly  when  achieve- 
ment scores  are  involved.  Nevertheless,  the  push  goes  on 
to  recognize  students,  teachers,  administrators,  and  schools 
for  outstanding  achievement.  It  would  be  helpful  if  there 
were  a better  indicator  than  the  socioeconomic  status  of  stu- 
dents to  predict  in  advance  which  schools  would  be  likely 
to  have  high  or  low  achievement.  The  socioeconomic  sta- 
tus of  students  is  extremely  difficult  to  change  whereas  an- 
other variable  might  not  be. 

The  purpose  of  this  research  was  to  investigate  any 
relationships  which  might  exist  between  student  achieve- 
ment and  possible  predictor  variables.  Predictor  variables 
investigated  were  the  following:  effective  school  variables, 
school  climate  variables,  and  the  socioeconomic  status  of 
students.  A second  purpose  was  to  investigate  which  vari- 
ables are  the  most  important  for  student  achievement. 


In  order  to  provide  a theoretical  framework  for  this 
project,  the  authors  reviewed  the  research  on  effective  schools 
and  school  climate.  The  literature  review  is  a summary  of 
findings  in  these  two  areas  because  research  in  the  two  fields 
is  so  extensive.  The  authors  will  address  the  research  on 
the  relationship  of  socioeconomic  status  to  achievement  first, 
and  then  follow  with  the  research  on  effective  schools  and 
school  climate.  Hopefully,  this  will  give  the  reader  a better 
understanding  of  those  factors  which  have  a relationship 
with  achievement. 

The  Coleman  (1966)  report  was  a landmark  study 
which  documented  that  the  socioeconomic  status  of  students 
is  the  best  predictor  of  student  achievement.  The  research 
of  Metz  (1988)  and  Chubb  and  Moe  (1990)  also  found  that 
the  socioeconomic  status  of  students  is  important  for  achieve- 
ment. Chubb  and  Moe’s  research  was  based  on  data  gath- 
ered from  20,000  students  and  500  schools  nationwide.  Of 
significance  was  the  finding  that  the  socioeconomic  status 
of  students  and  the  organization  of  the  school  in  terms  of 
goals,  leadership,  personnel,  and  practice,  had  an  equal  in- 
fluence on  student  achievement. 

The  effective  schools  research,  as  reviewed  in 
Malluck(1987),  Cruickshank  (1990),  and  Bliss,  etal.  (1991), 
identified  many  variables  which  are  relevant  for  student 
achievement.  While  there  are  differences  in  the  variables 
depending  on  the  researcher,  there  is  agreement  on  a core 
group  of  variables  which  are  relevant  for  student  achieve- 
ment. They  arc:  orderly  climate,  leadership,  expectations, 
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frequent  monitoring  of  instruction  or  assessment,  parent  and 
community  involvement,  and  instruction.  Other  variables 
which  researchers  cite  as  important  for  achievement  are  the 
following:  site-based  management,  staff  stability,  staff  de- 
velopment, collaboration,  time-on-task,  and  sense  of  mis- 
sion. 

Critics  of  the  effective  schools  research  stated  that 
most  of  the  data  collected  was  from  poor  urban  schools  and 
students  of  low  socioeconomic  status  and  that  the  research 
was  methodologically  flawed  (Bliss,  et  al.,  1991;  Firestone, 
1991;  Good  & Brophy,  1986;  Purkey&  Smith,  1983).  An- 
other critic  (Matluck,  1987)  suggested  that  the  definition  of 
terms  was  a flaw’  in  the  research  because  methodologically 
similar  studies  used  the  same  terms,  but  lacked  agreement 
on  the  meaning  of  the  terms,  e.g.  climate,  leadership,  and 
high  expectations.  Despite  this  criticism,  there  is  consider- 
able support  for  the  premise  that  effective  schools  improve 
student  achievement. 

Acknowledgement  of  the  role  of  school  climate  in 
improving  student  achievement  has  also  received  widespread 
support  (Agnew,  1981;  Anderson,  1982;  Brookover,  et  al., 
1977;  Howe,  1985;  Keefe,  et  al.,  1985;  Lezotte,  Hathaway 
&Miller,  1980;  Montoya,  1990;  Parades,  1991;  Stickard,  et 
al.,  1986;  Strong  & Jones,  1991).  The  works  of  Brookover, 
etal.  (1979),Rutter(1981),  Rutter,  etal.  (1979),  and  Wynne 
(1980,  cited  in  Purkey  & Smith,  1983)  were  used  to  justify 
the  statement  that  a school’s  climate  influences  a student’s 
chance  for  success.  Ralph  and  Fennessey  (1983),  in  dis- 
cussing Brookover ’s  (1979)  work,  stated  that  school  climate 
variables  may  be  the  effect  or  the  cause  of  changes  in  other 
variables,  e.g.  achievement.  Hoyle,  English,  and  Stefiy 
(1985)  stated,  “School  climate  may  be  one  of  the  most  im- 
portant ingredients  of  a successful  instructional  program. 
Without  a climate  that  creates  a harmonious  and  well-func- 
tioning school,  a high  degree  of  academic  achievement  is 
difficult,  if  not  downright  impossible  to  obtain”  (p.  15).  Fi- 
nally, Sweeney  (1988)  wrote,  “A  winning  school  climate 
provides  the  very  foundation  for  a sound  educational  pro- 
gram. When  the  climate  is  right,  people  are  inspired  to  do 
their  best.  Teachers  and  students  ...  do  what  needs  to  be 
done  to  stimulate  learning.  Achievement  generally  rises” 
(p.  1). 

Several  studies  did  not  show  a significant  positive 
relationship  between  climate  and  achievement.  Culpepper 
(1993)  gathered  data  from  698  teachers  in  41  elementary 
schools.  She  used  the  school  as  the  unit  of  analysis  and 
found  no  significant  relationships  between  climate  and  read- 
ing and  math  achievement.  Montoya  ( 1 990)  collected  data 
from  two  schools  and  eight  classes  of  sixth  graders.  She 
also  found  no  relationship  with  climate  and  achievement. 

While  there  is  a great  deal  of  agreement  that  school 
climate  is  important  for  achievement,  critics  state  that  there 
is  very  little  agreement  on  the  definition  of  school  climate. 


Arter  (1989)  wrote,  “As  with  many  other  concepts  in  edu- 
cation, there  is  no  unanimous  agreement  as  to  exactly  what 
constitutes  school  or  classroom  climate”  (p.  2).  Stronge 
and  Jones  (1991)  stated,  “School  climate  is  a term  which 
we  tend  to  intuitively  understand,  but  one  for  which  there  is 
no  single  accepted  definition”  (p.4 1).  In  the  effective  schools 
research,  school  climate  is  usually  called  a safe  orderly  en- 
vironment. In  Brookover,  et  al.  (1979),  school  climate  re- 
fers to  pupil  efficacy  and  pupils’  and  principals’  percep- 
tions of  others’  behavior.  Hoyle,  et  al.  (1985)  defined  cli- 
mate as  “the  environment  of  the  school  as  perceived  by  its 
students,  staff,  and  patrons.  It  is  the  school’s  ‘personality’” 
(p.  15).  Lezotte,  et  al.  (1980)  included  physical  attributes 
such  as  heat,  light,  and  noise;  psychological  attributes  such 
as  satisfaction,  morale,  trust,  openness,  and  cooperation; 
and  institutional  attributes  such  as  norms,  beliefs,  and  atti- 
tudes. Sergiovanni  and  Starratt  (1993)  stated  that  climate 
can  be  view-ed  as  “the  enduring  characteristics  which  de- 
scribe the  psychological  character  of  a particular  school” 
(P- 82). 

Ellis  (1988)  stated  that  school  climate  consists  of 
subjective  and  objective  indicators  which  give  an  overall 
feel  for  a school.  Perhaps  Lezotte  and  Ellis  are  talking  about 
the  same  thing.  Are  psychological,  physical,  and  institu- 
tional attributes  also  subjective  and  objective  indicators?  To 
resolve  this  question,  the  authors  developed  a definition 
which  incorporates  many  of  the  above  ideas. 

Definition 

The  definition  of  school  climate  that  was  used  for 
the  purpose  of  this  research  is  “the  perception  someone  has 
about  the  psychological  and  institutional  attributes  of  an 
organization  or  those  psychological  and  institutional  at- 
tributes which  give  an  organization  its  personality.”  The 
physical  attributes  of  school  climate  were  not  included  be- 
cause there  is  little  evidence  to  show  that  they  affect  school 
climate. 

In  order  to  operationalize  school  climate,  the  Ten- 
nessee School  Climate  Inventory  (TSCI)  (Butler  and  Albeig, 
1991)  was  chosen.  It  has  seven  subscales  which  measure 
order,  leadership,  environment,  involvement,  instruction, 
expectations,  and  collaboration.  Each  subscale  consists  of 
descriptions  of  seven  behaviors  which  make  up  that  subscale. 
The  TSCI  was  chosen  as  the  measure  of  school  climate  be- 
cause it  provides  data  on  five  of  the  six  variables  frequently 
identified  in  the  effective  school  research.  These  variables 
are  the  following:  order,  leadership,  instruction,  involve- 
ment, and  expectation.  The  other  two  variables  of  the  TSCI 
are  environment  and  collaboration.  These  variables  are  more 
frequently  found  in  the  climate  domain.  Both  the  effective 
schools  and  school  climate  domains  provide  research  sup- 
port which  shows  that  they  arc  important  for  student  achieve- 
ment. Consequently,  it  was  believed  by  the  authors  that  an 
instrument  which  measured  both  domains  to  some  extent 
would  prove  useful  for  this  research. 


Definitions  of  the  variables  are  as  follows.  The 
first  five  are  effective  schools  variables  and  tend  to  measure 
the  institutional  attributes  of  school  climate.  Environment 
and  collaboration  tend  to  measure  the  psychological  at- 
tributes of  school  climate. 

Order:  the  extent  to  which  the  environment  is 

ordered  and  appropriate  behaviors  are 
present. 

Leadership : the  extent  to  which  the  administration 

provides  instructional  leadership. 

Involvement : the  extent  to  which  parents  and  the  com- 

munity are  involved  in  the  school. 

Instruction:  the  extent  to  which  the  instructional  pro- 

gram is  developed  and  implemented. 

Expectations:  the  extent  to  which  students  are  expected 
to  learn  and  to  be  responsible. 

Environment:  the  extent  to  which  a positive  learning 
enviionment  exists. 

Collaboration:  the  extent  to  which  the  administration, 
faculty,  and  students  cooperate  and  par- 
ticipate in  problem-solving. 


Hypotheses 

The  literature  review  of  effective  schools  and  cli- 
mate research  shows  that  a number  of  variables  are  impor- 
tant for  student  achievement.  The  TSCI  measures  much  of 
the  domain  cited  as  important  for  student  achievement  with 
the  exception  of  students’  socioeconomic  status.  Conse- 
quently, the  hypotheses  were  as  follows: 

1 . There  is  a significant  positive  relationship  between 
school  climate  scores  as  measured  by  the  TSCI  and  student 
achievement  as  measured  by  the  California  Test  of  Basic 
Skills  (CTBS). 

2.  There  is  a significant  positive  relationship  between 
the  socioeconomic  status  of  students  and  student  achieve- 
ment. 

Because  both  socioeconomic  status  and  school  cli- 
mate have  been  shown  to  have  an  effect  on  student  achieve- 
ment, an  additional  hypothesis  was  the  following: 

3 . There  is  a significant  positive  relationship  between 
the  socioeconomic  status  of  a school’s  students  and  the 
school’s  climate  score. 

Procedures 

Subjects 

Six  hundred  and  eleven  (611)  teachers  and  princi- 
pals from  twenty-seven  elementary  schools  in  Western  Ken- 
tucky were  involved  in  the  study.  The  principals  of  all  of 
the  schools  volunteered  to  participate  in  the  study  with  the 
condition  that  they  would  be  provided  a profile  of  their 
school.  The  schools  varied  in  size  ranging  from  a low  of  93 
pupils  to  a high  of 700  pupils.  The  populations  of  the  schools 
were  primarily  Caucasian  of  upper-low  er  to  lower-middle 
class.  Overall  the  sample  for  this  study  is  representative  of 
the  schools  in  Kentucky  and  w ould  be  representative  of  most 
populations  except  for  large  urban  schools  and  schools  with 
a high  proportion  of  minority  students. 


Instrumentation 

The  TSCI  was  the  instrument  selected  for  this  study 
based  on  the  reasons  cited  earlier.  Reliability  data  on  the 
TSCI  using  the  Cronbach  alpha  or  measure  of  rationale 
equivalence  was  an  average  of  +.80  for  the  seven  subscales 
(Butler  & Alberg,  1991). 

The  TSCI  has  seven  subscales  which  measure  or- 
der, leadership,  environment,  involvement,  instruction,  ex- 
pectations, and  collaboration.  Each  subscale  has  seven 
behaviors  for  a total  of  49  items  or  behaviors  which  are 
measured.  It  measures  the  same  domain  as  the  effective 
schools  research  except  for  frequent  monitoring  of  instruc- 
tion and  student  time-on-task.  It  also  measures  collabora- 
tion and  environment,  two  variables  more  commonly  found 
in  the  climate  domain. 

In  addition  to  the  climate  data,  data  were  also  col- 
lected on  achievement  using  the  California  Test  of  Basic 
Skills  (CTBS)  and  on  the  socioeconomic  status  (SES)  of  the 
students.  The  SES  of  students  was  determined  by  counting 
the  number  of  students  on  free  and  reduced  lunch.  While 
this  may  not  be  the  best  measure  of  a student’s  socioeco- 
nomic status,  it  was  within  the  scope  of  this  study.  Chubb 
et  al.  (1990)  reported  that  parents’  education  and  income 
were  the  most  important  socioeconomic  variables  for  deter- 
mining the  performance  of  students.  This  study  will  only 
look  at  the  income  level  as  measured  by  free  and  reduced 
lunch  counts.  The  failure  to  gather  data  on  the  education  of 
the  parents  is  a limitation  of  this  study  in  terms  of  testing 
hypothesis  2. 

The  unit  of  analysis  for  climate,  achievement,  and 
the  socioeconomic  status  of  students  was  the  school.  The 
rationale  for  this  decision  was  that  as  the  climate  score  rep- 
resented all  of  the  respondents’  opinions,  i.e.  the  entire 
school,  there  would  have  to  be  a score  for  the  entire  school 
in  the  other  areas  as  well.  Thus  there  was  one  score  for  the 
whole  school  in  each  of  these  areas:  school  climate,  each  of 
the  climate  subscales,  student  achievement,  and  number  of 
free  and  reduced  lunches.  The  statistical  technique  used  to 
analyze  the  data  was  the  Pearson  product  moment  correla- 
tion. 

Results 

The  overall  school  climate  scores  were  correlated 
with  the  achievement  scores.  The  mean  climate  score  was 
25.3  with  a standard  deviation  of  2.32.  The  mean  achieve- 
ment score  was  59.54  with  a standard  deviation  of  .46.  A 
positive  correlation  of  +.5 17  was  found  between  the  school 
climate  and  student  achievement  scores.  The  correlation 
was  significant  at  the  .01  level.  Hypothesis  1 was  sup- 
ported. There  is  a significant  positive  relationship  between 
school  climate  and  achievement. 
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The  reduced  and  free  lunch  count,  which  served  as 
a measure  of  the  socioeconomic  status  of  students  for  each 
school,  ranged  from  a low  of  14.3%  of  the  students  to  a 
high  of  70%.  The  mean  free  and  reduced  lunch  count  was 
40.5%  with  a standard  deviation  of  12.98.  There  was  a 
wide  range  of  socioeconomic  levels  with  most  schools  fall- 
ing into  the  medium  to  low  socioeconomic  levels.  A posi- 
tive correlation  of  +.409  w'as  found  betw  een  student  achieve- 
ment and  socioeconomic  status.  It  was  significant  at  the 
.05  level.  Hypothesis  2 was  supported.  There  is  a signifi- 
cant positive  relationship  between  the  socioeconomic  status 
of  students  and  achievement. 

A negative  correlation  of  -.064  (not  significant) 
was  found  between  the  overall  school  climate  score  and  so- 
cioeconomic status.  Hypothesis  3 was  not  supported. 
There  is  no  relationship  between  school  climate  and  the 
socioeconomic  status  of  students. 

Climate  subscale  scores  for  each  of  the  schools  were 
correlated  with  achievement  scores.  With  25  degrees  of 
freedom,  a correlation  of +.38  is  required  at  the  .05  level  of 
confidence,  and  .49  at  the  .01  level.  Only  two  of  the  subscales 
were  significantly  correlated  with  achievement  scores.  The 
subscale  titled  “involvement”  had  a correlation  of  r(25)  = 
.49,  p < .01  and  the  subscale  titled  “instruction”  had  a cor- 
relation of  r(25)  = .39,  p < .05. 

Discussion 

The  finding  that  there  is  a significant  positive  re- 
lationship between  achievement  and  school  climate  is  en- 
couraging. Even  more  encouraging  is  the  fact  that  the  rela- 
tionship between  school  climate  and  achievement  is  stron- 
ger than  the  relationship  between  achievement  and  the  so- 
cioeconomic status  of  the  students.  This  is  encouraging 
because  school  climate  scores  can  be  raised  whereas  the  so- 
cioeconomic status  of  the  students  is  difficult  to  change. 

In  related  research,  Benton  and  Bulach  (1994)  de- 
veloped a school  improvement  plan  designed  to  improve 
school  climate  subscale  scores.  The  TSCI  data  were  col- 
lected in  October  1993,  the  improvement  plan  was  imple- 
mented to  address  specific  subscale  weaknesses,  and  the 
TSCI  was  again  administered  in  April  1994.  A significant 
improvement  in  the  collaboration  (p  < .05)  and  involve- 
ment (p  < .05)  subscales  occurred.  Collaboration  and  in- 
volvement were  two  areas  of  weakness  in  the  overall  cli- 
mate of  the  school  which  were  targeted  in  the  school  im- 
provement plan.  This  provides  support  for  the  above  state- 
ment that  school  climate  scores  can  be  improved. 

The  strongest  correlation  for  the  subscales  with 
achievement  was  the  involvement  subscale  (r(25)  = .49,  p < 
.01).  This  finding  supports  the  research  of  Anderson  ( 1 994), 
Marcon  (1993),  and  Snodgrass  (1991).  The  importance  of 
involving  students,  parents  and  the  community  in  the  school 
can  not  be  overlooked  as  a significant  factor  related  to  stu- 


dent achievement.  It  also  adds  further  support  for  the  role 
of  school-based  decision-making  and  the  feeling  of  com- 
munity w'hich  Sergiovanni,  et  al.  (1993)  advocate  in  their 
latest  book  on  supervision. 

The  involvement  subscale  was  follow’ed  by  the  in- 
struction subscale  in  terms  of  its  relationship  with  achieve- 
ment scores.  The  seven  behaviors  in  this  subscale  deal  with 
teaching  and  evaluation  methodology.  It  follows  that  there 
should  be  a relationship  between  achievement  and  instruc- 
tion if  teachers  actually  exhibit  the  behaviors  measured  by 
this  scale,  e.g.,  use  a variety  of  teaching  strategies;  sequence 
learning  activities  so  students  can  experience  success;  de- 
velop higher-order  thinking  skills,  etc.  As  a matter  of  fact, 
we  expected  this  relationship  to  be  the  highest  with  achieve- 
ment. The  fact  that  it  was  not  may  be  indicative  of  the  fact 
that  teachers  say  they  do  these  things  when  that  may  not 
always  be  the  case. 

There  was  a surprise  with  the  remaining  subscales. 
While  they  are  all  positively  correlated  with  achievement, 
we  had  expected  the  leadership  subscale  r = .24  to  be  much 
higher.  This  finding  was  somewhat  disturbing  because 
Bulach  and  Malone  (1994)  found  a correlation  of  +.90  be- 
tween scores  on  the  leadership  subscale  and  the  overall  cli- 
mate score.  This  indicated  that  the  principal  is  a strong 
force  in  the  overall  picture  of  school  climate.  The  score  on 
the  leadership  subscale  should  be  an  accurate  predictor  of 
the  overall  school  climate  score  and  a less  accurate  predic- 
tor of  the  school’s  achievement  scores.  That  it  did  not  hap- 
pen in  this  study  could  be  explained  by  the  fact  that  the 
principals  in  Kentucky  are  currently  leading  a massive  re- 
form movement  which  could  detract  from  instructional  lead- 
ership, thereby  causing  the  low  correlation. 

As  in  the  studies  of  Coleman  (1969),  Metz  (1988), 
and  Chubb,  et  al.  (1990),  this  research  verified  that  the  so- 
cioeconomic status  of  students  is  a factor  in  their  achieve^ 
ment  level.  However,  schools  with  a large  number  of  low 
socioeconomic  status  students  can  achieve  at  high  levels. 
As  a matter  of  fact,  the  school  in  this  study  with  the  highest 
achievement  scores  had  43.7%  of  its  students  on  free  or 
reduced  lunch.  Of  course  the  school  with  the  highest  per- 
centage of  free  and  reduced  lunches  also  had  the  lowest 
achievement  scores.  The  relationship  is  definitely  there, 
but  it  is  not  as  strong  as  once  thought.  Schools  with  stu- 
dents who  have  a low  socioeconomic  status  can  achieve  at 
high  levels.  The  reader  needs  to  keep  in  mind  that  this 
research  was  done  in  elementary  schools.  Mayer  and  Jencks 
( 1 989)  stated  that  little  is  known  about  the  effect  of  SES  on 
student  achievement  in  the  elementary  schools.  This  re- 
search provides  evidence  that  high  achievement  in  elemen- 
tary schools  with  low  SES  students  is  possible. 

That  may  not  be  possible  at  the  high  school  level. 
The  work  of  Metz  (1988)  paints  a very  dismal  picture  of 
achievement  levels  in  low  SES  high  schools.  She  wrote 


that  students  enter  the  9th  grade  badly  equipped  to  meet  the 
demands  of  a high  school  curriculum  and  that  they  are  deeply 
discouraged  about  their  academic  prospects.  The  work  of 
Mayer  and  Jencks  (1989)  suggests  otherwise.  They  state 
that  the  effect  of  SES  Qn  the  achievement  of  high  school 
students  is  small.  However,  based  on  teaching  and  admin- 
istrative experience  in  inner-city  and  suburban  schools  in 
Cincinnati,  OH,  they  believe  that  once  the  pattern  of  low 
academic  achievement  is  set,  it  may  be  difficult  to  reverse 
even  if  school  climate  is  good. 

This  raises  another  question.  Does  a healthy  school 
climate  lead  to  higher  achievement,  or  Does  high  student 
achievement  lead  to  a healthy  school  climate?  The  work  of 
Metz  would  lead  one  to  believe  that  achievement  provides 
staff*  with  intrinsic  rewards  which  indirectly  leads  to  a 
healthy  school  climate.  Further,  teachers  in  high  SES 
schools  work  hard,  receive  a lot  of  support,  and  take  pride 
and  pleasure  in  their  students’  progress.  The  question  raised 
could  very  well  be  one  of  the  “chicken  or  egg  syndrome.” 
Just  as  you  can’t  have  an  egg  without  a chicken  or  vice 
versa,  you  can’t  have  achievement  without  a healthy  cli- 
mate, or  a healthy  climate  without  student  achievement. 

Perhaps  the  finding  that  there  is  no  relationship 
between  school  climate  scores  and  the  socioeconomic  sta- 
tus of  the  school’s  students  can  shed  some  light  on  this  is- 
sue. Since  there  is  a relationship  between  climate  and 
achievement  and  none  between  climate  and  SES,  it  is  pos- 
sible that  climate  makes  an  independent  contribution  to  stu- 
dent achievement.  Longitudinal  research  focusing  on  school 
improvement  plans  to  improve  school  climate  variables 
might  be  one  way  for  determining  which  school  climate 
variables  have  the  most  effect  on  student  achievement. 

There  are  those  who  might  say  that  it  is  difficult  to 
improve  school  climate  in  schools  where  you  have  a large 
percentage  of  low  SES  students,  e.g.,  to  get  parents  involved, 
maintain  high  expectations,  establish  a safe  orderly  envi- 
ronment, etc.  These  are  all  indicators  of  a healthy  school 
climate,  and  while  it  may  be  more  difficult  in  a school  with 
a high  percentage  of  low  SES  students,  it  can  be  done. 

Summary  and  Conclusions 

This  research  has  continued  the  investigation  on 
indicators  of  effective  schools,  and  it  has  combined  that  area 
of  research  with  the  research  on  school  climate.  This  study 
made  the  following  contributions  to  these  areas  of  research: 

- a research  instrument  which  collects  data  on  both  ef- 
fective schools  and  climate  domains  was  presented; 


evidence  was  provided  that  high  achievement  is  pos- 
sible in  elementary  schools  which  have  low  SES  levels. 

Additionally,  the  data  suggest  that  school  climate 
makes  an  independent  contribution  to  student  achievement 
levels  over  and  above  the  socioeconomic  status  of  students. 
Because  school  climate  scores  can  be  raised,  this  is  very 
encouraging  for  further  research  in  this  area.  The  authors 
believe  that  parent  and  community  involvement  and  the  in- 
structional habits  of  teachers  have  the  strongest  relation- 
ship with  achievement. 


APPENDIX  A 


Building#  Achievement 
Score 

Climate  %On  Free 
Score  & Reduced  Lunch 

27 

73.6 

28.48 

43.7 

3 

70.3 

25.7 

38.5 

23 

66.4 

24.31 

21.6 

24 

66 

24.2 

14.3 

22 

65.2 

25.46 

29.4 

7 

62.4 

27.45 

29.8 

1 

62.3 

27.7 

56.2 

25 

61.8 

28.44 

29.4 

2 

61.4 

27.65 

43.9 

26 

61.3 

24.74 

42.8 

19 

60.7 

24.45 

26.5 

6 

60.5 

28.06 

47.5 

20 

58.7 

23 

56.6 

21 

58.2 

25.98 

27.2 

15 

57.9 

23.86 

68.3 

18 

57.5 

26.23 

44.1 

17 

57.3 

27.25 

56 

5 

57.1 

25.73 

33.3 

9 

57.1 

26.56 

36.7 

14 

56.6 

23.48 

36.9 

10 

56.4 

23.6 

31.5 

16 

56 

21.85 

41 

8 

55.1 

22.27 

38.8 

13 

53.9 

24.79 

37.6 

11 

53.5 

18.24 

40.7 

12 

53.4 

23.22 

51.4 

4 

47 

23.02 

70 

MEAN  59.54 

25.03 

40.51 

SD 

.46 

2.32 

12.98 

- evidence  was  provided  to  establish  that  the  socioeco- 
nomic status  of  students  need  not  be  the  most  impor- 
tant variable  in  determining  student  achievement  level; 
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Book  Review1 
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Faltis,  Christian  J.  (1993).  Joinfostering:  Adapting  Teach- 
ing Strategies  for  the  Multilingual  Classroom.  New 
York:  Macmillan  Publishing  Company.  179  pp.  ISBN 
No  0-675-21326-6  (paper). 

Imagine  that  you  are  the  proprietor  of  the  only  meat 
store  in  a neighborhood  that  from  one  day  to  the  next  went 
from  being  predominantly  Polish-Catholic  to  predominantly 
Jewish.  Over  the  last  twenty  years  you  learned  that  pork- 
based  products  were  best  sellers  among  those  who  patron- 
ized your  store.  Currently,  you  carry  mostly  pork  products. 
After  the  population  shifts,  however,  it  only  takes  you  a few 
days  to  figure  out  that  there  is  a sharp  decline  is  your  sales. 
If  you  wanted  to  increase  your  sales  by  doing  business  with 
the  Jewish  community,  what  would  be  the  logical  thing  to 
do?  Your  best  alternative  would  be  to  learn  about  the  di- 
etary preferences  of  your  new  costumers  and  tailor  your  prod- 
ucts to  meet  their  needs.  You  could,  of  course,  insist  on 
stocking  mostly  pork  products  and  advertise  heavily  to  try 
to  change  your  new  costumers’  dietary  rules.  This  latter 
choice  will  certainly  not  only  make  Jewish  people  feel  un- 
welcome in  your  store  but  also  lead  you  to  bankruptcy. 

In  the  United  States,  teachers  and  schools  are  fac- 
ing a situation  analogous  to  the  one  encountered  by  the  meat 
grocer  described  above.  It  is  a well-known  fact  that  the 
linguistic  and  demographic  characteristics  of  the  recipients 
of  school  services  are  rapidly  changing  and  so  are  the  edu- 
cational needs  that  teachers  must  fulfill.  Unfortunately,  the 
high  attrition  and  underachievement  rates  among  ethnic 
minorities  suggest  that,  unlike  the  grocer  who  wants  to  stay 
in  business  and  changes  the  merchandise  to  meet  the  needs 
of  a new  ethnic  group,  too  many  teachers  insist  on  deliver- 
ing content  and  pedagogy  in  traditional  ways. 

In  this  book,  Christian  Faltis  clearly  articulates  why 
educators  who  insist  on  conducting,  to  use  Sleeter  and 
Grant’s  term  (1993),  “business  as  usual”  are  condemning 
the  social  institution  of  school  to  moral  bankruptcy.  Schools 
that  fail  to  account  for  the  needs  of  second-language  learn- 
ers of  English  (“conservatively  projected  to  reach  3.5  mil- 
lion by  the  year  2000”,  p.  6)  will  not  fulfill  their  fundamen- 
tal role  of  helping  materialize  traditional  democratic  prin- 
ciples for  all  the  children  that  they  are  entrusted  with  by 
parents  and  society  at  large.  Through  a description  of  a 
pedagogical  approach  he  labels  Joinfostering,  Faltis  pro- 
vides educators  a framework  for  instruction  that  refashions 
traditional  all-English  classrooms  to  meet  the  needs  of  sec- 
ond-language learners. 

Faltis  notes  that  Joinfostering  is  not  to  be  under- 
stood as  a set  of  techniques.  Instead,  Joinfostering  is  a com- 


mitment to  creating  classroom  environments  that  provide 
full,  equitable  access  and  integration  for  second-language 
students  and  their  parents,  regardless  of  their  level  of  En- 
glish proficiency.  Taking  a \tygotskian  perspective  on  cog- 
nitive development,  he  notes  the  importance  of  the  social 
context  in  learning  and  argues  for  the  development  of  class- 
room practices  that  give  primacy  to  two-way  communica- 
tive exchanges  that  support  reciprocal  talk  to  foster  self- 
regulated  learning. 

In  seven  chapters,  numerous  examples  and  activi- 
ties are  provided  to  assist  the  reader  to  translate  this  peda- 
gogical framework  into  classroom  practice.  The  first  chap- 
ter describes  language  and  literacy  socialization.  To  illus- 
trate how  discontinuities  between  a child’s  home  and  school 
life  increase  the  likelihood  of  academic  failure,  Faltis  con- 
trasts literacy  practices  in  mainstream  schools,  Mexican- 
American,  and  Chinese-  American  homes. 

Faltis  advocates  that  creating  a classroom  that  in- 
cludes second-language  learners,  necessitates  teachers  who 
are  knowledgeable  in  four  areas.  First,  teachers  need  to  be 
aware  of  the  various  bilingual  education  programs  that  their 
second-  language  students  might  have  experienced.  Sec- 
ond, teachers  need  to  know  about  alternative  physical  and 
social  classroom  arrangements  that  inhibit  or  enhance  so- 
cial interaction  among  diverse  students  as  well  as  between 
teachers  and  their  students.  Third,  the  regular  classroom 
teachers  who  serve  second-language  learners  must  under- 
stand the  principles  governing  the  acquisition  of  a second 
language  and  know  how  to  incorporate  these  into  their  in- 
structional repertoire. 

Chapter  Four  provides  concrete  examples  of  how 
teachers  can  integrate  language  and  content  instruction  in 
the  context  of  teacher-led  whole-class  instruction.  Chapter 
Five  focuses  on  ways  of  integrating  children  at  different  lev- 
els of  English  proficiency  in  the  context  of  small-group  in- 
struction. At  this  point  Faltis  introduces,  in  a fairly  acces- 
sible language,  \tygotskian  principles  to  provide  the  theo- 
retical rationale  for  the  practices  he  has  recommended  so 
far.  Chapter  Six  centers  on  the  crucial,  and  often  elusive, 
home-school  link.  Drawing  from  the  work  of  D.  Pettit,  T. 
Rasinski,  and  A.  Fredericks,  Faltis  describes  a detailed  four- 
level  sequential  approach  for  fostering  parental  involvement 
in  their  children’s  schooling.  Chapter  Seven  provides  a com- 
prehensive summary  of  Joinfostering  and  contrasts  it  to  Jim 
Cummins’  framework  for  empowering  minority  students. 
Multiculturalism  is  premised  on  the  belief  that  all  peda- 
gogy is  culturally  and  historically  constructed  and,  there- 
fore, potentially  exclusionary.  From  this  perspective,  all 
pedagogy  must  be  critically  scrutinized  to  uncover  the  voices 
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ture Editor  reaponsiblc  for  soliciting  and  coordinating  this  Book 
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that  it  legitimizes  as  well  as  the  voices  that  are  silenced.  It 
would  have  been  very  illustrative  if  Faltis  had  helped  teach- 
ers explore  ways  in  which  the  approach  he  suggests  can 
create  cultural  discontinuities  for  some  children.  In  this 
way,  he  could  have  further  modeled  for  teachers  the  process 
of  interrogation  that  is  intrinsic  to  the  provision  of  equi- 
table schooling.  This  analysis  is  necessary  because  second- 
language  learners  bring  to  their  school  cultural  knowledge 
that  goes  beyond  a different  mother-tongue. 

The  principal  importance  of  this  book  is  its  focus 
on  empowering  the  regular  classroom  teacher,  as  opposed 
to  the  bilingual  teacher,  to  meet  the  “social,  communica- 
tive, and  educational  needs  of  both  native  English-speak- 
ing and  second-  language  learners  of  English.”  (p.  3).  Faltis 
constantly  reminds  the  reader  that  the  academic  failure  of 
mainstreamed  second-language  learners  is  not  the  inevi- 
table outcome  of  these  students’  limited  English  proficiency. 
Teachers,  he  states,  “can  and  must  change  the  existing  so- 
cial organization  of  their  classrooms  to  create  a variety  of 
meaningful  and  culturally  appropriate  learning  environ- 
ments.” (p.  24). 

This  book  is  a much  needed  resource  to  comple- 
ment the  “culture-blind”  approach  of  too  many  traditional 
methods  courses  as  well  as  educational  psychology  courses 


in  an  undergraduate  teacher  preparation  program.  The  peda- 
gogical framework  exemplified  by  Faltis  makes  it  clear  that 
we  currently  have  teaching  technologies  that  make  it  inex- 
cusable and  morally  wrong  for  teachers  to  refuse  to  restock 
their  instructional  repertoire  with  approaches  that  nurture 
all  children,  not  just  those  who  have  mainstreamed  learn- 
ing preferences. 

References: 

Cummins,  J.  (1986).  Empowering  minority  students:A 
framework  for  intervention.  Harvard  Educational  Re- 
view, 56(1),  18-36. 

Pettit,  D.  (1989).  Opening  up  schools: School  and  commu- 
nity in  Australia.  New  York.Penguin. 

Rasinski,  T.,  & Fredericks,  A.  (1989).  Dimensions  of  par- 
ent involvement  The  Reading  Teacher , November,  ISO- 
182. 

Sleeter,  C.E.,  & Grant,  C.A.  (1993).  Making  choices  for 
multicultural  education.  Five  approaches  to  race , 
class,  and  gender  (2nd  ed.).  New  York:  Macmillan 
Publishing  Company. 


721 


TEACHERS  MEET  RESEARCHERS 


"Teachers  Meet  Researchers"  is  a new  program  from  the 
Mid-Western  Educational  Research  Association. 

MWERA's  an  affiliate  of  the  American  Educational 
Research  Association  and  is  its  4th  largest  affiliate  with 
over  600  members.  At  its  annual  convention  in  Chicago 
at  the  Bismarck  Hotel,  over  100  papers  are  presented  as 
well  as  having  guest  speakers,  workshops,  and 
discussion  groups.  If  you  are  interested  in  doing 
research  in  your  classroom  in  PARTNERSHIP  with  a 
college  professor,  send  your  name,  school,  area  of 
interests),  subjects),  grade  level(s)  taught,  and  address 
to  Jay  Adler,  405  West  Main  Street,  Cary,  IL  60013.  This 
information  will  be  published  in  the  official  journal  of 
MWERA.  An  interested  researcher  will  then  contact  you. 
This  is  a wonderful  opportunity  to  make  a real 
contribution  to  the  advancement  of  educational 
knowledge  and  grow  personally  and  professionally  at 

the  same  time. 

A New  Program  From  MWERA 
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SALUTATIONS!  Here  it »,  your  program,  vour  annual  meeting,  your  excuse  to  come  to  Chicago  and  network,  learn,  share  and  compare,  soda  foe, 
and  dare  l say  tt,  shop  (but  not  until  Saturday  afternoon)!  Over  half  of  our  membership,  and  many  people  we  hope  w*  become  members,  wtt  be  joining  us 
for  this  event.  Our  members  who  keep  coming  back  year  after  year  tefl  us  that  they  enjoy  the  informal  ways  that  they  can  state  with  others,  meet  well- 
known  leaders  In  our  field  face-to-face,  and  come  to  a place  where  theories,  Ideologies,  and  models  can  be  developed,  dfccussed  and  challenged  In 
positive  ways.  As  In  previous  years,  we  anticipate  many  graduate  students  will  be  joining  us  for  this  conference.  I hope  that  everyone  w*  take  the 
opportunities  to  welcome  them,  and  facilitate  their  interactions  and  involvements  with  uc.  As  in  previous  years,  the  publishers  who  exhibit  with  us  have 
generously  agreed  to  donate  books  for  our  graduate  students.  Those  will  be  available  at  the  President's  reception  on  Friday  night. 

A newer  addition  to  this  program  is  the  series  of  workshops  we  have  both  pro-  and  during-conference.  Our  intent  is  to  be  able  to  share  our  expertise 
with  others,  and  reach  more  of  the  teachers,  administrators , and  other  education-related  professionals  we  would  tike  to  have  involved  with  the  organization. 

I hope  you  will  take  the  time  to  encourage  them  to  participate! 

Our  program  Is  made  possible  because  so  many  people  have  so  generously  given  of  themselves.  The  invited  speakers,  and  workshop  presenters,  are 
donating  time  and  services  at  a fraction  of  their  costs.  Various  publishers  are  sponsoring  the  speakers,  the  morning  coffees,  and  giving  other  donations  to 
us.  The  Division  Chairs,  and  other  program  committee  members  have  spent  countless  hours  making  tough  decisions  In  organizing  this  program.  We  had 
many  more  submissions  than  we  could  possibly  tit  Into  a program  a week  long,  much  less  three  days.  We  had  many  proposals  which  overlapped,  and  hard 
choices  had  to  be  made  about  what  to  include  and  what  not  to  Include.  The  Board  of  Directors  has  been  supportive  and  helpful  with  the  tough  decisions 
concerning  conference  issues.  My  Dean  of  Northeastern  i Knots  University's  College  of  Education,  Mike  Cart,  has  been  reorganizing  the  entire  college. 

During  this  hectic  time,  he  has  supported  the  efforts  is  has  taken  to  develop  this  program  and  provided  various  generous  contributions  to  MWERA.  Without 
everyone's  support,  this  program  would  not  be  possible! 

1 have  to  warn  you  that  we  have  new  deadlines  this  year.  Make  sure  you  pay  careful  attention  to  getting  your  hotel  and  conference  registrations  in 
earty.  The  hotel  16  under  new  management,  and  has  already  booked  the  rooms  we  did  not  reserve!  Unlike  previous  years,  vrtwre  members  could  walk  In 
and  stilt  get  the  reduced  room  rates,  the  rates  this  year  are  only  guaranteed  until  September  26.  Also  unlike  previous  years,  there  will  probably  not  be  space 
available  if  you  do  not  book  earty!  As  room  rates  are  up,  and  rooms  at  the  hotel  have  been  rehabbed,  some  people  may  want  to  share  rooms.  Mary 
Sudzina  has  agreed  to  coordinate  the  room  sharing.  I encourage  you  to  can  her  if  you  have  a room  to  share,  or  are  looking  to  find  someone  to  stare  with. 
Her  number  is  (51 3)229-3389. 

The  success  of  this  program  is  now  in  your  hands.  I hope  that  you  will  copy  and  distribute  the  flyer  pages  to  your  schools,  colleagues,  anyone  you 
think  might  be  interested.  I hope  that  you  will  share  your  program  with  others,  and  ask  them  to  join  us.  i hope  that  I wiH  have  the  opportunity  to  see  you 
here.  Sharon  McNeely,  MWERA  1995  Program  Chair 


ON  THE  COVER 

Northeaster^  Illinois  University  was  founded  in  1867  in  Englewood  as  the  Cook  County  Normal  School.  It  then  became  the 
Chicago  Teachers  College.  The  campus  at  5500  N.  St.  Louis  Avenue  opened  in  1961.  The  main  part  of  the  commuter-campus  is 
located  in  the  northern  part  of  the  City  of  Chicago,  in  the  most  culturally-diverse  zip  code  in  the  United  States.  NEIU's  10,000+ 
students  como  from  diverse  cultural  and  language  backgrounds,  usually  do  not  speak  English  as  their  first  language,  are  first- 
generation  college,  and  typically  are  8-10  years  older  than  their  counter-parts  at  residential  schools.  In  addition  to  NEIU's  main 
campus,  there  are  three  other  outreach  centers  in  the  city. 

Historically,  NEIU's  mission  has  been  to  serve  in  the  preparation  of  teachers.  In  the  past  several  years  it  has  developed 
programs  in  other  major  areas,  including  business,  arts  and  sciences,  and  non-traditional  degree  programs.  Graduate  studies  have 
also  been  expanded,  now  accounting  for  almost  30%  of  all  students.  Graduate  degrees  are  earned  in  the  arts  and  sciences,  business, 
and  education.  Graduate  degrees  in  education  can  be  earned  in  such  diverse  fields  as  counseling,  educational  administration, 
exercise  science  and  cardiac  rehabilitation,  gifted  education,  human  resource  development,  inner  city  studies  education,  reading,  and 
special  education.  


Information  for  Contributors  to  the  Mid-Western  Educational  Researcher 

The  Mid-Western  Educational  Researcher  accepts  research-based  manuscripts  that  would  appeal  to  a wide  range  of  readers.  All  materials  submitted  for 
publication  must  conform  to  the  language,  style,  and  format  of  the  Publication  Manual  of  the  American  Psychological  Association,  4th  ed.,  1 994  (available 
from  order  Department,  American  Psychological  Association,  P.O.  Box  271 0,  Hyatt**'”'  20784). 

Three  copies  of  the  manuscript  should  be  submKteo  typed  double-spaced  (inducting  quotations  and  references)  on  6V2  x 1 1 paper.  Onty  words  to  be 
italicized  should  be  underlined.  Abbreviations  and  acronyms  should  be  spelled  out  when  first  mentioned.  Pages  should  be  numbered  consecutively, 
beginning  with  the  page  after  the  title  page.  Manuscript*  should  be  less  than  20  pages  long.  An  abstract  of  less  than  100  words  should  accompany  the 
manuscript. 

The  manuscript  will  receive  blind  review  from  at  least  two  professionals  with  expertise  in  the  area  of  the  manuscript.  The  author's  name,  afftiiatioo,  etc., 
should  appear  on  the  title  page  onty.  Efforts  will  be  made  to  keep  the  review  process  to  less  than  two  months.  The  editors  reserve  the  right  to  make  minor 
changes  in  order  to  produce  a concise  and  dear  article.  The  authors  win  be  consulted  if  arjrmajor  changes  are  necessary. 

Manuscripts  should  be  sent  with  a cover  letter  to: 

Ayres  G.  D’Costa,  MWERA  Edkor 

287  Arps  HaK,  1945  N.  High  Street,  The  Ohio  State  University,  Columbus,  OH  43210 

The  Mid-Western  Educational  Researcher  (ISSN  1056-3997)  Is  published  quarterly  by  the  MidWestem  Educational  Research  Association  through  The  Ohio 
State  University.  Non-pmftt  postage  paid  at  Columbus,  Ohio.  POSTMASTER:  Send  address  ctange  to:  Dr.  Jean  Pierce,,  EPSCE,  Northern  Unols  UnN, 
DeKalb.  IL60115 
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MAIL  THIS  FORM  TO  HOTEL  - TO  BE  RECEIVED  BY  SEPTEMBER  25, 1995 

HOTEL  ROOM  RESERVATION  FORM 

Organization:  Mid-West  Educational  Researchers  Association  (MWERA) 

To  make  your  hotel  room  reservation,  please  complete  and  send  this  form  to: 

Reservations  Manager 
Bismarck  Hotel 
171  West  Randolph  Street 
Chicago,  IL  60601 

PH.312/236-0123  FX.312/236-3177  Res.  800/643-1500 

Specially  reduced  room  rates  are  available  to  conference  participants.  Te  ensure  a room  at  the 
special  rate,  reservations  must  be  received  bv  the  hotel  bv  September  25. 1995.  After  that 
date,  reservations  will  be  made  at  the  prevailing  rate  on  a space  available  basis. 

Name: Ph: 

Company/Affiiiation: 

Address: 

City/St/ZI  P 

Sharing  room  with: 

Method  of  payment: Credit  Card  No.: 

Signature: Expiration  Date: : 

Arrival  Date:  Arrival  Time:  Departure  Date: 

(Room  may  not  be  available  before  2:00p.m.)  (Check  out  by  12  noon) 

Reservations  will  be  held  until  6:00  p.m.  unless  guaranteed* 

Check  type  of  Accommodation  requested: 

Single  occupancy  (1  double  bed)  $75  Triple  occupancy  (2  double  beds)  $99 

Double  occupancy  (1  double  bed)  $79  Quad  occupancy  (2  double  beds)  $109 

No  Smoking  room  if  available 

* To  guarantee  your  reservation,  please  enclose  a check  for  one  night’s  cost  payable  to  the 
Bismarck  Hotel,  or  provide  your  credit  card  (AMEX,  Diners,  Cart  Blanche,  VISA,  or  MasterCard) 
information  in  the  above  space.  For  guaranteed  reservations  only,  I understand  that  I am 
responsible  for  one  night’s  room  and  tax  charges  which  will  be  deducted  from  my 
deposit  or  charged  to  my  credit  card  if  I fail  to  cancel  my  reservation. 

Signature: 

All  rooms  subject  to  local  city  tax 

NOTE:  Hotel  Valet  parking  is  $17.00  in/out  per  24  hours.  7 2 3 


MWERA  95  PROPOSAL  REVIEWERS 

In  addition  to  the  Program  Committee,  the 
following  people  are  owed  thanks: 


Carol  Albright,  Ft  Wayne  Community  Schls , IN 
Diane  Anderson,  Bryan  Momorial  Hosp.  Shi  Nursing 
Daisy  Arrendondo,  Univ.  MO-Columbia 
Grover  H.  Baldwin,  Univ.  of  Toledo 
Jerrold  Barnett,  NW  MO  State  Univ. 

Linda  Behar-Horenstein,  Univ.  FL 
Carolyn  Benz,  Univ.  of  Dayton 
Ruth  Bombaugh,  Univ : of  Ml 
Connie  Bowman,  Ohio  State  Univ. 

Susan  Brookhart,  Duquesne  Univ. 

Roger  Carisen,  Univ.  of  Dayton 
Russell  Carney,  SWMO  State  Univ. 

Jacqueline  Collins,  Miami  Univ. 

Alice  Corkill  Dempster,  Univ.  NV-Las  Vegas 
Karen  Dutt,  Indiana  State  Univ. 

Kenneth  S.  Elliott,  Northern  IL  Univ.. 

Mellisa  Frieberg,  Univ.  of  Wl-Whitewater 
Lyndon  G.  Furst,  Andrews  Univ. 

Carol  Furtwengler,  Wichita  State  Univ. 

William  Furtwengler,  Wichita  State  Univ. 

Maria  Elena  Galvez,  Ohio  State  Univ. 

Jesus  Garcia,  Univ.  of  IL 
Julie  Gedeon,  Kent  State  Univ. 

Crystal  Gips,  Ohio  University 
Dorothy  Giroux,  Loyola  Univ. -Chicago. 

Marilyn  Grady,  Univ.  of  NE-Uncoln 
Jeffrey  B.  Hecht,  IL  State  Univ. 

Donald  Hendricks,  Reed-Custer  Schools 
Rich  Hofmann,  Miami  Univ. 

Linda  Houser,  Ball  State  Univ. 

Judythe  GE  Hummel,  Ctl  OH  Reg’l  Prof  Dev.  Ctr 

Jirn  Impara,  University  of  Nebraska 

Steve  Jurs,  University  of  Toledo 

Pam  Kahlich,  PRC,  Inc 

Kenneth  Kiewra,  Univ.  NE-Lincoln. 

Charles  Kline,  Purdue  Univ. 

Ruth  Koskela,  Univ.  of  Wl-Whitewater 

Perry  Lanier,  Ml  State  Univ 

Kevin  C,  Larkin,  American  Dentaf  Assoc.. 

Julie  Larson,  West  Suburbn  Col.  Nursing 
Dennis  Leitner,  Southern  IL  Univ. 

Judith  Levinson,  Evanston/Skokie  Schl  Dist.  65-IL 
Daniel  Lewis,  Kent  State  Univ. 

Earl  L.  Loschen,  So  IL  Univ.  Schl.  Medicine 
Leslie  Lukin,  Kansas  City,  MO  Public  Schools 
Mary  Lunz,  American  Soc.  Clinical  Pathologists 
Ronald  Marso,  Bowling  Green  State  Univ. 

Kathleen  Maury,  Mankato  State  Univ. 

Don  McCarty,  Univ.  of  Wl-Madison 
Joan  McGuire,  LaSalle  Elem.  Dist.  199,  IL 
Sandra  Michelsen,  Valpariso  Univ. 

Jean  Morrow,  Emporia  State  Univ. 

Mark  Mostert,  Moonehead  State  Univ. 

Ralph  Mueller,  Geo/ye  Washington  Univ. 

Gil  Naizer,  Ohio  State  Univ.-Newark 
James  R.  Necessary,  Ball  State  Univ. 

Carole  Newman,  Univ.  of  Akron 
Peggy  Fast  Oakerson,  Ball  State  Univ. 

Beverly  Ochs,  National  Louis  Univ. 

Tom  Oklenski,  Univ.  Dayton. 

Jeff  Peck,  Ohio  State  Univ. 

Barbara  S.  Plake,  Univ.  of  NE 
Jay  Price,  Univ.  of  Wl-Stevens  Point 


Neil  Prokosch,  National-Louis  Univ. 

Dan  Raisch,  Univ.  of  Dayton 
Joan  Rankin,  Univ.  NE 
Jacqueline  Rickman,  Western  Illinois  Univ 
Bruce  Rogers,  Univ.  of  Northern  I A. 

Charles  Runyan,  Pittsburgh  State  Univ. 

Teri  Sandoval,  Arlington , VA 
Gregg  Schraw,  Univ.  NE-Uncoln 
Terry  Schurr,  Ball  State  Univ. 

William  Sharp,  SO  IL  Univ.-Carbondale 
Peggy  Simpson,  Univ.  of  Cincinnati 
Ervin  Sparapovi,  Saji  now  Valley  State  Univ. 
Sherwood  Smith,  Bah  State  Univ. 

Sonja  Smith,  Mt.  Vernon  Nazarene  College 
Cheryl  Sputa,  Ball  State  Univ. 

Brian  Stone,  Wichita  State  Univ 
Marcia  Summers,  Ball  State  Univ. 

William  Thiel,  Thiel  Enterprises. 

Joan  Thrower  Timm,  Univ.  of  Wl-Oshkosh 
Yuxi  Wang,  Delco  Electronics  Corp. 

Mary  Ann  Wham,  Univ . of  Wl-Whitewater 
Sara  Willis,  IL  State  Univ. 

Martha  Wilson,  Capital  University 
Jeff  Winter,  National-Louis  Univ. 

Ted  A.  Zigler,  Wm  Henry  Hamson  High  Schl,  OH 
Dennis  Zuelke,  Jacksonville  State  Univ. 


In  all,  Program  Reviewers  considered 
over  300  different  proposals.  The 
Reviewers,  and  the  entire  program 
committee  faced  tough  decisions,  with 
some  Divisions  having  to  reject  nearly 
50%  of  their  proposals  due  to  space 
limitations.  I thank  these  people  for  all  of 
their  hard  work. 

If  you  would  like  to  be  a Program 
Reviewer  next  year,  attend  your 
Divisional  meeting  and  submit  your 
name  there.  Also,  send  your  name 
directly  to  Kim  Metcalf,  1996  MWERA 
Program  Chair,  Indiana  University, 
School  of  Education,  Bloomington,  IN 
47405; 

email:  kmetcalf@ucs.indiana.edu 


IF  YOU  ARE  NOT  THE  KIND  OF 
PERSON  WHO  READS  THE  BACK 
FIRST,  I SUGGEST  YOU  CONSIDER 
JUST  THAT!  PAGE  40  HAS  A 
CHECKLIST  OF  IMPORTANT  ITEMS, 
AND  MAY  SAVE  YOU  TIME  AND 
INCONVENIENCE  IF  YOU  KEEP  TRACK 
OF  THESE  ITEMS  AS  YOU  MAIL  IN 
YOUR  REGISTRATION  FORMS,  ETC. 


MEETING  REGISTRATION  FORM 

1995  MWERA  ANNUAL  MEETING  CHICAGO,  IL— OCTOBER  11-14,  1995 

Ail  attendees,  including  program  presenters,  must  register  and  pay  applicable  fees.  Please  clearly  print  or  type  your 
name  as  you  wish  it  to  appear  on  your  meeting  badge.  Nonmembers  wishing  to  apply  for  membership  may  register  at 
the  member’s  rate  if  membership  application  and  fee  is  enclosed  with  registration. 


Name 

Affiliation 

Address 

Citv/ST/ZIP 

Highest  Degree 

MWERA-Division  Preference 

Institution  Awarding  Degree 

Major  area  of  Specialization 

Telephone:  Bus. 

Hm. 

E-mail 

Fax 

Is  this  your  first  MWERA  Conference?  Yes No 


Pre-Conference  Workshops  (see  following  pages  for  details) 

* Fee  for  these  workshops  is  separate  from  Registration  fee. 

W.1.ME  @$10  W.I.C  @$10  W.1.E  @$5  W.1.L  @$10 

W.1.B  @$10  W.1.D  @$5  W.1.F  @$10 

TOTAL  for  Pre-Conference  Workshops  $ 


Meeting  Registration 

Postmarked  by  Sept  25 

After  Sept 

25 

MWERA  Member 

@ 

$45 

$55 

$ 

Nonmember* 

@ 

$50 

$60 

$ 

Student  Member  (must  enclose  proof  of  current  status) 

@ 

$30 

$35 

$_ 

Attending  Luncheon  ONLY 

@ 

$23 

$25 

$_ 

• The  Friday  luncheon  is  included  in  the  registration  fee.  Will  you 

be  present  at  the  luncheon?: Yes 

No 

Membership  Dues 

1995  Membership  dues  (required  for  all  participants/registration  discount  rate)  must  be  paid  by  Sept.  25,  1995. 


- Regular  $18,  Student  $10 $ 

1996  Membership  dues  - Regular  $18,  Student  $10 $ 

Life  Membership  -$180 $ 


Conference  Workshops:  fee  will  be  waived  if  meeting  registration  is  paid  in  full 

T.1150.F  @ $5  T.450.#505  @ $5  F.130.ME @$10 

T.1150.Max  @ $No  fee  T.1010J505 @$10  F.310.ME  @$10 

T.1010.E  @ $5  F.1010.F  @ $5  S.1010ME  .@$5 

* Non-members  attending  only  workshops  should  submit  workshop  fees  only.  TOTAL  for  Workshops  $ 

MWERA  Material  All  materials  must  be  picked  up  at  the  registration  desk  at  the  conference,  prices  do  not 

include  postage.  Payment  now  guarantees  that  we  will  try  to  have  materials  available  for  you. 


Indicate  quantities  below: 

MWERA  Membership  Directory  $7 $_ 

MWERA  95  Annual  Meeting  Abstracts  ( paper  $4)  ( IBM  $3) $ 

MWERA  Lapel  Pin  $3  each $' 


TOTAL  AMOUNT  ENCLOSED  FOR  MEETING  $ 


When  registering  and/or  joining,  please  make  check(e)  payable  to  MWERA,  and  mail  with  completed 
form(s)  by  Sept  25  to:  Jean  Pierce,  Northern  Illinois  Univ.,  Dept  EPCSE,  DeKalb  IL  60115 
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| GENERAL  INFORMATION 


Registration:  Everyone  participating  in  or  attending  the 
MWERA  annual  meeting  must  be  registered.  Those  planning  on 
attending  the  annual  meeting  are  encouraged  to  pre-register  for 
the  conference,  any  workshops,  and  make  hotel  reservations 
early  (pre-registration  and  hotel  reservations  must  be 
received  by  September  25, 1995).  Registrations  mailed  after 
Sept.  25  may  not  be  received,  and  on-site  payment  in  the  form 
of  cash  or  personal  checks  will  be  expected.  If  double  payment 
is  later  determined,  a refund  will  be  issued.  On-site  registration 
and  packet  pick-up  will  be  available  in  the  lobby  of  the  Bismarck 
at  the  following  times: 

Wednesday,  Oct.  11,  11:30-4:30  pm 
Thursday,  Oct.  12,  8:00  an>4:00  pm 
Friday,  Oct.  13,  8:00  am-4:00  pm 
Saturday,  Oct.  14,  8:00-10:30  am 

Shared  Housing:  Mary  Sudzina  is  coordinating  shared 
housing  arrangements.  Please  call  her  at  (513)229-3389  if  you 
have  a room  to  share  or  are  looking  to  find  someone  to  share 
with. 

Name  tags  should  be  worn  to  all  sessions  and  must  be 
worn  to  the  conference  luncheon.  Those  teachers, 
administrators,  and  others  who  are  registering  for  workshops 
only  should  still  come  to  the  registration  desk  to  receive  their 
special  tags  and  permits  to  enter  workshops. 

Membership  provides  reduced  conference  registration  fees 
and  a subscription  to  the  MWERA  official  publication,  the  Mid- 
Western  Educational  Researcher.  Those  attending  are 
encouraged  to  join.  Conference  presenters  must  be  paid 
members  for  1995. 

Selected  MWERA  publications  are  available  through  pre- 
registration.  These  include  the  Directory  of  MWERA  members 
for  $7,  the  MWERA  1995  Meeting  Abstracts  for  $4  paper,  and 
$3  IBM  computer  disk.  These  publications  may  not  be  available 
at  the  conference  unless  ordered  through  pre-registration.  If  they 
are  available  at  registration,  cash  or  checks  will  be  accepted. 

MWERA  lapel  pins  are  available  this  year  for  the  first  time. 
The  pins  are  your  way  to  show  others  that  you  support  MWERA, 
and  they  add  to  your  attire.  These  stylish  pins  were  made 
available  to  us  at  a special  discount,  and  we  have  passed  along 
that  discount  to  you. 

This  year's  Exhibit  Hall  will  feature  publishers  and  those 
providing  materials  and  services  to  educators  on  Friday,  in  the 
Maximillian  Room.  We  have  added  a sharing  table  for  you  to 
bring  job  announcements,  fill-out  mentor  forms,  and  share  other 
information  which  helps  all  of  us.  Plan  on  stopping  by  between  9 
am  and  4 pm. 

Evaluate  the  sessions  and  the  annual  meeting:  As  in 
previous  years,  we  request  that  ail  session  Chairs  distribute 
evaluation  forms  for  each  session.  In  your  registration  packet, 
you  will  also  receive  a form  to  evaluate  the  meeting.  The  forms 
get  returned  to  the  registration  table,  or  directly  to  Jack 
Snowman,  Member-at-Large.  This  is  your  conference,  and  the 
comments  you  provide  are  helpful  to  us  in  improving  our 
meetings. 

The  Blackhawk  room  will  be  used  for  session  preparation; 
practice  with  overheads,  etc.  You  are  welcome  to  use  it  for 
continued  discussions  after  sessions  (an  alternative  to  using  the 
hallways,  please).  It  can  also  be  used  for  people  attending  who 
are  not  staying  at  the  hotel  to  take  respite  between  sessions. 


EXPLANATION  OF  PROGRAM  AND  SESSION  FORMATS: 


T.  1 050. C ‘ Teacher  Beliefs  (Division  K-Paper  session) 

T = Session  is  held  on  Thursday. 

1050  = Session  begins  at  1050  in  the  morning 
C = Session  is  held  in  Parlor  C 


This  information  is  followed  by  the  session  title,  the  Divison 
sponsoring  the  session,  and  then  the  session  format. 

For  all  sessions,  authors  are  expected  to  have  complete 
copies  of  their  papers  available.  We  suggest  30  copies.  Make 
sure  you  deposit  one  at  the  registration  table  for  forwarding  to 
ERIC  archives. 

Session  Formats 

Paper  sessions  provide  each  author  an  opportunity  to 
present  an  abbreviated  version  of  a paper.  The  presenter 
usually  has  15  minutes  for  the  presentation.  The  author  should 
not  read  the  paper  as  a form  of  presentation.  When  a 
discussant  is  included  in  the  session,  comments  should  be 
made  that  synthesize,  compare,  or  contrast  the  papers,  or  point 
out  the  strengths  and  weaknesses  fo  the  studeis.  The 
discussant  should  not  provide  a detailed  critical  review,  but 
rather  focus  on  the  conceptual  and  methodological  nature  of  tht 
papers  and  their  results. 

Table  poster/Small  discussion  groups  allow  the  author  ar 
opportunity  to  interact  with  small  groups  of  interested  colleague: 
for  a longer  period  of  time  (usually  40  minutes).  Authors  are 
encouraged  to  use  poster  display  boards  to  present  their  work 
on  the  top  of  the  table.  The  poster  should  include  a brief 
abstract  as  well  as  highlights  or  significant  information  from  the 
paper  presented  in  a large  font  size  for  easy  reading  from  a 
distance. 

Symposia  allow  the  panel  of  presenters  with  a shared  topic 
an  opportunity  to  make  a presentation  and  share  views. 

Invited  speakers  and  panels  have  been  invited  to  address 
the  conference.  They  are  recognized  leaders  in  education  and 
have  been  asked  to  share  their  experience  and  knowledge. 

Roundtables  allow  the  author  an  opportunity  to  discuss  the 
work  with  a small  group  in  a circle,  participative  manner. 

Workshops  are  designed  to  allow  presenters  to  involve 
those  attending  in  the  active  development  of  new  skills  or 
knowledge.  They  are  scheduled  for  1 .5  or  3 hours.  A small  fee 
charged  for  pre-conference  workshops  and  for  t hose  workshop 
scheduled  during  the  conference.  The  during-conference 
workshop  fee  is  waived  for  members  who  have  paid  for  full 
conference  registration. 
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EVENTS  AND  INFORMATION 


Division  Meetings  provide  colleagues  within 
MWERA  Divisions  an  opportunity  to  discuss 
experiences  and  plan  future  events.  Possible 
invited  speakers  are  discussed  as  well  as  the 
Annual  Meeting  as  a whole.  One  of  the  most 
important  activities  is  to  gather  names  of  those 
interested  in  serving  as  Division  Chairs.  The 
Program  Chair  chooses  Chairs  to  head  each 
Division  for  the  next  year.  Often  a “junior”  Chair 
becomes  the  “senior”  Chair  for  the  next  year.  To 
make  this  early  hour  easier,  we  are  having  coffee 
and  rolls  sponsored  by  various  publishers.  The 
hotel  also  has  agreed  to  have  its  continental 
breakfast  bar  open  in  the  lobby  for  members  to 
purchase  other  items.  This  year’s  Division  Meetings 
are  held  on  Friday  and  Saturday,  8:00-9:00  a.m.. 
Check  the  program  schedule  for  your  Division’s 
specific  meeting  place.  Feel  free  to  attend  a 
different  one  each  morning! 

The  Association  Council  is  the  governing  body  of 
MWERA.  It  includes  the  elected  members  of  the 
Association  Council  and  the  Board  of  Directors.  At 
the  Annual  Meeting  financial  reports  and  other 
Association  business  are  discussed.  This  year’s 
Association  Council  meeting  is  Thurs.  at  3:10  p.m. 

The  Cracker  Barrel  Social  is  an  informal  get 
together  to  wind  up  the  first  full  day  of  the 
conference.  A cash  bar  is  planned. 

The  General  Business  Meeting  is  open  to  all  paid 
members.  It  is  the  only  activity  scheduled  during 
the  9:00-10:00  a.m.  time  slot  on  Friday.  It  is  hoped 
that  everyone  will  attend.  Information  is  presented 
and  Association  business  is  discussed.  The 
Graduate  Student  award  drawing  is  held. 
Nominations  for  officers  and  councilors  are  also 
accepted. 

The  Friday  Luncheon  is  included  in  the 
conference  registration  fee.  Announcements  are 
made  and  an  address  will  be  given  by  Gerald 
Bracey.  This  year  both  the  keynote  speaker  and 
the  luncheon  speaker  have  agreed  to  be  available 
after  their  presentations  for  informal  discussion  and 
questions  and  answers. 


The  Program  Committee  Meeting  will  take  a look 
at  the  positives  and  negatives  of  the  current  Annual 
meeting  and  begin  preparations  for  next  year’s 
meeting.  Comments,  criticisms,  and  volunteers  are 
invited.  Division  Chairs  are  expected  to  attend. 

The  President’s  Reception  is  held  in  the 
Regency  Suite  of  the  Bismarck  beginning  at  9:00 
p.m.  on  Friday.  Everyone  is  invited  to  relax  with 
new  and  old  friends  and  finish  discussions  or  start 
new  ones.  Soft  beverages  will  be  provided. 

Thomas  Andre’s  Presidential  Address  entitled 
Science.  Gender,  and  the  Thinking  School  will  be 
on  Saturday  morning  at  9 a.m. 


Suggestions  to  Presenters 

To  make  the  conference  sessions  as  helpful  and 

enjoyable  as  possible,  the  Board  of  Directors  ask 

presenters  to  please  follow  these  guidelines: 

1 . Send  a completed  copy  of  your  paper  to  the 
Session  Chair  and  Discussant  so  that  it  is 
received  no  later  than  September  25, 1995. 
Discussants  are  not  obligated  to  discuss  papers 
received  after  this  date. 

2.  Bring  at  least  40  copies  of  your  paper  to  the 
conference.  People  interested  in  your  paper 
should  receive  a copy  at  the  conference. 

3.  Make  overheads  and  handouts  that  are 
attractive  and  readable.  Posters  should  be  firm 
enough  to  lean  or  lay  on  a table  and  should 
include  an  abstract  and  highlights  from  the 
paper. 

4.  Plan  to  present,  rather  than  read  your  paper  in 
the  time  allotted. 

5.  Session  chairs  should  divide  the  time  available 
equally  among  the  presenters,  discussants, 
and  the  audience. 

6.  Because  of  purchase  costs,  storage  space,  and 

maintenance  issues,  equipment  other  than 
overheads  will  not  be  provided. 


How  to  Get  to  the  Conference 

When  coming  to  Chicago,  attendees  have  a 
variety  of  transportation  options: 

O’Hare  Airport  to  the  Bismarck  Hotel  (3  options) 

1.  Take  a CTA  train  to  downtown  for  about  $2.00.  Catch 
the  train  in  the  basement  of  Terminal  3.  Take  an  A or 
B line.  Get  off  at  the  Lake  Transfer  station.  This  is  in 
the  basement  of  the  State  of  Illinois  Building.  Climb 
the  stairs  and  proceed  to  the  Bismarck,  one  block. 

This  is  the  fastest  way  during  rush-hours,  and  the 
cheapest. 

2 Take  the  Continental  Bus  for  $12.50  one-way  or 
$22.00  round-trip.  No  reservations  are  required  from 
the  airport.  See  the  agent  at  the  booth  in  the  lower 
level  baggage  claim  area. 

3.  Take  a cab  for  around  $22.00.  Wait  in  the  cab  -land 
area.  In  off-hours  a ride  takes  about  30  minutes.  In 
rush  hours  (7-10  a. m.,  3-7  p.m),  the  ride  could  take 
an  hour  or  more.  Tips  average  fifteen  percent. 

Midway  Airport  to  the  Bismarck  Hotel  (3  options) 

1.  Take  a CTA  train  to  downtown  for  about  $2.00.  Catch 
the  train  at  the  east  end  of  the  airport.  Get  off  at  the 
Clark  & Lake  station.  Climb  down  the  stairs  and 
proceed  to  the  Bismarck,  one  block. 

2.  Take  a Continental  Airport  Bus  for  $9.50  one-way  or 
$16.75  round  trip.  No  reservations  are  required  from 
the  airport.  See  the  agent  at  the  booth  for  tickets. 

3.  Take  a cab  for  around  $1 8.00.  See  O’Hare 
information  above  regarding  time. 

Driving  But  NOT  Parking  Downtown  (3  options) 

From  the  North  or  West 

1 . Park  near  a Metra  station  and  take  a Metra  Train 
downtown.  From  the  Metra  station  you  will  need  to 
take  a cab  to  the  hotel.  Depending  on  where  you 
board  the  train,  your  ride  can  be  inexpensive.  For 
details  call  (312)836-7000.  Be  certain  to  find  out 
about  return  trips,  especially  on  weekends. 

2.  Park  at  O’ Hare  remote  (follow  highway  signs  to 
O’Hare),  take  a shuttle  into  O'Hare  and  follow  any  of 
the  O'Hare  options.  Remote  parking  is  inexpensive. 

3.  Park  at  Kiss  and  Ride  at  either  the  Cumberland  or  the 
Harlem  Avenue  exits  off  of  1-94  (the  Kennedy).  Take 
the  CTA  train  (See  O'Hare  option  1 ).  Parking  is 
inexpensive. 

From  the  South  or  East 

1 . Park  near  a Metra  station  and  take  a Metra  Train  See 
#1  above 
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Driving  and  Parking  Downtown  (5  options) 

• Listen  to  the  Radio  (670  or  780  AM)  for  traffic  reports. 

• Remember,  rush  hours  are  7-10  a.m.,  3-7  p.m.  in  both 
directions.  Travel  in  the  city  takes  time.  There  is  a lot 
of  construction.  Plan  at  least  two  hours  from  the  near 
suburbs  to  downtown.  Plan  one-half  hour  (minimum) 
in  downtown  traffic. 

1 . Coming  in  on  1-94  from  the  North:  1-94  junctions  with 
the  Kennedy  at  Irving  Park  Road.  Continue 
downtown.  If  traffic  is  good,  it  should  take  20  minutes. 
Beyond  the  Ohio  Street  exit,  get  in  the  right-hand 
lane.  Exit  at  Washington  Street  going  East.  At 
LaSalle,  make  a left,  go  one  block  and  make  a left  on 
Randolph  to  the  hotel.  After  you  drop  off  your 
baggage,  you  can  park  your  car  in  a self-park  (about 
$15.00/day)  or  have  the  hotel  park  it  for  an  in/out  fee 
of  $17.00  per  day.  There  is  NO  street  parking. 

2.  Coming  in  on  1-90  from  the  Northwest:  Follow  1-90 
downtown.  This  becomes  the  Kennedy.  Follow 
directions  in  #1  above  for  exits  and  parking. 

3.  Coming  in  on  1-90/1-94  from  the  Southeast:  T ake  the  I- 
90  (Skyway)  in.  The  toll  will  be  about  $2.00,  but  it  will 
save  you  alot  of  time.  Get  in  the  Express  Lanes  to 
downtown.  When  you  approach  the  LOOP,  follow  the 
signs  saying  1-94,  Kennedy  and  Wisconsin.  Exit  at 
Monroe  Street  and  head  East  (right).  At  LaSalle,  take 
a left,  then  a left  on  Randolph  to  the  hotel.  After  you 
drop  off  your  baggage,  you  can  park  your  car  in  a 
self-park  (about  $1 5/day)  or  have  the  hotel  park  it  for 
an  in/out  fee  of  $17.00/day. 

4.  Coming  from  the  South  or  Southwest:  Take  the  1-57 
in.  This  junctions  with  1-94  and  1-90.  Read  #3  above. 

5.  Coming  from  the  West:  Take  the  1-55  or  1-290  into 
downtown.  Follow  the  signs  saying  to  1-94  Wisconsin. 
Read  #3  above. 

..  you  are  arriving  some  other  way,  or  have  any  questions, 
please  call  Sharon  McNeely  at  (312)794-2788  before  your 
trip.  She  will  be  happy  to  help. 

The  Bismarck  Hotel  171  W.  Randolph  St.,  Chicago  IL  60601 
The  Bismarck  Hotel  has  recently  been  partially  renovated 
and  no  longer  has  any  single  beds  in  any  rooms.  Each 
room  has  a security  chain,  peep  hole  and  voice  mail.  The 
Bismarck  has  been  home  to  the  Annual  Meeting  of  the 
Mid-Western  Educational  Research  Association  for 
several  years  and  is  a friend  to  the  Association.  It 
continues  to  offer  some  of  the  most  reasonable  rates  in 
Chicago.  A change  in  management  has  brought  major 
renovations  to  the  Hotel  as  well  as  additional  services 
and  activities.  The  Bismarck's  Gate  31/2  Sports  Bar  is 
open  1 lam-lam  with  lunch,  dinner  and  snacks.  The 
Palace  Cafe’  serves  breakfast  and  lunch.  The  Crown 
room  is  open  for  Breakfast,  lunch,  dinner  and  serves  a 
great  lunch  buffet!  The  Green  Orchid  Lounge  has  Jazz 
music  Thursday-Saturday,  7pm  to  midnight.  The  Hotel  is 
also  offering  complimentary  shuttle  bus  service  to  many  of 
the  sights  in  Chicago  including  the  museums,  Art  Institute, 
and  the  Water  Tower  shopping  area. 


DAVID  BERLINER  (at  left) 

Professor,  Arizona  State  University, 
Educational  Psychologist,  Researcher, 
Author  of  Numerous  Articles  and  Texts 

Recent  author  of  book  on  the  crisis  in 
education,  and  co-editor  of  the 
Handbook  of  Educational  Psychology, 
Past-President  of  the  American 
Psychological  Association's  Division 
of  Educational  Psychology,  and 
world-renowed  lecturer  on  critical  topics 
in  education. 

Dr.  Berliner  joins  us  for  the  Wednesday 
night  forum  on  the  manufactured  crisis 
in  education.  He  will  provide  the  ■ 
Opening  Keynote  address  on  Thursday 
morning,  and  then  informally  discuss 
issues  he  raises  in  a smaller  session 
immediately  following  the  keynote. 


GERALD  BRACEY  (at  right) 

Distinguished  Fellow  for  the  Agency 
for  Instructional  Technology, 

Policy  Analyst,  Researcher,  Writer, 
Author  of  Numerous  Articles 

Author  of  the  Bracey  Reports. 

The  Fourth  Bracey  Report  has  been 
nominated  by  Project  Censored  as  one 
of  the  best  under-reported  articles  of 
1 994.  Also  author  of  Transforming 
America's  Schools.  Currently  travels 
worldwide  speaking,  and  training 
educators  and  educational  researchers. 

Dr.  Bracey  will  join  us  on  Friday 
for  the  Luncheon  address,  which  will 
provide  new  insights  into  recent  trends 
in  reporting  American  students’ 
achievement  test  scores.  Immediately 
following  the  luncheon  he  will  provide 
an  informal  discussion  of  the  issues 
he  raises. 
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BARBARA  MCCOMBS  (at  right) 


Senior  Director  for  the  Motivation  and 
Human  Development  group  at  the 
Mid-continent  Regional  Educational 
Laboratory,  Aurora,  Colorado; 

Educational  Psychologist,  Researcher, 
Author  of  Numerous  Articles 

Primary  author  of  the  Learner-Centered 
Psychological  Principles:  Guidelines 
for  School  Redesign  and  Reform, 
developed  by  the  American  Psychological 
Association’s  Task  Force  on  Psychology 
in  Education.  Works  for  systemic  school 
reform,  and  trains  practioners  in  putting 
the  Learner-Centered  Principles  (LCPs) 
into  practice. 

Dr.  McCombs  will  join  us  on  Wednesday 
to  do  a pre-conference  training  workshop 
on  the  LCPs.  On  Wednesday  night  she 
will  join  in  the  forum  on  the  crisis  in 
education.  On  Thursday  afternoon,  she 
will  provide  an  Invited  Address  on 
promoting  teacher  leadershiip  through 
self-assessment  and  reflection  tools. 


THOMAS  ANDRE  (at  right) 

Professor,  Iowa  State  University, 
Educational  Psychologist,  Researcher, 
Author,  President  of  the  Mid-Western 
Educational  Research  Association. 

Dr.  Andre’s  researches  issues  related 
to  teaching  subject  area  content, 
particularly  science,  and  to  issues  of 
gender.  Although  he  has  several  other 
commitments  for  the  meeting,  and  will 
be  hosting  the  President’s  Reception  on 
Friday  night,  he  will  be  giving  his 
Presidential  address  bright  and  early 
Saturday  morning.  His  talk  will  talk 
about  science,  gender,  and  the  thinking 
school. 
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BARBARA  SHADE  (above) 

Dean  of  the  School  of  Education  at  the  University 
of  Wisconsin-Parkside,  educational  psychologist, 
and  author  of  numerous  articles  on  teaching  to 
culturally  different  information-processing  styles. 
Dr.  Shade  will  join  us  on  Friday  morning  for  an 
Invited  Address  on  creating  culturally  compatible 
classrooms. 


KENNETH  KIEWRA  (above) 

Professor  of  educational  psychology  at 
the  University  of  Nebraska,  Lincoln,  and 
author  of  numerous  articles  on  note- 
taking and  knowledge  representations. 
On  Thursday  afternoon,  Dr.  Kiewra,  a 
former  MWERA  president,  will  present 
his  overdue  address  on  knowledge 
representation. 


GREG  MARCHANT  (above) 

Professor,  Ball  State  University,  MWERA 
President-Elect,  Past-President  of  the 
Teaching  Educational  Psychology  SIG  of  AERA, 
and  fully  recovered  1994  MWERA  Program 
Chair!  Dr.  Marchant  will  be  one  of  the 
panelists  at  the  Wednesday  night  forum  on 
the  manufactured  crisis  in  education. 


MICHAEL  CARL  (above) 

Dean  of  the  College  of  Education, 
Northeastern  Illinois  University. 

Dr.  Carl  has  developed  a forum/panel 
of  school  development  and  outreach 
professionals  who  will  discuss  new 
initiatives  in  forming  professional 
development  liaisons  with  schools. 
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WEDNESDAY 


best  COP'V  AVAIIABIK 


MWERA  WORKSHOPS:  PRE-  & DURING- 
CONFERENCE 

MWERA  sponsors  workshops  as  a means  to  provide  information  and 
education  to  our  members  and  to  other  education-related  professionals. 
Registration  for  each  workshop  is  $10.00,  unless  noted.  MWERA  reserves 
the  right  to  cancel  workshops  which  do  not  have  sufficient  registration  at 
the  conclusion  of  advance  registration. 

WEDNESDAY,  PRE-CONFERENCE  WORKSHOPS 
1 - 4 p.m.  (unless  noted) 

W.I.Me  For  Our  Students,  For  Ourselves: 

Implementing  Learner-Centered  Practices 
Medili  - Fee  $10.00 

PRESENTER:  Barbara  McCombs.  Mid-Continent  Regional 
Educational  Laboratory  in  Aurora,  CO 
This  workshop  is  designed  to  engage  teachers,  administrators, 
professors,  and  other  participants  in  an  exploration  of  the 
concept  of  learner-centered  and  how  it  is  implemented  in 
practice  at  the  school  and  classroom  levels.  Participants  will 
engage  in  activities  designed  to  increase  their  awareness  of  the 
need  for  learner-centered  practices,  understanding  of  effective 
practices  associated  with  a learner-centered  model,  and  skills 
for  engaging  in  these  practices.  Video  models  will  complement 
the  training  activities. 

W»1  .F  How  to  Implement  Portfolios  In  the 

Classroom  as  a Means  of  Student  Motivation  and  Alternative 
Assessment  Parlor  F - Fee  $10.00 

PRESENTER:  Carole  Newman . University  of  Akron 
This  workshop  will  present  a “how  toM  model  to  help  teachers 
and  administrators  take  the  initial  steps  to  begin  the  portfolio 
process  in  classrooms.  There  will  be  a brief  discussion  of  the 
philosophy  and  value  of  implementing  portfolios  as  a means  of 
motivating  and  empowering  students  to  become  active  decision 
makers  in  their  learning.  Participants  will  then  !eam  about  the 
decisions  which  must  be  made  when  getting  started  and  how  to 
make  the  process  manageable  and  rewarding  for  both  student 
and  teacher.  Discussion  will  focus  on  establishing  teacher  goals 
for  the  portfolio,  management  techniques,  selecting  appropriate 
evidence,  developing  criteria  and  rubrics  for  student  setf- 
evaJuation  and  teacher  assessment,  student  goal  setting  and 
parent  involvement. 

W.1.E  Developing  a Self-esteem  Mentoring 

Program  for  Children  and  Adolescents  with  Disabilities  in 
Public  Schools  1 :00-2:30  p.m.  Parlor  E - Fee  $5.00 

PRESENTERS:  Eddie  E.  Glenn.  Illinois  State  University 
Judy  Walker.  Developmental  Psychologist  ( Private  Practice ) 
Dfadre  Jackson.  Bradley  University 
Thomas  Mldaette.  University  of  Arkansas 

Teachers,  counselors,  administrators,  and  other 
participants  will  be  provided  with  information  about  how  to 
develop  a self-esteem  mentoring  program  for  individuals 
covered  under  the  Education  for  All  Handicapped  Children  Act 
(P.L.  94-142)  and  the  Individual  with  Disabilities  Education  Act 
(P.L.  99-457).  A brief  literature  review  that  provides  correlations 
between  disabilities  and  lowered  sief-esteem  wiil  be  presented. 
The  training  provided  is  designed  to  help  develop  awareness, 
sensitivity,  and  knowledge  about  children  and  adolescents  with 
disabilities,  and  help  participants  develop  and  design  activities 
that  enhance  self-esteem,  especially  the  use  of  a mentoring 
program.  THIS  WORKSHOP  WILL  ALSO  BE  OFFERED  ON 
THURSDAY,  10:10-11:40  am,  Medili 


W.1,  Li  Obtaining  educational  information  from  and 

developing  collaborative  relationships  with  the  North  Central 
Regional  Educational  Laboratory  (NCREL) 

Lincoln  - Fee  $10.00 

PRESENTERS:  Peanne  Durrett  Randy  Knuth,  Bill  Quinn.  Lynn 
Stinnette,  Arie  van  der  Ploeg,  NCREL 

NCREL  serves  educational  needs  in  Illinois,  Indiana,  Iowa,  Ohio, 
Michigan,  Minnesota,  and  Wisconsin.  It’s  work  focuses  on 
comprehensive  and  systematic  school  restructuring  that  is 
research-based  and  learner-centered..  It  disseminates 
information  about  effective  programs,  develops  educational 
products,  holds  conferences,  provides  technical  assistance,  and 
conducts  research  and  evaluation.  NCREL  uses 
telecommunications  technology  to  link  and  sustain  a variety  of 
ujot>altken  networks  and  task  forces  in  the  region,  including 
assessment  directors,  intermediate  service  agencies,  state 
mathematics  and  science  specialists,  and  others.  It  works  with 
numerous  university  staff  and  seeks  collaborative  relationships. 
This  workshop  will  provide  more  information  on  programs,  and 
demonstrate  some  work  in  prog^ss  including  the  Strategic 
Teaching  and  Reading  Project,  Pathways  to  Schcol 
Improvement  (NCREL s WWW  information  server  that  delivers 
educational  reserach  to  the  desktop),  the  Leadership  Academy, 
the  Census  Web  server,  the  NCES  School  District  Data  Book, 
and  the  State  Student  Assessment  Programs  data  base. 

W.1.D  A Primer  on  Building  Teacher  Evaluation 

Instruments  1:00-2:30  p.m.  Parlor  D - Fee  $5.00 

PRESENTERS:  Ted  Bitner.  Ron  Kratzner.  Anderson  University 
Teachers,  administrators,  professors,  and  other 
participants  will  be  presented  with  information  designed  to  build 
accurate  teacher  evaluation  instruments.  These  instruments 
use  a scientifically  oriented  knowledge  base  which  requires  that 
the  concepts  of  validity  and  reliability  be  understood.  Both 
content  and  construct  validity  are  discussed,  including 
suggestions  for  developing  them.  Reliability  and  how  to 
establish  it  is  presented.  A checklist  of  key  questions  is 
included  with  suggestions  for  moving  from  present  instruments 
to  more  valid  and  reliable  evaluation  instruments. 

THIS  WORKSHOP  WILL  ALSO  BE  OFFERED  ON  FRIDAY, 
1:30-3:00  P.M,,  Medili 

W.1.B  Multiple  Regression  for  the  Evaluation  Practitioner 
Parlor  B - Fee  $10.00 

PRESENTER:  Isadora  Newman.  University  of  Akron 
This  workshop  is  an  introduction  to  the  General  Linear  Model 
and  its  relationship  to  various  tests  including  simple  regression 
and  multiple  regression.  Participants  will  be  shown  how  to  use 
multiple  regression  to  do  analysis  of  covariance.  The 
relationship  of  regression  and  traditional  analysis  of  variance, 
repeated  measures  designs  and  discriminate  analysis,  policy 
capturing  and  multivariate  T will  be  discussed.  Examples  of 
interactions  between  (a)  categorical  ‘continuous  variables,  (b) 
continuous  ‘categorical  variables  and  (c)  categorical 
‘categorical  variables  will  be  provided.  Curvilinear  relationships, 
power  analysis  and  meta-analysis  will  also  be  discussed. 

W.1.C  Designing  and  Implementing  Simulation  Studies  in 
Rasch  Measurement  Parlor  C - Fee  $1 0.00 

PRESENTER:  RichandM . Smith.  Rehabilitation  Foundation 
Inc./Marianiov  Rehabilitation  Hospital  and  Clinics 
This  workshop  is  designed  to  provide  researchers  and  graduate 
students  with  the  theoretical  foundations  and  computer 
expertise  necessary  to  conduct  simulation  studies  in  Rasch 
measurement,  including  the  design  of  studies  to  determine  the 
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null  distribution  of  statistics,  Type  1 error  rates,  and  the  power  of 
statistics  to  detect  departures  from  the  null  distribution.  Three 
Rasch  measurement  models  will  be  discussed:  rating  scale, 
dichotomous,  and  partial  credit  models.  Research  on  the 
number  of  replications  necessary  for  stable  results  will  be 
summarized.  Participants  will  be  trained  to  use  computer 
programs  to  generate  data  for  simulation  studies,  including 
batch  processing  techniques.  Each  participant  will  be  able  to 
purchase  ($15)  a copy  of  the  handouts  and  a DOS-based 
simulation  program  that  can  be  used  to  generate  response  data. 

THURSDAY,  DURING-CONFERENCE  WORKSHOPS 

T.1010.E  A Self-esteem  Mentoring  Program  for 

Children  and  Adolescents  with  Disabilities  in  Public  Schools 
Medill  - Fee  $5.00  (Fee  waived  if  conference  fee  paid) 
PRESENTERS:  Eddie  E.  Glenn,  Illinois  State  University 
Judy  Walker.  Developmental  Psychologist  ( Private  Practice ) 
Diedre  Jackson,  Bradley  University 
Thomas  Midoette,  University  of  Arkansas 
See  Wednesday,  W.1.E  for  a complete  description. 

T.1150.Max  State-wide  Assessment  Practices:  Using 

Student  Assessment  Data  Bases  in  General,  and  the  Illinois 
Base  in  Particular  Maximilian  - No  Fee 

PRESENTER:  Arie  van  derPloea,  North  Central  Regional 
Educational  Laboratory 

This  interactive  presentation/workshop  will  provide  information 
on  how  student  assessment  data  bases  are  currently 
functioning,  how  to  access  these,  and  what  potential  benefits 
they  may  have  to  educational  researchers.  The  Illinois  data  base 
wili  be  used  as  an  example  to  explain  set-up,  access,  and  what 
types  of  information  are  available.  The  participants  will  have  a 
chance  to  discuss  potential  feasibility  of  use  of  the  data  bases 
for  their  own  research  applications. 

T.450.#505  Writing  a Letter  of  Application:  Addressing 
the  Pertinent  Issues  Room  #505  - $5.00 

(Fee  waived  if  conference  fee  paid) 

PRESENTERS:  Mary  K.  Bendixen-Noe  and  Gilbert  L Naizer ; 
Ohio  State  Universitv-Newark 

This  presentation  will  focus  on  how  to  write  a high 
quality  letter  of  application  for  the  field  of  academia. 

Participants  will  be  involved  in  identifying  key  criteria  in  actual 
academic  advertisements,  and  addressing  these  in  a letter  of 
application.  Additionally,  individuals  will  be  able  to  recognize 
their  professional  strengths  and  wili  learn  how  to  highlight  these 
qualifications  for  specific  positions. 

In  a recent  search  committee,  the  presenters  were 
amazed  at  the  applicants’  lack  of  knowledge  on  how  to  write  a 
letter  addressing  a specific  academic  position.  Of  the  letters 
received,  only  twenty  percent  contained  information  that  was 
appropriate  to  the  position  as  advertised.  The  information 
provided  may  assist  individuals  in  being  granted  an  interview. 
Participants  will  receive  feedback  that  should  strengthen  their 
letter  of  application  skills.  At  the  conclusion  of  the  workshop, 
each  participant  will  have  developed  a sample  letter  of 
application  relevant  to  their  skills  and  interests. 


FRIDAY,  DURING-CONFERENCE  WORKSHOPS 

F.1010.F  Developing  Research-Based  Student 

Teaching  Supervision  Materials  Medill  - $5.00 
(Fee  waived  if  conference  fee  paid) 

PRESENTERS:  Donald  Williams.  Doug  Smith,  Hema 
Ramanathan,  Laura  Lipsett,  Ohio  State  University 
This  workshop  is  designed  to  involve  participants  in  an 
examination  of  student  teaching  supervision  materials  based 
upon  current  research  and  theory  regarding  the  student  teaching 
practicum.  Findings  from  recent  research  concerning  the 
content  and  current  knowledge  base  of  student  teaching 
programs  will  be  used  to  link  theory  and  practice  in  the  analysis 
of  student  teaching  materials.  Workshop  participants  will 
consider  the  process  of  developing  a student  teaching  handbook 
beginning  with  the  underlying  philosophy  and  goals  of  a program 
and  maintaining  these  through  all  the  elements  of  the  student 
teaching  experience.  A structural  “model”  for  handbook 
development  and  lists  of  research-based  roles  and  tasks  of 
supervisors  will  be  provided  to  guide  workshop  activities. 

F.130.Me  A Primer  on  Building  Teacher  Evaluation 

Instruments  1 :30-3:00  p.m.  Medill  - Fee  $5.00 
(Fee  waived  if  conference  registration  paid) 

PRESENTERS:  Ted  Bitner.  Ron  Kratzner.  Anderson  University 
See  W.1.D  for  complete  description 

F.310.Me  Getting  and  Keeping  an  Academic  Position 

Medill  - Fee  $10.00  (Fee  waived  if  conference  fee  paid) 
PRESENTERS:  Jerry  Jinks,  Illinois  State  University 
Gregory  Manchant.  Ball  State  University 
Kim  Metcalf ; Indiana  University 

This  three  hour  workshop  is  intended  primarily  for  graduate 
students  anticipating  careers  in  higher  education  and  early 
career  faculty  who  are  in  the  initial  stages  for  establishing  their 
records  for  tenure  and  promotion.  Others  who  might  find  the 
workshop  of  interest  include  those  who  may  not  have  had  recent 
experience  with  the  academic  job  market  but  are  serving  as 
advisors  for  graduate  students  as  weil  as  faculty  and 
administrators  interested  in  faculty  recruitment.  The  workshop 
is  presented  in  two  parts.  The  first  part  deals  with  the  job 
search  and  the  second  part  deals  with  adjusting  to  the  facutly 
role  and  with  preparing  oneself  for  merit  review,  tenure,  and 
promotion.  Faculty  search  and  evaluation  procedures  will  be 
reviewed,  examples  of  application  letters  and  vitae  will  be 
provided  as  will  insights  into  the  screening  and  interview 
processes.  Suggestions  for  managing  the  teaching, 
scholarship,  and  service  expectations  of  the  faculty  role  will  also 
be  presented  along  with  techniques  for  building  a strong  dossier. 
The  presenters  will  bring  their  collective  faculty  and 
administrative  experience  with  institutions  of  various  missions, 
sizes,  and  locations  to  bear  upon  separating  myth  from  reality 
regarding  academic  job  searches  and  faculty  evaluation. 


S.  1010. ME  Ways  to  Assess  and  Enhance  Students’ 
Self-Concepts  Mediil-Fee  $5.00 
(Fee  waived  if  conference  fee  paid) 

PRESENTERS:  James  R.  Necessary.  Ball  State  University 
Thomas  Pahsh,  Kansas  State  University 
This  90  minute  workshop  will  discuss  ways  to  assess  self- 
concepts  and  other  social-emotional  attributes,  focusing  on 
different  approaches  to  measure  and  interpret  results  of  various 
scales.  Then,  various  methods  for  enhancement  will  be 
presented,  including  regular  and  alternative  pathways.  Specific 
strategies  will  be  discussed 
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MWERA95  SPECIAL  SESSION 


CRISIS  IN  EDUCATION 

WHO  ARE  THE  PLAYERS? 

WHO  PROFITS? 

WHAT  IS  THE  AGENDA? 

David  Berliner 


Medill  Room,  Bismarck  Hotel,  171  W.  Randolph,  CHICAGO,  IL 


Public  Invited  - 8:00  pm  - No  Charge 


Sponsored  by  the  Mid-Western  Educational  Research  Association 


Please  duplicate,  distribute,  and  post  this  announcement 
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Coffee  8:00  a.m. 

Sponsored  by  Brown  & Benchmark  Publishers 


9:00  a.m.  - 10:00  a.m. 


T.9.MAX 

Opening  Keynote  Address 

The  Manufactured  Crisis  in  Education: 
Separating  Facts  from  Fancy 

SPEAKER:  David  Berliner,  Arizona  State  University 

9:00-10:00  a.m. 
in  the  Maximilian  Room 

I 

CHAIRS:  Sharon  McNeely,  Northeastern  Illinois  University 
Gregory  Merchant,  Ball  State  University 


10:10  a.m.  - 11:40  a.m,  ] 

t.ioio.f  New  Member  Welcome: 

An  introduction  for  those  new  to  MWERA  or  the  annual  meeting 
10:10-11:40  a.m.  Parlor  F 
CHAIR:  Connie  Bowman,  University  of  Ohio 
PARTICIPANTS:  MWERA  Officers  and  friends 

t.ioio.l  Discussion  Group 

10:10-11:40  a.m.  Lincoln 
CHAIR:  Clint  Chase 

GUEST:  David  Berliner,  Arizona  State  University 
Follow  up  to  the  Keynote  Opening  Address 
An  informal  discussion 

T.f  0:10.A  Preservice  Teacher  Education 
(Division  K-Paper  Session)  10:10-11:40  a.m.  Parlor  A 
CHAIR:  Unda  Ptevyak,  Ohio  State  University 
PARTICIPANTS: 

Unlimited  Wait-Time  in  University  Classrooms  and  Individual 
Settings  Orpha  K.  Duel!,  Tany’a,  Swygert , Wichita  State  U. 
Process  vs.  Product  Methods  of  Making  STAD  Team  Awards 
William  J.  Gnagey,  Jo  L.  DeNoyer,  Illinois  State  University 
Personal  and  Interpersonal  Narrative:  An  Experiential  Approach 
the  Study  of  Human  Development  William  New,  De  Pauw  U. 
DISCUSSANT:  Mark  Mostert,  Moomhead  State  University 

T.IOIO.B  Issues  on  School  Climate  and  Student  Perceptions 
(Division  B-Symposium)  10:10-11:40  a.m.  Parlor  B 
CHAIR:  Dr.  Carolyn  Benz,  Univerity  of  Dayton 
PARTICIPANTS: 

Comer  School  Development  Process:  Differences  Among  Three 
Grade  Levels  in  Perception  of  School  Climate  Carolyn  Benz,  U. 
of  Dayton;  Mary  Lou  Andrews,  Pat  Hoyle,  Montgomery  County 
Schools  Pam  Young,  Springfield  City  Schools 


T.1010.C  Impediments  to  Minority  Success 

(Division  G-Paper  Session)  10:10-11:40  a.m.  Parlor  C 
CHAIR/DISCUSSANT;  Mary  Ann  Flowers,  Cleveland  State  U. 
PARTICIPANTS: 

Refuting  the  Myth  of  the  Model  Minority:  The  Case  of  Asian 
Americans  in  Education  Judy  H.  Kim,  U.  of  IL  Urbana-Champ. 
The  Grammatical  Glass  Ceiling  Impacting  Minority  Employees 
Roger  Dore,  Loyola  University  of  Chicago 
The  Learning  Climate  for  Junior  High  Minority  Students  in  a 
Midwestern  School  Mary  Ann  Bendezu , U.  of  Nebraska-Lincofn 

T.1010.D  Issues  Pertaining  to  Combining  Item  Formats  in  a 
Statewide  Assessment 

(Division  D-Symposium)  10:10-11:40  a.m.  Parlor  D 
CHAIR:  Christine  Fox , University  of  Toledo 
ORGANIZER/PARTICIPANT:  Jan  Crandell,  Ohio  Dept  of  Ed. 
PARTICIPANTS:  Sharon  Frey,  Sara  Hennings,  Tom  Hirsch, 
Riverside  Publishing  Company 

This  is  a Symposium  of  four  presentations.  They  are  as  follows: 
The  Design  of  an  Assessment  Using  Both  Multiple-Choice  and 
Open-Ended  Questions;  Scaling  and  Equating  Test  Forms 
Using  Multiple  Item  Formats;  Test  and  Scoring  Reliability 
Issues;  Differential  Item  Functioning  and  other  Fairness  Issues 

T.1010.E  Teacher  Education 

(Division  K-Paper  Session)  10:10-11:40  a.m.  Parlor  E 

CHAIR/DISCUSSANT:  Susan  M.  Brookhart,  Duquesne  U . 

PARTICIPANTS: 

Contemporary  Supervisory  Practices:  Profiling  the  Cooperating 
Teacher  William  G.  Sparks  III,  Diana  L Jones,  Illinois  State  U. 
What  Research  Tells  Us  About  Nontraditional-Aged  Students 
Mary  Bendixen-Noe , The  Ohio  State  University 
The  Effects  of  Teacher  Age,  Teacher  Experience  and 
Administrative  Level  of  the  Evaluator  in  Employment  Screening 
Decisions  A.  William  Place,  U.  of  Dayton;  John  Newby,  New 
Castle  High  School 

T.130.ME  A Self-esteem  Mentoring  Program  for  Children 
and  Adolescents  with  Disabilities  in  Public  Schools 
1:00-2:30  p.m.  (90  minute  workshop)  Medill 
$5  fee  waived  if  registered  with  full  conference  payment 
CHAIR:  E.  Jane  Williams,  Columbus  Ohio 
PRESENTERS:  Eddie  E.  Glenn,  IL  State  U.;  Judy  Walker, 
Devt.l  Psychologist;  Died  re  Jackson,  Bradley  U.;  Thomas 
Midgette,  University  of  Arkansas 
*See  descriptor  on  workshop  pages 


11:50  a.m.  - 1:20  p.m. 


T.1150.A  Educational  and  Training  Issues  in  the 
Professions 

(Division  1-Paper  Session)  11:50-1:20  p.m.  Parlor  A 
CHAIR:  Mary  E Lunz,  American  Society  of  Clinical  Pathologists 
PARTICIPANTS:  Enhancing  Learning  for  Future  Work:  A 
Description  of  an  On-going  Research  Program  Ronald  R. 
Morgan,  Loyoia  U.  of  Chgo ; Edward  E.  Gordon,  N.  Am.  Inst . for 
Training  and  Educ.  Research;  Judy  J.  Ponticell,  Texas  Tech  U. 
Predicting  Persistence  in  Distance  Learning  Programs  Nancy  F. 
Fjortoft,  University  of  Illinois  at  Chicago 
Policy  Influences  and  Effects  on  Post-Baccalaureate 
Educational  Opportunities  in  Engineering  Peggy  Simpson, 
University  of  Cincinnati 

DISCUSSANT:  Kevin  C.  Larkin,  American  Dental  Association 


WiST  COPY  AVAILABLE 


T.1150.ME  Attitudes  of  Under-Represented  Groups  Toward 
Mathematics,  Science,  and  Other  School  Subjects 

(Cross-Divisions  Symposium)  11:50-1:20  p.m.  MediH 
CHAIR/ORGANIZER:  Thomas  Andre,  Iowa  State  University 
PARTICIPANTS:  Myma  Whigham,  Carlie  C.  Tartakou,  Charlotte 
Hasehuhn,  Thomas  Andre,  Iowa  State  University 

T.1150.B  Teaching  as  Research:  Educational  Research, 
Teachers  and  the  Missing  Paradigm 

(Division  K-Symposium)  11:50-1:20  p.m.  Parlor  B 
CHAIR:  Sandra  Michelson,  Valparaiso  University 
ORGANIZER:  Jeff  Kuzmic,  De  Paul  University 
PARTICIPANTS:  Jessie  Trepanier-Mougette,  Ranchview  Efem . 
School;  Robert  Mankiewicz,  Chgo  Voc.  School;  Steven  Strull, 

Du  Sable  High  School;  Stephanie  Turrell,  Brvokdale  Elementary 

T.1150.C  Individual  Differences 
(Division  C-Paper  Session)  11:50-1:20  p.m.  Parlor  C 
CHAIR/D1SCUSSANT:  Marlene  Schommer,  Wichita  State  U. 
PARTICIPANTS: 

Further  Validation  of  the  Coping  Strategies  Inventor/  for 
Statistics  Shawn  M.  Fitzgerald,  Michael  LeBlanc,  U.  of  Toledo 
A Model  of  Collegiate  Aviation  Performance  Gerald  £ Larson, 
Navy  Persl.  Research  and  Devt . Ctr;  Ronna  F.  Dillon,  So.fL  U. 
Gender  Differences  in  SAT  Scores:  Analysis  by  Race  and 
Socioeconomic  Level  Charles  Frederick  Haigh,  Ball  State  U.  & 

Ft.  Wayne  Comm.  Schools 

T.1150.D  Statistical  Methods:  Monte  Carlo  Techniques 

(Division  D-Paper  Session)  11:50-1:20  p.m.  Parlor  D 
CHAIR:  James  R.  Necessary,  Ball  State  University 
PARTICIPANTS: 

The  Effects  of  Skewed  Pretest  and  Posttest  Marginal 
Distributions  on  the  Dependent  T-Test  and  the  Wilcoxon  Signed 
Rank  Test  Reed  A.  Castle,  Barbara  S.  Plake,  U.  of  Nebraska 
MANOVA  Simultaneous  Test  Procedures:  A Comparison  of  the 
Robustness  Properties  of  Selected  Contrasts  Janet  K.  Sheehan, 
Northern  Illinois  U. 

Predictive  Power  Method  for  Selecting  Regression  Sample 
Sizes  Gordon  P.  Brooks,  Robert  S.  Barcikov/ski,  Ohio  U. 
DISCUSSANT:  Jeffrey  B.  Hecht,  Illinois  State  University 

T.1150.E  Expanding  Multicultural  Understanding 

(Division  G-Paper  Session)  11:50-1:20  p.m.  Parlor  E 
CHAIR/DISCUSSANT:  Ruth  Koskela,  U.  of  Wis. -Whitewater 
PARTICIPANTS: 

The  Multicultural  Mentorship  Project  Norvella  Carter,  IL  State  U. 
Expanding  Multicultural  Understanding  Through  the  Story  Time 
Experience  Mary  Ann  Wham,  U.  of  Wisccnsin-Whitewater 
Children’s  Prejudice  and  Social  Attitudes:  What  Has  Cognitive 
Developmental  Level  Got  to  do  with  Them?  Joan  Thrower 
Timm,  University  of  Wisconsin-Oshkosh 

T.1150.L  Evaluating  the  Effects  of  Environmental  Science 
Programs  on  Teachers,  Students,  and  Communities 

(Division  H/K-Symposium)  11:50-1:20  p.m. Lincoln 
ORGANIZER:  Deborah  Bainer,  Ohio  State  University-Ma  /sfield 
PARTICIPANTS:  Deborah  Bainer,  Ohio  State  U.-Mansbald ; Don 
Williams,  Ohio  State  U.  -Columbus;  Carol  Fialkowski,  Chgo 
Acad,  of  Sciences;  Bona  Simmons,  Lorado  Taft  Center 


T.1150.MAX  State-wide  Assessment  Practices:  Using 
Student  Assessment  Data  Bases  in  General,  and  the  Illinois 
Data  Base  in  Particular 

11:50-1:20  p.m.  (Presentation/Workshop)  Maximilian 
PRESENTERS:  Arie  van  derPioeg , North  Central  Regional 
Educational  Laboratory 
See  description  on  workshop  pages. 

T.1150.F  Preservice  Teacher  Education 

(Division  K-Paper  Session)  11:50-1:20  p.m.  Parlor  F 
CHAIR:  Anna  Austin,  National  Louis  University 
PARTICIPANTS: 

Preservice  Teachers  Changing  Attributions  to  Elementary 

Students  Success  or  Failure  Stephen  R.  Wallace,  Thomas  E. 

Thompson,  Northern  Illinois  University 

Teaching  and  Learning:  Calculators  in  5th  and  6th  Grade  Mary 

Ellen  Schmidt,  Ohio  State  University 

Preservice  Elementary  Teachers’  Representations  of  Science: 

Photography  of  Science  in  Your  Neighborhood  Gilbert  L Naizer, 

Ohio  State  University  at  Newark 

DISCUSSANT:  Kathleen  Maury,  Mankato  State  University 


1:30  p.m. -3:00  p.m. 


T.130.A  Legallssues  and  State  Trend* 

(Division  A-Paper  Session)  1:30-3:00  p.m.  Parlor  A 
CHAIR:  Charles  Kline,  Purdue  University 
PARTICIPANTS: 

Public  School  Academies:  Legal  and  Administrative  Challenges 
to  Charter  Schools  in  Michigan  Lyndon  G.  Furst,  Andrews  U, 
Censorship  Attempts  in  Ohio  Schools,  1990-1995  Norman  L 
Sommers,  Ashland  University 
Politics  and  “Punks”:  The  Origins,  Implementation  and 
Consequences  of  Michigan’s  Weapon-Free  Schools  Act  Beverly 
B.  Geftner,  Eastern  Mich.  U.;  John  S.  Gooden,  Georgia  So.  U. 
DISCUSSANT:  Carolyn  Benz,  The  University  of  Dayton 

T.130.B  Teacher  Education  Program* 

(Division  K-Paper  Session)  1:30-3:00  p.m.  Parlor  B 
CHAIR:  Carole  Newman,  University  of  Akron 
PARTICIPANTS: 

The  Effect  of  Specialized  Middle  Level  Preparation:  A Case 
Study  S.  Carmen  Giebelhaus,  U.  of  Dayton 
Frame  Theory  Analysis  of  the  Cultures  of  Three  Outstanding 
Teacher  Induction  Programs  Karen  M.  Peterson,  Gov. State  U., 
Janet  T.  Bercik,  Northeastern  Illinois  U.f 
A Variety  of  Ideal  Visions:  A Study  of  Teacher  Education  Mary 
Lou  Morton,  Joan  Kavanaugh,  Kwee  Hiong  Ong,  Kelly  Sputh, 
Indiana  U. 

DISCUSSANT:  Kathleen  Maury,  Mankato  State  University 

T.130.C  Reforms  and  Reformers:  A Historical  Perspective 

(Division  F-Paper  Session)  1 :30-3:00  p.m.  Parlor  C 
CHAIR;  Louise  Fleming,  Ashland  University 
PARTICIPANTS: 

Charles  William  Eliot:  His  Life  and  Contributions  to  Education 
Kenny  O.  McDougle,  Pittsburgh  State  University 
The  Importance  of  the  Music  Educator  in  the  Misiones 
Culturales  Experiment  During  the  Era  of  Socialist  Education  in 
Mexico  David  G.  Tovey,  The  Ohio  State  University , Mansfield 
Political  Theory  in  the  Classroom:  The  Black  Panther  Party  and 
Cultural  Nationalists  Joy  Williamson,  U.  of  Illinois  at  Urbarm 
DISCUSSANT:  Michael  Penrod,  SE  Kansas  Ed.  Service  Center 
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T.450.D  Technological  innovations  in  Educational  Research 

(Division  D-Symposium)  4:50-6:20  p.m.  Parlor  D 
CHAIR:  Jeffrey  Hecht,  Illinois  State  University 
PARTICIPANTS:  David  J.  Dwyer,  Gigai  Fansler,  Nicole  K. 
Roberts,  Perry  L Schoon,  Illinois  State  University 

T.450.F  Access  and  Success  in  Higher  Education 
(Division  J-Paper  Session)  4:50-6:20  p.m  Parlor  F 
CMAIR/DISCUSSANT:  Wayne  Van  Zomeren,  NW  Missouri  S.U 
PARTICIPANTS: 

Students*  Perceptions  of  Exceptional  Teaching:  Traditionally  or 
Cooperatively  Defined?  Monica  Silva-Raveau,  Mladen 
Koljatic, Ron tificia  Universidad  Catolica  de  Chile;  Frances  Stage, 
Indiana  University 

Access  to  Higher  Education  in  South  Africa:  The  Role  of  ‘Black1 
and  ‘White*  Universities  in  the  Provision  of  African  Graduates 
Reitumetse  O.  Mabokela,  U.  of  Illinois  at  Urbana-Champaign 
Examining  the  Ramifications  of  Pre-collegiate  Intervention  for 
Disadvantaged  African  American  Students  Allen  J . Bryson, 
University  of  Illinois  at  Urbana 

T.450.L  Social,  Moral  and  Motivation  Issues  in  Schooling 
(Division  G- Paper  Session)  4:50-6:20  p.m  Lincoln 
CHAIR/DISCUSSANT:  Clara  New,  U.  of  Wisconsin,  Parkside 
PARTICIPANTS: 

Peer  Disputes  Among  Preschoolers:  Issues  and  Strategies 
Elizabeth  J.  Lokon,  Miami  University 
Influencing  the  Academic  Achievement  of  At-Risk  Students 
Through  Computer  Technology  Linda  Behar-Horonstein, 
University  of  Florida 

A Qualitative  Study  of  Volunteer  Experience  and  Motivation  in  a 
Christian  Setting  Nancy  G.  Saunders ; Ball  State  University 


TABLE  POSTERS/SMALL  DISCUSSION  GROUPS 


T.450. Max  (Mixed  Divisions)  Maximilian 
CHAIR:  Mian  Yusuf,  University  of  Wisconsin,  Parkside 


PARTICIPANTS: 

The  Classroom  as  a Moral  Context  Cary  A.  Buzzelli,  Usa  Cutter, 
Ali  Al  Jafar,  Indiana  University 

The  Interaction  of  Self  and  Science:  Raising  Questions  About 
the  Validity  of  Inquiry  in  Educational  Research  Carolyn  Benz, 
Julie  Biddle , University  of  Dayton 
Individualism-Collectivism  as  Predictors  of  Stress  Type, 
Attribution,  and  Stress  Coping  Changming  Duan,  Hoyoung  Kim, 
Lucy  Hlavac > Paul  Vu,  University  of  Missouri-Cdumbia 

An  Explanation  into  the  Role  of  Support  Community  as  a 
Negotiation  Toward  Meaning  for  Doctoral  Students  in  Education 
Tammy  Gooch,,  Indiana  University 

How  Does  Centering  Affect  Interpretability  in  Hierarchical  Linear 
Modeling?  Tianqi  Han , Janet  K Sheehan,  Northern  IL  U. 

Job  Satisfaction  and  Dissatisfaction  among  a National  Sample 
of  School  Psychologists  Alex  Thomas,  Miami  University 
A Multi-faceted  Evaluation  of  Satisfaction  and  Reading 
Improvement  Using  the  Writing  to  Read  Computer  Program 
Robert  G.  Harrington,  DickB.  Tracy,  University  of  Kansas 


T»450.#505  Writing  a Letter  of  Application:  Addressing  the 
Partinant  Issues  4:50-6:20  Room  #505  Fee  $5.00 
(Fee  waived  if  conference  registration  paid) 

CHAIR:  Cheryl  Kish,  Northern  Illinois  University 
PRESENTERS:  Mary  K.  Bendixen-Noe,  Gilbert  L Naizer,  Ohio 
State  Universrty-Newark  * See  descriptor  on  workshop  pages 


6:30  p.m.  - 3:00  p.m. 

T^630  Max  _ ~ 

Cracker  Barrel 

6:30-8:00  p.m.  Maximilian 

Friendly  conversation  and  cash  bar 

COORDINATOR:  Adria  Karle-Weiss,  Murray  State  Univ. 


PLEASE  SHARE  THIS 
PROGRAM  WITH  YOUR 
COLLEAGUES  AND  OTHERS! 

i 

This  program  is  distributed  to  all  paid 
membership  as  part  of  membership  dues, 
and  to  Researcher  subscribers. 

Producing,  printing,  and  mailing  this 
program  costs  MWERA  thousands  of 
dollars.  We  ask  our  members  to  share 
their  programs  with  others  who  may  like 
to  attend,  as  our  members  are  our  best 
resources  to  spread  the  word  about  our 
program  and  our  association.  We  hope 
that  you  will  photocopy  and  distribute 
registration  forms,  the  special  “flyer” 
pages,  and  any  other  parts  of  the  program 
that  you  think  others  will  be  interested  in. 
We  are  particularly  hopeful  that  you  will 
share  copies  of  the  workshop  pages  with 
your  local  school  administrators  and 
teachers. 
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BEST  COPY  AVAILABLE 


FRIDAY,  OCTOBER  13 


MWERA95  SPECIAL  SESSION 


The  Greatly  Exaggerated 

Death  of  our  Schools  Gerald  Bracey 


Palace  Ballroom,  Bismarck  Hotel,  171  W.  Randolph,  CHICAGO,  IL 


Public  Invited  - 11:50  a.m.  -$23.00 


Sponsored  by  the  Mid-Western  Educational  Research  Association 


All  attendees  must  pre-register  with: 

Jean  W.  Pierce,  EPCSE  Dept.,  NIU,  DeKalb,  IL  60115-2854 
PH:  815/753-8470  FX:  708/232-1892  INTERNET:  JPIERCE@NIU.EDU 

Please  duplicate,  distribute,  and  post  this  announcement  749 


FRIDAY 


Coffee  8:00  a.m. 

F.8.A-L  Division  Meetings 

(DIVISIONS  A-F&K)  8:00-9:00  a.m.  Parlors  A-F&L  respectively 
Discussion-bring  your  coffee  and  rolls  and  review  past  and  plan 
future  with  your  Division  colleagues 

F.9.ME  Business  Meeting 
9:00-10:00  a.m.  Medill 

(General  business  meeting  for  ail  to  attend-information,  input, 
and  graduate  student  awards) 

CHAIR:  Thomas  Andre,  Iowa  State  University 
PARTICIPANTS:  All  MWERA  Members 


EXH5BIT  HALL 

9:00-4:00  p.m.  Maximilian 

Publisher  and  materials  showroom 
COORDINATORS:  Nancy  Fellows  and  Ellen  Fiedler 
Bring  notices  for  jobs,  mentoring  and  miscellaneous 
items  for  resources  sharing  table. 


10:10  - 11:40  a.m. 


F.101Q.ME  Creating  Culturally  Compatible  Classrooms 
(Invited  Address)  10:10-11:40  a.m.  Medill  Room 
PRESENTER:  Barbara  Shade,  U.  of  Wisconsin-Parkside 
This  presentation  will  help  the  participants  think  about  the 
impact  of  culture  on  classroom  climate,  the  teacher-learner 
interaction,  and  the  impact  of  thinking  styles  on  the  teaching- 
learning  process.  More  important,  participants  will  brainstorm 
and  develop  ideas  which  help  address  these  cultural 
differences. 

F.1010.A  Early  Field  Experiences 
(Division  K-Paper  Session)  10:10-11:40  a.m.  Parlor  A 
CHAIR/DISCUSSANT:  Charles  Runyan,  Pittsburg  State  U. 
PARTICIPANTS: 

Longitudinal  Study  of  an  Experimental  Field-Based  Pre-Service 
Elementary  Education  Program  Bernard  W.  Arenz,  U.of  Texas - 
El  Paso;  David  Brown , SW  Missouri  State  U. 

Early  Clinical  Experiences:  The  Debate  Between  Continuity  and 
Diversity  Elizabeth  Wilkins,  Audrey  Edwards,  Eastern  IL  U. 
Components  of  a Pre-Service  First  Year  Experience:  Focus  on 
Preparation,  Peer  Advising,  Portfolios,  and  Professional 
Attitudes  Donna  Barron,  Susan  Ferguson,  University  of  Dayton 

F.1010.B  Various  Assessments  Related  to  Schools 

(Division  H-Paper  Session)  10:10-11:40  a.m.  Parlor  B 
CHAIR:  Sharon  Latkovich,  Ashland  College 
PARTICIPANTS: 

Assessing  Elementary  Teachers'  Training  in  Teaching  Science 
by  Inquiry  Kathleen  Sparrow,  Akron  City  Schools 
The  Transition  Process  From  Middle  School  to  High  Schools:  An 
Evaluation  Study  Carol  Furtwengler,  Witchita  State  U.;  David 
Hurst,  Bill  Furtwengler,  Randall  Turk,  Witchita  State  U. 

A Comparison  Among  Four  Methods  Used  to  Test  Single-Case 
Designs:  A Monte  Carlo  Study  Isadora  Newman,  U.  of  Akron 
Teaching  Language  Arts:  Perspectives  from  the  College  and 
Elementary  Classroom  Elizabeth  G.  Biederstedt,  Indiana  U. 


F.1010.C  Cognitive  Development 

(Division  C-Paper  Session)  10:10-11:40  a.m.  Parlor  C 
CHAIR/DISCUSSANT:  Jennifer  Fager,  Western  Michigan  U. 
PARTICIPANTS: 

Epistemological  Beliefs  and  Valuing  School:  Touching  the 
Heartstrings  of  Learning  Marlene  Schommer,  Kiersten  Walker, 
Witchita  State  University 

Reconstructing  the  Paradigm  of  Learning  Disabilities:  A 
Holistic/Constructivist  Interpretation  Betsy  Grobecker, 

University  of  Southern  Indiana 

Life-Span  Developmental  Psychology:  Implications  for  Adult 
Education  and  Learning  Thomas  L.  Pourchot,  Northern  Illinois  U. 

F.1010.D  Genera  I liability  Theory,  Rasch,  and  Equating 
(Division  D-Paper  Session)  10:10-11:40  a.m.  Parlor  D 
CHAIR:  Julie  Gedeon,  Kent  State  University 
PARTICIPANTS: 

The  Validity  and  Reliability  of  Student  Annotations  of  Work 
Samples  in  Portfolios  Susan  M.  Brookhart,  Duquesne  University 
National  Database:  Equating  Scores  Between  the  1991  Long- 
Form  Instrument  and  the  1994  Revised  Instrument  Mohammed 
A.  Rahman  and  William  E.  Loadman,  Ohio  State  University 
A Comparison  of  Two  Approaches  of  Estimating  Reliability: 
Generalizability  Theory  and  Rasch  Model  William  £ Loadman, 
Abdelhafez  Q.  Al-Shayeb,  Ohio  State  University 
DISCUSSANT:  Susan  Holmes , Riverside  Publishing 

F.1010.E  Applications  of  Functional  Assessment  in 
Rehabilitation  Medicine 

(Division  i-Symposium)  10:10-11:40  a.m.  Parlor  F 
CHAIR:  Gene  A.  Kramer,  American  Dental  Association 
PARTICIPANTS: 

Measuring  the  Extent  of  Disability  With  the  FIM*"  Alan 
Heinemann,  Rehabilitation  Institute  of  Chicago 
Using  LifeScaies™  to  Assess  Levels  of  Disabilty  Richard  M. 
Smith,  Rehab  Fndtn,  Inc.  / Marianjoy  Rehab  Hospital  and  Clinics 
DISCUSSANT:  Benjamin  D.  Wright,  University  of  Chicago 

F.1010.F  Developing  Research-Based  Student  Teaching 
Supervision  Materials 

10:10-11:40  a.m.  Parlor  F-  Fee  $5.00 

(Fee  waived  if  registered  with  full  conference  payment) 

CHAIR:  Janet  Bercik,  Northeastern  Illinois  University 
PRESENTERS:  Donald  Williams,  Doug  Smith,  Hema 
Ramanathan,  Laura  Lipsett,  Ohio  State  University 
* see  description  on  workshop  pages 

F.1010.#505  Issues  for  Success  and  Inclusion 

(Mixed  Divs-Table  Poster/Small  Discussion  Groups) 

10:10-11:40  a.m.  #505 

CHAIR;  Richard  Lipka,  Pittsburgh  State  University 
PARTICIPANTS: 

Cross-Modal  or  Cross-Hemispheric  Deficits  for  Dyslexia?  A 

Comparison  of  Average  and  Reading-Disabled  College  Students 

Sharon  K Chambers,  Iowa  State  University 

Prevalence  of  Attention  Deficit  Hyperactivity  Disorder  in  Adults 

with  Mental  Retardation  Gholam  Kibria,  Delaware  State  U;  Lew 

Miller,  Stockley  Center ; Delaware 

Performance  of  Students  in  an  Inclusion  Setting  David  E. 

Suddick , Irene  Fioravanti,  Governors  State  University 


F.450.D  Validity  In  Qualitative  Research:  A Symposium 

(Division  D-Symposium)  4:50-6:20  p.m.  Parlor  D 
CHAIR/ORGANIZER:  Marcia  Salner,  Sangamon  State  U. 
PARTICIPANTS: 

Reene  Alltcy,  U.  Akron ; John  Cresweil,  Dana  Miller,  U Neb; 
Jeffrey  Hecht,  IL  SU;  Rich  Hoffman , Peter  Magokfa,  Miami  U. 
This  is  a symposium  of  five  presentations.  They  are  as  follows: 
How  Qualitative  Research  Makes  Differing  Demands  on  Validity 
Terminology;  Important  Methodological  Steps  to  Improving 
Validity  of  Qualitative  Results;  Issues  Such  as  Self-Deception 
and  How  it  Differs  from  Benign  Self-reflexivity;  How  to  Relate 
Various  Methods;  How  Technological  Media  Affect  Validity  of 
Researchers’  interpretations  of  Subjects’  Experience 

F.450.E  Facilitating  Student  Achievement 

(Division  E-Paper  Session)  4:50-6:20  p.m.  Parlor  E 
CHAIR/DISCUSSANT:  Sharon  E.  Paulson,  Ball  State  University 
PARTICIPANTS: 

A Comparison  of  Standardized  Measures  of  Achievement  and 
Ability  with  Locally  Normed  Curriculum  Based  Measures  of 
Reading  in  a High  Achieving  District  Ann  Glesson,  Ronald  R. 
Morgan,  Loyola  University  of  Chicago 

School  Achievement,  Age,  and  Students’  Perception  of  Parental 
Encouragement  for  Schoolwork  Jupian  J.  Leung,  Daniel  O. 

Lynch , UWis-Oshkosh 

The  Family  Interview:  A Technique  of  Early  Childhood 
Assessment  Barbara  Lowenthal,  Northeastern  Illinois  University 

F.450.F  Learning  to  Become  a Teacher:  Exploratory  Studies 
into  the  Phenomena  of  Pre-Service  Preparation 
(Division  K-Symposium)  4:50-6:20  p.m.  Parlor  F 
CHAIR/DISCUSSANT:  Jesse  Goodman,  Indiana  University 
PARTICIPANTS: 

Betsy  Biederstedt,  Marie  Boozer,  Susan  Clayton-Randolph, 
Mem’e  Beth  Fisher,  Tammy  Gooch,  Evelyn  Horn,  Melody  Shank, 
Indiana  University 

F.450.L  A Relational  Approach  to  School  Change:  Chicago 
Teachers  Center/Chicago  Public  Schools 
(Forum)  4:50-6:20  p.m.  Lincoln 

CHAIR/ORGANIZER: Dear?  Micheal  Carl,  Northeastern  IHiniois 
University 

PARTICIPANTS:  Wendy  Stack,  Elaine  Koffman,  Marilyn  Koule 
George,  Margie  Neal,  Jerry  Olson,  Mike  Carl,  Northeastern 
Illinois  University 

President’s  Reception 

Everyone  is  invited! 

It’s  casual  Soft  beverages  provided 
9:00  p.m.  until  ? Regency  Suite 
HOST:  Thomas  Andre,  Iowa  State  University 
COORDINATORAdria  Karle-Weiss,  MurrayS U 


DID  YOU  KNOW  THAT  YOUR 
ATTENDANCE  ON  SATURDAY 
MAKES  A BIG  DIFFERENCE? 

YES,  DIVISIONS  ARE 
ALLOCATED  SESSIONS  BASED 
ON  THE  NUMBER  OF  MEMBERS 
IN  A DIVISION  AND  BASED  ON 
THE  ATTENDANCE  AT 
SESSIONS. 

IN  THE  PAST,  SOME  MEMBERS 
WHO  HAVE  BEEN  VERY  VITAL 
TO  SESSIONS  ON  THURSDAY 
AND  FRIDAY  HAVE  NOT  COME 
TO  SATURDAY  SESSIONS, 
LOWERING  ATTENDANCE 
COUNTS  THAT  DAY.  THIS 
LEADS  SOME  TO  BELIEVE 
THAT  SATURDAY  SESSIONS 
ARE  LESS  IMPORTANT. 

SATURDAY  SESSIONS  ARE 
PUT  TOGETHER  JUST  LIKE  ANY 
OTHER  SESSIONS.  THEY 
WERE  NOT  RATED  LOWER  BY 
REVIEWERS,  AND  THE 
PRESENTERS  ARE  LOOKING 
FORWARD  TO  HAVING  AN 
AUDIENCE.  I HOPE  YOU  WILL 
BE  THERE! 
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8:00  a.m.  - 9:00  a.m. 


S.8.B-F  DIVISION  MEETINGS 

(Divisions  G-K)  Parlors  B-F 

Div  G in  Parlor  B Div  I in  Parlor  D Div  K (2nd  Part)  Parlor  F 

Div  H in  Parlor  C Div  J in  Parlor  E 


9:00  a.m.  - 10:00  a.m. 

S.9.Max 

PRESIDENTIAL  ADDRESS 

Science,  Gender  and 
The  Thinking  School 

SPEAKER:Thomas  Andre,  Iowa  State  U. 

9:00  a.m.  in  the  Maximilian  Room 


10:10  a.m.  -11:40  a.m. 


S.  lOIO.Max  On  Publishing  in  Educational  Psychology 
(Mixed  Divs-Discussion  Grp)  10:10-11:40  a.m.  Maximillian 
PRESENTER: 

Paul  Pint  rich,  Editor  of  the  Educational  Psychologist 

5.1010. A  Collaboration  and  Programmatic  initiatives 

(Division  A-Paper  Session)  10:10-11:40  a.m.  PariorA 
CHAIR:  Thomas  Oldenski,  The  University  of  Dayton 
PARTICIPANTS: 

Strategies  that  Promote  Collaboration  Between  School  Districts: 
A Study  of  School  District  Collaboration  Randali  Turk , William 
Furtwengler,  Carol  Furtwengler,  David  Hurst , Wichita  State  U. 
The  University  and  The  School:  A Leadership  Model  for  Col- 
laboration Inquiry  C. Stephen  Obom , Gay  Lynn  Shipley , UDayton 
Education  Reform:  Programmatic  Initiatives  in  Indiana’s  Larger 
School  Districts  Theodore  J.  Kowalski,  Terry  L Wiedmer,  BallSU 
DISCUSSANT:  Marilyn  Grady,  University  of  Nebraska  at  Lincoln 

5.1010. B  Preservice  Teachers 

(Division  K-Paper  Session)  10:10-1 1:40  a.m.  Parior  B 
CHAIR:  Nancy  Fjortoft,  U of  Illinois 
PARTICIPANTS: 

Preservice  Teachers  Most  Identified  Needs  and  Most 
Troublesome  Questions  Joy  McCullough,  Trinity  Western  U. 
Needs  Assessment  to  Train  Preservice  Teachers:  Using  Two 
Factor  Analytic  Studies  to  Refine  A Teacher  Needs  Assessment 
Instrument  Charles  Runyan,  Rozanne  Sparks,  David  Hurfond, 
Richard  Lipka,  Pittsburg  State  University 
Preservice  Teachers’  Change  in  Perceptions  of  Their  Needs  in  a 
Two-Week  Pre-Student  Teaching  Experience  Jacqueline  K. 
Collier ; Miami  University 

DISCUSSANT.  Marilyn  K.  Urguhart,  University  of  South  Dakota 
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5.1010. C  Motivation 

(Division  C-Paper  Session)  10:10-11:40  a.m.  Parlor  C 
CHAIR/DISCUSSANT:  Gregory  Schraw,  U.Nebraska-Lincoln 
PARTICIPANTS: 

Elements  of  Both  Cooperation  and  Competition  Within  Learning 
Groups  Mary  Lanigan,  Indiana  University 
The  Relationships  Among  Prior  Achievement,  Motivational 
Characteristics,  and  Attitudes  Toward  Cooperative  Learning 
G.ft  Overbey,  Sarah  E.  Peterson,  Northern  Illinois  University 
Subject  Variables  Related  to  Attributions}  Paradigm  Larry 
Krengel,  Northern  Illinois  University 

5.1010. D  Teacher  Attitudes  and  Interactions 

(Division  G-Paper  Session)  10:10-11:40  a.m.  Parlor  D 
CHAIR/DISCUSSANT:  Clara  New,  U Wis-Parkside 
PARTICIPANTS: 

Faculty  and  Student  Attitudes  Toward  the  Evaluation  of  College 
Teaching  Peter  J.  Brady,  Clark  State  Community  College 
Student-Instructor  Interactions  on  Course  Performance  in 
Statistics:  An  Exploratory  Study  Monica  Silva-Raveau,  Pontifica 
Universidad  CatoUca  de  Chile 
The  Nice  Kind  Teacher1:  A Kindergarten  Teacher's 
Understanding  of  Her  Role  in  Social  Learning  Mandy  Cole, 

Miami  University 

5.1010. E  Legal  and  Counseling  Issues  with  Special 

Needs  Students 

(Division  E-Paper  Session)  10:10-11:40  a.m.  Parlor  E 
CHAIR/DISCUSSANT:  Nina  Dorsch,  Northern  Illinois  U. 
PARTICIPANTS: 

Legal  Issues  of  Children  with  Health  Care  Needs  and  the 
Medical  Nature  of  Related  Services  Cynthia  A.  Dieterich, 
Cleveland  State  University 

Facilitated  Communication:  Failsafe,  Fiction,  or  Fad?  Mark  P. 
Mostert,  Moorhead  State  University 
The  Utility  of  Solution  Focused  Brief  Therapy  in  Schools: 
Potential  From  an  Initial  Study  Deborah  L Mostert,  SE  Regional 
Service  Ctr,  Erin  Johnson,  Mark  Mostert,  Moorhead  SU 

5.1010. F  Preservice  Teacher  Education 
(Division  K-Paper  Session)  10:10-11:40  a.m.  Parlor  F 
CHAIR:  Connie  Bowman,  Ohio  State  University 
PARTICIPANTS: 

Enhancing  Preservice  Social  Studies  Teaching  With  Computers 
Ruth  Koskela,  Alex  Pan , Judson  M.  Lyon,  U Wis~Whitewater 
Teaching  Language  Arts:  Perspectives  from  the  College  and 
Elementary  Classroom  Elizabeth  G.  Biederstedt,  Indiana  U. 
Variety  and  Purpose  of  Adult  Feedback  to  Children's  Oral 
Reading  Errors  Judy  C.  Lambert,  Joyce  H.  Boettcher,  UWis-Osh 
DISCUSSANT:  Toni  Grieg o Jones,  University  of  Wisconsin 


S. 1010. Me  Ways  to  Assess  and  Enhance  Students’  Self- 
Concepts.  Medili  - Fee  $5.00 

(Fee  waived  if  pakJ  conference  registration) 


*see  description  on  workshop  pages 


S.1010.#505  Contradictions  in  History 

(Division  F-Discu$sion)  10:10-11:40  a.m.  Room  #505 
CHAIR/DISCUSSANT:  Louise  Fleming,  Ashland  University 
PARTICIPANTS: 

From  Backwardness  to  At-risk:  Childhood  Learning  Difficulties 
and  the  Contradictions  of  School  Reform  Barry  Franklin 
* A Presentation  followed  by  Group  Discussion 


S.1010.L  Culture  and  Measurement  Issues 

(Mixed  Divs-Table  Poster/Small  Discussion  Groups)  Lincoln 

CHAIR:  Mian  Yusuf,  University  of  Wisconsin,  Parkside 
PARTICIPANTS: 

Factorial  Validity  of  the  Maslach  Burnout  Inventory  for 
Taiwanese  Secondary  School  Teachers  Jimmy  Kijai,  Jerry  Chi, 
Andrews  Unversity 

The  Reliability  of  the  Child  Behavior  Checklist  for  Minorities 
Sharon  A . Latkovich,  Ashland  University 
A Comparative  View  of  Creole  Across  the  Caribbean:  Social  and 
Educational  Issues  Melissa  Macdonald  Manhertz,  Stephen 
Franz , Indiana  University 

Freedom,  Success  and  Justice  in  Popular  Culture:  Lessons  of 
the  Media  Joan  Thrower  Timm,  U of  Wisconsin-Oshkosh 

CHAIR:  Mian  Yusuf,  University  of  Wisconsin,  Parkside 
PARTICIPANTS: 

Measuring  Attitude  Toward  Homework  Cheating  and  Test 
Cheating  in  High  School  Students  Rich  Hofmann,  Keith 
Brackenridge,  Thomas  Moffitt,  Marci  Nichols,  Miami  University 
Using  Structural  Equation  Modeling  Analysis  to  Confirm  the 
Underlying  Dimensions  of  the  New  Michigan  High  School 
Proficiency  Examination  Patricia  Buczynski,  Ml  Educ. 
Assessment  Prog;  Burton  E.  Voss,  U.  Michigan 
Effect  of  Motivation  and  Emotion  on  Cognitive  and  Affective 
Empathy  Changming  Duan , Thomas  Green,  U.  of  Missouri 


5.11. B  Program  Committee  Meeting 
11:00  a.m.  Biackhawk 

All  Division  Chairs,  those  who  want  to  provide  feedback  for  this 
meeting,  and  for  planning  the  1996  meeting. 

NOON:  END  OF  CONFERENCE. 

THANK  YOU  FOR  ATTENDING. 

HAVE  A SAFE  TRIP  HOME 
WE  WILL  PLAN  ON  SEEING  YOU  AT  MWERA  1996 
WATCH  THE  JANUARY  ISSUE  OF  THE 
RESEARCHER  FOR  THE  CALL  FOR  PROPOSALS 
AND  FURTHER  INFORMATION 

5.12. B  Board  of  Directors’  Meeting 
12:00  noon  Biackhawk 

All  current  Board  of  Directors.  The  meeting  may  last  until  5 p.m. 

THE  1996  MWERA  PROGRAM  CHAIR  IS  KIM  METCALF. 

IF  YOU  WOULD  LIKE  TO  HELP  ON  THE  CONFERENCE, 
OR  WANT  MORE  INFORMATION,  CONTACT  HIM. 


BEST  <:opy  AVAILABLE 
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SESSION  DESCRIPTORS: 

Family 

Field  Experience 

F.450.A 

F.1010.A,  F.130.B,  F.450.B 

Retention 

Revising 

F.450.C 

T.310.C 

Gender 

T.1 1 50.C,  T.41 0.MAX,  T.450.B 

School 

Accountability 

F.310.C 

-Equity 

T.1 1150  .A 

-Climate 

T.1010B,  T.1010.C 

Action  Research 

T.1150.B 

-Stereotypes 

F.1 30. D 

-Development 

T.1010.B 

Adaptive  Testing 

T.31 0. A 

Generalizabitity  Theory  F.1 010. D 

-Finance  Equity 

T.31 0. MAX,  F.31 0 A 

Administration 

F.310.A 

Glass  CeHing 

T.1010.C 

-Funding 

T.310.MAX,  F.1 30 A 

Aduit  Education 

F.1010.C 

Hierarchical  Linear  Modeling  T.450.MAX 

Self-esteem 

W.1.E,T.1010.ME 

Art  Education 

F.310.B 

History 

T.1 30.C.,  T.31 0.#505 

Social  Learning 

S.1010.D 

Asian  Americans 

T.1010.C 

Identity  Formation 

F.310.C 

Spatial  Abilities 

T.1150.C 

Assessment  methods  T.31 0.D,  F.450.C 

Inclusion 

T.450.A,  F.130.D 

Spatial  Cognition 

T.31 0 A 

-Alternative 

T.1010.D 

Individual  Differences  T.  1 1 50 . C 

Spatial  Representations  F.1 30.C 

-Educational 

T.310.D 

Inquiry 

S.1010A 

Special  Education 

T.450.C 

-Functional 

F.1010.E 

Instruments 

T.130.D.,  S.1010.L 

State  Trends 

T.130A 

-Performance 

T.1010.D,  F.1010.E 

-Development 

S.1010.L 

Statistics 

T.1150.C,  T.130.E 

-Statewide 

T.1010.D 

Intelligence 

T.1 150. C.,  F.130.D 

Statistical  Analysis 

T.1 150  ,D 

At-Risk 

S.1010.#505 

Interactive  Learning  T.130.E 

Stress 

T.450.MAX 

Attitudes 

T.1150.ME,  S.1010.B,  S.1 1.L 

Interdisiplinary 

T.450.MAX 

Student  Interaction 

T.450.L 

-Social 

T.1 150. E 

Interpersonal  Relationships  T.1 01 0.B 

Student  Perceptions  T.1 01 0.B 

-Student 

F.130.D 

Immigrants 

F.450A 

Student-Teacher  Interaction  S.1010.D 

Attribution 

T .450. MAX,  S.1010.C 

Item  Formats 

T.1010.D 

Study  Strategies 

F.130.C 

Bias 

T.450.B 

Job  Satisfaction 

T.310.MAX 

Superintendents 

T.310.MAX,  F.31 0 A 

Career 

F.450.C 

K-12 

T.450A,  S.1 010  A 

Supervision 

F.1 30. B,  F.450.B 

Case  Studies 

T.130.D,  T.450.A.,  F.130.A 

Law 

T.1 30  .A 

Teacher 

Censorship 

T.1 130  .A 

Leadership 

T.450.A 

-Development 

F.450.F 

Change 

F.130.A 

Learner-centered 

W.1.ME,  W.1.L 

-Effectiveness 

F.310.L 

-Educational 

F.130.F 

Literacy 

T.310.C 

-Preparation 

T.310.E 

Charter  Schools 

T.1 30.  A 

Literature 

T.1150.C,  F.310.C 

-Roles 

S.1010.D 

Cheating  T.450.L 

-Based  Instruction 

T.310.B 

-Values 

T.310.B 

Cognitive  Development.  T.1 1 50.E,  F.1 01 0.C 

Math 

T.1 150.ME,  F.130.F,  F.450.C 

-Styles 

T.1 30. E 

Cognitive  Strategies  F . 1 30.C 

Measurement 

T.1010.D,  T.130.D,  T.310.D, 

Technology 

T.450.D 

Collaboration 

T.310.L,  T.410.Max,  S.1010A 

F.310.D 

Test  Results 

T.310.D 

-Interdistrict 

S.1010.A 

Medical  Performance  Exams  T.31 0.A 

Traditions 

T.310.#505 

-Univeristy 

S.1010.A 

Mentoring 

W.1.E,  T.1010.ME 

Training 

T.1150A 

Comparative  Statistical  Methods  T.1 150.D,  F.  310.D 

Middle  Schools 

F.1010.B 

University  Teaching  F.310.L 

Component  Analysis  T.31 0. A 

Minority  Students 

T.1010.C,  T.1 150. ME 

Urban/Rural  School  F.310.a 

Computer  Technology  T.310.B,  T.410.MAX,  T.450.D 

Mnemonics 

F.130.C 

Validity 

W.1.D,  F.450.D, 

-networks 

F.310.E 

Monte  Carlo  Methods  T.1 1 50.D,  T.130.D 

S.1010.L 

Concept  Attainment  F.310.B 

Moral  Development  T.450.1 

Violence 

T.130.A 

Conflict  Resolution 

T.450.L 

Motivation 

T.450.MAX,  S.1010.C.S.1 1.L 

Weighted-Option  Scoring  F.31 0.D 

Constructivism 

F.1010.C 

Parent  Invotvmentq  F.310.C 

Writing 

T.310.C 

Content  Area  Teaching  S.1010.F 

Peer  Coaching 

F.130.B 

Women  Administrators  F.1 30 .A 

Cooperative  Learning  S.1010.C 

Perceptions 

S.1010.B 

Women’s  Issues 

F.310.C,  F.450A 

-Teaching 

F.450.B 

Portfolios 

W.1.F,  F.1010.B 

Criterion  Referenced  Assessment  T.310.D 

Policy  Analysis 

T.310.B 

Critical  Theory 

F.1 30  .A 

Power  and  Robustness  T.1150.D 

Differences 

T.450.B 

Practitioner  Research  T.1 1 50.B 

Disabilities 

T.1 300,  F.1010.E 

Preservice  Teachers  T.1150.F,  T.310.E,  S.1010.B 

-Learning 

F.1010C,  S.1010.#505 

-preparation 

T.1 010  A,  F.1 010  A,  F.450F, 

Discrimination 

T.450.B 

S.1010.F 

Distance  Learning 

T.1 150  A.,  T.130.E 

Principals 

T.450.A 

Education 

Programmatic  Initiatives  S.1 01 0.A 

-Early  Childhood 

T.450.L 

Psychology 

T.1 010 A,  T.450.MAX 

-Mufticuttura! 

T.1010.C.,  T.1150.E.,  F.450.A 

Public  Relations 

T.31 0. MAX 

-Science 

T.1 150. ME,  T.1150.L, 

Private  Educatic  . 

F.450.A 

T.1 150.F,  F.1 30. F.,  F.450.E 

Rasch  Analysis 

T.130.D,  T.310.A,  F.1010.E 

-Teacher 

T.1 150. B,  T.1 150. F,  T.310.E, 

Reading 

T.310B,  T.310.C 

T.310.L,  T.450.C,  F.1010A,  F.1010.B, 

Reform 

T.130.C,  S.1010.#505 

F.310.E,  F.450.B,  F.450.F, 

Regression 

W.1.B 

S.1010.B,  S.1010.F 

Rehabiliation  Medicine  F.1 01 0.E 

Educational  Opportunity  T.1 1 50. A 

ReJiabtity  Studies 

S.1010.L 

Engineering 

T.1150A 

Representations 

F.130.C 

Environment 

T.1150.L 

Research 

Episemology 

F.1010.C 

-Educational 

T.450.MAX 

Evaluation 

T.1 150.L,  F.1010.B,  F.130.F 

-Methods 

T.450.D 

-Course 

S.1010.D 

-Narrative 

T.130.L 

-Faculty 

S.1010.D 

-Paradigm 

T.130.L 

-Student 

W.1.F,  F.310.L 

-Qualitative 

T.130.L,  F.450.D 

-Teacher 

W.1.D,  F.310.A 

-Quantative 

T130.L 

Equating 

T.130.D 

-So6o#ngu«stic 

T.130.L 
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PARTICIPANT  ADDRESSES  AND  SESSION  INDEX: 

(These  art  adckessea  suppled  when  proposals  were  submitted,  or  obtained  from  membership  rosters.  Some  addresses 
may  be  incomplete  or  invaid.  I apologize  for  any  inconvenience... Sharon  McNeely) 


Adler,  Jay;  100  S.  Wulff  St.,  Cary,  IL  60013;  T.310.ME,  S.11.B 

Aldrich,  David  G.;  3500  Camp  Bowie,  Univ  N Texas  Hlth  Sc,  Fort  Worth,  TX  76107;  T.310.A 

AWafar,  All;  IN  U,  WW  Wright  Ed  Bldg,  201  N.  Rose  Ave,  Bloomington,  IN  47405-1006;  T.450.Max 

Allen,  Gayle;  N103  Lagomardno,  IA  State  Univ,  Ames,  IA  50010;  F.30.E 

Alley,  Reene  A.;  Univ.  Akron,  284  Starriine  Drive,  Tallmadge,  OH  44278;  T.50.A,  F450.D 

Al-Shayeb,  Abdelhafez  Q.;  287  Arps  Hall,  OH  State  U.,  1945  N.  High  St,  Columbus,  OH  43210;  F.1010.D 

Andre,  Thomas;  IA  State  Univ,  Dept  Psych,  W.112  Lagomardno  Hall,  Ames,  IA  50011;  T.115G.ME, 

T.310.ME,  T450.ME,  F.9.ME,  F.  11 55.  PALACE,  S.9.MAX 

Andrews,  Mary  Lou;  Dept  Ed  Admin,  Univ  Dayton,  Dayton,  OH  45469-0534;  T.1010.B 

Appelman,  Robert  L;  Ed.  Tech  Srvs,  School  Ed.,  IN  U.,  Bloomington,  IN  47405;  T.130.E,  T.310.E 

Arenz,  Bernard  W.;College  Educ,  Univ.  Texas  El  Paso,  El  Paso,  TX  79968;  F1010.A 

Austin,  Anna;  National-Louis  Univ,  2840  Sheridan  Road,  Evanston,  IL  60202;  T1150.F 

Bainer,  Deborah;  OH  State  Univ-Mansfield,  1680  Univ.  Drive,  Mansfield,  OH  44906;  T.1150.L, 

T.130.ME,T.310.ME,  F310.C,  F450A  S.8.B,  S.11.B 

Bakken,  Unda;  Wichita  State  Univ,  Wichita,  KS  67206;  F.9.ME 

Bald  vin,  Grover  H.;  Univ  Toledo,  2454  Hampsford  Cirde,  Toledo,  OH  43617;  F.310.A 

BarciVowski,  Robert  S.;  OH  Univ,  201  McCracken  Hail,  Athens,  OH  45701;  T.1150.D 

Bariev,  Zoe  A.;  Western  Michigan  Univ,  2315  Lorraine,  Kalamazoo,  Ml  49008;  F.130.F 

Barnett,  Bernice  McNair;  Univ  IL-Urbana,  PO  Box  2353  Sta.  A,  Champaign,  IL  61825;  F.450.A 

Barron,  Donna;  Univ  Dayton,  Dept  Teacher  Ed,  Dayton,  OH  45469-0525;  F.101G.A 

Bayfen,  Danllo  M.;  Northern  IL  Univ,  PO  Box  160,  DeKalb,  IL  60115;  T.310.F 

Beckwith,  Tatla;  Northern  IL  Univ,  1310  Reva  Lane,  Sandwich,  IL  60548;  T.450.A 

Behar-Horenstein,  Unda  S.;  Col  Ed,  Univ  Florida,  Gainesville,  FL  32611;  T.130.L,  T.130.ME,  T.310.ME 

Bandezu,  Mary  Ann;  Dpt  Ed  Adm,  Univ  NE-Lincoln,  3712  WHdbriar  Lane,  Lincoln,  NE  68516;  T.1010.C 

Bendixen-Noe,  Mary;  OH  Dept  Educ,  12384  Woodsfield  Cirde  E.  Pickerington,  OH  43147;  T.1010.E, 

T,45O.#505,  F.8.L,  F.130.B,  F.310.E,  S.8.F,  S.11.B 

Benson,  Carol;  Univ  H.S.  7100,  IL  State  UM  Normal,  IL  61790-7100;  F.450.C 

Benton,  Stephen  L.;  369  Bluemont  Hall,  Ed  Psych  & Cnslg.,  KS  State  Univ,  Manhattan,  KS  66506; 
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Karie-Weiss,  Adria;  Murray  State  Univ,  Wells  Hall,  Dept  El  & Sec  Ed,  Murray,  KY  42071;  T.630.MAX, 

S. 11.B 

Kavanaugh,  Joan;  720  College  Mall  Rd.,  Apt  1-5,  Bloomington  IN  47401  T.130.B 
Keener,  Catherine  D.;  Miami  Univ,  1083  Tumbleweed  Drive,  Loveland,  OH  45140  T.450.A 
Kent,  Susan;  Dept  Ed.  Th.  & Prac.,  OH  State  Univ.,  1179  Univ  Drive,  Newark,  OH  43055-1797  F.450.B 
Kibria,  Gholam;  Delaware  State  Univ,  319  Eagle  Nest  Drive,  Camden,  DE  19934  F.1010JS05 
Kiewra,  Kenneth  A.;  Dpt  Ed  Psych,  1307  Seaton  Hall,  Univ  NE-Uncoln,  Lincoln,  NE  68588-0641 

T. 450.ME,  F.130.C 

Kflai,  Jimmy;  School  of  Education,  Andrews  Univ,  Berrien  Springs,  Ml  49104  S.1010.L 

Killmer,  Nadine;  N131  Lagomarcino  Hall,  IA  State  Univ,  Amos,  IA  50011  F.450.B 

Kim,  Judy  H.;  406  E.  Clark  #6,  Champaign,  IL  61820  T.1010.C 

Kim,  Hoyoung;  Dept  of  Ed,  16  Hill  Hall,  U of  MO,  Columbia,  MO  6521 1 T.450.MAX 

Kish,  Cheryl  K.;  Northern  IL  Univ.,  Coll  Ed.,  Dept  C&l,  Gabel  Hall  162-L,  DeKalb,  IL  601 15-2854  T.310.C 

Kline,  Charles  E.;  5136  LAEB,  Purdue  Univ,  West  LaFayette,  IN  47907  Y.130.A 

Knuth,  Christine;  John  Camoit  Univ,  20350  North  Park  Blvd.,  #7A,  Shaker  Heights,  OH  441 18  T.450.E 

Knuth,  Randy;  NCREL,  1900  Spring  Rd,  Ste  300,  Oak  Brook,  IL  60521-1480  W.1.L 

Koffman,  Elaine  C.;  Northeastern  IL  Univ,  6948  N.  Kostner,  Linoolnwood,  IL  60646  T.450.C,  F.450.L 
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Koljatk,  Mladen;  U IN-Bloomington,  818  Tulip  Tree,  Bloomington,  IN  47406  T.450.F 

Koskela,  Ruth  A.;  800  West  Main,  U Wl- Whitewater,  Whitewater,  Wl  53190-9973  T.1150.E,  F.310.E, 

S. 1010.F 

KouleGeorge,  Marilyn;  Chicago  Teachers  Center,  770  N.  Halstead,  Ste  420,  Chicago,  IL  60622;  F.450.L 
Kowalski,  Theodore  J.;  Bali  State  U,  Dpt  Ed  Ldr,  Tchrs  College,  Muncie,  IN  47306  F.130.#505,  S.1010.A 
KranvJr,  Gene  A.;  ADA,  Dept. of  Testing  Serv.,  211  E.  Chicago  Ave,  Suite  1840,  Chicago,  IL  60611-2678 

T. 310A  F.1010.E,  S.8.D,  S.11.B 

Kratzner,  Ron;  Anderson  U.,  1100  E.  5th  St.,  Anderson,  IN  46012  W.1.D,  F.130.ME 

Krengel,  Lawrence;  9409  Voss  Road,  Northern  IL  Univ,  Marengo,  IL  60152  S.1010.C 

Kuper,  Raymond;  Union  Ridge  chool  D#86,  4500  N.  Oak  Park,  Harwood  Hts.,  IL  60656  T.310.L 

Kuzmic,  Jeff;  DePaul  Univ,  Schl  Ed,  SAC380,  2320  N.  Kenmore  Ave,  Chicago  IL  60614  T.1150.B 

Lambert,  Judy  C.;  Reading  Education/COEHS,  Univ  of  Wl  at  Oshkosh,  Oshkosh,  Wl  54901  S.1010.F 

Lamp#,  Scherie  E.;  Univ  of  Wl  at  Oshkosh,  800  Algoma  Blvd,  Oshkosh,  Wl  54901  T.310.E 

Lanier,  Perry  E.;  Michigan  State  Univ,  116  Erickson  Hall,  East  Lansing,  Ml  48824  T.450.B 

Lanigan,  Mary;  IN  Univ.  at  Bloomington,  124  S.  Glenwood  Ave,  West  #2,  Bloomington,  IN  47408  S.1010.C 

Larkin,  Kevin  C.;  Amer  Dental  Association,  211  E.  Chicago  Ave,  Ste  1840,  Chicago,  IL  60611  T.1150.A 

Larson,  Gerald  E.;  Navy  Personnel  Research  & Dev.  Ctr,  San  Diego,  CA  92152  T.1150.C 

Latkovich,  Sharon;  3498  Est  Normandy  Park  Drive,  #p-6,  Medina,  OH  44256  F.1010.B,  S.1010.L 

Lavelie,  Ellen;  126  5th  Ave  SE,  LeMars,  IA  51031  T.410.MAX 

Lebda,  Dennis;  School  District  #34  IL,  T.310.L 

LeBlanc,  Michael  J.;  Univ  of  Toledo,  8 86  Sandlewood  Road,  West,  Perrysburg,  OH  43551  T.1150.C 

Leung,  Jupian  J.;  College  of  Ed.  & Human  Services,  Univ.  of  Wl  at  Oshkosh,  Oshkosh,  Wl  54901  F.450.E 

Levin,  Joel  R.;  Univ.  of  Wise.,  Dept  Ed.  Psych.,  1025  W.  Johnson  Street,  Madison,  Wl  53706  F.130.C 

Li,  Ching-Yen;  U of  Toledo,  Toledo  OH  T.450.E 

Lindner,  Reinhard;  1326  Parkview  Dr.,  Macomb  IL  61455  F.130.#505 

Lipka,  Richard  P.;  Pittsburgh  State  Univ,  1102  Imperial  Drive,  Pittsburg,  KS  66762  T.310.ME, 

F.1010,#505,  S.1010.B 

Upsett,  Laura;  OH  State  Univ.,  Worthington,  OH  43085;  F/I010.F 
Litz,  Charles;  KS  State  Univ,  Manhattan,  KS  66506  T.310.#5Q5 

Loadman,  William  E.;  287  ARPS  Hall,  1945  N.  High  St.,  OH  State  Univ,  Columbus,  OH  43210  F.1010.D 

Locke,  Kathryn  G.;  5 Cromwell  Terrace,  Akron,  OH  44313-5554  T.450.A 

Lokon,  Elizabeth;  Miami  Univ,  601  Brookview  Court,  Oxford,  OH  45056  T.450.L 

Lowenthal,  Barbara;  Northeastern  IL  Univ.,  Special  Ed.,  5500  N.  St.  Louis  Ave.,  Chgo,  IL  60625  F.450.E 

Lukin,  Leslie;  KS  City  (MO)  Public  Schools,  Kansas  City,  MO;  T.310.ME 

Lunz,  Mary  E.;  American  Society  of  Clinical  Pathologists,  2100  W.  Harrison  St.  #270,  Chicago,  IL  60612 
T.1150.A,  T.310.A 

Lynch,  Daniel  O.;  College  of  Ed.  & Human  Services,  U Wl-Oshkosh,  Oshkosh,  Wl  54901  F.450.E 

Lyon,  Judson;  Dept  of  C&l,  Coll  of  Ed.,  U of  Wis-Whitewater,  Whitewater,  Wl  53190  S.1010.F 

Mabokela,  Reitumetse;  U IL-Urbana-Champ.,  309  W.  Springfield  Ave.,  Apt  #5,  Urbana,  IL  61801  T.450.F 

Magolda,  Peter  M.;  501  E.  Chesnut  St.,  Oxford  OH  45056  F.450.D 

Manges,  Charles;  Wayne  State  College,  124  Brandenburg,  Wayne,  NE  68787  T.450.C 

Man  hertz,  Melissa  Macdonald;  IN  Univ-Bloomington,  313  Tulip  Tree,  Bloomington,  IN  47406  S.1010.L 

Mankiewfcz,  Robert;  Chicago  Voc.  School,  2100  E.  87th  St,  Chicago  IL  60617  T.1150.B 

Mansberger,  Nancy;  3210  Sangren  Hall,  Western  Mich  U,  Kalamazoo,  Ml  49008  F.130.F 

Mantemach,  Jill  C.;  IA  State  Univ,  1128  1st  St,  SW,  Mason  City,  IA  50401  F.450.A 

Merchant,  Gregory  J.;  Dpt  Ed  Psych,  Tchrs  College,  Ball  State  Univ.,  Muncie,  IN  47306-0595  W.8.ME, 

T.310.ME  F.9.ME,  F.130.E,  F.310.ME 

Marso,  Ronald  N.;  Ed  Fdn  &lnq,  Bowling  Green  St  U,  1001  E.  Wooster  St.,  Big.  Green  OH  43402  T.310.E 
Maury,  Kathleen  A.;  Manketo  St  U,  Cps  Box  52,  P.O.Box  8400,  Mankato  MN  56002-8400  T.1150.F, 
T.130.B,  T.310.F 

McCombs,  Barbara  L.;  McREL,  2550  S Parker  Rd,  Suite  500,  Aurora,  CO  80014  W.1.ME,  W.8.ME, 

T.  130.  MAX 

McCullough,  Joy  D.;  Trinity  Western  U,  7600  Glover  Road,  Langley  BC  V2Y1 Y1 , CANADA  T.310.ME, 

S.1010.B 
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McDougle,  Kenny  O.;  Pittsburgh  State  Univ,  1701  S.  Broadway,  Pittsburg,  KS  66762  T.130.C 
McGowan,  Thomas  M.;  Coil  of  Ed,  PO  Box  870911,  Arizona  State  U.t  Tempe,  AZ  85287-0911  T.310.E 
McGuire,  Joan  E.;  LaSalle  Elementary  Dist.#122,  1315  25th  Street,  Peru,  IL  61354  T.450.A 
McMurray-Schwarz,  Paula;  IA  State  Univ,  305  W.  Third  Street,  Huxley,  IA  50124  F.130.D 
McNeely,  Sharon;  NE  IL  Univ,  5500  N.  St.  Louis,  Chicago,  IL  60625;  W.8.ME,  T.310.ME,  F.9.ME,  S.11.B 
McNeil,  Larry;  IL  State  Univ,  Dept  Ed  Ad  & Fndtns,  Degalmo  Hall  Rm  331,  Normal,  IL  61790-5900;  S.11.B 
Meixner,  Sharon;  Cleveland  State  U.,  RT  1416,  Euclid  Ave  @ E24th  St,  Cleveland  OH  44115  F.310.C 
Metcalf,  Kim  K.;  Sc!  Ed,  IN  Univ,  Bloomington,  IN  47405  T.310.ME,  T.130.D,  F.9.ME,  F.310.ME,  S.11.B 
Michelson,  Sandra  S.;  Valparaiso  Univ,  2120  Yorktown,  Valparaiso,  IN  46383  T.1150.B 
Midgen,  Joe;  Univ.  Akron,  Akron,  OH  44313  T,310.MAX 

Midgette,  Thomas;  Counselor  Ed  Prog,  Univ.  AR-Fayetteville,  Fayetteville,  AR  72701  W.1.E,  T.1010.ME 
Miller,  Dana;  218  Bancroft  Hall,  Lincoln,  NE  68588  F.450.D 

Miller,  Lew;  Staff  Development  Officer,  Stockley  Ctr,  Georgetown,  DE  19947  F.1010.#505 

MofFrt,  Thomas;  350  McGuffey  Hall,  Miami  U,  Oxford,  OH  45056  S.11.L 

Moore,  Rodney  S.;  U of  Akron,  400  Sumner  St,  #3,  Akron  OH  44304  T.310.MAX 

Moran,  Kelli  Jo  Kerry;  E016  Lagomarcino,  IA  State  U.t  Ames  IA  5001 1 F.310.B 

Morgan,  Ronald  R;  Loyola  U-Chicago,  6525  N.  Sheridan  Rd.,  Chicago  IL  60626  T.115Q.A,  T.130.L, 

F.450.E 

Morrow,  Linda;  6740  Friendship  Dr,  New  Concord,  OH  43762;  S.11.B 

Morton,  Mary  Lou;  IN  Univ-Bloomington,  PO  Box  5941,  Bloomington,  IN  47407  T.130.B 

Mostert,  Deborah  L.;  Moorhead  State  Univ,  Moorhead  MN  56560-9980  S.1010.E 

Mostert,  Mark  P.;  Moorhead  State  Univ,  Moorhead,  MN  56560-9980  T.1010.A,  S.1010.E 

Mouw,  John  T.;  Dept  Ed.  Psych  & Sp.Ed.,  So.  IL  U.,  Carbondale,  IL  62901  F.220.#505 

Mueller,  Daniel;  Indiana  Univ,  Education  1000,  201  N.  Rose,  Bloomington,  IN  47405;  T.130.ME,  T.310.ME 

Mucci,  Rosemarie;  Strongsville  City  Schools,  11109  Webster  Rd,  Strongsville,  OH  44136  T.310.E 

Nazier,  Gilbert  L.;  OH  State  Univ  at  Newark,  1179  Univ  Drive,  Newark,  OH  43055  T.1150.#505,  T.450.F 

Neal,  Margie;  Chicago  Teachers  Center,  770  N.  Halstead,  Suite  420,  Chicago,  IL  60622;  F.450.L 

Nebelsick-Gullett,  Lori;  Univ.  KS,  Cnt  Ed  Testing,  B101  Bailey  Hall,  Lawrence,  KS  66045  T.310.ME 

Necessary,  James  R;  4318  W.  Friar  Drive,  Ball  State  Univ,  Muncie,  IN  47304  T.1150.D,  T.410.MAX, 

F.310.F,  S.1010.ME 

Nelson,  C.  Van;  Department  of  Computer  Science,  Ball  State  Univ,  Muncie,  IN  47306-0450  F.310.F 

Nelson,  Jacquelyn  S.;  Graduate  School,  Ball  State  Univ,  Muncie,  IN  47306  F.310.F 

Nelson,  Mike;  U Wl-  Whitewater,  800  West  Main,  Whitewater  Wl  53190-9973  F.310.B 

New,  Clara  A.;  U Wl-Parkside,  900  Wood  Road,  Box  2000,  Kenosha,  Wl  53141-2000  T.450.L,  S.8.B, 

S.1010.D,  S.11.B 

New,  William;  Dept  Ed,  DePauw  University,  Greencastle,  IN  46135  T.1010.A 

Newby,  John;  New  Castle  H.S.,  001  Parkview  Dr.,  New  Castle,  IN  47362  T.1010.E 

Newman,  Carole  H.;  U Akron,  2995  Stanley  Road,  Akron,  OH  44313  W.1.F,  T.1010.#505,  T.130.B 

F.310.L 

Newman,  Isadora;  U Akron,  2995  Stanley  Road,  Akron,  OH  44313  W.1.B,  T.130.D,  T.310.ME,  F.1010.B, 
S.8.C,  S.11.B 

Nichols,  M;  Miami  Univ,  110  Wood  St.,  Batavia,  OH  45103  F.130.D,  S.11.L 

Obom,  C.  Stephen;  Ripley  Union  Lewis  Huntington  Sch,  Sup  Off,  120  Main  St,  Ripley  OH  45167  S.1010.A 

Oldenski,  Thomas  E,;  Univ  of  Dayton,  300  College  Park,  Dayton,  OH  45469-0534  F.130.A,  S.1010.A, 

Olson,  Jerry;  Chicago  Teachers  Center,  770  N.  Halstead,  Suite  420,  Chicago,  IL  60622;  F.450.L 

Olszewski,  William;  Mankato  State  U,  Box  52,  PO  8400,  Mankato,  MN  56002  T.310.F 

O’Neill,  Thomas  R;  Am.  Sty  Clinical  Pathologists-BOR,  2100  W.  Harrison  St.,  Chicago  IL  60612  T.310.A 

Ong,  Kwee  Hiong;  Evermann  Apts,  #314,  Bloomington  IN  47406  T.130.B 

Overbey,  G.R;  Dept  of  Ed.  Psych.,  Csig.  & Sp.Ed.,  Northern  IL  Univ,  DeKalb  IL60115  S.1010.C 

Paces,  James;  Shaker  Hts.  City  Schools,  15600  Parkland  Dr,  Shaker  Heights,  OH  44120  F.310.C 

Packard,  Abbot  L.;  VA  Polytech  Institute  &State  Univ.,  PO  Box  268,  Blacksburg,  VA  24060-0268  T.130.E 

Pan,  Alex;  Dept  C&l,  Coll  of  Ed,  U Wl-Whitewater,  Whitewater,  Wl  53190  F.310.B,  S.1010.F 

Papa,  Frank;  Family  Medicine,  UNTHSC,  3500  Cemp  Bowie  Blvd,  Ft.  Worth,  TX  76107-2699  T.310.A 
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Parish,  Thomas  S.;  317  Bluemont  Hall,  Fndtns  & Adult  Ed.,  KS  State  Univ.,  Manhattan,  KS  66506 
T.410.MAX.  F.310.F,  S.1010.ME 

Paulson,  8haron  E.;  Dept  Ed  Psych,  Ball  State  U-TC524,  Munde  IN  47306-0595  F.8.E,  F.130.E,  F.450.E, 
S.11.B 

Panrod,  Michael  R.;  SE  KS  Ed  Srv  Ctr,  827  Smith,  Manhattan,  KS  66502  T.130.C,  T.310.#505,  F.8.F, 

S. 11.B 

Parana,  Peter;  DoPaul  Univ,  4955  Kimbark  Ave,  Chicago,  IL  60615  F.310.B 

Patarson,  Karan  M.;  Cottage  of  Education,  Governors  State  Univ,  Univ  Park,  IL  60466  T.130.B 

Paterson,  Sarah  E.;  Dept  Ed  Psych,  Northern  IL  U.,  DeKalb,  IL  601 15  T.310.ME,  T.130.ME,  S.1010.C 

Piarca,  Jean;  Northern  IL  Univ,  EPCSE,  DeKalb,  II 60115;  T.310.ME,  F.9.ME,  S.11.B 

Plgga,  Fred  l_;  EDFI  Dept.,  College  of  Education,  Bowling  Green  Univ,  Bowling  Green,  OH  43403  T.310.E 

Pintrich,  Paul;  U Ml,  Ed.  Studies  Prog.,  610  E.  Univ.,  1225  SEB,  Ann  Arbor,  Ml  48109-1259  S.1010.MAX 

Place,  A-  William;  Univ  Dayton,  Dept  Ed  Admin,  Dayton,  OH  45409-9929  T.1010.E,  F.8.A.,  S.11.B 

Plake,  Barbara  S.;  135  Bancroft  Hall,  Univ  of  NE  at  Lincoln,  Lincoln,  NE  68588-0348  T.1150.D,  T.310.D 

Plevyak,  Linda;  The  OH  State  U.,  1945  N.  High  St,  Rm#150  Arps  Hall,  Columbus,  OH  43210  T.1010.A, 

F.130.B 

Pohlman,  John  T.;  Dept  Educational  Psychology,  Southern  IL  Univ,  Carbondale,  IL  62901  F.310.L 
Pomplun,  Mark  R.;  B101  Baily  Hall,  1 Jayhawk  Blvd,  Univ  of  KS,  Lawrence,  KS  66045  T.130.D 
Ponticall,  Judith  A.;  6906  Genoa  Ave,  Lubbock  TX  79424  T.1 1 50. A 
Pourchot,  Thomas  L;  Northern  llliniois  Univ,  425  Leonard  Ave,  DeKalb,  IL  601 15  F.1010.C 
Powell,  Jamas  H.;  Ball  State  Univ,  527  N.  Shellbark  Rd„  Munde,  IN  47304-3750  T.310.E 
Pugh,  Richard  C.;  3707  Chaudion  Court,  IN  U,  Bloomington,  IN  47401  T.130.E,  T.310.ME,  F.8.ME, 

F.450.C 

Quinn,  Bill;  NCREL,  1900  Spring  Road,  Ste  300,  Oak  Brook,  IL  60521-1480  W.1.L 
Rahman,  Mohammad  A.;  287  Arps  Hall,  OH  State  Univ,  1945  N.  High  St,  Columbus  OH  43210  F.1010.D 
Ralsch,  C.  Daniel;  Univ  Dayton,  Dpt  Ed  Adm,  300  College  Park  Drive,  Dayton  OH  45469-0513  F.310. A 
Ramanathan,  Hama;  OH  State  Univ,  2452  N.  High  Street,  #4,  Columbus,  OH  43202  F.1010.F,  F.130.B 
Raynor,  Heidi;  Cleveland  State  U.,  RT1345,  Eudid  Ave  @ E24th  St,  Cleveland,  OH  441 15  F.310.C 
Reilly,  Irena;  School  District  #34,  IL  T.310.L 

Rickman,  Jacqueline  C.;  Northern  IL  Univ,  12763  Westgate  Drive,  Palos  Heights,  IL  60463  T.31C.E 

Roberts,  Nicola  K.;  IL  State  Univ,  300  Shelboume,  #18,  Normal  IL  61761  T.450.D 

Rodriquez,  Karan;  Westmont  H.S.,  140  Raintree  Ct.,  Aurora,  IL  60504  T.450.A 

Rogers,  Bruce  G.;  Dept  Ed  Psych,  U Northern  IA,  Cedar  Falls,  IA  50614-0607  T.130.ME,  T.310.ME 

Romanowskl,  Michael  H.;  Tchr  Ed.,  525  S.  Main  Street,  OH  Northern  Univ,  Ada,  OH  45810-9989  T.450.B 

Rothilsberg,  B.A.;  Dept  of  Ed.  Psych,  Teachers  College  524,  Ball  State  Univ,  Munde,  IN  47306  F.130.E 

Runyan,  Charles;  Dept  C&l,  Pittsburg  State  Univ,  Pittsburg,  KS  66762  F.1010.A,  S.1010.B 

Seiner,  Marcia  B.;  Ed  Ad,  BRK  388,  Sangamon  State  Univ,  Springfield,  IL  62794-9243  F.130.A,  F.450.D 

Samiawi,  Faqih;  OH  State  U..  531  Stinchcombe  Dr#,  Columbus,  OH  43202  F.130.B 

Sandoval,  Gloria;  Univ.  of  Nevada,  Las  Vegas,  NV  F.310.F,  S.8.E,  S.11.8 

Saunders,  Nancy  G.;  Ball  State  Univ,  Teachers  College,  4301  W.  Riverside,  Munde,  IN  47304  T.450.L 
Schmidt,  Mary  Ellen;  OH  State  U-Mansfieid,  307  Ovaiwood  Hall.  Mansfield,  OH  44906  T.1150.F,  T.450.B 
Schommer,  Marlene;  Col  Ed,  Campus  Box  123,  Wichita  St  U,  Wichita,  KS  7260-0123  T.1150.C, 

T. 310.ME,  F.1010.C 

Schoon,  Peny  L;  IL  State  Univ,  300  E.  Shelboume,  Apt  27,  Normal  IL  61761  T.450.D 

Schraw,  Gregory;  U NE-Uncdn,  Dept  Ed  Psych,  1311  Seaton  Hall,  Lincoln,  NE  68588-0841  T.310.C, 

T.310.ME,  S.1010.C 

Schumacker,  Randall  E,;  U N TX,  College  Education,  P.O.  Box  13857,  Denton,  TX  76203  T.310.A 

Schunk,  Dale  H.;  1446  LAEB  Rm5108,  Purdue  Univ.,  West  Lafayette,  IN  47907-1448  F.130.E 

Scott,  Roee  Mary;  Univ  Wl  at  Parkside,  P.O.  Box  2000,  Kenosha,  Wl  53141-9988  F.31Q.B 

Sebbareon,  David;  St  Cloud  State  U,  720  Fourth  Ave,  St.  Cloud,  MN  56301  T.310.F 

Shade,  Barbara;  U.WI-Parkalda,  Schl  Ed., 900  Wood  Rd,  Box  2000,  Kenosha,  Wl  53141-2000  F.1010.ME 

Shank,  Melody;  Indiana  Univ,  Indianapolis,  IN  46208  F.4S0.F 
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YOUR  PERSONAL  PREPARATION  CHECKLIST: 

(Those  experienced  MWERA  attendees  may  not  need  this  fct,  but  I prepared  it  in  case  you  want  to  make  sure  you  covered 
the  basics,  and,  in  case  you  are  new  to  MWERA!.,. Sharon) 


This  Program  belongs  to: 

If  found,  my  address  for  return  is: 


If  I am  presenting  in  a session  with  a discussant,  I mailed  my  paper  to  the 
discussant: , on  the  date  of: 

I made  by  hotel  reservatic  n by:  mail  phone  FAX 

on  the  date  of: my  hotel  confirmation  number  is:. 

I reserved  a room  for  the  dates  of 

I am  sharing  a room  with 

I mailed  my  MWERA  annual  meeting  registration  on  the  date  of: 

I paid  by  check  # in  the  amount  of  $ 

I made  my  travel  plans  as  follows: 

airlines: flights: 

other: 


I have  everything  I need  if  I am  presenting: 

30  copies  of  my  paper 

business  cards 

prepared  overhead  transparencies 

poster  prepared 


I have  everything  I need  for  Chicago: 
warm  clothes  for  cold  winds 

money  for  tips,  cabs,  tolls,  parking 

casual  clothes  for  Pres,  reception 

this  copy  of  my  program 


I notified  someone  where  I will  be,  and  how  to  reach  the  hotel  if  they  need  to  reach  me. 

I know  that  if  I am  presenting,  I made  a commitment  to  be  there.  If  an  emergency  delays  me,  I will 
contact  Sharon  McNeely  at  the  hotel. 


OTHER  NOTES: 
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Ashland  University  is  a private,  liberal  arts  and  sciences  institution  preparing  students  for 
professions  and  careers.  Ashland's  rich  heritage  of  preparing  personnel  for  school  dates  back  to 
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is  based  on  current  research,  effective  practice  and  collaborative  relationships  among  Ashland  fac- 
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both  undergraduate  and  graduate  levels  and  is  accredited  by  the  National  Council  for  Accreditation 
of  Teacher  Education.  The  program  emphasizes  informing  practice  with  theory  and  therefore  is 
implemented  through  experiences  in  both  university  clases  and  supervised  field  placements. 


Information  for  Contributors  to  the  Mid-Western  Educational  Researcher 

The  Mid-  Western  Educational  Researcher  accepts  research-based  manuscripts  that  would  appeal  to  a 
wide  range  of  readers.  All  materials  submitted  for  publication  must  conform  to  the  language,  style,  and  format  of  the 
Publication  Manual  of  the  American  Psychological  Association,  4th  ed.,  1994 
(available  from  Order  Department.  American  Psychological  Association,  P.O.  Box  2710,  Hyattsville,  MD  20784). 

Three  copies  of  the  manuscript  should  be  submitted  typed  double-spaced  (including  quotations  and  references)  on 
8V2  x 1 1 paper.  Only  words  to  be  italicized  should  be  underlined.  Abbreviations  and  acronyms  should  be  spelled  out  when  first 
mentioned.  Pages  should  be  numbered  consecutively,  beginning  with  the  page  after  the  title  page. 

Manuscripts  should  be  less  than  20  pages  long.  An  abstract  of  less  than  100  words  should  accompany  the  manuscript. 

The  manuscript  will  receive  blind  review  from  at  least  two  professionals  with  expertise  in  the  area  of  the  manuscript. 

The  author’s  name,  affiliation,  etc.,  should  appear  on  the  title  page  only.  Efforts  will  be  made  to  keep  the  review  process  to 
less  than  two  months.  The  editors  reserve  the  right  to  make  minor  changes  in  order  to  produce  a concise  and  clear  article. 

The  authors  will  be  consulted  if  any  major  changes  are  necessary. 

Manuscripts  should  be  sent  with  a cover  letter  to: 

Ayres  G.  D’Costa,  MWER  Editor 

287  Arps  Hall,  1945  N.  High  Street,  The  Ohio  Slate  University.  Columbus,  OH  432 10 
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Introduction  to  Special  Issue  on  Midwestern  History 


Guest  Editors: 

Louise  E.  Fleming,  Ashland  University 
Kathleen  A.  Murphey 

Indiana  University-Purdue  University  Fort  Wayne 

This  issue  is  devoted  to  current  work  in  the  field  of  educational  history.  We  have  specifically  sought  out  new 
researchers  in  the  field  of  educational  history,  i.e..  graduate  students,  recent  graduates,  and  previously  unpublished  scholars 
whose  work  has  focused  on  underrepresented  groups,  such  as  those  defined  by  race,  ethnicity,  gender,  and  class.  We  have 
also  targeted  educational  history  of  the  Midwest,  for  we  feel  there  are  few  outlets  for  research  about  this  region. 

The  first  two  selections  by  Karen  L.  Graves  and  Joseph  Watras  respectively,  focus  on  aspects  of  midwestem 
educational  history  related  to  race.  Graves  researches  curricular  choices  of  African  American  women  in  the  high  schools  of 
St.  Louis,  Missouri,  early  in  this  century;  Watras  studies  the  effects  of  federal  intervention  programs  on  desegregation  in 
Dayton,  Ohio,  in  the  late  1960s. 

Jana  Nidiffer  leads  us  to  the  realm  of  higher  education.  By  researching  the  career  development  of  four  women, 
Nidiffer  chronicles  the  evolving  profession  of  deans  of  women  students  at  the  turn  of  the  century  in  Midwestem  universities. 
With  Louise  E.  Fleming  we  look  at  one-room  country  schools  and  their  consolidation  as  experienced  by  several  students  and 
teachers  in  Asland,  Ohio.  James  L.  Green’s  work  centers  on  the  founding  of  a children's  international  summer  camp  in 
Cincinnati,  Ohio,  in  the  1940s. 

Finally,  we  have  included  a piece  by  Elizabeth  K.  Johnson  and  Lucy  F.  Townsend,  which  speaks  to  the  concept  of 
listening  historically  to  other  voices.  The  authors  critique  the  current  emphases  of  educational  history  and  make  a plea  for 
more  variety  of  form  in  historical  writing.  They  especially  encourage  life-writing,  or  biography. 

As  a group  these  historical  writings  offer  a wide  range  of  method,  scope,  and  perspective.  We  applaud  the 
researchers’  efforts,  as  well  as  the  initiative  of  theAf/W-  Western  Educational  Re  searcher , for  generating  this  special  forum  on 
educational  history  of  the  Midwest. 


The  Guest  Editors 


COPYRIGHT  NOTICE 

Articles  published  in  MWER  are  copyrighted  by  the  Mid-Western  Educational 
Research  Association,  and  may  not  be  reproduced  for  commercial  or  for-profit  use  without 
written  permission  from  the  MWER  Editor. 

It  is  MWERA  policy  to  facilitate  the  use  of  MWER  material  for  any  educational 
or  non-profit  use.  There  is  no  royalty  charge  for  such  duplication  of  MWER  materials. 
Instructors  are  hereby  granted  permission  to  duplicate  MWER  articles  for  distribution  to 
students  in  their  courses,  provided  proper  acknowledgment  is  given  to  the  author(s)  and  to 
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The  Impact  of  the  Differentiated  Curriculum  on  African  Ameri- 
can Women  High  School  Students : The  Case  in  St.  Louis 


Karen  L.  Graves,  Denison  University 
Abstract 

Historians  have  tagged  the  transformation  to  the  differentiated  curriculum  as  an  influential 
factor  in  the  shaping  of  the  twentieth-century  high  school  in  the  United  States.  Although  gender,  race, 
and  social  class  affected  the  way  in  which  a student's  education  was  altered  by  the  differentiated 
curriculum,  the  impact  of  the  differentiated  curriculum  on  African  American  women  high  school  stu- 
dents has  not  been  studied  extensively.  This  paper  examines  the  effect  of  the  differentiated  curriculum  on 
African  American  women  s course  selection  in  St.  Louis  public  high  schools  from  1914  to  1930.  Conclu- 
sions drawn  here  both  confirm  and  challenge  the  existing  literature  on  women's  secondary  education. 


The  implementation  of  the  differentiated  curricu- 
lum in  public  high  schools  marked  a transformative  moment 
in  the  history  of  education  in  the  United  States.  Although 
advocates  of  the  differentiated  curriculum  early  in  the  twen- 
tieth century  argued  that  diverse  courses  of  study  would 
better  meet  the  individual  needs  of  students,  historians  have 
exposed  social  class  and  ethnic  biases  as  fundamental  com- 
ponents in  this  school  reform.  Rather  than  accept  the  changes 
in  curricula  as  a “democratic"  attempt  to  establish  equal  edu- 
cational opportunity,  many  scholars  understand  this  devel- 
opment. which  had  a profound  influence  on  secondary 
schooling  in  the  twentieth  century,  as  a form  of  social  control 
intended  to  stabilize  the  U.S.  corporate  economy  and  to  pro- 
tect a national  agenda  created  by  a power  elite  (Anderson, 
1988;  Bowles  &Gintis,  1976;  Kantor,  1988;  Kantor&Tyack. 

1 982;  Karier,  1986;  Katz,  1975;  Spring,  1989;  Violas,  1978). 

Much  of  the  early  critical  scholarship  on  the  differenti- 
ated curriculum  focused  primarily  on  its  impact  on  working- 
class  and  immigrant  students.  Ironically,  although  girls  com- 
prised the  majority  of  high  school  students  in  the  decades 
surrounding  the  introduction  of  the  differentiated  curricu- 
lum, gender  has  been  little  used  as  a lens  for  examination  of 
this  major  policy  change.  Recent  work  which  has  targeted 
gender  as  a crucial  issue  in  the  study  of  the  differentiated 
curriculum  has  advanced  knowledge  of  the  philosophy,  poli- 
tics, and  practice  underlying  this  mainstay  of  the  U.S.  educa- 
tion system.  Books  by  Jane  Bernard  Powers  (1992)  and  John 
Rury  (1991)  have  proven  particularly  significant  additions  to 
the  field;  each  work  reflects  an  appreciation  for  the  complex- 
ity of  the  issues  under  observation.  Yet.  within  the  body  of 
work  now  being  produced  on  gender  and  the  differentiated 
curriculum,  the  experiences  of  African  American  students 
have  been  attended  to  only  peripherally. 

In  1916  there  were  only  64  high  schools  in  the  United 
States  open  to  African  Americans  (Bond,  1934).  In  that  year 
the  states  of  Georgia,  Louisiana.  Mississippi,  North  Caro- 
lina. and  South  Carolina  provided  no  publicly  supported  high 
schools  for  African  Americans;  Delaware.  Florida,  and  Mary- 
land claimed  one  each  (Anderson,  1 988).  As  James  D.  Ander- 


son ( 1 988)  documents  in  his  history'.  The  Education  of  Blacks 
in  the  South , only  a small  percentage  of  African  American 
youth  had  access  to  secondary  schooling  until  the  middle  of 
the  twentieth  century.  The  relatively  small  number  of  high 
schools  available  to  African  American  students  may  help 
explain  why  so  little  research  has  been  conducted  on  the 
effect  of  the  differentiated  curriculum-on  African  American 
women’s  education.  Another  difficulty  is  that  social  scien- 
tists often  failed  to  include  African  American  students  in 
their  surveys.  For  instance,  George  Counts  included  St.  Louis 
in  his  survey,  which  Rury  (1991)  refers  to  as  the  only  study  of 
the  period  to  examine  systematically  the  manner  in  which 
students  were  distributed  across  different  high  school 
courses  in  a number  of  urban  contexts.  Unfortunately,  Counts 
( 1 922)  gathered  incomplete  data  on  St.  Louis  African  Ameri- 
can students  and  did  not  wholly  incorporate  their  high  school 
experiences  into  his  results.  In  spite  of  such  challenges,  in- 
formation on  how  the  differentiated  curriculum  transformed 
African  American  women’s  secondary  education  promises 
to  illuminate  key  issues  in  the  history  of  women's  education 
as  well  as  the  history  of  African  American  education.  Schol- 
ars in  both  fields  have  commented  on  schooling  as  training 
for  domestic  service  for  African  American  women  (Ander- 
son, 1988;Giddings,  1984;  Powers.  1992;  Rury’,  l99l;Tyack 
& Hansot,  1990).  Little  has  been  written,  however,  on  how 
African  American  women  students  fared  in  public  high 
schools  during  the  transition  from  the  traditional  academic 
curriculum  to  the  differentiated  curriculum.  This  study  pro- 
vides an  analysis  of  the  high  school  course-taking  patterns 
of  African  American  women  students  in  St.  Louis,  Missouri 
during  the  transition  to  the  differentiated  curriculum. 

The  public  school  system  of  St.  Louis  provides  an  ex- 
cellent opportunity  for  study.  The  city  of  St.  Louis  enjoyed 
national  prominence  in  the  last  decades  of  the  nineteenth 
century.  Its  diverse  industrial  economy  mirrored  economic 
conditions  in  cities  in  the  Northeast  while  its  social  flavor 
contained  strong  elements  of  the  American  South.  One  might 
expect,  then,  that  rationale  for  high  school  attendance  re- 
flected both  a desire  for  advancement  in  the  workplace  and 
an  aspiration  for  education  for  “race  uplift"  (Perkins,  1983; 
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Rury,  199] ).  The  public  school  system  in  St.  Louis  earned 
national  recognition  during  the  superintendency  of  William 
Torrey  Harris  (1868  to  1880)  and  maintained  its  status  well 
into  the  twentieth  century.  In  1 885,  St.  Louis  school  officials 
announced  the  first  commencement  exercises  for  Sumner  High 
School,  the  first  public  high  school  for  African  Americans 
west  of  the  Mississippi  River.  Therefore,  public  secondary 
schooling  for  African  Americans  in  St.  Louis  can  be  traced  to 
the  decade  which  witnessed  the  first  great  surge  in  public 
high  school  development  in  the  United  States. 

Missouri’s  state  constitution,  written  after  the  Civil  War, 
provided  for  the  establishment  of  separate  schools  for  chil- 
dren of  African  descent.  Sumner  High  School  was  officially 
founded  in  1 8 75,  some  two  decades  after  Central  High  School 
opened  in  St.  Louis  for  European  American  students.  Sumner 
remained  the  only  public  high  school  available  to  African 
American  students  in  St.  Louis  until  Vashon  High  School 
initiated  classes  for  the  1 927-28  school  year.  Given  that  Afri- 
can Americans  had  been  legally  barred  from  all  education 
prior  to  the  Civil  War  in  Missouri,  early  high  school  enroll- 
ments for  African  Americans  in  St.  Louis  were  low.  With  some 
years  of  exposure  to  elementary  schooling,  however,  atten- 
dance at  the  high  school  began  to  catch  up  with  the  enthusi- 
astic commitment  St.  Louis  African  Americans  made  to  learn- 
ing (Gersman,  1972).  Students  at  Sumner  High  School  soon 
represented  a percentage  of  the  total  high  school  enrollment 
in  St.  Louis  which  reflected  the  African  American  percentage 
of  the  city’s  population.  Sumner  High  School  students  ac- 
counted for  8 percent  of  the  St.  Louis  public  school  enroll- 
ment in  1905, 10  percent  in  1915,  and  1 1 percent  in  1925  (Graves, 
1993). 

Although  formally  established  in  1875,  Sumner  High 
School  forged  its  identity  as  a secondary  institution  in  the 
1 880s.  The  nineteenth-century  philosophy  of  Sumner  High 
School  reflected  the  ethos  of  African  American  schooling  in 
the  decades  following  the  Civil  War  (Anderson,  1988;  Karier, 
1986;  Krug,  1969;  Perkins,  1983;Tyack&Hansot,  1990).  In 
1882,  St.  Louis  educators  pledged  that  “The  Sumner  High 
School  must  do  its  share  to  train  the  future  leaders  of  the 
race,  so  that  they  may  be  men  and  women  of  good  intelli- 
gence and  pure  character’’  (St.  Louis  Annual  Report,  1 904,  p. 
159).  Many  Sumner  graduates,  most  of  whom  were  women, 
elected  to  make  their  contributions  as  teachers.  Over  half  of 
the  Sumner  High  School  graduates  from  1 895  to  1909  became 
teachers  or  enrolled  in  normal  schools  (Graves,  1 993). 

From  1 885  to  19 1 1 the  General  and  Normal  courses  of 
study  constituted  the  curriculum  at  Sumner  High  School. 
Beginning  in  1911,  Sumner  students  took  classes  as  deter- 
mined by  the  General,  Classical,  Scientific,  Commercial.  Art, 
Domestic  Art  and  Science,  or  Manual  Training  courses  of 
study;  graduates  were  distinguished  by  these  courses  of 
study  until  1930.  It  is  important  to  note,  however,  that  Sumner 
High  School  added  a Department  of  Domestic  Science  for 
women  and  sent  male  high  school  students  to  the  UOuverture 
Elementary  School  for  manual  training  classes  in  1 899.  Two 
years  later  Sumner  principal,  Oscar  Waring,  commented  that 


the  “success  which  has  attended  the  introduction  of  Manual 
Training  and  Domestic  Science,  has  undoubtedly  given  these 
branches  a permanent  place  in  our  schools”  (St.  Louis  An- 
nual Report,  1902,  p.  84). 

The  shift  to  a curriculum  which  included  more  “practi- 
cal” studies  paralleled  a similar  change  at  Central  High  School 
and  reflected  elements  of  the  educational  pol:cy  debate  on 
the  secondary  school  curriculum  being  carried  on  at  the  na- 
tional level.  With  this  transformation,  those  who  directed 
policy  altered  the  objectives  endorsed  by  Sumner  High 
School  in  the  nineteenth  century:  to  prepare  students  for 
college  and  for  teaching  in  the  St.  Louis  elementary  schools 
for  African  American  children. 

Sumner  High  School's  reputation  as  an  academic  insti- 
tution extends  back  to  its  first  graduating  class  in  1885.  On 
more  than  one  occasion  the  St.  Louis  Annual  Reports  attest 
to  the  fact  that  an  equal  level  of  scholarship  and  educational 
attainment  was  expected  of  students  from  Sumner  and  Cen- 
tral High  Schools.  Such  rhetoric  was  supported  by  a variety 
of  evidence.  For  instance,  the  1 90 1 Annual  Report  noted  that 
Sumner  High  School  was  equipped  with  “as  well  appointed  a 
chemical  laboratory  as  any  High  School  in  the  State”  (St. 
Louis  Annual  Report,  1902,  p.  85).  In  addition,  school  offi- 
cials reported  that  Sumner  High  School  graduates  had  con- 
tinued study  in  almost  every  college  in  the  United  States 
which  accepted  African  American  students  (Graves,  1993). 
Further,  historian  Horace  Mann  Bond  selected  Sumner  High 
School  as  an  example  of  a superior  high  school  among  large, 
segregated  city  school  systems  (Bond,  1 972). 

The  sterling  record  of  academic  achievement  identi- 
fied Sumner  High  School  as  an  outstanding  secondary  edu- 
cational institution  in  the  late  nineteenth  and  early  twentieth 
centuries.  Yet,  whereas  educators  were  eager  to  emphasize 
similarities  in  the  courses  of  study  between  public  high 
schools  for  African  American  and  European  American  chil- 
dren in  St.  Louis  prior  to  the  implementation  of  the  differenti- 
ated curriculum,  a different  rhetoric  emerged  in  the  1 920s.  In 
1928  the  St.  Louis  Annual  Report  clearly  stated  that  “the  law 
requires  that  both  white  and  negro  children  must  be  afforded 
equal  educational  opportunities.  It  should  be  noted  that  equal 
educational  opportunity  does  not  necessarily  imply  the  same 
educational  opportunity”  (St.  Louis  Annual  Report,  1928.  p. 
546).  As  Paul  Violas  (1978)  discusses  in  The  Training  of  the 
Urban  Working  Class , the  phrase  “equality  of  educational 
opportunity”  entered  the  educators’  lexicon  as  the  differen- 
tiated curriculum  reconstructed  the  high  school  curriculum. 
It  replaced  the  notion  of  “equal  education,”  a pillar  of  nine- 
teenth-century educational  philosophy  which  had  been  up- 
held in  1 894  by  the  National  Education  Association  Commit- 
tee of  Ten.  By  emphasizing  “opportunity.”  schools  offered 
different  and  unequal  education  to  students,  opening  the 
door  to  gender,  race,  and  social  class  discrimination.  A Feb- 
ruary 5,  1 933  article  in  the  St.  Louis  Globe-Democrat  titled  a 
report  on  one  “opportunity”  available  to  students  at  Vashon 
High  School  with  the  words,  “Where  Waiters  Arc  Trained” 
(Graves,  1993).  School  officials  thought  it  proper  to  devote 
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class  time  to  the  “scientific"  study  of  restaurant  service.  Such 
decisions  expose  a philosophical  reconstruction  of  the  ob- 
jectives of  secondary  education  which  repudiated  study 
aimed  at  intellectual  and  character  development.  The  emerg- 
ing philosophy  effected  one  of  the  most  significant  policy 
changes  in  twentieth-century  American  education.  How  did 
African  American  high  school  women  fare  in  the  curricular 
conversion  which  followed  in  St.  Louis? 

One  way  to  determine  the  degree  of  impact  that  the 
differentiated  curriculum  had  on  the  education  of  African 
American  women  in  St.  Louis  is  to  examine  percentages  of 
high  school  graduates  in  various  courses  of  study  from  1914 
to  1930,  See  Table  1 . Since  Sumner  High  School  introduced 
the  differentiated  curriculum  in  1911, 1914  marks  the  first  year 
that  African  American  graduates  were  distinguished  by 
course  of  study  in  the  St.  Louis  Annual  Reports.  The  class  of 
1 930  was  the  last  group  of  graduates  to  be  identified  by  course 
of  study.  The  information  in  Tables  1 ,2.  and  3 indicates  that 
both  gender  and  race  were  factors  which  influenced  the  course 
of  study  taken  by  African  American  women  high  school 
graduates  in  St.  Louis.1 

African  American  women  graduates  completed  the 
General  Course  more  often  than  any  other  course  of  study  in 
the  years  from  1914  to  1930.  Only  in  1919  and  1920,  years 
following  the  1917  passage  of  the  Smith-Hughes  legislation 
which  provided  federal  funding  for  vocational  education,  did 
more  women  graduate  from  the  Domestic  Art  and  Science 
Course  than  the  General  Course  at  Sumner  High  School.  The 
high  percentages  of  African  American  female  graduates  in 
the  General  Course  (one-half  or  more  in  twelve  of  the  seven- 
teen years  from  1914  to  1930)  suggest  that  the  legacy  of 
education  for  “race  uplift"  continued  to  influence  young 
women  who  were  making  decisions  concerning  secondary 
schooling.  The  General  Course,  with  more  emphasis  on  aca- 
demic subjects  than  the  Domestic  Art  and  Science  or  Com- 
mercial Courses,  was  better  able  to  satisfy  the  “great  desire 
for  education"  that  Paula  Giddings  (1984)  discusses  in  When 
and  Where  l Enter  (p.  101).  Many  women  looked  to  an  aca- 
demic education  to  provide  “an  escape  from  the  limitations 
that  society  imposed"  on  them  (Giddings,  1984,  p.  101).  Gen- 
der appears  to  have  been  a key  factor  in  this  course-taking 
pattern;  European  American  women  also  graduated  from  the 
General  Course  more  often  than  from  any  other  course  of 
study.  Fewer  percentages  of  African  American  men,  how- 
ever, graduated  from  the  General  Course  in  these  years.  Rarely 
did  more  than  one-third  of  Sumner  male  graduates  complete 
the  General  Course  (Graves,  1 993). 2 

It  is  important  to  note  that,  while  the  General  Course 
may  have  been  perceived  as  the  avenue  of  study  which  main- 
tained a connection  to  the  academic  curriculum  of  the  nine- 
teenth century,  it  was  not  considered  the  most  rigorous  course 
of  study  when  compared  to  new  additions  to  the  high  school 
curriculum.  Shortly  after  Central  High  School  expanded  its 
curriculum  to  include  the  Scientific  and  Classical  courses  of 
study  (which  occurred  about  a decade  before  these  courses 


were  offered  at  Sumner  High  School),  the  St.  Louis  Post- 
Dispatch  (1904)  proclaimed  that  the  “general  course  is  not 
considered  as  difficult  as  the  scientific  or  classical  course,  as 
it  gives  students  more  freedom  in  selecting  branches  of 
study." The  following  year  the  St.  Louis  Annual  Report  (1906) 
confirmed  this  statement  in  a description  of  the  various 
courses  of  study.  Listed  under  the  heading  of  “The  Best 
General  Education"  and  “recommended  in  the  order  in  which 
they  are  here  given"  were  the  Scientific.  Classical,  General, 
and  Art  Courses  (pp.  20 1-202).  The  striking  observation  from 
Table  3 is  the  disparity  between  the  percentages  of  male  and 
female  graduates  who  finished  the  Scientific  Course.  No  more 
than  3 percent  of  African  American  or  European  American 
women  graduated  from  the  course  labeled  “The  Best  General 
Education"  in  St.  Louis  from  1 9 14  to  1 930.  Gender  was  clearly 
a factor  here  since  both  African  American  and  European 
American  males  graduated  from  the  Scientific  Course  in 
double-digit  percentages  frequently  throughout  this  period. 

African  American  and  European  American  women, 
then,  were  quite  likely  to  graduate  from  the  General  Course 
and  not  likely  to  select  the  Scientific  Course.  Race,  however, 
appears  to  have  been  a significant  factor  regarding  other 
courses  of  study.  A higher  percentage  of  African  American 
women  graduated  from  the  Domestic  Art  and  Science  Course 
than  the  Commercial  Course  fifteen  out  of  the  seventeen  years 
from  1914  to  1930.  The  pattern  was  reversed  for  European 
American  women;  more  European  American  women  gradu- 
ated from  the  Commercial  Course  than  the  Domestic  Art  and 
Science  Course  in  all  but  six  years  in  this  period. 

While  the  Domestic  Art  and  Science  Course  was  not 
generally  the  dominant  course  of  study  for  African  Ameri- 
can women  graduates  in  St.  Louis,  rather  high  percentages 
of  women  did  finish  this  course.  The  percentages  were  in 
double-digits  for  fifteen  of  the  seventeen  years  from  1 9 1 4 to 
1 930,  reaching  a high  of  52  percent  in  1 9 1 9.  Whi le  secondary 
schooling  in  the  St.  Louis  public  high  schools  did  not  reflect 
the  Booker  T.  Washington  philosophy  of  education  which 
spread  through  the  South  after  his  Atlanta  Exposition  Ad- 
dress in  1895.  pragmatic  elements  regarding  the  economic 
value  of  schooling  filtered  in  some  way  to  most  schools. 
Giddings'  (1984)  point  that  “Funds  for  Black  schools  were 
easier  to  come  by  if  one’s  curricular  ‘buckets'  were  cast  in 
the  Washingtonian  mold"  is  well  taken  (p.  101).  In  addition  to 
the  advocates  of  home  economics,  ,who  preached  thrift  and 
morality  lessons,  were  the  voices  of  those  such  as  Mary 
Church  Terrell  who  looked  to  the  professionalization  of  do- 
mestic work  as  one  solution  to  the  labor  problem  encoun- 
tered by  African  Americans  early  in  the  twentieth  century 
(Anderson,  1988;  Giddings,  1984).  The  data  on  European 
American  women’s  enrollment  in  the  Domestic  Art  and  Sci- 
ence course  of  study  provided  a contrast  to  the  pattern  es- 
tablished by  African  American  women.  As  the  information  in 
Table  2 shows  European  American  women  graduated  from 
the  Domestic  Art  and  Science  Course  in  double-digit  per- 
centages only  in  the  seven  years  from  1914  to  1920.  The 
highest  percentage  ever  reached  was  26  percent  in  1917. 
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Table  Is  Percentages  of  African  American  Women 
Graduates  in  Various  Courses  of  Study  in  St  Louis 
Public  High  Schools,  1914  to  1930 


Year 

General 

Domestic 
Arts  & Sciences 

Commercial 

1914 

42 

7 

1915 

36 

22 

0 

1916 

75 

19 

2 

1917 

61 

29 

1918 

58 

31 

5 

1919 

38 

52 

5 

46 

44 

6 

1921 

55 

35 

2 

1922 

35 

27 

25 

1923 

64 

20 

14 

1924 

50 

21 

25 

1925 

65 

13 

1926 

74 

13 

5 

1927 

81 

6 

8 

1928 

72 

21 

3 

1929 

16 

9 

1930 

94 

4 

0.9 

Source:  St.  Louis  Annual  Reports. 


Table  2:  Percentages  of  European  American  Women 
Graduates  in  Various  Courses  of  Study  in  St  Louis 
Public  High  Schools,  1914  to  1930 


Year 

General 

Domestic 
Arts  & Sciences 

Commercial 

1914 

26 

17 

8 

1915 

25 

8 

1916 

39 

22 

13 

1917 

45 

26 

13 

1918 

57 

13 

1919 

54 

20 

12 

61 

11 

13 

1921 

51 

8 

11 

1922 

45 

6 

15 

1923 

43 

5 

17 

1924 

' 

5 

18 

1925 

48 

6 

19 

1926 

51 

5 

17 

1927 

51 

6 

14 

1928 

56 

4 

14 

1929 

69 

3 

13 

95 

0.5 

2 

Source:  St.  Louis  Annual  Reports. 


Table  3:  Percentages  of  St.  Louis  Public  High  School  Graduates 
in  the  Scientific  Course,  by  Sex  and  Race,  1914  to  1930 


Year 

African 

American 

Women 

African 

American 

Men 

European 

American 

Women 

European 

American 

Men 

1914 

1 

22 

2 

11 

1915 

0 

0 

1 

13 

1916 

2 

13 

0.2 

19 

1917 

0 

15 

1 

13 

1918 

1 

13 

1 

10 

1919 

3 

21 

1 

15 

1920 

0 

14 

2 

21 

1921 

1 

0 

0.8 

12 

1922 

0.7 

14 

0.8 

8 

1923 

0.9 

6 

0.4 

6 

1924 

0.8 

10 

0.3 

6 

1925 

1 

17 

0.5 

7 

1926 

0 

19 

0.2 

7 

1927 

1 

13 

0.4 

9 

1928 

1 

16 

0.1 

8 

1929 

0.5 

12 

0.1 

6 

1930 

0 

0 

0 

1 

Source:  St.  Louis  Annual  Repons. 
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Few  African  American  women  graduated  from  the  Com- 
mercial Course  in  St.  Louis.  With  the  exception  of  the  years 
1922  to  1925  when  ratios  ranged  from  10  to  25  percent*  less 
than  10  percent  of  African  American  women  graduated  from 
the  Commercial  Course.  Again,  a different  pattern  emerged 
for  European  American  students.  European  American  women 
graduated  from  the  Commercial  course  of  study  in  double- 
digit  percentages  fourteen  times  between  1 914  and  1930.  Em- 
ployment figures  for  St.  Louis  support  the  conclusion  that 
women’s  options  in  the  labor  force  made  an  impact  on  course 
selection.  In  19 10, 99  percent  of  women  employed  in  clerical 
occupations  in  St.  Louis  were  European  American,  Only  38 
African  American  women  were  hired  for  the  10,082  clerical 
positions  reported  in  the  census.  Ninety-two  percent  of  all 
African  American  women  in  the  St.  Louis  paid  labor  force 
were  hired  as  domestic  laborers  (U.S.  Bureau  of  the  Census, 
1914).  To  the  extent  that  a female  student's  schooling  was 
intended  to  prepare  her  for  the  paid  work  force,  race  was  a 
major  determinant  in  course  selection. 

The  course-taking  pattern  of  African  American  women 
in  St.  Louis  high  schools  from  1914  to  1930  both  confirms 
and  challenges  aspects  of  recent  theories  in  the  areas  of 
women's  educational  history  and  the  history  of  African 
American  education.  Rury's  (1991)  work  stands  in  the  fore- 
front of  those  who  have  argued  that  the  differentiated  cur- 
riculum created  a gender-segregated  high  school  curriculum 
(Powers,  1992;  Tyack  & Hansot,  1990).  Evidence  from  St. 
Louis  supports  this  point.  Few  African  American  women  stu- 
dents graduated  from  the  Scientific  Course  once  it  was  fi- 
nally offered  at  Sumner  High  School.  Fewer  than  2 percent  of 
African  American  women  graduates  took  the  Scientific  Course 
in  all  but  two  years  in  the  period  from  1914  to  1930.  In  con- 
trast, over  10  percent  of  African  American  men  in  St.  Louis 
graduated  from  the  Scientific  Course  during  most  of  these 
years.  The  course  of  study  taken  most  often  by  African  Ameri- 
can women,  the  General  Course,  was  not  a popular  course  for 
African  American  men;  the  highest  percentage  of  African 
American  men  who  graduated  from  the  General  Course  from 
1 9 1 4 to  1 930  was  39  percent  in  1 927.  In  point  of  fact,  fewer 
than  30  percent  of  male  graduates  finished  the  General  Course 
for  most  of  these  years  (Graves,  1993).  The  course  of  study 
taken  most  frequently  by  African  American  women  (follow- 
ing the  General  Course),  Domestic  Art  and  Science,  was  a 
course  designed  exclusively  for  women.  Thus,  after  the  ad- 
vent of  the  differentiated  curriculum,  the  vast  majority  of 
African  American  women  high  school  graduates  in  St.  Louis 
enrolled  in  courses  of  study  which  were  selected  by  few 
men.  While  women  and  men  often  studied  in  the  same  class- 
rooms together  (many  classes  were  required  across  all 
courses  of  study),  gender  was  a significant  factor  in  deter- 
mining a student's  course  of  study. 

Historians  disagree  on  the  importance  of  this  phenom- 
enon, Tyack  and  Hansot  (1990)  admit  that  the  public  high 
school  of  the  1920s  clearly  evinced  more  sex  differentiation 
than  its  nineteenth-century  counterpart;  however,  they  claim 
that  segregation  by  gender  occurred  only  on  the  periphery 
of  the  curriculum.  Their  argument  discounts  the  hidden  mes- 


sages embedded  in  a gender-segregated  curriculum.  Powers 
( 1 992)  extends  a different  interpretation.  She  writes  that  al- 
though home  economics  courses  never  measured  up  to  the 
social-efficiency  ideal  promoted  by  reformers  in  the  first  de- 
cades of  the  twentieth  century,  it  did  become  a standard  of- 
fering in  most  junior  and  senior  high  schools  in  the  Unit'd 
States.  As  a result,  women’s  enrollments  in  mathematics  and 
science  courses  dropped  after  1900  and  a legacy  of  gender 
segregation  in  the  high  schools  was  established  (Powers, 

1 992).  Statistics  concerning  African  American  women’s  en- 
rollments in  the  Scientific,  Domestic  Art  and  Science,  and 
General  Courses  in  St.  Louis  support  these  points.  Women's 
participation  in  the  Scientific  course  of  study  was  minimal 
and  women’s  dominance  in  the  General  and  Domestic  Art 
and  Science  courses  very  likely  strengthened  the  conscious- 
ly ss  of  a gender  segregated  curriculum.  Unlike  Tyack  and 
K.,nsot's  thesis.  Powers'  argument  acknowledges  the  force 
of  rhetoric  in  forming  one's  educational  experiences.  She 
makes  a strong  case  that  myths  are  “at  all  times  a powerful 
shaping  force"  (Powers,  1 992,  p.  9). 

St.  Louis  data  on  African  American  and  European 
American  women  graduates'  enrollments  in  the  Domestic  Art 
and  Science  and  Commercial  courses  of  study  also  support 
Rury's  ( 1991 ) second  major  conclusion,  that  the  differenti- 
ated curriculum  reproduced  the  social  division  of  labor  within 
the  female  work  force.  Hiring  patterns  in  St.  Louis  funneled 
most  African  American  women  into  domestic  service  and 
reserved  clerical  work  for  European  American  women.  Course- 
taking patterns  in  St.  Louis  high  schools  reflected  this  eco- 
nomic reality  as  more  African  American  women  graduated 
from  the  Domestic  Art  and  Science  Course  than  the  Commer- 
cial Course,  while  the  reverse  was  true  for  European  Ameri- 
can women.  Undoubtedly,  given  that  only  0.3  percent  of 
women  with  clerical  positions  in  1910  were  African  Ameri- 
can, women  in  St.  Louis  shared  the  experience  of  Addie  W. 
Hunter,  a graduate  of  the  Cambridge  Latin  and  High  School. 
Writing  in  1916  on  her  unsuccessful  lawsuit  to  gain  a clerical 
position  for  which  she  was  qualified.  Hunter  commented, 
“For  the  way  things  stand  at  present,  it  is  useless  to  have  the 
requirements.  Color — the  reason  nobody  will  give,  the  rea- 
son nobody  is  required  to  give,  will  always  be  in  the 
way"!  Jones.  1985.  p.  179). 

Although  African  American  women  graduated  from 
the  General  and  Domestic  Art  and  Science  Courses  in  far 
greater  numbers  than  the  Commerical  Course,  the  data  from 
St.  Louis  do  challenge  the  trend  regarding  commercial  sub- 
jects in  one  way.  Powers  (1992)  reports  that  only  2 percent  of 
all  African  American  high  school  students  were  enrolled  in 
commercial  courses  in  1 925.  In  St.  Louis,  however,  1 925  capped 
off  a four-year  period  in  which  African  American  women 
graduated  from  the  Commercial  course  of  study  in  double- 
digit percentages.  Furthermore,  in  twelve  of  the  seventeen 
years  from  19 14  to  1930.  the  percentage  of  African  American 
women  graduates  in  the  Commercial  C oursc  in  St.  Louis  ex- 
ceeded the  1925  national  average. ' 
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The  record  of  African  American  high  school  gradu- 
ates in  St.  Louis  further  advances  our  understanding  of  the 
effects  of  the  differentiated  curriculum  on  women  with  the 
information  it  provides  on  Domestic  Art  and  Science.  Histo- 
ries of  women’s  experiences  with  the  differentiated  curricu- 
lum, thus  far,  stress  the  prominent  place  home  economics 
was  given  in  African  American  women's  education  (Powers, 
1992;  Rury,  1991;  Tyack  & Hansot,  1990).  Certainly,  this  point 
is  upheld  by  the  St.  Louis  data.  Domestic  Art  and  Science  did 
account  for  a substantial  percentage  of  African  American 
female  graduates;  however,  perhaps  an  equally  vital  point  is 
that,  for  the  period  under  examination,  most  women  gradu- 
ated from  the  General  Course,  rejecting  the  Domestic  Art  and 
Science  course  of  study.  Evidence  from  other  high  schools 
in  this  period  is  needed  to  determine  the  extent  to  which 
Domestic  Art  and  Science  courses  did,  indeed,  dominate 
African  American  women's  education. 

It  is  probable  that  the  impact  of  the  differentiated  cur- 
riculum on  African  American  women’s  secondary  education 
varied  by  geographic  region  and  the  histories  of  various  in- 
stitutions. Anderson's  comprehensive  study  of  African 
American  education  in  the  South  documents  that  as  African 
Americans  lost  political  and  economic  power  in  the  post- 
Reconstruction  years,  they  lost  substantial  control  of  public 
schools.  A second-class  education  emanated  from  a social 
ideology  designed  to  foster  conformity  to  racist  forms  of 
political  and  economic  subordination  (Anderson,  1 988).  It  is 
logical  to  suspect  that  the  differentiated  curriculum  in  south- 
ern high  schools  for  African  Americans,  where  they  existed 
in  the  early  years  of  the  twentieth  century,  channeled  women 
students  into  Domestic  Art  and  Science  courses.  Thus,  high 
school  for  most  African  American  women  became  training 
for  domestic  work.  Rury  (1991)  states  that  this  is  the  pattern 
which  developed  in  Memphis.  In  high  schools  for  African 
American  students  with  an  established  history  of  first-class 
academic  education,  however,  the  differentiated  curriculum 
probably  affected  women  students  in  a different  manner.  One 
such  institution  was  The  M Street  School  in  Washington, 
D C.  Students  there  became  well-known  for  their  academic 
achievements,  and  attended  the  most  prestigious  universi- 
ties in  the  United  States.  Principal  Anna  Julia  Cooper  took  a 
stand  against  the  movement  to  weaken  the  academic  content 
of  the  high  school  curriculum  and  it  cost  her  her  job  in  1906 
(Giddings,  1984). 


Evidence  from  St.  Louis  high  schools  suggests  that 
the  differentiated  curriculum  did  not  affect  all  African  Ameri- 
can students  in  the  same  way.  nor  did  it  affect  African  Ameri- 
can students  exactly  as  it  affected  European  American  stu- 
dents. Further  study  of  curriculum  development  in  schools 
such  as  Sumner  High  School  and  The  M Street  School  is 
needed  to  fully  understand  the  influence  the  differentiated 
curriculum  brought  to  bear  on  secondary  education  in  the 
United  States.  How  many  schools  were  able  to  maintain 
Cooper’s  vision  of  an  academic  education,  and  for  how  long? 
Was  the  African  American  legacy  of  education  for  “race  up- 
lift” strong  enough  to  hold  off  the  economic  pull  on  school- 
ing? How  much  did  African  American  students’  educational 
experiences  vary  across  different  types  of  institutions  and  in 
different  regions  of  the  country?  The  issues  involved  in  the 
introduction  of  the  differentiated  curriculum  are  complex;  they 
are  embedded  in  a network  of  political,  social,  and  economic 
forces.  Knowledge  about  the  high  school  experiences  of 
African  American  women  will  sharpen  our  assessment  of  the 
impact  of  the  differentiated  curriculum  on  secondary  educa- 
tion in  the  United  States  and  on  the  lives  of  the  students  who 
were  thus  schooled. 


1 Since  few  African  American  women  graduated  from  the  Art  or 
Classical  Courses,  these  courses  of  study  will  not  be  addressed  in 
this  study. 

2 A substantial  percentage  of  male  graduates  from  Sumner  High 
School  in  the  years  from  19 14  to  1930  completed  the  Manual  Train- 
ing Course;  the  Scientific  and  Commercial  Courses  also  claimed  a 
significant  percentage  of  African  American  men  graduates.  The 
General  Course  claimed  an  increasingly  larger  percentage  of  women 
high  school  graduates  and  European  American  men  graduates  in  the 
five  years  leading  up  to  1 930.  The  percentage  of  African  American 
men  who  gradu^ied  from  the  General  Course  remained  under  40 
percent  during  this  period,  until  91  percent  of  African  American 
men  graduated  from  the  General  Course  in  1930.  Perhaps  students 
were  encouraged  to  select  the  General  Course  a few  years  before  the 
practice  of  recognizing  graduates  by  other  courses  of  study  was 
eliminated. 

' Further  research  may  disclose  the  conditions  in  St.  Louis  which 
prompted  the  above-average  enrollments  in  the  Commercial  Course. 


Please  Plan  to  Attend  Our : 

• MWERA  Association  Council  Meeting,  Thursday,  October  12,  3: 10  - 4:40  pm,  Medill  Room 

• MWERA  General  Business  Meeting,  Friday,  October  13,  9 - 10  am,  Medill  Room 
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Federal  Aid,  Black  Separatism,  and  the  Public  Schools 


Joseph  Walras,  University  of  Dayton 

Abstract 

In  1967 , President  Johnson  announced  the  creation  of  the  Model  Cities  program  to  give  special  grants 
to  cities  that  developed  comprehensive  plans  enlisting  federal,  state,  local , and  private  resources  to 
transform  blighted  areas  into  useful  ones.  Dayton,  Ohio  was  among  the  first  cities  to  have  such  a 
program,  and  it  was  directed  by  African  American  residents  from  the  section  known  as  the  inner  west . 
While  these  community  activists  instituted  important  reforms  within  the  schools  and  the  neighborhoods 
where  low  income  African  American  families  lived,  they  frustrated  efforts  to  racially  desegregate  the 
public  schools.  Consequently,  the  story  of  Dayton  s Model  Cities  Demonstration  Project  raises  the 
important  question  whether  urban  renewal  and  school  improvement  can  be  accomplished  while  main- 
taining segregated  conditions . 


In  northern  cities,  the  civil  rights  movement  had  at 
least  two  parts.  One  part  was  the  legal  suits  the  NAACP 
directed  against  segregated  school  districts.  The  legal  cases 
in  the  north  tried  to  dismantle  the  racial  segregation  of  schools 
caused  by  racially  separate  neighborhoods.  For  example,  in 
Milliken  v.  Bradley , the  NAACP  sought  to  integrate  White 
children  from  suburban  communities  with  the  Black  children 
in  Detroit.  In  part,  because  of  dismay  over  the  slowness  of 
desegregation,  other  African  Americans  took  another  direc- 
tion. Some  community  activists  asked  for  reforms  within  the 
schools  and  the  neighborhoods  where  low  income  Black  fami- 
lies lived.  In  places  such  as  Dayton,  Ohio,  reporters  some- 
times called  these  activists  “Black  separatists". 

Interestingly,  the  federal  government  aided  both 
groups.  NAACP  lawyers  found  the  federal  courts  to  be  ame- 
nable to  the  changes  they  requested.  The  second  group, 
called  Black  separatists,  found  the  Model  Cities  program  a 
source  of  millions  of  dollars  for  activities  they  wanted  to 
begin.  While  these  two  efforts  appear  distinct,  they  repre- 
sent intrusions  by  the  federal  government  into  local  school 
affairs.  NAACP  lawyers  wanted  the  federal  courts  to  change 
the  local  school  attendance  policies  they  saw  as  unfair.  On 
the  other  hand.  Presidents  Johnson  and  Nixon  thought  the 
Model  Cities  programs  would  help  residents  direct  the  fed- 
eral programs.  Consequently,  researchers  could  use  the  cases 
of  court-ordered  desegregation  and  the  Model  Cities  pro- 
gram to  ask  whether  the  federal  government  can  engineer 
racial  harmony.  The  Model  Cities  program  raises  another  im- 
portant question.  This  is  whether  urban  renewal  and  school 
improvement  can  be  accomplished  while  maintaining  segre- 
gated conditions. 

The  National  Model  Cities  Program 

During  the  1960s,  the  federal  government  intervened 
in  a wide  range  of  local  community  affairs.  According  to  James 
Sundquist  ( 1 969).  foremost  among  these  efforts  was  the  Eco- 
nomic Opportunity  Act  of  1964.  Designed  for  urban  and 
rural  areas,  this  Act  called  for  locally  initiated  comprehen- 


sive community  action  programs  to  focus  a variety  of  re- 
sources on  the  roots  of  poverty.  The  hope  was  that,  in  each 
community,  community  action  agencies  would  bring  together 
separate  efforts  sponsored  by  the  federal,  state,  and  local 
governments  to  create  a unified  approach. 

Unfortunately,  the  job  was  too  large  for  the  community 
action  agencies.  Sundquist  says  that  there  are  many  reasons 
why  community  action  agencies  failed.  One  reason  is  that 
those  agencies  never  occupied  seats  of  authority  in  their 
local  communities.  For  example,  southern  communities  saw 
the  community  action  agencies  as  extensions  of  the  civil 
rights  movement  that  the  White  leadership  distrusted.  An- 
other reason  is  the  community  action  agencies  grew  quickly 
and  created  projects  without  careful  planning.  Sundquist 
believes  the  federal  government  encouraged  the  chaotic 
growth  of  community  action  agencies.  He  says  that  the  Of- 
fice of  Economic  Opportunity  approved  “individual  projects 
that  would  not  be  inconsistent  with  the  comprehensive  plans 
when  and  as  they  were  developed"  ( 1969,  p.  39).  Conse- 
quently, individual  communities  did  not  study  their  prob- 
lems but  submitted  applications  indiscriminately.  In  response, 
the  “OEO  . . . began  to  set  its  own  priorities  in  ‘national 
emphasis  programs’"  (Sundquist.  1 969,  p.  42).  Among  these 
were  Operation  Head  Start,  legal  services,  comprehensive 
health  services,  foster  grandparents,  and  Upward  Bound. 
The  result  was  that  community  action  agencies  could  no 
longer  devise  plans  to  fit  the  local  conditions.  Despite  ef- 
forts in  1966  to  reinforce  the  authority  of  the  community  ac- 
tion agencies,  the  results  were  disappointing.  In  1967, 
Sundquist  visited  several  community  action  agencies  around 
the  country.  He  found  that  they  were  unable  to  carry  out 
their  proposed  functions  of  community-wide  planning,  mo- 
bilization. and  coordination. 

Less  than  three  years  after  forming  community  action 
agencies.  President  Johnson  announced  the  creation  of  the 
Model  Cities  program  to  give  special  grants  to  cities  that 
developed  comprehensive  plans  that  enlisted  federal,  state, 
local,  and  private  resources  to  uar.sfomi  blighted  areas  into 
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useful  ones.  In  January  1966,  President  Johnson  sent  the 
proposal  for  Model  Cities  to  the  U .S.  Congress  saying  that  it 
would  ‘'concentrate . . . available  resources  — in  planning,  in 
housing  construction,  in  job  training,  in  health  facilities,  in 
recreation,  in  welfare  programs,  in  education-to  improve  the 
conditions  of  life  in  urban  areas”  (Sundquist,  1969,  p.  81). 
The  Model  Cities  program  included  two  important  changes 
from  the  community  action  agencies.  First,  Model  Cities  re- 
quired that  comprehensive  and  coordinated  planning  take 
place  before  any  action  began.  As  a result,  cities  applied  for 
planning  grants  :o  submit  proposals.  If  the  U.S.  Department 
of  Housing  and  Urban  Development  accepted  a proposal,  it 
gave  the  winning  city  another  year  to  perfect  five-year  ac- 
tion plans.  Second,  in  order  to  receive  a Model  Cities  grant, 
proposals  had  to  show  evidence  of  citizen  participation  in 
the  planning  and  execution  of  the  program. 

In  November  1 966,  despite  waning  support  for  the  War 
on  Poverty,  the  U.S.  Congress  approved  most  of  the  Model 
Cities  program  that  the  President  had  submitted.  Congress 
reduced  the  funding,  dropped  a provision  calling  for  racial 
integration  of  housing,  prohibited  HUD  from  requiring  school 
busing  as  a precondition  of  assistance,  and  eliminated  the 
requirement  for  each  city  to  have  a federal  coordinator 
(Sundquist,  1969,p.  82). 

Dayton  Model  Cities  Demonstration  Project 

When  the  U.S.  Department  of  Housing  and  Urban  De- 
velopment set  a deadline  of  May  1,  1967  for  initial  proposals. 
Dayton,  Ohio  was  ready  to  apply.  Dayton’s  city  manager  had 
recently  hired  an  administrative  assistant  to  coordinate  all 
federal  programs.  The  city  had  just  finished  a five-year  study 
funded  by  the  U.S.  Department  of  Housing  and  Urban  De- 
velopment that  fit  the  Model  Cities  program.  This  study 
recommended  improvement  of  the  city's  economic  base,  ag- 
gressive enforcement  of  building  codes  and  housing  reha- 
bilitation, and  extension  of  self-help  programs  to  urban  dwell- 
ers. In  May  1966,  Dayton's  City  Commission  assigned  an 
agency,  named  the  Special  Committee  On  Urban  Renewal 
(SCOUR)  to  prepare  a draft  application.  The  agency  hired  a 
university  professor  as  a consultant  who  picked  West  Day- 
ton  as  the  focus  of  the  Model  Cities  application.  West  Day- 
ton  contained  30 9c  of  Dayton's  substandard  housing.  The 
area  had  a population  of  42,000  residents,  92  % of  whom  were 
Black,  and  329F  of  whom  had  annual  incomes  of  less  than 
$3000  (Staff  Report,  1969). 

On  September  1 , 1 966,  some  residents  of  West  Dayton 
rioted  briefly  but  dramatically.  The  television  and  newspaper 
accounts  confirmed  the  view  that  West  Dayton  should  re- 
ceive the  attention  of  Model  Cities.  When  SCOUR  released 
the  preliminary  draft  in  December  1966,  a group  of  African 
Americans  complained  that  the  people  who  lived  in  the  area 
had  not  helped  prepare  it.  They  claimed  the  program  short- 
changed the  residents.  (Staff  Report,  1969).  In  January  1967, 
when  HUD  distributed  guidelines  for  the  program.  SCOUR 
revised  the  draft  application  to  include  the  concerns  voiced 
by  West  Dayton  residents. 


Submitted  on  April  1 2, 1 967,  SCOUR’S  Model  City  ap- 
plication asserted  that  Dayton  had  the  problems  found  in 
any  large  city,  but  that  they  were  less  pronounced  and  there- 
fore solvable.  The  application  said  that  neighborhood  asso- 
ciations created  a system  of  indigenous  leadership.  The  ap- 
plication added  that  the  city  had  a new  city  manager,  a new 
police  chief,  and  a new  superintendent  of  public  schools 
who  would  initiate  new  plans  ( Special  Committee  on  Urban 
Renewal,  1967).  Pointing  to  the  1966  riot  to  prove  the  needs 
of  West  Dayton,  SCOUR’s  plan  was  to  set  up  programs  to 
assure  freedom  of  choice  in  housing,  job  opportunity,  and 
job  training.  It  offered  two  innovative  suggestions:  a Plan- 
ning Council  composed  of  elected  residents  and  a founda- 
tion to  raise  private  money  to  add  to  the  programs  (Special 
Committee  On  Urban  Renewal,  1967). 

While  SCOUR'S  application  was  under  consideration 
in  Washington,  two  disturbances  broke  out  in  the  desig- 
nated program  area.  In  October  1967,  the  city  hired  an  interim 
Model  Cities  project  coordinator,  opened  offices  in  West 
Dayton,  and  initiated  a housing  inspection  program  in  West 
Dayton.  The  project  coordinator  appointed  an  Ad  Hoc  Ad- 
visory Committee  to  structure  elections  of  residents  for  the 
Planning  Council.  He  organized  the  Model  Cities  Policy  Com- 
mittee consisting  of  representatives  from  local  public  agen- 
cies, such  as  the  City  Commission,  the  Board  of  Education, 
and  the  County  Board  of  Commissioners.  According  to  the 
Project  Coordinator’s  ideas,  the  policy  committee  was  going 
to  supervise  the  actions  of  the  Planning  Council.  HUD  ap- 
proved this  arrangement.  On  November  1 6, 1 967,  Dayton  was 
among  seventy-five  cities  to  receive  a federal  planning  grant. 

In  January  1968,  the  residents  argued  against  the  planned 
structure  complaining  that  the  professionals  on  the  policy  com- 
mittee could  overrule  the  decisions  made  by  the  Planning  Coun- 
cil. This  dispute  arose  again  in  the  middle  of  February;  the  city 
manager  applied  for  federal  money  to  fund  a Concentrated  Em- 
ployment Program  without  seeking  the  agreement  of  the  Plan- 
ning Council.  After  a long  meeting,  the  city  commission  abol- 
ished the  policy  committee.  This  gave  the  residents  on  the 
Planning  Council  the  power  to  make  the  policy  decisions  for 
the  Model  Cities  program  (Staff  Report,  1 969). 

The  formation  of  the  Planning  Council  generated  wide- 
spread enthusiasm  among  residents  in  the  project  target  area. 
Seventy-one  candidates  ran  for  27  scats.  On  election  day, 
March  14. 1968,  fully  24  percent  of  the  eligible  voters  came  to 
vote.  No  other  Model  Cities  program  in  the  nation  had  a 
higher  turn  out  of  eligible  voters  than  cast  ballots  in  Dayton 
(Staff  Report,  1969).  Once  elected,  the  Planning  Council 
seemed  to  turn  to  young  or  militant  Black  people  for  leader- 
ship. The  result  was  that  the  residents  in  the  community  who 
had  distinguished  records  of  service  accused  the  Planning 
Council  of  being  aloof  and  unrespoi,  .ive.  On  April  24,  1968, 
angry  members  of  other  community  groups  complained  that 
the  Model  Cities  program  was  violating  their  trust,  making 
decisions  in  closed  sessions,  and  neglecting  their  own  con- 
stituency. The  residents  who  complained  were  also  African 
Americans  ( Goodman,  1968a).  These  people  collected  246 
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signatures  on  petitions  asking  that  their  neighborhood  as- 
sociations  no  longer  be  considered  part  of  Model  Cities.  They 
withdrew  their  petitions  when  the  Planning  Council  prom- 
ised to  meet  with  them  to  find  ways  to  settle  the  difficulties 
(Dansker,  1968). 

In  June  1968,  Battelle  Memorial  Institute  released  an 
evaluation  of  Dayton's  Model  City  program.  It  repeated  the 
charge  that  the  Planning  Council  failed  to  involve  the  resi- 
dents in  decisions.  The  report  said  that  a few  people  made 
the  major  decisions  about  programs.  Furthermore,  the  Battelle 
report  said  the  Planning  Council  had  a poor  public  informa- 
tion program  that  caused  area  residents  to  form  unrealistic 
expectations.  Battelle's  report  laid  the  blame  on  the  Model 
Cities  Planning  Council;  it  said  the  members  had  developed 
internal  solidarity  fighting  for  a strong  role.  Unfortunately, 
those  same  members  tended  to  ignore  important  program- 
matic considerations,  and  they  had  weak  ties  to  the  commu- 
nity (Goodman,  1968b). 

The  power  the  Planning  Council  held  made  the  Dayton 
Model  Cities  Demonstration  Project  unique.  No  other  pro- 
gram approved  by  HUD  allowed  target  area  citizens  to  have 
equal  authority  with  the  city  administration.  To  some  extent, 
federal  officials  saw  this  as  a risk.  The  director  of  Model 
Cities  Administration  in  New  York  said  that  “it  is  the  city's 
responsibility  to  delineate  the  extent  of  citizen  responsibil- 
ity". He  saw  citizen  participation  as  dangerous  when  the 
group  decided  to  act  on  its  own.  While  he  praised  Dayton’s 
coalition  between  citizens  and  city  hall,  he  noted  that  his 
confidence  was  “based  on  the  City  Manager’s  ability  to  stay 
on  top  of  the  program”  (Goldwyn,  1 968). 

Evaluators  commissioned  by  HUD  to  study  similar  pro- 
grams in  eleven  cities  revealed  the  unique  nature  of  Dayton's 
Model  Cities  Demonstration  Project.  Released  in  1970,  the 
report  by  Marshall  Kaplan,  Gans,  and  Kahn,  Inc.  noied  that 
Dayton,  Ohio  was  the  only  program  where  the  residents  domi- 
nated the  planning  responsibilities.  The  report  said  that  in 
Dayton's  case,  the  existence  of  a cohesive  resident  base  en- 
abled them  to  exert  dominance.  However,  it  added  that 
Dayton's  city  manager  was  continually  involved  in  the  Model 
Cities  program  offering  visible  public  suppoit.  Unfortunately, 
since  residents  inexperienced  with  government  regulations 
dominated  Dayton’s  program,  the  proposal  ignored  many  of 
HUD’s  guidelines  (Staff  Report,  1970). 

M(*>1  Cities  and  the  Board  of  Education 

Resident  domination  of  Dayton's  Model  Cities  educa- 
tion component  led  to  conflicts  with  the  Board  of  Education. 
In  general,  the  School  Board  supported  Model  Cities.  For 
example,  on  June  27.  1 968.  the  Board  announced  the  creation 
of  an  Integration  Advisory  Council  to  report  directly  to  the 
Board.  The  members  of  the  Advisory  Council  came  from  all 
sections  of  the  city  including  the  West  Dayton.  In  addition, 
at  the  same  June  1968  meeting,  the  Board  appointed  3 1 build- 
ing administrators,  16  of  whom  were  Black  (Lashley,  1968). 
However,  thirty  White  supporters  of  the  Model  Ciltes  Plan- 


ning Council  who  attended  the  School  Board  meeting  in  June 
1968  did  not  see  these  changes  as  improvements.  They 
shouted,  “Black  control  of  Black  schools.”  They  claimed  they 
favored  integration,  but  since  there  were  Black  schools,  they 
thought  Blacks  should  control  them.  An  African  American 
employee  of  the  juvenile  detention  center  objected  saying 
that  “Black  control  of  Black  schools  means  White  control  of 
White  schools”  (Plan  Rebuked,  1 968). 

At  first,  the  Model  Cities  members  and  the  school  offi- 
cials tried  to  appease  each  other.  In  July  1968,  the  newly 
appointed  Dayton  school  superintendent  paid  his  first  visit 
to  a meeting  of  the  Model  Cities  Planning  Council.  He  praised 
the  program  as  “a  unique  opportunity  for  achievement  in  the 
inner  city”  (Dansker,  1968).  The  education  consultant  to 
Model  Cities  tried  to  help  the  public  schools.  In  December 
1 968,  the  School  Board  asked  the  voters  to  approve  a school 
tax  levy.  The  Model  Cities  consultant  suggested  using  some 
Model  Cities  program  money  to  help  the  schools  in  the  entire 
city  (Model  Cities  Levy  Linked,  1968). 

At  the  November  1968  meeting,  Dayton's  Board  of 
Education  declared  its  desire  to  actively  participate  in  the 
Model  Cities  program.  Although  this  was  only  tentative  ap- 
proval, it  was  essential  in  order  for  Model  Cities  to  receive 
federal  support.  Unfortunately,  it  was  not  clear  who  would 
control  the  schools  in  the  Model  Cities  area.  In  1968,  the 
Board  of  Education  approved  the  formation  of  community 
school  councils.  In  each  school  building,  the  council  included 
six  parents  elected  from  the  area,  the  principal,  the  commu- 
nity school  director,  representatives  from  the  teachers'  orga- 
nizations, and,  in  the  high  schools,  a member  of  the  student 
council.  The  purpose  of  these  community  school  councils 
was  to  encourage  citizen  participation  in  school  affairs 
(Projects  Listed,  1968).  On  the  other  hand,  the  Model  Cities 
people  expected  these  councils  do  more  than  encourage  citi- 
zen participation.  They  wanted  these  school  councils  to  have 
final  authority  over  whatever  happened  in  those  schools. 
The  1969  Comprehensive  Model  Cities  Plan  said  that  the 
community  school  councils  had  to  have  authority  if  the 
schools  were  to  serve  the  children  in  the  neighborhood. 

The  1969  application  made  a significant  change  over 
the  initial  application  submitted  in  1967  by  SCOUR.  The 
premise  of  the  SCOUR'S  1967  application  was  that  there  was 
something  wrong  with  the  homes  and  the  neighborhoods  in 
which  the  children  lived.  Thus,  they  proposed  that  compen- 
satory education  services  should  extend  from  preschool 
through  upper  secondary  level.  These  services  were  to  make 
up  for  non-supportive  homes,  deprived  environments,  and 
prevailing  disinterest  in  school  success.  In  contrast,  the  1969 
Model  Cities  comprehensive  plan  said  the  basic  cause  of  the 
problems  found  in  the  inner  West  area  was  discrimination 
expressed  in  four  ways.  First,  the  residents  were  excluded 
from  policy  making  or  administrative  decisions.  Second,  the 
services  delivered  to  the  area  were  inadequate.  Third,  indi- 
viduals were  prevented  from  using  supposedly  available  ser- 
vices. Fourth,  the  residents  had  few  choices  in  employment 
or  housing.  To  prove  the  pervasiveness  of  discrimination. 
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they  said  “the  Dayton  Board  of  Education  divides  the  money 
within  its  budget  into  equal  portions  for  school  districts 

throughout  the  city.  This  appears  to  be  fair Except*  the 

children  in  Model  Cities  Neighborhood  schools  have  a wide 
variety  of  special  needs  and  problems. . . . An  equal  portion 
is  not  enough  to  enable  these  children  to  achieve  at  the  same 
level  as  students  from  other  homes”  (City  of  Dayton,  1 969). 
First,  the  1969  plan  asserted  that  the  seven  members  of  the 
Dayton  Board  of  Education  School  Board  did  not  represent 
individuals  living  in  the  Model  Cities.  The  Planning  Council 
did  conclude  that  “community  involvement  and  the  exchange 
of  ideas  between  the  community  and  the  School  Board,  which 
represents  the  larger  White  community,  has  been  discour- 
aged by  the  forbidding  facts  of  organizational  structure  and 
operation”  ( City  of  Dayton,  1 969).  Second,  evidence  of  inad- 
equate services  was  found  in  the  low  achievement  of  stu- 
dents, the  high  number  who  drop  out,  and  the  few  students 
going  on  to  college.  Further,  the  Planning  Council  said  that 
many  of  these  difficulties  arose  because  the  residents  lacked 
access  to  the  schools;  the  lack  of  communication  and  shar- 
ing of  power  by  the  School  Board  alienated  parents  and  chil- 
dren who  then  did  not  identify  with  the  goals  of  the  schools. 

In  its  application,  the  Planning  Council  exaggerated 
the  failings  of  the  School  Board.  Although  federal  courts 
decided  that  Dayton  had  operated  a dual  system  of  schools, 
at  least  one  Black  man  had  been  a member  of  the  Board  from 
1954.  In  1969,  none  of  the  seven  members  of  the  School  Board 
lived  in  the  inner  West  section,  but  one  member  lived  in  the 
West  side  of  Dayton.  Further,  the  Model  Cities  Planning 
Council  ignored  the  new  superintendent’s  efforts  to  hire  Af- 
rican American  administrators  and  to  introduce  Black  stud- 
ies and  ethnic  sensitivity  programs  into  the  schools.  The 
Planning  Council  may  have  ignored  these  improvements  be- 
cause it  wanted  to  justify  taking  control  of  the  schools  in  the 
Mwdel  Cities  area.  They  wanted  to  control  the  finances;  they 
also  wanted  the  power  to  select  staff,  principals,  and  teach- 
ers for  the  schools. 

The  Planning  Council  moved  to  take  this  control.  In 
April  1969,  the  chairperson  of  the  Model  Cities  Planning 
Council  said  that  the  purpose  of  the  elected  councils  should 
be  to  set  policy  for  the  schools.  He  added  that  the  educa- 
tional technicians  would  carry  it  out  (Harris,  1969a).  Conse- 
quently, the  Planning  Council  set  up  programs  to  prepare 
residents  to  serve  on  the  community  school  councils.  In 
June  1 969,  the  project  director  of  the  educational  component 
reported  success  in  teaching  residents  “to  participate  fully 
in  the  development  of  new  educational  programs  for  the  en- 
tire community.”  The  residents  who  took  pari  in  this  program 
learned  to  make  decisions  about  site  selection  of  schools, 
design  of  schools,  purchase  of  materials,  and  designing  cur- 
riculum. According  to  the  report,  the  participants  viewed  the 
program  as  one  that  was  moving  toward  positive  school  re- 
form (Thomas,  1969). 

Although  it  generated  intense  emotions,  the  fight  for 
Black  control  of  Black  schools  did  not  alter  the  educational 
programs.  It  devolved  into  a narrow  personnel  dispute.  The 


Planning  Council  wanted  a young  African  American  man,  then 
an  assistant  principal  in  a Dayton  school,  to  he  the  director. 
The  Board  was  unwilling  to  name  him,  although  they  agreed  to 
do  so  on  June  10, 1969  (Harris,  1969b).  In  July  1969,  the  School 
Board  reversed  a decision  the  director  made  about  job  an- 
nouncements for  positions  in  the  Model  Cities  education  staff 
(Allbaugh,  1969).  The  Model  Cities  education  director  fought 
the  Board  saying  that  the  School  Board  should  not  control  the 
project.  He  said  the  City  Demonstration  Agency  controlled 
Model  Cities  since  the  federal  money  went  to  this  group;  the 
City  Commissioner  and  the  Superintendent  of  Dayton  schools 
disagreed.  Although  he  lost  that  battle,  the  Education  Director 
publicly  accused  the  Superintendent  and  the  Dayton  School 
Board  of  trying  to  destroy  Model  Cities  (Felton,  1969).  After 
nearly  eight  months  of  rancor,  the  Board  agreed  that  all  propos- 
als affecting  schools  in  the  target  area  would  be  agreeable  to 
the  Model  Cities  Planning  Council  (Worth  1 969).  Two  months 
later,  the  Board  fired  the  Education  Director  of  Model  Cities 
because  he  had  interfered  at  a not  at  Stivers  High  School.  When 
the  School  Board  ignored  the  protests  of  the  Planning  Council, 
the  Planning  Council  sued  in  common  pleas  court.  They  com- 
plained that  the  Board  of  Education  had  violated  the  agreement 
to  share  decision  making  with  the  Planning  Council.  In  Novem- 
ber 1969,  the  judge  ruled  that  the  Board  could  not  enter  an 
agreement  to  share  the  power  to  select  personnel;  the  School 
Board  could  not  abdicate  the  responsibility  to  hire,  retain,  or 
dismiss  staff.  In  January  1 970,  the  Planning  Council  returned  to 
court  and  contended  that  federal  program  guideline  stipulated 
that  the  Board  of  Education  and  the  Planning  Council  share 
power.  The  judge  said  that  federal  guidelines  could  not  force 
people  to  enter  illegal  agreements  (Ruling  Backs  School,  1 970). 

This  personnel  issue  did  not  alter  the  programs  of- 
fered in  the  area  schools  for  two  reasons.  First,  despite  being 
fired  by  the  Board  of  Education,  the  former  director  was 
hired  by  the  Model  Cities  Planning  Council  as  a consultant 
(“Thomas  to  Draw  Pay,”  1970).  Furthermore,  the  compensa- 
tory educational  programs  continued  in  the  Model  Cities 
neighborhood  despite  the  controversy. 

In  1 970,  of  all  the  aspects  of  Model  Cities  in  inner  West, 
the  biggest  share  of  the  total  $2,949,000  budget  went  into  the 
education  component.  It  used  $555,000.  Job  development 
was  second  with  a total  of  $5 1 2,000.  The  money  for  educa- 
tion was  spent  on  several  projects.  For  example,  the  commu- 
nity schools  program  kept  five  schools  open  from  seven  in 
the  morning  until  ten  at  night.  During  this  time,  the  buildings 
held  adult  education  classes,  set  up  recreational  activities  in 
the  gyms,  and  allowed  residents  to  offer  personal  services  to 
other  people  in  the  neighborhood.  This  program  served  over 
1,000  people.  Since  residents  of  the  area  taught  in  the  pro- 
grams, the  community  schools  employed  and  trained  people 
who  might  not  have  had  jobs. 

The  education  component  tried  to  change  the  person- 
nel in  the  schools  through  two  programs.  First,  the  adminis- 
trative interns  program  sought  to  train  people  to  become 
change  agents  in  inner  city  schools.  The  interns  took  sensi- 
tivity training  and  they  studied  the  perceptions  of  neighbor- 
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hood  residents.  Second,  the  education  component  of  Model 
Cities  retrained  teachers.  Teachers  learned  to  develop  inno- 
vative teaching  techniques  and  team  teaching.  In  the  first 
year,  these  inservices  focused  on  Black  awareness. 

Finally,  there  were  several  programs  for  the  students. 
For  example,  programs  of  guidance  and  counseling  prevented 
children  in  the  upper  elementary  grades  from  developing  nega- 
tive attitudes.  The  education  component  invited  prominent 
Black  Americans  to  visit  the  schools  to  inspire  the  children 
to  succeed.  Sonic  of  these  programs  were  from  other  agen- 
cies, such  as  Head  Start  that  enrolled  almost  fifteen  hundred 
children  andf  employed  164  people  to  develop  perceptual, 
social,  and  verbal  skills  in  the  children  (City  of  Dayton,  1 970). 

Many  of  these  programs  were  successful.  The  stu- 
dents in  the  summer  youth  tutoring  program  gained  from  six 
months  to  two  years  reading  ability  because  of  sixty  hours  of 
instruction.  Between  1969  and  1971  eighteen  interns  received 
master's  degrees  in  administration  with  special  emphasis  on 
inner-city  schools  (Tyson,  1 973).  The  administrative  interns 
were  constantly  on  the  job.  They  set  up  student  council 
courts  to  help  the  students  handle  the  discipline  problems 
themselves.  The  interns  arranged  for  municipal  court  judges 
to  visit  the  schools  and  officiate  at  mock  trials  to  show  how 
the  criminal  justice  system  worked.  Through  the  student 
council  courts,  the  children  in  the  school  took  a share  in 
building  management,  and  they  learned  important  lessons  in 
civics.  The  interns  made  home-visits  to  try  to  help  children 
who  were  having  trouble,  and  they  conducted  inserviccs  to 
help  teachers  realize  the  problems  the  children  faced  at  home. 
Because  of  this  work,  school  attendance  rates  improved  and 
discipline  problems  declined.  Further,  Model  Cities  contracted 
a branch  of  the  Kettering  Foundation,  IDEA,  to  teach  teach- 
ers and  administrators  how  to  introduce  individually  guided 
instruction  into  the  schools.  (Revere,  1994). 

These  activities  increased  to  the  point  that  in  1 974,  the 
education  component  secured  more  funds  in  partnership  with 
other  agencies  than  any  other  aspect  of  Model  Cities.  These 
partnership  monies  created  opportunities  for  middle-school 
children  with  reading  problems  to  teach  reading  to  primary 
school  children.  Other  partnerships  included  a program  that 
* recruited  students  from  nearby  colleges  to  serve  as  teach- 
ers' aides.  Furthermore,  a local  historically  Black  state  uni- 
versity opened  a branch  campus  in  the  designated  project 
area(Martinda!e,  1974). 

Model  Cities  and  School  Segregation 

The  Model  Cities  programs  reinforced  the  racial  segre- 
gation of  the  public  schools  in  three  ways.  First,  the  basis  of 
the  compensatory  programs  was  that  the  children  in  the  in- 
ner West  faced  special  problems.  Therefore,  they  should  be 
kept  apart.  One  example  is  illustrative.  In  1969.  the  U.S.  De- 
partment of  Health  Education  and  Welfare  pressured  the 
School  Board  to  racially  desegregate  the  faculty.  In  May,  the 
Model  Cities  Planning  Council  sent  a letter  to  the  School 
Board  saying  there  had  been  a “concentrated  effort  on  be- 


half of  the  coordinator  to  orientate  and  further  sensitize  teach- 
ers to  the  neighborhoods'  educational  problems.  It  is  impor- 
tant the  present  teachers  be  allowed  to  stay  in  their  positions 
if  they  so  desire"  (“Model  Cities  Council,"  1969).  Conse- 
quently, in  the  eyes  of  the  Planning  Council,  the  special  train- 
ing of  the  teachers  outweighed  the  benefits  of  a desegre- 
gated faculty. 

Second,  the  Model  Cities  program  reinforced  racial  seg- 
regation in  schools  by  trying  to  defeat  the  liberal  members  of 
the  School  Board  who  were  working  to  racially  desegregate  the 
schools.  Until  1 972,  Board  members  who  called  themselves  lib- 
eral held  most  of  the  seven  seats  on  the  Board  of  Education. 
When  the  Board  fired  the  Model  Cities  education  director  in 
1 969,  a member  of  the  Model  Cities  Planning  Council  joined  a 
newly  formed  conservative  Serving  Our  Schools  party.  Sup- 
ported strongly  by  White  people  on  the  east  side  of  Dayton, 
SOS  members  favored  retaining  neighborhood  schools.  As  a 
result,  they  favored  firing  the  superintendent  who  had  inte- 
grated the  faculty  in  the  schools  and  was  moving  toward  inte- 
grating the  students  (Allbaugh,  1973).  The  Planning  Council 
tried  to  show  the  liberal  Board  that  the  ideas  of  the  conserva- 
tive School  Board  party  were  reasonable.  In  February  1970,  the 
chairperson  of  the  Model  Cities  education  sub-committee  an- 
nounced the  formation  of  an  alliance  for  quality.  This  new  group 
asked  two  representatives  from  each  of  Dayton’s  ten  high 
schools  to  compile  a report.  Their  aim  was  to  show  the  School 
Board  that  the  school’s  quality  was  more  important  than  racial 
balance  among  its  students.  The  chairperson's  rationale  was 
that  if  all  schools  were  of  high  quality,  “the  Black  child  will  have 
no  difficulty  being  accepted  in  the  White  school  and  vice  versa" 
(Allbaugh,  1970). 

Most  important,  the  Model  Cities  antagonism  against 
the  School  Board  seemed  to  tip  a crucial  election  in  favor  of  the 
conservative  party  “Serving  Our  Schools"  In  1969,  three  con- 
servative members  of  the  SOS  party  won  election  to  the  school 
Board.  Drawing  unprecedented  publicity  to  school  affairs,  they 
resisted  the  efforts  of  the  liberal  majority  to  voluntarily  deseg- 
regate the  schools.  In  November  1 97 1 , a fourth  SOS  won  a seat 
on  the  Board.  In  December  1971,  before  the  conservatives  took 
control,  the  liberal  Board  members  passed  three  resolutions. 
One  was  an  admission  of  responsibility  for  causing  segrega- 
tion in  the  schools.  Another  asked  the  State  Department  of 
education  to  form  a metropolitan  school  district  to  force  subur- 
ban children  to  attend  city  schools.  The  last  was  to  order  the 
desegregation  of  Dayton’s  schools.  When  they  took  office  in 
January  1972,  the  newly  elected  conservative  SOS  majority  re- 
scinded those  resolutions.  The  NAACP  sued  in  U.S.  District 
Court  three  months  later.  As  a result,  the  1 973  election  was  an 
important  election.  If  the  liberals  could  win  a majority,  they 
would  end  the  extensive  legal  resistance  to  desegregation  the 
conservative  SOS  party  caused. 

In  1973,  liberals  organized  into  a School  Board  party 
named  Citizens  for  Better  Schools.  They  had  a chance  to 
unseat  the  conservatives  who  had  taken  control  of  the  School 
Board  in  1 972  because  four  of  the  seven  seats  were  open  for 
election.  Liberals  already  controlled  two  of  the  scats  that 
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were  not  open  forelection.  CBS  members  collected  money, 
selected  candidates,  and  planned  a campaign.  While  one 
member  of  the  CBS  party  won  a seat,  the  candidate  for  the 
crucial  second  seat  lost  by  seven  votes  with  a total  of  1 8, 1 7 1 . 
The  election  results  showed  that  African  Americans  in  West 
Dayton  had  helped  defeat  her.  Before  the  election,  activists 
whom  newspaper  reporters  called  “Black  separatists”  said 
that  integration  was  not  a primary  concern  for  young  Afri- 
can Americans;  they  complained  that  desegregation  would 
make  Black  children  a minority  in  all  buildings!  Hanna,  1972). 
Perhaps  because  of  these  arguments,  voters  from  the  pre- 
dominantly Black  West  Dayton  did  not  support  the  liberals 
as  the  CBS  leaders  had  expected.  One  CBS  candidate  in  1 973 
was  Reverend  U.A.  Hughey,  a former  officer  in  the  NAACP. 
Although  he  was  the  only  African  American  running  for  the 
School  Board,  he  polled  only  6,61 8 votes  from  West  Dayton. 
This  was  5,500  more  votes  than  the  strongest  candidate  from 
SOS  had  from  the  same  area.  But  Hughey's  popularity  among 
Black  voters  was  not  as  high  as  it  should  have  been  if  those 
voters  held  a concern  for  the  liberal  views  on  the  School 
Board.  In  the  same  election,  a liberal  Black  man,  James  McGee, 
who  ran  for  reelection  for  mayor,  received  8.690  votes  from 
West  Dayton.  This  means  that  more  than  two  thousand  vot- 
ers from  West  Dayton  supported  the  liberal  mayor  but  re- 
fused to  cast  a vote  for  a liberal  School  Board  candidate 
(Schumacher,  1973). 

Finally,  Model  Cities  encouraged  racial  segregation  in  a 
controversy  about  the  relocation  of  a school.  In  Spring  1 967,  a 
fire  partially  destroyed  Edison  Elementary  School  located  in 
the  Model  Cities  target  area.  During  Summer  1 968,  members  of 
the  Planning  Council  anu  the  Education  Director  of  Model  Cit- 
ies wanted  to  rebuild  Edison  School  on  its  original  site  and 
improved.  Their  view  was  that  if  the  school  was  an  excellent 
one.  White  children  would  ask  to  come  to  Edison.  Hughey 
wanted  Edison  School  to  be  relocated  closer  to  White  neigh- 
borhoods. Hughey's  view  was  the  school  would  promote  inte- 
gration by  its  location.  Hughey  lost  that  debate;  the  School 
Board  rebuilt  Edison  on  its  original  site  (Goodman,  1 968c). 

Conclusion 

In  197 1.  President  Richard  Nixon  announced  that  Day- 
ton  was  one  of  the  twenty  cities  to  participate  in  an  innova- 
tion called  Planned  Variations  of  the  Model  Cities  Programs. 
This  meant  that  Model  Cities  would  expand  to  cover  all  parts 
of  the  city.  The  Model  Cities  Demonstration  Project  on  the 
West  side  remained  apart,  however,  and  its  Planning  Council 
continued  to  control  its  affairs  much  more  than  citizens' 
groups  in  other  areas  could.  Unfortunately,  pressure  built  in 
the  U.S.  Congress  to  remove  Model  Cities  programs.  By  Feb- 
ruary 1974.  there  were  three  bills  in  congress  that  sought  to 
consolidate  the  Model  Cities  monies  into  block  grants.  In 
part,  the  antagonism  developed  because  many  parts  of  the 
country  did  not  have  these  programs.  A more  difficult  argu- 
ment against  Model  Cities  was  that  the  programs  wasted 
money.  Since  Dayton's  project  was  among  the  most  suc- 
cessful, other  progrant  directors  asked  the  city  to  try  to  save 


the  program.  In  response,  the  City  of  Dayton  produced  a 
forty-page  progress  report  and  accompanying  slide  presen- 
tation celebrating  the  success  of  the  demonstration  project 
on  the  West  side.  Unfortunately,  the  publicity  did  not  influ- 
ence enough  congressional  votes.  On  August  30  1 975,  all  of 
Dayton's  Model  Cities  projects  ended. 

Dayton's  Model  Cities  demonstration  project  on  the 
West  side  of  Dayton  left  financial  problems  in  its  wake.  The 
city  was  forced  to  pay  back  large  sums  of  money  to  the  fed- 
eral government  that  the  Model  Cities  demonstration  project 
had  misspent.  As  a result,  the  city  administration  refused  to 
give  any  citizen's  group  the  financial  control  that  the  Model 
Cities  Planning  Council  enjoyed  ( Woodie,  1 994).  The  effort 
to  racially  desegregate  Dayton’s  public  schools  was  more 
successful.  In  September  1976,  Dayton  began  a the  first  pro- 
gram of  cross-district  busing  for  racial  balance  in  Ohio.  News- 
papers such  as  the  New  York  Times  praised  it  as  the  most 
successful  up  to  that  time. 

Most  important,  neither  Model  Cities  nor  the  court  or- 
dered desegregation  of  public  schools  reduced  racial  segrega- 
tion. The  number  of  children  in  the  Dayton  schools  has  steadily 
declined  and  the  percentage  of  the  students  in  the  Dayton 
schools  who  are  African  Americans  has  steadily  increased.  As 
in  the  1960s,  school  segregation  reflects  housing  segregation. 
In  1980,  only  13.5  % of  the  households  in  Montgomery  County, 
in  which  Dayton  lies,  live  in  integrated  census  tracts  (Mont- 
gomery County  Fair  Housing  Board,  1985).  This  is  such  a 
severe  rate  of  segregation  that  in  1988  a researcher  found  the 
housing  patterns  in  the  Dayton  Metropolitan  area  to  be  the 
third-most  segregated  among  fifty- nine  other  cities.  Only  Cleve- 
land and  Chicago  were  worse  (Scipio,  1 988). 

In  1978,  national  columnist  William  Raspbenry  tried  to 
assess  the  value  of  Model  Cities  to  Atlanta,  Georgia.  He 
noted  that  the  population  had  declined.  Buildings  were  de- 
molished. The  percentage  of  families  on  public  assistance 
had  increased.  Students  in  the  area  schools  did  badly  when 
compared  to  students  in  other  parts  of  the  city.  Raspberry 
said  that  these  statistics  do  not  prove  that  the  project  was  a 
failure.  He  said  that  the  project  had  allowed  people  to  move 
out  of  the  area.  While  President  Johnson  had  promised  that 
Model  Cities  would  transform  the  slum.  Raspberry  was  con- 
tent that  Model  Cities  had  helped  people  leave. 

The  same  is  true  of  the  West  side  of  Dayton.  Housing 
is  demolished.  Jobs  arc  rare.  Population  has  declined.  In  1 994, 
population  of  the  inner  West  area,  formerly  the  target  area  of 
the  Model  Cities  Demonstration  project,  was  1 1.420.  This 
represents  a decline  of  73 7c  in  less  than  thirty  years.  When 
the  Model  Cities  demonstration  project  began,  42,000  people 
lived  in  the  target  area.  Model  Cities  did  not  transform  this 
slum.  Most  residents  abandoned  it. 

Nonetheless,  many  groups  look  back  to  the  Mixlcl  Cit- 
ies experience  and  find  important  and  valuable  lessons.  Ad- 
ministrators in  the  City  of  Dayton  acknowledge  that  Model 
Cities  was  an  important  project  that  encouraged  residents  to 
decide  what  will  happen  in  their  neighborhoods.  It  led  to  the 
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priority  Board  system  that  determines  what  projects  go  on  in 
the  city.  Teachers  say  they  learned  that  school  people  can  join 
with  parents  and  community  members  to  make  improvements 
in  schools.  An  active  system  of  community  education  councils 
work  within  the  Dayton  Public  Schools.  Furthermore,  the  ad- 
ministrative intern  program  from  Model  Cities  schools  trained 
many  African  American  women  who  occupy  important  posi- 
tions in  school  systems  and  in  regional  government.  Some  reli- 
gious leaders  say  they  learned  to  work  effectively  to  overturn 
the  effects  of  White  racism  (DavL,  1 990). 

These  may  appear  to  be  minor  benefits  for  a program 
that  consumed  a great  deal  of  money,  time,  and  human  en- 
ergy. However,  the  people  involved  thought  that  the  ben- 
efits were  extensive.  Most  important,  these  benefits  imply 
that  the  empowerment  of  African  Americans  will  break  down 
the  effects  of  racism.  Unfortunately,  in  Dayton,  the  argu- 
ments of  resident  control  of  Model  Cities  seemed  to  rein- 
force the  power  of  a small  elite  more  than  it  encouraged  genu- 
ine democracy.  Perhaps  widespread  popular  participation 
would  have  come  in  time.  Dayton's  Model  Cities  Demonstra- 
tion Project  lasted  seven  years  before  national  leadership 
abolished  the  program.  This  may  have  been  too  short  a pe- 
riod for  participation  to  spread.  Consequently,  it  is  difficult 
to  draw  firm  conclusions.  Racially  segregated  programs  could 
reduce  the  effects  of  racism  and  enhance  democracy.  Dayton's 
Model  Cities  Demonstration  Project  did  not. 
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From  Matron  to  Maven:  A New  Role  and  New  Professional 
Identity  for  Deans  of  Women,  1892  to  1916 


Jana  Nidiffer,  University  of  Massachusetts.  Amherst 

Abstract 

Presidents  of  mid-nineteenth  century  coeducational  colleges  hired  dormitory  matrons  as  chaperones  or 
disciplinarians.  This  arrangement  was  replaced  by  a new  type  of  woman  administrator — dean  of  women. 
The  deans  were  highly  trained , ambitious  women  not  content  with  such  a limited  role.  The  careers  and 
strategies  of  four  women  who  were  instrumental  in  transforming  the  position  of  dean  of  women  into  a 
profession  are  examined.  This  small  cadre  of  women,  working  in  midwestem  institutions,  developed  an 
expansive  vision  for  their  position:  Marion  Talbot,  University : of  Chicago,  1892  to  1925;  Maty  Bidwell 
Breed,  Indiana  University,  1901  to  1906;  Ada  Louise  Comstock,  University-  of  Minnesota,  1906  to  1912; 
and  Lois  Kimball  Mathews,  University  of  Wisconsin.  1911  to  1918. 


The  term  “dean  of  women"  often  conjures  up  one  of 
two  enduring  stereotypes:  either  that  of  a matronly,  curmudg- 
eonly chaperone  or  an  innocuous  mother  figure  (Phillips, 

1 9 1 9,  p.  3).  Yet  neither  of  those  two  characterizations,  despite 
their  persistence  in  the  popular  imagination,  is  wholly  accu- 
rate. During  the  Progressive  Era,  it  became  instead  a position 
“in  which  intelligent,  well-qualified,  well-educated  women 
could  exercise  administrative  skills  and  professional  leader- 
ship and  exert  a unifying  influence  on  behalf  of  women" 
(Treichler,  1985,  p.  24).  These  well-qualified,  well-educated 
deans  did  help  improve  the  material  lot  of  women  students, 
especially  at  midwestem  state  universities.  But  most  impor- 
tantly, the  deans — at  least  a small  cadre  of  leaders  between 
the  years  1 892  and  1 9 1 6 — forged  a new  professional  identity 
for  themselves  as  the  first  senior  women  administrators  on 
coeducational  university  campuses.  Their  effort  to  create  a 
profession  for  women — its  initial  success  and  what  is  seen 
as  the  eventual  reversal  of  fortune — reveals  typical  difficul- 
ties faced  by  professional  women  in  the  early  twentieth  cen- 
tury. 

The  position  of  dean  of  women  also  played  an  inter- 
esting historical  role  by  being  the  first  systemic,  administra- 
tive response  in  higher  education  to  cope  with  a new,  and 
essentially  unwelcome,  population.  There  was  one  brief  pe- 
riod when  the  College  of  William  and  Mary  hired  a “Master 
of  the  Indian  School,"  to  look  after  the  few  Native  American 
students,  but  by  1721,  the  Indian  School  had  faded  away  and 
it  was  not  emulated  at  other  Colonial  colleges  (Morpurgo, 
1 976,  pp.  67-69).  The  position  of  dean  of  women,  on  the  other 
hand,  was  replicated  widely. 

Early  History  of  Deans  of  Women 

The  position  of  dean  of  women  was  bom  in  the  ante- 
bellum liberal  arts  colleges  of  the  midwest;  it  came  of  age  in 
midwestem  universities  in  the  early  twentieth  century.  Oberlin 
College  opened  its  doors  to  women  in  1833,  an  era  in  which 
propriety  required  the  close  supervision  of  unmarried  young 


women  in  proximity  to  young  men.  The  president  and  faculty 
quickly  recognized  such  “problems  which  demanded  the  pres- 
ence and  supervision  of  an  older  woman"  (Holmes,  1 939,  p. 

1 09).  The  first  woman  to  serve  in  this  position  at  Oberlin  was 
Marianne  Parker  Dascom  with  the  title  “Lady  Principal  of  the 
Female  Department"  (Kehr,  1938,  p.  6).  The  1835  description 
of  the  Female  Department  in  the  college  catalog  indicated 
both  Oberlin *s  desire  to  appease  trepidation  regarding  co- 
education and  the  scope  of  Mrs.  Dascom's  duties: 

Young  ladies  of  good  minds,  unblemished  morals . 
and  respectable  attainments  are  received  into  this 
department  and  placed  under  the  supervision  of  a 
judicious  lady,  whose  duty  it  is  to  correct  their 
habits  and  mould  the  female  character.  They  at- 
tend recitations  with  young  gentlemen  in  all  the 
departments.  Their  rooms  are  entirely  separate  from 
those  of  the  other  sex.  and  no  calls  or  visits  in  the 
respective  apartments  are  at  all  permitted  ( Oberlin, 

1835,  p.  24). 

Antioch  College  in  Yellow  Springs.  Ohio  was  also  co- 
educational from  its  opening  in  1 854.  President  Horace  Mann 
acknowledged  that  “[!]he  advantages  of  joint  education  are 
very  great.  The  dangers  are  terrible."  Mann  insisted  on  a 
boarding  house  for  the  young  women.  He  stated,  “1  should 
deprecate  exceedingly  turning  them  out  in  the  streets  for 
meals"  (Holmes,  1939,  p.  6-7).  The  boarding  house  required  a 
female  supervisor. 

When  members  of  the  Board  of  Regents  of  the  Univer- 
sity of  Michigan  were  contemplating  coeducation  for  their 
institution  in  1858,  they  solicited  opinions  from  educational 
experts  of  the  day  including  Mann  and  Charles  Grandison 
Finney,  president  of  Oberlin.  Finney  replied  that  the  results 
at  Oberlin  were  “satisfactory  and  admirable"  and  offered  the 
Board  the  following  advice  for  ensuring  success:  “You  will 
need  a wise  and  pious  matron  with  such  lady  assistants  as 
to  keep  up  supervision. ... " (emphasis  added,  Holmes.  1939, 
p,  7).  Despite  the  positive  outcome  reported  by  Finney,  Michi- 
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gan  remained  single- sex  for  another  twelve  years  until  eco- 
nomic pressures  by  tax-payers  forced  the  university  to  open 
its  doors  to  women  in  1 870. 

The  experiences  of  Oberiin  and  Antioch  illustrated  two 
important  themes  in  the  earliest  history  of  deans  of  women. 
First,  the  “Lady  Principal''  was  hired  as  a direct  response  to 
prevailing  concerns  regarding  coeducation.  Second,  her  du- 
ties were  limited  to  supervision  of  living  arrangements  and 
the  moral  guardianship  of  the  women  students.  After  the 
Civil  War,  coeducation  became  more  prevalent  and  so  did  the 
number  of  residential  colleges  employing  lady  principals, 
matrons,  or  preceptresses  who  supervised  the  women’s  hous- 
ing. Swarthmore  College  was  typical  and  engaged  a “judi- 
cious matron"  in  1 872.  By  1880,  this  practice  was  more  com- 
mon than  not  in  the  liberal  arts  colleges  of  the  midwest 
(McGrath,  1936). 

The  pattern  of  hiring  deans  of  women  at  midwestem 
universities  was  different,  however,  and  it  did  not  begin  until 
the  1 890s.  The  primary  reason  why  many  univer:  :es  failed 
to  employ  a “wise  and  pious  matron"  from  the  outset  was 
because  the  young  state  universities  had  not  made  provi- 
sion for  on-campus  housing  for  women  or  men  due  to  lack  of 
resources.  The  women  students  were  expected  to  lodge  with 
family  members  or  in  local  rooming  houses.  Without  a spe- 
cific dormitory,  house,  or  female  college  to  supervise,  univer- 
sity presidents  felt  little  imperative  to  hire  a female  adminis- 
trator. For  example.  Indiana  University  experimented  briefly 
with  the  position  when  Sarah  Parke  Morrison,  IU's  first  fe- 
male graduate  in  1869,  was  hired  to  be  a social  advisor  to 
women  students  in  1 873.  Morrison  resigned  her  position  af- 
ter only  two  years  and  it  remained  unfilled  for  the  next  quar- 
ter of  a century  (Rothcnberger,  1 942). 

In  the  late  1880s  and  early  1890s  circumstances 
changed,  leading  to  the  appointment  of  women  administra- 
tors. At  a few  universities,  women  students,  their  parents, 
and  sometimes  community  members  as  well,  agitated  for  the 
university  to  offer  some  living  arrangements  for  the  women 
students.  Without  supervised  housing,  middle-class  parents 
and  families  who  lived  long  distances  from  the  campuses 
expressed  reluctance  to  send  daughters  to  college  (Gordon, 
1990).  If  boarding  houses,  residence  halls,  or  sorority  houses 
were  created,  an  administrator  was  needed. 

There  were  other  catalysts,  however,  beyond  the  need 
to  monitor  a dormitory.  As  the  1890s  progressed,  faculty 
members  on  several  campuses,  with  or  without  special  resi- 
dence halls  for  women,  grew  increasingly  concerned  about 
the  extra-curricular  activities  of  students.  At  the  same  time, 
faculty  reluctance  to  handle  such  matters  was  intensifying. 
The  growing  demand  for  research  productivity  placed  new 
pressures  on  faculty  and  created  an  unwillingness  on  their 
part  to  spend  vast  amounts  of  time  on  administrative  details 
or  student  supervision.  Nor  would  a president  interested  in 
research  results  want  a faculty  so  engaged  (Veyscy.  1969). 

It  was  interesting  that  the  administrative  response  to 
excesses  in  student  behavior,  which  included  class  “rushes" 


and  violence  in  athletics,  was  a dean  of  women,  when  it  was 
generally  acknowledged  that  it  was  male  students  who  ex- 
hibited the  most  troubling  behavior.  Such  reactions  suggest 
that  presidents  were  responding  equally  to  a resurgence  of 
anti-coeducation  sentiment  at  the  turn  of  the  century  and  to 
the  consequent  uneasiness  felt  on  many  campuses 
(Rosenberg,  1988). 

The  battle  for  coeducation  was  long  and  acrimonious. 

It  has  been  compared  by  historian  Patricia  Palmeri  (1987)  to 
the  abolition  debate  in  terms  of  the  intensity  of  emotions  on 
both  sides  of  the  issue  and  the  numbers  of  white  middle 
class  men  and  women  involved.  The  high  degree  of  negative 
feelings  toward  women  on  campuses  created  an  environ- 
ment that  ranged  from  inhospitable  to  openly  hostile.  There- 
fore. administrators  at  coeducational  universities  in  the  1 890s 
were  obligated  to  worry  about  the  “woman  problem."  One 
response  was  hiring  a dean  of  women.  A pioneer  in  this  re- 
gard was  William  Rainey  Harper  of  the  University  of  Chi- 
cago. Harper's  dream  was  to  make  Chicago  a Western  Yale 
and  the  generosity  of  John  D.  Rockefeller  gave  him  the  re- 
sources to  lure  prestigious  eastern  academics  to  the  shores 
of  Lake  Michigan  (Gordon,  1 990). 

Harper  was  determined  to  fashion  a great  university 
quickly  by  hiring  proven  administrators  and  established  schol- 
ars. Harper  was  not  an  enthusiast  for  coeducation,  but  the 
charter  of  the  university  demanded  it.  In  keeping  with  his 
desire  to  hire  the  most  talented  faculty  that  he  could  and  the 
social  expectation  that  college  women  needed  supervision. 
Harper  offered  Alice  Freeman  Palmer,  the  President  of 
Wellesley  College,  the  position  of  professor  of  history  and 
dean  of  women  for  the  university. 

Palmer  was  reluctant  to  turn  down  an  opportunity  to 
become  a female  professor  in  a coeducational  institution,  for 
there  were  precious  few  such  offers  in  1892.  She  agreed,  how- 
ever, upon  two  conditions.  Because  her  Harvard  professor 
husband,  George  Herbert  Palmer,  was  unwilling  to  leave  Cam- 
bridge, Alice  Palmer  said  she  would  only  work  in  Chicago  for 
twelve  weeks  a year.  She  also  demanded  that  Marion  Talbot, 
also  a professor  at  Wellesley,  be  appointed  as  her  deputy. 
Because  of  Palmer's  schedule,  Talbot  was,  in  effect,  the  dean 
of  women  at  Chicago  (Fitzpatrick,  1 989). 

F rom  Matron  to  Ma ven 

With  Talbot's  appointment  in  1892,  the  position  of  dean 
of  women  began  to  change.  By  1916,  the  year  in  which  the 
National  Association  of  Deans  of  Women  (NADW)  was 
founded,  a small  cadre  of  women  from  midwestern  institu- 
tions had  transformed  the  position  into  a profession.  This 
article  examines  the  careers  of  four  such  women  and  the  strat- 
egics they  employed.  Each  woman  made  a specific  contribu- 
tion to  the  evolution  of  the  profession.  In  addition,  each 
woman  was,  at  times,  representative  of  other  deans  serving 
in  the  same  era.  The  four  women  arc:  Marion  Talbot,  Univer- 
sity of  Chicago,  1892  - 1925;  Mary  Bidwell  Breed,  Indiana 
University,  1901  - 1906;  Ada  Comstock,  University  of  Minne- 
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sola.  1906-  1912;  and  Lois  Kimball  Mathews,  University  of 
Wisconsin,  1911  - 1918.  The  process  they  went  through  to 
establish  a profession  is  similar  to  that  of  myriad  other  pro- 
fessions that  were  established  in  the  early  twentieth  century. 
Identified  are  four  steps  that  were  especially  salient  to  the 
deans:  laying  an  intellectual  foundation;  initiating  collective 
activity;  becoming  an  expert;  and  creating  a professional  lit- 
erature and  association. 

Laying  the  Intellectual  Foundation 

Marion  Talbot  was  a bright  and  ambitious  young  woman 
whose  family  was  part  of  the  Boston  intelligentsia — Julia 
Ward  Howe  and  Louisa  May  Alcott  were  in  her  social  milieu. 
Her  father,  Israel  Tisdale  Talbot,  was  passionate  about  health 
reform  and  the  first  dean  of  Boston  University’s  medical 
school.  In  1881,  along  with  her  mother,  Emily  Talbot.  Marion 
founded  the  Association  of  Collegiate  Alumnae  (ACA).  the 
forerunner  of  the  American  Association  of  University  Women 
(Fitzpatrick.  1989).  It  was  (he  most  important  organization  for 
college-educated  women  during  the  era,  dedicated  to  assist- 
ing women  graduates  in  finding  employment  and  intellectual 
opportunities  in  adult  life. 

Talbot’s  concern  for  the  post-college  fate  of  educated 
women  was  transformed  at  Chicago.  She  became  devoted  to 
making  sure  that  the  women  students  enjoyed  the  full  ad- 
vantages of  the  university  while  on  campus.  She  understood 
the  anti-coeducation  sentiment  that  prevailed,  and  she.  like 
F reed,  Comstock,  and  Mathews,  wanted  to  change  the  uni- 
versity and  make  it  a rr  e hospitable  environment  for  women. 
Talbot  articulated  a purpose  for  women's  education  that  she 
believed  would  both  lay  the  intellectual  foundations  for  the 
work  of  deans  and  minimize  resistance  to  coeducation.  She 
subscribed  to  several  strains  of  late  nineteenth  century 
thought  regarding  intelligence  and  sex  role  definition  which 
were  challenging  conventional  assumptions  about  the  place 
of  women  in  education  and  society.  In  terms  of  her  efforts  to 
professionalize  deans,  two  of  her  beliefs  were  particularly 
relevant  (Rosenberg,  1982). 

First,  she  believed  in  a modernist  notion  about  the  in- 
herent rationality  of  all  human  beings  which  implied  that 
women  were  as  capable  of  intellectual  thought  as  men.  As 
she  stated  unequivocally  in  her  book.  The  Education  of 
Women . “women  have  proved  their  abi  lity  to  enter  every  realm 
of  knowledge.  They  must  have  the  right  to  do  it. ...  Unham- 
pered by  traditions  of  sex.  women  will  naturally  and  without 
comment  seek  the  intellectual  goal  which  they  think  good 
and  fit"  (1910,  p.  22).  Yet.  Talbot  never  completely  let  goof  all 
the  vestiges  of  Victorian  notions  of  propriety  and  separate 
spheres,  other  than  intellectual,  so  the  second  component  of 
her  belief  was  that  women  were  unique  from  men  and  re- 
quired an  environment  that  was  special  or  distinct.  Her  be- 
liefs in  the  benefits  of  a separate  women's  community  placed 
Talbot  firmly  within  the  tradition  of  late  nineteenth  century 
feminists  who  adopted  what  Estelle  Freedman  ( 1979)  rel erred 
to  as  “separatism  as  a strategy  " The  women  “preferred  to 
retain  membership  in  a separate  female  sphere,  one  which 


they  did  not  believe  to  be  inferior  to  men's  sphere  and  one  in 
w'hich  women  could  be  free  to  create  their  own  forms  of  per- 
sonal. social,  and  political  relationships"  (Freedman.  1979,  p. 
514).  Creating  essentially  a separate-but-equal  social  life  for 
women,  as  historian  Joyce  Antler  has  noted,  often  reinforced 
the  sexual  status-quo  by  making  the  separate  spheres  seem 
immutable,  and.  perhaps,  this  actually  limited  the  choices  for 
women.  Yet,  the  creation  of  a discrete  “social  structure ...  was 
a positive  response  to  the  pervasive  sexism  on  campus"  (Ant- 
ler, 1987,  pp.  98-99).  If  any  of  the  four  deans  engaged  the 
merits  of  this  debate,  they  left  no  written  record.  It  was  clear 
from  their  actions,  however,  that  they  followed  the  separat- 
ism strategy  common  to  women  prior  to  World  War  1 and 
created  a distinct  women's  community  on  campus. 

Talbot  was  attacked  by  those  opponents  of  coeduca- 
tion who  argued  that  women  should  be  in  separate  class- 
rooms as  well.  But  Talbot  firmly  stated  that  mixed  classrooms 
were  the  only  way  to  insure  equivalent  educational  opportu- 
nities and  that  the  needed  “special"  environment  was  for  the 
out-of-classroom  lives  of  women.  Thus.  Talbot  acted  as  an 
intellectual  bridge  between  the  older  view  that  feminine 
uniqueness  implied  intellectual  limitations — “true  woman- 
hood”— and  the  belief  that  women  were  as  rational  as  men, 
but  still  distinct — “new  womanhood"  (Freedman,  1974; 
Rosenberg,  1982).  By  asserting  that  women  were  academi- 
cally capable  in  any  field  and  the  need  for  unique  circum- 
stances applied  only  to  the  social  realm,  she  secured  for 
women  a safe  place  within  the  university,  maintained  propri- 
ety. and  yet  kept  all  avenues  of  mental  exploration  open.  Her 
view  laid  the  foundation  for  the  professional  work  of  deans. 

Initiating  Collective  Activity 

Talbot  took  the  next  step  in  professionalization  and 
communicated  her  beliefs  with  other  deans  of  women.  She 
published  widely  in  various  education  journals,  especially 
the  Journal  of  the  ACA,  but  most  importantly  site  initiated 
the  first  collective  activity  of  deans  by  organizing  the  first 
professional  conference.  She  decided  to  invite  several  women 
from  other  midwestem  colleges  and  universities  for  a two- 
day  conference  in  November  of  1 903. 

Eighteen  women,  including  the  young  chemistry  pro- 
fessor and  dean  of  women  at  nearby  Indiana  University — 
Mary  Bidwell  Breed — arrived  in  Chicago  in  the  autumn  of 
1903  (Minutes  of  the  Conference,  1903;  Potter,  1927,  p.  212- 
216).  All  the  deans  represented  institutions  in  the  midwest 
(except  the  dean  of  the  college  of  Barnard)  so  it  was  not 
surprising  that  the  meeting's  official  title  was  the  Conference 
of  Deans  of  Women  of  the  Middle  West.  Ten  of  the  women 
were  from  private  institutions  while  eight  represented  state 
universities.  Twelve  of  the  women  held  faculty  appointments 
in  addition  to  their  work  as  deans. 

N ot  surprisingly,  the  first  substantive  ssue  addressed 
was  housing — the  most  pressing  student  need  that  deans 
faced.  But  they  discussed  a few  other  topics  as  well  includ- 
ing the  helpfulness  <4  the  l cogue  of  Women  and  the  YWCA. 
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“Ways  of  Influencing  Young  Women.*'  the  effectiveness  of 
“at  homes"1  with  the  dean,  and  self-government  versus  di- 
rect government  (Minutes  of  the  Conference,  1903,  p. 9).  The 
deans  then  voted  to  meet  two  years  hence  and  passed  a 
series  of  resolutions  summing  up  the  collective  opinion  of 
the  group.  Mary  Bidwell  Breed  was  then  elected  president  of 
the  1905  meeting. 

Some  time  in  the  two  years  intervening  between  the 
first  and  second  meeting,  a decision  was  made  to  limit  the 
membership  of  the  group  to  deans  of  women  in  state  univer- 
sities, except  for  founder  Marion  Talbot  who  represented  a 
private  institution.  No  record  exists  of  who  made  the  deci- 
sion or  why,2  but  when  the  deans  met  in  Chicago  in  Decem- 
ber of  1905,  the  gathering  was  convened  as  the  first  meeting ' 
of  "The  Conference  of  Deans  and  Advisors  of  Women  in 
State  Universities."  With  the  exception  of  Lucy  Sprague  from 
the  Llniversity  of  California,  all  participants  were  from 
midwestem  institutions.  The  early  leadership  of  the  new  pro- 
fession was  securely  in  the  hands  of  women  working  in  the 
midwestem.  public  sector  (Breed  Correspondence,  1901  - 
1906). 

One  interesting  development  at  the  1905  meeting,  how- 
ever, was  that  the  deans  went  beyond  deliberations  of  the 
basic  needs  of  students.  The  first  resolution  passed  was  on 
ways  of  making  a community  of  women  on  campus  which 
they  believed  was  “absolutely  necessary"  (Potter,  1927,  p. 
217).  Deans  of  women  were  probably  unique  on  their  cam- 
puses in  understanding  the  complexity  involved  in  achiev- 
ing what  would  now  be  termed  “full  access."  Typically,  male 
administrators  believed  that  admission  to  the  institution  was 
all  that  women  needed.  Deans,  however,  recognized  that  while 
the  immediate  concerns  of  housing,  adequate  meals,  rest, 
and  good  health  were  necessary,  the  higher  needs  of  women 
such  as  intellectual  parity,  career  aspirations,  leadership  op- 
portunities, and  a sense  of  community  must  also  be  addressed. 
In  this  vein,  the  deans  also  discussed  levels  of  scholarship 
and  the  place  of  domestic  science  in  the  curriculum,  and  were 
in  almost  unanimous  agreement  that  the  classroom  should 
not  be  segregated  by  gender  (Minutes  of  the  Conference, 
1905). 

The  biennial  conferences  not  only  aided  the  individual 
women  in  the  course  of  their  daily  jobs  by  recommending 
standards  of  practice,  but  they  were  also  a mechanism  for 
communication  among  one  another.  Most  importantly,  how- 
ever, they  helped  shape  an  identity  for  the  new  profession.  A 
conference  illustrated  that  the  number  of  practitioners  was 
growing,  that  they  had  an  articulated  purpose  and  a field  of 
expertise,  and  it  placed  deans  of  women  within  the  tradition 
of  all  other  university  administrators  of  the  era  who  were  also 
forming  professional  organizations  and  developing  profes- 
sional identities. 

Resistance  to  their  presence  and  their  work  was  a sig- 
nificant obstacle  faced  by  deans  on  the  state  university  cam- 
puses. Although  Breed  held  a PhD.  from  Bryn  Mawr  and  a 
record  of  scholarly  accomplishment  which  included  study  in 


a prestigious  German  university  laboratory,  her  problem  of 
acceptance  was  illustrative.  When  she  took  up  residence  in 
Bloomington  in  the  fall  of  1 90 1 , she  met  with  resentment  from 
both  student*:  and  faculty.  President  Swain,  who  recruited 
her,  believed  deans  were  desirable.  He  was  impressed  with 
both  her  Eastern  “sense  of  decorum"  and  her  manner  which 
was  “strict  enough  to  enforce  her  code  of  gentle-womanly 
behavior'’  (Clark,  1 970,  p.  1 : 320).  The  fact  that  he  wanted  a 
woman  who  combined  scholarly  accomplishment  with  gentle- 
womanly  grace  was  again  consistent  with  the  prevailing  no- 
tions of  qualifications  for  the  position.  But  several  male  fac- 
ulty members  expressed  resistance  to  the  idea  of  a dean  of 
women — not  because  of  her  potential  effect  on  students — 
but  because  they  objected  to  having  a woman  with  any  ad- 
ministrative authority  at  any  level  on  campus.  By  the  time  of 
Breed's  appointment,  only  three  other  women  had  ever  been 
employed  by  the  university;  the  female  contributors  to  the 
university  had  been  professor's  wives  and  town  women 
(Rothenbeiger,  1942;  Clark,  1970). 

Breed  also  met  resistance  from  students  who  believed 
a dean  was  an  affront  to  their  integrity  or  feared  possible 
limitations  on  their  newly  found  freedom  (Rosenberg.  1988, 
p.  1 18).  Gertrude  Martin  who  later  became  a dean  herself, 
recalled  her  undergraduate  days  at  the  University  of  Michi- 
gan when  they  learned  of  Marion  Talbot  at  nearby  Univer- 
sity of  Chicago.  “We  resented  that  Chicago  Dean  of  Women 
as  an  unwarrantable  criticism  of  the  conduct  of  college  women 
in  general.  We  were  very  certain  we  needed  no  disciplining" 
(Martin,  191  l,p.  66). 

Evidence  left  by  students  including  letters  and  diaries 
suggests  that  deans  on  many  campuses  were  successful  in 
reversing  resentment  and  converting  it  to  a respect  that  some- 
times verged  on  reverence  (Haddock,  1952;  Antler.  1987; 
Fitzpatick,  1989;Eisenmann,  1991;  Stephens,  1992).  Breed's 
strategy  to  win  over  opponents  was  rather  straightforward 
to  a modem  reader,  but  it  was  new  at  the  time — she  expanded 
her  role  beyond  discipline,  involved  students  in  policies  and 
program  decisions,  and  advocated  for  women  in  ways  that 
made  tangible  differences  in  their  lives.  For  example,  she  se- 
cured membership  in  the  ACA  so  that  Indiana  students  were 
eligible  for  certain  scholarships. 

Such  high  regard  should  not  obscure  the  fact  that 
deans  and  female  students  were  not  always  of  one  mind. 
There  were  components  of  a generation  gap  and  elements  of 
a disciplinarian/disciplined  relationship.  There  were  also  class 
tensions  at  limes  between  the  laigely  private-school  edu- 
cated deans  and  state  university  students.  The  deans — Tal- 
bot, Breed.  Comstock,  and  Mathews — each  came  from  upper 
middle  class  backgrounds,  most  had  powerful  fathers,  and 
all  had  been,  before  becoming  a dean,  associated  with  an 
elite  private  institution.  One  of  Comstock's  close  friends  and 
colleagues,  Lucy  Sprague  of  Berkeley  who  also  came  from  a 
privileged  background,  was  more  vocal  on  this  issue  than 
other  deans.  At  times,  she  expressed  her  uncomfortableness 
with  the  rough-hewn  nature  of  the  state  university  women 
students  (Antler.  1987). 
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Students  and  deans  shared  many  political  objectives, 
especially  in  re  form -oriented  areas,  but  many  women  stu- 
dents were  pro-suffrage  and  thought  the  deans  maddeningly 
silent  on  this  issue.  Students  agitated  for  more  freedom  in 
male-female  socialization  which  also  caused  a split  between 
the  two  generations  of  women.  Deans  thought  students  were 
too  frivolous;  students  thought  deans  were  old  fashioned, 
perhaps  sexually  unfulfilled  or  even  “deviant"  (Gordon.  1 990; 
Mathews,  1915).  But  overall,  female  students  had  very  few- 
adult  female  role  models  on  coeducational  campuses  between 
1 900  and  1 920  and  even  fewer  advocates. 

Becoming  an  Expert 

The  next  phase  of  professionalization  called  for  the 
development  of  expertise:  deans  became  experts  in  women’s 
education  in  coeducational  settings.  This  phase,  roughly 
from  1 905- 1912,  was  marked  by  a growing  professional  matu- 
rity among  the  deans.  Deans  regularly  published  in  educa- 
tional journals,  made  connections  to  other  professional 
women  in  education  (especially  the  ACA),  and  became  more 
“scientific,”  using  techniques  and  language  associated  with 
scientific  research.  In  1 9 1 1 , Dean  Gertrude  Martin  of  Cornell 
conducted  and  distributed  the  first  statistical  research  project 
on  the  work  of  deans.  This  intellectual  activity,  Lucy  Sprague 
said,  saved  the  profession  from  the  “bog  of  discipline  and 
decorum”  (Antler,  1987,  pp.  1 1 1-1 12). 

Ada  Comstock  began  her  administrative  career  as  dean 
of  women  at  the  University  of  Minnesota  in  1906.  She  is 
perhaps  best  known  as  the  long-term  president  of  Radcliffe 
College,  from  1 922  to  1 943,  who  eventually  secured  full  mem- 
bership (at  least  in  theory)  for  undergraduate  women  at 
Harvard.  However,  she  was  also  instrumental  in  helping  deans 
.of  women  develop  their  field  of  expertise.  When  Comstock 
arrived  in  1 906,  she  was  immediately  able  to  employ  the  strat- 
egies suggested  by  her  colleagues  for  coping  with  the  most 
basic  deaning  issues  such  as  housing,  so  she  was  free  to 
devote  energy  to  other  matters.  She  collected  data  on  stu- 
dents and  illustrated  a systematic,  more  “scientific”  approach 
to  the  job.  In  journal  articles  and  speeches,  she  helped  ar- 
ticulate the  specific  expertise  needed  by  deans,  building  upon 
the  ideas  of  women's  nature  previously  expressed  by  Talbot. 
She  then  used  her  expertise  as  the  basis  for  the  campus  pro- 
grams she  initiated. 

Comstock’s  initiatives  were  dedicated  to  addressing 
the  higher  needs  of  women  such  as  a sense  of  community, 
leadership  roles,  employment,  and  intellectual  opportunities. 
As  far  as  students  were  concerned,  this  was  the  strategy 
with  the  most  tangible  results.  One  of  Comstock’s  first  acts 
was  to  fight  the  use  of  the  word  "coed”  in  the  Minneapolis 
and  campus  publications  and  the  ridicule  that  women  faced 
in  the  guise  of  humor.  Although  she  was  only  partially  suc- 
cessful, fighting  public  mockery  became  a cause  taken  up  by 
several  of  her  peers. 

Creating  a sense  of  community  for  the  young  women 
was  Comstock's  highest  priority.  The  Alice  Shevlin  Hall, 


which  provided  women  students  with  a physical  place  on 
campus  to  rest,  study,  eat,  and  associate  with  one  another  to 
ease  the  loneliness  and  feelings  of  isolation,  was  central  to 
her  mission  (Comstock,  1 9 1 3.  p.  157).  In  fact,  she  described 
Shevlin  Hall  as  her  most  effective  “tool”  (Johnson,  1910,  p. 
194).  Comstock  recognized  that  universities  were  organiza- 
tions created  and  run  by  men  “and  however  kindly  the  indi- 
vidual members  of  the  faculty  may  show  themselves  ...  the 
close  discipleship  which  the  young  men  may  enjoy  ...  [is]  not 
so  easily  attainable  to  the  young  women.”  (Comstock.  1929, 
p.  413).  In  several  respects,  Shevlin  Hall  was  not  unlike  con- 
temporary women’s  centers  found  on  many  campuses  today. 

The  mechanism  Comstock  used  to  develop  leadership 
skills  and  responsibility  in  students  was  ti:°  Student  Self- 
Government  Association  which  was  voted  in  by  students  in 
December  of  1906  for  the  purpose  of  aiding  in  the  care  and 
conduct  of  Alice  Shevlin  Hall.  Such  associations  originated 
in  the  women’s  colleges  and  Comstock  herself  had  partici- 
pated in  self-government  while  attending  Smith  College. 
Comstock  believed  that  student-developed  and  student-en- 
forced policies  achieved  more  positive  outcomes  (especially 
in  terms  of  greater  compliance)  than  those  dictated  by  ad- 
ministrators. In  the  meantime,  the  process  taught  students 
about  leadership,  consensus,  law  and  order,  and  good  citi- 
zenship (Comstock,  1909,  p.  4;  Ladd,  19  iO,  pp.  7-8). 

A student's  need  to  finance  her  education,  find  suit- 
able employment,  and  develop  career  aspirations  was  as  im- 
portant to  Comstock  as  building  a dormitory.  She  wanted  to 
“fit"  women  for  a greater  variety  of  gainful  occupations 
(Johnson,  1910,  p.  195).  In  1909,  it  was  estimated  that  the 
average  student  needed  between  $350  and  $450  to  attend  the 
university  (Johnson,  1910).  Comstock  conducted  research 
and  found  that  fifteen  percent  of  women  students  were  at 
least  partially  self-supporting  (compared  with  sixty-four  per- 
cent of  the  men).  On  average,  the  women  earned  $ 1 9 1 while 
their  male  classmates  earned  $306  per  year  on  the  job.  The 
women  worked  in  very  female-oriented  occupations  includ- 
ing housekeeping,  child  care,  office  clerking,  tutoring,  and 
other  secretarial  work.  Comstock  believed  that  low  salaries 
obligated  women  to  work  longer  hours  and  she  observed 
that  the  women  often  suffered  from  overwork  and  exhaus- 
tion. She  also  discovered  that  despite  the  hardship,  the  self- 
supporting  women  did  as  well  academically  as  their  non- 
working counterparts  (Comstock.  1910). 

Comstock  took  it  upon  herself  to  oversee  the  employ- 
ment of  women,  making  sure  that  it  was  safe  and  fairly  paid. 
She  once  said  that  “this  aspect  of  the  work  of  my  office  is  of 
very  great  interest  to  me.  It  brings  me  in  contact  with  many 
girls  whom  I am  especially  glad  to  know”  (Comstock,  1 908,  p. 
4).  She  used  Shevlin  Hall  as  a clearing  house  for  job  listings, 
but  often  the  choices  were  limited.  To  increase  employment 
opportunities.  Comstock  spent  the  Christmas  vacation  of 
1911-12  walking  up  and  down  the  streets  of  the  Twin  Cities 
trying  to  convince  department  stores  of  the  sagacity  of  hir- 
ing women.  She  found  that  they  “were  particularly  impreg- 
nable to  the  suggestion"  (Blanshard,  1 974,  p.  1 1 ). 
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Creating  a Professional  Literature  and  Professional 
Association 

Successfully  initiating  programs  such  as  those  created 
by  Comstock  and  insuring  that  women  had  full  intellectual 
participation  in  the  campus  became  the  raison  d'etre  of  the 
young  profession  of  dean  of  women.  Some  deans,  however, 
believed  that  their  work  on  behalf  of  students  and  their  own 
sense  of  self-esteem  would  be  enhanced  and  legitimated  if 
the  overall  status  of  the  position  was  elevated.  Lois  Mathews 
at  the  University  of  Wisconsin  from  1911  to  1918,  was  of 
such  a mind.  She  believed  that  deans  of  women  should  also 
be  members  of  the  faculty  and  have  more  of  the  attributes 
normally  associated  with  a profession — including  a profes- 
sional literature  and  formal  training  for  aspirants. 

Mathews  was  a prot6g6  of  Frederick  Jackson  Turner 
and  the  First  women  to  pass  Harvard's  Ph.D.  examination  in 
history — although  her  degree  was  from  the  Radcliffe  gradu- 
ate school,  a bureaucratic  anomaly  created  to  award  doctor- 
ates to  women  because  Harvard  would  not.  She  was  an  as- 
sistant professor  of  history  at  Vassar  and  an  associate  pro- 
fessor at  Wellesley  College  before  moving  to  Wisconsin. 

In  her  long  and  occasionally  heated  negotiations  with 
Charles  Van  Hise,  president  of  the  university,  she  held  out 
for  the  title  of  dean  (rather  than  advisor  as  he  suggested)  and 
the  rank  of  associate  professor.  She  argued  that  an  associate 
professorship  carried  more  weight  with  students  and  faculty 
and  contributed  to  the  dignity  of  her  office.  She  also  noted 
that  she  might  only  spend  a few  years  in  administration  and 
might  choose  to  resume  a full-time  academic  career,  in  which 
case  she  would  need  the  rank  of  associate  professor  to  se- 
cure her  own  future.  When  explaining  why  she  did  not  relent, 
she  said,  “if  I were  to  undertake  so  great  and  serious  a task  as 
the  deanship  of  women  in  the  University  of  Wisconsin,  it 
seemed  to  me  it  would  be  my  First  duty  to  make  it  in  stature 
what  it  is  in  opportunity;  and  at  the  same  time  to  try  to  make 
it  an  example  to  other  universities  in  that  regard"  (Van  Hise 
Correspondence). 

Mathews'  scholarly  potential  and  productivity  prior 
to  entering  Wisconsin  was  considerable — she  published  ar- 
ticles and  wrote  a very  important  book  in  1909,  The  Expan- 
sion of  New  England , that  had  its  last  printing  in  1962;  her 
career  as  an  historian  was  quite  disappointing  after  she  was 
made  dean.  Although  she  continued  to  teach,  she  did  not 
contribute  much  after  1912  to  the  field  of  history.  Unfortu- 
nately, Mathews'  experience  was  very  typical.  All  four  women 
in  this  study  were  trained  as  faculty  members  and  all  four 
found  their  scholarly  progress  impeded  by  the  exigencies  of 
administrative  positions. 

Mathews  was  very  dedicated  to  her  new  profession 
and  brought  to  it  the  same  intellectual  vigor  thal  she  had 
applied  earlier  to  history.  While  dean,  she  had  numerous 
public  speaking  engagements,  published  several  articles,  and 
spoke  frequently  at  ACA  and  the  biennial  deans'  confer- 
ences. She  invited  aspiring  deans  to  visit  her  on  the  Madi 


son  campus  to  learn  about  the  job.  She  organized  a state- 
wide conference  for  all  women  deans  in  Wisconsin,  includ- 
ing those  from  small  colleges  and  normal  schools.  In  the 
summer  of  1 9 1 5 she  taught  a course  in  “College  Administra- 
tion for  Women,"  which  was  the  first  of  its  kind  taught  in  a 
public  university  and  was  offered  concurrently  with  the  first 
courses  taught  on  the  subject  at  Teachers  College  ( The  Daily 
Cardinal , 1915,  1916). 

Her  most  lasting  contribution,  however,  was  her  19 15 
book.  The  Dean  of  Women,  the  first  book  ever  written  on  the 
profession  that  eventually  became  known  as  student  affairs. 
A second  book  on  the  subject  was  not  written  until  1926 
(Merrill  and  Bragdon).  Mathews  held  a particular  vision  for 
the  profession.  She  wanted  to  be  “more  than  a wise  and 
pious  matron."  She  believed  deans  should  be  scholars,  ex- 
perts on  women's  education,  and  general  advocates  for 
women  who  expanded  the  social,  vocational,  and  intellectual 
opportunities  available  to  them.  This  book  represented  the 
collective  wisdom  of  Mathews  and  her  like-minded  peers  on 
issues  ranging  from  teaching  to  supervision  in  the  dormito- 
ries to  how  to  organize  an  office.  With  all  the  pieces  in  place 
by  1916,  the  position  had  the  vestiges  of  a profession. 

Reversal  of  Fortune 

The  new  profession  of  dean  of  women  opened  up  the 
possibility  of  administrative  careers  on  coeducational  cam- 
puses. Because  of  the  direct  relationship  between  the  num- 
ber of  women  students  at  an  institution  and  the  presence  of 
women  in  the  faculty  or  administration,  women's  colleges 
traditionally  offered  a few  opportunities,  but  prospects  at 
coeducational  universities  were  scarce,  especially  before  1 920 
(Clifford,  1989).  Coeducational  institutions,  therefore,  held 
tremendous  promise  for  women  who  sought  professional 
careers  in  universities,  but  who  lived  in  the  midwest  or  other 
regions  of  the  country  where  single-sex  education  was  less 
common.  Therefore,  deans  acted  as  the  “entering  wedge"  in 
coeducational  institutions  (Rossiter,  1982,  p.  2).  As  the  first 
and  often  the  only  female  administrators  who  either  held  a 
broad  range  of  responsibilities  or  the  sufficient  rank  needed 
in  the  institution  to  initiate  policy  proposals,  “they  had  the 
most  consistent  effect  in  bringing  more  women  into  the  pro- 
fessional community"  (Clifford,  1989,  p.  13).  They  also  suc- 
ceeded in  making  the  position  of  dean  de  rigueur.  Although 
women's  needs  were  hardly  an  institutional  priority,  the  vast 
majority  of  all  types  of  coeducational  institutions  had  a dean 
after  1920. 

One  cautionary  note  on  the  effect  of  the  position  of 
dean  on  professional  women  is  in  order,  however.  Like  other 
women  in  nascent  professions,  the  pioneering  deans 
struggled  and  strategized  to  secure  professional  status,  over- 
come resistance,  secure  acceptance,  and  gain  recognition. 
Yet,  attaining  the  position  was  somewhat  of  a two-edged 
sword,  perhans  analogous  to  the  experience  of  academic 
women  who  sought  appointments  within  home  economics. 
Like  home  economics,  being  a dean  provided  women  with 
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opportunities  for  professional  work,  but  it  also  contributed 
to  the  ghettoizing  of  women  into  administrative  roles  that 
became  essentially  student  affairs  positions  and,  conse- 
quently, undervalued  by  the  academy.  In  addition,  many  of 
the  early  deans  (those  hired  in  the  first  years  of  this  century) 
were  women  with  credentials  which  should  have  earned  them 
faculty  posts.  These  highly  trained  “teaching  deans"  com- 
bined teaching  and  administration  and  held  faculty  rank,  but 
their  administrative  duties  inhibited  scholarly  advancement. 
One  can  only  speculate  on  how  many  women  reluctantly 
settled  fora  combined  administrative/academic  post  because 
they  were  not  offered  a purely  academic  job. 

It  was  this  trend  toward  an  exclusively  administrative 
post,  away  from  teaching  and  in  the  direction  of  student 
affairs,  that  can  be  labeled  (albeit  rather  dramatically)  as  the 
reversal  of  fortune.  Talbot,  Breed,  Comstock,  and  Mathews 
worked  in  large  universities  and  simultaneously  held  faculty 
positions.  However,  deans  of  women  were  also  hired  in  other 
types  of  institutions  such  as  smaller  colleges  and  normal 
schools.  Deans  in  these  environments  (and  in  some  univer- 
sities) began  to  question  the  need  for  dual  faculty  appoint- 
ments— they  chose  instead  to  emphasize  the  counseling,  guid- 
ance. and  regulatory  nature  of  their  work.  A few  women  with 
this  point  of  view  were  studying  for  a master's  degree  at 
Teachers  College  in  the  summer  of  1916  when  they  formed 
the  National  Association  for  Deans  of  Women  (NADW) — 
which  eventually  became  the  professional  organization  for 
all  deans.  However,  the  NADW  placed  very  little  emphasis 
on  the  importance  of  faculty  rank  to  the  position  of  dean. 

Lois  Mathews'  vision  of  deans  as  scholars  lost  out  to 
the  newer  vision  of  the  profession  which  was  shared  by  the 
newdy  created  office  of  dean  of  men  (Catton.  1956).  As  stu- 
dent affairs  practioners,  they  suffered  a lack  of  prestige  w ithin 
the  academy.  Therefore,  in  terms  of  the  administrative  influ- 
ence of  deans  of  women,  the  era  examined,  1892  to  1916, 
represented  a high  point.  Later  decades  saw  it  further  re- 
duced in  stature  w hen  former  deans  of  women,  who  had  once 
reported  directly  to  the  president,  subsequently  became  as- 
sistants who  reported  to  male  deans  of  students  (Greenleaf, 
1968).  It  is  intriguing  to  speculate  on  whether  the  strategy 
that  Mathews  proposed — holding  dual  faculty/administra- 
tive appointments — might  have  helped  the  profession  of  dean 
of  women  maintain  or  even  increase  its  prestige  on  campus. 
As  a result  of  separating  themselves  from  the  faculty,  deans 
w'ere  isolated  from  any  important  pow'erbase  within  the  acad- 
emy. 

Is  there  a place  in  a modem  coeducational  university 
for  a dean  of  w omen?  It  is  currently  the  case  that  many  of  the 
1 unctions  historically  performed  by  deans  of  women  such  as 
housing,  career  advising,  discipline,  and  health  care  are  ex- 
ecuted by  various  student  affairs  professionals  of  both  gen- 
ders. But  to  assume  that  such  functions  w ere  the  sine  qua 
nan  of  the  work  of  the  pioneers  such  as  Talbot.  Breed. 
Comstock,  and  Mathews  is  to  ignore  the  historical  evidence. 
What  drove  the  pioneering  deans  to  create  a new  model  for 
the  role  was  a desire  to  addiess  inequities  in  coeducational 


environments,  attend  to  the  intellectual  development  of 
women  students,  and  move  beyond  providing  basic  needs 
and  discipline. 

There  is  still  a need  to  help  women  combat  the  effects 
of  sexism,  achieve  intellectual  parity,  and  find  a community 
on  campus.  If  the  work  of  a dean,  in  the  tradition  of  the  pio- 
neers. is  needed,  perhaps  it  is  being  accomplished  today  by 
professionals  such  as  the  heads  of  w-omen's  studies  pro- 
grams or  the  directors  of  women's  centers.  So.  w-hile  a person 
with  the  title  of  dean  may  not  be  needed,  someone  with  her 
agenda  most  assuredly  is. 


1 “Ai  homes’'  were  small  gatherings  in  the  dean’s  office  or  home. 
The  conversation,  accompanied  by  tea  and  refreshments,  was  guided 
by  the  dean  for  the  purpose  of  discussing  policies  or  problems. 

: Several  archival  and  published  sources  were  consulted  to  estab- 
lish the  fact  that  no  written  record  of  this  decision  seems  to  exist, 
including:  the  papers  and  published  Works  of  Mary  Bidwell  Breed 
(Indiana  University)  and  Marion  Talbot  (University  of  Chicago); 
the  archives  of  the  National  Association  of  Deans  of  Women  (cur- 
rently the  National  Association  of  Women  in  Education)  including 
the  minutes  of  the  dean’s  conferences;  other  histories  of  specific 
deans  of  women,  the  position  of  dean,  or  the  NADW.  (See  the 
bibliography  for:  Catton,  B..  1956;  Haddock.  R..  1952;  Holmes,  L.. 
1939;  Martin.  G.  S..  1911:  Mathews.  L.  K..  1915;  Merrill.  R.  A. 
and  H.  D.  Bragdon,  1926;  Phillips.  K.  S.  M..  1919;  Potter.  M.  R.. 
1927;  and  Rolhenberger.  K..  1942). 
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Consolidation  Comes  to  Ashland  County , Ohio 


Louise  E.  Fleming.  Ashland  University 

Abstract 

This  study  looks  at  the  education  and  community  of  one-room  schools  in  rural  Ohio  in  the  early  20th 
century . It  focuses  on  three  individuals,  all  of  whom  were  students  in  one-room  schools  and  two  of  whom 
taught  in  them.  It  ends  with  the  consolidation  of  the  one-room  schools  in  Ashland  County * Consolidat- 
ing small  schools  was  much  touted  by  educators  at  the  time,  but  it  raises  questions  today  about  what  the 
rural  community  lost  and  what  it  gained. 


The  one-room  schoolhouse  served  midwestem  rural 
community  life  in  the  1 9th  and  early  20th  centuries  (Fuller, 
1982,  p.  235).  In  many  ways  the  school  grew  up  as  an  exten- 
sion of  the  community.  Farmers  sculpted  the  school  as  an 
arm  of  their  beliefs  and  lifestyle.  Additionally,  in  the  one- 
room  schoolhouse,  the  community  together  witnessed  exhi- 
bitions such  as  recitations,  orations,  songs,  readings,  sea- 
sonal performances,  and  spell-downs.  School  picnics  and 
eighth-grade  graduations  also  took  place  in  these  commu- 
nity centers  (Fuller,  1982,  p.  21 2). 

During  this  time  period,  however,  consolidation- form- 
ing a school  district  out  of  several  small  schools-was  begin- 
ning to  reduce  the  number  of  one-room  schoolhouses  (Fuller, 

1 982,  p.  1).  In  most  areas  local  farmers  opposed  consolida- 
tion. Although  advocated  by  educators  who  promised  bet- 
ter and  larger  facilities,  libraries,  and  a principal  for  each  build- 
ing (Fuller,  1982,  p.  231 ),  consolidation  also  meant  loss  of 
direct  community  control  over  education.  It  meant  taking  the 
children  out  of  the  immediate  community,  relinquishing  their 
education  and  even  their  transportation  to  another,  larger 
community  which  represented  or  was  perceived  to  represent 
a different  culture  and  possibly  a different  religion.  It  meant 
that  their  children  would  have  to  conform  in  dress  and  be- 
havior to  a different  set  of  standards  and  might  face  forms  of 
“corruption,"  such  as  smoking,  not  faced  before  (Fuller,  1 982, 
pp.  235-236). 

Educators  touted  consolidation  as  the  cure  for  the 
problems  that  plagued  the  one-room  schools:  lack  of  money, 
poor  quality  of  teaching,  poor  facilities,  lack  of  textbooks, 
and  insufficient  time.  Consolidation  represented  progress  to 
these  educators  (Fuller,  1982,  p.  2).  Forthem.oneofthemost 
important  reasons  to  consolidate,  although  unstated  when 
trying  to  convince  farmers  to  consolidate  their  schools,  was 
to  professionalize  decision-making,  thus  taking  control  from 
the  local  community  which,  in  the  opinion  of  many  educa- 
tors, could  not  be  trusted. 

Was  consolidation  a loss  or  a gain  to  Ashland 
County?  To  explore  this  question,  we  will  consider  the  expe- 
riences of  individuals  who  were  students  or  teachers  in  a 
one-room  school.  In  this  study  we  meet  three  individuals 


from  Ashland  and  Medina  Counties,  Ohio.  All  three  studied 
in  one-room  schools;  two  later  taught  in  one-room  schools. 
Two  related  their  experiences  directly,  and  one  is  remembered 
in  college  catalogues,  in  newspaper  reports,  and  by  family 
members. 

Jenny  May  Kohler , who  preferred  to  be  called  May, 
grew  up  in  Mifflin  Township  in  Richland  C junty,  Ohio.  She 
was  the  daughter  of  farmers,  Jacob  and  Alice  Kohler,  and  the 
sister  of  Lyman,  Mabel,  and  Mildred.  The  Kohler  family  lived 
close  to  the  border  of  another  Mifflin  Township,  in  neighbor- 
ing Ashland  County,  and  because  Ashland  County’s  Hiller 
School  was  the  closesi  school  to  the  Kohlers,  the  children 
were  allowed  to  cross  the  county  line  to  attend  school.  They 
attended  St.  Michael's  Lutheran  Church  in  the  village  of 
Mifflin,  also  in  Ashland  County. 

Hiller  School  was  originally  named  Pleasant  Valley, 
then  Houghenbough’s,  and  finally  Hiller's,  depending  on  who 
owned  the  farm  adjacent  to  it.  Other  schools  in  Mifflin  Town- 
ship of  Ashland  County  were  Stony  Point,  renamed  West  Point 
when  it  was  rebuilt  and  moved  after  a fire  destroyed  it:  Mifflin 
Grammar  School,  a two-room  building  in  the  village  of  Mifflin; 
and  Buckeye  Hall.  (Kopp&  Sloan,  1 944,  pp.  46, 52, 89). 

The  adjoining  Ashland  County  township,  Milton 
Township,  had  schools  which  included  Pifer’s,  Wharton’s,  Para- 
dise Hill,  Anderson’s,  Albert’s,  Nelson’s,  Bum's,  and  Roland's 
(where  May  eventually  taught).  Albert's  School  was  built  in 
1826  and  was  rebuilt  as  a “beautiful”  red  brick  building.  Nelson’s 
was  also  red  brick,  rebuilt  in  1891 . The  Baptists  Tunkers  in  the 
community  used  Bum’s  School  as  a church.  In  19 14  the  School 
Board  of  Pifer’s  School  was  censured  for  hiring  a female  teacher. 
Apparently  the  boys,  who  often  attended  school  until  age  20, 
were  notoriously  hard  to  handle,  even  for  male  teachers  (Kopp 
& Sloan,  1944,  pp.  149, 161, 166, 189). 

May’s  family  struggled  financially,  as  did  many  other 
farm  families,  but  they  managed  to  send  her  to  the  Ashland 
College  Normal  program  in  the  village  of  Ashland,  Ohio  in 
the  years  1906-07  and  1907-08.  In  the  1907-08  catalog  May 
was  listed  as  an  undergraduate  in  the  normal  program  and  a 
participant  in  penmanship  (Ashland  College,  1906,  p.  78;  1907, 
pp.  57, 60).  The  complete  normal  program  lasted  three  years. 
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but  May  did  not  graduate  from  it.  Apparently  two  years  was 
enough,  however,  to  obtain  a teaching  license.  May  is  in- 
cluded in  the  April  4,  1908  list  of  teachers  who  passed  the 
teacher-licensing  exam  (“Ideals,"  1908;  “Licensed,"  1908). 

Family  members  remember  that  May  taught  at  both 
Hiller  School,  in  Mifflin  Township,  and  Roland  School,  in 
Milton  Township,  and  that  she  stayed  with  at  least  two  fami- 
lies other  than  her  own  (All  family  information  came  from  B. 
Smalley,  personal  communication,  July  21,1 994;  J.  Conn  Sc  F. 
Cook,  personal  communication.  September  4, 1 994).  May  had 
to  give  her  earnings  to  her  father  who  promised  to  save  them 
for  her.  but  when  she  got  married,  he  did  not  have  the  money. 
He  did  pay  back  at  least  part  of  the  sum  in  the  ensuing  years. 

For  seven  years  May  dated  Chester  Conn,  a resi- 
dent and  teacher  in  Mifflin  village,  whom  she  had  met  at  her 
Mifflin  church.  While  May  taught  at  Roland  School,  she  lived 
with  George  and  Sue  Ohl  who  owned  the  farm  across  from 
the  school;  Sue  Ohl  was  Chester  Conn’s  aunt.  Across  the 
street,  John  and  Anna  Ohl  had  purchased  their  farm  from  the 
Rolands  and  donated  a parcel  of  land  to  build  Roland  School. 
'Their  son,  Ray  Ohl,  now  deceased,  remembered  having  had 
May  as  a teacher  (R.  Ohl,  personal  communication,  April, 
1994).  Another  family  May  stayed  with  was  that  of  Charlie 
and  Florence  Aby. 

One  township  news  column  (“North  Milton,"  1 909) 
reported  that  “Misses  May  Kohler  and  Florence  Brubaker 
took  dinner  with  Mrs.  Jay  Latter  of  Ashland."  May  and 
Chester  both  attended  a five-day  Teacher's  Institute,  held  in 
Savannah,  Ashland  County,  Ohio,  in  August  1 908  for  which 
they  each  received  a certificate  of  attendance  (“Teachers  In- 
stitute," 1908).  Chester  and  May  were  married  in  1914  when 
May  was  25.  The  couple  moved  to  Akron,  Onio  so  that 
Chester  could  find  work  and  make  enough  money  to  support 
a family.  By  the  next  year  May  had  her  first  child.  She  did  not 
seek  a teaching  job  in  Akron. 

Details  of  May’s  life  as  a teacher  are  difficult  to 
piece  together.  Ashland  city  schools  have  school  board  min- 
utes for  the  time  period,  but  few  records  exist  for  the  one- 
room  schools.  When  the  rural  one-room  schools  consoli- 
dated with  Ashland  schools  in  1939,  most  of  the  one-room 
schools'  records  were  destroyed.  Although  news  about 
Ashland  village  schools  appears  in  the  newspaper  regularly 
during  the  time  period  from  1908  to  1914,  news  about  one- 
room  schools  in  the  surrounding  townships  rarely  does.  The 
schools  played  such,  an  integral  role  within  the  rural  commu- 
nity that,  except  for  an  occasional  spelling  bee,  they  were  not 
considered  newsworthy.  Additionally,  while  the  rural  one- 
room  schools  were  integral  to  their  rural  communities,  they 
were  outside  the  activity  of  the  village  of  Ashland,  where  the 
paper  was  published. 

Clarence  Brubaker  began  attending  Roland  School 
in  1915.  That  year  new  reading  texts  replaced  Me  Guffey's 
readers.  During  Clarence’s  time  at  Roland  School,  a male  stu- 
dent was  paid  $1 .00  a week  to  bring  in  coal  and  start  the  fire 
on  cold  mornings,  while  the  teacher  swept  and  cleaned  the 


schoolroom.  Clarence’s  first  teacher  was  Rhea  Urban,  fol- 
lowed by  Rhea  Workman.  The  teacher  taught  about  1 7 stu- 
dents in  8 grades.  Clarence  spoke  favorably  about  his  time  at 
Roland  School,  and  mentioned  that  he  was  able  to  finish  two 
grades  in  one  year,  second  grade  by  Christmas  of  1916  and 
third  grade  by  the  end  of  the  1916-17  school  year.  This  indi- 
vidualized pace  allowed  him  to  pass  the  high  school  exam  a 
year  early  and,  then,  to  attend  Ashland  High  School.  He 
drove  a horse  and  buggy  until  he  was  in  his  third  year  of  high 
school  when  he  had  a car  to  drive  (C.  Brubaker,  personal 
communication.  April,  1994). 

Dorothy  Rice  was  both  student  and  teacher  in  a 
one-room  school.  Sht  attended  school  in  Chatham  in  Medina 
County,  Ohio,  north  of  Ashland  County.  Eight  grades  shared 
the  school,  and  the  teacher,  Sam  Orr,  read  the  Bible  daily  to 
his  students.  He  also  kept  the  fire  going  and  the  school 
clean.  Dorothy  has  happy  memories  of  school,  particularly 
recess,  when  Orr  played  games,  especially  baseball,  with  the 
children.  She  began  school  at  age  5,  walking  one  and  a half 
miles  with  her  10  year  old  sister.  In  the  winter  their  father  took 
them  on  a sled.  Dorothy  finished  her  schoolvvork  a year  early 
and,  then,  after  passing  the  eighth  grade  graduation  exam, 
entered  Lodi  High  School,  also  in  Medina  County.  The  exam, 
the  Boxwell-Pattison  Examination,  tested  the  children  in  his- 
tory (including civil  government),  physiology,  grammar,  read- 
ing, arithmetic,  geography,  writing  (hand-writing),  and  or- 
thography (grammar,  punctuation,  and  spelling)  (Fuller,  1 982, 
p.  2 1 3).  Dorothy  stayed  with  a family  in  Lodi,  working  for  her 
room  and  board. 

In  1915  she  graduated  and  attended  a one-year  nor- 
mal program  in  nearby  Medina,  Ohio,  taught  by  the  Medina 
County  superintendent,  and  then  a two-year  normal  program 
at  Kent  State  in  Kent,  Ohio.  In  1 9 1 8- 1 9 1 9 she  taught  grades 
1 -4  at  the  Poe  School  in  Poe,  Ohio,  now  Montville,  in  Medina 
County.  Grades  5-7  were  taught  in  the  Grange  Building.  She 
then  moved  to  Spencer,  Ohio  in  Medina  County,  near  Chatham, 
where  she  had  grown  up,  and  taught  second  grade  (D.R. 
Fuller,  personal  communication,  August  17, 1994). 

Dorothy  opened  each  day  with  the  Pledge  of  Alle- 
giance, followed  by  reading.  Other  subjects  she  taught  were 
spelling,  arithmetic,  phonics,  history,  art.  music,  and  pen- 
manship. The  children  were  brought  to  school  on  a “kid 
wagon"  pulled  by  two  horses.  Everyone,  including  Dorothy, 
brought  lunch,  and  they  all  shared  a common  water  bucket. 
Dorothy  and  the  children  often  played  games  outside  after 
lunch.  A female  janitor  built  a fire  in  the  stove  in  the  morning 
and  kept  the  schoolroom  clean.  Dorothy,  however,  washed 
her  own  boards.  She  remembers  hosting  spelling  bees,  which 
the  parents  attended,  in  the  evening.  The  class  members  drew 
names  to  exchange  Christmas  gifts,  and  in  the  spring  she 
took  them  outside  for  flower  collection  and  identification  (D.R. 
Fuller,  personal  communication,  August  17,  1994). 

In  Ashland  County,  the  reign  of  the  rural  one-room 
schools  ended  in  1939.  Joining  other  school  districts  across 
the  nation,  the  Ashland  County  school  hoard  proposed  to 
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consolidate  the  rural  one-room  schools  into  two  districts  and 
to  consolidate  the  nearby  schools  into  Ashland  city  schools. 
The  recommendation  “brought  violent  protest  from  members 
of  district  boards”  at  an  open  meeting  at  the  county  court- 
house. The  community  representatives  expressed  resentment 
over  sending  their  children  to  another  community  and  hav- 
ing their  money  leave  their  local  area.  Jay  Roberts,  Milton 
Township  board  president  was  in  a quandry.  Three  of  their 
one-room  schoolhouses  had  been  condemned  by  the  state 
department  of  education  and  were  to  close  at  the  end  of  the 
term.  The  Board’s  long-range  options  were  to  build  their 
own  elementary  schools  or  to  send  township  children  to 
schools  outside  the  township.  Apparently  a temporary  op- 
tion, which  Roberts  preferred,  was  to  repair  the  decaying 
buildings,  but  the  state  only  had  promised  that  option  for  a 
year  (“Delegations.”  1939). 

Despite  Roberts’  intentions,  consolidation  was  the 
less  expensive  route  to  take.  Two  days  later  Roberts  declared 
that  he  was  “heartily  in  favor”  of  sending  Milton  Township 
children  to  Ashland  city  schools  (“Roberts,”  1939).  A week 
and  a half  later,  Milton  Township  school  district  was  trans- 
ferred to  the  Ashland  city  school  district  (“Transfer,”  1939). 
A delegation  from  the  Roland  school  attendance  area  in 
Milton  Township  petitioned  to  have  their  pupils  join  with  a 
county  district  instead  of  the  Ashland  city  district  (“Delega- 
tions,” 1939).  They  feared  the  city  students  would  corrupt 
their  children.  As  a result,  the  Roland  school  attendance  area 
wrs  divided.  One  side  of  Township  Road  #1706  went  to  a 
county  district;  the  other  side  went  to  the  city  of  Ashland  (J. 
Mueser,  personal  communication,  April,  1994). 

Like  other  farmers  across  the  Midwest,  Ashland 
County  rural  residents  resisted  consolidation.  With  consoli- 
dation they  lost  part  of  the  nature  of  their  community.  The 
schools  had  offered  a cohesiveness  that  otherwise  was  lack- 
ing. Because  of  the  large  distance  between  farms,  lack  of 
easy  transportation  or  telephones,  and  a lifestyle  that  re- 
quired hard  work  day  after  day,  little  socializing  was  done  on 
a daily  basis.  People  visited  in  town  on  Saturdays  while  they 
purchased  groceries  and  other  necessities,  and  on  Sundays 
when  they  attended  church.  Children  attended  the  schools 
daily  during  the  term,  and  parents  maintained  involvement 
with  the  schools  by  serving  on  school  boards,  attending 
spelling  bees,  and  providing  transportation  for  their  children 
when  necessary.  Most  of  the  schools  were  within  walking 
distance,  and  most  of  the  schools  reflected  the  culture  of  the 
community  in  which  they  were  located. 

Teachers  in  those  one-room  township  schools  were 
also  responsive  to  individual  needs,  allowing  students  to 
complete  two  years'  curriculum  in  one,  for  example,  as  in  the 
case  of  both  Clarence  and  Dorothy.  In  many  ways  the  school 
was  like  an  extension  of  home.  Teachers  played  with  the  chil- 
dren at  recess:  they  lived  or  boarded  in  the  community:  they 
knew  the  children's  parents,  brothers,  sisters,  aunts,  and 
uncles.  Children  at  school  were  not  strangers  to  the  teacher, 
to  each  other,  or  to  each  other’s  families.  Children,  teachers. 


and  parents  shared,  inside  and  outside  the  school,  in  the 
same  community,  a community  whose  cohesiveness  the  one- 
room  school  perpetuated. 

Rural  Ohioans  were  proud  of  their  one-room  schools. 
With  consolidation,  children  traveled  beyond  their  known 
worlds.  Whatever  the  alleged  educational  and  administra- 
tive gains  of  consolidation,  parents  were  no  longer  as  much 
a part  of  the  school  culture,  nor  was  the  school  as  much  a 
part  of  the  parents'  culture.  In  the  name  of  progress  one- 
room  schools  were  abandoned,  and  with  them,  a form  of  com- 
munity life  as  it  had  been  known  and  fostered  in  rural  Ohio. 
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The  Children  of  the  Dream:  Postwar  Planning  for 
The  First  Camp  of  the  Children’s  International 
Summer  Villages  Organization 


James  L.  Green,  College  of  Mounl  St.  Joseph 

Abstract 


Established  in  the  Midwest  in  the  late  I940's  by  Dr.  Doris  Allen  of  the  University  of  Cincinnati, 
Children  s International  Summer  Villages  (CISV)  is  a worldwide  youth  organization  dedicated  to  peace 
and  better  global  understanding.  This  article  focuses  on  its  creation  and  the  ideas  behind  CISV,  plus  it 
documents  the  organizational  work  undertaken  to  open  the  first  international  childrens  summer  camp 
in  suburban  Cincinnati,  Ohio  in  1951.  Although  multiculturalism  is  a contemporary  expression , it  can 
be  seen  historically  that  CISV  represents  a precursor  to  our  current  efforts  in  multicultural  education. 


Established  nearly  half  a century  ago  in  the  Mid- 
west. Children’s  International  Summer  Villages  (CISV)  is  an 
international  youth  organization  dedicated  to  peace  educa- 
tion and  global  understanding.  With  an  annual  budget  in  the 
U.  S.  alone  approaching  one  million  dollars,  CISV  has  grown 
from  a small  midwestem  association  to  a world-wide  organi- 
zation with  international  headquarters  located  currently  in 
England.that  has  served  over  100.000  people,  mostly  chil- 
dren, with  its  various  international  programs.1 

Prompted  by  the  fiftieth  anniversary  of  World  War 
II,  recent  regional  historical  scholarship  has  focused  on  the 
role  of  schools  during  that  conflict,  as  evidenced  by  several 
articles  in  the  1995  issue  (Volume  22)  of  the  Journal  of  the 
Midwest  History  of  Education  Society.  This  article  examines 
the  role  of  American  education  in  the  immediate  postwar  pe- 
riod. Within  that  context,  CISV  represented  a group  of  edu- 
cators who  felt  that  internationalism  should  be  a part  of  edu- 
cation. Their  efforts  and  idealism  were  mirrored  domestically 
by  a postwar  movement  known  as  intergroup,  or  intercul- 
tural  education,  which  in  the  Midwest  was  made  known 
through  the  work  of  progressive  educator  Hilda  Taba,  direc- 
tor of  the  Center  for  Intergroup  Education  at  the  University 
of  Chicago  from  1948-51.  Intergroup  education  represents 
both  a precursor  to  and  an  early  form  of  current  multicultural 
educational  programs;  likewise  CISV  can  be  seen  as  an  early 
form  of  multiculturalism. 

Founded  in  the  1940's,  CISV  was  developed  by  Dr. 
Doris  Twitchell  Allen,  then  associate  professor  of  psychol- 
ogy at  theUniversity  of  Cincinnati  and  chief  psychologist  at 
nearby  Longview  State  Hospital.  Noting  the  negative  post- 
war climate  of  international  tension  and  distrust,  she  thought 
international  summer  camps  for  children  (called  villages) 
would  teach  children  to  live  in  peace  with  people  of  other 
nationalities,  a lesson  that  would  carry  into  their  adult  lives 
and  provide  a seed  for  developing  better  international  rela- 
tions.2 

In  retrospect,  Allen's  conceptual  idea  was  idealistic 
and  optimistic  for  its  time  and  place.  Internationally,  the  late 


Forties  were  dominated  by  an  American  foreign  policy  which 
stressed  the  containment  of  Communism.  Deteriorating  rela- 
tions with  the  Soviet  Union  had  resulted  in  the  Truman  Doc- 
trine and  the  Marshall  Plan.  Tensions  in  Europe  were  height- 
ened by  the  Berlin  Blockade.  By  the  time  CISV  had  launched 
its  first  summer  village  in  195 1 , the  U.S.  was  deeply  involved 
in  the  Korean  Conflict.  Throughout  this  time  period,  the  threat 
of  nuclear  war  hovered.  Against  this  backdrop  Dr.  Allen  de- 
veloped and  presented  her  concept  of  CISV,  perhaps  encour- 
aged by  the  fact  that  in  the  immediate  postwar  period  many 
Americans  had  rejected  isolationism.  As  noted  by  William 
Chafe  \nThe  Unfinished  Journey , “Nearly  80  percent  [of  the 
American  public]  endorsed  U.S.  involvement  in  the  United 
Nations"  in  late  1 945  (Chafe,  1 99 1 , p.  3 1 ). 

The  city  of  Cincinnati,  with  just  over  one  half  mil- 
lion inhabitants  in  1950,  was  known  for  its  conservative  so- 
cial and  political  climate.  From  this  perspective  alone  it  might 
seem  surprising  that  such  an  apparently  liberal  organization 
as  CIS  V,  dedicated  as  it  was  and  is  to  world  peace  and  under- 
standing, would  have  originated  there.  That  it  did  so  must  be 
credited  to  the  vision  and  charisma  of  Dr.  Allen  and  to  a small 
group  of  internationally  minded  citizens.  This  paper  focuses 
on  the  creation  of  CISV,  its  objectives,  and  its  organizational 
efforts  in  establishing  its  first  summer  camp. 

In  his  history  of  CISV,  the  late  William  P.  Matthews, 
connected  with  the  organization  for  nearly  thirty-five  years 
in  various  leadership  positions,  chronicles  the  birth  of  the 
CISV  idea.  According  to  Matthews,  Dr.  Allen  conceived  of 
the  idea  in  1946  as  a reaction  to  a proposal  by  Alexander 
Meicklejohn,  who  recommended  creating  “a  sort  of  interna- 
tional graduate  school  for  Ph.D.  level  students  of  philoso- 
phy, history,  political  science,  economics,  physics  and  the 
social  sciences"(Matthcws,  1991,  p.  22).  The  purpose  of  this 
school  was  to  produce  the  nucleus  of  a leadership  group 
which  would  be  predisposed  toward  world  peace.  As  a spe- 
cialist in  child  growth  and  development,  Allen  thought  that 
Meicklejohn  had  targeted  the  wrong  age  group.  For  Allen, 
effective  peace  education  needed  to  begin  at  a younger,  more 
impressionable  age,  specifically  prcadolescent  children. 
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Later  in  the  fall  of  1 946,  Allen  was  prepared  to  spread 
her  idea  of  an  international  youth  organization  dedicated  to 
peace  education.  While  attending  the  annual  conference  of 
the  American  Psychological  Association,  she  promoted  the 
idea  before  her  professional  colleagues.  Shortly  afterwards 
she  repeated  her  efforts  before  a meeting  of  social  scientists 
in  Bar  Harbor,  Maine.  Professional  support  was  visible,  in- 
cluding that  of  anthropologist  Margaret  Mead  and  sociolo- 
gist Gordon  Allport. 

One  year  later  Allen  attended  the  2nd  General  Con- 
ference of  UNESCO  in  Mexico  City.  According  to  Matthews, 
Allen  was  disappointed  by  her  reception.  Hoping  to  receive 
financial  support,  as  well  as  support  for  her  idea,  she  re- 
ceived neither  from  this  United  Nations  organization,  even 
though  she  felt  “that  UNESCO  was  the  proper  home  for  the 
CIS  V idea’’(Matthews.  1 99 1 . p.  24).  Her  disappointment  was 
tempered  when  her  seven-year-old  son  unexpectedly  asked 
her  one  day  if  he  would  have  to  ever  fight  in  a war  similar  to 
the  one  which  had  just  concluded.  His  youthful  concern  pro- 
vided the  incentive  for  her  to  continue  to  promote  the  CISV 
idea  and  work  for  its  realization.  By  May  of  1 947,  her  renewed 
efforts  had  been  noticed  in  an  article  in  the  New  York  Times 
(Kaempffert  1 947,  p.  Ell). 

Throughout  1948  and  1949,  organizational  work 
continued.  Because  Allen  envisioned  psychologists  and 
social  scientists  studying  the  children  at  this  first  camp  to 
see  how  the  children  would  react  to  their  many  cultural  dif- 
ferences, she  developed  the  Twitched  Allen  Three-dimen- 
sional Personality  Test  for  assessing  personality  dynamics 
within  a multicultural  setting.  During  1949,  she  visited  Eu- 
rope and  surveyed  various  international  youth  programs, 
including  The  Pestalozzi  Children's  Village,  the  Junior  Red 
Cross  Headquarters,  and  the  International  Voluntary  Work 
Camps,  all  located  in  Switzerland  (History,  CIS V Papers.  Box 
1,  File  I).  While  in  Europe,  she  visited  the  UNESCO  head- 
quarters in  Paris  and  once  again  requested  financial  support 
for  both  operating  the  first  camp,  as  well  as  the  psychologi- 
cal and  social  science  research  connected  with  it.  The  first 
request  was  denied,  but  the  latter  was  granted  $3,000. 
UNESCO's  response  was  a turning  point  for  the  planning  of 
the  first  CISV  camp.  Up  to  this  point  Allen  had  envisioned  a 
European  location  as  its  site.  With  UNESCO's  refusal  to  pro- 
vide operating  funds,  Allen  and  her  husband  Erastus,  a promi- 
nent attorney  who  now  had  become  actively  involved  with 
her  idea,  made  the  key  decision  to  locate  the  first  CISV  vil- 
lage in  Cincinnati. 

From  this  point  forward,  much  of  the  planning  for 
the  first  camp  centered  itself  in  Cincinnati.  Erastus  Allen 
drew  up  incorporation  papers  for  CISV  and  by  September  of 
1950  the  organization  had  achieved  tax  deductible  status,  an 
important  step  for  fund  raising.  By  this  time  also,  the  deci- 
sion had  been  made  that  for  this  first  camp  the  host  city 
would  be  responsible  for  financing  the  entire  camp,  as  well 
as  travel  costs  for  the  foreign  delegations,  most  of  whom 
would  be  from  Europe.  CISV  founders  thought  war-tom  Eu- 
rope had  not  yet  fully  recovered  economically,  so  it  was  un- 


realistic to  expect  those  nations  to  be  able  to  afford  camp 
expenses.  Allen  and  her  growing  supporters  felt  that  local 
funding  would  be  the  most  reliable  means  to  finance  the  op- 
erations.3 

Meanwhile  a finance  committee  had  already  deter- 
mined that  a total  of  $40,000,  a sizeable  sum  of  money  in  1 950, 
would  be  needed  to  sponsor  the  first  village.  The  committee 
decided  that  individual  contributions  would  be  the  best  way 
to  raise  money,  rather  than  seeking  state  or  federal  govern- 
ment funds  which  might  compromise  CISV’s  neutral  stance 
regarding  political  ideology  during  this  Cold  War  era.  There 
was  some  concern  that  federal  funds,  in  particular,  might  lead 
to  the  State  Department  using  the  first  CISV  village  for  pro- 
pagandist^ purposes.  Corporate  sponsorship  was  relatively 
minor  with  a $ 1 ,000  gift  from  Coca  Cola,  plus  complimentary 
soda  for  the  month-long  camp  (Correspondence,  CISV  Pa- 
pers, Box  2,  File  1 ),  and  a $3,000  donation  from  WLW,  a part 
of  the  Crosley  communications  business  (Financial,  CISV 
Papers,  Box  7.  File  13).  Most  of  the  needed  $40,000  came  from 
private  donors  with  the  largest  single  gift,  $ 1 5,000,  from  Mary 
C.  Johnston,  a member  of  the  Procter  family  with  historical 
ties  to  Procter  and  Gamble,  Cincinnati's  most  well-known 
company.  The  depth  of  Dr.  Allen’s  commitment  was  mea- 
sured by  her  own  $5,000  contribution  to  this  first  camp  (Fi- 
nancial, CISV  Papers,  Box  7,  File  13).  Concurrent  with  their 
fund-raising  efforts,  the  fledgling  CISV  organization  waged  a 
public  relations  campaign  with  thirty-five  press  releases  pub- 
lished in  Cincinnati’s  three  daily  papers  in  1951. 

By  early  1951,  the  year  of  the  first  summer  village, 
CISV  had  organized  national  committees  in  England,  France, 
Denmark,  West  Germany,  Norway,  and  Sweden,  charged  with 
the  responsibility  of  selecting  child  and  adult  delegates  for 
the  first  camp.4  Each  nation  was  to  send  only  six  children, 
usually  selected  from  a single  city.  For  example,  in  West  Ger- 
many, six  children  were  chosen  from  the  schools  in  Hamburg. 

The  selection  process  reveals  much  about  the  CISV 
philosophy  and  its  objectives.  Eleven  year  olds  were  chosen 
as  campers,  or  child  delegates  as  they  were  labeled,  because 
they  were  mature  enough  to  spend  a month  away  from  home 
and  would  also  be  able  to  communicate  their  experiences 
with  their  peers  when  they  did  return  to  their  home  countries. 
Yet  this  age  group  was  still  young  enough  that  their  cultural 
and  racial  prejudices  had  still  not  solidified.  It  was  also  felt 
children  at  this  age  were  relatively  stable  physiologically  and 
emotionally,  plus  adaptable  to  new  experiences  (CISV  Hand- 
book, 1967,  p.  5).  Working  with  children  this  young  was  a 
unique  feature  of  CISV,  which  has  distinguished  it  from  nearly 
all  other  international  youth  exchanges.  The  inspiration  for 
choosing  this  age-group  came  from  Dr.  Allen  and  was  en- 
dorsed by  Margaret  Mead.  The  criteria  for  selecting  the  first 
CISV  child  delegates  were  also  developed  by  Dr.  Allen  and 
included  “the  ability  to  learn  quickly,  an  outgoing,  friendly 
nature,  acceptance  by  other  children,  good  health,  a stable 
emotional  makeup,  the  ability  to  transmit  the  experience  to 
others  after  camp,  and  a real  desire  to  be  friends  with  children 
from  other  countries."  (Matthews,  1 99 1 , p.  30-3 1 ). 
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Although  only  one  of  the  criteria  alludes  to  academic 
excellence,  the  evidence  from  the  later  academic  careers  of 
the  American  child  delegates  suggests  an  academically  tal- 
ented group.  Five  of  six  of  them  were  to  attend  college,  in- 
cluding such  places  as  Yale.  Cornell.  Harvard,  and  Michigan 
(Delegates,  CISV  Papers.  Box  1 2,  File  5). 

In  retrospect,  and  from  a modem  multicultural  per- 
spective, choosing  children  from  primarily  Northwestern 
European  countries,  three  from  Scandinavia  alone,  hardly 
seems  multicultural.  Racial  differences  were  nearly  non-exis- 
tent; and  religious,  linguistic,  and  ethnic  differences  seem 
small  when  viewed  from  a contemporary  global  or  even  na- 
tional perspective.  Even  the  early  leaders  of  CISV  by  the  mid 
1 950's  were  cognizant  of  the  need  for  a more  diverse  interna- 
tional participation  in  their  organization.  Yet  to  minimize  the 
cultural  differences  within  this  first  group  of  child  delegates 
would  overlook  the  then  recent  experiences  of  World  War  II. 
Such  a critique  would  miss  the  sharp  divisions  which  still 
existed  between  various  European  nationalities  as  a result  of 
the  war.  In  fact,  Allen  hoped  that  these  differences  could  be 
reduced  by  CISV  participation,  when  children  of  diverse  back- 
grounds began  to  discover  their  likenesses. 

A closer  examination  of  the  background  of  the  se- 
lected children  reveals  personal  wartime  circumstances  in 
their  lives  that  could  have  been  potentially  very  divisive  at 
that  first  camp.  For  example,  at  least  one  each  of  the  German 
and  Austrian  children  had  lost  a father  in  the  war.  Likewise, 
one  of  the  French  children,  who  was  Jewish,  had  lost  several 
family  members  to  the  Holocaust  (St.  Edmund’s  Camp,  CISV 
Papers,  Box  1 3,  File  1 ).  All  of  the  European  children,  except 
the  Swedes,  had  at  least  some  direct  memories  of  the  war, 
since  they  were  age  five  at  its  close.5  Thus,  recent  historical 
events  heightened  whatever  cultural  differences  might  have 
normally  existed  amongst  these  children. 

Several  countries  felt  the  need  to  internally  diver- 
sify their  own  child  delegations.  France  and  Austria,  both 
overwhelmingly  Catholic,  purposely  selected  Jewish  and  Prot- 
estant children  as  well  as  Roman  Catholic.  Likewise,  West 
Germ  any,  Austria,  and  Great  Britain  consciously  diversified 
along  social  class  lines.  For  example,  the  West  German  del- 
egation chose  children  whose  fathers  included  two  white 
collar  clerks,  one  teacher,  one  postman,  and  a factory  worker 
(St.  Edmund’s  Camp,  CISV  Papers.  Box  1 3,  File  l ).  In  the  United 
States,  planners  specifically  chose  one  African  American 
child  delegate  as  well  as  hired  one  Black  camp  counselor  for 
the  staff,  because  they  felt  it  was  important  for  the  foreign 
delegations  to  witness  U.S.  racial  diversity.  This  was  done 
during  the  early  years  of  the  civil  rights  movement  and  when 
Cincinnati,  itself,  was  still  overtly  segregated.  In  fact,  evi- 
dence of  such  segregation  is  noted  in  the  first  entry  of  a 
diary  kept  by  the  director  of  this  first  summer  village.  Written 
during  June  of  1 95 1 , camp  director  Ted  Wuerfel  wrote,  “On 
trip  to  Glendale  [the  suburban  location  of  this  camp]  group 
was  refused  service  at  one  place  because  of  Claire  (Negro). 
Went  to  Igler's  instead"  (Wuerfel,  1951,  p.l).  In  other  words, 
they  were  denied  service  at  one.  ice  cream  shop  and  had  to 
patronize  another. 


By  spring  of  1951,  the  children  had  been  selected 
with  their  adult  chaperones.  As  conceived  by  Dr.  Allen,  this 
first  summer  village  would  consist  of  four  components  in- 
cluding the  childrens'  camp  itself,  an  adult  institute,  a re- 
search program,  and  a public  relations  campaign  (Matthews, 
1991. p.  31). 

In  many  ways  the  camp  was  like  any  other  summer 
camp.  Activities  planned  involved  sports  (highlighted  in  this 
instance  by  recreational  swimming  and  other  non-competi- 
tive sports),  arts  and  crafts,  folk  dancing,  daily  chores,  and 
parliamentary  meetings.  The  camp  was  unique  in  that  the 
children  came  from  nine  different  nations,  delegations  of  six 
children  each  about  to  embark  on  a one  month  long  experi- 
ment in  international  living.  As  part  of  the  planned  camp, 
each  delegation  was  to  entertain  the  whole  group  with  a show 
of  skits,  songs,  and  dances  demonstrating  their  national  heri- 
tage. Sightseeing  in  Cincinnati  would  be  limited  so  that  the 
time  these  children  could  intermingle  at  the  camp  setting  would 
be  maximized. 

The  chaperones,  or  adult  delegates,  camped  at  a 
separate,  but  nearby  site.  Allen  thought  this  would  be  best 
in  that  their  lingering  prejudices  and  war  time  memories  would 
be  kept  somewhat  at  a distance  from  the  children.  In  retro- 
spect, her  decision  was  wise.  In  a 1994  interview  with  Dr. 
Allen,  she  noted  that  the  children  on  their  own  were  able  to 
surmount  their  cultural  differences  much  more  easily  than 
the  adults. 

The  research  component  was  to  be  led  by  Dr.  Allen 
herself,  who  worked  with  a team  of  eleven  social  scientists. 
There  was  also  one  resident  psychologist  at  the  camp. 

The  fourth  and  final  component  was  publicity,  whicn 
reflected  the  hopes  of  the  founders  of  CISV  that  there  would 
be  future  summer  villages,  based  on  this  CISV  model.  Conse- 
quently, Look  magazine,  the  Voice  of  America,  and  the  U.  S. 
State  Department  were  ail  permitted  to  generate  news  items 
about  CISV 

On  June  3,  1951,  the  children  arrived  and  the  first 
CISV  summer  village  was  officially  opened  at  a church  camp 
in  suburban  Cincinnati.  Dr.  Allen’s  idea  had  become  a reality. 
All  the  pieces  were  in  place  for  her  to  test  the  effectiveness 
of  her  experiment  in  peace  education  and  global  understand- 
ing. 


1.  These  figures  arc  taken  from  the  1993  Annual  Report  of  the 
Children's  International  Summer  Villages.  Inc.  (United  Slates  Asso- 
ciation). 

2.  Technically.  CISV  offically  labeled  their  summer  camps  as  vil- 
lages. In  this  paper,  both  terms  are  used  interchangeably. 

3.  By  early  1951,  Allen  had  recruited  the  active  support  of  Cincin- 
nati council  member.  Potter  Stewart,  later  to  he  Justice  Stewart  of 
the  U.  S.  Supreme  Court.  Outside  of  Cincinnati,  she  had  also  en- 
listed the  support  of  the  late  Senator  Margaret  Chase,  who  repre- 
sented Allen's  native  stale  of  Maine. 
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4.  In  addition  to  these  seven  European  countries,  there  were  also 
delegations  from  the  United  States  and  Mexico. 

5.  See  Ingvild's  Diary  by  Ingvild  Schartum-Hansen  for  the  war 
memories  of  a Norwegian  girl  delegate  as  she  described  the  German 
invasion  of  her  homeland. 
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Introduction  To  Another  Voice: 
Educational  Life-Writing  As  Responsible  Text 


Elizabeth  K.  Johnson,  Eastern  Michigan  University 
Lucy  F.  Townsend,  Northern  Illinois  University 

Abstract 

Good  educational  biography  serves  to  humanize  both  historical  actors  and  the  past  itself.  It  gives 
readers  a sense  of  real  people  involved  with  real  issues  in  a complex  world.  If  done  with  sensitivity  and 
skill,  educational  biograhy  provides  us  with  knowledge,  insight  and  understanding,  elements  that  are 
always  in  short  supply  (Beauchamp,  1980,  p.  4). 


Life-writing,  a broad  category  of  writings  which  in- 
cludes both  biography  and  autobiography,  is  an  immensely 
popular  genre  in  contemporary  North  America.  A survey  by 
the  Library  of  Congress  revealed  that  during  the  first  six 
months  of  1 990,  more  people  read  biographies  than  any  other 
kind  of  book.  Some  view  these  biographies  as  an  escape 
mechanism  from  the  tremendous  pressures  of  contemporary 
life  (Beauchamp,  1980,  p.  1).  Others  feel  that  biographical 
writings  can  fill  a void  in  their  readers’  lives-lives  void  of 
intrigue,  adventure,  and  excitement. 

Historically,  the  reading  of  novels  has  been  that  outlet 
for  many  of  its  readers.  According  to  James  Veninga,  "Biog- 
raphy has  taken  the  place  the  novel  used  to  fill.  Nineteenth 
century  novels. . .provided  readers  with  large  slices  of  life  in 
which  questions  of  character,  motivation,  morality,  social  pres- 
sure, and  internal  conflict  could  be  explored  in  great  depth." 
He  continues  by  saying,  "Most  modem  novels-all  bare 
bones  and  spare  parts-do  not  provide  that  kind  of  satisfac- 
tion. Modem  biographies  often  do"  ( 1 983,  p.37). 

Educational  life-writing  focuses  on  "theoretical  ideas 
about  the  nature  of  human  life  as  lived  to  bear  on  educational 
experience  as  lived"  (Connelly  & Clandinin,  1990,  p.  3).  It 
unites  the  experiences  of  life  and  education.  An  educational 
biographer  gathers  materials  such  as  letters,  journal  entries, 
diaries,  photographs,  tape-recordings,  and  interviews  to  con- 
struct the  life-story  of  a living  or  deceased  individual.  Edu- 
cational biography  has  taken  on  various  forms.  The  two 
most  notable  are  individual  biography  and  group  biography, 
the  latter  referred  to  as  multibiography.  Individual  biogra- 
phy is  a written  story  of  one  life;  multibiography  surveys  the 
"lives  of  two  or  more  persons  published  together  for  some 
definite  purpose"  (Winslow,  1978,  p.  69).  The  individuals 
featured  in  biographies  may  be  well-known  educationists 
such  as  John  Dewey  or  relatively  unknown  individuals  con- 
nected to  an  elite  institution  such  as  Harvard  University.  Or 
the  subjects,  meaning  the  persons  about  whom  a biography 
is  constructed,  may  be  non-elite  individuals  such  as  stu- 
dents. teachers,  principals,  schoolmasters  and  school  mis- 
tresses. or  even  homeschoolcrs. 


Educational  life-writing,  whatever  its  particular  char- 
acteristics, is  not  popular,  at  least  in  the  form  of  biographical 
essays  published  in  scholarly  journals.  Only  one  American 
journal  is  devoted  exclusively  to  life-writing.  Vitae 
Scholasticae  (VS),  the  organ  for  the  Internationa!  Society  for 
Educational  Biography.  VS  has  a circulation  of  less  than  100, 
an  indication  of  the  small  measure  of  interest  in  its  subject 
matter.  History  of  Education  Quarterly  (HEQ),  the  organ  for 
the  History  of  Education  Society  (United  States),  is  consid- 
ered the  undisputed  leader  in  the  field  of  educational  history. 
HEQ  published  only  five  biographical  articles  and  a small 
number  of  biographical  reviews  between  1977  and  1987 
(Beauchamp,  1980).  A content  analysis  of  the  first  twelve 
volumes  of  the  interdisciplinary  journal  Biography,  revealed 
only  eight  educational  biographical  studies,  a figure  repre- 
senting less  than  four  percent  of  the  total  (Beauchamp,  1 980). 
Many  of  these  articles  feature  techniques  and  strategies  for 
constructing  biographies.  Actual  educational  life-writings 
were  the  exception  rather  than  the  rule. 

Given  the  apparent  lack  of  interest  in  educational  biog- 
raphy in  the  United  States,  American  educational  historians 
might  be  interested  to  learn  that  of  the  first  thirty-three  ar- 
ticles published  in  Historical  Studies  in  Education/Revue 
D'Historie  De  L'Education  (HSE),  the  organ  of  Canadian 
History  of  Education  Association,  thirty-nine  percent,  or  thir- 
teen articles,  fall  under  the  rubric  of  life-writing. 

Furthermore,  narrative  inquiry  is  increasingly  selected 
as  the  methodology  of  choice  by  researchers  across  many 
disciplines.  The  word  “narrative"  means  a narration,  or  ac- 
tual description  of  chronological  events  and  experiences. 
Narrative  researchers  use  personal  narratives  to  construct 
biographies  and  other  texts.  For  the  most  part,  narrative 
implies  a story  of  a person's  life  as  told  to  someone  else.  If 
the  term  narrative  appears  in  a book  title,  such  as  A Narra- 
tive of  the  Life  of  Mrs.  Margaret  Douglas , it  implies  a written 
account  of  the  subject's  life  as  constructed  by  the  biogra- 
pher. Narrative  can  also  be  the  oral  or  written  source  mate- 
rial. or  text,  the  researcher  collects  and  uses  to  answer  a re- 
search question.  For  example,  in  order  to  study  the  drop-nut 
problem,  a researcher  collects  personal  narratives  of  girls 
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who  have  left  high  school  prior  to  graduation.  In  other  words, 
narrative  can  reflect  ( 1 ) the  historical  life  text  as  constructed 
by  the  biographer,  and  (2)  the  collected  data,  or  text,  the 
researcher  uses  to  study  some  aspect  of  people's  lives. 

The  study  of  narrative,  called  narratology,  is  a "study 
of  the  ways  humans  experience  the  world."  According  to 
Connelly  and  Clandinin,  narratologists  view  education  as 
"the  construction  and  reconstruction  of  personal  and  social 
stories;  teachers  and  learners  are  storytellers  and  characters 
in  their  own  and  other's  stories"  (1990  p.  3).  Narratologists 
are  found  in  many  disciplines-psychology,  philosophy,  his- 
tory, anthropology,  and  education;  they  write  biographies, 
case  studies,  and  life  histories.  Narrative  inquiry,  which  also 
falls  under  the  rubric  of  life-writing,  stresses  to  restore  "hu- 
man agency  and  human  relationships."  It  further  focuses  on 
the  "motives,  qualities  of  intellect,  or  creative  sensibilities 
which  the  architects  of  education  [have]  brought  to  their 
task"  (Finkelstein,  1990.  p.  6). 

Many  researchers  have  viewed  life-writing  in  one  of 
two  ways.  Some  regard  it  as  "just"  interesting  stories  with 
the  possibility  of  some  literary  value.  Yet,  due  to  observer 
and  narrator  bias,  these  interesting  data  can  yield  no  real 
generalizations  or  principles  and  thus  have  little  value.  A 
second  viewpoint  is  that  these  data  "might"  have  some  sci- 
entific merit  if  analyzed  in  an  "objective"  manner.  According 
to  Gordon  Allport,  an  early  pioneer  in  biographical  research, 
data  can  be  objectified  by  following  two  procedures:  by  mini- 
mizing "observable  bias"  or  by  using  the  data  to  illuminate 
general  concepts  or  principles.  Allport  felt  that  minimizing 
observer  bias  would  promote  validity  and  reliability  and  that 
data  could  then  yield  patterns  resulting  in  generalizations 
and  principles  (Freeman  & Krantz,  1 980,  p.  3). 

Allport  distinguished  between  using  life-writings  to 
analyze  the  person  who  had  constructed  them  and  using 
such  documents  to  "discover  generalizations  about  human 
personality"  (Garraty,  1 98 1 , p.  284).  In  the  1 930's  he  set  out  to 
standardize  biographical  techniques  and  eventually  produced 
mles  to  evaluate  life- writings.  However,  he  soon  realized 
that  these  rules  were  inappropriate  and  ineffective.  He  con- 
cluded that  "biographies  could  not  be  reduced  to  formulas 
of  any  kind"  (p.  284).  This  conclusion  is  the  same  as  that 
reached  by  narratologists  Connelly  and  Clandinin  who  be- 
lieve that  the  criteria  of  validity,  reliability,  and  generalizability 
are  not  appropriate  for  life-writing.  Currently  narrative  re- 
searchers are  developing  their  own  research  standards  for 
each  research  project,  which  they  justify  as  part  of  their  meth- 
odology (Connelly  & Clandinin,  1 990). 

This  study  seeks  to  dispel  the  myth  that  biography 
and  history  are  two  separate  genres.  It  endeavors  to  release 
the  "straight-jacket"  definition  of  history,  that  is.  an  uncriti- 
cal definition  of  history  as  a genre  whose  principles  are  un- 
changing and  hound  by  tradition.  With  regard  to  this  pur- 
pose, we  raise  the  following  questions:  What  is  responsible 
text?  Is  educational  life- writing  a demonstration  of  respon- 
sible text?  Or,  is  it  theoretically  deficient  because  it  doesn't 


adhere  to  traditional  social  science  criteria  and  principles? 
And,  with  regard  to  educational  life-writing,  do  American 
and  Canadian  historians  of  education  differ  in  their  percep- 
tions of  "responsible  text"? 

In  order  to  answer  these  questions,  we  will  examine  the 
leading  American  and  Canadian  history  of  education  jour- 
nals to  determine:  ( 1 ) the  total  number  of  articles  published, 
(2)  the  percentage  of  educational  life-writings,  and  (3)  the 
apparent  criteria  for  selecting  publishable  articles.  One  ar- 
ticle from  each  journal  that  perhaps  best  represents  what  the 
journal  has  currently  published  in  the  life-writing  category 
will  be  examined.  The  analysis  will  be  augmented  by  com- 
ments of  the  editors  and  editorial  board  members.  Our  analy- 
sis might  help  us  ascertain  standards  by  which  educational 
life-writing  is  judged  as  "responsible  text”. 

History  of  Education  Quarterly 

The  History'  of  Education  Society  is  an  international 
scholarly  society.  Its  purposes  are  to  encourage  and 
facilitate  research  in  the  history  of  education;  to  en- 
courage cooperation  among  specialists  in  history  of 
education;  and  to  promote  an  appreciation  of  the  value 
of  historical  perspective  in  the  making  of  educational 
policy  {History'  of  Education  Quarterly , Winter,  1994). 

History'  of  Education  Quarterly , {HEQ),  established  in 
1 949  by  the  History  of  Education  Society  (HES)  has  a circu- 
lation of  approximately  1,600.  Between  1985  and  Winter  1994, 
HEQ , published  130  articles.  Twenty  articles,  or  15%,  are 
classified  as  educational  life-writing. 

Barbara  Finkelstein  says  that  the  dearth  of  biographi- 
cal articles  in  HEQ  points  to  the  fact  that  American  histori- 
ans have  ignored  relationships  among  people.  Furthermore. 
"...  historians  have  implicitly  defined  human  motivation,  ac- 
tion. achievement,  and  sensibility  as  utterly  derivative-the 
product  of  economic  desire,  greed,  political  cunning,  status 
anxiety,  and/or  philosophical  and  ideological  commitments" 
(Finkelstein,  1990,  p.6). 

Finkelstein’s  assertions  were  supported  by  a recent 
past  editor  of  HEQ . Professor  William  J.  Reese,  who  stated 
that  most  of  the  leading  educational  historians  in  the  United 
States  arc  not  writing  biographies.  Reese  explained  that  he 
and  many  of  his  colleagues  were  trained  to  be  social  histori- 
ans who  are  more  interested  in  groups  of  people  and  large 
movements  in  education  than  in  individual  lives  (Reese,  1 990). 
All  of  HEQ  life-writings  can  be  grouped  into  two  categories, 
principle-case  studies  and  collective  biographies.  A principle- 
case  study,  the  more  popular  construction,  is  an  essay  that 
features  a general  historical  principle  which  is  used  to  ex- 
plain an  important  aspect  of  an  educational  movement  or 
institution.  The  principle,  repeated  several  times  throughout 
the  article  and  given  special  emphasis  in  the  conclusion,  is 
supported  and  illustrated  by  an  historical  case  study,  one 
clement  of  which  is  a description  of  an  educational  leader. 
All  details  about  the  leader's  personality  ami  life  story  arc 
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excluded  except  those  related  to  the  principle.  Most  leaders 
in  the  case  studies  are  well  known  (e.g.,  Adam  Smith,  Horace 
Mann,  Joseph  Lancaster)  and  the  institutions  are  usually 
elite  (e.g.,  Barnard  and  Amherst  colleges,  the  Camegies  cor- 
poration, University  of  Chicago). 

"A  Gamble  of  Youth:  Robert  M.  Hutchins,  the  Univer- 
sity of  Chicago  and  the  Politics  of  Presidential  Selection,"  by 
Benjamin  McArthur,  is  an  excellent  principle-case  study 
(McArthur,  1990,  pp.  161-168).  McArthur  begins  by  stating 
a principle  that  might  be  applied  to  a host  of  instructions  of 
higher  learning:  "As  bastions  of  tradition  and  instigators  of 
change,  universities  periodically  confront  the  tension  em- 
bedded in  those  two  antagonistic  roles."  He  goes  on  to 
explain  that  the  selection  of  a president  is  often  the  occasion 
when  the  conflict  between  these  two  roles  is  apparent. 
McArthur  next  defends  his  selection  of  the  particular  case 
study  which  he  plans  to  explore  in  the  article.  While  Robert 
Hutchins  was  president  of  the  university,  he  became  "a  voice 
of  educational  reform  and  made  his  college  the  focus  of  na- 
tional interest."  In  a few  deft  strokes  augmented  by  photo- 
graphs, Robert  Hutchins  is  portrayed  as  a young,  gifted  uni- 
versity administrator  with  considerable  potential  to  lead  the 
University  of  Chicago  to  even  greater  prominence;  but  nei- 
ther Hutchins’  personality  nor  his  educational  philosophy  is 
fully  revealed.  Instead,  McArthur  focuses  on  the  power 
struggle  among  the  members  of  the  search  committee.  Their 
actions  and  personalities  spring  to  life  through  the  use  of 
insightful  analysis  and  provocative  quotations. 

A striking  feature  of  the  article  is  its  strong  argument 
that  the  study  is  worthy  of  the  reader's  attention.  In  addition 
to  the  reason  cited  above,  McArthur  states  that  the  story  of 
the  selection  of  Hutchins  is  fascinating,  it  reveals  the  univer- 
sity "at  an  important  juncture  in  its  history,"  and  it  reveals 
how  administrators  at  the  University  of  Chicago  would  con- 
tinue to  make  selections  for  presidents  for  the  next  sixty  years. 
Without  stating  so  explicitly,  he  also  challenges  historians  of 
American  higher  education  who  have  generally  overlooked 
the  political  process  of  selecting  a university  president.  He 
also  cites  from  an  impressive  collection  of  personal  and  insti- 
tutional documents  in  his  reconstruction  of  the  process  of 
selecting  Hutchins;  and  in  so  doing,  he  illuminates  the  ten- 
sion between  tradition  and  innovation  which,  he  asserts,  is 
central  to  the  functioning  of  a major  American  university. 

In  an  interview.  Professor  Jeffrey  Mirel.  editorial  board 
member  of  HEQ,  explained  why  McArthur's  explicit  and  im- 
plicit arguments  for  the  importance  of  his  study  arc  essential: 

Some  authors  seem  to  assume  that  if  they  arc  inter- 
ested in  a topic,  then  surely  it  is  important.  These 
authors  need  to  convince  me  that  the  topic  is  impor- 
tant, but  also  that  their  topic  connects  to  something 
larger,  such  as  progressivism  in  New  York  or  progres- 
sivism  in  general.  The  article  should  enlarge  our  un- 
derstanding of  a movement  in  education"  (Mirel. 
1991). 


The  life,  personality,  and  educational  philosophy  of 
Robert  Hutchins  are  not  particularly  significant  to  Mirel  nor, 
perhaps,  to  the  larger  community  of  scholars  he  represents. 
What  is  more  important  is  Hutchins'  connection  to  major 
institutions  of  higher  learning  in  the  early  twentieth  century'. 
According  to  Mirel.  that  connection  must  be  stated  explicitly 
and  supported  with  solid  evidence.  Even  if  he  is  unconvinced 
by  the  historian’s  argument,  Mirel  says,  he  still  accepts  ar- 
ticles that  present  an  interesting  strong  argument  and  are 
well  researched  (Mire.  1991). 

Historical  Studies  in  Education/Revue  D’ Historic 
DeL’ Education 

HSE/RHE . the  organ  of  Canadian  History  of  Educa- 
tion Association,  was  founded  at  a conference  hosted  by 
the  University  of  Calgary  in  1 988.  It  now  has  a circulation  of 
220  (around  10 % are  U.S.  subscribers).  It  is  bilingual  so  as  to 
appeal  to  both  English-speaking  and  Francophone  scholars. 

Between  1989  and  1994,  HSE/RHE  published  70  ar- 
ticles, 28  (or  40%)  of  which  were  life- writings.  These  articles 
can  be  grouped  into  three  categories:  methodological  es- 
says, individual  life  stories,  and  collective  biographies.  Col- 
lective biographies,  the  most  prevalent  type,  usually  explore 
some  portion  of  the  lives  of  a group  of  people,  all  of  whom 
share  a common  identity  or  experience,  e.g.,  lay  schoolmas- 
ters of  New  France,  teachers  in  late  1 9th  century  British  Co- 
lumbia. women  students  at  Queens.  Typically,  the  HSE/RHE 
life-writer  traces  the  impact  of  factors  such  as  gender,  social 
class  and  ethnicity  on  the  individuals'  life-choices  as  well  as 
the  larger  social  and  historical  context  in  which  they  lived. 
The  author  concludes  by  making  one  or  more  generaliza- 
tions about  the  group's  choices  and  social  conditions. 

Rosemary  Gagan’s  "More  than  'A  Lure  to  the  Gilded 
Bower  of  Matrimony':  The  Education  of  Methodist  Women 
Missionaries,  1881-1 925"  ( 1 989),  is  an  exceptionally  well-writ- 
ten collective  biography.  Gagan  explores  the  educational 
backgrounds  of  300  Canadian  women  engaged  by  the 
Women’s  Missionary  Society  (WMS)  of  the  Methodist 
Church  of  Canada  between  1881  and  1925. 

Like  the  biographers  published  in  HSE/RHE , Gagan 
devotes  some  attention  to  defending  the  selection  of  her 
topic.  WMS  missionary  work  was  a "unique  career  opportu- 
nity" for  educated,  single  middle-class  women,  she  explains, 
especially  since  most  female  wage-earners  in  that  era  were 
from  the  working  class.  She  argues  further  that  in  view  of  the 
limited  options  available  to  women  (domesticity  or  a secular 
professional  career),  missionary  work  was  "an  attractive,  re- 
spectable, and  exciting  alternative."  Most  interestingly,  she 
explains  that  missionary  work  had  a hierarchical  structure. 
The  best  qualified  women  went  to  the  more  visible  foreign 
fields,  particularly  Japan,  whereas  the  least  accomplished 
labored  with  naive  Americans  and  immigrants  at  home.  These 
disparities  help  to  explain  why  some  missionaries  had  lengthy 
careers  whereas  others  dropped  out  quickly. 
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Gagan  is  particularly  adept  at  placing  the  women  in 
their  social  and  historical  context.  For  example,  she  briefly 
but  clearly  describes  a wide  variety  of  schools  attended  by 
the  missionaries:  elementary  schools,  high  schools,  ladies’ 
colleges,  normal  schools,  universities,  Bible  institutes,  medi- 
cal schools,  nurses'  training  schools,  and  business  colleges. 
She  devotes  a good  deal  of  attention  to  the  institution  estab- 
lished especially  to  train  female  religious  workers,  the  Na- 
tional Methodist  Training  School  in  Toronto.  In  this  way, 
she  provides  an  excellent  overview  of  the  schools  open  to 
Canadian  women  of  that  era. 

Gagan  concludes  by  tracing  the  field  failures  and  suc- 
cesses of  the  missionaries,  such  as  their  inability  to  learn 
Japanese  or  to  cope  with  adversity.  However,  she  reports 
that  university  graduates  in  Japan  had  longer  careers  than 
those  with  less  schooling.  "The  pattern  is  repeated  for  West 
China  and  for  home  missions,  suggesting  that  WMS  univer- 
sity graduates  were,  in  fact,  more  committed  to  the  goal  of  a 
professional  career  as  a single  women  than  their  less  edu- 
cated colleagues.”  Here  is  a fascinating  portrait  of  a little 
studied  female  profession. 

While  an  excellent  essay,  Gagan’s  collective  biogra- 
phy should  not  serve  as  a template  for  articles  likely  to  be 
accepted  by  HSE/RHE  editors.  Unlike  HEQ , the  Canadian 
journal  has  no  one  article  that  could  serve  as  a representa- 
tive sample.  This  is  because  the  articles  vary  widely  both  in 
style  and  content.  They  do,  however,  share  some  common 
attributes. 

First,  many  explore  the  experiences  of  non-elite  indi- 
viduals such  as  students  and  teachers.  These  non-elite 
voices,  many  being  relatively  powerless  and  unremembered, 
have  been  selectively  omitted  from  much  historical  discourse. 
E.H.  Carr  remarks  that  selecting  the  facts  of  history  is  "like 
fish  swimming  about  in  a vast  and  sometimes  inaccessible 
ocean,  and  what  the  historian  catches  will  depend,  partly  on 
chance,  but  mainly  on  what  part  of  the  ocean  he  chooses  to 
fish  in  and  what  tackle  he  chooses  to  use-these  two  factors 
being,  of  course,  determined  by  the  kind  of  fish  he  wants  to 
catch"  ( 1 964,  p.  23).  Articles  on  elite  and  famous  educators 
are  the  exception  in  HSE/RHE. 

Second,  a large  number  of  published  articles  focus  on 
issues  of  gender  and  power.  Women  are  the  subjects  of  most 
of  the  collective  biographies,  but  men  are  not  ignored;  on  the 
contrary,  the  life  experiences  of  both  genders  are  usually 
compared  and  contrasted.  Winifred  Millar,  co-editor,  was 
asked  why  women's  history  was  a prominent  feature  of  the 
journal.  She  explained  that  a grant  from  the  Social  Sciences 
and  Humanities  Research  Council  of  Canada  had  resulted  in 
the  publication  of  papers  presented  at  the  1988  meeting  of 
the  Canadian  History  of  Education  Association  and  that  the 
theme  for  the  conference  was  "Aspects  of  Class  and  Gender 
in  Education."  She  further  explained  that  gender  is  an  area  of 
scholarship  that  has  been  previously  neglected  but  is  now 
of  much  interest  among  Canadian  historians  (Millar,  1991). 


According  to  Johanna  Selles-Roney,  the  call  to  include 
"ethnicity,  class,  and  gender  has  often  left  religion  behind" 

( 1 99 1 , p.  1 0 1 ).  Not  so  with  Canadian  historians  of  education- 
-they  are  exploring  the  frequently  ignored  topic  of  religious 
education.  Four  of  the  ten  articles  in  the  1994  "Special  Is- 
sue," referred  to  earlier  in  this  paper,  focussed  on  religious 
influences.  "Educating  for  Temperance:  The  Woman’s  Chris- 
tian Temperance  Union  [WCTU]  and  Ontario  Children,  1 880- 
1916"  (Cook,  1993)  is  atypical  example.  This  article  gives  a 
brief  historiography  of  the  WCTU  and  the  program  of  tem- 
perance education  in  Protestant  Sunday  schools.  It  further 
elaborates  the  pedagogy  rooted  in  evangelical  convictions. 
Such  articles  place  HSE/RHE  on  the  cuting  edge. 

The  Canadians'  commitment  to  the  development  of 
young  scholars  contributes  to  its  diversity.  The  editors  of 
HSE/RHE  encourage  graduate  students  to  submit  articles 
for  publication.  The  publication  of  such  articles  is  one  of  the 
policies  of  this  journal.  Rebecca  Coultor,  a co-editor,  ex- 
plained that  the  policy  was  formulated  in  older  to  foster  the 
development  of  the  next  generation  of  Canadian  scholars. 
Editors  sometimes  request  one  or  more  revisions  before  the 
students'  manuscripts  are  sent  out  for  blind  review.  Coulter 
stated  that  graduate  students  often  need  such  mentoring  in 
order  to  become  productive  scholars  (Coulter,  1991). 

It  is  evident  when  examining  the  diversity  in  style  and 
content  of  published  articles  that  Canadians  are  committed 
to  nurturing  new  perspectives  and  are  encouraging  diversi- 
fied formats.  There  is  no  "one  size  fits  all." 

The  Evidence  of  Responsible  Text  In  Educational  Life- 
Writing 

Oral  history  has  enjoyed  a small  but  legitimate  niche  in 
Academe,  but  still  it  is  often  ignored  by  many  academic  his- 
torians or  discounted  along  with  "local"  or  "amateur”  histo- 
ries as  being  not  sufficiently  objective  or  analytic.  The  aca- 
demic tradition,  in  history  at  least,  has  always  set  great  store 
by  objectivity.  The  subject  may  add  color  but  corroborating 
evidence  has  always  been  demanded  before  any  "serious" 
analysis  can  be  made.  Besides  this,  traditional  academic  au- 
thors have  deliberately  placed  themselves  between  their  sub- 
jects and  the  data  in  the  interest  of  further  ensuring  the  ob- 
jectivity of  the  final  product  (Weiss,  1994,  p.  193). 

Educational  life-writing  is  preferred  and  legitimated  by 
a few.  ignored  and  bastardized  by  many--bastardiz.cd  in  that 
life-writing  is  believed  to  debase  or  lower  the  character,  qual- 
ity, and  value  of  historical  scholarship.  Traditional  academic 
prowess,  as  Gillian  Weiss  states,  lies  in  the  researchers'  abil- 
ity to  distance  themselves  from  the  subject.  The  desired 
outcome  is  bias-free  data  that  yield  a set  of  generalizations 
and  principles  that  further  explain  a broad  movement  of  edu- 
cation. Many  academic  historians  view  this  process  and  the 
resulting  product  as  "responsible  texl."  They  believe  that 
before  any  life- writing  essay  or  article  lor  submission  can  be 
taken  seriously,  it  must  meet  a predetermined  standard,  that 
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is.  a set  of  rigid  criteria  designed  to  reject  any  amateur  at- 
tempt at  reconstructing  history.  In  this  case,  the  term  "ama- 
teur" usually  means  an  attempt  at  reporting  personal  experi- 
ences, whether  factual  or  perceived,  with  little  concern  for 
norms  or  standardization. 

History  of  Education  Quarterly  has  the  mindset  de- 
scribed above.  In  keeping  with  the  scholarly  tradition,  the 
History  of  Education  Society  as  represented  by  its  publica- 
tion, HEQ , has  defined  and  constructed  history  that  incor- 
porates human  relationships  as  byproducts-derivatives  from 
the  larger  society  at  work.  Although  the  editors  have  not 
totally  neglected  the  inclusion  of  non-elites,  a multitude  of 
voices  (both  elite  and  non-elite)  are  silenced.  Advocates  of 
this  approach  view  life-writing  only  as  a springboard  toward 
understanding  the  larger  society  or  movements  in  educa- 
tion. They  selectively  abandoned  the  principle  of  intention- 
ality,  that  is,  "that  there  is  inseparable  connectedness  of  the 
human  being  to  the  world”  (Van  Manen,  1993,  p.  181).  This 
abandonment  of  the  nature  and  importance  of  lived  experi- 
ence supports  objectivity.  It  also  defines  history  as  genre 
bound  by  a rigidity  of  style  and  format.  It  places  a wedge 
between  history  and  biography  defining  both  as  separate 
and  somewhat  adversarial  genres. 

As  stated  earlier  in  this  study,  the  life-writing  articles 
in  HEQ , which  amount  to  only  15%,  fall  into  two  distinct 
categories:  principle-case  studies  and  collective  biographies. 
There  appears  to  be  little,  if  any,  room  for  creative  examina- 
tions of  human  subjectivities  and  connections.  Why  is  this 
the  case?  Admittedly,  the  editors  have  confessed  that  they 
are  trained  social  historians  who  center  their  interests  on 
groups  and  large  movements  rather  than  on  the  personalities 
and  relationships  of  individuals.  Their  professed  standards 
for  selection  of  articles  is  in  keeping  with  their  social  training 
and  within  the  boundaries  of  what  they  believe  is  acceptable 
to  the  historical  community. 

The  resulting  journal  is  bland  and  repetitive,  lacking 
vitality,  intimacy,  and  sensitivity.  To  place  distance  between 
oneself  and  one's  subjects  results  in  texts  that  are  often  stale 
and  lifeless.  Yet.  in  the  editor’s  eyes,  these  texts  reflect  valid- 
ity and  reliability.  Their  perceived  evidence  of  "responsible 
text"  is  rooted  in  the  ideology  of  objectification. 

Historical  Studies  in  Education/Revue  D'Historie  De 
L' Education  allows  for  fresh  voices  and  new  approaches. 
The  questions  that  we  would  propose  arc;  What  can  we,  as 
American  historians,  learn  from  our  Canadian  neighbors? 
What  is  their  conception  of  life-writing  as  responsible  text? 

It  appears,  from  our  content  analysis,  that  HSE/RHE 
places  much  faith  in  non-elite  voices.  These  voices  are  both 
authors  of  articles  and  the  individuals  they  write  about.  The 
fact  that  the  editors  have  designed  a policy  to  mentor  gradu- 
ate students  towards  becoming  the  new  Canadian  scholars 
is  evidence  of  their  commitment  to  new  voices.  The  1 act  that 
40%  of  the  total  articles  are  life-writings  about  relatively  un- 


known individuals,  such  as  students  and  teachers  of  inaus- 
picious institutions,  shows  that  editors  are  affording  power 
to  those  once  historically  silenced  voices.  Both  non-elite 
and  elite  voices  are  not  bound  by  traditional  ideologies  that 
prevents  us  from  learning  and  experiencing  the  soft,  sensi- 
tive surfaces  of  lived  experience.  Rather,  lived  experience  is 
transformed  in  the  breadth  and  depth  of  authentic  meaning. 
Lived  experiences  can  be  likened  to  "motifs  in  the  andante  of 
a symphony,"  (Van  Manen,  1934,  p.  37).  Therefore,  biogra- 
phy and  history  are  united  as  one  genre,  or  one  experiential 
life  symphony. 

Second,  HSE/RHE  is  not  bound  by  traditional  western 
academic  traditions.  This  holds  true  with  respect  to  method- 
ology and  perception  of  scholarly  rigor.  Both  methodologi- 
cal positions,  the  objective  and  subjective,  are  celebrated 
and  encouraged.  One  is  not  seen  as  more  valid  than  the 
other.  Both  are  needed-both  are  vital  to  the  concept  of  "re- 
sponsible text."  The  acceptance  of  data  that  do  not  seek  to 
generate  principles  and  generalization  but  seek  to  celebrate 
each  individual  life,  is  refreshing  as  well  as  pluralistic  (Weiss, 
1994). 

In  closing,  "responsible  text,"  and  the  evidence  that 
supports  it,  are  found  in  the  Canadian  journal.  "The  histo- 
ries of  women,  working  and  middle  classes,  literacy,  children 
and  youth,  families,  among  others  contradict"  the  claim  that 
the  history  of  education  thus  far  has  failed  to  achieve  the 
promise  of  the  "new"  or  revisionist  histories.  "New  ap- 
proaches to  gender,  generation,  family;  ethnicity,  race,  class, 
culture,  the  state,  politics,  hierarchy,  order,  authority  ; ideol- 
ogy, discourse,  rhetoric;  institutions,  teachers,  learners.,  of- 
fer unfulfilled  or  untapped  possibilities"  (Graff,  1991,  p.  205- 
206). 
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MEETING  REGISTRATION  FORM 

1995  MWERA  ANNUAL  MEETING  CHICAGO,  IL— OCTOBER  11-14,  1995 

AH  attendees,  including  program  presenters,  must  register  and  pay  applicable  fees.  Please  clearly  print  or  type  your 
name  as  you  wish  it  to  appear  on  your  meeting  badge.  Nonmembers  wishing  to  apply  for  membership  may  register  at 
the  member's  rate  if  membership  application  and  fee  is  enclosed  with  registration. 


Name 

Affiliation 

Address 

Citv/ST/ZIP 

Highest  Degree 

MWERA-Division  Preference 

Institution  AwardinQ  Degree 

Major  area  of  Specialization 

Telephone:  Bus. 

Hm. 

E-mail 

Fax 

Is  this  your  first  MWERA  Conference?  Yes  _ No 


Pre-Conference  Workshops  (see  following  pages  for  details) 

* Fee  for  these  workshops  is  separate  from  Registration  fee. 

W.1.ME  @$10  W.l.C  @$10  W.1.E  @ $5  W.1.L  @$10 

W.1.B  @$10  W.1.D  @ $5  W.1.F  @$10 


TOTAL  for  Pre-Conference  Workshops  $_ 

Meeting  Registration  Postmarked  by  Sept  25  After  Sept  25 


MWERA  Member  @ $45  $55  $_ 

Nonmember*  @ $50  $60  $_ 

Student  Member  (must  enclose  proof  of  current  status)  @ $30  $35  $_ 

Attending  Luncheon  ONLY  @ $23  $25  $_ 

• The  Friday  luncheon  is  included  in  the  registration  fee.  Will  you  be  present  at  the  luncheon?: Yes  No 

Membership  Dues 

1995  Membership  dues  (required  for  all  participants/registration  discount  rate)  must  be  paid  by  Sept.  25,  1995. 

- Regular  $18,  Student  $10 $, 

1996  Membership  dues  - Regular  $18,  Student  $10 $_ 

Life  Membership  -$180 $ 


Conference  Workshops:  fee  will  be  waived  if  meeting  registration  is  paid  in  full 

T.1150.F  @ $5  T.450.#505  @ $5  F.130.ME @$10 

T.1 150.Max @ $No  fee  T 1010J505 @$10  F.310.ME  @$10 

T.1010.E  @ $5  F.1010.F  @ $5  S.1010ME  @ $5 

* Non- members  attending  only  workshops  should  submit  workshop  fees  only.  TOTAL  for  Workshops  $ 


MWERA  Material  All  materials  must  be  picked  up  at  the  registration  desk  at  the  conference,  prices  do  not 

include  postage.  Payment  now  guarantees  that  we  will  try  to  have  materials  available  for  you. 


Indicate  quantities  below: 

MWEFRA  Membership  Directory  $7 $__ 

MWERA  95  Annual  Meeting  Abstracts  ( paper  $4)  ( IBM  $3) $ 

MWERA  Lape!  Pin  $3  each $’ 


TOTAL  AMOUNT  ENCLOSED  FOR  MEETING  $, 


When  registering  and/or  joining,  please  make  check(s)  payable  to  MWERA,  and  mail  with  completed 
form(s)  by-$e£t£5  to:  Jean  Pierce,  Northern  Illinois  Univ.,  Dept  EPCSE,  DeKalb  IL  60115 


MWERA  1995  PROGRAM 


SOfi 


Have  You  Made  Your  Reservations  Yet? 

Overview  of  the  1995  MWERA  Annual  Meeting 

by  Sharon  L.  McNeely,  Northeastern  Illinois  University 
Program  Chair 

Chicago  has  been  the  home  to  MWERA  for  so  long,  it  is  difficult  for  most  of  our  members  to  remem- 
ber a time  when  we  haven’t  been  in  Chicago,  or  at  the  Bismarck  Hotel.  When  you  walk  into  the  Bismarck,  you 
may  remember  the  old,  but  you  will  find  some  changes  the  new  management  has  made  in  the  lobby,  the  rooms 
(those  single  beds  are  gone),  and  the  services  (easier  check-in.  voice  mail , etc.).  What  you  may  not  notice, 
unless  you  look  closely  at  the  program,  is  that  we  also  underwent  some  remodeling. 

Our  remodeling  started  with  moving  the  registration  deadline  ahead  (September  25)  to  match  the 
Bismarck’s.  While  this  may  seem  minor  to  our  newer  members,  there  are  indications  that  some  of  our  longer- 
term  members  may  not  notice  changes  (e.g.  the  30+  people  who  tried  to  send  their  proposals  in  late,  using  the 
deadline  that  had  been  in  place  for  prior  years.  Standard  letter:  ...I  just  assumed  it  was  the  same,  I never 
checked...)  So,  if  you  haven't  registered,  do  it  now.  and  then  finish  reading  this! 

One  of  the  other  changes  in  our  program  is  to  integrate  professional  development  into  more  of  our 
annual  meeting.  My  hope  is  to  build  our  membership,  share  in  more  depth  some  of  the  important  work  of  some 
of  our  members,  and  try  to  bring  our  finances  into  better  shape.  This  year  we  designed  the  workshops  to  run 
in  various  patterns  of  pre-and  during-conference,  and  to  appeal  to  our  membership,  teachers,  administrators, 
various  educational  graduate  students,  etc.  I hope  you  will  encourage  educators  you  know  to  attend  the 
workshops. 

Unchanged  is  our  integration  of  our  student  members’  participation.  You'll  find  their  papers  through- 
out. As  in  some  recent  years,  students  are  not  identified  as  such  in  the  program.  The  idea  is  to  integrate  them, 
not  segregate  them! 

I know  “the  crisis”  in  education  is  old  these  days,  but  I am  hoping  that  the  focus  taken  by  Drs.  David 
Berliner  and  Gerald  Bracey  will  put  a new  twist  on  the  old  arguments.  Dr.  Berliner  is  joining  us  Wednesday 
night,  October  1 1 . for  an  open  forum  on  the  crisis  (8  p.m.).  Joining  him  on  the  debate  will  be  Barbara  McCombs 
and  Gregory  Marchant.  As  in  previous  years,  this  is  open  to  the  public.  On  Thursday  morning  Dr.  Berliner  will 
provide  our  opening  keynote  and  focus  the  crisis  back  to  some  of  the  challenges  we  face  in  doing  educational 
research.  This  will  be  followed  by  a day  of  at  least  80  different  presentations,  including  invited  addresses  by 
Barbara  McCombs  and  Ken  Kiewra. 

The  Friday  luncheon  promises  to  be  jam-packed  (no  pun  intended,  I didn't  order  jam  for  the  lunch). 
Of  course,  there  will  be  the  usual  brief  gracious  ceremonies  and  eats,  and  then  Dr.  Bracey  will  talk  about  the 
misrepresentation  of  test  data  in  “hyping”  the  crisis  in  education,  and  some  of  the  long-term  ramifications  to  al  1 
of  us.  Dr.  Bracey,  like  Dr.  Berliner,  will  be  available  after  his  talk  to  meet  for  further  discussion  of  his  topic. 
Friday  also  includes  an  invited  address  by  Barbara  Shade,  and  another  60+  different  presentations. 

Friday  is  also  the  day  of  Exhibits.  I feel  a lot  of  personal  investment  here,  since  I have  worked  on 
developing  the  Exhibits  over  the  past  few  years.  I am  so  pleased  that  the  various  exhibitors  are  recognizing  our 
membership  as  important  authors,  contributors,  reviewers,  consumers,  etc.  There  are  more  exhibitors  than 
ever  before;  and  this  year,  some  of  the  publishers  have  also  agreed  to  sponsor  coffee  in  the  mornings,  etc.  Their 
donations  to  us  are  enormous,  so  please  stop  by  and  thank  them  for  being  here  even  if  you  don't  buy  some- 
thing! If  you  are  like  some  of  our  other  members,  you  may  want  to  bring  an  extra  suitcase  with  you  just  for 
taking  home  the  books  you  buy  at  the  meeting! 
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Saturday  morning  has  the  Presidential  address  by  Tom  Andre  (How  will  he  do  that  after  hosting  the 
President's  reception  Friday  night?),  an  invited  discussion  with  Paul  Pintrich,  and  another  20+  presentations. 
There  is  also  a session  for  feedback  about  this  confer  ;i  :e,  and  the  last  of  the  Divisional  meetings. 

From  the  time  Dr.  Berliner  opens  the  conference  until  we  close  sessions  Saturday  at  noon,  we  have 
such  a full  schedule  that  we  negotiated  more  time  and  more  rooms  with  the  hotel!  There  were  hundreds  of 
submissions  for  this  conference.  Every  Division,  with  the  exception  of  one,  had  to  reject  between  ! 0 and  45% 
of  their  proposals.  I hate  writing  rejection  letters  for  good  work.  So,  as  much  as  possible,  I carefully  consid- 
ered the  papers  Divisions  wanted  to  accept  and  didn't  have  room  for,  and  found  most  of  them  spots  by 
combining  presentations  across  Divisions,  or  allocating  to  other  formats  those  papers  which  seemed  like  they 
could  fit  that  way.  The  result  of  all  of  the  Division  co-chairs'  decisions  is  a program  of  over  160  different 
presentations  that  really  offers  variety  and  depth.  There  are  symposia  that  have  standard  educational  research, 
and  those  that  link  with  teachers,  students,  administrators.  There  are  invited  speakers  who  have  a session 
alongside  other  sessions  because  we  couldn't  give  them  our  undivided  attention  without  severely  cutting  the 
presentations.  There  are  papers,  posters,  roundtables  and  discussion  groups.  Keeping  one  session  per  Divi- 
sion per  time  slot  was  an  impossible  goal  for  some  of  the  bigger  Divisions.  So,  some  participants  will  have  to 
choose  carefully  among  sessions. 

I remember  my  first  years  as  a graduate  student  attending  MWERA.  I couldn’t  wait  for  sessions  to  end 
so  I could  go  shopping!  Members  returning  to  Chicago,  and  those  just  joining  us  might  be  thinking  the  same 
thing.  Yes,  there  are  stores  open  after  the  sessions  end  each  night.  I also  want  to  remind  you  that  you  are 
coming  to  an  urban  downtown.  Please  be  wise  and  stop  at  the  registration  desk  to  get  a local  map,  directions 
to  shopping,  restaurants,  etc.  Please  don't  carry  a lot  of  cash,  and  avoid  purses,  bulging  wallets,  and  the  like  if 
you  can  help  it.  When  you  are  in  the  hotel,  use  the  safe  deposit  boxes,  and  make  sure  you  chain  lock  and  bolt 
your  door.  I don't  mean  to  scare  you,  just  ask  that  you  be  aware.  I have  lived  here  long  enough  now,  I feel  I 
should  run  a training  course  on  “what  to  watch  out  for." 

Yes,  you  should  watch  out!  If  you  don't  plan  your  time  wisely,  and  look  carefully  at  your  program,  you 
are  probably  going  to  miss  some  fantastic  presentations.  I wish  we  could  audio  and  video  tape  a number  of  the 
sessions.  Unfortunately,  there  weren’t  enough  sales  of  tapes  last  year  to  offer  that  to  members  this  year.  So, 
arrange  with  colleagues  that  each  of  you  attends  a different  session.  If  you  bring  1 0 colleagues  you  should  be 
able  to  cover  everything  in  any  one  time  slot! 

As  in  previous  years,  we  are  counting  on  the  goodwill  of  our  membership  to  really  help  make  the 
annual  meeting  a great  meeting.  We  know  that  one  of  the  key  ways  we  build  membership  is  through  each 
member  bringing  a colleague  or  a student  to  the  meeting.  If  you  haven't  already  shared  the  information  about 
the  annual  meeting  with  someone,  now  is  the  time  to  do  so. 

I have  arranged  for  overhead  projectors.  I am  still  working  on  getting  help  for  moving,  set-up  and 
storage  of  them.  I am  hoping  you  will  help,  or  be  patient  with  those  who  are  helping.  I also  ask  that  everyone 
take  a moment  when  they  leave  a session  and  remember  that  another  session  is  starting  in  that  room  in  a couple 
of  minutes.  Please  help  put  chairs  back,  and  clean  up  the  room.  If  you  are  continuing  a discussion,  please  move 
to  the  Blackhawk  Room,  and  try  not  to  disrupt  the  other  sessions  that  are  beginning. 

I can't  say  enough  good  things  about  the  fantastic  work  that  the  Division  co-chairs,  and  all  the  other 
program  associates  have  done  and  arc  doing  for  this  meeting.  I don't  want  to  envision  my  job  if  any  of  them 
hadn't  done  theirs!  I am  hoping  you  will  enjoy  the  conference! 


40 


AfiiMVVurni  folut  tirioiitil  Rcuuitt  lift 


fino 


Volume  H.  Numbei  -1  • t all  l<WS 


~! 


From  the  #1  Publisher  in  Teacher 
Education,  a new  text  in 
Motivation 


from 


Paul  R.  Pintrich 


Dale  H.  Schunk 


t i rfAT  /~\  'E  t 


\SS8SSa&&'- 


1 


See  MOTIVATION  S EDUCATION  - 

as  VwA  te  our  ot^fidu&tfibi^ 
titles  at  the  MERRILL  EDUCATION  booth! 


Merrill,  An  Imprint  of  Prentice  Hall 


Nancy  L.  Zimphcr,  Dean 
College  of  Education 
The  Ohio  State  Univenity 
1945  N.  High  Street 
Columbus,  Ohio  43210 


Nonprofit  Org. 
U.S.  Postage 
PAD) 

Columbus,  Ohio 
Permit  No.  711 


ERIC/CRESS , p . 0 . # I Vi  o 
A PAEAGHIA  ED.  LAB 
J-UoJ.  UUARRIER  STRFFT 
CHARLESTON,  WV  25305 


dESI  COPY  AVAILABLE 


Q 1 n 


lO^fqCc 


Volume  9,  No  1 Winter  1996 


Midwestern  = 

Educational 

Researcher 

Official  Publication  of  the  Mid-Westem  Educational  Research  Aasociation  * 


D 

M 

JD 


>L  * 
S>  ■ 


The  Ohio  SUle  University,  Columbus,  Ohio 


Special  Sections:  The  Bell  Curve 

Invitation  for  Proposals 


J 


On  The  Cover 


The  College  of  Education  at  The  Ohio  State  University  is  widely  acknowledged  as  a preeminent  profes- 
sional school  of  education,  both  in  terms  of  the  quality  of  its  preparation  programs  for  entry-level  educators, 
education  leaders  and  the  education  professoriate,  and  as  an  accomplished  center  for  research  and  development 
initiatives.  Hence,  for  decades  it  has  received  the  highest  rankings  from  its  peers. 

In  1974,  Change  Magazine  reported  college  of  education  rankings,  placing  OSUs  college  in  the  top  five, 
following  only  Stanford  and  Harvard,  making  this  College  the  number  one  public  college  of  education  in  the 
country.  In  the  Forgan  (1989)  reputational  study  of  colleges  of  education,  OSUs  College  of  Education  ranked 
number  one,  tied  with  Michigan  State  University,  in  preparation  programs  for  teachers  and  other  practitioners, 
and  in  the  top  five  for  research  efforts  in  education  and  services  contributed  to  the  profession  and  the  commu- 
nity. In  one  of  the  most  comprehensive  rankings  studies  to  date,  conducted  by  West  and  Rhee  (1993),  and 
assessing  institutions  and  departments  on  multiple  variables,  OSUs  College  of  Education  ranked  third  in  the 
country  on  both  productivity  and  program  impact,  and  prestige.  Further,  across  seven  academic  areas,  it  was  in 
the  top  five  in  four  of  these  and  in  the  top  10  in  two  others. 
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Forging  “Connections”:  A Frames  Analysis  of  the 
Implementation  of  a Pilot  Interdisciplinary  Program 

Nina  G.  Dorsch,  Northern  Illinois  University 


Abstract 


The  current  wave  of  education  reform  is  characterized  by  initiatives  which  rely  on  the  ability  of  teach- 
ers to  collaborate  as  a collegial  community.  This  qualitative  case  study  examines  the  experience  of  one 
teaching  team  as  they  implemented  “ Connections , " an  inclusive,  interdisciplinary  pilot  program . The 
making  of  Connections  was  a process  of mutual  adaptation,  not  only  of  the  teachers  ’ former  individual 
practices  with  their  new  collective  practice,  but  also  of  the  larger  school  organization  and  the  emerg- 
ing Connections  organization.  Guided  by  Bolman  and  Deal  s theory  of  frames  analysis , this  study 
considers  how  the  Connections  teachers  created  and  sustained  a collegial  community. 


The  current  wave  of  education  reform  challenges  the 
traditional  patterns  of  school  organization.  Initiatives  such  as 
inclusion  and  interdisciplinary  curricula  rely  on  the  ability  of 
implementing  teachers  to  collaborate  as  a collegial  commu- 
nity. Models  for  reform  innovations  propose  creating  oppor- 
tunities for  interaction  among  educators.  While  such  arrange- 
ments foster  increased  teacher  interaction,  they  are  critiqued 
as  most  often  generating  only  a surface  collaboration  that 
Hargreaves  (1991)  labels  ‘'contrived  collegiality.”  Yet  such 
collaborative  structures  are  inherent  in  what  Little  (1990)  views 
as  one  of  two  fundamental  conditions  necessary  to  true  colle- 
giality: opportunity.  The  other  necessary  condition  for  colle- 
giality is  interdependence. 

Research  points  to  the  dynamic,  unpredictable  nature 
of  the  change  process  as  most  often  incremental,  fragmented, 
and  context-bound  (Odden,  1991;  Fullan,  1993).  In  most 
schools  and  districts,  many  partially  implemented  innovations 
and  pilot  programs  operate  at  any  given  time  (Joyce,  Wolf,  & 
Calhoun,  1 993 ).  Moreover,  within  the  local  context  of  change, 
multiple  and  sometimes  competing  or  conflicting  organiza- 
tional environments  exist  and  so  complicate  the  implementa- 
tion process  (Little  & McLaughlin,  1 993).  How  implementors 
resolve  such  competition  and  conflict  influences  the  outcome 
of  innovations. 

The  purpose  of  this  study  is  to  describe  the  experiences 
of  one  teaching  team  in  a school  in  southern  Ohio,  Cedar  City 
High  School,  as  they  implemented  a program  called  “Con- 
nections” during  the  1993-1994  school  year.1  Connections 
was  an  innovative  pilot  program  designed  to  encompass  the 
content  areas  of  English,  science  and  social  studies.  The  Con- 
nections program  derived  its  name  from  its  interdisciplinary 
goal  of  designing  instruction  so  that  students  would  come  to 
understand  the  interrelatedness,  or  connections,  among  the 
three  subject  areas.  A voluntary  program  option.  Connec- 
tions was  conceived  as  serving  eighty  students  in  a heteroge- 
neous ninth  grade  cohort,  including  students  identified  as  hav- 
ing learning  disabilities.  The  four  implementing  teachers  rep- 
resented each  of  the  tliree  content  areas  and  special  education. 
With  its  dimensions  of  interdisciplinary  study  and  inclusion. 
Connections  represented  the  type  of  curricular  innovation 


which  Ohio  (like  many  other  states)  encourages  as  part  of  its 
agenda  for  reform.  Like  many  other  schools  and  districts 
which  take  pride  in  the  quality  of  the  education  they  provide. 
Cedar  City  (for  both  political  and  practical  reasons)  under- 
took innovations  cautiously — Connections  would  be  imple- 
mented in  the  context  of  a school  which  retained  its  tradi- 
tional structures  and  culture.  The  dynamics  involved  in  the 
mutual  adaptation  of  competing  and/or  conflicting  organiza- 
tional environments  described  by  Little  and  McLaughlin 
(1993)  could  reasonably  be  expected  to  emerge  during  Con- 
nections’ initial  implementation. 

In  studying  the  Connections  program  throughout  its  ini- 
tial implementation  year,  significant  attention  was  given  to 
the  process  of  mutual  adaptation  that  attended  the  Connec- 
tions teachers’  experiences  in  implementing  a collaborative 
reform  within  an  otherwise  traditional  high  school.  While 
the  overarching  research  question  concerned  the  extent  to 
which  the  Connections  teachers  were  able  to  create  and  sus- 
tain a teaching  team  that  represented  the  collegial  community 
implicit  in  the  program,  this  study  also  considered  two  sub- 
sidiary questions: 

1.  How  did  the  Connections  teaching  team  at  Cedar 
City  High  School  organize  to  implement  the  Connections  pro- 
gram? 

2.  How  did  the  larger  Cedar  City  school  and  district 
organizations  influence  the  Connections  program’s  imple- 
mentation? 

Guided  by  these  questions,  a case  study  of  the  Connec- 
tions experience  might  well  add  to  an  understanding  of  the 
regularities  of  teaching  and  what  may  be  involved  in  trying 
to  change  them. 

Data  Collection  and  Analysis 

This  study  followed  a qualitative  case  study  research 
design  (Merriam,  1988),  employing  data  gathering  and  analy- 
sis techniques  characteristic  of  qualitative  research.  Data 
sources  include:  (1)  observations — of  the  teachers’  plan- 
ning and  training  sessions  prior  to  the  start  of  the  school  year, 
meetings  of  teachers  with  administrators,  parent  information 
meetings,  and  twicc-weckly  observations  of  both  the  teach- 
ers’ common  planning  period  and  the  three-period  Connec- 


1 To  respect  confidentiality,  “Cedar  City”  is  a pseudonym.  All  administrators,  teachers,  and  students  names  in  this  study  alio  have  been  given  pseudonyms. 
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tions  block  of  classes  throughout  the  year;  (2)  interviews — 
with  teachers  and  administrators;  and  (3)  documents — in- 
cluding internal  communications,  district  community  news- 
letters, and  relevant  local  newspaper  articles.  Because  the 
interviews  and  observations  were  conducted  over  an  extended 
period  of  time  (a  full  year),  the  teachers  were  quite  candid 
and  comprehensive  in  their  responses  and  unguarded  in  their 
actions  and  interactions.  Triangulation  among  these  data 
sources  as  well  as  the  reactions  of  the  teachers  and  principal 
to  working  drafts  also  contributed  to  the  trustworthiness  of 
the  data. 

The  extensive  field  notes,  observer’s  comments,  and 
interpretive  memos  within  this  data  set  suggested  that  Con- 
nections involved  multiple  relationships,  or  connections  — 
between  and  among  teachers,  students,  parents,  administra- 
tors, and  the  surrounding  organizational  systems.  Coding 
categories  (e.g.,  perspectives  held  by  subjects,  activity  codes, 
strategy  codes,  process  codes  2)  which  emerge  during  con- 
tent analysis  confirm  the  complexity  of  these  connections. 
Any  analysis  of  these  connections  would  require  a concep- 
tual framework  that  accounted  for  this  complexity.  Bolman 
and  Deal’s  (1991)  four  frames  of  organizational  analysis  — 
structural,  human  resources,  political,  and  symbolic  — of- 
fered such  a perspective. 

Bolman  and  Deal  posit  that  each  frame  affords  a per- 
spective that  might  shed  light  on  “a  different  slice  of  life”  (p. 
309)  within  the  Connections  experience.  In  presenting  this 
study’s  findings,  the  structural,  human  resources,  political, 
and  symbolic  dimensions  of  both  the  emerging  Connections 
organization  and  the  larger  school  and  district  organizations 
will  each  be  considered  in  turn.  However,  Bolman  and  Deal 
point  out,  “For  different  times  and  different  situations,  one 
perspective  may  be  more  important  than  others”  (p.  325). 
Therefore,  Connections’  context  — its  people  and  setting  — 
would  be  an  appropriate  starting  point  for  analysis. 

Connections1  Context 

Cedar  City  and  Its  Schools 

Located  within  commuting  distance  of  three  urban  ar- 
eas, Cedar  City  is  a postcard  prototype  of  small  towns  of  the 
American  heartland.  Cedar  City’s  location  and  Norman 
Rockwell-ian  atmosphere  have  contributed  to  the  population 
growth  and  economic  expansion  the  community  has  experi- 
enced beginning  in  the  1960s.  Cedar  City  Schools  mirror 
this  community  growth.  A sustained  pattern  of  growth  in 
student  enrollment  led  to  two  building  projects  as  well  as  to 
the  Board  of  Education’s  decision  to  seek  passage  of  an  op- 
erating levy  during  the  Connections  year. 

Cedar  City  Schools,  and  the  high  school  that  is  the  set- 
ting for  this  study,  mirror  not  only  the  city’s  growth,  but  its 
character  as  well.  Cedar  City  High  School  (CCHS)  exhibits 
a decor  common  to  most  high  schools.  But  distinctive  touches 
are  presented  as  well.  A grouping  of  four  chairs  upholstered 
in  a faded  shade  of  maroon,  one  of  the  school  colors,  is  ar- 
ranged to  create  a lobby  at  the  main  entrance.  Benches  have 
been  placed  at  intervals  along  the  central  corridor,  and  stu- 


dents often  cluster  there  before  school  or  between  classes.  It 
is  an  environment  that  is  comfortable  for  the  750  overwhelm- 
ingly white,  middle  class  students  and  their  44  teachers. 

Cedar  City  students  and  teachers  experienced  several 
changes  in  administrative  personnel  in  the  three  years  prior 
to  Connections’  implementation.  In  1990,  Martin  Young  as- 
sumed the  superintendency;  the  next  year  brought  Mike  Davis 
to  Cedar  City  as  the  Assistant  Superintendent  for  Curriculum 
and  Instruction;  and  1992  saw  several  changes  in  building 
leadership,  including  a new  high  school  principal,  George 
Cemy.  Under  this  new  leadership,  the  district  initiated  sev- 
eral changes.  One  of  the  changes  was  Connections. 

Initial  interest  in  developing  Connections  came  about 
through  a visit  Davis  and  Cemy  made  to  observe  a similar 
program  in  the  Columbus  area.  The  local  newspaper  quoted 
Cerny’s  description  of  the  event  that  would  lead  to 
Connection’s  adoption: 

We  were  so  impressed  that  we  sent  up  three  of  the 
schools'  department  heads  who,  afterwards,  turned  out 
to  be  equally  as  enthusiastic ...  At  this  point  it’s  just  a 
matter  of  presenting  the  benefits  of  the  class  to  the 
board,  selecting  the  teachers  to  teach  the  class,  and  dis- 
cussing it  with  parents.3 

Cemy ’s  forecast  was  accurate.  As  the  three  department 
heads  talked  with  their  colleagues,  several  teachers  became 
interested.  Guided  by  their  interested  teachers’  areas  of  certi- 
fication and  experience  with  ninth  grade  curriculum,  the  ad- 
vice of  department  chairs,  and  his  first  year  experience  ob- 
serving the  teaching  interaction  of  his  staff,  Cemy  chose  the 
Connections  teaching  team.  They  will  be  introduced  next. 

The  Connections  Teaching  Team 

The  four  Connections  teachers  were:  Sheryl  Hart,  En- 
glish; Bemie  Lyons,  Social  Studies;  Tim  Schwartz,  Learning 
Disabilities;  and  Dan  Centers,  Physical  Science. 

With  25  years  in  the  district,  Sheryl  Hart  was  the  vet- 
eran teacher  of  the  group.  She  had  taught  Art  as  well  as  En- 
glish, and  had  worked  in  all  five  buildings  in  the  district.4 
Prior  to  coming  to  the  high  school  three  years  befure,  Sheryl 
had  been  part  of  a close-knit  group  of  teachers  at  the  junior 
high.  Family  was  a theme  that  surfaced  often  with  Sheryl. 
Conversations  with  Sheryl  often  centered  around  her  family, 
and  homey  touches  — including  a smiling  picture  of  her  three- 
year-  old  granddaughter — distinguished  Sheryl’s  desk  area. 
As  part  of  the  Connections  teaching  team,  the  importance  of 
family  to  Sheryl  would  also  be  evident. 

Bemie  Lyons  joined  Connections  with  15  years  of 
teaching  experience,  nine  of  them  at  Cedar  City  High  School. 
During  the  Connections  Year,  one  edition  of  the  monthly  dis- 
trict newsletter  featured  Bemie  in  its  regular  staff  profile  col- 
umn. The  article  began  with  this  portrait: 

You  know,  he’s  one  of  those  teachers  that  students  say 
can  be  very  demanding  but  they  really  like  his  class 
anyway.  He’s  one  that  lives  and  breathes  his  subject 
— history. 


3 The  development  of  decoding  categories  after  data  collection,  as  well  as  analysis  in  the  field,  conformed  to  Bogdan  and  Uiklcn's  (19X2)  suggestions 
regarding  qualitative  data  analysis. 

-1  To  respect  confidentiality,  the  local  newspaper  source  will  not  be  given. 

4 The  five  buildings  include  three  elementary  schools  for  grades  K-4,  an  intermediate  (grades  5&6)  and  junior  high  (grades  7&8)  housed  m Uic  same 

building,  and  the  high  school.  


Bemie’s  love  of  history  was  a constant,  as  was  his  love 
of  coaching.  But  the  Connections  year  would  also  bring 
changes  in  his  life.  October  brought  two  dramatic  changes: 
his  family  moved  to  a new  house  and  Bemie’s  mother  died. 
Both  of  these  influences,  Bemie’s  view  of  his  teaching  area 
and  the  changes  he  had  experienced,  could  be  expected  to 
affect  Connections. 

Tim  Schwartz  came  to  Connections  with  1 5 years  teach- 
ing experience,  the  last  eight  within  the  Cedar  City  system. 
Most  of  his  teaching  experience,  and  all  of  his  years  at  Cedar 
City,  had  been  as  a learning  disabilities  teacher.  But  like 
Sheryl,  Tim  also  had  a background  in  art  education.  Also  like 
Sheryl,  he  taught  at  the  junior  high  before  coming  to  the  high 
school.  During  the  Connections  year  Tim  would  also  share  a 
life  experience  with  Bemie:  Tim’s  father  died  in  October. 
All  of  these  aspects  of  Tim’s  life  and  work  would  shape  his 
Connections  experience,  but  none  more  than  his  status  as  a 
learning  disabilities  teacher. 

Dan  Centers  worked  for  ten  years  in  industry  before 
comng  to  Cedar  City  High  School  to  teach  physical  science 
and  physics  in  1990.  Some  aspects  of  Dan’s  life  and  work 
that  shaped  his  Connections  year  were  readily  apparent:  his 
extra-curricular  school  roles  and  his  interest  and  work  with 
educational  technology.  Dan’s  role  as  a senior  class  advisor 
claimed  many  a morning  before  classes  began.  Dan’s  consci- 
entious approach  to  organization  came  to  the  fore  as  he  dealt 
with  the  myriad  of  details  involved  in  his  role.  Dan  also  took 
his  membership  on  both  the  district’s  Instructional  Council 
and  Instructional  Technology  Committee  seriously.  More 
reticent,  quiet,  and  private  than  his  Connections  teammates, 
the  influences  of  Dan’s  life  beyond  school  were  more  diffi- 
cult to  detect.  Dan  did  not  often  talk  about  his  family. 

Before  Connections,  ties  among  the  four  teachers  had 
been  limited.  Tim  and  Sheryl  were  acquainted  with  each  other 
during  their  junior  high  days,  and  Tim  and  Bemie  shared  the 
acquaintance  that  came  with  being  coaches.  But  acquaintance 
appeared  to  be  the  extent  of  the  team’s  pre-Connections  ties. 
As  Sheryl  commented, 

Tim,  I sort  of  knew;  Bemie  was  a “hello;”  Dan,  well, 
English  and  science  people  don’t  get  much  chance  to 
know  each  other. 

Sheryl’s  observation  foreshadows  a significant  struc- 
ture characteristic  of  Cedar  City  High  School.  So  it  is  appro- 
priate to  choose  the  structural  frame  to  begin  this  frame  analy- 
sis. 

The  Structural  Frame 

Through  the  lens  of  a structural  perspective,  the  archi- 
tecture of  an  organization  can  be  seen.  Rules,  roles,  and  rela- 
tionships assume  a design,  and  an  organization’s  effective- 
ness depends  on  whether  that  design  is  appropriate  and  ad- 
equate to  meeting  the  organization’s  goals.  The  elements  of 
design  are  affected  by  such  structural  imperatives  as  the 
organization’s  size,  technology,  environment,  goals,  and  work 
force  (Bolman  & Deal,  1991).  For  Cedar  City  High  School 
(CCHS)  and  Connections,  some  of  these  structural  impera- 
tives were  held  in  common:  others  were  not.  So  it  follows 
dial  CCHS  structures  would  coexist  and  might  well  be  ex- 


pected to  affect  the  extent  to  which  Connections  teachers 
would  create  and  sustain  a collegial  community. 

“The  Key  is  Flexibility ” 

When  visitors  came  to  observe  Connections  and  asked 
about  elements  essential  to  successful  implementation,  the 
teachers  would  invariably  echo  Tim’s  thought,  “ The  key  is 
flexibility.”  Conceived  and  implemented  as  a program  op- 
tion, Connections  implicitly  represented  flexibility.  The  Ce- 
dar City  High  School  Vision  Statement  (adopted  in  1993) 
declared  the  school’s  commitment: 

We  will  implement  course  structures  . . . such  as  the 
Connections  Program  ...  In  addition  to  forging  links 
between  academic  disciplines,  our  goal  is  to  develop 
inquiring,  responsive  minds. 

Flexibility,  departments,  and  disciplines.  In  order  for 
Connections  to  meet  its  goal  of  interdisciplinary  study,  teach- 
ers from  three  academic  disciplines  and  special  education 
would  need  to  integrate  the  established  curricula  for  English 
9,  Physical  Science,  and  World  history.  This  would  prove 
not  to  be  an  easy  task.  Perhaps  the  single  most  visible  struc- 
ture at  CCHS  was  apparent  in  the  configuration  of  corridors 
by  curricular  departments.  Each  subject  had  distinct  geo- 
graphic boundaries.  Reinforcing  geographic  propinquity,  the 
structure  of  department  chairs  bolstered  subject  departments 
as  the  unit  of  professional  community  at  Cedar  City  High 
School.  Communication  among  departments  was  limited. 
The  common  structure  of  subject  departments  in  high  schools 
and  its  implications  for  teachers’  sense  of  identity  and  pat- 
terns of  professional  community  has  been  well-noted  in  the 
literature.5  CCHS  department  structures  retained  an  abiding 
presence  in  Connections.  The  Connections  teachers,  in  a nod 
to  the  departmental  structure  at  CCHS,  chose  to  rotate  the 
role  of  “chair.”  Each  Connections  teacher  retained  his  or  her 
room  within  the  CCHS  geography  by  department,  forming  a 
collegial  community  among  the  Connections  teachers.  To 
facilitate  the  process,  the  structures  of  summer  planning  meet- 
ings and  a common  planning  period  were  instituted. 

Flexibility  and  curriculum  design.  In  the  course  of  the 
summer  meetings  the  teachers  decided  that  a unit  structure 
would  provide  flexibility  in  their  approach  to  curriculum  con- 
tent. During  the  first  semester,  units  of  study  were  driven  by 
the  chronology  of  history.  For  example,  in  the  unit  “Begin- 
nings,” Bemie  focused  on  the  development  of  civilizations, 
Sheryl  focused  on  mythology  and  The  Odyssey , and  Dan  fo- 
cused on  the  elements  of  the  scientific  method,  and  measure- 
ment in  particular.  But  as  the  weeks  went  by,  it  became  in- 
creasingly clear  that  the  existing  science  curriculum  did  not 
integrate  easily  into  a chronological  approach.  The  unit  struc- 
ture would  need  to  be  modified  if  Connections’  interdiscipli- 
nary goal  was  to  be  supported.  Over  the  Christmas  break, 
the  teachers  met  and  made  the  decision  to  “go  with  thematics,” 
with  science  concepts,  rather  than  chronology,  as  the  source. 
Under  this  new  plan,  the  second  semester  began  with  “Struc- 
tures.” Sheryl’s  instruction  centered  on  grammatical  struc- 
tures, Bemie ’s  on  the  “isms”  (nationalism,  imperialism,  co- 
lonialism), and  Dan’s  on  atomic  structures  and  elements. 


' See  Johnson  (1990),  Little  (1992),  and  McLaughlin  (1993),  for  example. ^ 
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Flexibility  and  heterogeneity.  Flexibility  would  also 
be  important  as  the  teachers  addressed  Connections’  hetero- 
geneous student  cohort.  Like  all  Cedar  City  High  School 
students.  Connections  students  entered  the  high  school  with 
the  track  designation  of  honors,  academic,  or  general.  Nor- 
mally, ninth  grade  general  students  would  not  be  enrolled  in 
Physical  Science;  that  was  the  freshman  province  of  academic 
and  honor  students.  Under  this  structure,  Dan’s  past  experi- 
ence teaching  Physical  Science  had  been  primarily  with  aca- 
demic or  honors  students.  Nor  would  freshmen  normally 
enroll  in  World  History.  In  addition,  the  tracking  structure  at 
CCHS  provided  for  separate  sections  and  differentiated  cur- 
ricula within  English  9 based  on  tracks.  Clearly,  Connec- 
tions flexibility  would  require  alternative  structures. 

As  the  full  Connections  cohort  gathered  on  the  first  day 
of  school,  the  first  item  of  business  after  introductions  was 
the  announcement  of  student  advisory  groups.  The  theory, 
as  developed  during  summer  planning  sessions,  was  that  ran- 
domly assigning  students  to  groups  of  20  per  teacher  would 
be  a student  grouping  alternative  to  tracking  that  would  be 
consistent  with  Connections’  heterogeneous  purposes.  In 
practice,  Connections’  structures  for  student  grouping  could 
not  totally  resist  the  influence  of  CCHS  tracking  structures. 
Student  advisory  groups  were  not  formed  totally  at  random; 
all  learning  disability  students  and  schedules  became  part  of 
Tim’s  group.  Moreover,  as  Sheryl  explained  to  a group  of 
visiting  teachers,  CCHS  tracking  distinctions  could  not  to- 
tally be  ignored  in  the  area  of  English.  After  all,  “honors’’ 
Connections  students  would  receive  weighted  grades  in  the 
area  of  English. 

Flexibility  and  schedules.  Another  significant  area  of 
flexibility  lay  in  the  structure  of  scheduling.  Within  the  seven- 
period  high  school  schedule,  Connections  was  allocated  a 
three-period  instructional  block  and  a common  planning  pe- 
riod. There  would  betimes  when  the  entire  Connections  co- 
hort met  for  the  full  block  — often  to  work  on  or  present 
student  projects.  At  other  times  students  would  be  placed  in 
two  groups  of  two  advisory  groups  each  for  a more  complex 
period  configuration  balanced  among  the  three  subject  areas 
over  a period  of  three  days.  This  arrangement  allowed  for 
lengthy  science  labs  or  dramatic  historical  simulations.  When 
the  students  were  asked  for  their  input  at  the  end  of  the  first 
semester,  they  overwhelmingly  indicated  a strong  preference 
for  these  alternative  schedule  options.  Perhaps,  as  Bemie 
surmised,  “They  know  we  can’t  lecture  for  three  periods.” 
Yet  more  often  than  not,  the  students  in  Tim’s  advisory  group 
were  parceled  out  among  the  three  other  groups'  students  and 
a “regular  three-class  rotation”  was  followed.  After  all,  CCHS 
structures  meant  Connections  student  report  cards  would  in- 
dicate separate  grades  for  each  of  the  three  content  areas  en- 
compassed in  Connections. 

Structures:  Barriers  and  Alternatives 

As  the  education  reform  movement  with  its  frequent 
emphasis  on  restructuring  would  indicate,  the  structural  per- 
spective on  Connections’  implementation  is  significant.  From 
a structural  perspective,  the  departmental  and  tracking  frame- 
work that  characterized  Cedar  City  High  School’s  organiza- 
tional architecture  appeared  to  work  at  cross-purposes  with 
the  interdisciplinary  and  heterogeneous  nature  of  the  Con- 


nections program.  Long  before  the  current  wave  of  reform, 
Seymour  Sarason  (1971)  observed: 

The  existing  structure  of  a setting  . . . defines  the  per- 
missible ways  in  which  goals  and  problems  will  be  ap- 
proached . . . The  existing  [structure]  is  a barrier  to 
recognition  and  experimentation  with  alternative  ones. 
(P-12) 

The  connections  experiment  would  suggest  that  CCHS 
structures,  while  not  excluding  the  Connections  experiment, 
did  raise  partial  barriers  to  many  Connections  structures.  This 
is  not  surprising.  As  Sarason  noted,  long-standing  structures 
are  neither  easily  nor  quickly  changed.  Considering  Little’s 
twin  conditions  for  collegiality , opportunity  and  interdepen- 
dence, the  opportunities  afforded  by  Connections’  structures 
(especially  as  they  coexisted  with  and  were  influenced  by 
CCHS  structures)  could  not  be  expected  to  produce  a colle- 
gial community  in  and  of  themselves.  Perhaps,  as  Bolman 
and  Deal  might  postulate,  the  discrepancies  between  CCHS 
structures  and  Connections  structures  may  be  traced  to  dif- 
fering structural  imperatives.  With  its  relatively  small  size, 
its  innovation  purposes  and  goals,  and  its  particular  teaching 
team,  Connections  would  and  should  develop  unique  organi- 
zational structures.  Yet  the  relationship  between  Cedar  City 
High  School  and  Connections  was  far  more  complex  than 
their  structures  alone.  The  perspectives  of  other  frames  are 
needed. 

The  Human  Resources  Frame 

The  human  resources  perspective  focuses  on  the  “fit” 
between  individuals  and  the  organization  in  a symbiotic  rela- 
tionship. If  an  organization  is  to  be  effective,  the  needs  of  its 
members  must  be  met,  and  the  gifts  each  member  brings  to 
the  organization  must  be  compatible  with  the  organization’s 
needs.  Tacitly  recognizing  the  importance  of  the  human  re- 
sources frame,  administrators  knew  that  selecting  the  mem- 
bers of  the  teaching  team  would  be  of  great  consequence.  As 
Mike  Davis  put  it,  “It  was  clerical ...  the  teachers  needed  to 
be  enthusiastic . . . Having  teachers  that  parents  would  recog- 
nize as  top-notch  was  important”  (Interview,  May  11, 1993). 
Selecting  teachers  whose  skills,  abilities,  needs,  and  orienta- 
tions would  be  compatible  with  each  other  and  with  Connec- 
tions’ needs  and  goals  would  be  a strong  determinant  of  the 
extent  to  which  collegial  community  developed. 

Intensityy  Inclusivity,  and  Orientation 

Little  and  McLaughlin  (1993)  distinguish  three  dimen- 
sions of  teachers’  professional  relations:  intensity,  inclusivity, 
and  orientation.  Examining  each  of  these  dimensions  should 
provide  insight  into  the  human  resources  dynamics  within 
Connections. 

Intensity.  Intensity  refers  to  the  strength  of  the  ties 
among  a group  of  teachers,  especially  in  comparison  to  ties 
with  other  sources  of  identity  and  community.  At  CCHS, 
professional  ties  tend  to  center  around  departments.  During 
Connections’  implementation,  several  factors  worked  together 
to  allow  this  traditional  allegiance  and  affiliation  to  shift  from 
departments  to  the  Connections  program.  The  Connections 
newsletter  given  to  parents  at  a meeting  the  week  before  school 
started  pointed  to  one  factor:  “Wc  were  chosen  for  this  class 
on  a strictly  voluntary  basis  which  gives  Connections  its  best 


chance  for  success.”  Bemie’s  comment  to  a group  of  visiting 
administrators  in  May  pointed  to  another  factor: 

Over  the  summer,  we  got  together  maybe  40  to  50 
hours.  Maybe  the  biggest  thing  we  got  out  of  it  was 
team  building,  ‘cause  we  scrapped  a lot  of  it. 

Time  that  would  allow  teachers  to  forge  ties  was  also 
part  of  the  rationale  behind  Connections'  additional  common 
planning  period.  Yet  the  common  planning  period  did  not 
always  work  toward  this  purpose.  One  incident  in  Novem- 
ber is  indicated.  Early  one  morning,  Dan  could  be  found,  as 
usual,  at  his  computer.  When  asked  about  plans  the  group 
had  been  working  on  the  past  few  days,  Dan  replied,  “I  don't 
know.  They  were  talking  about  it  yesterday.  I heard  some- 
thing about  it.”  Increasingly,  Dan  would  be  present  for  com- 
mon planning  time  (the  teachers  met  in  his  room  during  the 
first  semester),  but  did  not  join  the  others  sitting  together  at 
the  table.  Instead,  he  would  be  readying  lab  equipment  for 
the  day  or  be  seated  at  his  computer.  Benue' s presence  for 
the  full  planning  period  also  became  increasingly  rare  with 
the  passage  of  time.  His  coaching  duties  and  the  work  in- 
volved in  the  American  Studies  dyad  that  comprised  his  af- 
ternoons appeared  to  provide  strong  competition  for  Bemie's 
time.  Both  Bemie  and  Dan  seemed  to  be  practicing  what 
Hargreaves  ( 1 993)  has  called  “strategic  individualLsm”  (p,  63), 
Yet  there  were  times  when  the  common  planning  time  was 
marked  by  the  full  involvement  of  all  four  teachers.  These 
moments  were  often  related  to  crises,  whether  personal  or 
professional.  The  deaths  of  Bemie’s  and  Tim’s  parents  and 
moments  when  differences  could  no  longer  be  ignored  served 
as  the  impetus  for  intense  common  planning  period  meet- 
ings. Shared  trials  and  tribulations  would  intensify  the  ties 
among  Connections’  teachers. 

Inclusivity,  The  second  dimension  of  professional  re- 
lations, inclusivity,  refers  to  membership  boundaries.  On 
more  than  one  occasion,  Assistant  Superintendent  Davis  and 
Principal  Cerny  had  told  the  Connections  teachers,  “rhis  is 
your  baby.”  Clearly,  the  teachers  took  this  message  to  heart; 
they  were  reluctant  to  let  “strangers”  be  involved  in  the  care 
of  their  “child.”  The  teaching  team’s  relationship  with  Dan’s 
second  semester  student  teacher,  Jim  Pelfrey,  illustrates  this. 
Just  as  second  semester  with  its  change  in  unit  focus  was  be- 
ginning, Jim  was  unexpectedly  assigned  to  Dan.  Jim  joined 
the  first  period  gatherings,  but  he  was  rarely  included  in  the 
conversation.  Jim’s  responses  during  an  interview  in  late  April 
revealed  his  perceptions  of  his  relationship  with  the  Connec- 
tions team: 

1 still  don’t  feel  part  of  the  team.  Like  yesterday,  they 
kind  of  asked  me  for  an  idea  for  the  introduction  to  the 
futuristic  unit,  and  when  my  response  was  not  imme- 
diate, Dan  and  Sheryl  immediately  turned  their  atten- 
tion away. 

As  the  incident  illustrates,  the  Connections  team  tended 
to  be  exclusive  rather  than  inclusive.  The  informal  roles  within 
the  teaching  team  may  have  left  no  room  for  “outsiders”  and 
so  played  a part  in  this  exclusivity. 

By  temperament  and  expertise,  Dan  became  the  com- 
puter whiz  of  the  Connections  learn.  It  was  he  who  created 
class  lists  and  forms.  Attention  to  details  was  also  a pari  of 


Tim’s  role,  as  he  served  as,  in  Connections  jargon,  “lackey.” 
Tim  substituted  for  Bemie  or  Sheryl  when  they  were  ill;  he 
would  assist  Bemie  in  organizing  and  running  historical  simu- 
lations or  dramatizations;  and  he  quite  often  took  aside  stu- 
dents who  needed  individual  attention  with  English  reading 
assignments.  By  mid -September  when  I asked  Tim  to  char- 
acterize his  role  within  the  team,  he  was  quick  to  say,  “I  see 
myself  as  the  most  flexible  — I can  jump  off  and  go  wher- 
ever I’m  needed.  I’m  used  to  that  as  an  LD  teacher.”  Sheryl 
was  often  the  organizer  of  the  group,  telling  her  colleagues, 
“Hey,  guys,  we’ve  gotta  . . .”  By  gender  and  inclination, 
Sheryl  also  took  a motherly  role.  She  brought  home-baked 
goodies  to  share,  handed  tissues  to  those  with  colds,  and  in- 
quired about  families.  Bemie  was  the  “idea  man”  for  the  team. 
His  participation  in  planning  often  began  with  “What  if  we  . 

. .?”  It  was  also  Bemie  who  would  often  tie  the  conversation 
to  broader  issues,  as  when  the  teachers  and  administrators 
met  in  January  to  reflect  on  Connections  at  midyear.  The 
discussion  turned  to  the  relative  success  of  students  from  vari- 
ous tracks  within  Connections,  and  it  only  took  a few  min- 
utes before  Bemie  observed,  “If  s the  old  philosophical  ques- 
tion, isn’t  it?  How  do  we  meet  individual  needs?”  Bemie’s 
question  provides  a segue  to  the  third  dimension  of  profes- 
sional relations:  orientation. 

Orientation.  Orientation  refers  to  teachers’  value  dis- 
positions: their  conceptions  of  subject  matter  ( fixed  or  mal- 
leable) and  their  conceptions  of  their  students  as  learners  (mo- 
tivated, academically  able).  If  Connections  were  to  be  true  to 
its  interdisciplinary  goal,  the  teachers  would  need  to  uncover, 
rather  than  cover,  their  traditional  and  established  curricula. 
Yet  the  teachers’  autonomy  in  creating  Connections’  curricu- 
lum was  not  total.  Since  Connections  was  a pilot  program 
option,  students  would  need  to  be  able  to  rejoin  the  tradi- 
tional curriculum  successfully  in.  their  sophomore  year.  So, 
expectations  inherent  in  the  articulated  Cedar  City  English 
and  Science  curricula  dictated  many  of  the  teachers’  choices. 
As  an  elective,  World  History  could  be  more  flexible.  But 
within  these  strictures,  Connections  teachers’  conceptions  of 
their  disciplines  would  allow  for  varying  degrees  of  adapt- 
ability in  their  approach  to  content. 

Science  proved  to  be  the  least  adaptable.  Natural  ties 
between  science  and  history  and  English  were  elusive.  On 
those  occasions  when  his  colleagues  bemo  aned  the  seemingly 
inability  of  science  to  “connect”  with  their  disciplines,  Dan 
would  say,  “ I’m  not  a science  historian.”  In  one  interview, 
Dan  expanded  on  this  comment: 

It’s  never  been  easy  to  connect  academically.  I wasn’t 
taught  that  way  ....  I know  if  s me  ...  I don’t  care 
about  names  and  dates.  I don’t  want  it  to  be  artificial, 
contrived,  a surface  connection.  The  kids  see  through 
that. 

Dan’s  thought  hints  at  two  factors  at  work  in  the  teach- 
ers’ ability  to  adopt  a malleable  conception  of  their  subject 
area.  Their  own  learning  experiences  did  not  reflect  an  inter- 
disciplinary view.  Moreover,  in  the  highly  specialized  world 
of  secondary  teacher  preparation  and  departmental  structures, 
they  were  not  familiar  with  each  other’s  content.  Sheryl  and 
Bemie  knew  little  about  elements  or  Newton’s  laws;  and  Dan 
knew  little  about  To  Kill  a Mockingbird  or  medieval  history. 
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Common  planning  period  content  sharing  was  limhed  — 
mostly  to  coordinate  and  accommodate  individual  subject- 
area  plans. 

Orientation  also  bears  directly  on  the  well-documented 
relationship  of  dependency  between  teachers  and  students. 
Teachers  rely  on  students  for  their  sense  of  satisfaction  and 
efficacy.6  Given  Connections’  heterogeneous  student  cohort, 
the  teachers’  conceptions  of  student  motivation  and  abilities 
could  be  expected  to  powerfully  affect  this  relationship. 
McLaughlin  (1993)  describes  three  general  patterns  in  teach- 
ers’ classroom  responses  to  students.  Teachers  could  main- 
tain traditional  standards  and  conventional  practices;  they 
could  lower  their  expectations;  or  they  could  adapt  their  prac- 
tices and  pedagogy,  broadening  their  definitions  of  achieve- 
ment and  creating  active  roles  for  students.  Both  the  fust  and 
last  occurred  in  Connections.  The  first  could  be  seen  in  “ the 
lab  book  crisis.”  The  main  activity  in  Dan’s  science  classes 
was  lab  work,  Dan  had  very  specific  requirements  for  an  ap- 
propriate lab  book,  and  lab  reports  would  not  be  graded  until 
they  were  recorded  in  a lab  book.  A form  of  gridlock  took 
shape  as  Dan’s  standards  were  not  altered  and  many  students 
had  not  secured  “correct”  lab  books  several  weeks  into  the 
fust  quarter.  Bemie  and  Tim  attempted  to  break  the  gridlock, 
but  were  only  partially  successful.  The  incident  would  color 
the  relationship  between  Dan  and  many  of  the  Connections 
students. 

The  “ lab  book  crisis”  notwithstanding,  the  third  pat- 
tern, adapting  practice  and  pedagogy,  was  often  evident  in 
Connections.  In  a clear  departure  from  traditional  CCHS 
classes,  Connections’  most  visible  pedagogical  method  was 
student  projects.  When  students  accompanied  the  four  teach- 
ers on  “ recruiting  trips”  to  present  Connections  to  eighth- 
grade  students,  Amanda’s  remarks  were  typical: 

We  do  projects  all  the  time.  It’s  project  after  project . . 
the  Renaissance  Fair  ...  the  Quests  ...  the  twentieth 
century  time-line  ...  the  final  projects  we’re  working 
on  right  now. 

In  fact,  Connections’  fust  day  involved  a group  project. 
As  students  worked  in  groups  of  four  for  two  periods  to  con- 
struct cardboard  bridges  that  would  sustain  the  weight  of  sev- 
eral bricks,  and  then  presented  their  work  during  Connec- 
tions’ third  period,  teacher  comments  could  be  overheard: 
Sheryl  (to  Tim):  That  girl  who’s  doing  all  the  work  — 
she’s  a general  kid  who  almost  didn’t  make  it.  I love 
it! 

Bemie  (to  Sheryl):  You  gotta  see  some  of  these  de- 
signs! 

Tim  (to  Dan):  Know  what?  Three  of  these  are  mine 
[LD]  and  I didn’t  even  know  it.  Look  at  them! 

The  tracking  stereotypes  that  pervaded  CCHS  began 
to  be  broken  on  the  first  day.  The  fust  day’s  success  allowed 
the  process  to  continue.  By  the  end  of  the  year,  when  I asked 
each  teacher  to  reflect  on  various  aspects  of  their  practice, 
their  comments  revealed  a consensus: 

The  general  kids  performed  above  expectations  and 
their  expectations  ....  They  constantly  amazed  us. . . 


Seeing  the  LD  students  rise  to  the  occasion  so  often 
has  been  significant. 

This  uniform  perception  did  not  always  mirror  reality. 
Many  of  the  Connections  projects  had  been  tied  to  English 
and/or  history;  few  had  included  science.  Moreover,  several 
students,  all  general  or  LD,  “failed”  science. 

“ The  Vision  Thing” 

Ultimately,  it  was  the  dimension  of  orientation  within 
the  human  resources  frame  that  produced  a rift  in  the  team. 
The  teachers’  individual  stances  were  the  products  of  years 
of  experiences  as  teachers  and  learners;  changes  would  not 
come  swiftly.  As  frustrated  as  the  teachers  were  by  their  in- 
ability to  forge  academic  connections  with  science,  the  major 
stance  that  finally  separated  Dan  from  his  colleagues  was  the 
three  other  teachers’  conception  that  Connections  was  about 
ensuring  student  success.  Sheryl,  Bemie  and  Tim  questioned 
whether  Dan  would  or  could  ( as  Sheryl  put  it)  “buy  into”  the 
“vision  thing,”,  and  adopt  the  orientation  they  shared.  By  the 
last  week  of  school,  in  the  minds  of  his  colleagues,  Dan’s 
continued  membership  on  the  Connections  team  was  in  ques- 
tion.7 

The  Political  Frame 

The  political  perspective  focuses  on  the  relationship  be- 
tween coalitions  and  resources  within  an  organization.  At 
CCHS,  coalitions  were  defined  by  departments  and  their  com- 
petition would  revolve  around  such  resources  as  status,  time, 
money,  and  space.  As  George  Cemy  told  a group  of  visiting 
administrators,  “We  are  fragmented.”  Durin^  the  Connec- 
tions year,  concern  for  school  climate  war  such  that  one  fo- 
cus of  the  school’s  ON-TASC  (Ohio  Network:  Training  and 
Assistance  for  Schools  and  Communities)  three-year  grant 
was  on  improving  staff  morale.  Polarization  by  department 
was  especially  evident  in  the  intense  jockeying  for  “old”  sci- 
ence rooms  when  the  new  science  wing  was  ready  for  occu- 
pancy at  mid-year.  Yet  the  year  also  brought  at  least  a brief 
opportunity  for  coalescing  across  departments  as  teacher  con- 
cerns rose  about  the  potential  effects  of  a community  group 
known  as  Freedom  2000.  Two  candidates  for  the  Board  of 
Education  appeared  to  be  allied  to  this  emerging  group  with 
ties  to  the  religious  right.  The  local  teachers  association  sprang 
into  action,  sponsoring  a “Meet  the  Candidates”  forum  and 
acting  to  recommend  three  candidates.  Neither  of  the  Free- 
dom 2000  candidates  was  elected,  and  the  threat  passed.  So, 
too,  did  staff  unity. 

In  the  spring  the  Board  acted  to  place  an  operating  levy 
on  the  May  ballot  and  to  make  budget  cuts.  As  resources 
became  more  scarce,  the  political  relationship  between  Con- 
nections and  other  CCHS  coalitions  became  more  apparent. 
A grant  had  assured  Connections  of  abundant  money  re- 
sources. Teachers  received  a stipend  for  their  summer  plan- 
ning sessions,  and  teachers’  requisitions  for  instructional 
materials  could  be  liberally  granted.  While  other  teachers’ 
days  would  include  a “duty”  period,  Connections  teachers 
were  given  a second  planning  period  in  common.  As  George 
Cemy  observed,  “People  sort  of  resented  that  a little  bit,  and 
rightly  so.”  Part  of  the  resentment  may  have  stemmed  from 


‘ See  McLaughlin  (1 W),  I.icbcrman  & Miller  (1990),  Pauly  (1991 ).  and  Cohen  (1988). 

1 Events  during  the  following  summer  evidently  resolved  this  difference  sufficiently  for  Dan  to  remain  with  Connections  as  its  second  year  began  in 
August  1994. 


the  status  and  publicity  Connections  received.  When  Con- 
nections teachers  approached  the  principal  with  the  idea  of 
allocating  the  old  science  rooms  to  Connections  so  they 
wouldn't  be  so  scattered,  Cemy  had  ambivalent  feelings.  He 
could  see  the  practical  validity  of  the  teachers'  request,  but 
he  feared  that  dedicating  awing  to  Connections,  interdepart- 
mental dyads,  and  the  status  as  a separate  “department"  im- 
plied by  such  geography  would  “further  isolate  them.  They 
need  to  keep  a foot  in  the  work  of  the  rest  of  the  building.” 
Just  as  a political  perspective  illuminates  the  relation- 
ship between  Connections  and  CCHS,  it  also  sheds  light  on 
the  relationship  among  the  Connections  teachers.  From  a 
political  perspective,  the  Connections  teachers  can  be  seen  as 
representatives  of  the  coalitions  at  CCHS.  Coming  to  Con- 
nections with  affiliations  with  their  departments,  Connections 
teachers  could  be  expected  to  embody  the  “enduring  differ- 
ences . . . in  values,  preferences,  beliefs,  information,  and  per- 
ceptions of  reality"  (Bolman  & Deal,  1 99 1 , p.  1 86)  of  their 
respective  coalitions.  According  to  the  political  frame,  con- 
flict among  the  teachers  over  these  enduring  differences  would 
be  inevitable  and  would  be  resolved  only  as  power  would  be 
exercised  in  a negotiation  process.8  Understanding  who  had 
power  and  how  power  was  exerted,  then,  become  important 
in  the  organization’s  approach  to  conflict,  and 
concommitantly,  community.  Power  takes  many  forms:  ex- 
pertise, coercion,  charisma  With  his  master ' s degree  in  gifted 
education,  his  tenured  status,  and  his  nine  years  at  CCHS, 
Bemie  clearly  possessed  the  power  of  expertise.  He  also,  as 
the  district  newsletter  profile  suggested,  was  charismatic.  Only 
slightly  less  charismatic  in  the  eyes  of  students,  and  with  her 
25  years  of  experience,  Sheryl  also  held  power  within  the 
Connections  team.  But  both  Sheryl  and  Bemie  carefully  ob- 
served the  traditional  school  norm  of  mutual  noninterference 
among  teachers  and  so  tended  to  avoid  conflict.  Moreover, 
while  both  Bemie  and  Sheryl  held  power,  neither  held  au- 
thority. Bemie  and  Sheryl  did  speak  to  administrators  who, 
with  the  leverage  of  evaluation  and  considerable  rewarding 
and  coercive  power,  might  have  intervened.  Yet  to  do  so 
would  remove  considerable  autonomy  from  the  team,  and 
both  Davis  and  Cemy  preferred  that  the  teachers  resolve  any 
conflicts  among  themselves.  In  terms  of  power,  a condition 
of  stalemate  prevailed. 

The  Symbolic  Frame 

The  symbolic  perspective  posits  that  in  the  face  of  the 
uncertainties  of  organizational  life,  symbols  and  the  culture 
they  reflect  help  people  fmd  order  and  meaning  in  their  expe- 
rience. Certainly,  the  education  enterprise  is  fraught  with 
uncertainies.9  As  an  innovative  pilot  program,  Connections 
could  be  expected  to  pose  even  more  uncertainty.  Indeed, 
Sheryl  told  the  Board  of  Education,  “ We  were  all  apprehen- 
sive at  first."  As  the  symbolic  perspective  suggests,  rituals, 
ceremonies,  myths,  and  sagas  would  be  quite  visible  in  Con- 
nections' implementation. 

Each  day  at  Cedar  City  High  School  began  with  a ritual. 
Promptly  at  7 :45,  the  assistant  principal’s  voice  would  come 
over  the  public  address  system  saying,  “Good  morning,  and 
welcome  to  [Cedar  City]  High  School."  Pep  assemblies, 


Homecoming  activities,  the  junior-senior  prom,  and  all  the 
myriad  of  CCHS  traditions  attested  to  the  symbolic  aspects 
of  life  at  CCHS.  Powerful  norms  also  prevailed  at  CCHS. 
One,  in  particular,  profoundly  affected  the  Connections  teach- 
ers' ability  to  merge  their  previously  individual  practices  in  a 
collective,  interdependent  practice.  At  CCHS,  as  at  most 
schools,  a norm  of  mutual  noninterference  was  rigorously 
observed.  Teachers  might  notice  differences  among  their 
separate  practices  and  disagree  with  many,  but  private 
thoughts  never  became  public  discussions.  As  evident  as 
symbols  and  cultural  norms  were  in  the  life  of  CCHS,  they 
would  be  even  more  apparent  in  Connections. 

Faced  with  the  tasks  of  preparation,  it  is  notable  that 
the  Connections  teachers  chose  each  other’ s homes  as  the  sites 
for  their  summer  meetings.  Hospitality,  and  the  associated 
ritual  of  breaking  bread  together,  would  be  a hallmark  of  team- 
building in  Connections.  Each  morning  the  aroma  of  coffee 
accompanied  the  common  planning  period  meetings.  Other 
rituals  attended  common  planning  time.  A large  white  marker 
board  served  as  the  vehicle  for  planning  each  week's  activi- 
ties. Certain  days  were  reserved  for  certain  purposes — Thurs- 
days were  planning  days,  and  Fridays  were  for  “talking  about 
kids." 

The  Connections  classes  bore  their  symbolic  marks  as 
well.  During  the  first  semester,  the  entire  Connections  co- 
hort gathered  together  each  morning,  ostensibly  for  atten- 
dance-taking. But  the  gathering  promoted  social  solidarity 
among  students  as  well.  The  structure  of  student  advisory 
groups  also  had  a symbolic  dimension  of  identity.  On  the 
first  day,  other  Connections  traditions  were  bom.  Group 
work,  student-constructed  knowledge,  and  public  presenta- 
tions would  become  hallmarks  of  the  emerging  Connections 
culture.  The  first  day  also  gave  birth  to  the  first  story  in  the 
Connections  saga 

Oft-repeated,  the  “phenomenon  of  the  unheard  bell" 
figured  prominently  in  Connections  lore.  On  that  first  day, 
as  groups  of  students  were  busily  engaging  in  the  task  of  con- 
structing bridges,  the  CCHS  end-of-second-period  bell 
sounded.  No  one,  teachers  or  students,  noticed!  Other  sto- 
ries — like  one  mother's  tale  of  her  LD  son’s  rapt  reading 
Romeo  and  Juliet  and  his  telling  her,  “This  is  so  cool;  have 
you  ever  read  it?"  — would  assume  their  places  in  Connec- 
tions' growing  saga.  Each  story  was  a success  story,  validat- 
ing Connections  as  a program  and  the  teacher's  work.  And 
each  story  contributed  to  an  emerging  vision  of  what  Con- 
nections was  U about. 

As  Fullan  (1993)  asserts,  “Vision  emerges  from,  more 
than  it  precedes,  action.  Shared  vision,  which  is  essential  for 
success,  must  evolve"  (p.  127).  Vision-building  is  a process. 
The  symbolic  elements  of  ritual  and  cultural  norms  were  part 
of  that  process  for  Connections.  Central  to  the  Connections 
vision,  as  the  saga  stories  indicated,  was  a cultural  norm  that 
valued  a flexibility  of  pedagogy  designed  to  ensure  student 
success. 

Conclusions 

The  structural,  human  resources,  political,  and  symbolic 
frames  overlap.  Politics  and  structures  at  CCHS  were  mulu- 


1 For  a discussion  oflhc  power  and  political  dynamics  of  schools,  sec  Blase  (1991). 

9 For  example,  sec  Flinders  (1988),  Rosenholtz  (1989),  Jackson  (1986),  and  Cohen  (1988). 
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ally  reinforcing,  most  notably  for  departments.  Many  of  the 
structures  Connections  devised  had  symbolic  value  as  well. 
Human  resource  orientations  were  often  the  by-product  oi 
teacher  experience  witliin  the  structures  of  CCHS.  Politics 
limited  options  in  structural  change.  Symbolic  rewards  and 
political  rewards  coexisted. 

Faced  with  uncertainty,  The  Connections  teachers  ini- 
tially relied  strongly  on  creating  a separate  Connections  cul- 
ture. Since  the  Connections  teachers  worked  both  in  the  world 
of  Connections  and  the  world  of  Cedar  City  High  School,  the 
creation  of  a distinctive  Connections  culture  appeared  to  be 
an  attempt  to  compartmentalize  their  work.  However,  the 
two  worlds  could  not  be  totally  separated.  Areas  of  conflict 
abounded.  The  CCHS  structures  of  departments  and  track- 
ing conflicted  with  Connections’  interdisciplinary  and  het- 
erogeneous nature.  CCHS  schedule  and  grading  structures 
intruded.  Connections’  abundant  resources  conflicted  with 
increasingly  scarce  resources  for  the  school  as  a whole.  The 
pervasive  school  norm  of  mutual  noninterference  dictated  that 
the  Connections  teachers  avoid  open  discussions  of  their  dif- 
ferences in  personal  orientation. 

Within  the  Connections  teaching  team,  the  structures 
and  symbols  the  teachers  created  supported  collaborative  op- 
portunities. Many  of  the  often-cited  supports  seen  as  neces- 
sary for  collegiality  (Little,  1990)  — administrative  support, 
decision-making  power  and  autonomy,  common  planning 
time,  training  and  assistance  during  the  summer,  and  mate- 
rial support — were  in  place  during  Connections’  implemen- 
tation. Shining  moments  of  collegiality  occurred.  Yet  the 
collegial  condition  of  interdependence  proved  cliimeral.  In 
the  final  analysis,  the  dimension  of  teacher  orientation  proved 
the  most  important  to  sustaining  collegial  community.  Its 
importance  became  most  clear  at  the  end  of  the  year  when 
Dan’s  continued  membership  on  the  teaching  team  hinged 
on  his  willingness  to  share  what  Sheryl  termed  “the  vision 
thing.” 

For  Connections,  time  was  necessary  to  collegial  com- 
munity. Only  through  time  did  communication  become  open 
and  honest,  confronting  and  attempting  to  reconcile  differ- 
ences. Only  through  time  did  trust  grounded  in  mutual  pro- 
fessional respect  become  sufficient  to  overcome  the  traditional 
norm  of  mutual  noninterference.  Only  through  time  did  a 
shared  vision  emerge.  Only  through  time  did  the  teachers’ 
initial  commitment  to  try  a program  become  a commitment 
to  the  program. 
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1995  Convention  Perspectives 

by  Sharon  McNeely 

• We  are  growing  in  every  way.. .attendance,  membership, 

programs. 

• Over  240  sessions.  Great  effort,  exciting  presentations. 

• Presenters  came  from  all  over  the  US,  not  just  the  midwest. 

• Some  glitches,  yes... but  all's  well  that  ends  well. 

• Incoming  VP,  Kim  Metcalf,  welcomes  your  suggestions 

and  reflections. 

• Don't  miss  the  1996  convention,  we  have  a new  hotel 

site  and  wonderful  plans! 

1995  Convention  Photos  by  John  Surber 
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MWERA  Luncheon  Speaker:  The  Greatly 


Exaggerated  Death  of  our  Schools 


Through  Their  Eyes:  Teacher  Seif-Assessment 

Ann  M.  Jones  and  Peter  W.  Airasian 
Boston  College 

Abstract 

This  exploratory  study  gathered  information  about  teachers'  self-assessment  practices.  Thematic  con- 
tent analysis  was  applied  to  data  collected  from  discussions  with  1 7 teachers  broken  into  4 focus 
groups.  Among  the  topics  explored  were  teachers * general  impressions  of  self-assessment,  use  of for- 
mal and  informal  measures  in  self-assessment , specific  areas  of  self-assessment,  personal  standards i 
criteria  used  in  self-assessment  and  impediments  and  aids  to  the  self-assessment  process.  From  this 
initial  investigation,  it  is  evident  that  teachers  engage  in  a variety  of  self-assessment  activities,  find 
them  useful  in  understanding  and  improving  their  teaching  practices,  and  need  more  quality  time, 
relevant  feedback  and  a strong  support  network  to  participate  in  meaningful  self-assessment. 


questions  such  as : how  do  teachers  know  when  they  have  taught 
a good  or  poor  lesson,  what  criteria  or  standards  do  teachers 
use  in  their  self-assessments;  what  factors  initiate  teacher  self- 
assessment,  and  what  factors  impede  it.  Answers  to  these  ques- 
tions will  help  link  teacher  self-assessment  activities  to  their 
professional  development.  This  study  is  an  initial  step  towards 
making  such  a link. 

Data  Collection 

The  sample  in  this  study  was  purposefully  chosen.  Nomi- 
nations of  teachers  in  grades  one  through  five  were  solicited 
from  a principal,  a curriculum  director,  and  a veteran  teacher 
in  three  school  districts.  Nominators  were  asked  to  submit  the 
names  of  teachers  judged  to  be  “excellent”  and  reflective  about 
their  practice.  Teachers  with  these  characteristics  were  sought 
for  the  study  because  it  was  felt  that  they  would  be  more  con- 
scious of  and  able  to  discuss  their  self-assessment  practices. 
Nominated  teachers  were  then  invited  to  participate  in  one  of 
four  focus  group  discussions  on  which  this  study  is  based.  A 
total  of  17  teachers  participated. 

The  focus  groups  varied  in  size  from  three  to  six  teach- 
ers. Only  elementary  teachers  were  involved  and  most  teach- 
ers were  in  self-contained  classrooms.  Teachers  of  grades  one 
through  five  were  selected  from  a total  of  eight  different  el- 
ementary schools  in  the  three  communities.  All  the  teachers 
participating  were  female,  and  years  of  teaching  experience 
ranged  from  2 to  24  years.  Group  discussions  were  held  after 
school  or  during  release  time  in  the  elementary  schools  of  each 
of  the  three  school  districts  represented. 

The  focus  group  sessions  were  facilitated  by  one  or  both 
of  the  investigators  and  varied  from  45  to  75  minutes  in  length. 
In  order  to  provide  some  focus  to  the  discussions,  a reflection 
sheet  was  sent  to  the  teachers  in  advance  of  the  group  meeting. 
It  was  necessary  to  provide  a structure  for  the  groups  because 
the  concept  of  self-assessment  is  open  to  many  interpretations 
and  because  of  the  limited  time-frame  for  discussion  with  each 
group.  Specifically,  the  reflection  sheet  told  teachers  that  “we 
would  like  to  enlist  your  aid  in  helping  to  better  understand  the 

1 This  work  was  supported  by  the  Office  of  Research,  Office  of  Educational  Research  and  Improvement,  U.S.  Department  of  Education  (Grant  No. 
R1 17Q00047).  The  opinions  expressed  are  those  of  the  authors,  and  no  official  support  by  the  U.S.  Department  of  Education  is  intended  or  should  be 
inferred. 


Teaching  is  an  activity  fraught  with  uncertainty.  Every 
day,  teachers  wonder  about  the  success  of  their  activities  and 
strive  to  convince  themselves  that  they  have  had  some  influ- 
ence on  their  students.  To  reduce  this  uncertainty  and  to  pro- 
vide information  about  the  success  of  their  endeavors,  teachers 
engage  in  self-assessment,  the  process  of  collecting  evidence 
about  one’s  performance  and  using  this  evidence  to  make  judg- 
ments about  personal  accomplishment.  Its  main  purpose  is  to 
help  teachers  gain  an  understanding  of  their  practice  so  that  it 
can  be  improved  or  refined.  In  this  sense,  teacher  self-assess- 
ment is  a formative  evaluation  of  oneself  with  regard  to  one’s 
practice.  ScY-assessment  is  a common  process  all  teachers 
carry  out  tc  form  their  own  personal,  professional  knowledge 
and  to  assess  their  instructional  effectiveness  on  a day-to-day 
basis  (Schon,  1987;  Ross,  Cornett  & McCutcheon,  1992). 

Airasian  and  Gullickson  (1994)  point  out  that  teacher 
self-assessment  is  the  most  common  of  all  teacher  assessment 
techniques.  The  fact  that  it  usually  goes  unnoticed,  because  it 
is  carried  out  informally  and  unobtrusively  by  teachers,  should 
not  obscure  its  importance  in  the  professional  life  of  a teacher. 
The  most  important  assessments  of  professionals  are  the  ones 
conducted  by  the  professionals  themselves  (Stufflebeam  & 
Shinkfield,  1 985).  Opportunities  to  explore  one’s  values,  prac- 
tices and  beliefs,  often  can  lead  to  questioning  and  subsequent 
reflection  of  one’s  patterned  expectations  and  norms  (Argyris 
& Schon,  1974;  Nais,  1987).  When  individuals  are  encour- 
aged to  reflect  on  and  revisit  beliefs  and  practices;  awareness, 
improvement  and  growth  occur.  Clandinin  and  Connelly  (1 988) 
suggest  that  the  best  way  to  improve  practice  is  to  help  practi- 
tioners monitor  their  own  behavior  by  self-assessing  and  be- 
coming more  aware  of  their  practice.  Also,  encouraging  teach- 
ers to  self-monitor  is  the  best  way  to  give  teachers  a true  ‘Voice” 
in  their  practice  (Gitlin  et  al.,  1992). 

The  purpose  of  this  study  was  to  gather  information 
about  teachers’  self-assessment  practices.  The  information  col- 
lected was  intended  to  shed  light  on  questions  which  have  gone 
virtually  unexplored  in  the  educational  assessment  literature, 


self-assessment  and  self-improvement  processes  as  they  occur 
in  classrooms”  and  “in  essence,  we’re  trying  to  understand  the 
ways  in  which  teachers  judge  their  own  practices,  actions  and 
accomplishments.”  Also  as  advance  organizers,  teachers  were 
given  suggestions  of  the  kind  of  topics  likely  to  be  discussed 
in  the  focus  group.  For  example:  “How  do  I know  when  I’ve 
taught  a good  lesson?  What  information  or  indicators  do  I 
use?  If  I’m  not  sure  how  well  the  lesson  went,  how  do  I go 
about  finding  out?;”  “How  do  I know  when  my  students  are 
learning?;”  and  “Think  about  the  last  few  days  in  school  to  see 
whether  you  can  recall  specific  situations  in  which  some  or  all 
of  these  questions  arose.” 

After  an  introduction  which  reiterated  the  general  pur- 
pose of  the  study  and  the  focusing  questions,  teachers  were 
asked  to  discuss  the  viability  of  self-assessment  as  an  aspect 
of  teacher  practice  and  their  experiences  with  self-assessment. 
Care  was  taken  to  allow  the  discussion  to  evolve  from  the  teach- 
ers’ comments.  Given  the  limited  amount  of  discussion  time 
and  the  goal  of  this  exploratory  research,  investigators  reserved 
their  comments  to  posing  general  questions  and  asking  for 
elaboration  of  teacher  responses.  Each  session  was  audio -taped 
in  order  to  accurately  record  the  teachers’  responses.  The  ses- 
sion transcripts  show  that  the  majority  of  the  focus  group  dis- 
cussion (i.e.,  approximately  85-90%  of  the  transcript)  consisted 
of  the  teachers’  responses,  comments  and  discussion  among 
themselves,  and  not  researchers’  directives  or  comments. 

Data  Analysis 

The  transcribed  audio-tapes  totaled  129  pages  and  were 
analyzed  using  thematic  content  analysis.  Each  of  the  four 
interview. sessions  was  analyzed  separately  and  independently 
by  each  author  and  emerging  themes  coded.  The  co  ding  scheme 
was  generated  from  multiple  readings  of  the  transcripts  in  search 
of  recurring  issues,  views,  and  practices.  Notes  made  in  the 
margins  of  the  transcripts  served  as  the  basis  for  the  coding 
strategy.  The  researchers  compared  their  codings  and  reached 
consensus  on  coding  disagreements  through  discussion. 

For  this  study,  to  be  considered  a theme,  the  coded  con- 
cept had  to  be  mentioned  by  at  least  two  teachers  in  a focus 
group.  In  order  to  fmd  common  themes,  comparisons  of  the 
codes  were  made  across  the  individual  session  transcripts.  A 
common  theme  was  one  identified  in  at  least  two  of  the  four 
groups.  The  thematic  content  analysis  resulted  in  the  follow- 
ing five  general  categories  or  themes:  self-assessment  indica- 
tors, formal  evaluation  measures,  time  for  self  assessment,  as- 
sessment support,  and  use  of  standards . Each  theme  will  be 
discussed. 

It  should  be  noted  that  the  focus  group  transcripts  served 
as  the  sole  source  of  data  in  this  study.  Given  the  exploratory 
nature  of  the  study,  no  attempt  was  made  to  employ  triangula- 
tion techniques  using  data  other  than  those  collected  during 
the  focus  group  discussions.  However,  more  than  one  focus 
group  discussion  was  held  and  responses  were  compared  across 
sessions  to  lend  more  depth  to  the  analysis.  Also,  when  inter- 
preting the  findings,  it  is  important  to  keep  in  mind  that  the 
context  boundaries  for  the  focus  group  discussions  were  de- 
fined largely  through  the  use  of  the  reflection  sheet  distributed 
to  teachers  prior  to  the  group  discussion. 

Results 

Self  Assessment  Indicators 

An  area  that  teachers  commented  on  extensively  was 
the  indicators  or  “triggers”  which  caused  them  to  self-assess 
their  practice.  For  example,  in  discussing  how  they  knew  a 


lesson  was  going  well  or  poorly,  teachers  identified  two  distinct 
types  of  indicators:  process  indicators  which  occurred  during  or 
inside  of  practice  and  product  indicators  which  occur  after  or 
outside  of  practice. 

Process  indicators  occurred  during  teaching  practice  and 
involved  using  students’  reactions  as  an  ongoing  barometer  of 
the  success  or  failure  of  a lesson.  Not  unexpectedly,  all  teach- 
ers reported  constant  self-assessment  of  their  teaching  through 
students’  reactions  and  involvement.  The  most  commonly  used 
process  indicators  were  svidents’  attentiveness,  body  language, 
questions,  and  facial  expressions;  indicators  that  exist  in  abun- 
dance during  the  teaching  process.  Most  of  these  indicators 
occurred  spontaneously  and  informally  during  instruction. 
Teachers  also  noted  that  interpreting  process  indicators  is  some- 
what intuitive  and  that  accurate  interpretation  was  vital  to  effec- 
tive utilization  of  these  indicators  as  signals  for  self-assessment. 

I watch  their  feet  a lot,  if  their  feet  are  wiggling  around,  I 
know  they  are  kind  of  “antsy.”  Either  nervous  or  bored, 
but  when  their  attention  is  really  riveted  they  don’t  move 
at  all. 

I tend  to  use  vocabulary  that’s  above  their  grade  level  so 
I’m  constantly  tuning  in  to  facial  expressions  and  I’ve 
really  tuned  into  a blank  look. 

If  they’re  all  over  the  place,  wiggling  all  over  the  place, 
you  know  that  you’ve  gone  on  too  long  and  they’re  not 
getting  it,  or  it  means  you  should  try  something  different. 

To  give  an  example,  we  do  a science  unit  on  sound  and 
you  have  this  “feel”  for  when  things  are  going  — when 
it’s  genuine  interest  or  involvement,  or  when  it’s  just 
stepped  over  the  edge.  They’re  losing  it  and  are  distracted, 
they’re  misusing  the  equipment  or  whatever.  I mean  it  is 
just  very  clear. 

Self-assessment  product  indicators  were  linked  to  post- 
teaching activities  and  thus  focused  on  indicators  such  as  the 
frequency  and  type  of  questions  students  raised,  and  student  frus- 
tration or  excitement  levels  immediately  at  the  end  of  the  teach- 
ing process.  Other  product  indicators  surfaced  well  after  teach- 
ing was  completed:  students’  demonstrated  knowledge  from  one 
lesson  to  the  next,  parental  feedback  concerning  student’s 
progress,  and  even  past  students  returning  to  visit. 

When  students  that  I’ve  had  in  elementary  school  come 
back  to  me  in  high  school  or  in  college  (or  parents)  and 
tell  me  what  kind  of  effect  such  and  such  a thing  had  - 
then  that  is  when  I feel  that  I’m  doing  the  right  thing. 
Whether  they  go  to  their  desk  immediately  . . . slow  to 
get  up  and  drag  and  not  ready  to  start — and  show  look  of 
puzzlement  . . . But  also,  kids  in  their  own  voices  will 
say:  “I  don’t  understand  any  of  this!” 

The  kids’  responses  are  really  important  and  I’d  like  to 
see  kids  carry  things  over.  I’m  not  talking  around  the  time 
of  the  lesson,  I’m  talking  days  or  weeks  later.  How  are 
the  kids  responding  to  that  one  lesson,  are  they  even  us- 
ing it,  is  it  something  applicable  to  their  every-day  lives, 
and  you  hear  them  using  it. 

I do  put  a lot  of  weight  on  students  sharing  with  me  what 
they  have  learned,  whether  it’s  in  a journal  from  a student 
who  has  a lot  of  difficulty  or  blocks  about  writing,  what 
they’re  getting  out  of  something  in  answering  specific 
questions,  talking  to  them, ...  all  of  that  goes  into  whether 
I’m  doing  what  I think  I need  to  be  doing  as  a teacher  and 
evaluating  that  as  it’s  going  on. 

Thus,  as  evidenced  by  these  comments,  teachers  do  view 
themselves  as  self-assessing,  are  prodded  by  informal  process 
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and  more  formal  product  indicators,  and  derive  most  of  their 
evidence  from  student -generated  sources. 

Formal  Evaluation  Measures 

A second  theme  which  emerged  from  the  focus  groups 
was  a reported  general  lack  of  impact  that  many  types  of  for- 
mal evaluation  information  had  on  teachers'  self-assessments. 
For  example,  students’  standardized  test-scores  and  homework 
were  not  viewed  as  being  especially  helpful  in  informing  self- 
assessment  by  most  teachers. 

So,  generally  homework  for  me  is  a reinforcer.  I gener- 
ally like  to  think  that  it’s  [the  topics  covered  in  the  home- 
work assignment)  something  they’ve  got  a pretty  good 
grasp  on.  Every  now  and  then  you  get  surprised  and  it 
comes  back  and  you're  like:  “Oh,  I thought  they  knew 
what  they  were  doing  here!” 

I use  homework  for  different  kind  of  assessment.  I use 
it  for  an  assessment  of  their  own  sense  of  responsibility. 

It’s  [homework]  an  assessment  of  — do  they  have  a study 
space  at  home,  how  reliable  are  they  in  returning  stuff, 
do  they  get  assistance  or  do  they  not  get  assistance. 

I don’t  put  much  weight  on  formal  testing.  I do  put  a lot 
of  weight  on  students  sharing  with  me  what  they  have 
learned. 

I can  see  where  it  would  be  easy  to  fall  into  a trap  if  you 
want  your  kids  to  do  well  on  a standardized  test,  and  if 
they  don’t  do  well,  does  that  mean  that  you  need  to  ad- 
just your  teaching  to  allow  them  to  do  better  on  stan- 
dardized tests?  So  in  that  sense  you  are  self-assessing. 
Okay,  I need  to  change  my  curriculum  to  allow  kids  to 
do  well  on  the  standardized  test,  but  if  you’re  not  a per- 
son who  has  sU-ong  beliefs  in  general  about  what  stan- 
dardized tests  tell  you  - then  maybe  you  need  to  say 
‘Well,  that’s  interesting!’  and  move  on. 

I don’t  find  tests  very  helpful  [in  my  self-assessment]. 
Every  year  the  fourth  grade  does  the  assessment  test.  I 
just  didn’t  find  that  helpful.  I didn’t  fmd  that  it  matched 
what  I was  doing,  didn’t  match  the  core  curriculum  that 
we’re  teaching  at  all.  ...  I guess,  no,  it  didn’t  help  me 
because  I didn’t  feel  like  I could  do  anything  better  un- 
less I literally  taught  the  test. 

Similarly,  for  most  teachers,  the  principal's  formal  evalu- 
ations were,  in  themselves,  not  viewed  as  providing  useful  in- 
formation for  self-assessments.  Teachers  did  feel  that  they 
gained  more  insight  about  their  practice  from  their  preparation 
for  the  evaluation,  than  from  results  provided  by  the  principal. 
This  perception  suggests  that  the  process  of  preparation  for  an 
evaluation  constitutes  a useful  self-assessment  activity  for  teach- 
ers. It  is  likely  that  an  impending  evaluation  forces  teachers  to 
step  out  of  the  action  of  teaching  and  begin  to  reflect  more 
thoughtfully  on  their  teaching  practices  and  beliefs. 

Many  of  the  teachers  felt  that  principals'  evaluations  had 
the  potential  to  be  a useful  source  of  self-assessment  informa- 
tion. Specifically,  teachers  felt  that  principals'  evaluations 
would  be  more  useful  if  the  principals  were  better  trained,  spent 
more  time  getting  to  know  the  classrooms  they  evaluate,  placed 
a greater  emphasis  on  improving  teaching,  and  followed  up  on 
suggestions  they  make.  Overall,  there  was  agreement  that, 
based  on  their  experiences,  the  results  of  traditional  principal 
evaluations  themselves  provided  little  relevant  information  for 
self-assessment. 


I learned  more  preparing  for  those  visits  [principal’s 
evaluation).  . . . You’re  preparing,  you’re  planning, 
you’re  thinking  about  your  style.  Y ou’re  thinking  “what 
is  the  best  thing  I want  to  do?  What  do  I want  to  show 
this  person?” 

I naively  went  into  it  [the  evaluation]  thinking  that  the 
purpose  of  a principal  coming  into  the  classroom  was  to 
be  helpful  to  me,  to  say  ‘you  should  do  this  this  way’ 
but  it  really  isn’t  that  — in  that  it  is  set  up  to  fmd  out  if 
you’re  going  to  be  rehired  or  not. 

I was  observed  last  year  and  the  principal  kept  a beauti- 
ful running  record  of  the  entire  classroom,  and  that  to 
me  was  wonderful . . . except  that  in  the  evaluation  there 
was  little  or  no  reference  to  the  beautiful  running  records 
that  were  kept.  . . and  then  there’s  no  follow-through. 

Time 

The  most  frequently  noted  theme  focused  on  teachers’ 
concerns  about  time.  Lack  of  time  was  seen  as  the  primary 
impediment  to  self-assessment,  with  special  emphasis  on  the 
constant  daily  interruptions  that  teachers  must  contend  with 
and  the  furious  pace  of  teaching.  The  time  allocation  problem 
became  a personal  bargaining  situation  for  teachers,  one  in 
which  they  noted  that  self-reflection  and  self-assessment  are 
often  the  first  activities  bargained  away. 

In  one  sense  this  seems  contradictory,  since  the  teachers 
who  earlier  reported  engaging  in  various  types  and  levels  of 
self-assessment  also  feel  they  don’t  have  enough  time  to  self- 
assess.  The  distinction  between  reflection  inside  and  outside 
of  practice  sheds  light  on  this  apparent  contradiction.  Teach- 
ers reported  doing  a great  deal  of  self-assessment  “inside”  prac- 
tice, that  is,  the  automatic,  ongoing,  informal  reflection  and 
monitoring  that  occurs  simultaneously  with  the  teaching  pro- 
cess. However,  self-assessment  “outside”  practice,  that  is  more 
formal,  reflective,  time-consuming  self-assessment,  such  as 
occurs  prior  to  the  principal’s  evaluation  visit,  is  difficult  to 
fmd  the  time  to  do. 

I really  don’t  have  much  time  to  do  this  and  that  [self- 
assess]  in  the  frantic  pace  we’re  keeping.  It’s  [self-as- 
sessment] not  something  we  really  take  time  to  do  a lot 
of. 

I think  we  need  to  have  those  kinds  of  times  when  we 
can  sit  and  we  just  talk  about  what’s  working  and  what’s 
not,  and  remind  each  other  of  what  we  know  and  what 
we  use,  and  bring  it  to  the  forefront  because  there  is  not 
enough  time  for  that. 

I don’t  think  we  put  enough  emphasis  on  this  [self-as- 
sessment] because  of  the  frantic  pace,  you  barely  have 
time  to  do  all  the  other  things  that  somehow  take  prior- 
ity. 

It’s  frustrating,  and  I think  that  sometimes  teachers  feel 
put  upon  because  so  much  is  expected  and  sometimes 
your  self-assessment  can  fall  into  the  cracks. 

A second  dimension  of  time  noted  by  teachers  concerned 
the  fact  that  certain  points  in  the  school  year  have  particularly 
time-consuming  activities  that  must  be  completed;  for  example, 
the  administration  of  standardized  tests  or  giving  report  card 
grades.  At  these  times,  it  is  especially  difficult  for  teachers  to 
fmd  time  to  engage  in  outside-of-practice  self-assessment  ac- 
tivities. Finally,  teachers  mentioned  that  self-assessment  in 
the  beginning  of  the  school  year  is  difficult  because  they  do 
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not  know  their  new  students  very  well  and  thus  have  a difficult 
time  interpreting  process  indicators. 

Overall,  the  teachers  interviewed  felt  that  when  they  were 
able  to  take  the  time  to  engage  in  formal  self-assessment,  it 
was  time  well  spent.  They  said  they  gained  valuable  insights 
which  were  reflected  in  future  teaching.  Furthermore,  these 
teachers  reported  feelings  of  frustration  from  knowing  how 
valuable  self-assessment  outside  of  practice  can  be,  and  not 
being  able  to  find  the  time  to  carry  it  out. 

Assessment  Support 

Another  theme  common  to  all  of  the  focus  groups  was 
the  teachers’  desire  for  support  to  conduct  self-assessment. 
Teachers  mentioned  that  administrators  needed  to  be  support- 
ive by  providing  time  for  them  to  conduct  in-depth,  formal, 
“outside”  practice  type  of  self-assessment;  as  well  as  relevant, 
meaningful  professional  development  experiences.  In  provid- 
ing support,  it  was  imperative  that  administrators  foster  a “safe” 
environment  for  teachers  to  engage  in  self-assessment.  A safe 
environment  was  viewed  as  one  in  which  teachers  could  en- 
gage in  self-assessment  activities  secure  in  the  knowledge  that 
any  evidence  collected  would  be  used  solely  for  personal  im- 
provement purposes.  Furthermore,  teachers  felt  that  it  would 
be  beneficial  for  administrators  to  schedule  time  for  teachers 
to  share  their  experiences  with  each  other. 

But  you  [another  teacher  in  the  group]  bring  in  a really 
important  piece,  and  that  is  the  ability  to  look  at  myself 
and  not  feel  threatened  by  that.  And  that,  that’s  a safety 
issue  for  educators.  I mean,  we  try  to  create  safety  within 
our  own  classrooms,  but  as  educators  we  need  to  have 
that  same  level  of  safety. 

A common  expression  is  that  you  get  your  best  ideas 
from  other  teachers  at  school.  I think  that’s  true,  but  in 
the  past  we  haven’t  been  encouraged  to  do  it,  and  people 
view  it  as  threatening.  They  view  it  as  another  kind  of 
evaluation,  and  that  the  bottom  line  in  any  of  this  is  if 
you  really  want  to  make  adjustments  in  your  practice 
and  you  involve  another  person,  you  have  to  trust  them. 

I think  that’s  very  specific  to  buildings  and  the  people  in 
the  environment.  I’ve  worked  in  a place  where  it  wasn’t 

— it  wasn’t  safe  to  ask  for  help,  so  you  stop  assessing 
after  a while.  . . . you  almost  got  to  the  point  where  I 
don’t  want  to  know  when  I’m  messing  up  because  I can’t 
go  to  anybody  anyway.  I’m  in  here  all  on  my  own  with- 
out any  support  - so.  I’m  just  going  to  try  to  survive. 

So  once  you  kind  of  highlight  what  you  want  to  work 
on,  you  have  to  rely  on  larger  factors  to  help  you  grow 

— like  the  administration.  There  has  to  be  enough  op- 
portunity offered  for  teachers  to  work  — one  is  sitting 
in  in-service. 

Support  from  colleagues  was  also  viewed  as  an  impor- 
tant component  in  the  creation  of  a safe,  non-competitive,  pro- 
fessional environment.  Collegial  support  was  seen  as  a neces- 
sity in  order  to  divert  any  tension  which  might  result  from  a 
competitive  environment  and  away  from  the  self-assessment 
experience.  Also,  teachers  expressed  a desire  to  discuss  with 
other  teachers  as  they  conducted  their  self-assessments,  valu- 
ing an  objective  perspective  and  peer’s  experiences^  well  as 
the  understanding  and  satisfaction  that  comes  from  sharing  the 
results  of  their  self-assessments  with  other  teachers. 

Again,  I think  that’s  why  it’s  so  important  to  have  a 
chance  to  talk  to  other  people  about  those  kinds  of  things 


[negative  and  positive  experiences  in  the  classroom]  be- 
cause they  can  really  help  you  . . . sometimes  just  talk- 
ing it  out  with  someone  — you  almost  know  the  answer 
yourself  in  terms  of  what  you  should  have  done. 

When  you  talk  to  someone  about  it  [positive  and  nega- 
tive experiences  in  the  classroom]  you  hear  yourself  say 
it  and  you  think  about  it.  But,  also  you  get  the  support 
from  each  other  — that’s  real  important. 

I mean  I’ve  had  teachers  come  up  to  me  and  say,  why 
are  you  doing  that?  Are  you  just  doing  that  to  make  us 
look  bad?  To  me  they  were  very  serious.  It  really  both- 
ers me  because  I don’t  look  at  it  [teaching]  as  competi- 
tion. 

Standards 

A final  theme  from  the  focus  group  discussions  concerned 
the  standards  teachers  used  to  make  judgments  about  their  prac- 
tice. The  term  “standard”  was  purposely  used  in  the  group 
discussions  to  focus  teacher  responses  on  the  implicit  or  ex- 
plicit levels  or  benchmarks  they  used  in  self-assessment  to  de- 
termine the  success  or  failure  of  activities  or  outcomes.  This 
theme  investigates  whether  or  not  teachers  had  conscious  stan- 
dards for  judgment,  and  the  nature  and  stability  of  these  stan- 
dards. 

All  teachers  said  they  did  have  standards  for  their  self- 
assessments,  but  had  a difficult  time  describing  them  precisely. 
In  attempting  to  define  their  self-assessment  standards  or  crite- 
ria utilized,  the  attainment  of  a particular  goal  or  objectives 
was  voiced  repeatedly.  The  discussion  included  descriptions 
of  concrete  and  also  more  fleeting  goals.  Concrete  goals  in- 
cluded reaching  mandated  curriculum  aims,  monitoring  gen- 
der bias  behaviors,  and  maximizing  individual  student  academic 
and  social  development.  Less  concrete  goals  were  also  noted 
by  teachers  when  they  spoke  of  a “feel  for,”  a “sense  of,”  or 
“an  intuition  about”  the  ideal  noise,  activity  or  interest  level  in 
a “successful”  classroom.  Questions  of  how  teachers  identi- 
fied deviations  from  the  ideal  produced  responses  of  “it’s  a 
feeling,”  “I  just  know,”  and  the  like. 

I wonder  how  much  of  it  [standards]  is  sort  of  an  intui- 
tive gut  feeling  that  grows  and  gains  substance  and  depth 
the  more  years  in  which  you  teach. 

In  the  school  I came  from  [attended]  before  I became  a 
teacher  . . . teachers  would  play  favorites.  No  matter 
what  you  did  you  could  never  please  them.  So,  when  I 
became  a teacher,  I made  up  my  mind  that  if  I didn’t  do 
anything  else,  I was  going  to  be  fair  and  treat  everyone 
equally.  So,  I work  very  hard  at  that. 

I think  that  I’m  comparing  myself  to  the  best  of  what 
I’ve  read . . . I’m  looking  for  the  best  that  is  out  there  in 
terms  of  research. 

It’s  to  me  always  a question  of  how  well  the  kids  are 
doing.  ...  I sort  of  look  to  them  to  reflect  back  to  me 
how  well  I’m  doing.  If  they’re  not  getting  it . . . and 
they’re  looking  at  me  like  "I  don’t  get  this! ,?  you  know  if 
they’re  confused  or  if  they’re  frustrated,  that’s  sort  of  a 
mirror  for  how  well  I’m  doing. 

It  is  interesting  to  note  that  teachers  differed  in  the  stan- 
dards they  used  to  assess  common  issues  such  as  classroom 
control  or  academic  growth  Also,  teachers’  personal  standards 
were  flexible  and  context  dependent,  such  that  a teacher’s  stan- 
dards could  be  altered  based  on  the  nature  of  an  activity  or 
their  own  personal*mental  and/or  physical  comfort  level. 
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A complicating  factor  to  add  to  that  is  your  own  mental 
frame.  Some  days  you  can  handle  more  than  others  and 
other  days  you  look  at  it  and  say  “if  that  had  been  yes- 
terday I would  have  said  Okay,  but  it  isn’t  yesterday  and 
my  whole  mental  outlook  today  was  such  that  I couldn’t 
handle  this.” 

Now  my  style  and  my  counterpart  in  the  building ...  it’s 
very  different.  I’m  able  to  tolerate  a lot  of  noise.  You 
know,  that’s  just  our  different  styles.  So, . . . if  it’s  noisy 
and  they’re  involved  — that’s  fine.  But,  to  someone 
else,  it  may  seem  that  my  room’s  totally  out  of  control. 
Sometimes  what  you  thought  were  certain  standards  are 
thrown  right  out  the  window  because  you’re  dealing  with 
new  issues.  I think  a lot  of  it  comes  with  a certain  expe- 
rience of  working  with  people. 

You  still  have  to  stand  on  your  judgments,  because  1 
have  a different  feeling  or  philosophy  on  how  something 
is  going  to  work  in  my  class.  Or  a different  personal 
style,  1 happen  to  be  very  loud  and  boisterous^and  a per- 
son who  is  very  quiet  and  reserved  may  have  to  use  an- 
other course.  You  still  have  to  be  some  sort  of  judge 
about:  Well  is  this  going  to  fit  in,  does  this  fit  in  with 
what  I believe  in,  does  this  fit  with  what  I can  do,  does 
this  fit  with  my  personality  and  style? 

Summary 

Overall,  teachers  described  self-assessment  as  an  on-go- 
ing, unconscious  process  involving  many  different  types  of  cues. 
The  cues  or  indicators  tended  to  break  into  two  groups,  those 
associated  with  the  teaching  process  and  those  associated  with 
teaching  products.  The  vast  majority  of  process  indicators  were 
associated  with  immediate  student  feedback  to  the  teaching  pro- 
cess. Product  indicators  were  linked  to  post-teaching  activities 
and  included  student  frustration  and  excitement  levels,  parental 
feedback,  and  measures  of  student  academic  growth.  While 
process  and  product  indicators  were  seen  to  be  valid  evidence 
for  informing  their  self-assessments,  the  majority  of  teachers 
viewed  formal  student  and  teacher  assessment  measures,  such 
as  standardized  tests  and  principal’s  evaluations,  as  consider- 
ably less  valid  and  useful. 

The  major  impediment  to  self-assessment  was  time. 
Teachers  were  frustrated  by  the  lack  of  quality  time  they  had  to 
carry  out  formal  out-of-practice  reflection  relative  to  their  de- 
sire to  engage  in  self-assessment  activities.  Teachers  noted  that 
administrative  and  collegial  support  were  necessary  to  foster  a 
suitable  environment  in  which  self-assessment  could  occur. 
Administrative  support  desired  by  teachers  included  unencum- 
bered release  time  and  appropriate  professional  development 
experiences.  In  addition  to  support  from  the  administration, 
support  from  colleagues  was  also  noted  as  invaluable  to  the 
creation  of  a “safe”  environment  in  which  honest  self-assess- 
ment could  be  carried  out. 

A final  theme  which  emerged  from  the  group  discussions 
concerned  teachers’  standards  for  their  self-assessments.  Teach- 
ers strove  for  both  concrete,  tangible  self-assessment  goals  such 
as  reaching  mandated  curriculum  aims,  as  well  as  more  abstract 
ones  in  which  they  relied  upon  intuition  and  feelings.  More- 
over, goals  and  objectives  varied  from  teacher  to  teacher,  and 
were  adjusted  according  to  the  classroom  context  at  any  par- 
ticular time. 

From  this  initial  investigation,  it  is  evident  that  teachers 
engage  in  a variety  of  self-assessment  activities  and  find  them 


useful  in  understanding  and  improving  their  teaching  practices. 
It  is  also  apparent  that  teachers  need  more  quality  time,  rel- 
evant feedback,  and  a strong  support  network  to  participate  in 
meaningful  self-assessment.  Given  the  harried  pace  of  teach- 
ing, the  need  for  immediate  feedback,  and  lack  of  formal  re- 
flection time,  teachers  may  come  to  over-rely  on  informal,  in- 
ternal, “inside”  practice  type  of  self-assessment  activities.  It 
has  been  suggested  that  by  supplementing  informal,  unplanned, 
intuitively  based  teacher  self-assessments  with  more  formal, 
planned,  objective  “outside”  practice  techniques,  distortions 
of  self  derived  from  subjective  evidence  may  be  avoided 
(Airasian  & Gullickson,  1994).  Before  self-assessment  can 
inform  professional  development  and  help  teachers,  it  must 
strike  a reasonable  balance  between  data  from  inside  and  out- 
side of  practice. 
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Invitation  for  Proposals 

Annual  Meeting  of  the  Mid-Western  Educational 

Research  Association 

October  2 - 5, 1996 

Holiday  Inn  - Mart  Plaza,  Chicago  Illinois 

Kim  K.  Metcalf,  Program  Chair 

Plan  now  to  attend  the  excfthg  1 996  Annual  Meeting  of  the  Mid-Western  Educational  Research  Association,  The  1 996  program 
includes  a variety  of  features  which  reflect  the  tremendous  growth  and  energy  of  the  organization  while  maintaining  the  strong 
collegiality  and  support  for  which  MWERA  is  known.  A wide  array  of  presentation  formats,  including  symposia,  panel 
discussions,  workshops,  forums,  allow  authors  the  greatest  flexibility  in  disseminating  their  work.  Plenary  session  will  feature 
respected  scholars  representing  a range  of  perspectives  on  education  and  research  issues.  And,  perhaps,  most  exciting  will 
be  the  new  confs^ince  site,  the  Holiday  Inn  at  Mart  Plaza.  The  hotel  features  comfortable,  modem  conference  rooms,  spacious 
guest  rooms  ov  ing  breathtaking  views  from  high  above  the  city,  an  indoor  pool  and  exercise  facility,  and  hundreds  of  shops, 
restaurants,  and  entertainment  only  a short,  safe  walk  away. 

Please  accept  this  invitation  to  participate  in  the  1996  Annual  Meeting.  Mid-Western  Educational  Research  Association  offers 
researchers  and  scholars  of  all  types,  perspectives,  and  levels,  the  opportunity  to  share  ideas  in  a supportive  yet  challenging 
environment,  to  strengthen  existing  professional  friendships,  and  to  build  new  ones. 


General  Information 


1.  Any  educational  professional  may  submit  a proposal,  whether  or  not 
a membar  of  MWERA.  Non-members  must  join  MW  ERA  upon 
notification  of  an  accepted  proposal. 

2.  Typical  presentation  formats  Include  paper  presentations, 
roundtables,  poster-paper  sessions,  and  symposia,  among  others. 
However,  alternative  or  experimental  formats  which  may  be  better 
suited  to  the  nature  of  the  research  are  welcomed.  Participants  are 
encouraged  to  propose  formate  which  best  communicate  their 
scholarship  or  which  promote  scholarly  debate  about  research  and 
theoretical  Issues.  The  Program  Committee  reserves  the  right  to 
make  final  decisions  concerning  presentation  format,  grouping,  or 
scheduling. 

3.  All  proposals  must  be  received  by  the  appropriate  senior 
dMskm  chair  not  later  than  April  1, 199*.  No  submissions  will  be 
accepted  by  FAX  or  e-mail.  Please  note  that  this  date  Is 
approximately  one  month  earlier  than  in  the  past 

4.  Papers  presented  at  MWERA  are  expected  to  present  original 
scholarship  conducted  by  the  authors)  and  which  has  not  been 
previously  published.  Further,  K is  a violation  of  MWERA  policy  to 
promote  commercially  available  products  or  services  (except  as 
Exhibits)  which  go  beyond  the  limits  of  appropriate  schotarty/scJentific 
commtuiceboa  IndMduals  who  wish  to  display  educationally  related 
products  or  services  are  encouraged  to  contact  Dr.  Sharon  McNeety, 
Assistant  Program  Chair  for  Exhibits,  P.O.  Box  34421,  Chicago, 
Illinois  60634,  (312)  794-2788. 

5.  Al  persons  attending  the  Annual  Meeting,  whether  as  participants  or 
presenters  are  expected  to  register  for  the  meeting.  All  sessions 
listed  in  the  program  wiH  be  open  to  any  registered  participant; 
however,  enrolment  may  be  limited  and  a small  additional  fee  may  be 
required  for  tome  workshop  sessions.  Registration  materials  for  the 
Annual  Meeting  will  be  published  In  the  Mkt-Wastam  Educational 
Rasaarchar  or  can  be  obtained  by  contacting  the  Program  Chair  or 
any  Division  Chair. 

6.  Presenters  are  responsible  for  submitting  a completed  version  of  their 
conference  paper  to  both  the  chair  and  discussant  assigned  to  their 
session  on  or  before  September  15, 1996.  Papers  not  available  to  the 
discussant  and  chair  may  be  eliminated  from  the  program  at  the 
discretion  of  the  session  chair. 

7.  Presenters  must  provide  complete  copies  of  their  papers  or  detailed 
handouts  to  attendees  at  their  sessions. 

6.  Overhead  projectors  and  screens  will  be  provided  by  MWERA  in 
most  rooms.  Presenters  who  will  need  additional  AV  equipment  are 
responsible  for  arranging  such  with  the  hotel  and  at  the  presenter's 
expense. 

9.  MWERA  reserves  the  right  to  reproduce  and  distribute  summaries 
and  abstracts  of  al  accepted  proposals.  Unless  expressly  prohibited 
in  writing  by  the  authors),  summaries  may  also  be  made  available  to 
the  press  or  other  interested  parties  upon  request.  Such  limited 
distribution  does  not  preclude  subsequent  publication  by  the 
authors). 

1 0.  Authors  of  accepted  proposals  assume  the  ethical  and  professional 
responsibility  to  appear  at  the  Annual  Meeting  and  to  participate  in 
their  presentation  or  assigned  session.  When  circumstances 
preclude  authors)  from  doing  so,  it  is  the  responsibility  of  the  author 
to  arrange  a suitable  substitute  and  to  notify  the  Program  Chair  in 
advance. 


Poster  Session:  Poster  sessions  allow  extended,  one-to-one  Interaction 
between  authors  and  interested  Individuals.  Authors  of  several 
papere  are  provided  space  in  which  they  can  display  posters  or  other 
visual  materials  which  reflect  the  nature  of  their  papers  for  45-50 
minutes,  interested  indMduate  are  free  to  move  from  poster  to  poster, 
inquiring  of  or  talking  with  authors  of  their  choice.  Authors  are 
expected  to  provide  complete  copies  of  the  paper  on  which  the  poster 
Is  based  to  all  interested  individuals. 

Symposium:  A symposium  is  intended  to  provide  an  opportunity  for 
examination  of  specific  problems  or  topics  from  a variety  of 
perspectives.  Symposium  organizers  are  expected  to  identify  the 
topic  or  issue,  identify  and  ensure  the  participation  of  individual 
speakers  who  wi  participate,  prepare  any  necessary  materials  for  the 
symposium,  and  chair  the  session.  It  Is  suggested,  though  not 
required,  that  the  speakers  or  symposium  organizer  will  provide  to 
Interested  individuals  one  or  more  papers  relevant  to,  reflective  of,  or 
drawn  from  the  symposium. 

Roundtable  Session:  Roundtable  sessions  are  intended  to  provide 
opportunities  for  interested  Individuals  to  participate  In  a dialogue  with 
other  interested  individuals  and  the  authors)  of  a paper.  Authors  are 
provided  a small  table  around  which  interested  individuals  can  meet 
to  discuss  the  authors)*  paper.  Interested  Individuals  are  free  to 
move  Into  and  out  of  these  discussions  as  they  wish.  Authors  are 
expected  to  make  avaiabie  complete  copies  of  the  paper  on  which  the 
roundtable  discussion  was  focused. 

Discussion  Group/Forum:  These  sessions  are  intended  to  allow 

maximum  interaction  between  the  session  organizers  and  interested 
individuals  on  a topic  or  issue  of  debate  or  interest  Unlike  a 
symposium,  wherein  the  organizer  intentionally  invites  individuals  who 
represent  particular  points  of  view  to  speak  to  audience  members,  the 
discussion  or  forum  formats  are  designed  to  provoke  discussion 
among  aU  participants.  The  organizer  Is  expected  to  identify  a topic 
or  issue  which  is  likely  to  be  of  Interest  and  a provocative  way  of 
initiating  the  discussion,  and  to  monitor  or  mediate  the  discussion. 

Workshop:  Workshops  are  intended  to  provide  an  extended  period  of  time 
during  which  the  workshop  leader  helps  participants  develop  or 
improve  their  ability  to  perform  some  process  (e.g.t  how  to  provide 
clinical  supervision  or  appropriately  use  loglinear  analysis). 
Organizers  may  request  from  1-1/2  to  3 hours,  and  are  responsible 
for  providing  ail  necessary  materials  for  participants.  Workshops 
typically  are  scheduled  for  Wednesday  afternoon,  but  may  be 
scheduled  throughout  the  conference.  Organizers  may,  if  they  wish, 
receive  an  honorarium  based  upon  the  number  of  participants  In  their 
workshop. 

Alternative  Session:  The  form,  topics,  and  format  of  alternative  sessions 
are  limited  only  by  the  Imagination  and  creativity  of  the  organizer. 
These  options  are  intended  to  afford  the  most  effective  method  or 
approach  to  disseminating  scholarty  work  of  a variety  of  types. 
Proposals  for  alternative  sessions  will  be  evaluated  on  their 
appropriateness  to  the  topic  and  audience,  their  suitability  to  meet 
limitations  of  time,  space,  or  expense  for  MWERA,  and  the  basic 
quality  or  value  of  thf  topic.  The  organizer  of  alternative  sessions  is 
responsible  for  identifying  all  major  participants  or  speakers, 
developing  and  providing  any  necessary  materials,  and  conducting  or 
mediating  the  session.  Because  a variety  of  approaches  may  be 
proposed  within  this  category,  alternative  session  proposals  should 
include  a brief  rationale  for  the  alternative  being  proposed. 


Guidelines  for  Submitting  Individual  Proposals 


Session  Foimat  Descriptions 


Paper  Presentation:  Paper  sessions  are  Intended  to  allow  authors  the 
opportunity  to  make  short,  relatively  formal  presentations  In  which 
they  overview  their  papers  to  an  audience.  Three  to  five  Individual 
papers  dealing  with  related  topics  are  grouped  Into  a single  session 
of  from  1-1/2  to  2 hours.  The  suthor(«)  of  tech  paper  te(are)  allowed 
•pprotomatety  15  minutaa  to  present  the  highlights  of  the  paper,  and 
a stocks  dtocuseart  is  allowed  15  minutes  to  comment  on  the  papers. 
Autoors  are  s^paclsd  to  provide  complete  copies  of  their  papers  to  ad 
interested  audtonce  members. 


Individual  proposals  is  used  to  describe  any  proposal  intended  to 
present  a single  piece  of  scholarship  by  one  or  more  authors.  The  most 
basic  example  of  an  individual  proposal  would  be  one  in  which  an  individual 
scholar  proposes  to  present  a paper  reporting  on  his  or  her  research.  This 
paper  could  be  assigned  to  a paper  session  with  other  similar  papers,  a 
roundtable  session,  or  a poster  session.  Similarly,  in  instances  where 
muftipte  scholars  have  collaborated  on  a single  work,  an  individual  proposal 
would  be  appropriate. 

The  presenting  or  lead  author  of  an  accepted  proposal  must  ensure 
that  the  paper  is  presented  at  the  Annual  Meeting.  If  the  lead  author  is 
unable  to  present  the  paper,  he  or  she  is  responsible  for  arranging  an 
acceptable  substitute  and  for  contacting  the  Division  or  Program  Chair  as 
soon  as  possible. 


Materials  to  be  Submitted  With  an  Individual  Session 
Proposal 


Individual  Proposal  Cover  Sheet  (see  attached).  Six  (6)  copies  with  ail 
items,  including  subject  descriptors,  completed. 

Summary.  Six  (6)  copies  of  a 2-3  page  summary  for  use  in  Judging  the 
marts  of  the  proposal.  Summaries  can  be  single-spaced,  but  must  be  typed 
on  8-1/2x11"  paper  In  no  smaller  than  10  point  type,  with  1"  margins. 
Proposals  which  do  not  meet  these  criteria  may  be  refused  by  the  Division 
Chair  without  review. 

The  summary  should  explicitly  address  as  many  of  the  following  as 
appropriate,  and  preferably  In  this  order,  (a)  objectives,  goals,  or  purposes; 
(b)  perspective(s)  and/or  theoretical  framework;  (c)  methods  and/or 
techniques  (data  source,  instruments,  techniques,  procedures);  (d)  results 
or  conclusions;  and  (f)  educational  or  scientific  importance  of  the  work. 
Individual  proposals  for  alternative  sessions  should  also  Include  a brief 
rationale  for  the  proposed  format. 

For  three  copies  of  the  summary,  the  heeding  should  use  the  following 
format.  In  the  upper  left  comer,  type  the  title  of  the  submission,  authors), 
and  institution^).  in  the  upper  right  comer,  state  the  name  of  the  presenting 
or  lead  author  and  his  or  her  complete  mailing  address  (including  e-mail). 
For  the  remaining  three  copies,  only  the  title  of  the  paper  should  appear. 
Abstract  Three  (3)  copies  of  a 100-150  word  narrative  abstract  should  be 
prepared  for  publication  In  the  Annual  Meeting  Abstracts.  Abstracts  must 
be  type-written,  single-spaced,  using  12-polnt  Aria!  or  Universal  font. 
Use  clear,  precise  language  which  can  be  understood  by  readers  outside 
your  discipline.  In  the  upper  left  comer,  type  the  title  of  the  paper,  the  name 
and  Institutional  affiliation  of  each  author. 

Envelopes.  Four  (4)  stamped,  self-addressed,  business-sized  envelopes. 
These  will  be  used  to  inform  you  of:  (1)  receipt  of  the  proposal  by  the 
division  chair;  (2)  the  decision  about  your  paper's  acceptance;  (3)  your 
scheduled  session  time;  and  (4)  additional  information  which  you  may  need 
prior  to  the  conference. 

Index  Cards.  Two  (2)  3x5"  index  cards.  These  should  contain  the 
following,  typewritten  Information:  (a)  title  of  the  paper  IN  CAPS  across  the 
top;  (b)  the  full  name,  Institutional  affiliation,  complete  mailing  address  with 
zip  code,  business  telephone  number,  FAX  number,  and  e-mail  address  for 
the  lead  or  presenting  author,  and  (c)  full  name  and  institutional  affiliation  of 
each  additional  author. 


Guidelines  for  Submitting  Muftiple-Presonter 
Proposals 


Multiph-pnsontar  proposals  is  used  to  refer  to  proposed  session 
formats  which  are  organized  to  allow  two  or  more  presenters  or  speakers  to 
address  a single  topic,  issue,  or  problem.  Examples  of  these  sessions 
would  Include  symposia,  panel  discussions,  or  forums,  and  alternative 
session  formats  meeting  the  above  criteria.  This  format  is  q&  Intended  to 
allow  each  of  several  authors  to  address  his  or  her  contribution  to  a single 
work.  Rather,  the  multiple  presenters  should  reflect  several  perspectives, 
methodologies,  or  findings  regarding  the  pedicular  topic. 

Organizers  of  multipie-presenter  sessions  are  expected  to  have  the 
consent  of  al  presenters  before  submitting  the  propoeal  and  to  chair  the 
session  or  specify  another  Individual  to  do  so.  The  organizer  of  accepted 
multiple-presenter  proposals  Is  responsible  for  ensuring  that  each  person 
named  as  a participant  will  be  present  at  the  Annual  Meeting.  Should 
unforeseen  circumstances  prevent  a named  participant  from  attending,  the 
organizer  muat  identify  a suitable  replacement,  notify  all  other  presenters  of 
the  change,  and  inform  the  Division  Chair  or  Program  Chair. 


Materials  to  be  Submitted  With  a Multiple-Presenter 
Proposal 


.riuMple-Preeentar  Proposal  Cover  Sheet  (see  attached).  Six  (6)  copies 
with  a*  Items,  Including  subject  deecriptors,  completed. 

Summary.  Sb(  (6)  copies  of  a 2-3  page  summary  for  use  In  judging  the 
marts  of  the  propose.  Summntaacan  be  single  spaced,  but  moat  be  typed 


on  8-1/2x11"  paper  in  no  smaller  than  10  point  type,  with  1"  margins. 
Proposals  which  do  not  meet  these  criteria  may  be  refused  by  the  DMsicn 
Chair  without  review. 

The  summary  should  expUcKty  address  as  many  of  the  foBowing  as 
appropriate,  and  preferably  in  this  order,  (a)  descriptive  titis  of  the  session; 
(b)  the  importance  of  the  topic,  Issue,  or  problem;  (c)  names,  Institutional 
affiliations,  and  specific  contribution  or  perspective  to  be  contributed  to  the 
session  by  each  presenter;  (d)  an  explanation  of  the  basic  format  or 
structure  of  the  session  and  why  It  is  relevant  In  light  of  the  topic;  (e)  a brief 
explanation  of  the  role  of  the  chair,  organizer,  mediator,  or  discussant;  and 
(f)  anticipated  audience  and  audience  involvement 

For  all  copies  of  the  summary,  the  heading  should  use  the  following 
format.  In  the  upper  left  comer,  type  the  full  name,  institutional  affiliation, 
mailing  address  Including  zip  code,  business  telephone,  home  or  evening 
telephone,  and  e-mail  address  of  the  session  organizer. 

Abstract  Three  (3)  copies  of  a 100-1 50  word  narrative  abstract  should  be 
prepared  for  publication  In  the  Annual  Meeting  Abstracts.  Abstracts  must 
be  type-written,  single-spaced,  using  12 -point  Ariel  or  Universal  font. 
Use  clear,  precise  language  which  can  be  understood  by  readers  outside 
your  dtodpine.  In  the  upper  left  comer,  type  the  tide  of  the  paper;  the  name, 
institutional  affitetion,  maing  address,  and  telephone  number  of  the  session 
organizer;  and  fun  name  and  institutional  affiliation  of  each  presenter. 
Envelopes.  Four  (4)  stamped,  business-sized  envelopes,  preaddressed 
to  the  organizer.  These  will  be  used  to  Inform  you  of:  (1)  receipt  of  the 
proposal  by  the  division  chair;  (2)  the  decision  about  the  session's 
acceptance;  (3)  the  scheduled  section  time;  and  (4)  additional  information 
which  may  be  needed  prior  to  the  conference. 

Index  Cards.  Two  (2)  3x5"  index  cards.  These  should  contain  the 
following,  typewritten  Information:  (a)  title  of  the  paper  IN  CAPS  across  the 
top;  (b)  the  full  name,  Institutional  affiliation,  complete  mailing  address  with 
zip  code,  buainset  telephone  number,  FAX  number,  and  e-mail  address  for 
the  session  organizer,  if  other  than  the  session  organizer,  this  information 
must  also  be  included  forth#  session  chair,  mediator,  or  discussant 


Guidelines  for  Submitting  Workshop  Proposals 


Workshop  topics  should  be  of  interest  and  use  to  a sizeable  number  of 
MWERA  members.  Presenters  may  elect  to  receive  an  honorarium  based 
upon  the  number  of  participants  attending  the  workshop.  AH  persons  listed 
as  presenters  are  required  to  appear  at  the  Annual  Meeting  end  to  conduct 
the  workshop  at  the  designated  time.  Most  workshops  will  be  held  on 
Wednesday  afternoon. 


Materials  to  Be  Submitted  With  a Workshop  Proposal 


Workshop  Proposal  Cover  Sheet  (see  attached).  Six  (6)  copies  with  all 
applicable  Mams,  including  descriptors,  completed. 

Summary.  Six  (6)  copies  of  a 2-3  page  summary  for  use  in  judging  the 
marts  of  the  proposal.  Summaries  can  be  single-spaced,  but  must  be  typed 
on  8-1/2x11"  peper  In  no  smaller  then  10  point  type,  with  1"  margins. 
Proposed  which  do  not  meet  these  criteria  may  be  refused  by  the  Workshop 
Chair  without  review. 

The  summary  should  explicitly  address  as  many  of  the  following  at 
appropriate,  and  preferably  In  this  ordar  (a)  descriptive  title  of  the  workshop; 
(b)  objectives,  goals,  purposes  of  the  workshop;  (c)  names,  Institutional 
affiliations,  and  specific  contributions  of  each  workshop  leader;  (d)  the 
importance  or  value  of  the  workshop  for  participants  and  a statement  about 
the  My  attraction  of  the  vxxtohop  for  participants;  (e)  methods,  techniques, 
or  approaches  to  instruction  (especially  how  participants  wW  be  stowed  to 
apply  whet  they  Item);  and  (!)  e brief  description  of  the  presenters)'  relevant 
experience. 

For  all  copies,  the  heeding  of  the  2-3  page  summary  should  use  the 
following  format,  in  the  uppar  left  comer,  type  the  fun  nama,  Institutional 
afflUHon,  malting  addreaa  Including  zip  code,  business  talephooe,  home  or 
evening  telephone,  and  e-mal  addreaa  of  aach  workshop  leader  or 

Abstract  Three  (3)  copies  of  • 100-1 50  word  narrative  abstract  should  be 
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be  type-written,  atngte-epaoad,  using  12-polnt  Ariel  er  Universal  font. 


Use  clear,  precise  language  which  can  be  understood  by  readers  outside 
your  discipline,  in  the  upper  left  comer,  type  the  title  of  the  workshop,  the 
name  and  Institutional  imitation  of  the  workshop  organtzer(s). 

Envelopes.  Four  (4)  stamped,  business-sized  envelopes,  preaddressed 
to  the  workshop  organizer  for  (1)  acknowledgement  of  receipt  of  the 
proposal  by  the  Workshop  Chair,  (2)  notification  of  the  acceptance  of  the 
workshop  propose!;  (3)  scheduled  workshop  time;  and  (4)  additional 
Information  which  may  be  needed  pricr  to  the  conference. 

Index  Cards.  Two  (2)  3x5"  index  cards,  typed  In  the  fotiowing  format  (a) 
title  of  the  workshop  IN  CAPS  across  Jhe  top;  (b)  full  name  of  organizer 
fbfcwsd  on  aubeequtrt  inse  by  Ns  or  her  complete  maHlng  address  with  zip 
code,  business  and  home  telephone  numbers  with  ares  code,  FAX  number, 
and  e-mail  address. 

Workshop  proposals  should  be  submitted  to  Dr.  Mary  Ann  Wham, 
CoVtge  of  Education,  University  of  WIsconsJn-Whitewater,  800  West 
Main  Street,  Whitewater,  Wisconsin  83180. 


Where  To  Submit  Proposals 


Proposals  should  be  submitted  to  the  Chair  of  the  division  listed  below  with 
which  I is  most  doeeiy  afigned.  Proposals  may  be  submitted  to  only  one 
division.  Dhrtston  Chairpersons  hold  the  right  to  forward  proposals  which 
they  believe  might  best  be  suited  to  another  division  to  the  appropriate 
Division  Chair.  Questions  about  the  appropriateness  of  proposals  for 
particular  divisions  should  be  directed  to  the  Division  Chairs. 

For  consideration,  complate  proposal  materials  must  be  received  by 
the  Division  Chair  not  later  than  April  1, 1898. 


Division  A:  Administration  and  Leadership 


This  division  Is  concerned  with  research,  theory,  development,  and  the 
In^xowirnent  of  practice  In  the  organization  and  administration  of  education. 

Larry  McNeil 

Department  of  Educational  Administration  & Foundations 
Illinois  State  University 
Degalmo  Hall,  Room  331 
Normal,  Illinois  61790-5900 
(309)438-5155 
GILSTU.EDU.LMCEA 


Division  B:  Curriculum  Studies 


ThfacfvWon  It  concerned  with  curriculum  and  instructional  practice,  theory, 
and  research. 

Jay  C,  Thompson,  Jr. 

Department  of  Educational  Leadership 
TC915 

Ball  State  University 
Munde,  Indiana  473000590 
(317)285-5350 


Division  C:  Learning  and  Instruction 


This  division  Is  concerned  with  theory  and  research  on  human  abilities, 
learning  styles,  Individual  differences,  problem  solving,  and  other  cognitive 
factors. 

Stephen  L.  Benton 

Department  of  Counseling  & Educational  Psychology 
369  Bkiemoot  Hall 
Kansas  State  University 
Manhattan,  Kansas  66506 
(913)  532-5784 
LEROY©KSUVM.KSU.EDU 


Division  D:  Measurement  and  Research 
Methodology 


This  division  Is  concerned  with  measurement,  statistical  methods,  and 
research  design  applied  to  educational  research. 

Thomas  S.  Parish 
Professor  and  Assistant  to  the  Dean 
College  of  Education 
Kansas  State  University 
447  Bluemont  Hall 
Manhattan,  Kansas  66506 
(913)  532-5537 

TPARISH©KSUVM.KSU.EDU 


Division  E:  Counseling  and  Development 


This  division  Is  concerned  with  the  understanding  of  human  development, 
special  education,  and  the  application  and  improvement  of  counseling 
theories,  techniques,  and  training  strategies. 

Eddie  E.  Glenn 
Illinois  State  University 
P.O.  Box  733 
Normal,  IHinois  61761 
(309)438-7884 


Division  F:  History  and  Philosophy 


This  dMsk>n  is  concerned  with  the  findings  and  methodologies  of  historical 
research  In  education. 

Louise  E.  Fleming 
Ashland  University 
313  BWer  Hall 
Ashland,  Ohio  44805 
(419)  289-5347 


Division  G:  Social  Context  of  Education 


Workshops 


This  division  Is  concerned  wKh  theory,  practice,  and  research  on  social, 
moral,  affective,  and  motivational  characteristics  and  development,  especially 
multicultural  perspectives. 


Clara  New 

University  of  Wisconsin  - ParksJde 
800  Wood  Road,  Box  2000 
Kenosha,  Wisconsin  531 41 -2000 
(414)  595*2015 
NEWQCSUWP.EDU 


Mary  Ann  Wham 
College  of  Education 
University  of  Wisconsin  - Whitewater 
800  W.  Main  Street 
Whitewater,  Wisconsin  531 90 
(414)  472-5377 

WHAMMQUWWVAX.UWW.EDU 


Exhibits 


Division  H:  School  Evaluation  and  Program 
Development 


This  division  is  concerned  with  research  and  evaluation  to  improve  school 
practice,  including  program  planning  and  Implementation. 

John  W.  Fraas 
220  Andrews  Hail 
Ashland  University 
Ashland,  Ohio  44805 
(419)289-5930 
JFRAASQASHLAND.EDU 


Division  I:  Education  in  the  Professions 


MWERA  welcomes  individuals  and  companies  who  wish  to  display 
commercially  available  products,  materials,  or  services  which  may  be  of 
interest  to  our  members.  Such  displays  often  include  current  publications, 
software,  instructional  materials,  media,  or  consulting  services.  Individuals 
who  wish  to  participate  in  these  exhibits  are  encouraged  to  contact  the 
Assistant  Program  Chair  for  Exhibits: 

Sharon  McNeety 
Northeast  Illinois  State  University 
P.O.Box  34421 
Chicago,  Illinois  60634 
(31  r '94-2788 


For  Additional  Information 


This  division  Is  concerned  wfth  educational  practice,  research,  and 
evaluation  In  the  professions  (e.g.,  medicine,  nursing,  public  health, 
business,  law,  and  engineering). 

Richard  M.  Smith 

RFl/Merien  Joy  Rehabilitation  Hospital 
P.O.Box  675 
Wheaton,  Illinois  601 87 
(708)  462-4102 


Additional  Information  can  be  obtained  by  contacting  the  1996  Program 
Chair 


Wm  K.  Metcalf 

Teacher  Education  Laboratory 
School  of  Education 
Indiana  University 
Bloomington,  Indiana  47405 
(812)  856-8123 

KMETCALFQUCS.INDIANA.EDU 


Division  J:  Postsecondary  Education 


This  dMsion  Is  concerned  with  a broad  range  of  issues  related  to  two-year, 
four-year,  and  graduate  education. 


Gloria  T.  Sandoval 
28  Alondra  Road 
Santa  Fe,  New  Mexico  87505 
(505)4664432 


Division  K:  Teaching  and  Taachar  Education 


This  dMsion  It  concerned  with  theory,  practice,  and  research  related  to 
teaching  at  al  levels  and  In-service  end  preservice  teacher  education, 
including  field  experience  supervision  and  mentoring. 

Carmen  R.  Qebelheus 
University  of  Dayton 
221F  Chaminede  Ha* 

300  Cofept  Park 
Dayton,  Ohio  46480-0525 
(513)2204306 


INDIVIDUAL  PROPOSAL  COVER  SHEET 

(Paper/Poster/Roundtable  and  Alternative  Sessions) 

(Please  type) 

1 . Please  check  the  type  of  format  you  prefer  for  this  session 

Paper  Session Poster  Session 

Alternative  Format  (please  describe): 

2.  Title  of  Submission 


Roundtable  Session 


5.  Are  you  a member  of  MWERA?  Yes No 

6.  Subject  Descriptors:  Indicate  3 one-  or  two-word  descriptors  for  this  submission. 

(D (2) (3) 

7.  I hereby  certify  that  this  proposal  has  not  been  previously  published  nor  has  it  been  submitted  to  any  other  Division  in 
MWERA.  1 further  certify  that,  if  this  paper  is  accepted  for  the  1 996  Annual  Meeting,  I will  register  for  the  conference, 
appear,  and  deliver  the  presentation  at  the  assigned  time  and  date. 


Signature  Date 

Be  certain  to  enclose  all  of  the  following  with  your  proposal: 

SIX  SETS  OF  MATERIALS,  stapled  together,  EACH  SET  CONTAINING  ONE  OF  EACH  OF  THE  FOLLOWING: 
Individual  Proposal  Cover  Sheet 

2 to  3 page  summary  (3  copies  blind;  3 with  author  information) 

PLUS: 

Three  copies  - 1 00-1 50  word  narrative  abstract  in  1 2-point  Anal  or  Universal  font 
Four  self-addressed,  stamped,  business-sized  envelopes 

Two  3x5”  index  cards  with  information  noted  in  "Guidelines  for  Submitting  Individual  Proposals" 


THIS  INFORMATION  MUST  BE  RECEIVED  BY  THE  APPROPRIATE  DIVISION  CHAIR  BY  APRIL  1, 1996 


MULTIPLE-PRESENTER  PROPOSAL  COVER  SHEET 

(Symposia/Forums/Panel  Discussions  and  Alternative  Sessions) 

(PlMMtyp*) 

1 . Please  check  the  type  of  format  you  prefer  for  this  session: 

Symposium  Forum  Panel  Discussion  

Alternative  Format  (please  describe): 

2.  Please  indicate  the  approximate  amount  of  time  you  would  prefer  for  this  session  (Please  note:  the  exact  time  allotted 
to  each  session  will  be  determined  by  the  Division  and/or  Program  Chair): 

45  minutes 90  minutes Other  (please  specify) 

2.  Title  of  Submission 


3.  Organizer’s  Name: 

Last  Name  First  Name  M.I. 

Affiliation: Telephone:  f ) 

Mailing  Address:  


FAX  Number : ( 1 Complete  e-mail  address: 

4.  Attach  a separate  sheet  which  lists  all  presenters  including  full  names,  institutional  affiliations,  telephone  numbers,  and 
TITLE  or  topic  which  each  will  address.  Circle  the  names  of  all  presenters  who  are  graduate  students. 

5.  Are  you  a member  of  MWERA?  Yes No 

6.  Subject  Descriptors:  Indicate  3 one-  or  two-word  descriptors  for  this  submission. 

(1) (2) (3) 

7.  I hereby  certify  that  this  proposal  has  not  been  previously  published  nor  has  it  been  submitted  to  any  other  Division  in 
MWERA.  I further  certify  that,  if  this  paper  is  accepted  for  the  1 996  Annual  Meeting,  I will  register  for  the  conference, 
appear,  and  ensure  the  delivery  of  the  presentation  at  the  assigned  time  and  date. 

Signature  Date 


Be  certain  to  enclose  all  of  the  following  with  your  proposal: 

SIX  SETS  OF  MATERIALS,  stapled  together,  EACH  SET  CONTAINING  ONE  OF  EACH  OF  THE  FOLLOWING: 
Multiple-Presenter  Proposal  Cover  Sheet 
2 to  3 page  summary  (all  with  author  information) 

PLUS: 

Three  copies  - 1 00-1 50  word  narrative  abstract  in  1 2-point  Ariel  or  Universal  font 
Four  self-addressed,  stamped,  business-sized  envelopes 

Two  3x5"  index  cards  with  information  noted  in  "Guidelines  for  Submitting  Multiple  Presenter  Proposals" 

THIS  INFORMATION  MUST  BE  RECEIVED  BY  THE  APPROPRIATE  DIVISION  CHAIR  BY  APRIL  1, 1996 


WORKSHOP  PROPOSAL  COVER  SHEET 

(To  be  submitted  to  the  Workshop  Chair) 

(Please  type) 

t.  Please  indicate  the  approximate  amount  of  time  you  would  prefer  for  this  workshop  (Please  note:  the  exact  time 
allotted  to  each  workshop  will  be  determined  by  the  Workshop  and/or  Program  Chair): 

45  minutes 90  minutes Other  (please  specify) 

2.  Descriptive  Title  of  Workshop 


3.  Organizer's  Name: 

Last  Name  First  Name  M.l. 

Affiliation: Telephone:  ( 1 

Mailing  Address:  


FAX  Number : ( 1 Complete  e-mail  address: 

4.  List  all  workshop  presenters  or  instructors  including  full  names,  Institutional  affiliations,  telephone  numbers,  and 
aspect  which  each  will  address.  Circle  the  names  of  all  presenters  who  are  graduate  students. 


5.  Are  you  a member  of  MWERA?  Yes No 

6.  I hereby  certify  that  this  workshop  has  not  been  previously  presented  within  any  other  Division  in  MWERA.  I further 
certify  that,  if  this  workshop  is  accepted  for  the  1996  Annual  Meeting,  I will  register  for  the  conference,  appear,  and 
ensure  the  delivery  of  the  presentation  at  the  assigned  time  and  date. 

Signature  Date 


Be  certain  to  enclose  all  of  the  following  with  your  proposal: 

SIX  SETS  OF  MATERIALS,  stapled  together.  EACH  SET  CONTAINING  ONE  OF  EACH  OF  THE  FOLLOWING: 
Workshop  Proposal  Covet  Sheet 

2 to  3 page  summary  (all  with  workshop  leader  or  organizer  Information) 

PLUS: 

Three  copies- 100-1 50  word  narrative  abstract  in  12-point  Ariel  or  Universal  font 
Four  self-addressed,  stamped,  business-sized  envelopes 

Two  3x5"  Index  cards  with  Information  noted  In  "Guidelines  for  Submitting  Workshop  Proposals" 

THIS  INFORMATION  MUST  BE  RECEIVED  BY  THE  APPROPRIATE  DIVISION  CHAIR  BY  APRIL  1, 19M 


SPECIAL  SECTION 


Reviews  of  the  Book:  The  Bell  Curve 

Section  Editor:  Dennis  W Leitner1,  Southern  Illinois  University 


This  contro- 
versial book  (an  un- 
derstatement, to  be 
sure!)  The  Bell 
Curve  : Intelli- 

gence and  Class 
Structure  in  Ameri- 
can Life  (hereafter 
referred  to  as  TBC) 
by  Richard  J. 

Hermstein  and 
Charles  Murray  (de- 
noted H&M)  is  one 
of  the  most  impor- 
tant books  pub- 
lished within  the 
last  18  months. 

This  issue  of 
MWER  brings  to- 
gether contributions 
from  several 
sources,  with  the  in- 
tent of  presenting 
comment  from  all 
sides  of  the  issue  in 
the  shape  of  a bell 
curve. . . . balanced  around  a central  base  of  ideas. 

The  purpose  of  this  effort  is  not  to  persuade  you  of  the 
validity  of  one  side  or  the  other.  If  you  haven't  yet  taken  a 
position  about  the  book  (an  event  which  has  a probability 
close  to  zero),  you  might  find  some  information  or  sources 


herein  that  inter- 
est you  and  may 
help  you  to  come 
to  a position,  if 
you  so  desire. 

We  have  as- 
sembled contribu- 
tions from  many 
sources.  Lyle 
White  has  created 
an  annotated  bib- 
liography of 
many  of  the  pub- 
lished reviews  of 
TBC.  While  this 
bibliography  is 
certainly  not  ex- 
haustive, it  repre- 
sents a wide  spec- 
trum of  views. 

Tom  Knapp 
has  focused  his 
unique  evaluation 

on  the  statistical 
NY:  The  Free  Press,  845  pp.  analyses  in  the 

book,  most  of  which  are  discussed  in  the  appendices.  We 
know  of  no  other  reviews  of  the  appendices  of  TBC. 

Mary  Sudzina  has  contributed  comments  from  Part  II 
of  her  interview  with  John  Goodlad,  a continuation  of  a 
broader  interview.  Part  1 of  which  appeared  in  the  Spring 
1995  issue  of  MWER. 


1 1 wish  to  thank  Ayres  D’Coste,  Mery  Sudzina,  Msriene  Schommer  end  Joe!  Levin  for  helping  greatly  with  identifying  end  soliciting  these  contributions. 
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Marlene  Schommer  focuses  her  very  popular  MWER 
column  Voices  in  Education  on  TBC.  Education  experts 
voice  their  professional  opinions  on  the  book,  its  findings, 
and  its  relevance  for  educators. 

Why  is  this  book  so  controversial?  It  has  been  ar- 
gued that  many  of  the  critics  of  TBC  haven’t  read  it  - or  at 
least  not  all  of  it.  Could  it  be  that  it  is  too  difficult  to  read? 
The  authors  mention  in  ’A  Note  to  the  Reader’  that  this 
845-page  book  can  be  read  at  several  levels.  Reading 
only  each  chapter’s  opening  precis,  which  is  written  infor- 
mally and  free  of  technical  terms,  shortens  the  book  to  about 
30  pages.  You  could  then  proceed  to  read  the  many  boxed 
inserts  of  relevant  and  interesting  (but  not  necessary)  top- 
ics for  thought.  The  technically  minded  would  want  to 
move  into  the  appendices  which  provide  explanation  of 
statistics,  data  analysis  and  other  key  information. 

But  another  avenue  would  be  to  read  the  enclosed 
summary  of  TBC  originally  written  by  J.  Laurie  Snell  for 
Chance  News , which  is  an  electronic  publication  available 
on  the  World  Wide  Web  at  http://www.geom.umn.edu/lo- 
cate/chance.  The  summary  starts  with  Chance  News  3.14: 
(22  September)  and  continues,  along  with  related  comments 
and  stories,  for  several  subsequent  issues  to  15  October, 
1994. 

In  order  to  clarify  the  notions  of  the  'heritability1  of 
intelligence,  Lizabeth  and  David  DiLalla,  developmental 
psychologists  specializing  in  behavioral  genetics  at  South- 
ern Illinois  University’s  School  of  Medicine  and  Depart- 


ment of  Psychology,  have  written  for  us  a layman’s  dis- 
cussion of  'heritability.' 

In  addition,  I have  tried  to  summarize  the  Black  per- 
spective on  TBC  by  creating  an  annotated  bibliography  of 
the  articles  in  the  Winter  1995  issue  of  The  Black  Scholar , 
Included  is  a discussion  of  the  statistical  considerations  in 
TBC  from  Chance,  a magazine  of  the  American  Statistical 
Association  (not  to  be  confused  with  J.  Laurie  Snell’s 
Chance  News). 

One  possible  criticism  of  this  Review  of  Reviews  may 
be  that  it  is  late  - after  all,  the  book  was  published  in  Octo- 
ber, 1994.  However,  new  reviews  continue  to  appear:  A 
recent  Feature  Review  of  TBC  by  Robert  J.  Sternberg  ap- 
pears in  the  September  1995  issue  of  Psychological  Sci- 
ence. And  I’m  sure  others  will  appear  after  this  issue  of 
MWER . A thorough  statistical  analysis  and  reanalysis  of 
H&M’s  data  is  expected  to  appear  in  the  Journal  of  the 
American  Statistical  Association.  Both  AERA  and  NCME 
have  planned  sessions  on  TBC  for  their  annual  conferences 
in  NYC  in  1996. 

While  this  effort  has  been  exhausting  to  me,  it  cer- 
tainly is  not  exhaustive.  The  ideas  and  perspectives  of 
many  other  authors  in  many  other  forums  could  have  been 
included.  But  in  the  true  sense  of  a statistician,  this  was 
meant  to  be  a sampling  of  opinions.  I’ll  leave  it  to  the 
reader  to  judge  if  it  is  a representative  sampling  of  those 
opinions,  while  granting  that  it  is  not  a random  sampling. 


ANNOUNCEMENT 

Educational  Research  Home  Page  on  the  Web 

An  unofficial  Home  Page  for  educational  research  is  available  on  the 

World  Wide  Web: 

http://bsuvc/bsu.eduM>Ogjmarchant/edresearch.html 
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An  Annotated  Bibliography  of 
Reviews  of  The  Bell  Curve 

Lyle  J.  White,  Southern  Illinois  University 


Individual  Reviews  in  Professional  Journals  and 
Popular  Press 

Ducharme,  E.  R.,  & Ducharme,  M.  K.  (Eds.).  (1995, 
January-February).  The  Hermstein  and  Murray  book:  A 
controversy.  [Interview  with  Nancy  Cole,  President,  Edu- 
cational Testing  Service]  Journal  of  Teacher  Education,  4, 
6,(1),  7-9. 

Cole  found  this  book  “very  worrisome”  in  that  it  pre- 
sents false  issues  about  education,  and  misuses  test  data  to 
provide  proof  of  inherited  intelligence.  She  noted  that  many 
interpretative  issues  were  not  addressed  in  a careful  and 
scientific  way,  and  that,  the  data  presented  seemed  chosen 
to  emphasize  racial  differences.  She  continued  by  noting 
that  the  views  presented  in  the  book  will  likely  harden  the 
views  of  those  who  already  hold  negative  views  about  hu- 
man possibilities. 

Miele,  F.  (1995).  Interview  with  Robert  Sternberg 
on  The  Bell  Curve.  Skeptic  (3)3,  72-80. 

Robert  Sternberg,  author  of  A Triarchic  Theory  of  In- 
telligence and  Yale  professor,  began  this  interview  by  not- 
ing that  although  many  psychometricians  may  agree  on  a 
theory  or  a state  of  affairs  (see  The  Wall  Street  Journal  ar- 
ticle reviewed  here),  it  does  not  lead  to  the  implication  of 
truth.  He  noted  that  even  if  heritability  of  intelligence  is 
fairly  high  (he  suggested  about  .5),  it  does  not  mean  that 
intelligence  cannot  be  modified.  Nor  does  it  explain  differ- 
ences in  group  means.  The  authors  often  invite  the  reader 
to  make  generalizations  (e.g.,  race  differences  are  due  to 
genetics)  even  though  no  evidence  is  provided.  He  cited 
several  instances  where  Hermstein  and  Murray  misrepre- 
sented and  misinterpreted  data  (e.g.,  drawing  causal  infer- 
ences from  correlation  data  and  the  use  of  the  National  Lon- 
gitudinal Study  of  Youth  which  was  not  particularly  repre- 
sentative of  the  United  States  population).  He  also  noted 
the  conceptual  inconsistencies  in  the  authors  noting  the 
Flynn  Effect  (i.e.,  IQs  are  generally  going  up)  and  why  they 
believe  IQs  are  going  down.  Sternberg  also  discussed  his 
theory  of  intelligence  and  how  it  is  more  useful  in  discuss- 
ing societal  issues  than  the  more  limited  model  proposed 
by  Hermstein  and  Murray. 

Gardner,  H.  (1994,  Winter).  Cracking  Open  the  IQ 
Box:  The  American  Prospect,  73-75. 

Howard  Gardner,  professor  of  education  at  Harvard 
University  and  author  of  Multiple  Intelligences , acknowl- 
edged the  importance  of  this  book,  the  clarity  of  the  argu- 
ments, and  the  reasonableness  of  some  of  the  analysis.  Nev- 


ertheless he  found  many  faults  with  The  Bell  Curve,  most 
disturbingly  the  stylistic  manner.  Gardner  characterized 
this  style  in  numerous  ways,  including:  “special  pleading, 
based  on  biased  reading  of  the  data,”  “scholarly 
brinkmanship”  (i.e.,  taking  readers  up  to  a position  of  ex- 
tremism and  then  backing  away  from  it  at  the  last  moment, 
leaving  readers  to  continue  on  their  own  without  the  author 
acknowledging  this  intention),  “ungenerous,”  “rhetorical 
bomb-throwing,”  and  “smug  self-satisfaction.” 

Gould,  S.  J.  (1994,  November  26).  Curveball  [Re- 
view of  the  Book  The  Bell  Curve).  The  New  Yorker,  139- 
149. 

Author  of  The  Mismeasure  of  Man  and  Harvard  Uni- 
versity Zoology  professor,  Stephen  Jay  Gould  began  his 
trenchant  review  by  speculating  on  the  causes  that  have  led 
to  the  popularity  of  The  Bell  Curve.  He  concluded  that  we 
are  living  in  “...a  historical  moment  of  unprecedented 
ungenerosity,  when  a mood  for  slashing  social  programs 
can  be  powerfully  abetted  by  an  argument  that  beneficia- 
ries cannot  be  helped”  (p.  139).  Gould  continued  his  cri- 
tique by  questioning  the  validity  of  the  four  premises  on 
which  Hermstein  and  Murray  base  their  general  claim  that 
intelligence  is  the  major  determinant  in  social  standing,  that 
is,  intelligence  must  be:  depictable  as  a single  number,  ca- 
pable of  ranking  people  in  linear  order,  genetically  based, 
and  effectively  immutable.  Gould  also  incorporated  an  ar- 
ticle in  The  New  Republic  (1994,  October  31)  written  by 
Murray  and  Hermstein  to  support  his  charge  of  their  disin- 
genuousness in  choice  of  methods,  presentation,  and  con- 
clusions. 

Kamin,L.  J.  (1995,  February).  Behind  the  Curve  [Re- 
view of  the  book  The  Bell  Curve).  Scientific  American,  99- 
103. 

In  this  review,  Leon  Kamin,  professor  of  psychology 
at  Northeastern  University,  and  author  of  Science  and  poli- 
tics of  IQ,  criticized  the  quality  of  evidence  used  by 
Hermstein  and  Murray,  as  well  as  the  social  policy  they 
advocated.  Kamin  argued  that  the  evidence  cited  in  The 
Bell  Curve  is  troubling  because  much  of  it  is  gleaned  from 
second-hand  sources  that,  once  examined  closely,  is  faulty 
and  is  directed  by  preconceived  notions  about  race  and  in- 
telligence. Kamin  also  argued  that  too  often  Hermstein 
and  Murray  used  correlation  statistics  to  reason  causal  re- 
lations. On  the  final  issue,  the  social  policy,  Kamin  con- 
tinued the  theme  that  Hermstein’ s and  Murray’s  precon- 
ceived notions  (e.g.,  affirmative  action  is  an  unwise  and 
destructive  policy)  directed  their  selection  and  interpreta- 
tion of  data. 
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Kamin  concluded  the  review  by  declaring,  “The  book 
has  nothing  to  do  with  science”  (p.  103). 

Robinson,  D.  N.  (1994/1995,  Winter).  Hereditary 
Monarch  in  the  Republic  of  Virtue  [Review  of  the  book 
The  Bell  Curve].  Journal  of  Blacks  in  Higher  Education, 
117-122. 

Daniel  Robinson,  author  and  professor  of  psychol- 
ogy at  Georgetown  University,  found  the  discussion  on  the 
relation  between  heritability  and  environmental  factors  in 
The  Bell  Curve  lacking  in  rigor  and  conceptual  sophistica- 
tion. Robinson  also  questioned  the  ease  and  “smugness” 
with  which  Hermstein  and  Murray  treat  psychological  data, 
“as  if  they  were  gradations  on  a ruler”  (p.  120)  [i.e.,  ratio 
numbers]  and  the  relative  unimportance  the  authors  attached 
to  three  findings.  The  first  important  finding  that  Robinson 
found  relatively  ignored  by  Hermstein  and  Murray  was  that 
when  sampling  blacks  and  whites  with  the  same  average 
IQs,  one  is  twice  as  likely  to  finds  blacks  in  poverty,  five 
times  more  likely  to  be  bom  out  of  wedlock,  about  three 
times  more  likely  to  have  been  on  welfare,  more  than  twice 
as  likely  to  have  lived  in  poverty  during  the  first  three  years 
of  life,  and  more  than  twice  as  likely  to  give  birth  to  a low 
birth-weight  child.  Second,  white  mothers  classified  as  dull 
are  as  likely  to  have  children  with  severe  behavior  prob- 
lems as  are  white  mothers  classified  as  very  bright.  Third, 
although  88  percent  of  the  women  receiving  welfare  for  at 
least  five  years  are  within  the  bottom  half  of  the  IQ  distri- 
bution, 3 to  4 percent  of  them  are  within  the  1 16-126  range. 
Robinson  concluded  his  review  by  calling  on  America  to 
refocus  its  energy  on  questions  regarding  the  moral  center 
around  which  each  life  can  be  organized. 

Series  of  Reviews  in  a Magazine 

The  Bell  Curve : A Symposium  (1994,  December  5). 
National  Review,  32-61.  John  O’Sullivan,  Editor 

Barone,  M.  Common  Knowledge , 32,  34. 

Michael  Barone,  a senior  writer  at  U.  S.  News  & World 
Report , suggested  that  the  message  of  The  Bell  Curve  is 
already  widely  understood  by  most  Americans,  that  is,  “...the 
differences  in  average  intelligence  among  the  races  do  not 
justify  discrimination  against  or  for  individuals  of  those 
races  (p.32)  and  that  “....the  disproportionately  low  num- 
ber of  blacks  in  top  positions  and  the  disproportionately 
high  number  of  blacks  in  prison... .do  not  result  from  racial 
discrimination”  (p.  34).  For  Barone  these  arguments  are 
further  evidence  against  “Left”  political  polices  of  required 
racial  preferences,  radical  social  engineering,  or  economic 
redistribution. 

Shipman,  P.  Legacy  of  racism , 34,  36,  38) 

As  a pal eoanthropo logist,  Pat  Shipman  congratulated 
Hermstein  and  Murray  for  their “heroic”  attempt  at  an  honest 
and  clear  explication  of  a complex  topic  to  the  general  pub- 
lic. Shipman  also  noted  that  Hermstein  and  Murray  should 
have  examined  further  the  potential  effects  of  prejudice  on 

IQ. 


Van  Den  Haag,  E.  Not  hopeless , (38,  40) 

Ernest  Van  Den  Haag,  a psychoanalyst,  supported  the 
arguments  within  The  Bell  Curve  that  intelligence  predicts 
outcomes  better  than  parental  privilege.  Nevertheless,  he 
was  critical  of  Hermstein’ s and  Murray’s  implied  socio- 
economic hopelessness  regarding  “low-IQ”  individuals  and 
their  failure  to  note  that  in  some  sub-cultures  (e.g.,  high 
school)  intelligence  holds  less  prestige  than  other  factors. 

Neuhaus,  R.  J.  Going  Public , 40,  42 

Priest,  journal  editor,  and  Richard  John  Neuhaus, 
friend  of  Charles  Murray,  criticized  Hermstein  and  Murray 
for  interjecting  the  argument  that  intellectual  ability  varies 
among  races  (if  the  allegation  is  true,  little  or  nothing  can 
be  done  about  it)  into  this  book  and  into  the  debate  over 
social  policies  such  as  affirmative  action  and  immigration 
practices.  Neuhaus  submitted  that  these  polices  can  be 
debated  honestly,  and  perhaps  more  cogently,  without  the 
IQ  factor.  Neuhaus  concluded  his  review  with  a caution  for 
his  fellow  conservatives,  “...To  think  that  it  is  to  their  ad- 
vantage to  seize  upon  the  racial  factor  in  The  Bell  Curve 
would  be  very  dumb.  It  would  also  be  very,  very  wrong” 
(P-  42). 

Genovese,  E.  D.  Living  with  Inequality , 44,  46. 

Describing  The  Bell  Curve  as  thoughtful,  challeng- 
ing, and  deeply  flawed  book,  author  Eugene  Genovese  com- 
mended the  book  for  its  analysis  of  the  transformation  of 
the  American  elite,  and  its  proposals  for  reforms.  He  con- 
demned the  authors,  however,  for  their  preoccupation  in 
their  analyses  of  racial  differences,  a category  they  initially 
stated  did  not  exist.  Furthermore,  he  pronounced  Hermstein 
and  Murray  naive,  if  not  disingenuous,  in  their  belief  that 
calling  attention  to  racial  differences  between  blacks  and 
whites  can  somehow  reduce  racial  prejudice. 

Wilson,  J.  Q.  Acting  Smart , 46-48 

James  Wilson,  a management  and  public  policy  pro- 
fessor, emphasized  that  believing  in  nurture  does  not  nec- 
essarily make  change  more  likely  or  easier,  nurture  as  well 
as  nature  factors  are  hard  to  change.  He  also  joined  other 
reviewers  in  noting  the  unfortunate  likelihood  than  many, 
liberals  and  conservatives  alike,  will  pay  more  attention  to 
the  race  issues  than  to  the  other  “penetrating”  qualities  of 
the  book. 

Jensen,  A.  R.  Paroxysms  of  Denial , 48-50 

Arthur  Jensen,  Professor  Emeritus  of  Educational  Psy- 
chology at  the  University  of  California,  Berkeley,  is  well 
known  to  scholars  and  professionals  who  have  studied  theo- 
ries of  intelligence  and  how  intelligence  is  related  to  other 
human  traits.  Consequently,  it  should  be  no  surprise  that  he 
found  the  essential  facts  presented  in  The  Bell  Curve  to  be 
correct.  Because  other  scholars  hold  dissimilar  views,  Jensen 
proposed  that  an  appropriate  course  of  action  would  be  for 
President  Clinton  to  ask  the  National  Academy  of  Sciences 
to  appoint  a panel  of  experts  to  evaluate  the  factual  claims 
of  The  Bell  Curve  and  report  its  conclusions  to  the  public, 


much  like  the  process  that  was  initiated  after  Jensen's  pub- 
lication of  Bias  in  Mental  Testing . Only  in  this  way,  argued 
Jensen,  could  the  public  debate  over  this  book  proceed  from 
questions  regarding  the  validity  of  the  facts  to  the  more  im- 
portant questions  related  to  public  policy  and  the  nation’s 
future. 

Glazer,  N.  Is  Intelligence  Fixed?,  50-52 

Nathan  Glazer,  author  and  professor  emeritus  of  edu- 
cation and  sociology  at  Harvard  University,  found  the  dis- 
cussion of  differences  of  intelligence  among  groups,  de- 
fined by  a common  inheritance  and  culture,  too  brief  in  The 
Bell  Curve,  especially  in  the  area  of  environmental  factors 
that  have  explanation  possibilities.  He  took  further  issue 
with  Hernistein  and  Murray  on  three  related  issues:  (a)  How 
fixed  are  the  differences?  (b)  Can  test  performances  of  low 
performing  groups  be  raised?  (c)  How  can  a country  that 
“has  struggled  so  long,  and  still  struggles  to  make  blacks 
full  and  equal  participants”  (p,  52)  not  support  a public 
policy,  such  as  affirmative  action,  that  promotes  group  rep- 
resentation. 

Lomasky,  L.  E.  Meritocracy  That  Works , 52-53 

Loren  Lomasky,  professor  of  philosophy  at  Bowling 
Green  State  University,  used  the  National  Basketball  Asso- 
ciation, as  an  example  of  a meritocracy  that  works,  to  sup- 
port and  clarify  his  arguments  for  the  acceptance  for  a more 
generalized  societal  meritocracy. 

Young,  M.  Moral  Intelligence,  53-54 

Michael  Young  is  an  English  nobleman  and  the  au- 
thor who  coined  the  term  “meritocracy”  forty  years  ago.  In 
his  review,  he  challenged  the  authors,  and  the  rest  of 
America,  to  consider  the  place  of  a “moral  intelligence”  in 
modem  life.  He  suggested  that  the  moral  leadership  in  this 
country  has  “...deteriorated  as  leadership  has  been  more  and 
more  restricted  to  people  with  a particular  kind  of  cognitive 
ability”  (p.  54).  He  further  challenged  the  authors  (i.e., 
Murray)  and  all  Americans  to  consider  remedies  beyond 
the  “time-honored  maxim  that  the  Federal  Government 
should  get  off  people’s  backs”  (p.  54)  and  to  look  more 
closely  at  the  relations  between  social  and  geographical 
mobility  and  traditions  of  community  and  family  morality. 

Berger,  B.  Methodological  Fetishism,  54-56. 

From  her  position  as  a professor  of  sociology  at  Bos- 
ton University,  Brigitte  Berger  reviewed  The  Bell  Curve 
and  found  it  to  be  “narrow  and  deeply  flawed.”  The  limita- 
tions of  the  book  and  its  argument,  she  noted,  is  based  on 
the  assumption  that  “empirically  measured  differences 
among  racial  groups  reflect  ‘intelligence’”  (p.  55).  She  pro- 
posed instead  that  measured  intelligence  is  more  an  assess- 
ment of  “modem  consciousness,”  a term  she  used  to  de- 
scribe skills  that  “ . . .are  particularly  relevant  to  operating  in 
the  highly  specialized  worlds  of  modem  technology  and 
rationalistically  organized  bureaucracies”  (p.  55).  These 
skills  she  believes  can  be  learned. 


Loury,  G.  C.  Dispirited,  56-58. 

Glenn  Loury,  a professor  of  economics  at  Boston 
University,  questioned  Hermstein’s  and  Murray’s  on  sev- 
eral points,  including  their  willingness  to  develop  causal 
relations  in  a field  (i.e.,  social  science)  where  understand- 
ing of  causality  “..is  so  limited,  and  the  importance  of  mat- 
ters of  the  spirit  so  palpable”  (p.  58).  He  also  questioned 
the  authors’  suggestion  that  as  a country  we  accommodate 
ourselves  to  the  inevitability  of  the  differences  between 
groups  in  cognitive  skills. 

Novak,  M.  Sins  of  the  Cognitive  Elite,  58-60. 

Michael  Novak  holds  an  endowed  chair  in  Religion 
and  Public  Policy  at  the  American  Enterprise  Institute.  He 
concentrated  his  review  on  two  theses  he  found  important 
but  largely  ignored  in  the  book:  the  twin  hazards  of  having 
either  above-average  or  below-average  intelligence.  For 
the  cognitive  elite,  the  physical  isolation  and  hubris  of  these 
groups  tends  to  distort  its  vision  and  sense  of  reality.  For 
those  in  the  low  intelligence  group,  making  moral  decisions 
in  a complex  ambiguous  society  can  be  especially  prob- 
lematic as  “those  with  fewer  chances  in  life  have  much  more 
to  lose  with  every  chance  they  bobble”  (p.  61). 

Seligman,  D.  Trashing  the  Bell  Curve . 60-61. 

Columnist  Daniel  Seligman  suggested  that  much  of 
the  criticism  of  The  Bell  Curve  is  unfounded  and  the  result 
of  the  liberal  media  attempts  to  suppress  the  ideas  contained 
therein. 

The  New  Republic  (1994,  October  24).  Andrew 
Sullivan,  Editor 

In  this  special  section,  19  brief  responses  to  The  Bell 
Curve  were  written  by  editors  and  reporters  of  The  New 
Republic  and  Harper's,  academicians  Henry  Louis  Gates, 
Jr.,  Andrew  Hacker,  Randall  Kennedy,  Glenn  Loury,  and 
Richard  Nisbett,  and  authors  Nathan  Glazer,  Hugh  Pearson, 
and  Alan  Wolfe.  These  articles,  many  in  expanded  form, 
are  contained  within  The  Bell  Curve  Wars  (Fraser,  1995) 
and  reviewed  below.  In  addition,  this  issue  contained  an 
essay  by  Charles  Murray  and  Richard  J.  Hermstein,  “Race, 
Genes  and  I.Q. — An  Apologia”  where  they  summarized 
portions  of  The  Bell  Curve  and  presented  a case  for  conser- 
vative multiculturalism. 

Newsweek,  (1994,  October  24).  Maynard  Parker,  Editor 

Morganthau,  T.  IQ:  Is  it  destiny?  pp.  53-55. 

Tom  Morganthau  summarized  the  book  in  terms  of 
three  basic  arguments:  1)  A reinterpretation  of  social  class, 
2)  The  role  of  intelligence  in  explaining  other  social  phe- 
nomena, and  3)  Racial  differences  are  genetically  based. 
Morganthau  called  into  question  the  relation  between  IQ 
and  intelligence,  and  the  apparent  contradictions  contained 
within  the  book  (e.g.,  citing  a reference  that  reported  IQ 
gains  in  society  over  time  and  then  arguing  for  a national 
dysgenesis).  As  a way  of  illustrating  the  variety  of  IQ  in 
successful  and  celebrated  personalities,  they  list  names  and 
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report  (no  references  given)  IQs,  including  a score  of  228, 
and  placed  on  a normal  distribution  curve.  Readers  should 
keep  in  mind  that  such  illustrations  are  of  questionable  util- 
ity without  citation,  especially  when  the  reported  scores  ex- 
ceed those  that  are  maximally  attainable  on  modem  and 
adequately  normed  intelligence  tests  (i.e.,  most  have  ceil- 
ings in  the  150-160  range). 

Cowley,  G.  Testing  the  Science  of  Intelligence,  pp. 
56-59. 

Geoffery  Cowley  cited  surveys  of  scientists  and  the 
long  history  of  intelligence  research  to  argue  that  “main- 
stream” psychologists  support  the  utility  of  the  IQ  construct. 
As  part  of  his  justification  of  this  position,  he  included  an 
illustrative  timeline  of  some  of  the  major  figures  and  devel- 
opments in  intelligence  measurement  (from  Juan  Huarte  to 
Thomas  Bouchard).  His  arguments  were  entangled  some- 
what by  his  misguided  attempt  to  clarify  the  concept  of  cor- 
relation, “A  correlation  of  .4  would  tell  you  that  40  percent 
of  the  variation  in  one  thing  is  matched  by  variation  in  an- 
other, while  60  percent  of  it  is  not”  (p.  57).  He  added  fur- 
ther to  this  entanglement  by  reporting  (without  reference) 
that  “Muhammad  Ali  made  the  big  time  with  an  IQ  of  78” 
(p.  57).  Without  access  to  the  origins  of  this  information 
such  a statement  is  difficult  to  judge.  Nevertheless,  anyone 
who  has  heard  Ali’s  quick  wit  during  an  interview,  will  find 
this  statement  difficult  to  accept,  and  given  the  nature  of 
The  Bell  Curve , a rather  lamentable  illustration. 

Reviews  in  a Series  in  a Professional  Journal 

Harvey,  J.  H.  (Editor).  (1995).  Contemporary  Psychol- 
ogy, 40  (5). 

Bouchard,  T.  M.,  Jr.  Breaking  the  Last  Taboo.  415-418. 

Noting  that  The  Bell  Curve  is  “superbly  written  and 
exceedingly  well-documented”  (p.  418),  Thomas  Bouchard, 
professor  of  psychology  and  director  of  the  Minnesota  Cen- 
ter for  Twin  and  Adoption  Research,  commended  Hermstein 
and  Murray  for  writing  a book  that  questioned  the  current 
wisdom  of  liberal  equality.  Whereas  other  reviewers  (c.f., 
Gould,  1994;  Kamin,  1995)  have  questioned  the  quality  of 
the  evidence  used  in  The  Bell  Curve , Bouchard  contends 
that  the  evidence  is  compelling  and  carefully  documented. 
Bouchard  continued  his  support  of  the  importance  of  ge- 
netic factors  in  social  standing  by  citing  his  own  twin  stud- 
ies as  well  as  other  genetic  inheritance-ability -social  status 
correlation  studies. 

Dorfman,  D.  D.  Soft  science  with  a neoconservative 
agenda.  418-421. 

Donald  Dorfman,  a professor  of  psychology  and  radi- 
ology at  The  University  of  Iowa  and  author  in  the  field  of 
assessment  and  statistics,  censured  Hermstein  and  Murray 
for  their  lack  of  scholarship.  Dorfman  pointed  out  that  nei- 
ther author  has  published,  in  any  peer-reviewed  scientific 
journal,  an  empirical  study  that  has  investigated  the  rela- 
tion of  intellectual  ability  and  SES  to  the  social  factors  dis- 
cussed in  the  book  (e.g.,  marriage,  divorce,  illegitimacy, 
welfare  dependency,  and  parenting).  Dorfman  also  critiqued 


Hermstein  and  Murray  for  publishing  outside  their  areas  of 
professional  expertise.  Hermstein,  a Harvard  University  pro- 
fessor for  36  years,  studied  the  experimental  analysis  of 
decision-making  in  pigeons  and  rats.  Murray,  who  holds  a 
doctorate  in  political  science,  has  published  most  frequently 
in  neoconservative  magazines,  but  never  about  the  genetic 
basis  of  intelligence  and  poverty  in  a scientific  journal. 
Dorfman  suggested  that  this  publication  record,  or  lack 
thereof,  is  related  to  the  Hermstein’s  and  Murray’s  misuse 
of  linear  regression. 

E.  S.  Shapiro,  Editor,  C.  L.  Frisby,  Guest  Editor 
(1995).  School  Psychology  Review,  24. 

Frisby,  C.  L.  (a).  Introduction  to  The  Bell  Curve  com- 
mentaries. 9-11. 

As  the  Guest  Editor  for  this  special  issue,  Frisby  pro- 
vided the  readership  (a)  an  introduction  to  The  Bell  Curve , 
(b)  the  special  issue  of  this  journal,  which  consisted  of  in- 
vited, non-peer-reviewed  commentaries,  (c)  a list  of  popu- 
lar and  professional  media  sources  where  The  Bell  Curve 
has  been  previously  reviewed,  and  (d)  references  to  similar 
studies  and  discussions  regarding  intellectual  ability, 
achievement,  SES,  race,  and  culture.  In  addition,  Frisby 
outlined  the  four  basic  types  of  controversy  in  the  social 
sciences  as  a context  to  consider  this  book  and  the  reviews 
presented  in  this  issue. 

Frisby,  C.  L.  (b).  When  facts  and  orthodoxy  collide: 
The  Bell  Curve  and  the  robustness  criterioa  12-19. 

In  his  own  review,  Frisby  synthesized  the  explana- 
tions alternative  to  intellectual  ability  which  have  been  pro- 
posed, some  empirically  based,  others  speculative,  to  ac- 
count for  the  relative  scholastic  under-achievement  of  blades 
compared  to  whites.  Frisby  evaluated  the  robustness  of 
Hermstein’s  and  Murray’s  explanatory  theory  versus  the 
alternative  theories  according  to  three  criteria:  (a)  involves 
the  fewest  number  of  statements  and  assumptions,  (b)  ex- 
plains the  broadest  range  of  phenomena,  and  (c)  involves 
predictions  that  are  the  most  accurate.  Frisby  concluded 
that  Hermstein  and  Murray  have  provided  the  more  robust 
explanation,  and  that  when  “facts  and  orthodoxy  collide, 
the  bearer  of  the  facts  is  reflexively  accused  of  being  ‘elit- 
ist,’ racist,’ and  ideologically  reactionary”  (p.  17). 

Oakland,  T.  The  Bell  Curve:  Some  implications  for 
the  discipline  and  the  practice  of  School  Psychology.  20- 
26. 

In  a review  less  impassioned  than  many,  Oakland 
questioned  the  conclusions  championed  by  Hermstein  and 
Murray  because  of  some  recent  research  by  himself  and 
others.  Oakland  began  this  review  by  discussing  the  na- 
ture of  intelligence  and  aptitudes,  and  the  limitations  of 
correlation  data  to  interpret  relations  between  variables.  He 
concluded  his  critique  by  citing  some  of  his  recent  research 
regarding  the  relation  between  measured  intelligence  and 
reading  comprehension,  and  the  evaluation  of  a home-based 
program  in  the  Gaza  Strip  as  evidence  that  the  study  of  the 
modifiability  of  cognitive  ability  be  continued. 


Braden,  J.  P.  For  whom  the  Bell  tolls:  Why  The  Bell 
Curve  is  important  for  school  psychologists.  27-35. 

Braden  proposed  that  in  reading  The  Bell  Curve , psy- 
chologists should  address  four  question:  “(a)  Is  IQ  really 
helpful?  (b)  Could  the  black — white  IQ  gap  be  genetic? 
(c)  Could  it  help  to  know  that  the  gap  is  genetic?  and  (d) 
What  should  educators  do  about  all  this?  He,  in  turn,  an- 
swered Yes  to  the  first  three,  and  to  the  last,  “it  is  individu- 
alism (rather  than  egalitarianism)  that  provides  a socially, 
morally,  and  scientifically  defensible  basis  for  educational 
policy”  (p.  27).  Braden  further  addressed  the  fourth  ques- 
tion by  interpreting  the  ability-grouping  literature  as  pro- 
viding support  forthis  practice  (Note:  Not  all  scholars  agree 
here)  and  by  suggesting  that  ‘‘education  might  become 
skewed  when  schools  are  told  to  eradicate  intractable  dif- 
ferences between  groups”  (p.  33). 

Kranzler,  J.  H.  Commentary  on  some  of  the  empiri- 
cal and  theoretical  support  for  The  Bell  Curve . 3641. 

Kranzler  choose  to  limit  his  review  to  two  compo- 
nents of  The  Bell  Curve : (a)  the  original  empirical  evi- 
dence used  to  demonstrate  the  central  role  of  intelligence 
in  American  life  and  (b)  Spearman’s  g.  Kranzler  com- 
mended Hermstein’s  and  Murray’s  choice  of  the  National 
Longitudinal  Survey  of  Youth  (NLSY),  and  their  decision 
to  use  regression  analysis  as  their  research  tool.  He  did, 
however,  criticize  them  for  their  use  of  causal  language 
and  for  their  neglect  of  measurement  error  in  their  interpre- 
tation and  discussion  of  their  study.  Kranzler’s  discussion 
of  Spearman’s  g was  both  concise  and  supportive  as  a psy- 
chometric construct;  nevertheless,  he  cautioned  that  policy 
decisions  “...must  be  based  on  more  than  psychometrics  or 
statistics”  (p.  40). 

Richardson,  T.  Q.  The  window  dressing  behind  The 
Bell  Curve.  4244. 

Richardson  disputed  several  of  Hermstein’s  and 
Murray’s  basis  assumptions  and  concluded  that  the  authors 
have  provided  nothing  more  than  “...scholarly  window- 
dressing  for  the  same  old  prejudice  that  has  plagued  this 
country  since  its  very  conception”  (p.  43).  For  example, 
she  noted  that  although  the  universal  nature  of  the  g-factor 
may  be  present,  each  culture  will  have  unique  ways  of  as- 
sessing it.  She  also  questioned  whether  Hermstein  and 
Murray  can  concurrently  hold:  (a)  that  ability  is  primarily  a 
genetic  inheritance  and  essentially  immutable  and  (b)  that 
increased  resources  ought  to  allocated  to  increase  the  qual- 
ity of  the  learning  environment  of  high  ability  students. 

Reviews  in  Edited  Books 

Jacoby,  R.,  & Glauberman,  N.  (Eds.)  (1995).  The 
Bell  Curve  debate . New  York:  Random  House. 

The  editors  of  the  book  have  provided  an  important 
service  to  scholars  and  students  who  wish  to  expand  their 
reading  in  this  area  or  who  would  appreciate  having  many 
of  the  important  review  articles  regarding  The  Bell  Curve 
compiled  and  easily  accessible.  Included  in  this  compila- 
tion are  the  scries  of  reviews  that  appeared  in  the  National 


v/ew,  and  longer  reviews  by  authors  such  as  Stephen  Jay 
Gould,  Leon  Kamin,  Irving  Lousi  Horowitz,  and  Howard 
Gardner.  In  addition,  the  editors  have  included  readings 
from  previous  debates  regarding  the  nature  of  intelligence. 
Classic  essays  by  Francis  Galton,  Karl  Pearson,  Charles 
Cooley,  Lewis  Terman,  Lothrop  Stoddard,  Walter 
Lippmann,  Carl  Brigham,  and  Horace  Bond  are  contained 
herein.  Articles  by  Arthur  Jensen,  Leon  Kamin,  and  other 
contemporary  scholars  complete  this  work.  Given  the  scope 
of  the  readings  contained  within  this  book,  it  is  likely  that 
it  will  soon  become  a required  text  in  psychology,  sociol- 
ogy, and  education  courses  where  the  nature  of  the  intelli- 
gence, environment,  and  heredity  are  studied  and  debated. 

Fraser,  S.  (1995).  The  Bell  Curve  wars.  New  York: 
Basic  Books, 

This  edited  book  provides  a supplement  to  the  Jacoby 
and  Glauberman  text  by  providing  expanded  versions  of 
articles  that  appeared  in  the  October  31,  1994  editions  of 
The  New  Republic.  In  addition  to  those  selections,  reprinted 
articles  by  Stephen  Jay  Gould,  Howard  Gardner,  and  Tho- 
mas Sowell  are  included.  Original  chapters  by  Jacqueline 
Jones  and  Orlando  Patterson  complete  this  contribution  to 
the  debate. 

Related  Publications 

Azar,  B.  (1994,  December).  Psychology  weighs  in 
on  Bell  Curve  debate.  APA  Monitor,  pp.  1,  22,  23. 

Staff  writer  Azar  added  to  the  debate  surrounding  the 
book  by  providing  short  comments  from  a variety  of  psy- 
chologists. 

Gruber,  H.  E.,  et  al.  (1995,  January).  Social  factors 
carve  The  Bell  Curve  [Letter  to  the  editor].  APA  Monitor, 
p.  5. 

Howard  Gruber  and  eight  other  faculty  members  of 
Teachers  College,  Columbia  University,  used  the  “Shared 
Perspectives”  forum  to  call  into  question  many  of  the  as- 
sumptions used  in  The  Bell  Curve  to  justify  certain  social 
policies  and  to  challenge  American  scientists  to,  “seek  cre- 
ative ways  to  rectify  the  social  evils  that  afflict  us”  rather 
than  to  “make  excuses  for  the  failure  of  our  society”  (p.  5). 

Mainstream  Science  on  Intelligence.  ( 1 994,  Decem- 
ber 13).  The  Wall  Street  Journal,  section  A,  p.  18. 

In  response  to  the  attention  directed  by  the  public 
press  toward  The  Bell  Curve,  and  the  nature  of  human  in- 
telligence in  general,  fifty  college  professors,  including 
many  of  the  most  published  authors  in  the  field  of  intellec- 
tual measurement  and  theory,  provided  a list  of  25  conclu- 
sions regarding  the  nature  of  human  intelligence.  The  con- 
clusions they  offered,  labeled  as  “mainstream  among  re- 
searchers,” were  grouped  into  six  categories:  The  meaning 
and  measurement  of  intelligence,  Group  differences,  Prac- 
tical importance,  Source  and  stability  of  within-group  dif- 
ferences, Source  and  stability  of  between-group  differences, 
and  Implications  for  social  policy. 
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A statistical  critique  of  Herrnstein  & Murray  *s  The  Bell  Curve 

by  Thomas  R.  Knapp,  The  Ohio  State  University 


In  the  time  since  its  publication  about  a year  ago,  The  Bell 
Curve  has  generated  a great  deal  more  heat  than  light.  In  their 
attempt  tc  study  the  relationship  between  intelligence  and  lots  of 
other  things,  the  authors  have  managed  to  offend  all  of  the  same 
people  that  Arthur  Jensen  offended  a quarter  of  a century  ago,  and 
then  some.  I personally  don’t  care  about  their  results  regarding 
who  is  smarter  than  whom.  All  I care  about  is  the  quality  of  the 
research  methods  upon  which  those  results  are  based.  I shall  ac- 
cordingly restrict  myself  to  a review  of  the  appendices  to  their 
book,  strange  as  that  may  seem. 

There  are  seven  appendices.  Appendix  1 is  entitled  “Statis- 
tics for  people  who  are  sure  they  can’t  learn  statistics”  and  is  one 
of  the  finest  summaries  of  basic  statistical  concepts  I have  ever 
read.  Their  interpretation  of  the  geometry  of  multiple  regression 
is  simply  superb!  I have  only  a couple  of  quibbles:  ( 1 ) The  means 
and  standard  deviations  in  their  bogus  example  of  heights  of  Olym- 
pic female  gymnasts  and  NBA  male  basketball  players  strike  me 
as  a bit  off  the  wall  (mean  of  5’  1"  and  s.d.  of  2"  for  the  gymnasts; 
mean  of  6 ’6"  and  s.d.  of  4”  for  the  basketball  players).  Since  they 
make  a big  deal  about  normal  distributions  throughout  the  book,  a 
six  s.d.  range  would  be  from  A ’7"  to  5 ’7"  for  the  women  and  from 
5’6"  to  7*6"  for  the  men.  Mary  Lou  Retton  is  small,  but  4*7"  is 
too  tiny;  so  is  5’6"  for  an  NBA  player.  (2)  In  the  discussion  of 
correlation  and  regression  they  don’t  say  “linear”  often  enough, 
and  they  don’t  make  it  quite  clear  that  you  are  trying  to  minimize 
the  “errors”  in  the  vertical  direction.  (They  actually  never  defme 
“error”.) 

The  second  appendix  treats  several  technical  matters  re- 
garding the  National  Longitudinal  Survey  of  Youth  (NLSY),  from 
which  they  took  the  data  for  their  book.  This  is  a bewildering 
appendix  in  which  they  seem  to  go  back  anc  forth  from  preferring 
to  not  preferring  weighted  vs.  unweighted  cases,  (per)centiles  vs. 
standard  scores,  age-equated  vs.  unadjusted  scoring,  and  truncated 
vs.  actual  distributions.  The  interested  reader  will  find  it  difficult 
indeed  to  follow  what  they  finally  did  about  all  of  the  problems 
that  they  mention.  Their  operationalizations  of  family  income 
and  socioeconomic  status  are  particularly  bizarre.  After  taking 
the  logaritlim  of  actual  family  income  and  standardizing  0,1  they 
cut  off  at  -4  any  income  less  than  $1000.  For  parental  occupation 
they  used  a decile  modification  of  Duncan’s  1-100  scale.  If  a 
student’s  parents)  was(were)  not  in  the  labor  force  at  all,  they 
assigned  a decile  value  of  -1 . They  then  standardized,  added,  and 
averaged  four  separate  indicators  of  SES  (including  parental  oc- 
cupation) to  get  a total  score  (with  a disappointingly  low 
Cronbach’s  alpha  of  .76),  which  was  itself  further  standardized. 
If  any  of  the  four  were  missing,  the  value  assigned  to  the  student 
for  SES  was  the  average  of  whatever  indicators  there  were. 
Methinks  the  better  approach  would  be  to  treat  all  four  of  the  indi- 
cators as  separate  independent  variables  and  to  use  listwise  dele- 
tion to  toss  out  all  cases  for  which  any  indicator  was  missing. 
This  would  have  decreased  their  sample  size  from  1 1 ,878  to  7,447, 
but  that’s  still  a lot  of  people.  (An  additional  appendix  on  miss- 
ing-data problems  would  have  helped  enormously.) 

Appendix  3 concentrated  on  the  Armed  Forces  Qualifica- 
tion Test  (AFQT),  which  provided  the  “IQ”  score.  (It  is  not  IQ  in 
either  the  traditional  MA/CA  x 100  or  the  “deviation  IQ  score 
within  age  bracket”  sense,  but  is  closer  to  the  latter).  This  appen- 
dix contains  a short,  but  excellent,  paragraph  on  what  factor  analy- 
sis is  all  about,  but  builds  a slightly  shaky  case  for  “g”  based  upon 


a first  factor  associated  with  64%  of  the  variance  among  ten 
subtest  scores  (not  individual  items),  a second  factor  with  13%, 
and  a third  factor  with  5%.  'They  commendably  avoid  here  the 
complexities  surrounding  eigenvalues  and  eigenvectors,  the  scree 
test,  etc.,  but  why  they  bothered  to  mention  “three  inferred  fac- 
tors” is  beyond  me;  that  third  factor’s  eigenvalue  is  less  than  1 .0 
and  can  be  of  little  interest.  In  this  appendix  the  authors  also 
provide  a couple  of  examples  of  the  logistic  regressions  that  are 
the  analyses  of  choice  for  much  of  the  book.  I take  exception  to 
their  Prob>ChiSq  columns,  all  of  which  are  reported  as  .0000  or 
.00000.  Surely  they  mean  <.0001  or  <.00001 . One  cannot  have  a 
tail  probability  of  0,  and  traditional  significance  tests  for  the  re- 
gression coefficients  are  not  very  helpful  in  any  event,  since  most 
of  the  sample  sizes  are  so  large  that  almost  everything  will  be 
statistically  significant  even  if  substantively  trivial.  (All  the  more 
reason  for  using  all  four  separate  indicators  of  SES  in  the  regres- 
sions; there  are  lots  cf  degrees  of  freedom  to  play  with.)  And  the 
model  on  page  590  suggests  that  some  sort  of  path  analysis  of 
direct  and  indirect  effects  of  Earlier  IQ  Score  was  carried  out, 
whereas  all  analyses  were  simple,  multiple,  or  hierarchical  mul- 
tiple. 

The  fourth  and  sixth  appendices  present  the  results  of  a 
whole  bunch  of  regression  analyses  with  the  fourth  appendix  re- 
plete with  several  ,0000’s  and  .00000’s.  There  is  a good  discus- 
sion in  Appendix  4 of  the  problems  of  interpreting  standard  er- 
rors when  using  case  weights — but  once  more  indicating  the  au- 
thors’ waffling  between  using  them  or  not  using  them — and  then- 
preference  for  concentrating  on  regression  coefficients  rather  than 
R-squares.  (I  don’t  think  logistic  regression  analyses  yield  de- 
fensible R- squares  anyhow.)  This  appendix  also  contains  a par- 
ticularly unfortunate  typographical  error  and  a statistical  boo-boo, 
both  on  page  594.  The  authors  refer  to  “one  of  the  smallest”  R- 
squares  as  “only  0.17”;  it  is  actually  .017,  as  indicated  in  the 
tables  that  follow.  And  they  go  on  to  say  that  “the  parameter... is 
significant  beyond  the  .001  level”.  Tsk,  tsk;  it  is  statistics,  i.e., 
parameter  estimates , that  are  or  are  not  statistically  significant. 
The  tables  in  Appendix  4 and  Appendix  6 are  terribly  confusing, 
mainly  because  of  the  varying  sample  sizes  due  to  certain  inclu- 
sion and  exclusion  criteria.  Some  of  the  dependent  variables  ap- 
pear to  have  been  artificially  truncated,  resulting  in  a loss  of  use- 
ful information,  by  running  logistic  regression  analysis  rather  than 
traditional  multiple  regression  analysis.  For  example,  one  of  the 
dependent  variables  treated  in  Chapter  7 (on  Unemployment,  Idle- 
ness, and  Injury)  is  “Out  of  the  labor  force  for  four  weeks  or  more 
in  1 989”  (vs.  not)  dichotomy.  Surely  the  number  of  weeks  out  of 
the  labor  force  would  be  more  informative. 

Appendix  5 on  black-white  differences  and  Appendix  7 
on  affirmative  action  are  more  substantive  than  methodological. 
They  are  representative  of  the  places  in  the  book  where  Herrnstein 
and  Murray  have  raised  the  hackles  of  their  social  critics,  and  I 
am  not  qualified  to  comment  upon  their  arguments. 

My  final  observation  has  to  do  with  the  title  of  the  book, 
which  the  authors  attribute  to  Erwin  Glikes.  I think  it’s  a terrible 
title.  Their  study  of  intelligence  and  class  structure  is  an  impor- 
tant one,  no  matter  how  intelligence,  or  anything  else,  is  distrib- 
uted. 
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A Response  to  The  Bell  Curve:  Conversation  with  John  Goodlad 

Mary  R.  Sudzina,  The  University  of  Dayton 


John  Goodlad  is  Professor  of  Education  and  Direc- 
tor of  the  Center  for  Educational  Renewal  at  the  Univer- 
sity of  Washington.  He  is  also  President  of  the  Institute  for 
Educational  Inquiry  in  Seattle.  A prolific  writer  and  re- 
searcher\ Goodlad  has  authored  or  co-authored  over  25 
books , and  published  over  200  articles . His  most  recent 
book  is  Educational  Renewal : Better  Teachers.  Better 
Schools  (1994). 

MS**  The  recently  published  book,  The  Bell  Curve, 
has  caused  much  controversy  among  educators  and  politi- 
cians. Authors  Hermstein  and  Murray  suggest  that  differ- 
ences in  intelligence  and  class  structure  affecting  Ameri- 
can life  may  have  a genetic  component,  not  easily  compen- 
sated for  by  schooling.  What  are  your  thoughts  on  this 
issue? 

JG-  Well,  you  know  this  is  nothing  new.  This  is  a 
song  that  appears  every  20  years  or  so,  Arthur  Jensen  pro- 
posed this.  I think  it’s  very  unfortunate  that  this  is  being 
put  into  the  conversation  of  the  U.S.  at  a time  when  there  is 
so  much  hatred  going  around;  when  there  is  so  much  sepa- 
ration and  divisiveness.  This  is  one  more  division  of  our 
people.  The  best  answers  are  in  Stephen  Jay  Gould,  The 
Msmeasure  of  Man.  He  does  not  refute  the  data  presented. 
It  is  the  attribution  that  we  must  examine. 

What  reports  of  this  kind  completely  ignore  is  that 
three  generations  of  poverty  will  leave  you  in  poverty. 
Those  in  the  third  generation  of  poverty  inherit  a deprived 
environment.  What  about  all  of  those  children  of  this  sup- 
posed inferior  gene  background  who,  under  the  stimulus  of 
jobs,  income,  good  schooling  have  risen  to  very  high  places? 
How  do  you  explain  General  Powell?  How  do  you  explain 
Linda  Darling-Hammond?  How  do  you  explain  Donald 
Stewart,  the  head  of  the  College  Board?  How  do  you  ex- 
plain Franklin  Thomas,  the  president  of  the  Ford  Founda- 
tion? How  do  you  explain  all  of  these  people  who  have 
risen  to  university  presidencies,  and  who  are  black? 

MS-  That  sounds  like  you’re  making  some  sweeping 
generalizations  about  blacks. 

JG-  Given  the  opportunity,  they  succeed  just  as  well 
as  whites.  If  you  have  been  discriminated  against,  and  de- 
prived of  the  best  education,  doesn’t  it  follow  that  you’re 
not  going  to  perform  as  well?  If  you’ve  had  to  rise  out  of 
slavery,  rise  out  of  poverty,  then  what  is  being  inherited? 
The  genes  or  the  circumstances?  The  data  don’t  tell  us 
that. 

What  is  the  Number  One  predictor  of  a child’s  per- 
formance in  school?  Once  upon  a time  it  was  the  educa- 
tional level  of  the  father.  Now  it’s  the  educational  level  of 
both  parents.  If  the  two  parents  are  college  educated,  the 
child’s  chances  of  academic  success  are  good.  If  the  par- 
ents are  not  college  graduates,  chances  are  less.  So,  here 


we  are  saying  that  all  of  these  folks  who  have  had  only  an 
elementary  education,  and  a poor  one  at  that  in  a deprived 
community,  aren’t  as  bright  as  other  people.  It  isn’t  that 
they  aren  ’t  as  bright,  it’s  that  they  haven’t  learned  the  things 
that  are  performed  on  tests. 

We  published  a book  in  1990  which  challenged  many 
of  these  assumptions.  It  ’ s called  Access  To  Knowledge  and 
was  publishedby  the  College  Board.  It  was  released  again 
in  a new  edition  in  November,  1994.  It  provides  all  kinds 
of  counter  evidence  to  this  kind  of  argument. 

Howard  Gardner  says  that  there  are  many  kinds  of 
intelligence.  I wrote  a piece  in  Ed  Week  a few  years  ago 
called  “Beyond  Half  an  Education”  and  I talk  about  all  the 
bright  well-educated  people  who  didn’t  do  well  in  school. 
These  are  the  people  who  keep  me  afloat.  They  are  the 
people  who  know  how  to  fix  the  diesel  engine  in  my  boat. 
The  only  thing  that  got  many  of  them  through  school  at  all 
was  that  they  were  good  in  the  arts,  back  in  the  days  when 
we  had  arts.  These  people  are  geniuses  in  what  they  do, 
but  my  guess  is  that  on  a standardized  intelligence  test  they 
might  score  a 96.  They  are  absolutely  critical  to  our  soci- 
ety and  are  very  gifted  in  their  areas  of  competence. 

I did  a little  study  years  ago.  I never  published  it.  It 
had  to  do  with  a bill  in  California,  called  the  Miller  Unruh 
Bill,  which  provided  money  to  schools  to  provide  additional 
help  in  reading.  But  there  was  a condition  to  it,  and  that  is, 
you  had  to  have  a separate  class  and  there  couldn’t  be  more 
than  12  in  a class.  So,  I went  into  schools  and  disco  ered 
that  10  or  more  of  the  12  students  in  every  class  in  every 
school  were  black.  In  some  schools,  they  were  the  only 
black  children  in  the  schools.  How  had  they  gotten  into 
this  group?  On  the  assumption  that  because  they  were  black 
they  couldn’t  leam?  Because  they  were  dumber?  No,  be- 
cause it  was  assumed  they  were  dumber  because  they  were 
black. 

That  is  where  schools  are  immoral.  Look  at  the  fail- 
ure rates  in  city  schools  that  are  mixed  white  and  black. 
Black  failure  rates  will  outnumber  the  white  from  kinder- 
garten on.  Now  what’s  that  due  to?  That’s  largely  because 
of  the  affluence,  the  support,  and  the  educational  level  of 
the  white  families. 

An  important  book  on  this  subject  was  published  by 
Yale  University  Press  in  April,  1995.  It’s  by  a man  named 
Scott  Miller  and  it’s  a blockbuster.  It  raises  the  question, 
“Why  are  black  boys  not  doing  well  in  school?”  I suggest 
that  you  look  at  anthropologist  John  Ogbu’s  work  at  the 
University  of  California,  Berkeley,  and  you  will  begin  to 
see  why. 

MS-  Thank  you  for  your  thoughts  and  contributions 
on  this  issue. 
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Voices  in  Education 

Marlene  Schommer,  Wichita  State  University 


Veteran  leaders  of  education , as  well  as  some  new  leaders,  were  directly  asked  by  the  author  to  re- 
spond to  the  following  two  questions . Their  Reaction  and  Impact  estimates  are  summarized  below.  The 
u leader  ” is  identified  at  the  end  of  the  responses . 

L What  is  your  Reaction  to  the  controversial  book  entitled \ Ihe  Bell  Curve? 

2 . Do  you  believe  this  book  will  have  a major  Impact  on  ihe  field  of  education? 


Reaction:  My  initial  reaction  was  personal  embarrass- 
ment. I found  myself  slinking  around,  reading  the  book  on  the 
sly,  and  avoiding  it  in  conversation  with  my  colleagues.  After 
a while,  I realized  that  my  situation  actually  demonstrated  an 
embarrassment  within  *he  academy.  It’s  a sorry  commentary 
on  intellectual  freedom  when  a topic  so  obvious — namely,  ex- 
ploring cognitive  ability  in  any  way  that  is  relevant  to  social 
life — is  so  feared  and  avoided.  Even  the  reasons  people  give 
for  discounting  the  book  seem  tortured.  I heard  someone  say 
that  the  book  couldn’t  possibly  be  credible  because  Arthur 
Jensen’s  name  appeared  frequently  in  the  book’s  reference  list. 
In  essence,  this  argument  says:  The  book  shouldn’t  be  taken 
seriously  because  it  relies  on  recognized  experts  in  the  field  of 
intelligence.  Applying  similar  logic,  it  would  appear  that  texts 
on  gender  differences  should  be  rejected  if  David  or  Myra 
Sadker  is  cited. 

Second,  because  of  the  popular  hype  associated  with 
the  book,  I expected  to  find  much  ado  about  ethnic  differences, 
though  I found  comparatively  little.  Much  of  the  book  was 
devoted  to  exploring  interesting  correlates  of  cognitive  ability 
(for  example,  one  finding  was  that,  controlling  for  age,  educa- 
tion, and  SES,  smarter  people  have  fewer  accidents  on  the  job). 

Finally,  I was  delighted  that  the  book  became  a best 
seller.  I have  been  concerned  that  the  debates  that  occur  in 
psychometric  journals  are  too  often  arcane  and  irrelevant  to 
educational  policy  and  practice.  The  Bell  Curve  addresses  dif- 
ficult issues  in  a way  that  is  accessible  to  a diverse  readership 
and,  as  far  I can  tell,  does  not  compromise  accuracy  to  do  so. 
In  facv,  the  first  Appendix  (called  '‘Statistics  for  people  who 
arc  sure  they  can’t  learn  Statistics)  is  one  of  the  clearest  intro- 
ductory treatments  of  distributions,  dispersion,  correlation,  and 
regression  that  I have  seen. 

Impact:  None.  First,  I suspect  that  the  number  of  cop- 
ies of  the  book  purchased  greatly  exceeds  the  number  of  cop- 
ies actually  read.  A great  majority  of  Americans  own  Bibles 
too,  but  what  does  that  mean?  The  information  many  people 
get  about  the  book  will  be  second-hand;  they  will  probably 
inaccurately  conclude  that  the  book  is  all  about  race. 

The  book’s  authors  conclude  that  neither  current  edu- 
cational practice,  nor  any  of  the  popular  reform  efforts  is  likely 
to  have  much  impact  on  general  cognitive  ability.  However, 
one  of  the  book’s  policy  recommendations  that  seems  promis- 
ing is  that  we  find  ways  to  ascribe  more  value  to  cognitive 


ability  and  academic  success  in  American  education.  My  own 
daughter,  who  made  the  “Quiz  Bowl”  team  at  her  homoge- 
neous, middle-class,  suburban  junior  high  school,  will  still  not 
forgive  me  for  encouraging  her  to  try  out  for  the  team.  Appar- 
ently, success  at  cognitive  endeavors  makes  one  an  instanta- 
neous social  outcast.  She  tells  me  it’s  not  cool  to  get  As.  One 
hope  is  that  The  Bell  Curve  will  stimulate  broader  interest  in 
promoting  and  enhancing  cognitive  ability,  perhaps  (though 
this  may  be  too  great  a hope)  even  to  the  same  level  that  stu- 
dents now  apprehend  the  social  pressures  to  promote  and  en- 
hance athletic  ability. 

Gregory  J.  Cizek 

The  University  of  Toledo,  Ohio 


Reaction:  The  book  appears  to  be  most  controversial 
among  those  who  have  not  read  it  or  who  do  not  understand 
the  multiple  regression  methodology  used.  The  book  is  an  ex- 
cellent summation  of  a particular  field  of  educational  research 
and  a rigorous  analysis  of  existing  data.  Indeed,  the  book  should 
more  accurately  be  called,  “A  thorough  analysis  of  the  Na- 
tional Longitudinal  Survey  of  Youth”  (a  less  compelling  title, 
to  be  sure).  In  my  view,  the  main  legitimate  critique  of  the 
book’s  conceptual  basis  has  been  egregiously  overlooked  by 
half-cocked  critics  and  columnists.  Not  quite  a “fatal  flaw,” 
but  a concern  is  that  the  “ability”  measure  used  is  much  more 
of  a narrow  aptitude/academic  achievement  measure  than  it  is 
a broad  ability  measure.  Indeed,  the  ability  measure  employed 
is  much  closer  to  a SAT  in  content  than  to  a more  general 
ability  measure  (e.g.,  matrices-type  tests).  While  it  is  conceiv- 
able that  similar  results  could  have  been  found  with  a broader- 
based,  more  culturally-fair  measure  of  ability,  this  is  an  overall 
concern  that  deserves  more  attention. 

In  Appendix  3 of  the  book  the  measure  of  ability  is 
explained  at  length.  The  four  subtests  making  up  the  ability 
measure  are  Word  Knowledge  (a  vocabulary  test),  Paragraph 
Comprehension  (a  reading  comprehension  test),  Aritlmietic 
Reasoning  (a  problem-solving  test  using  math  fundamentals) 
and  Mathematics  Knowledge  (a  basic  math  test).  These  tests 
are  highly  g-loaded,  but  certainly  could  be  criticized  as  being 
mere  measures  of  academic  achievement.  This  is  particularly 
interesting  in  that  the  book  fingers  low  cognitive  ability  as  the 
main  culprit  in  creating  problems  in  society,  as  opposed  to  lack 
of  education,  This  important  fact  seems  to  have  been  totally 
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overlooked  in  nonscientific  knee-jerk  media  criticism  (such  as 
columnist  Carl  Rowan,  who,  in  his  reaction  called  testing  a 
“pseudo-science,”  which  causes  one  to  wonder  where  exactly 
column-writing  is  on  the  scientific  continuum). 

Also  of  concern,  the  authors  point  out  that  ability  con- 
sistently predicts  above  and  beyond  SES  (while  SES  never  pre- 
dicts above  and  beyond  ability).  The  authors  use  this  in  sup- 
port ofthe  importance  of  cognitive  ability.  Yet,  this  result  could 
entirely  be  due  to  the  unreliability  of  the  SES  measure,  rather 
than  due  to  ability  being  a better  predictor. 

My  two  criticisms  aside,  it  is  important  to  point  out 
that  the  authors  are  willing  to  investigate  a legitimate  research 
hypothesis.  Competing  hypotheses  are  also  proposed  by  the 
authors.  Scientific  method  allows  for  these  hypotheses  to  be 
studied,  and  for  support  to  fall  where  it  may.  Interestingly,  it 
seems  that  less  support  is  needed  for  a hypothesis  in  line  with 
current  political  opinion  than  for  one  that  the  authors  propose. 
Overall,  the  work  is  exceptionally  rigorous  and  much  more  tem- 
perate in  tone  than  the  media  would  lead  us  to  believe. 

Impact:  If  the  book  has  an  impact  in  education,  it  will 
be  to  further  conceptualize  educational  research  with  large  da- 
tabases, rather  than  to  shape  public  opinion  (I  do  not  think  re- 
search has  ever  been  a strong  factor  in  shaping  public  belief). 

Brian  Stone 

Wichita  State  University 

Reaction  and  Impact:  The  Bell  Curve  rings  hollow  for 
a number  of  reasons.  First,  the  book  repeatedly  confuses  cor- 
relation with  causation,  a mistake  that  even  first-year  statistics 
students  learn  not  to  make.  The  fact  that  there  is  a correlation 
between  IQ  and  a number  of  variables  says  nothing  about  the 
cause  of  this  correlation.  Certainly  it  does  not  imply  that  low 
IQ  causes  the  correlation. 

Second,  there  is  good  reason  to  believe  that  the  cor- 
relation is  otherwise  caused.  In  our  society,  we  require  high 
scores  on  IQ-like  tests  to  enter  higher  education — not  just  col- 
lege, but  graduate  and  professional  schools  as  well.  Someone 
who  does  not  test  well  is  likely  to  be  denied  access  to  routes  to 
high-paying,  prestigious  careers.  Thus,  we  create  a correlation 
between  IQ  and  career  and  other  forms  of  socio-economic  suc- 
cess. These  correlations  do  not  simply  exist  in  nature.  In  the 
past,  we  selected  on  other  things  (e.g.,  parental  income).  We 
need  to  distinguish  between  the  products  of  a social  system 
and  its  causes,  namely,  our  decisions  regarding  what  we  value. 

Third,  even  the  statistical  associations  reported  in  the 
book  are  very  weak.  You  have  to  turn  to  Appendix  IV  ofthe 
book  to  discover  that  most  of  the  coefficients  of  determination 
(squared  correlations)  on  which  the  inferences  are  based  are 
less  than  0.1.  In  other  words,  the  authors  draw  causal  argu- 
ments on  the  basis  of  less  than  10%  explained  variance! 

Finally,  the  book  will  have  little  effect  on  educational 
policy  because  the  policy  recommendations  in  the  book  have 
nothing  to  do  with  the  data.  One  could  not  come  to  any  educa- 
tional policy  recommendations  at  all  on  the  basis  of  these  data, 
and  one  would  hope  that  our  society  would  prefer  more  hu- 
mane rather  than  less  humane  ones  if  we  want  to  produce  the 
very  best  in  our  next  generation  of  children. 

Robert  J.  Sternberg 
Yale  University 


Reaction  and  Impact:  The  science  in  The  Bell  Curve  is 
more  like  special  pleading,  based  on  a biased  reading  of  the 
data,  than  a carefully  balanced  assessment  of  current  knowl- 
edge. 

They  report  that  efforts  to  raise  intelligence  have  been 
programs  of  affirmative  action  or  other  ameliorative  measures 
at  school  or  in  the  workplace.  Their  ultimate  solution,  such  as 
it  is,  is  the  resurrection  of  a world  they  attribute  to  the  Found- 
ing Fathers.  These  wise  men  acknowledged  large  differences 
in  human  abilities  and  did  not  try  artificially  to  bring  about 
equality  of  results;  instead,  Hermstein  and  Murray  tell  us,  they 
promoted  a society  in  which  each  individual  had  his  or  her 
place  in  a local  neighborhood  and  was  accordingly  valued  as  a 
human  being  with  dignity. 

Yet  I became  increasingly  disturbed  as  I read  and  re- 
read this  800-page  work.  I gradually  realized  I was  encounter- 
ing a style  of  thought  previously  unknown  to  me:  scholarly 
brinkmanship.  Whether  concerning  an  issue  of  science,  policy, 
or  rhetoric,  the  authors  come  dangerously  close  to  embracing 
the  most  extreme  positions,  yet  in  the  end  shy  away  from  do- 
ing so.  Discussing  scientific  work  on  intelligence,  they  never 
quite  say  that  intelligence  is  all-important  and  tied  to  one’s 
genes;  yet  they  signal  that  this  is  their  belief  and  that  readers 
ought  to  embrace  the  same  conclusions.  Discussing  policy, 
they  never  quite  say  that  affirmative  action  should  be  totally 
abandoned  or  that  childbearing  or  immigration  by  those  with 
low  IQS  should  be  curbed;  yet  they  signal  their  sympathy  for 
these  options  and  intimate  that  readers  ought  to  consider  these 
possibilities.  Finally,  the  rhetoric  of  the  book  encourages  read- 
ers to  identify  with  the  IQ  elite  and  to  distance  themselves  from 
the  dispossessed  in  what  amounts  to  an  invitation  to  class  war- 
fare. Scholarly  brinkmanship  encourages  the  reader  to  draw 
the  strongest  conclusions,  while  allowing  the  authors  to  dis- 
avow this  intention. 

Though  Hermstein  deviated  sharply  in  many  particu- 
lars from  his  mentor  B.  F.  Skinner,  the  analysis  in  The  Bell 
Curve  is  Skinnerian  in  a fundamental  sense:  It  is  a “black  box 
analysis.”  Along  with  most  psychometricians,  Herrstein  and 
Murray  convey  the  impression  that  one’s  intelligence  simply 
exists  as  an  innate  fact  of  life— unanalyzed  and  unanalyzable- 
as  if  it  were  hidden  in  a black  box.  Inside  the  box  there  is  a 
single  number,  IQ,  which  determines  vast  social  consequences. 

Howard  Gardner 

Harvard  University 

(Permission  granted  to  quote  from  1995,  Cracking  open 
the  IQ  box,  The  American  Prospect , 73-75.) 


What  is  “Heritability”  and  What  is  it  Not ? 

LisabethF.  DiLalla,  Behavioral  and  Social  Sciences,  School  of  Medicine 
David  L.  DiLalla,  Department  of  Psychology 
Southern  Illinois  University 


Afuch  controversy  has  been  generated  by  Hermstein  and 
Murray’s  1994  book,  The  Bell  Curve.  In  order  to  critically 
evaluate  some  aspects  of  the  research  they  discuss,  it  is  impor- 
tant to  understand  the  term  “heritability”  which  is  used  fre- 
quently in  the  book  as  well  as  in  much  of  the  research  literature 
on  intelligence. 

Human  beings  exhibit  a staggering  degree  of  physical 
and  behavioral  diversity.  What  accounts  for  these  ‘individual 
differences’  among  people  has  been  at  the  heart  of  the  tradi- 
tional nature-nurture  debate.  The  term  “heritability”  is  often 
mistakenly  employed  in  “yes  or  no”  terms  in  both  the  popular 
and  scientific  press  by  individuals  attempting  to  explain  the 
origin  of  individual  differences.  It  is  uninformative  and  incor- 
rect to  simply  report  that  a human  characteristic  is  heritable. 
Rather,  heritability  is  a statistic  that  provides  information  about 
the  degree  to  which  observed  differences  among  individuals 
are  the  result  of  genetic  differences  among  the  individuals. 
Heritability  (or  h2)  can  range  from  0 to  1 . Like  any  other  statis- 
tic, heritability  is  specific  to  the  sample  on  which  it  was  calcu- 
lated, and  it  should  only  be  generalized  to  groups  that  are  simi- 
lar to  the  original  sample. 

Heritability  is  also  a group  statistic.  It  does  not  provide 
predictive  information  about  specific  individuals.  For  example, 
height  is  a human  characteristic  that  has  been  found  to  have  a 
heritability  of  roughly  .80.  This  means  that  approximately  80% 
of  observed  differences  among  people  with  respect  to  height 
are  due  to  the  genetic  differences  among  the  individuals  mea- 
sured and  that  20  % of  the  observed  individual  differences  can 
be  traced  to  the  influence  of  environmental  differences  (and 
measurement  error).  A heritability  of  .80  does  not  imply  that 
80%  of  an  individual’s  height  is  the  result  of  genes  with  the 
remainder  due  to  environment.  It  does  imply  that  to  the  degree 
that  the  individual  differs  from  average,  80  % of  that  differ- 
ence is  the  result  of  genetic  factors  and  20%  is  the  result  of 
environmental  factors. 

The  distinction  between  within-gro up  and  between-group 
level  of  analysis  cuts  to  the  heart  of  much  of  the  controversy 
over  The  Bell  Curve.  The  vast  majority  of  studies  of  the  herita- 
bility of  IQ  are  based  on  predominantly  White  samples.  These 
within-group  heritability  statistics  cannot  appropriately  be  in- 
terpreted as  explaining  the  often  observed  mean  difference  in 
IQ  between  White  and  African  American  populations.  Given 
current  methodology,  tile  heritability  statistic  is  simply  unin- 
formative with  respect  to  the  question  of  what  gives  rise  to 
group  differences  in  human  characteristics. 

How  are  heritability  estimates  derived?  Behaviors  or 
other  characteristics  that  can  be  seen  or  measured  are  called 
“phenotypes”.  Height  is  a phenotype;  so  are  eye-color,  heart- 
rate,  presence  or  absence  of  a psychiatric  diagnosis,  marital 
status,  and  IQ.  The  “meaning”  of  phenotypes  is  not  always 


clear.  We  can  measure  marital  status  with  a high  degree  of 
accuracy,  and  if  we  conduct  a twin  study  of  marital  status,  we 
will  likely  find  a high  degree  of  heritability  for  divorce.  Does 
this  mean  that  there  is  a divorce  gene  somewhere  on  the  ge- 
nome? Of  course  not.  In  this  case,  the  ‘meaning’  of  divorce 
status  with  respect  to  heritability  may  have  more  to  do  with 
unmeasTired  characteristics  such  as  personality  traits. 

In  the  case  of  IQ,  there  is  a good  deal  of  evidence,  re- 
viewed by  Hermstein  and  Murray  (1994)  and  others  (e.g.,  Carrol 
& Horn,  1981)  that  IQ  tests  measure  a construct  related  to  indi- 
viduals’ general  cognitive  abilities.  Still,  it  must  be  borne  in 
mind  that  just  as  heritability  estimates  are  specific  to  samples, 
they  are  also  specific  to  the  phenotypic  measure  employed,  and 
the  reliability  and  validity  of  such  measures  should  always  be 
taken  into  account  by  consumers  of  research. 

Observable  measurable  characteristics,  then,  are  pheno- 
types. Our  genetic  make-up  is  our  “genotype”.  Heritability, 
as  noted  above,  is  a fairly  simple  statistic  that  represents  the 
ratio  of  genetic  variance  to  phenotypic  variance  (Plomin, 
DeFries,  & McCleam,  1990).  A phenotype  such  as  height  is 
highly  heritable  because  genetic  factors  play  a very  large  role 
in  determining  individual  differences  in  stature,  whereas  the 
environment  plays  a smaller,  but  by  no  means  unimportant, 
role.  A phenotype  such  as  religious  affiliation,  on  the  other 
hand,  shows  virtually  zero  heritability  because  differences  in 
religious  affiliation  are  primarily  dependent  on  the  affiliation 
of  the  family  one  happens  to  grow  up  with.  (Note  that  religios- 
ity, a personality  trait  related  to  intensity  of  religious  orienta- 
tion, shows  a higher  degree  of  heritability.)  Most  phenotypes 
that  we  study  fall  somewhere  in  between,  being  determined 
partly  by  genetic  make-up  and  partly  by  environmental  influ- 
ences. Measured  intelligence,  or  IQ,  appears  to  be  one  of  these 
phenotypes.  Research  to  date  suggests  that  somewhere  be- 
tween 40%  and  70%  of  the  variance  in  intelligence  can  be  at- 
tributed to  genetic  make-up,  with  about  30%  to  60%  of  the 
variance  being  attributed  to  environmental  influences  and  mea- 
surement error. 

In  studies  of  human  characteristics,  heritability  can  be 
estimated  using  one  of  several  types  of  samples  and  techniques. 
The  "twin"  method  involves  measuring  the  correlation  between 
identical  twins  and  the  correlation  between  fraternal  twins  on 
the  behavior  in  question.  The  correlation  between  identical 
twins  (the  degree  to  which  they  are  similar  to  each  other)  is  a 
function  of  their  genetic  make-up  (they  are  genetically  identi- 
cal) and  the  environmental  influences  that  they  share.  These 
are  designated  as  h2  and  c2,  respectively.  The  equation  for  this 
correlation  is  shown  in  Equation  1 : 

= h2  + cJ  (Eqn.  1) 

The  correlation  between  fraternal  twins,  who  share  on 
average  across  a large  sample  approximately  50%  of  their  genes,  __ 
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is  also  a function  of  their  genetic  make-up  and  the  environ- 
mental influences  that  they  share.  The  equation  for  this  corre- 
lation is  shown  in  Equation  2: 

iDZ=  ^(h^  + c2  (Eqn.  2) 

A rough  estimate  of  heritability  can  be  achieved  by  sub- 
tracting the  two  equations.  Thus,  r^  minus  rD2  is  equal  to  1/ 
2(h2).  Doubling  the  difference  between  the  correlations  pro- 
vides an  estimate  of  the  heritability  (h2)  of  the  characteristic 
under  study.  This  estimate  depends  on  a particular  assump- 
tion, called  the  “equal  environments  assumption”,  that  states 
that  identical  and  fraternal  twins  share  similar  “trait-relevant” 
environments  to  the  same  extent,  so  that  neither  identical  nor 
fraternal  twins  are  treated  more  similarly  to  each  other  than  the 
other  twin  type  with  respect  to  the  characteristic  of  interest. 
The  small  amount  of  research  that  has  explored  this  assump- 
tion has  supported  the  applicability  of  the  equal-environments 
assumption  (e.g.,  Loehlin  & Nichols,  1976;  Plomin,  1986). 

In  1981,  a meta-analysis  performed  by  Bouchard  and 
McGue  on  4,672  pairs  of  identical  twins  measured  for  intelli- 
gence showed  a correlation  between  pair  members  of  .86.  The 
correlation  between  members  of  5,546  pairs  of  fraternal  twins 
was  .60.  Doubling  the  difference  between  these  correlations 
yielded  a broad  heritability  estimate  of  2(.86  - .60)  = 2(.26)  = 
.52.  Thus,  this  meta-analysis  suggested  that  approximately  half 
of  the  variance  seen  in  measured  intelligence  is  attributable  to 
genetic  influences  and  approximately  half  of  the  variance  is 
attributable  to  environmental  influences  plus  measurement  er- 
ror. 

Theoretically,  a more  precise  estimate  of  heritability 
could  be  obtained  if  one  could  take  infants  who  were  geneti- 
cally identical  (identical  twins)  and  separate  them  at  birth,  rais- 
ing them  in  very  different  environments.  Their  later  measure- 
ments on  an  intelligence  test  could  then  be  compared.  If  these 
twin  pairs  showed  exactly  the  same  IQ  scores,  then  it  could  be 
assumed  that  intelligence  is  completely  genetically  determined. 
If  the  twin  pairs  showed  no  resemblance  at  all  in  their  IQ  scores, 
then  intelligence  could  be  said  to  be  completely  environmen- 
tally determined.  To  the  extent  that  their  correlations  fell  some- 
where in  between  these  extremes,  the  heritability  of  intelligence 
would  also  be  somewhere  between  100%  and  0%.  In  this  ide- 
alistic, perfect  experiment,  fraternal  twins  would  not  be  needed 
for  comparisons.  The  first  problem  with  this  design,  of  course, 
is  that  identical  twins  are  very  rarely  separated  from  each  other 
as  infants,  so  that  collecting  a sample  of  such  twins  is  extremely 
difficult  and  time-consuming.  Also,  of  the  identical  twins  who 
are  separated  from  each  other,  they  often  are  not  separated  right 
at  birth,  and  they  are  often  not  placed  in  very  different  types  of 
environments.  Finally,  if  the  prenatal  environment  has  an  im- 
portant effect  on  later  intelligence,  then  their  environments  are 
not  completely  independent.  A large-scale  study  using  this 
MZA  (monozygotic  apart)  design  is  on-going  in  Minnesota 
(Bouchard  et  al.,  1990)  and  the  results  are  provocative,  but  of 
course  the  caveats  mentioned  above  must  be  bom  in  mind. 

Adoption  studies  often  are  used  to  assess  heritability.  In 
the  adoption  design,  two  sets  of  correlations  are  obtained.  First, 
the  correlation  between  the  adopted  child  and  the  natural  par- 
ents is  calculated.  This  correlation,  assuming  the  child  was 
separated  from  the  parents  at  birth  and  raised  in  an  unrelated 
environment,  is  a reflection  of  the  genetic  influences  operating 
on  the  characteristic  being  measured.  The  second  correlation 


is  that  between  the  adopted  child  and  the  adoptive  parents.  This 
correlation  reflects  the  degree  to  which  the  environment  has 
played  a role  in  the  measured  characteristic.  A comparison 
between  these  two  correlations  can  provide  insight  into  the 
degree  to  which  the  characteristic  is  heritable.  If  the  child  is 
much  more  like  the  natural  parents  than  the  adoptive  parents, 
then  genotype  must  be  important  for  the  characteristic.  If,  on 
the  other  hand,  the  child  is  much  more  similar  to  the  adoptive 
parents,  then  the  environment  has  been  critical  for  shaping  the 
characteristic. 

In  sum,  heritability  can  be  estimated  several  ways.  Most 
importantly,  if  a number  of  estimates  using  a number  of  meth- 
ods continually  yields  heritabilities  that  are  comparable,  then 
we  can  feel  confident  that  these  heritability  estimates  are  fairly 
accurate.  This  is  the  case  with  studies  of  measured  intelligence. 
Across  a large  number  of  studies,  using  various  methods  and 
statistical  methodologies  varying  in  complexity,  the  heritabil- 
ity estimate  consistently  falls  between  approximately  .4  and 
.7.  Thus,  estimating  intelligence  as  being  about  50%  heritable 
is  a reasonable  conclusion.  We  must  bear  in  mind  that  this  leaves 
about  half  of  the  variance  attributable  to  environmental  influ- 
ences. This  leaves  plenty  of  room  for  intervention  efforts  de- 
signed at  increasing  IQ  scores  for  certain  populations  of  chil- 
dren by  working  with  parents  and  schools.  At  the  same  time,  it 
serves  as  a critical  reminder  that  individuals  have  intellectual 
limits.  The  important  thing  is  to  assist  children  in  reaching 
their  highest  potential  by  providing  high-quality  schooling  and 
by  intervening  with  families  when  children  appear  to  be  at  risk 
for  school  failure  or  other  negative  outcomes.  Heritability 
should  not  be  viewed  as  a deterrr;nistic  measure  that  revokes 
all  free  choice  and  individuality.  Nor  should  it  be  invoked  to 
explain  observed  mean  differences  in  IQ  between  groups  of 
people.  Rather,  it  allows  us  to  understand  the  degree  to  which 
genetic  and  environmental  factors  play  an  important  role  in 
shaping  characteristics  such  as  intelligence. 
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My  Swing  at  the  Bell! 

By  Dennis  W.  Leitner,  Southern  Illinois  University 


After  reading  the  book  and  many  of  the  reviews , I wanted  to  comment  on  several  aspects  of  The  Bell 
Curve . Fd  like  to  consider  a statistical  perspective , a Black  Perspective,  and  a 'central ' concluding 
idea. 


A Statistical  Perspective 

An  article  entitled  ’Wringing  The  Bell  Curve:  A 

Cautionary  Tale  About  the  Relationships  Among  Race, 
Genes  and  IQ’  written  by  Bemie  Devlin,  Stephen  E. 
Fienberg,  Daniel  P.  Resnick  and  Kathryn  Roeder  appeared 
in  the  Summer,  1995  (Vol.  8,  No.  3,  pp.  27-36)  issue  of 
Chance.  [The  reference  to  a bell-shaped  curve,  inappro- 
priate as  it  is  as  argued  by  Devlin,  et  al.,  continues  to  pro- 
mote puns  on  the  book’s  title.  Some  of  the  best/worst  ones, 
depending  on  your  opinion  of  puns,  are  ’CurvebalT  (Stephen 
Jay  Gould),  ’Alarm  Bell’  (Christopher  Caldwell),  ’Behind 
the  Curve’  (LeonJ.Kamin),  ’Cracked  Bell’,  and  ’For  Whom 
The  Bell  Curve  Curves’  (Stanley  Feingold). 

The  authors  note  that  the  publication  of  this  book  in 
October  1994,  the  vigorous  sales  of  this  book  in  the  fall- 
spring of  1994-95,  coupled  with  the  election  in  November 
1994  of  a ’Republican  majority  whose  political  agenda  was 
fully  in  sync  with  the  Hermstein  and  Murray  social  analy- 
sis,’ (p.  27)  forebodes  poorly  for  welfare  reform  and  affir- 
mative action  programs  affecting  education  and  the  work- 
place. They  argue  that  this  book  may  be  used  as  support  of 
the  arguments  of  this  Republican  majority,  even  though  the 
authors  find  serious  problems,  (some  definitional,  some  sta- 
tistical, some  logical)  with  the  conclusions  and  recommen- 
dations found  in  its  845  pages,  including  the  appendix.  In 
fact,  much  of  their  criticism  relate  to  the  statistical  meth- 
ods found  in  the  appendix. 

While  the  authors  think  that  this  is  an  important  book 
for  those  interested  in  education,  social  science  and  public 
policy,  they  are  ’not  persuaded  by  its  argument,  however 
and  ...  are  not  alone  in  our  judgement.... Suffice  it  to  say 
that  The  Bell  Curve  has  fared  poorly  in  the  eyes  of  its  quan- 
titatively oriented  academic  critics’  (p.  29). 

Devlin  et  al.  start  their  criticism  with  the  title.  Few 
of  H&M’s  arguments  require  the  normal  distribution  of  their 
data.  ’Scores  on  intelligence  t ests  that  lie  at  the  heart  of  the 
H&M  arguments  are  decidedly  not  normal,  even  approxi- 
mately’ (p.  3 1).  The  scores  are  transformed  to  remove  the 
skewness  in  the  IQ  data.  ’Then  they  attempt  to  explain  the 
implications  of  their  estimated  models  by  using  “illustra- 
tive examples”  of  individuals  falling  way  out  in  the  tails  of 
the  IQ  distribution!’  (p.  31). 

There  is  no  caution  of  inferring  causal  relationship 
from  regression  analysis  and  no  caution  of  errors  of  speci- 
fication and  bias.  After  an  inadequate  ’exposition  of  the 
technical  basis  of  their  arguments,  it  is  not  surprising  that 
H&M  lead  their  readers  quickly  to  the  edge  of  a causal  cliff 


and  drag  them  over  the  precipice  into  the  contrived  world 
of  genetic  determinism’  (p.  3 1). 

After  a historical  overview  of  genes  and  IQ  and  a 
discussion  of  what  exactly  is  intelligence,  the  authors  dis- 
cuss the  issue  of  the  heritability  of  IQ  and  distinguish  be- 
tween two  types  of  heritability.  ’...[T]he  quantity  H&M 
need  to  make  their  arguments  about  America’s  future  is 
what  is  known  among  geneticists  as  narrow-sense  herita- 
bility\ whereas  the  quantity  that  they  extract  from  the  twins 
studies  and  report  in  the  book  is  what  is  called  broad-sense 
heritability  plus  the  maternal  effect).’  Devlin  et  al.  have 
~ reanalyzed  data  from  original  studies.  ’Our  best  estimate 
of  narrow-sense  heritability  for  Caucasians  in  the  United 
States  is  .33;  for  broad-sense  heritability,  it  is  .45’  (p.  33). 
This  is  substantially  lower  than  the  .6  to  .8  H&M  seem  to 
propose  as  the  basis  for  their  cognitive  class  structure. 

In  questioning  the  use  of  multiple  and  logistic  regres- 
sion, the  authors  address  a series  of  five  questions.  (1)  Are 
the  data  from  the  NLSY  suited  for  the  exploration  of  the 
possible  “effects”  of  IQ  and  other  individual  variables  on 
variable  social  outcomes?  (2)  Have  H&M  extracted  the 
relevant  variables  for  inclusion  in  their  analysis?  (3)  Are 
the  regression  and  logistic  regression  equations  properly 
specified?  (4)  Do  they  provide  an  adequate  fit  to  the  data? 
(5)  Presuming  that  the  answers  to  questions  1 through  4 
are  positive,  do  we  have  sufficient  evidence  from  these  and 
other  analyses  to  interpret  the  results  in  a causal  fashion,  as 
H&M  do? 

While  the  authors  don’t  have  space  to  address  thor- 
oughly each  question,  they  note  that  most  critics  seem  to 
grant  that  NLSY  is  suitable  for  the  analysis,  but  question 
how  the  variables  are  measured  and  whether  H&M  then 
use  the  variables  appropriately.  There  has  been  criticism 
of  the  suirogate  variable  H&M  use  for  socioeconomic  sta- 
tus (i.e.,  ’an  arithmetic  average  of  standardized  version  of 
four  quantities — mother’s  and  father’s  education  (often  re- 
ported via  proxy  interview),  the  logarithm  of  family  in- 
come, and  the  status  of  “parental”  occupation’  p.  34).  Devlin 
et  al.  mention  that  several  individuals  now  working  with 
the  data  shared  by  Charles  Murray  and  subsequent  analysis 
may  confirm  or  refute  H&M’s  analysis.  H&M  present  no 
evidence  of  fit  of  the  models  to  the  data,  models  that  show 
weak  predictive  value. 

Devlin  et  al.  conclude  with  the  following: 

(1)  Intelligence  cannot  be  described  solely  by  IQ 
scoics. 
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(2)  Heritability  is  not  properly  modeled  or  interpreted 
in  the  way  it  was  originally  formulated  by  statistical  ge- 
neticists. 

(3)  The  potential  effects  of  intervention  are  underes- 
timated. 

(4)  Statistical  procedures  are  incorrectly  used  and 
inappropriately  interpreted’  (p.  35). 

James  Case  reviewed  TBC  in  an  article  for  the  SIAM 
News  (January,  1995,  pp.  6,  12.)  entitled  “Is  The  Bell  Curve 
statistically  sound?”  Whether  he  meant  to  punish  us  or 
not,  he  commented  that  ’Right  or  wrong,  The  Bell  Curve  is 
hardly  the  compendium  of  neo-Nazi  pseudoscience  some 
make  it  out  to  be.  Despite  the  clarity  of  its  exposition,  the 
book’s  contents  are  only  partially  accessible  to  technically 
unsophisticated  readers,  since  the  claims  made  and  the  evi- 
dence adduced  are  both  statistical  in  nature.’  (p.  6) 

After  coining  the  term  “IQtelligence”  as  “intelligence 
as  measured  by  g,’  he  criticizes  the  use  of  meta-analysis. 
’Resting  as  it  does  on  the  still  controversial  statistical  tech- 
nique known  as  meta-analysis,  the  evidence  with  which  the 
authors  seek  to  establish  the  correlation  between 
IQtelligence  and  adult  status  and  earning  power  demands 
scrutiny’  (p.  6). 

A Black  Perspective 

The  Black  Scholar  Symposium  in  the  Journal  of  Black 
Studies  and  Research  dedicated  its  Winter  1995  issue  (Vol. 
25,  No.  1)  to  a thorough  examination  and  critique  of  The 
Bell  Curve  from  varied  perspectives.  The  journal  assembled 
several  distinguished  scholars  for  what  it  called  The  Black 
Scholar  Symposium.  The  following  is  an  annotated  bibli- 
ography of  the  contributions  therein. 

Scientific  racism:  The  politics  of  tests,  race  and  ge- 
netics by  J.  Blaine  Hudson,  pp.  3-9. 

Hudson  admits  that  African  Americans,  Hispanic 
Americans  and  Native  Americans  have  scored  approxi- 
mately one  standard  deviation  below  whites  on  intelligence 
tests  since  the  beginning  of  their  use.  But  researchers,  like 
M&H,  have  inteipreted  that  these  differences  have  been 
genetically  transmitted,  ignoring  ’the  vast  preponderance 
of  social  science  and  genetic  research  over  several  genera- 
tions [which]  indicates  that  this  conclusion... is  inherently 
illogical  and  baseless,  and  that  differences  in  test  score  pat- 
terns reflect  difference  in  how  racial  groups  are  educated 
and/or  treated. . . . ’ He  then  proceeds  to  show  how  the  argu- 
ment in  TBC  is  wrong  by  considering  tests  and  score  inter- 
pretations, research  design  and  research  bias,  the  logic  of 
test  score  comparisons,  and  concluding  that  ’racial  differ- 
ences in  average  IQ  scores  are  simply  one  measure  of  rac- 
ism and  racial  inequality.’  He  addresses  the  ideology  of 
racism  and  the  genetic  argument  showing  evidence  of  the 
falsity  of  its  two  assumptions:  (1)  ’Races’  exist  and  can  be 
defined  and  clearly  delineated  and  (2)  Different  ’racial’ 
groups  have  radically  different  gene  pools. 

The  E 'll  Curve:  What's  all  the  fuss  about?  by 

Jacquelyne  Johnson  Jackson,  pp.  11-20 

Of  the  many  things  there  arc  to  fuss  about,  Jackson’s 
three  biggest  fusses  are  ’(1)  its  premise  [lower]  of  black- 


to-white  cognitive  ability;  (2)  its  concerns  about  higher 
fertility  rates  among  women  of  lower  measured  cognitive 
ability  or  dysgenesis;  and  (3)  why  it  has  received  far  more 
attention  than  Thomas  Sowell’s  (1 984, 1 989)  opposition  to 
affirmative  action  (p.  11).  She  provides  abundant  research 
to  argue  against  the  above  and  other  distressing  aspects  of 
the  book:  H&M’s  operational  definition  of  blacks  (i.e., 
blacks  who  define  themselves  as  blacks);  their  reliance 
upon  the  classical  tradition  of  studying  intelligence  (i.e., 
that  general  intelligence  is  the  core  of  human  mental  abil- 
ity, and  not  just  a statistically  manipulated  artifact);  the 
belief  that  cognitive  ability  is  a determination  of  socioeco- 
nomic status  and  that  it  is  not  very  malleable,  and  finally 
the  extrapolation  of  their  findings  from  the  National  Lon- 
gitudinal Survey  of  Labor  Market  Experience  of  Youth 
(NLSY)  to  different  black  age-cohorts. 

The  fallacy  of  positivist  reasoning . by  Earl  Lewis, 
pp.  21-24. 

One  of  the  fallacies  is  the  belief  in  one’s  own  con- 
structions. H&M  avoid  ’race’  by  using  the  term  ’ethnic.’ 
The  retreat  from  the  scientific  into  the  casual,  noting  dif- 
ferences in  hair,  color  and  muscle  mass  to  evidence  of  race’s 
genetic  foundation.  So  how  do  H&M  deal  with  millions  of 
years  of  human  contact  and  intermarriage?  By  accepting 
classifications  from  governmental  surveys  and  other  offi- 
cial data  of  what  people  call  themselves.  While  acknowl- 
edging environmental  factors,  H&M  conclude  that  intelli- 
gence is  largely  genetically  determined.  ’The  authors,  be- 
hind the  gloss  of  statistical  verification,  have  simply  proved 
yet  again  that  one’s  coefficients  are  not  better  than  the  data 
one  assembles.  Until  we  can  establish  that  race  is  geneti- 
cally bound,  one  cannot  establish  a clear  link  between  race 
and  what’s  called  intelligence.  To  argue  otherwise  is  to 
fall  prey  to  the  fallacy  of  positivist  reasoning’  (p.  24). 

What ’s  new  in  the  IQ  debate  by  Troy  Duster,  pp.  25-31. 

Central  to  the  debate  concerning  The  Bell  Curve  is 
human  genetics  and  what  it  means,  and  its  potential  for 
shaping  social  policy.  Duster  traces  human  genetics  from 
its  inception  in  the  latterpart  of  the  nineteenth  century  (Karl 
Pearson,  Francis  Galton,  Gregor  Mendel,  Charles  Daven- 
port, Herbert  Spencer,  James  George  Frazier,  et  al).  Eu- 
genics, a term  coined  by  Galton,  is  the  science  of  improv- 
ing the  qualities  of  the  human  race  through  selected  breed- 
ing and  other  elitist  practices  that  oppose  the  democratic 
vision  of  human  possibility.  Duster  draws  two  conclu- 
sions from  the  research  on  the  links  between  genetics,  in- 
telligence and  race:  (1)  Nothing  new  has  happened  in  the 
last  thirty  years  in  genetics  at  the  molecular  level.  (2)  What 
is  new  is  not  the  genetics,  it  is  the  audience  - the  receptive 
climate  since  the  mobilization  against  Jensen  following  his 
1969  article. 

The  Bell  Curve  as  the  mei  Ay  of  the  academic  will 
by  Gerald  Early ; pp  32-38. 

In  this  eloquent  article,  Gerald  Early  notes  that  the 
first  twelve  chapters  of  the  book,  dealing  with  intelligence, 
class  among  and  social  problem  among  whites,  set  up  the 


reader  for  the  thirteenth  chapter,  which  introduces  ethnicity. 
From  there  to  the  end  of  the  book,  TBC  justifies  a selected 
group  ’based  on  a sanctification  of  race  and  justified  through 
the  manifestation  of  something  called  intelligence;  * and  ex- 
plains the  complexity  of  life  through  that  one  characteris- 
tic. ’M&H,  the  good  strict  constructionists  that  they  are, 
wish  to  remind  us  that  the  great  white  fathers  of  our  land 
understood  in  their  wisdom.. .that  there  is  a level  of  immu- 
tability in  human  differences  and  inequalities.’ 

Plus  (7  a change , Plus  (7  a reste  la  memo  chose  by 
Karen  Wanza.  pp.  39-40. 

’The  more  things  change,  the  more  they  stay  the 
same,’  especially  in  psychometrics.  Karen  Wanza  notes 
the  history  of  IQ  and  testing,  from  Binet’s  ideas  of  intelli- 
gence (not  fixed)  and  tests  (for  use  solely  in  schools), 
through  Lewis  Terman’s  work  at  Stanford  to  include  an 
intelligence  quotient  for  adults,  to  Cyril  Burt,  ’who  was 
knighted  for  his  work  as  an  IQ  eugenicist.’  This  book 
comes  in  a reactionary  climate,  in  which  conservatives  will 
apply  M&H’s  proclamation  ’that  public  policy  should  be 
measured  against  cognitive  differences  between  the  races’ 
to  ’dismantle  all  programs  designed  for  social  uplift. 

The  Assault  on  the  human  spirit:  The  Bell  Curve  by 
Randolph  Quay e,  pp  41-43. 

Randolph  Quaye  notes  that  this  book  presents  its  pro- 
ponents with  a pseudo-scientific  justification  of  racism,  sex- 
ism and  classism  and  ’is  nothing  more  than  a revisionistic 
eugenic  idea,  a social  Darwinism  that  comprises  still  an- 
otherpolemic  against  the  dignity  and  worth  of  black  people.  ’ 
He  also  cites  Stephen  J.  Gould’s  Mismeasure  of  Man , in 
which  Gould  recounts  ...[that]  science,  like  all  aspects  of 
culture,  reflects  attitudes  and  prejudices  that  are  present 
within  society.  Throughout  history,  science  (especially 
pseudo-scientific  inquiry)  has  been  used  to  perpetrate  so- 
cial stratification  and  justify  racism  and  sexism’  (p.  41). 

WANTED:  Some  Black  long  distance  runners  - the 
message  of  The  Bell  Curve  by  Warren  C.  Whatley,  pp  44- 
46. 

Warren  Whatley  finds  the  book  to  be  a ’loosely  ar- 
gued set  of  propositions  that  rest  on  weak  empirical  foun- 
dations — propositions  that  are  crafted  for  maximum  shock 
value.  ...  [But]  science  is  not  the  culprit  here.  The  culprit  is  * 
an  attitude — America’s  fascination  with  its  legacy  of  racial 
oppression’  (p.  45).  He  suggests  that  it  is  time  to  ’take  off 
the  gloves’  and  require  reparations  payments  for  ’loss  of 
life,  welfare,  income,  wealth  and  dignity  and  ...  for  the 
murder  of  the  best  and  brightest  among  us’  (p.  46). 

The  Mismeasure  of  man , by  Stephen  Jay  Gould. 

One  of  the  authors  whose  opinions  and  writings  have 
appeared  most  often  in  the  discussions  of  TBC  has  been 
Stephen  Jay  Gould.  Not  only  has  Gould  opined  on  TBC, 
but  his  work  has  been  referenced  and  cited  in  other  cri- 
tiques of  TBC.  And  one  of  his  most  cited  works  is  The 
Mismeasure  of  Man.  (1981).  In  this  book,  Gould  thor- 
oughly discusses  three  aspects  of  the  criticism  of  TBC  that 


have  appeared  and  reappeared  in  the  many  reviews:  1)  The 
reification  of  IQ.  IQ  is  not  a thing  because  we  can  arrive  at 
a number.  2)  The  erroneous  interpretation  of  causality 
based  on  nothing  more  than  the  existence  of  correlation, 
and  sometimes  a small  one  at  that.  3)  The  continual  search 
for  and  ’discovery’  of  theories  and  evidence  to  show  the 
intellectual  superiority  of  the  group  of  which  the  ’scientist’ 
is  a member,  usually  Caucasian  males.  If  the  data  and/or 
theory  don’t  lead  to  the  ’right’  conclusion,  Gould  shows 
that  one  or  the  other  (or  both)  may  need  to  be  changed,  and 
consequently,  are  changed. 

Additional  Readings 

An  excellent  collection  of  readings  on  TBC  can  be 
found  in  The  Bell  Curve  debate:  History , Documents  and 
Opinions.  (1995)  by  Jacoby  and  GlaubermaiL  In  addition 
to  critiques  of  TBC,  you  can  find  in  one  place  many  ar- 
ticles of  historical  interest  dating  back  to  the  early  20th 
century.  This  book  would  be  a very  good  starting  point  for 
a seminar  discussing  the  issues  presented  in  TBC. 

In  conclusion,  I can  think  of  no  more  appropriate,  if 
not  totally  balanced,  stance  on  this  issue  than  the  one 
Stephen  Jay  Gould  took  during  a symposium  sponsored  by 
Howard  University  and  The  Urban  League  on  December 
12,  1994.  Gould  attributes  this  stance  to  Alan  Dershowitz 
from  a private  discussion.  Gould  said: 

We  really  don’t  know  the  causes  of  these  differences. 
We  really  don’t,  and  that’s  the  only  honest  statement  But 
think  of  it  this  way  ...  it  has  to  do  with  Class  I and  Class  II 
errors  in  technical  parlance....  Suppose  Hennstein  & Murray 
are  right;  but  since  we  don’t  know  that,  we  continue  to  try 
our  very  best  to  help  out  even  though  it  can’t  be  totally 
effective.  That’s  one  scenario.  Suppose  however,  that  we ’re 
right,  and  that  these  (class  differences)  are  substantially  re- 
mediable because  the  immutability  assumption  of  ... 
[Hermstein  & Murray]  is  wrong,  but  we  follow  Hennstein 
& Murray’s  recommendations.  You  see  the  differential  re- 
sults are  so  great.  After  all,  if  they’re  right,  but  we  do  our 
program,  what’s  the  result?  So  we  spend  some  money  and 
we’ve  encountered  some  frustration.  But  think  of  the  trag- 
edy involved  if  we’re  right  and  we  followed  their  recom- 
mendations and  then  extinguished  the  human  spirit  in  mil- 
lions of  people  where  it  could  have  been  acknowledged 
and  nurtured.  And  that’s  ultimately  where  it  comes  down 
on  cost-benefit  analysis  or  moral  argument. 
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Letters  to  the  Editor 


Variables  Related  to  Student  Achievement 

I read  with  considerable  interest  the  above  article  by 
Bulachetal.  inthe  Spring  1995  issue  of  \EeMd-Westem Edu- 
cational Researcher  (8,  2,  23-29).  .1  have  both  positive  and 
negative  reactions  to  that  article. 

On  the  positive  side,  the  authors  are  to  be  commended 
for  taking  a direct  approach  to  the  problem  and  using  the  cor- 
rect unit  of  analysis  (the  school).  Most  people  would  use  the 
student  as  the  unit  of  analysis  and  run  into  all  sorts  of  problems 
with  non-independent  observations.  The  authors  are  to  be  fur- 
ther commended  for  providing  the  actual  raw  data  so  that  in- 
terested parties  could  check  their  work,  run  alternative  analy- 
ses, etc. 

That  brings  me  to  the  negative  side.  Some  of  the  statis- 
tics reported  in  the  table  in  Appendix  A and  in  the  text  are 
incorrect.  The  standard  deviation  of  the  achievement  measures 
is  5.46,  not  .46.  You  can  see  that  .46  is  too  small  just  by 
“eyeballing”  the  numbers;  and  the  standard  deviation  can’t  be 
smaller  than  the  range  divided  by  the  square  root  of  twice  the 
number  of  observations,  or  larger  than  half  the  range — see,  for 
example,  K.R.  Hammond  & J.E.  Householder,  Introduction  to 
the  Statistical  Method , 1962,  pp.  130-131.  Also,  the  correla- 
tion between  achievement  and  lunch  is  -.409,  not  +.409.  (Per- 
haps the  authors  defined  SES  as  100  - lunch,  but  they  didn’t 
tell  us  that.) 

Near  the  end  of  the  article  the  authors  say  that  “school 
climate  makes  an  independent  contribution  to  student  achieve- 
ment levels  over  and  above  the  socioeconomic  status  of  stu- 
dents” (p.  27).  In  order  to  claim  that,  they  would  have  to  carry 
out  a hierarchical  regression  analysis,  with  SES  “entered”  first 
and  climate  “entered”  second.  They  did  not  do  so. 

Although  the  authors  used  the  school  as  the  unit  of  analy- 
sis for  the  regressions,  in  the  description  of  the  instrumenta- 
tion it  appears  that  the  individual  was  the  unit  of  analysis  for 
the  determination  of  Cronbach’s  alpha.  That  psychometric  di- 
lemma was  addressed  by  Sirotnik  in  a long  article  in  the  Jour- 
ncd  of  Educational  Measurement  several  years  ago  (1980, 17, 
245-282),  and  the  example  used  throughout  his  article  was  cli- 
mate! 

The  Bulach  et  al.  article  also  contains  a few  typos  (e.g., 
Cruickshank’s  middle  initial  is  R,  not  P),  they  should  have  said 
“significance”  rather  than  “confidence”  on  p.  26,  and  deleted 
the  word  “significant”  from  the  hypotheses;  but  these  things 
happen! 

Thomas  R.  Knapp,  The  Ohio  State  University 


Free  and  Reduced  Lunch  is  Negatively  Correlated 
with  Student  Achievement 

I am  very  appreciative  of  Knapp’s  comments.  He  is  ab- 
solutely correct  about  the  negative  correlation  between  the 
socio-economic  status  of  students  and  achievement.  The  ar- 
ticle stated  that  higher  socio-economic  status  was  related  to 
higher  achievement,  when  in  fact  higher  socio-economic  sta- 
tus was  reported  as  a lower  free  and  reduced  lunch  count.  This 
means  that  there  would  be  a negative  correlation  between  free 
and  reduced  lunch  and  achievement,  i.e.,  if  one  was  high  the 
other  would  tend  to  be  low.  This  was  true  in  our  research.  The 
statistic  was  presented  with  a positive  sign  instead  of  a nega- 
tive. The  sign  was  wrong,  but  the  conclusions  reached  were 
valid. 

His  appreciation  for  including  raw  data  might  be  worth 
considering  in  future  articles.  I have  received  other  feedback 
commenting  on  the  merit  of  including  raw  data  with  a research 
article.  In  addition  to  allowing  greater  insight  into  what  was 
done  statistically,  it  also  is  a great  teaching  tool  with  graduate 
students. 

Clete  Bulach,  West  Georgia  College 


APA  Db>.  IS  Announces  Conference  on 
Teaching  Educational  Psychology 


Authors,  editors,  and  leaders  in  educa- 
tional psychology  will  be  participating  in  an 
intimate  conference  concerning  the  teaching 
of  educational  psychology  (reservations  lim- 
ited to  75).  The  conference  is  June  8-11  at 
one  of  Scottsdale,  Arizona's  best  regarded  re- 
sorts. To  reserve  a place  send  $50  registration 
fee  or  to  receive  further  information  about  the 
conference  and  facilities  write  to:  Ms.  Kari 
Knutson,  Psychology  in  Education,  College  of 
Education,  Arizona  State  University,  Tempc, 
A Z 85207-0611 
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Estimating  the  Reliability  of  Criterion-Referenced  Tests 

Before  Administration 

Clint  Chase,  Indiana  University 


Abstract 


The  classical  procedures  for  calculating  the  two  indexes  of  decision  consistency  (P  and  Kappa) 
for  criterion - referenced  tests  require  two  testings  on  each  child.  Huynh  and  Peng  & Subkoviak  have 
presented  one-testing  procedures  for  these  indexes . This  article  shows  how  these  indices  can  be  esti- 
mated without  any  test  administration  using  Ebel ’s  estimates  of  the  mean,  standard  deviation  and  KR,r 


Two  reliability1  indices  have  been  recommended  for 
criterion-referenced  tests,  P and  Kappa  (Berk,  R.A.,  1980). 
P is  the  proportion  of  persons  consistently  classified  as  mas- 
ters versus  non-masters.  Kappa,  widely  known  as  Cohen’s 
Kappa,  is  a similar  index  of  decision  consisency.  The  stan- 
dard computational  procedures  for  each  of  these  indices 
call  for  two  administrations  of  a test.  This  requires  a consid- 
erable time  and  expense  commitment  before  educators  can 
decide  if  the  test  is  reliable  enough  to  use  in  decision-mak- 
ing. In  most  school-based  testing  applications  the  two-test- 
ing  procedure  is  impractical. 

There  are,  however,  alternatives  to  the  two-testing 
procedure,  each  of  which  can  be  done  with  just  one  test  ad- 
ministration. One  method  was  suggested  by  Huynh  ( 1 976), 
the  second  by  Subkoviak  (1976),  and  followed  up  by  Peng 
& Subkoviak  (1980). 

The  steps  in  Huynh’s  estimation  procedure  are  as  fol- 
lows: 

First,  compute  the  mean  (m),  standard  deviation  (s), 
and  the  KR2l  coefficient  (a,()  for  the  observed  scores.  Note 
that  Huynh  uses  the  KR^  coefficient  in  this  procedure.  This 
is  the  appropriate  coefficient  of  reliability  to  use  with  the 
beta-binomial  model  of  test  scores  (Keats  & Lord,  1962,  p. 
60-61);  although  other  reliability  coefficients  may  be  sub- 
stituted with  apparently  negligible  effects  on  results. 

Second,  solve  the  following  four  equations: 

1.  /i'  = sin  1 ffT/n 

2.  a'  = [(a21  +l)/(a21  +n)],/2 

3.  a'u  =Kn-l)/(n  + g,<))l/2 

4.  c'  = sin  "1  T(c  - 0.5)/  n 


When  these  figures  are  available,  compute: 

z'  = (c'-ju')/cr' 

Then  using  a table  of  the  normal  distribution,  obtain 
the  probability,  p’o,  that  a standardized  normal  variate  is  less 
than  . 

Following  this,  using  the  table  of  the  bivariate  normal 
distribution,  find  the  probability,  p’oo>  that  two  standardized 
normal  variates  with  correlation  a‘2)  are  less  than  z’.  [Huynh 
( 1 976),  has  made  a simple  table  of  the  bivariate  normal  dis- 
tribution that  may  be  accurate  enough  for  most  work,  but 
Gupta’s  table  ( 1 963)  is  more  detailed.] 

And  finally,  substitute  the  quantities  obtained  in  the 
last  two  steps  into  the  following  formulae: 

p'  = i+2(p^-p;) 
k'  = (p^-p;2)/(p;-p;2) 

(Actually,  Huynh  only  solved  for  Kappa,  but  P can 
also  be  easily  obtained  as  shown  above.) 

The  second  one-test  system  was  proposed  by  Peng  & 
Subkoviak  ( 1 980).  The  steps  outlined  below  are  essentially 
the  same  as  in  the  Huynh  procedure,  except  that  Huynh's 
second  step  is  omitted: 

First,  as  with  Huynh,  compute  the  mean,  standard  de- 
viation and  KR2I  for  a set  of  test  scores. 

Next  compute  directly: 

z"  = (c-0.5-jU)/a 


Note  that  Huynh's  four  cquatons  are  skipped,  and  that  0.5  is 
( Where  n refers  to  number  of  items,  and  c is  the  test's  critc-  ^1C  standard  correction  for  continuity, 
rion  for  passing.) 


j Tin'  term.  Reliability  , ts  used  hen*  because  (he  cited  writers  have  used  it  However,  in  criterion- refe rcnccd  tests  the  extent  to  which  two  assessments 
will  place  a student  in  the  same  category  is  often  referred  to  as  the  Index  of  location  ( 'umiJ/t’fln . 


Third,  from  a table  of  the  normal  distribution,  get  the 
probability  p”o  that  a standardized  normal  variate  is  less  than 
z”. 


Fourth,  using  a table  of  the  bivariate  normal  distribu- 
tion, obtain  the  probability,  p”^ , that  two  standardized  nor- 
mal variates  with  correlation  a2|  are  less  than  z’\  Then  cal- 
culate: 


P"  = l + 2(p"  -p") 

x"=(p^-p:;2)/(p;'-p"2) 


The  Problem 

Both  the  Huynh  and  the  Peng  Sc  Subkoviak  methods 
require  that  the  user  have  the  mean,  standard  deviation  and 
the  test  reliability  on  hand.  But  suppose  a test  developer  is 
in  the  early  stages  of  putting  a test  together.  No  data  have 
been  collected  at  this  point.  However,  the  developer  wishes 
to  estimate  the  coefficient  of  decision  consistency  (P  or 
Kappa)  prior  to  the  initial  field  application  of  the  test. 

The  problem  addressed  in  this  study  is  to  devise  a pro- 
cedure for  estimating  criterion-referenced  “reliability”  be- 
fore the  test  is  administered  even  once.  The  test  statistics 
(mean,  standard  deviation,  and  reliability)  are  estimated 
rather  than  actual. 

Procedure 

Of  the  two  procedures  described  above,  the  Peng  & 
Subkoviak  method  is  used  here  because  it  has  the  virtue  of 
being  simpler  and  it  yields  results  very  close  to  those  of 
Huynh.  The  intent  is  to  demonstrate  how  well  estimated 
(versus  actual)  test  statistics  perform  in  approximating  the 
criterion-referenced  reliability  indexes  (P  and  Kappa),  and 
not  to  compare  the  Huynh  and  Peng  Sc  Subkoviak  methods. 

Like  Huynh's  method,  the  Peng  & Subkoviak  proce- 
dure requires  that  the  actual  test  statistics  (mean,  standard 
deviation  and  KR,,  coefficient)  be  available  on  a set  of  test 
scores  before  an  estimate  can  be  made  of  P or  Kappa.  Nor- 
mally, the  test  would  be  administered  to  get  these  (actual) 
test  statistics.  It  is  however  possible  to  estimate  these  statis- 
tics before  the  administration  of  the  test . 

Ebel  (1969)  showed  that,  given  some  reasonable  as- 
sumptions about  the  mean  and  standard  deviation  of  a set  of 
scores  for  a well-constructed  test,  fairly  close  estimates  of 
the  test  statistics  can  be  obtained  as  follows: 


M = /)  = 

S = (T  = 


(k  + 1) 

n 

(2k) 

(k-1) 

n 

(6k) 


where  tt  is  the  number  of  items  in  the  test,  and  k is  the  num- 
ber of  choices  per  item. 


These  estimates  can  then  be  applied  to  calculate  an 
estimate  of  the  KR^,  reliability  coefficient: 


M(l  - — ) 


A = a„  = 


n-1 


[i H1-] 


With  estimated  mean,  standard  deviation  and  KR,t  co- 
efficient in  hand,  one  can  insert  these  values  into  Peng  Sc 
Subkoviak’s  procedure  and  estimate  P and  Kappa  without 
having  to  administer  the  test  at  all. 

To  demonstrate  this  procedure,  data  from  three  crite- 
rion-referenced tests  were  located,  and  the  actual  mean,  stan- 
dard deviation  and  KR^  coefficient  were  calculated.  These 
statistics  were  applied  to  Peng  Sc  Subkoviak’s  system  for 
determining  the  one-administration  “reliability  indexes”. 
Then,  the  Ebel  estimates  of  the  mem,  standard  deviation 
and  KR2l  coefficient  were  calculated  anJ  these  estimates  were 
used  to  again  calculate  the  same  “reliability  indexes”.  Last, 
a comparison  was  made  between  the  P and  Kappa  indexes 
based  on  the  estimated  data  and  the  P and  Kappa  based  on 
the  actual  test  data.  In  the  actual  test  administration  there 
were  1 1 2 cases  in  the  first  group,  98  in  the  second,  and  56  in 
the  third.  Each  test  was  made  up  of  multiple-choice  items. 


Results 

The  results  of  the  above  procedures  are  reported  in 
Table  1 . Here  the  Ebel  estimates  of  the  test  mean  (ME),  stan- 
dard deviation  (sE)  and  KR2I  (AE)  are  given,  along  with  the 
actual  values  obtained  from  the  test  administration.  For  con- 
venience, the  symbols  for  actual  test  mean  (MA),  standard 
deviation  (sA),  and  KR2I  (AJ  are  kept  consistent.  The  P and 
Kappa  values  were  calculated  based  first  on  the  estimated 
descriptive  data,  then  on  the  actual  descriptive  data.  The  re- 
sults of  the  estimated  procedure  (without  any  test  adminis- 
tration) appear  to  be  quite  close  to  those  based  on  the  one- 
testing  method  suggested  by  Peng  & Subkoviak.  On  the  ba- 
sis of  this  modest  trial,  it  appears  that  persons  who  wish  to 
estimate  the  “reliability”  of  their  criterion-referenced  test 
before  administering  it  may  do  so  with  reasonable  faith. 

Discussion 

A single  test  administration  procedure  has  the  advan- 
tage of  practicality  for  estimating  coefficients  of  decision 
consistency  for  criterion-  referenced  tests.  Huynh's  one-test- 
ing procedure  has  proved  to  have  little  error  (Huynh  & 
Saunders,  1 980);  however,  it  involves  considerable  calcula- 
tion. The  procedure  presented  by  Peng  & Subkoviak  ( 1 980 ) 
is  simpler  to  calculate  and  has  also  produced  acceptable  re- 
sults. Both  procedures  require  the  mean,  standard  deviation 
and  KR2|  coefficient  for  the  scores  on  the  test  based  on  a 
single  test  administration.  Thus  these  existing  methods  re- 
quire that  the  test  be  actually  administered  to  o’  viin  the  de- 
sired “reliability”  estimates.  However,  if  one  wishes  to  esti- 
mate the  “reliability”  of  a criterion-referenced  test  while  it  is 
still  in  the  production  stage:  its  mean,  standard  deviation  and 


Table  1. 

Statistics  for  Actual  and  Estimated  data  with  P and  Kappa  values 


Test 

Mn 

Ma 

SE 

SA 

Ae 

Aa 

n 

c 

k 

PE 

pA 

1. 

28.1 

26.4 

5.6 

7.2 

.68 

.81 

45 

30 

4 

.76 

.80 

.49 

.56 

2. 

112.5 

90.3 

22.5 

7.9 

.92 

.87 

180 

4 

.88 

.82 

.65 

.62 

3. 

16.7 

14.7 

2.8 

3.2 

,29 

.43 

25 

14 

3 

.82 

.84 

.17 

.19 

Note:  n = number  of  items  in  a lest,  c - criterion  score,  k = number  of  options  per  item  in  the  test. 
Subscripts  E and  A indicate  statistics  based  on  estimated  and  actual  data  respectively. 

M.  s.  and  A represent  test  mean,  standard  deviation,  and  KR^. 


KR2l  can  be  approximated  using  Ebefs  (1969)  method. 
These  approximations  can  then  be  substituted  into  the  Peng 
& Subkoviak  procedure,  and  an  estimate  made  of  the  “reli- 
ability” indexes  (P  and  Kappa)  for  the  criterion-referenced 
test. 

Does  this  method  work?  The  modest  demonstration 
presented  here  suggests  that  it  has  some  promise.  However, 
a much  more  extensive  assessment  of  the  procedure  is  nec- 
essary before  a conclusion  can  be  drawn  as  to  when  the  pre- 
administration method  is  likely  to  produce  acceptable  re- 
sults and  when  it  may  not. 

In  looking  over  the  results  of  this  trial,  one  must  won- 
der what  factors  affect  the  differences  between  the  actual 
and  estimated  mean,  standard  deviation,  and  KR2|  coeffi- 
cients. One  likely  factor  is  the  difficulty  of  the  items  in  the 
test.  A very  easy  test  would  cause  the  scores  to  bunch  up 
near  the  top  of  the  distribution,  whereas  a very  hard  test  would 
cause  a bunching  of  scores  in  the  lower  range.  Ebefs  pro- 
cedure will  typically  place  the  mean  not  far  from  the  center 
of  that  score  range  which  is  above  chance  level.  This  skew- 
ing will  cause  the  Ebel  estimates  to  miss  the  actual  mean, 
standard  deviation  and  KR:i  coefficient  by  varying  amounts. 
How  much  skewness  will  be  needed  to  seriously  distort  the 
estimated  reliability  indexes  is  not  known  at  this  time. 

However,  it  appears  reasonable  to  assume  that  one 
should  be  wary  of  skewness  when  using  Ebefs  estimates. 
For  assurance  that  the  estimated  statistics  will  approach  ac- 
tual values,  the  test  items  must  be  of  moderate  difficulty  so 
that  the  bunching  of  scores  will  be  near  the  center  of  the 
distribution. 

How  much  discrepancy  between  the  actual  and  esti- 
mated statistics  is  needed  to  make  an  important  difference 
in  the  reliability  indices?  In  the  current  data,  the  actual  and 
estimated  means  in  Tests  1 and  l were  fairly  close,  but  were 
more  discrepant  in  Test  2.  In  spite  of  this,  the  P and  Kappa 
values  based  on  the  estimated  data  were  no*  markedly  dif- 
ferent from  those  based  on  the  actual  data  for  the  three  sets 
of  test  sccras.  Further  work  is  needed  here  to  determine 
when  the  Ou/erence  between  the  actual  and  estimated  data 
has  an  important  impact. 


One  last  point  is  in  order.  In  the  final  analysis  of  any 
test,  the  quality  of  the  items  is  a major  factor  in  determining 
the  reliability  of  scores.  Poorly  written  items  cause  even 
good  students  to  utilize  random  guessing  to  solve  such  prob- 
lems. Random  guessing  should  negatively  impact  the  reli- 
ability of  the  data  and  affect  both  actual  and  estimated  reli- 
ability of  scores. 
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Motivation  in  Education: 

Current  Emphases  and  Future  Trends 

Dale  H.  Schunk,  Purdue  University 

Abstract 

This  article  discusses  motivational  processes  as  they  apply  to  educational  contexts.  Motivation  is  de- 
fined and  compared  to  other  constructs . A brief  historical  account  of  motivation  theory  and  research  is 
provided , to  include  important  trends  and  areas  in  motivation  research.  The  article  concludes  by  sug- 
gesting four  areas  that  future  research  might  address:  constructivism  and  learning,  long-term  motiva- 
tion, teacher  retention,  motivation  in  the  community. 


Motivation  has  assumed  a highly  prominent  position 
in  education  as  theories  have  moved  from  behavioristic  ac- 
counts to  those  incorporating  cognitive  and  affective  con- 
cepts. This  shift  in  emphasis  has  expanded  the  focus  of 
motivation  research,  which  increasingly  shows  that  motiva- 
tion is  central  to  teaching  and  learning  (Pintrich  & Schunk, 
1996).  Motivated  students  display  interest  in  activities,  feel 
self-efficacious,  expend  effort  to  succeed,  persist  <?t  tasks, 
and  use  effective  learning  strategies.  Motivated  teachers 
believe  they  can  help  students  learn,  spend  extra  time  on 
planning,  and  work  with  students  to  ensure  they  master  con- 
ten,.  When  motivation  declines  other  outcomes  suffer. 
Teachers  must  not  only  impart  knowledge  and  skills  but  also 
establish  a motivating  environment  for  learning. 

Despite  this  breakthrough  there  exists  much  confusion 
about  such  issues  as  the  nature  of  motivation,  what  variables 
affect  motivation,  and  how  motivation  influences  learning 
and  performance.  The  field  is  at  a critical  point  that  requires 
clear  understanding  of  motivational  processes  and  a vision 
for  the  future  of  motivation  in  education. 

Motivation  Defined 

There  are  many  definitions  of  motivation.  From  a 
cognitive  perspective,  motivation  can  be  defined  in  the  fol- 
lowing way  (Pintrich  & Schunk,  1996):  Motivation  is  the 
process  whereby  goal-directed  activity  is  instigated  and  sus- 
tained. It  is  clear  that  motivation  has  some  overlap  with 
other  psychological  constructs. 

To  illustrate,  learning  involves  an  enduring  change  in 
behavior  or  in  the  capacity  to  behave  in  a given  fashion  re- 
sulting from  practice  or  other  forms  of  experience.  Motiva- 
tion and  learning  are  related  but  not  synonymous. 

Another  similar  construct  is  self-regulation , or  the  pro- 
cess whereby  one  activates  and  sustains  behaviors,  cogni- 
tions, and  affects,  which  are  systematically  oriented  toward 
the  attainment  of  goals.  Self-regulation  differs  from  motiva- 
tion in  that  self-regulation  involves  some  degree  of  learner 
choice  of  outcomes,  methods,  settings,  social  and  environ- 


mental resources  (Zimmerman,  1994).  Choice  need  not  be 
a central  feature  of  motivation,  since  people  can  be  moti- 
vated to  perform  well  even  when  they  have  no  choice  of 
activities. 

Volition  is  often  compared  with  motivation.  William 
James  (1890)  viewed  volition  as  the  act  of  using  the  will. 
More  recently,  volition  has  been  conceptualized  as  part  of  a 
larger  self-regulatory  system  that  includes  motivation  and 
other  cognitive  processes  (Como,  1993).  Volition  presum- 
ably mediates  the  relation  between  goals  and  actions  to  ac- 
complish them  (Heckhausen,  1991;  Kuhl,  1984).  Whereas 
motivation  is  the  force  behind  establishing  goals,  volition  is 
responsible  for  attaining  them;  for  example,  by  keeping  per- 
sons focused  on  the  task  and  perseverant.  Although  not  all 
investigators  accept  this  division  of  functions  but  rather  ap- 
ply the  term  “motivation”  to  goal  setting  and  goal-directed 
activities  (Schunk,  1991),  most  researchers  do  not  view  mo- 
tivation and  volition  as  svnonymous  (Pintrich  Sc  Schunk, 
1996). 

Interest  (or  intrinsic  motivation)  refers  to  engaging  in 
a task  for  its  own  sake;  that  is,  for  no  obvious  reward  except 
for  the  activity  itself  (Pintrich  & Schunk,  1996).  Interest  is 
a form  of  motivation  but  almost  certainly  includes  such  other 
processes  as  attention  and  metacognition  (performance  moni- 
toring). Further,  motivation  is  not  confined  to  inherently 
interesting  activities.  Extrinsic  motivation  refers  to  the  pro- 
cess of  engaging  in  a task  as  a means  to  an  end. 

Historical  Overview 

At  the  start  of  the  twentieth  century,  motivation  was 
not  a separate  topic  of  study  as  it  is  today  (Weiner,  1990). 
Rather,  it  was  addressed  in  the  realm  of  psychology— itself 
a new  field  of  study.  Wilhelm  Wundt,  who  studied  volition 
through  the  method  of  introspection , helped  to  establish  psy- 
chology as  a science  independent  of  philosophy  with  the  first 
ps>chological  laboratory  in  Germany  in  1879.  Some  early 
writers  on  motivation  were  Ach,  Freud.  James,  and 
McDougall  (Heckhausen,  1991;  Ueidbreder.  1933;  Pintrich 
& Schunk,  1996;  Weiner,  1992). 
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The  rise  of  behaviorism  in  psychology  helped  to  es- 
tablish the  scientific  method  as  the  framework  for  experi- 
mentation. Watson  ( 1 924)  contended  that  if  psychology  was 
to  become  an  objective  and  experimental  science  it  had  to 
concern  itself  with  observable  and  scientific  phenomena  as 
the  physical  sciences  did.  Behavior  was  observable,  whereas 
introspection,  which  dealt  with  subjective  states  that  may 
have  no  basis  in  reality  (e.g.,  perceptions),  was  not  observ- 
able and  thus  not  scientific. 

Cognitive  Explanations  of  Motivation 

Prominent  behavioral  theories  were  formulated  by 
Thorndike,  Hull,  Spence,  Pavlov,  Watson,  Guthrie,  and  Skin- 
ner. In  Skinner’s  (1953)  operant  conditioning  theory,  for 
example,  a stimulus  sets  the  occasion  for  the  occurrence  of  a 
response,  which  is  followed  by  a consequence.  The  prob- 
ability of  behavior  occurring  in  the  future  is  a function  of 
the  consequences  of  prior  behavior.  Reinforcing  conse- 
quences strengthen  behavior  and  make  it  more  likely  to  oc- 
cur; punishing  consequences  weaken  behavior  and  lower  its 
likelihood  of  future  occurrence.  Operant  conditioning  de- 
fines motivation  (motivated  behavior)  as  an  increased  level 
of  responding  or  continued  high  level  of  responding  brought 
about  by  effective  reinforcement  contingencies  (Skinner, 
1968). 

The  history  of  motivation  research  reveals  a shift  from 
explanations  in  behavioral  terms  to  the  use  of  cognitive 
mechanisms.  In  contrast  to  behavioral  views,  cognitive  theo- 
ries stress  mental  structures  and  the  processing  of  informa- 
tion and  beliefs.  Cognitive  theories  became  more  prevalent 
in  psychology  as  behavioral  explanations  were  found  to  be 
wanting  for  much  behavior  and  especially  for  complex  phe- 
nomena (e.g.,  problem  solving).  The  dominant  contempo- 
rary learning  and  motivation  theories  are  cognitive.  Although 
cognitive  theorists  disagree  about  which  internal  factors  are 
important  (e.g.,  attributions,  perceived  competence,  values, 
goals,  social  comparisons,  affects),  they  all  view  motivation 
as  a process  and  do  not  equate  it  with  observable  behavior 
(Pintrich  & Schunk,  1996). 

Field  Studies 

Laboratory  studies  arc  conducted  in  controlled  settings; 
field  studies  are  conducted  where  participants  live,  work, 
and  go  to  school.  Early  motivation  research  was  conducted 
in  psychological  laboratories.  Laboratories  have  the  advan- 
tage of  controlling  extraneous  factors  that  can  influence  re- 
search results,  such  as  people  talking,  windows  to  look  out 
of.  phones  ringing,  and  hallway  noise. 

Despite  these  advantages,  researchers  increasingly  are 
conducting  studies  in  field  settings  to  maximize 
generalizability  of  results  to  other  similar  settings.  In  con- 
trast, generalization  of  laboratory  results  to  the  field  is  done 
with  less  confidence  Field  studies  can  capture  the  com- 
plexity of  factors  that  affect  motivation  and  thus  are  able  to 
pro\  ide  a clearer  picture  of  its  operation. 


Researchers  increasingly  are  using  human  participants 
in  research.  Much  older  psychological  research  used  infrahu- 
man species  such  as  dogs,  cats,  and  rats.  Behavioral  psy- 
chologists felt  that  behavior  could  be  explained  by  referring 
to  environmental  conditions  and  that  these  factors  operated 
across  species.  Since  greater  experimental  control  can  be 
exercised  over  animals,  they  are  preferable  to  humans  as 
research  subjects. 

It  is  true  that  many  processes  operate  across  animals 
and  humans;  for  example,  both  respond  to  the  effects  of  re- 
wards and  punishments.  A major  difference,  however,  is 
that  a wider  variety  of  processes  can  be  studied  in  people 
because  they  are  capable  of  complex  thought.  Such  pro- 
cesses as  expectations,  values,  and  goals,  are  important  cog- 
nitive motivators  (Pintrich  & Schunk,  1996).  In  addition, 
humans  allow  for  the  study  of  motivation  using  complex 
tasks  and  situations. 

Focus  on  Process 

The  focus  of  behaviorism  w;as  on  behavior.  Motiva- 
tion was  defined  in  terms  of  changes  in  the  intensity,  fre- 
quency, form,  or  persistence  of  behavior.  Products  (out- 
comes) were  the  chief  variables  of  study  and  were  affected 
by  environmental  conditions  and  prior  reinforcements  in  the 
individual’s  life. 

With  the  shift  to  cognitive  psychology  came  a 
reconceptualization  of  motivation  as  a process  internal  to 
the  individual  that  was  influenced  by  personal  and  environ- 
mental factors.  To  study  process  required  new  w'ays  of  as- 
sessment. Researchers  had  to  devise  instruments  to  assess 
such  internal  variables  as  goals,  attitudes,  expectations,  and 
values.  There  are  potential  problems  with  such  assessments; 
measuring  expectations,  for  example,  requires  asking  per- 
sons to  make  judgments  about  mental  states,  which  may  not 
always  be  clear.  There  also  is  the  possibility  that  people  will 
deliberately  distort  self-reports  to  make  themselves  appear 
more  desirable.  Although  self-reports  have  problems,  avail- 
able evidence  shows  they  are  valid  and  reliable  indicators  of 
mental  processes,  at  least  beginning  in  children  by  age  9 
(Assor  & Connell,  1992). 

Educationally  Relevant  Content 

Early  motivation  research  often  was  conducted  in  non- 
educational  settings  and  used  tasks  that  had  little  relevance 
to  school  learning.  Despite  much  of  it  being  high  quality,  its 
low  educational  relevance  precluded  generalization  of  re- 
sults to  human  learning  and  performance  settings.  Many 
studies  used  tasks  that  did  not  involve  learning  but  rather 
performance  of  previously-learned  actions  (e.g.,  ring-toss 
games).  While  motivation  is  important  for  performance,  it 
also  can  influence  learning  (Schunk.  1991).  Researchers 
increasingly  are  conducting  studies  in  schools  using  academic 
content  (eg.,  mathematics,  writing,  reading)  (Schunk  & 
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Hanson,  1985;  Schunk  & Rice,  1993;  Schunk  & Swartz, 
1993). 

A related  trend  is  to  study  motivation  over  time  with 
longitudinal  studies . Much  academic  learning  takes  time  as 
skills  develop  slowly.  Longitudinal  studies  determine  how 
motivational  processes  change  and  which  influences  are  more 
important  at  various  stages  of  learning.  Research  shows,  for 
example,  that  feedback  linking  success  with  effort  is  impor- 
tant in  the  early  stages  of  learning  but  that  feedback  stress- 
ing high  ability  has  greater  motivational  effects  as  skills  be- 
come established  (Schunk,  1983). 

Group  Motivation 

Motivation  research  traditionally  has  studied  behav- 
iors of  individuals.  Researchers  aggregate  data  across  per- 
sons to  arrive  at  conclusions.  In  contrast,  less  research  has 
studied  motivation  in  groups.  The  group  literature  within 
social  psychology  (Asch,  1955;  Deutsch.  1949)  primarily  is 
oriented  toward  group  dynamics  and  interaction  patterns 
rather  than  motivational  processes. 

Although  studies  of  individuals  continue  to  be  preva- 
lent, research  increasingly  is  focusing  on  groups.  Research- 
ers have  begun  to  determine  whether  individual  and  group 
processes  operate  in  similar  fashion  and  how  they  relate  to 
one  another.  For  example,  research  on  cooperative  and  com- 
petitive groups  shows  that  group  outcomes  affect  individu- 
als’ perceptions  of  their  capabilities  and  that  these,  in  turn, 
relate  to  subsequent  group  motivation  (Slavin,  1995). 

Context  Specificity 

The  field  of  motivation  has  moved  from  an  emphasis 
on  broad,  global  theories,  which  explained  behaviors  across 
diverse  situations,  to  theories  that  are  more  context  specific. 
As  research  showed  that  behavior  was  complex  and  capable 
of  being  influenced  by  multiple  factors,  theorists  turned  then 
attention  to  explaining  motivation  in  specific  situations.  With 
respect  to  the  construct  of  achievement  motivation,  for  ex- 
ample, research  shows  that  a general  achievement  motive  is 
not  strongly  linked  with  achievement  behaviors  in  different 
situations  (Weiner,  1992).  In  contrast,  motivation  for  learn- 
ing and  performing  well  in  a general  domain  (e.g..  math- 
ematics) is  context  specific  and  more  predictive  of  actual 
behavior  (Bandura,  1986). 

This  is  not  to  suggest  that  there  are  no  behavioral  gen- 
eralities. As  Bruner  (1985)  said: 

You  do  not  quite  need  a different  model  of  a learner 
to  talk  about  learning  how  to  play  chess,  learning 
how  to  play  the  flute,  learning  mathematics,  and 
learning  to  read  the  sprung  rhymes  in  the  verse  of 
Gerard  Manlev  Hopkins  ...  All  of  them  will  in- 
volve attention  and  memory  and  courage  and  . . . 
maintaining  frustration  tolerance.  The  issue  . is 
that  learning  is  indeed  context  sensitive,  but  that 
human  beings,  given  their  peculiarly  human  com- 


petence, are  capable  of  adapting  their  approach  to 
the  demands  of  different  contexts,  (pp.  5-6) 

Although  we  have  moved  toward  greater  context  speci- 
ficity, we  know  that  such  processes  as  goal  setting,  positive 
expectations,  and  valuing  learning,  operate  across  domains 
to  impact  motivation.  Researchers  today  attempt  to  specify 
how  such  general  processes  are  affected  by  situational  con- 
ditions. 

Constructed  Meanings 

Behaviorism  dismissed  cognitions  from  explanations 
of  behavior.  The  meanings  of  situations  and  events  were 
viewed  as  less  important  than  the  reinforcement  contingen- 
cies that  accompanied  those  situations  and  events.  Cogni- 
tive perspectives  on  motivation  are  more  phenomenological 
because  they  postulate  that  people  act  based  on  their  percep- 
tions (Pintrich  & Schunk,  1 996). 

Constructivism , which  represents  an  important  new 
perspective  in  education  and  psychology,  contends  that  be- 
havior occurs  in  contexts  and  that  people  form  or  construct 
much  of  what  they  learn  and  understand  as  a function  of 
their  experiences  in  situations  (Geary,  199  ).  As  discussed 
later,  the  impact  of  constructivism  on  motivation  is  likely  to 
increase. 

Current  Areas  of  Research  Emphasis 

Goals  and  Goal  Orientations 

Goal  theory  postulates  that  important  relations  exist 
between  goals,  expectations,  attributions  (perceived  causes 
of  outcomes),  conceptions  of  ability  and  motivational  orien- 
tations, social  and  self  comparisons,  and  achievement  be- 
haviors (Ames,  1992a,  1992b;  Blumenfeld,  1992;  Weiner, 
1990). 

A central  construct  in  goal  theory  is  goal  (motivational) 
orientation , or  the  purpose  and  focus  of  one’s  engagement 
in  achievement  activities.  One  distinction  is  between  learn- 
ing and  performance  goals.  A learning  goal  refers  to  what 
knowledge,  behavior,  skill,  or  strategy,  students  are  to  ac- 
quire; a performance  goal  denotes  what  task  students  are  to 
complete.  Other  types  of  goals  mentioned  in  the  literature 
that  are  conceptually  similar  to  learning  (performance)  goals 
include  mastery , task-involved , and  task-focused  {ego-in- 
volved, ability'-focused)  (Ames  & Archer,  1 988;  Butler,  1 992; 
Meece,  1991 ; Nicholls,  1984). 

The  importance  of  these  goals  for  motivation  stems 
from  the  effects  they  can  have  on  cognition  and  action. 
Learning  goals  presumably  focus  students*  attention  on  pro- 
cesses and  strategies  that  help  them  improve  their  skills 
(Ames,  1 992a).  Students  who  pursue  a learning  goal  arc  apt 
to  experience  a sense  of  self-efficacy  ocrccivcd  capability) 
for  attaining  it  and  be  motivated  to  engage  in  task-appropri- 
ate activities  (e.g.,  persist,  expend  effort)  (Bandura.  |98(v 
Schunk,  1991). 
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In  contrast,  performance  goals  are  hypothesized  to 
focus  students’  attention  on  completing  tasks.  Such  goals 
may  not  highlight  the  importance  of  processes  and  strate- 
gies underlying  task  success  or  raise  efficacy  for  acquiring 
skills.  Students  may  not  compare  their  present  and  past  per- 
formances to  determine  progress;  rather,  they  may  socially 
compare  their  work  with  that  of  others.  Social  comparisons 
result  in  low  perceptions  of  ability  and  low  motivation  among 
students  who  experience  difficulties  (Schunk,  1989). 

Meece,  Blumenfeld,  and  Hoyle  (1988)  assessed 
children’s  goal  orientations,  perceived  competence,  intrin- 
sic motivation,  and  cognitive  engagement,  during  science 
lessons.  Orientations  assessed  were  task  mastery  (goal  is  to 
understand  material  and  learn  as  much  as  possible),  ego/so- 
cial (goal  is  to  please  others),  and  work  avoidant  (goal  is  to 
minimize  effort  and  do  as  little  as  possible).  Active  cogni- 
tive engagement  referred  to  activities  involved  in  self-regu- 
lation (e.g.,  review  material  not  understood,  relate  current  to 
prior  material);  superficial  engagement  activities  were  de- 
signed to  complete  work  with  minimal  effort  (copy  answers, 
skip  hard  material).  Students  who  held  task-mastery  goals 
reported  more  active  cognitive  engagement  characterized  by 
self-regulatory  activities.  Children  reporting  greater  intrin- 
sic motivation  to  learn  placed  greater  emphasis  on  goals 
stressing  learning  and  understanding. 

S octal/ C on  textual  Infl  uences 

A related  motivation  research  area  explores  the  roles 
of  social  and  other  contextual  factors.  According  to  social 
cognitive  theory  (Bandura,  1986,  1991),  motivation  is  a func- 
tion of  personal  cognitions  (expectations,  goals)  and  self- 
evaluative  processes.  As  people  work  toward  goals,  they 
evaluate  their  progress.  The  perception  of  progress  enhances 
self-efficacy  and  sustains  motivation.  A perceived  negative 
discrepancy  between  one's  goal  and  present  performance 
creates  an  inducement  for  change. 

Social  and  contextual  factors  affect  motivation  through 
their  influence  on  expectations,  goals,  and  self-evaluations 
of  progress  (Schunk,  1989).  Important  factors  include  so- 
cial comparisons,  goals,  rewards,  models,  classroom  struc- 
tures, and  forms  of  feedback.  Perceived  similarity  to  mod- 
els in  important  attributes  can  raise  observers’  self-efficacy 
and  motivate  them  to  try'  the  task.  One  way  to  increase  model- 
observer  similarity  and  self-efficacy  may  be  with  peermod- 
ejs. 

Schunk  and  Hanson  (1985)  compared  the  effects  of 
videotaped  peer  mastery  and  coping  models  with  those  of 
teacher  models  and  no  models.  Peer  models  increase  self- 
efficacy  and  subtraction  achievement  better  than  teacher 
models  and  no  models;  teacher-model  children  outperformed 
no-model  students. 

Self- Regulation 

SclJ-rcgulation  refers  to  processes  that  students  use  to 
activate  and  sustain  cognitions,  behaviors,  and  affects,  which 


are  oriented  toward  the  attainment  of  goals  (Zimmerman, 
1989,  1990).  Researchers  are  investigating  how  students 
self-regulate  key  academic  behaviors  (e.g.,  planning  and 
managing  time,  using  social  resources,  establishing  a pro- 
ductive work  environment).  Models  of  self-regulation  of- 
ten incorporate  such  motivational  processes  as  goals,  expec- 
tations, values,  and  personal  satisfaction  (Zimmerman,  1994). 

Bandura  (1986)  hypothesizes  there  are  three  major 
phases  of  self-regulation;  Self-observation  refers  to  deliber- 
ate attention  to  specific  aspects  of  one’s  behavior;  self-judg- 
ment refers  to  comparing  present  performance  with  a stan- 
dard; self-reaction  involves  making  evaluative  responses  to 
judgments  of  one’s  performance.  Positive  evaluations  sus- 
tain motivation;  negative  evaluations  do  not  necessarily  di- 
minish it  if  students  believe  they  can  improve  through  such 
means  as  using  better  strategies  or  expending  more  effort. 

Zimmerman  and  Kitsantas  (in  press)  worked  with  high 
school  girls  learning  to  throw  darts.  Girls  given  a process 
goal  surpassed  girls  given  a product  goal  in  dart  throwing 
skill,  self-efficacy  beliefs,  self-reactions  (rated  satisfaction), 
and  intrinsic  interest  in  dart  throwing  relative  to  other  sports. 

These  results  suggest  that  as  strategic  performing  is 
being  internalized,  process  goals  enhance  learning  better  than 
product  goals,  perhaps  because  students  attempt  to  self-regu- 
late  performance  aspects  that  contribute  to  higher  scores. 
Once  internalized  self-control  is  attained,  however,  product 
goals  may  enhance  learning  better. 

Information  Processing 

Information  processing  theories  view  learning  as  the 
encoding  of  information  in  long-term  memory.  Learners 
activate  relevant  portions  of  long-term  memory  and  relate 
new  knowledge  to  existing  information  in  working  memory'. 
By  organizing  and  rehearsing  information,  learners  improve 
access  to  existing  knowledge  and  the  likelihood  of  remem- 
bering. When  information  is  cued,  learners  recall  it  from 
long-term  memory  into  working  memory. 

A central  feature  of  the  information  processing  sys- 
tem is  the  existence  of  control  processes , which  help  the 
learner  attend  to,  process,  retain,  and  recall  information. 
Control  processes  include  self-regulatory  and  motivational 
activities,  which  can  assist  learning  and  performance  in  vari- 
ous ways. 

The  role  of  motivation  w-ithin  an  information  process- 
ing framework  is  illustrated  in  the  resource  allocation  model 
(Kanfer&  Ackerman,  1989;  Kanfer&  Kanfer,  1991).  This 
model  posits  that  attention  is  a key  cognitive  process;  through 
attention,  such  other  factors  as  abilities,  motivation,  self-regu- 
lation, and  perceived  task  demands,  affect  performance. 
Attention  is  a limited  resource  and  is  allocated  to  activities 
as  a function  of  motivation  and  self-regulatory  processes. 
Distal  processes  refer  to  task-related  goals  and  limit  total 
resource  availability.  Proximal  processes  direct  attention  to 
on-task,  off-task,  or  self-regulatorv  activities.  Allocations 
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are  adjusted  based  on  feedback  about  effectiveness.  When 
task  demands  are  high  (e  g.,  difficult  goals),  people  allocate 
greater  attention  to  the  task;  when  demands  are  lower,  they 
may  shift  some  attention  away  from  the  task  and  to  other 
activities.  Self-regulation  is  a key  mechanism  for  produc- 
ing changes  in  resource  allocation. 

These  results  have  implications  for  instruction.  Teach- 
ers need  to  ensure  that  attentional  demands  are  appropriate 
for  students  during  learning  and  that  competing  conditions 
are  minimized.  Since  motivational  factors  also  are  impor- 
tant, instruction  should  help  build  these  outcomes  as  a means 
for  ensuring  continued  allocation  of  attention  to  learning 
tasks. 

Models  of  Achievement  Processes 

Atkinson  (1957)  helped  to  move  the  field  of  motiva- 
tion away  from  a behavioral  perspective  by  postulating  that 
motivation  is  a function  of  the  individual’s  expectancies  for 
success  and  perceived  value  of  engaging  in  the  task. 

By  incorporating  the  concept  of  value , expectancy- 
value  models  made  an  advance  over  theories  that  did  not 
consider  the  full  range  of  personal  perceptions.  The  value 
of  any  task  depends  on  three  factors:  Attainment  value  is 
the  importance  of  doing  well  on  the  task;  intrinsic  (interest) 
value  refers  to  the  inherent,  immediate  enjoyment  one  de- 
rives from  the  task;  utility'  value  relates  to  perceived  impor- 
tance relative  to  a future  goal  (e.g.,  taking  a course  to  ad- 
vance one's  career)  (Eccles,  1983;  Wigfield,  1994). 

Research  by  Eccles  and  her  colleagues  supports  many 
predictions  of  her  model.  Values  are  positively  related  to 
achievement;  however,  when  both  expectancy  beliefs  and 
values  are  used  to  predict  achievement,  expectancy  beliefs 
are  significant  predictors  and  values  are  not.  In  sum,  values 
may  be  important  for  choice  behaviors  and  student  enroll- 
ment in  courses,  but  once  students  are  in  the  course,  values 
are  not  as  important  for  achievement  as  are  expectancy  be- 
liefs. 

Instruction 

Historically,  teachers  were  viewed  narrow ly  as  moti- 
vators who  dispensed  rewards  and  punishments.  The  moti- 
vator role  of  teachers  has  broadened  in  light  of  evidence  that 
many  teacher  actions  have  potential  motivational  impact 
(Pintrich  &,  Schunk,  1996).  Further,  effects  are  reciprocal: 
Teachers  affect  student  motivation  and  teachers'  motivation 
for  teaching  and  helping  students  leam  is  influenced  by  how 
students  react  to  classroom  activities. 

Ames  (1981,  1984 ) explored  the  motivational  effects 
of  instructional  grouping  arrangements.  Ames  (1981)  com- 
pared competitive  and  cooperative  structures  for  their  ef- 
fects on  children's  self-evaluations.  Performance  outcome 
was  manipulated  such  that  one  child  in  e ,h  pair  outper- 
formed the  other;  within  the  cooperative  condition,  groups 
either  did  or  did  not  attain  their  goal.  In  the  cooperative 
groups,  group  outcomes  affected  students'  perceptions  of 


their  abilities  and  feelings  of  satisfaction.  Group  success 
alleviated  negative  self-perceptions  resulting  from  poor  in- 
dividual performances,  and  group  failure  lowered  positive 
self-perceptions  of  students  who  performed  well.  This  and 
other  research  (Ames,  1984)  shows  that  competitive  fai1  ire 
has  more  deleterious  effects  on  self-perceptions  than  does 
noncompetitive  failure:  however,  when  cooperative  groups 
fail,  dissatisfaction  can  run  high  regardless  of  one's  indi- 
vidual performance. 

Technology' 

It  often  is  assumed  that  because  computers  are  fun  to 
work  with  they  hold  great  motivational  appeal  for  students 
and  thus  should  facilitate  learning  compared  w-ith  traditional 
instruction.  For  example,  an  important  way  to  promote  in- 
trinsic motivation  is  through  activities  that  involve  fantasy 
through  simulations  and  games  that  present  students  with 
situations  not  actually  present  (Lepper  & Hodell,  1989). 
Some  evidence  suggests  that  fantasy  can  enhance  learning 
and  motivation.  Parker  and  Lepper  (1992)  conducted  two 
studies  with  third-  and  fourth-grade  students.  In  one  study, 
students  were  taught  computer  graphics  programming  where 
they  received  instruction  both  in  traditional  fashion  and 
embellished  with  fantasy  involving  pirates,  detectives,  or  as- 
tronauts. Students  preferred  the  fantasy  to  the  traditional 
context.  In  a second  study,  children  received  computer  in- 
struction and  were  assigned  to  an  individualized-fantasy,  as- 
signed-fantasy,  or  no-fantasy  condition.  Individualized-fan- 
tasy students  selected  their  fantasy  context;  assigned-fan- 
tasy  students  had  their  contexts  assigned  by  the  experimenter. 
Students  in  the  fantasy  conditions  demonstrated  greater  learn- 
ing compared  with  no-fantasy  children. 

How  interest  in  learning  may  translate  into  better  learn- 
ing is  not  w'ell  understood  but  may  involve  focusing  the 
learner's  attention  on  relevant  features  of  the  learning  con- 
text and  increasing  cognitive  effort  (Lepper  & Malone,  1987). 
which  many  fantasy  elements  ought  to  do.  It  is  imperative, 
however,  that  motivational  embellishments  be  relevant  to 
the  task  (Lepper  & Hodell,  1989).  Nonrelevant  features  or 
those  that  distract  will  not  enhance  students’  mental  effort. 
Software  with  embellishments  (e.g.,  lights,  noises)  only 
loosely  linked  to  what  learners  do  quickly  lose  motivational 
appeal.  Enhancements  contingent  on  learner  progress  in  skill 
acquisition  convey  that  learners  are  developing  competence, 
which  builds  motivation. 

Future  Directions 

Constructivism  and  Learning 

Constructivists  have  been  primarily  concerned  with 
explaining  how  students  construct  knowledge  structures  in 
content  domains  (e.g.,  science,  mathematics).  Such  research 
has  made  an  important  contribution  to  a learning  literature 
that  has  tended  to  focus  more  on  conditions  affecting  learn- 
ers' acquisition  of  knowledge  and  strategies  than  on  the  role 
learners  played  in  formulating  the  knowledge  and  strategics. 


An  obvious  question  is  how  motivation  relates  to  the 
construction  process  (Sivan,  1986).  We  might  ask  whether 
intrinsic  motivation  to  learn  leads  to  more  active 
constructivism.  Intuitively  it  would  seem  that  the  more  one 
wants  to  leam  the  harder  one  would  strive  to  make  sense  of 
the  environment  and  formulate  a strategy  that  will  assist  with 
learning,  but  this  hypothesis  needs  to  be  tested. 

Long-Term  Motivation 

There  are  few  longitudinal  studies,  and  most  do  not 
explore  the  process  whereby  motivation  changes.  More  re- 
search also  is  needed  on  such  practical  concerns  as  choosing 
a career  and  forming  interpersonal  relationships.  These  types 
of  studies  could  explore  which  variables  are  most  critical 
for  motivation  over  long  periods. 

Teacher  Retention 

At  a time  when  education  is  under  pressure  to  produce 
results,  many  fine  educators  leave  the  profession.  There  are 
many  reasons  why  teachers  leave  the  profession,  but  one 
involves  feeling  a low  sense  of  control  and  empowerment  in 
their  roles  to  make  positive  changes  and  a real  difference  in 
the  lives  of  students  (Ashton  & Webb,  1986;  Bandura,  1986). 

Research  might  address  such  issues  as  how  can  schools 
be  designed  to  provide  productive  work  environments  for 
teachers  and  what  types  of  career  incentives  are  needed  to 
help  retain  teachers.  A key  motivational  component  in  ca- 
reer choice  and  retention  is  teachers'  sense  of  efficacy  for 
performing  well  in  their  profession  (Hackett  & Betz,  1992). 
We  might  study  what  factors  in  teaching  serve  to  build  self- 
efficacy  and  which  need  to  be  improved. 

Motivation  in  the  Community 

Greater  research  emphasis  is  needed  on  motivation  in 
the  broader  community  that  includes  schools,  homes,  neigh- 
borhoods, and  businesses.  We  need  to  study  motivational 
processes  in-  and  out-of-school,  because  motivators  do  vary 
somewhat  with  the  context.  For  example,  teacher  rewards 
are  more  important  in  school  than  outside  of  it,  where  other 
rewards  (e.g.,  peer)  take  on  greater  significance.  The  two 
need  not  remain  exclusive.  Schools  can  invite  community 
residents  to  come  into  the  schools  to  assist  with  programs, 
and  students  can  work  in  apprenticeship  programs  under  the 
direction  of  community  mentors.  Such  collaboration  will 
provide  an  integrated  perspective  on  motivation  and  help  to 
sustain  teaching  and  learning  outside  of  traditional  bound- 
aries. 
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Assessing  Understanding  in  School-aged  Children 

Lori  Clancy  McKinney  and  Buford  E.  Wilson1,  Governors  State  University 


Abstract 


Previous  studies  have  shown  that  adult  subjects  can  recognize  and,  under  certain  conditions , recall 
material  they  have  learned,  but  not  understood  (Wilson  & Probst,  1990).  Under  conditions  where  the 
material  must  be  understood  to  be  applied,  however,  comprehenders  and  non-comprehenders  are  not 
equally  successful  ( Wilson , 1991).  Since  children 's  cognitive  processes  differ  from  adults  \ this  experi- 
ment attempted  to  replicate  Wilson  and  Probst  using  63  fifth-grade  students  to  see  if  previous  findings 
applied  to  children. 


How  many  of  you  are  familiar  with  the  expression, 
“A  watched  pot  never  boils?1'  If  you  were  in  my  classroom 
and  I used  that  expression,  you  would  probably  understand 
that  I mean  “When  you're  waiting  for  something,  it  seems 
to  take  a long  time."  My  use  of  the  idiom  would  solidify  the 
point  in  your  mind.  If,  however,  I were  to  say  “He’s  like  a 
bottle  in  the  smoke,"  you  might  not  understand  the  analogy. 
So,  no  matter  how  appropriate  the  expression  may  be,  it 
would  not  help  you  learn  what  I’m  teaching. 

Suppose  now  that  it’s  Friday,  and  I give  you  a test 
on  those  two  expressions.  Will  you  remember  what  the  pot 
doesn’t  do?  Where  the  bottle  is?  If  I phrase  the  questions  in 
that  way,  you  probably  will  be  able  to  answer  them.  If,  on 
the  other  hand,  I ask  you  “What  happens  when  you’re  wait- 
ing for  something"  or  “How  vital  do  I consider  this  person  " 
will  you  know  the  answers?  Most  likely,  you  will  be  able  to 
answer  the  first  question,  but  not  the  second.  More  impor- 
tantly, you  will  not  be  able  to  use  the  information  inherent  in 
the  second  analogy  for  anything  but  carefully  worded  tests. 

This  is,  in  fact,  what  happens  in  many  of  our  schools 
on  a daily  basis.  Our  students  do  not  know  which  area  of 
their  background  knowledge  to  activate  to  understand  the 
new  information  we  give  them.  In  the  above  example,  one 
would  have  to  know  '‘a  bottle  in  the  smoke"  is  a Biblical 
idiom.  Then  one  would  need  to  remember  that  in  ancient 
Middle  Eastern  culture,  unlike  our  culture,  bottles  were  made 
of  animal  skins.  A bottle  that  was  left  to  hang  near  the  fire, 
or  in  the  smoke,  would  dry  out  and  become  unfit  for  service. 
So  “a  bottle  in  the  smoke"  was  a colloquialism  for  some- 
thing that  had  become  useless.  If  you  were  unable  to  under- 
stand this  expression,  you  were  momentarily  in  the  same 
position  as  a student  who  doesn't  understand  the  expression 
A = L x W.  Both  expressions  can  be  memorized,  but  they 
arc  of  no  value  for  future  understanding.  Children  may  be 


able  to  repeat  the  formula  applied  to  a given  concept,  but 
they  do  not  know  how  to  actually  solve  problems.  Simply 
learning  the  vocabulary  and  mnemonics  isn’t  sufficient.  Since 
the  concept  hasn’t  been  learned,  the  students  cannot  recog- 
nize how  to  apply  it  or  what  constitutes  errors  (Wilson,  1987). 
This  doesn’t  only  happen  to  children.  College  students  may 
have  the  same  experience  when  studying  statistics,  physics, 
or  neuropsychology. 

Numerous  experiments  have  demonstrated  the  rela- 
tionship between  comprehension  of  context  and  memory. 
(Bransford  & Johnson,  1972,  1973;  Fisher  & Craik,  1977; 
Morris,  Bransford  & Franks,  1977;  Tulving  & Thomson, 
1973;  Wittrock,  1991).  Wilson  and  Probst  (1990)  presented 
subjects  with  a series  of  sentences  that  were  difficult  to  un- 
derstand without  knowing  the  context.  For  example,  the  sen- 
tences “The  pin  was  important  because  the  teeth  broke"  and 
“We  went  into  the  cornfield  because  the  student  forgot  his 
glass  s"  are  confusing  if  one  does  not  know  the  context  of 
the  sentences.  The  “comprehenders"  in  the  study  heard  a 
context  cue  before  each  sentence,  such  as  “Blue  jeans:  The 
pin  was  important  because  the  teeth  broke."  or  “Driver's  ed: 
We  went  into  the  cornfield  because  the  student  forgot  his 
glasses."  The  noncomprehender  group  heard  the  sentences 
without  any  context  cues.  Later,  the  subjects  were  tested  for 
recall  using  a cue  physically  related  to  the  original  sentence 
(a  surface  structure  cue)  or  to  the  meaning  of  the  sentence  (a 
deep  structure  cue). 

Examples  of  recall  cues: 

The  pin  was  important  because  the  teeth  broke. 

ss:  teeth  broke  ds:  fastener  substitute 

We  went  into  the  cornfield  because  the  student  forgot  his 
glasses,  ss:  cornfield  ds:  auto  accident 
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Following  the  recall  test,  subjects  were  given  a recog- 
nition test  for  the  original  sentences.  Recognition  was  very 
good  for  both  those  who  received  the  cue  at  the  time  of  en- 
coding (comprehenders  M = .95)  and  those  who  did  not  (non- 
comprehenders  M =.97).  Hence,  recognition  was  not  af- 
fected by  comprehension.  Similarly,  recall  using  surface 
structure  retrieval  cues  was  not  affected  by  comprehension. 
A physical  part  of  the  sentence  (a  surface  structure  recall 
cue)  worked  equally  well  in  retrieving  the  structural  encod- 
ing of  the  original  sentence  for  both  groups  (M  = .40  and 
.44).  However,  when  deep  structure  cues  related  to  the  mean- 
ing were  presented,  the  performance  of  comprehenders  im- 
proved to  64  percent  recall,  while  that  of  the  non- 
comprehenders  dropped  to  10  percent.  When  dealing  with 
the  meaning  of  the  sentence,  non-comprehenders  were  left 
to  their  own  devices. 

Why  should  students  be  able  to  remember  things  if 
they  haven't  really  learned  them?  The  above  findings  agree 
with  studies  of  transfer  appropriate  processing  (Fisher  & 
Craik,  1977;  Morris,  Bransford,  & Franks,  1977),  and  en- 
coding specificity  (Tulving  & Thomson,  1973).  Theoreti- 
cally, if  learning  were  tested  in  a way  that  matched  a person's 
original  processing,  the  material  would  be  well  recalled.  If 
the  material  was  learned  in  terms  of  its  surface  structure, 
rather  than  its  meaning,  we  would  expect  cues  related  to  its 
surface  structure  to  be  good  retrieval  cues.  For  example,  if 
academic  tests  resemble  the  original  material  closely  enough, 
the  student  can  rely  on  the  physical  similarities  between  the 
original  material  and  the  test  items  to  fill  in  the  blank  or 
choose  the  right  multiple-choice  answer.  Yet,  a discussion 
of  the  concepts  involved  may  reveal  that  the  student  cannot 
understand  the  meaning  of  the  concepts. 

Since  children's  cognitive  abilities  may  differ  from 
adults'  (Piaget  & lnhelder,  1973),  it  is  important  to  know 
how  these  findings  apply  to  them.  If,  as  hypothesized,  chil- 
dren show  the  same  ability  as  adults  to  recognize  and  recite 
material  they  do  not  understand,  we  as  educators  must  be 
careful  in  our  assessment  of  learning. 

Method 

Materials 

A series  of  sentences,  which  were  difficult  to  under- 
stand without  knowing  the  context,  was  pretested  on  a pilot 
group  of  fifth-grade  children.  The  children  first  heard  the 
sentences  without  the  context  and  asked  if  they  could  under- 
stand the  sentences.  Then  each  sentence  was  given  preceded 
by  the  context  as  a comprehension  cue.  The  children  were 
asked  if  they  understood  the  sentences  this  time.  If  so.  they 
were  asked  individually  to  tell  what  they  ihought  the  sen- 
tences meant.  Sentences  that  could  be  correctly  understood 
with  the  comprehension  cue,  but  not  without  it,  were  used 
for  the  acquisition  list  for  the  stud\ . 

Setting  and  participants 


Sixty-three  fifth-grade  children  participated  in  the 
study.  Thirty-two  children  ( 1 7 boys  and  1 5 girls)  were  in  the 
experimental  group.  The  other  thirty-one  children  (17  boys 
and  14  girls)  were  assigned  to  the  control  group. 

The  entire  “regular  education"  fifth  grade  class  for  the 
school  visited  during  the  study  was  housed  in  a double  class- 
room, a holdover  from  the  open  classroom  practice  of  previ- 
ous years.  Although  the  students  were  officially  divided  into 
two  classes  on  the  rolls,  the  group  functioned  as  one  class. 
Two  teachers  team-taught  all  the  students,  dividing  teach- 
ing responsibilities  between  themselves.  Many  daily  learn- 
ing activities  were  conducted  in  small  groups  in  various  cor- 
ners of  the  classroom.  This  study  was  conducted  in  the  stu- 
dents' regular  classroom  with  students  in  the  two  conditions 
gathered  in  different  parts  of  the  room  as  they  w'ould  be  for 
regular  daily  instruction. 

This  particular  class  was  exceptionally  large,  so  there 
were  two  full-time  instructional  aides  assigned  to  the  class- 
room. The  classroom  aides  presented  the  study  as  though  it 
were  part  of  an  ongoing  series  of  exercises  on  listening  and 
following  directions.  All  the  instructions  for  the  study  were 
given  on  audiotape  or  by  the  aides. 

Procedure 

The  children  w'ere  separated  into  groups  for  the  study 
and  asked  to  meet  in  different  sections  of  the  room.  Both 
conditions  were  run  simultaneously,  in  order  to  prevent  the 
children  from  talking  about  the  experiment  with  children  in 
the  other  condition,  and  to  complete  the  study  as  efficiently 
as  possible  so  as  to  be  least  disruptive  to  the  regular  class- 
room schedule.  At  the  beginning  of  the  study,  one  of  the 
aides  read  aloud  the  instructions  to  the  entire  group  of  chil- 
dren. This  included  an  explanation  that  all  the  sentences 
would  be  presented  on  tape  and  the  students  had  to  listen 
carefully,  because  nothing  could  be  repeated.  In  addition, 
the  children  were  to  rate  each  sentence  for  comprehensibil- 
ity on  a numbered  sheet  that  had  been  provided  for  them. 
The  aide  went  over  the  five-point  rating  scale  and  had  the 
children  mark  which  numbers  meant  “easy  to  understand" 
and  which  numbers  meant  “hard  to  understand".  The  pur- 
pose for  rating  the  sentences  was  to  keep  the  children  on 
task  as  they  listened  to  the  materials. 

The  acquisition  sentences  for  each  condition  were  pre- 
recorded and  presented  on  audiotape  at  ten  second  inter- 
vals. The  control  group  heard  the  acquisition  sentences  with- 
out the  context  comprehension  cues  (“non-comprehenders"). 
The  experimental  group  heard  the  sentences  preceded  by 
the  comprehension  cues  (“comprehenders").  The  children 
were  asked  to  rate  the  sentences  for  comprehensibility'  as 
the\  heard  each  sentence.  After  all  the  sentences  hau  been 
presented,  the  two  groups  were  subdivided  for  counterbal- 
ancing of  the  test  materials.  Those  with  odd-numbered  test 
packets  went  to  one  side  of  the  room  with  one  of  the  instruc- 
tional aides,  those  with  even-numbered  packets  w^ent  to  the 
other  side  of  the  room. 


Both  the  cued  recall  and  recognition  tests  were  given 
on  audiotape,  to  eliminate  confounding  due  to  discrepancies 
in  reading  ability'.  The  cued  recall  test  (given  first)  comprised 
seven  deep  structure  cues  and  seven  surface  structure  cues, 
intermingled  in  a predetermined  random  order.  Deep  struc- 
ture and  surface  structures  cues  for  each  sentence  were  coun- 
terbalanced across  subjects.  The  students  had  40  seconds  to 
write  the  sentence  that  corresponded  to  the  cue.  (The  time 
allotment  had  been  predetermined  by  observing  the  pilot 
group).  The  recognition  test  consisted  of  seven  target  sen- 
tences from  the  original  list  randomly  mixed  with  fourteen 
foils.  Students  were  given  a page  numbered  from  one  to  four- 
teen with  the  words  Yes  and  No  written  after  each  number. 
They  were  asked  to  circle  Yes  if  they  remembered  hearing 
the  sentence  in  the  first  part  of  the  exercise  and  No  if  they 
did  not  remember  it. 

Examples  of  (acquisition  context  cues),  sentences,  and 
surface  and  deep  structure  recall  cues: 

(Watching  television)  The  picture  was  poor  because  the  wind 
blew.  ss:  wind  blew  ds:  TV  antenna 

(Snowman)  The  man  grew  smaller  when  the  sun  came  out. 

ss:  grew  smaller  ds:  melting  figure 

(Grandfather  clock)  The  hand  stopped  because  the  chain 
broke.  ss:  chain  broke  ds:  telling  time 

Results 

The  pattern  of  results  for  the  research  with  children 
was  the  same  as  those  found  for  adult  subjects.  Recognition 
performance  did  not  separate  comprehenders  from  non- 
comprehenders,  t (61)  = .28,  ns.  Comprehenders  (M  = .86. 
sd  = .10)  and  non-comprehenders  (M  = .87.  sd  = .11)  did 
equally  well  on  the  recognition  test.  AH  tests  in  this  study 
were  conducted  with  an  alpha  level  of  .05. 


Surfftca  Dmp 
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Figure  I Comprehenders  and  noncomprchendcrs ' recall 
as  a function  of  type  of  cue 

A mixed  design  analysis  of  variance  using 
comprehenders  \ s.  noncomprchendcrs  as  a betw  ecn  subjects 
variable  and  deep  or  surface  structure  recall  cues  as  a within 
subjects  variable  indicated  there  was  a significant  main  ef- 
fect for  type  of  recall  cue  F ( 1 , 6 1 ) 22.22.  MSe  - .68.  and 
a significant  interaction  between  cue  and  experimental  group. 


F (1,61)  = 12.73,  MSe  = .39,  but  there  was  no  effect  for 
group,  F(  1,61)—  .44,  MSe  = .03.  Planned  comparisons  found 
no  difference  between  the  two  groups  with  respect  to  recall 
using  surface  structure  cues,  F (1,  61)  = 2.01,  MSe  - .05. 
Deep  structure  cues,  however,  did  separate  comprehenders1 
recall  from  noncomprehenders1,  F (1,61)  = 8.46,  MSe  = 
.04.  The  recall  means  for  comprehenders  and 
noncomprehenders  shown  in  Figure  I were  M = .28  and  M 
- .36  for  the  surface  structure  cues  and  M = .24  and  M = . 1 0 
for  the  deep  structure  cues. 

Discussion 

When  the  to-be-learned  material  was  re-presented  at 
the  time  of  test,  either  as  an  item  to  be  recognized  or  as  a 
surface  structure  cue,  there  were  no  test  differences  between 
the  comprehenders  and  the  noncomprehenders.  When  the 
children  were  given  deep  structure  cues  related  to  the  mean- 
ing of  the  sentence,  only  the  comprehenders  were  able  to 
answer  1 e questions  correctly.  The  noncomprehenders  did 
not  understand  the  sentences  and  were  not  able  to  use  the 
information  in  the  sentences  intelligently.  This  research  dem- 
onstrates that  recall  using  surface  structure  cues  is  not  ad- 
equate for  assessing  understanding. 

We  asked  the  pilot  group  what  they  had  learned  from 
the  sample  sentences.  It  was  clear  that  their  understanding 
did  not  always  match  the  original  intent  of  the  message.  The 
sample  sentences  were  from  a list  which  was  comprehen- 
sible to  adults  who  heard  the  context  (Wilson  & Probst, 
1990).  Adults  w'ho  are  presenting  new  material  to  children 
must  keep  in  mind  that  children  have  a different  set  of  expe- 
riences from  which  to  draw  when  interpreting  new  informa- 
tion. Background  knowledge  that  is  deficient  must  be  filled 
in  before  attempting  to  build  new  structures  on  it. 

One  finding  in  the  current  study  that  differed  from 
the  data  pattern  obtained  with  adult  participants  was  that  the 
children  in  the  comprehender  group  did  not  show  better  deep 
structure  cued  recall  than  surface  structure  cued  recall.  This 
may  be  attributable  to  the  fact  that  inferential  thinking  is 
still  a relatively  new  skill  in  fifth  grade.  Many  students  dem- 
onstrate a vulnerability  to  the  way  worksheets  and  tests  are 
worded.  When  children  are  in  the  process  of  developing  a 
cognitive  skill,  they  may  sometimes  fall  back  on  previously 
used  strategies  or  vacillate  between  two  or  more  strategies 
(Flavell,  1979,  p.  221;  Siegler,  1987,  1988). 

Frequently  we  use  tests  which  require  no  more  than 
recognition  or  recall  of  learned  material.  The  results  of  this 
study  suggest  that  noncomprehenders  as  well  as 
comprehenders  could  often  fill  in  the  blanks,  select  ihe  right 
multiplc-choicc  answer,  or  answer  true  false  questions.  Fur- 
thermore, in  situations  where  educators  teach  to  the  test,  the 
assessment  is  tantamount  to  a simple  recognition  test.  Re* 
suits  for  our  recognition  test  were  very  high.  Recognition 
and  surfacc-structure-cucd  recall  may  not  measure  under- 
standing and  consequently  would  not  assess  the  ability  of 
the  learner  to  use  the  material  in  appropriate  contexts.  The 
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Mentor  Roles: 

Views  of  Participants  in  a State-Mandated  Program 

Tom  Ganser,  University  of  Wisconsin-Whitewater 

Abstract 

Interviews  of  29  participants  (14  mentors  and  1 5 beginners)  were  analyzed  for  statements  de- 
scribing mentor  roles  and  responsibilities.  The  participants  were  employed  in  a central  state  requiring 
the  mentoring  of  beginning  teachers,  school  counselors,  and  school  librarians.  The  most  prominent 
mentor  roles  emphasized  providing  beginners  with  support  and  encouragement f help  with  logistical 
matters,  and  assistance  in  ' 'fitting  into  " a school  setting.  Statements  about  the  mentor 's  role  with  respect 
to  important  curriculum  and  teaching  skills  were  less  prominent,  whereas  comments  about  the  mentor ’s 
role  in  providing  feedback  were  both  frequent  and  strong.  Analysis  of  the  interviews  also  revealed  that 
expectations  for  mentors  were  ambiguous  and  that  j..xible  guidelines  for  serving  as  a mentor  are  desir- 
able. 


I 


j/V/entoring  programs  for  beginning  teachers  continue 
to  be  an  important  part  of  professional  development  in  schools 
despite  limited  resources  (Buttery,  Haberman,  & Houston, 
1990;  Furtvvengler,  1993, 1995;  Sclan&  Darling-Hammond, 
1992).  Programs  vary'  greatly,  most  utilizing  the  voluntary 
services  of  teachers  willing  to  serve  as  a mentor  for  new  teach- 
ers as  an  additional  responsibility.  A small  number  of  pro- 
grams release  teachers  from  part  or  all  of  their  teaching  as- 
signment to  serve  as  full-time  mentors  (DeBolt,  1 992;  Ganser, 
Freiberg,  & Zbikowski,  1994).  Mentoring  programs  serve 
several  purposes,  including  systematic  provision  of  induc- 
tion-year support,  retention  of  promising  teachers,  and  ful- 
fillment of  state  licensing  requirements  (Huling-Austin, 
1990b). 


year  of  employment.  “Beginning"  was  defined  to  include 
experienced  teachers,  counselors,  and  librarians  who  are  new 
to  a district  or  who  are  re-entering  the  workplace  after  sev- 
eral years1  absence,  in  addition  to  those  who  are  starting  their 
first  job.  Furthermore,  the  act  specified  that  qualification 
for  a license  beyond  the  initial  license  required  verification 
of  participation  in  a mentoring  program.  Although  the  re- 
form act  ordered  each  school  district  to  establish  a mentoring 
program  for  beginning  employees,  little  funding  was  pro- 
vided to  cover  associated  costs  and  no  direction  was  given 
to  districts  in  formulating  program  goals,  design,  implemen- 
tation, or  evaluation.  As  a result,  mentors  defined  their  work 
intuitively  and  based  on  enactment  of  the  role. 

Method 


Regardless  of  specific  organization,  all  mentoring  pro- 
grams depend  on  the  services  of  experienced  professionals 
whose  roles  and  activities  as  mentors  are  often  vaguely  de- 
fined (Huling-Austin,  1 990a).  Serving  as  a mentor  can  also 
be  a significant  experience  for  veteran  teachers  themselves, 
complementing  the  middle  and  later  stages  of  their  career  as 
classroom  teachers  by  providing  them  with  an  opportunity 
to  contribute  to  the  profession  of  teaching  (Burden,  1990; 
Combleth  & Ellsworth,  1994;  Fessler&  Christensen.  1992; 
Fessler  & Ungaretti,  1994). 

The  purpose  of  this  paper  is  to  present  an  analysis  of 
how  beginning  professionals  and  mentors  view  the  roles  of 
mentors  after  one  year  of  participation  in  mentoring  programs 
within  their  school  districts.  The  programs  were  established 
in  response  to  a comprehensive  educational  reform  act  of  a 
centrally  located  state.  One  provision  of  this  act  required  all 
school  districts  to  pair  beginning  teachers,  school  counse- 
lors. and  school  librarians  with  a mentor  during  their  first 


The  participants  in  this  study  worked  in  three  school 
districts  located  within  25  miles  of  a regional,  public,  com- 
prehensive university.  The  districts  were  selected  to  include 
an  urban,  a suburban,  and  a rural  school  district.  Additional 
infonnation  about  the  three  districts  is  provided  in  Table  1 . 

Table  V 


District 

Enrollment  Elementary  Junior  High 
Schools  Schools 

High 

Schools 

Teaching 

Stair 

Urban 

23,000 

41 

8 

6 

1,400 

Suburban 

2,000 

2 

1 

1 

100 

Rural 

500 

1 

0 

3 

40 

The  participants  included  1 3 mentor  teachers  and  one 
mentor  school  counselor,  and  1 3 beginning  teachers  and  two 


1 his  work  wus  supported  in  part  bv  a Slate  Research  Grant  front  the  linivcrsil)  of  Wisconsin- Whitewater  1 he  opinions  expressed  are  those  ot  the 
author  and  do  not  necessarih  reflect  the  \icws  of  the  l'ni\erxit\  of  Wisconsin-Whitewater 


beginning  librarians.  They  were  predominantly  female  and 
white,  although  they  differed  considerably  in  age,  school 
level,  and  teaching  experience. 

Each  participant  was  interviewed  once  near  the  end  of 
the  year  of  mentoring.  Twenty-six  interviews  were  tape- 
recorded  and  verbatim  transcriptions  were  prepared.  Three 
participants  preferred  that  their  interviews  not  be  tape-re- 
corded and  in  these  cases  notes  taken  during  the  interviews 
were  later  expanded.  The  interviews  ranged  from  16  to  5 1 
minutes  in  length  and  averaged  29  minutes.  Additional  com- 
ments (e.g.,  the  degree  to  which  the  participant  seemed  com- 
fortable during  the  interview)  were  also  recorded. 

The  interviews  were  semi-structured.  The  schedule 
included  questions  related  to  (1)  the  mentor's  prior  experi- 
ence in  formal  and  informal  mentoring  situations  or  the 
beginner’s  teacher  preparation  program  and  work  schedule, 
(2)  effective  mentoring  programs  in  general,  (3)  specific  fea- 
tures of  mentoring  programs  (4)  factors  used  in  matching 
beginners  and  mentors,  and  (5)  possible  benefits  and  prob- 
lems of  mentoring  programs. 

The  verbatim  transcriptions  of  the  interviews  were  read 
for  emergent  categories  of  information,  following  standard 
procedures  (Goetz  & LeCompte,  1984).  Utilizing  the  tech- 
nique of  peer  debriefing  (Lincoln  & Guba,  1985),  prelim  i- 
nary  categories  were  expanded  or  collapsed,  and  criteria  for 
inclusion  of  data  in  categories  were  established.  This  pro- 
cess resulted  in  six  major  categories:  (1)  mentor  character- 
istics, (2)  mentor  roles,  (3)  matching  factors,  (4)  features  of 
formal  mentoring  programs,  (5)  benefits  of  mentor  programs, 
and  (6)  potential  problems  of  mentor  programs.  A com- 
puter program  (Ethnograph)  was  used  to  facilitate  the  cod- 
ing of  data  and  the  sorting  and  retrieval  of  coded  segments 
(Seidel,  Kjolseth,  & Seymour,  1988). 

Results 

The  participants'  discussion  of  mentoring  revealed  two 
general  categories  of  mentor  roles:  Helping  roles  and  Pro- 
fessional roles.  Broadly  speaking,  the  emphasis  in  the  Help- 
ing roles  was  on  assisting  the  beginner  in  feeling  comfort- 
able in  the  new  job,  whereas  the  emphasis  in  the  Profes- 
sional roles  was  more  directly  related  to  the  work  of  teach- 
ers. The  Helping  roles  were  more  prominent  than  the  Pro- 
fessional roles.  In  addition,  the  Helping  roles  seemed  to  come 
to  the  mentors  more  easily  and  naturally  than  the  Profes- 
sional roles. 

Helping  Roles 

Support  and  Encouragement 


letter  of  pseudonyms  for  the  beginners  is  capitalized  [e.g., 
Heather]).  NINA  suggested  that  a willingness  to  “be  there” 
was  prominent  when  she  was  approached  about  mentoring. 
She  recalled,  “They  said,  'Would  you  be  her  mentor?'  and  1 
said,  'Well,  what  do  1 do?’  and  they  said,  'Well,  you're  just 
there  if  she  needs  you.”'  The  beginners  also  stressed  this 
role  for  the  mentor.  For  example,  Heather  summarized  the 
role  of  a mentor  as  “just  [to]  support  and  give  help.” 

Participants  differentiated  between  mentor-initiated 
support  and  support  provided  only  upon  request.  LORI  be- 
lieved that  mentors  often  needed  to  make  the  first  move  to 
“build  up  their  [beginners’]  ego”  and  DIANE  viewed  a ma- 
jor part  of  her  mentoring  responsibility  as  working  “to  keep 
them  encouraged  and  moving  . . . when  you  see  they're 
getting  overpowered.”  The  beginners  also  stressed  that  men- 
tors' making  the  first  move  is  often  appropriate  and  appreci- 
ated. Nora  noted  that  “It’s  always  nice  to  have  someone  tell 
you  the  things  that  you  do  that  are  good.”  Lisa’s  comments 
in  this  regard  were  typical  of  many  of  the  beginners:  “You 
have  someone  to  identify  with  you,  to  empathize  with  you, 
to  offer  possible  solutions,  to  give  you  moral  support.  And 
someone  [who]  could  also  remind  you  that,  ‘Yes,  the  first 
year  is  always  rough.  Hang  in  there.  You  will  survive.'” 

Among  some  participants,  the  emphasis  was  clearly 
on  the  mentors  offering  support  and  encouragement  when 
sought  out  directly  by  the  beginners.  This  mode  of  support 
depended  on  establishing  a mentor-protege  relationship  in 
which  it  was  safe  for  beginners  to  ask  “a  lot  of  questions  that 
a brand  new  teacher  may  be  afraid  or  embarrassed  to  ask” 
(Debby).  Legitimizing  asking  “dumb  questions”  generally 
required  explicit  encouragement  on  the  part  of  the  mentor  to 
overcome  what  Rachel  viewed  as  a significant  problem  for 
novices:  “A  lot  of  people  are  afraid  to  ask  a lot  of  stupid 
questions  about  simple  matters.” 

Trust  and  confidentiality  was  essential,  especially  if 
the  beginner  were  to  feel  comfortable  admitting  failure,  as 
noted  by  TAMMI:  There's  going  to  be  someone  that  you 
can  say,  'This  failed  miserably,’  and  they’re  not  going  to 
run,  tell  the  whole  faculty,  and  it’s  not  going  to  come  back 
and  haunt  them  later  on  some  type  of  evaluative  process. 
Knowing  that  there  is  someone  that  you  can  talk  to  who  will 
offer  advice,  but  who  is  never  going  to  hold  that  over  your 
head  or  file  it  for  future  reference. 

At  times,  the  support  offered  by  mentors  did  focus  on 
practical  matters.  For  instance,  Ursula,  Lucy,  and  Rachel 
indicated  that  they  were  able  to  turn  to  their  mentors  for  ad- 
vice on  personal  matters,  such  as  selecting  a health  insur- 
ance plan. 


The  participants  consistently  highlighted  the  role  of  The  role  of  mentor  in  providing  support  and  cncour- 

thc  mentor  as  someone  who  is  “always  there”  for  support  agement  to  beginners  was  very  important  and  inherently 
and  encouragement.  EVE  said,  “[Beginning  teachers]  need  appealing  to  veterans  and  beginners  alike.  This  is  what  draws 
someone  to  listen  to  them  when  they  arc  frustrated  and  upset  many  experienced  professionals  to  mentoring  in  the  first 
or  discouraged.”  (Note:  pseudonyms  for  the  mentors  are  place  (Ganser,  1995).  It  is  also  why  beginners  are  inclined 
written  in  all  capital  letters  [e.g,,  EVE],  while  only  the  first 
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to  view  working  with  a mentor  as  potentially  beneficial  and 
not  just  an  additional  ‘'bother”  during  their  first  year  of  work. 

Logistics  and  Paperwork. 

Providing  beginners  with  information  about  the  de- 
tails of  working  in  a particular  school  setting  emerged  as 
another  important  role  for  mentors.  Although  more  directly 
related  to  the  beginner's  work  than  general  support  or  en- 
couragement, the  emphasis  in  this  role  is  focused  on  occu- 
pational “survival  skills,”  not  curricular  and  instructional 
expertise.  SUE’s  comments  were  representative:  [The]  first 
thing  that  a new  teacher  has  to  have  is  help  with  just  the  way 
the  school  runs.  Who  do  you  see  when  you  have  a problem? 
Where  do  you  get  books,  desks,  etc.?  How  do  you  fill  out 
forms  that  have  to  be  filled  out?  Where  do  you  go  for  as- 
semblies? That  type  of  thing. 

Mentors  described  their  efforts  in  this  area  in  many 
different  ways,  from  “familiarizing  beginning  teachers  with 
programs  in  the  school  and  especially  the  jargon  and  acro- 
nyms” (ANN)  to  answering  questions  like  “What  day  do  we 
get  paid”  (DIANE). 

Many  mentors  viewed  assisting  beginners  with  paper- 
work as  their  most  important  function  and  one  which  could 
sometimes  save  the  occupational  life  of  the  beginner. 
MARGE  observed:  These  students  come  out  of  college  with 
no  concept  of  the  amount  of  paperwork  they  have  to  do  be- 
ing a classroom  teacher,  that  they  think  their  time  is  going  to 
be  spent  with  these  children  teaching  school  and  they  have 
absolutely  no  idea. 

Importantly,  some  participants  viewed  the  outcome  of 
this  mentoring  role  as  a prerequisite  to  effective  teaching, 
believing  that  beginners  cannot  really  focus  their  energies 
on  teaching  until  paperwork  and  similar  tasks  are  addressed. 
For  example,  SUE  commented:  Honestly,  for  a beginning 
teacher,  the  main  thing  to  worry  about  probably  for  the  first 
three  months  is  just  how  to  get  around  the  school  and  how  to 
take  care  of  the  day-to-day  business  that's  so  automatic  for 
the  rest  of  us.  And  then  you  can  kind  of  be  worried  about 
teaching. 

Elements  of  “day-to-day  business”  mentioned  by  par- 
ticipants included  student  records  and  cumulative  files 
(LORI),  attendance  records  (Zoe),  field  trip  procedures 
(Cathy),  and  the  location  of  the  Scantron  machine  (Rachel). 
Debby  suggested  a checklist  for  the  type  of  information 
needed:  “Just  a simple  checklist  to  show  the  new  teacher. 
Where  the  different  closets  are,  where  the  science  materials 
are  kept  for  experiments,  where  you  get  the  construction 
paper,  what  can  you  order,  where  are  the  workbooks.” 

Participants  generally  believed  that  helping  beginners 
with  the  logistics  of  teaching  is  clearly  needed  because 
teacher  training  programs  cannot  prepare  prospective  teach- 
ers for  work  in  a specific  school  and  because  quick  school 
orientations  are  ineffective.  Providing  assistance  in  this  area 


represents  a subtle  shift  from  general  support  and  encour- 
agement to  matters  which,  although  generally  still  quite 
mundane,  are  more  directly  related  to  the  “work”  of  teach- 
ing rather  than  to  the  “job”  of  teaching  (Feiman-Nemser, 
1983). 

Fitting  In 

Mentors'  helping  beginners  with  “paperwork”  is  part 
of  helping  them  to  become  acclimated  to  a new  work  envi- 
ronment. However,  knowing  which  form  to  use  in  a par- 
ticular situation,  even  though  necessary,  is  very  different  from 
becoming  part  of  the  professional  work  force  in  a school. 
Not  surprisingly,  therefore,  many  participants  believed  that 
another  importa..;  role  for  mentors  was  helping  beginners  to 
become  an  integral  part  of  the  school  staff.  Often  this  pe- 
riod of  transition  was  compared  to  moving  into  a new  home. 
NINA,  for  example,  talked  about  a mentor’s  obligation  to 
“make  sure  they  feel  at  home  in  this  situation.” 

One  aspect  of  helping  beginners  fit  into  the  school  was 
facilitating  their  becoming  “a  part  of  the  peers”  (TAMM1). 
For  this  reason,  Debby  and  Connie  appreciated  their  men- 
tors’ putting  them  “in  touch”  with  other  teachers  in  their 
schools.  Two  beginners  wished  that  their  mentors  had  made 
more  efforts  to  integrate  them  into  the  school’s  faculty. 
Becky  said,  “I  think  a mentor  should  try  to  get  you  involved 
with  any  of  the  committees  or  the  organizations  there  at 
school.”  Gail  regretted  that  her  mentor  failed  to  invite  her  to 
more  department  meetings  after  school  because  of  her  part- 
time  status. 

Another  facet  of  mentors’  helping  beginners  to  fit  in 
involves  familiarizing  them  with  practices  and  norms  that 
were  acceptable  within  the  workplace.  For  example,  RITA 
recalled  telling  her  beginner  about  the  upcoming  faculty 
Christmas  party,  “How  elaborate  that  would  be  and  what 
she  was  expected  to  do.”  RITA  characterized  this  mentor 
role  as  communicating  “things  I guess  that  just  are  not  writ- 
ten down.” 

Among  the  participants,  Becky  was  the  most  outspo- 
ken about  the  need  for  mentors  to  provide  beginning  teach- 
ers with  information  about  acceptable  practices.  For  example, 
she  sought  from  her  mentor  information  about  students’  tra- 
ditions which  “they've  done  ever  since  who  knows  when,” 
She  also  said,  “One  thing  I found  beneficial  from  the  mentor 
is  the  school  politics.  I mean,  you  always  need  to  know 
those  little  inside  [things].” 

As  an  example,  she  related  how  her  mentor  told  her 
about  an  important  but  unwritten  school  district  policy  re- 
garding dances.  She  says:  1 was  planning  the  FFA  and  FH  A 
social.  It  was  around  Halloween,  and  we  had  games  and  a 
pumpkin  decorating  contest.  And  then  we  were  going  to 
have  thirty  extra  minutes  and  1 wanted  to  have  a stereo  sys- 
tem and  let  them  dance.  He  [Becky's  mentor]  informed  me 
that  the  School  Board  would  absolutely  flip  if  we  let  them 
dance  for  thirty  minutes. 
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The  participants  described  other  ways  in  which  outs  (Gina)  and  allowing  access  to  the  mentor’s  personal 
mentors  helped  beginners  fit  in.  For  instance,  Becky  related  files  and  resource  materials  (Lisa,  SUE).  In  addition,  Ursula 
that  mentors  in  her  district  willingly  presented  the  begin-  referred  to  her  mentor’s  pointing  out  professional  develop- 
ing teachers’  concerns  to  the  Board  of  Education  without  ment  resources,  specifically,  “books  on  classroom  manage- 
identifying  whose  concerns  they  were.  She  said,  “We’d  write  ment  and  teaching  strategies.”  Some  mentors  were  very 
up  a list  of  things  we’d  want  and  then  we  would  hand  it  to  active  in  providing  beginners  with  resources.  For  example, 
them  [mentors]  and  let  them  bring  it  up.  That  way  they  Ursula  noted  that  her  mentor  “was  always  looking  for  things 
[Board  of  Education]  didn’t  know  who  it  was  coming  from.”  for  me.” 


RITA  recalled  sensitizing  her  beginner  to  the  commu- 
nity: Before  Christmas  I talked  to  her  about  decorating  her 
room  because  we  are  very  close  to  the  Jewish  synagogue. 
We  have  several  Jewish  children,  and  we  try  to  take  care  of 
everybody’s  beliefs.  Before  she  found  out  by  making  some 
mistakes  or  stepping  on  somebody's  toes. 

Among  the  participants,  the  emphasis  of  this  mentor 
role  was  on  helping  beginners  to  fit  into  and  conform  to  ex- 
isting structures.  There  was  no  room,  in  what  the  partici- 
pants said,  for  fostering  the  beginners’  attempts  to  influence 
school-based  norms  or  structures  as  they  existed  and  to  be- 
come the  kind  of  change  agents,  even  as  beginning  profes- 
sionals, that  Lacy  (1987)  and  Zeichner  and  Gore  ( 1 990)  sug- 
gest is  possible. 

Professional  Roles 

In  addition  to  viewing  mentor  roles  in  terms  of  pro- 
viding beginners  with  general  support  and  encouragement 
and  helping  them  to  fit  into  the  school’s  workplace  struc- 
ture, the  participants  also  discussed  mentor  roles  with  re- 
spect to  curricular  and  instructional  issues,  and  assessment 
of  the  beginner’s  performance.  In  general,  however,  pro- 
fessional roles  emerged  haltingly  as  secondary  to  the  social- 
ization roles.  If  the  time  and  resources  for  mentoring  activi- 
ties were  limited,  beginners  and  mentors  alike  sacrificed  talk 
about  curriculum  and  instructional  issues  for  general  encour- 
agement aimed  at  enabling  the  beginner  to  “survive.” 

Curriculum  and  Teaching. 

Although  the  mentor's  role  in  supporting  beginners 
was  prominent,  it  was  not  the  only  role  the  participants  as- 
cribed to  mentors.  In  fact,  TAMM1  argued  that  mentoring 
must  be  more  than  just  “Tell  me  your  problems  over  a cup 
of  coffee.”  An  important  professionalization  role  mentioned 
was  sharing  information  about  curriculum.  For  example, 
Nora  commented  that  it  was  “nice  to  have  another  teacher  or 
mentor  on  that  grade  level  so  you  can  talk  about  textbook 
things  and  about  student  ability  at  that  level.”  Nancy  be- 
lieved that  a mentor  offered  the  beginner  someone  to  “bounce 
off  these  curriculum  ideas.”  Among  the  participants,  only 
LORI  suggested  that  being  a curriculum  expert  was  the 
mentor's  most  important  role,  believing  “What  we  teach  the 
children  to  me  is  the  most  important.” 

More  typically,  the  participants  relegated  the  role  of 
the  mentor  as  curriculum  expert  to  sharing  copies  of  liand- 


Much  as  curriculum  expertise  was  described  by  par- 
ticipants as  a relatively  m inor  role  played  by  mentors,  so  too 
was  teaching  expertise.  There  was  some  implication  among 
the  mentors  that  this  was  one  of  their  roles,  but  little  men- 
tion of  it  among  the  beginners.  RUTH,  MARGE,  and  ANN 
suggested  that  mentors  must  at  least  be  competent  teachers. 
RUTH  believed  that  mentors  “should  be  well  versed  on  the 
latest  trends  in  education  and  should  have  tried  those.” 
MARGE  stipulated  that  one  important  role  of  the  mentor 
was  to  make  the  beginner  “a  better  teacher.”  ANN  was  the 
only  participant  who  included  demonstration  teaching  among 
a mentor’s  responsibilities. 

Although  there  was  relatively  little  evidence  among 
the  participants'  remarks  about  mentoring  activities  focused 
-.on  broad  curriculum  or  instructional  matters,  there  were  in- 
dications that  beginners  turned  to  mentors  for  advice  on  spe- 
cific teaching  tasks.  Zoe  mentioned  talking  with  her  mentor 
about  “how  to  assign  point  values  . . . and  participation 
grades.”  Lisa  suggested  that  the  mentor  could  provide  in- 
formation about  different  learning  styles  and  different  les- 
son plan  formats.  Nora  described  the  mentor  as  someone  to 
whom  the  beginner  could  turn  for  answers  to  questions  like, 
“Do  1 give  them  all  twenty  spelling  questions  or  do  1 give 
them  ten?”  The  mentors,  as  well,  mentioned  specific  ele- 
ments of  teaching  which  they  discussed  with  beginners,  in- 
cluding Individual  Educational  Plans  and  grading  papers 
(DIANE),  lesson  plans  (RITA),  communication  with  par- 
ents (LORI),  and  classroom  discipline  (BRUCE). 

Feedback. 

Providing  beginners  with  feedback  was  a mentor  role 
which  elicits  strong  and  generally  negative  responses  from 
beginners  and  mentors  alike.  Simply  stated,  most  partici- 
pants tended  to  equate  feedback  with  summative  evaluation 
and  strongly  believed  that  evaluation  was  not  the  mentor’s 
job.  For  example,  IRMA  said,  “I  would  never  be  part  of 
evaluation  or  assessment.”  Separating  the  mentor  from  evalu- 
ation was  sometimes  communicated  directly  and  forcefully 
to  the  prospective  mentor,  as  RUTH  recalled:  “We  were 
told.  Number  One,  that  what  we  do  with  that  person  has  noth- 
ing to  do  with  their  evaluation.  We  did  not  evaluate  them." 
The  beginners  were  equally  vocal  in  separating  mentoring 
from  evaluation.  Cathy  said  that  “Mine  [her  mentor]  had 
none  [i.c.,  evaluation  responsibilities]  and  that's  really  good 
that  she  didn't,”  and  Nora  stressed  “No.  they  [mentors]  don't 
evaluate  you  at  all.” 
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The  participants  offered  several  reasons  mentors 
should  not  be  involved  in  evaluating  the  performance  of  be- 
ginners. For  one  thing,  they  viewed  evaluation  as  the  re- 
sponsibility of  someone  else,  typically  the  principal.  For 
example,  NINA  said,  “1  think  that  [evaluation]  should  be 
left  to  somebody  that  is  more  involved  in  that  sort  of  thing.” 
NINA  and  RUTH  also  argued  that  assessment  and  evalua- 
tion of  teaching  require  special  training  which  mentors  gen- 
erally did  not  have.  “If  they  want  someone  to  assess  their 
teaching,"  NINA  comments,  “then  I think  they  definitely 
need  to  have  some  training  ” Beginners  were  sensitive  to 
this  point  as  well,  as  indicated  in  Gina's  observation:  “Those 
people  that  are  chosen  to  evaluate  you  are  supposed  to  be 
learned  in  evaluating  people,  whereas  the  other  teacher  [i.e., 
mentor]  may  be  clueless  ” 

Another  reason  cited  for  mentors’  avoiding  evalua- 
tion was  the  perceived  vulnerability  of  the  beginner  to  what 
could  be  construed  as  “pressure"  to  follow  a mentor’s  rec- 
ommendations. For  example,  SUE  said:  1 would  really  fear 
that  the  beginning  teacher,  particularly  a young  person  with 
not  a lot  of  confidence  in  [his  or  her]  teaching  ability,  would 
say,  'Well,  she  said  do  it  this  way.  That  must  be  the  right 
way  because  she's  been  teaching  for  so  long.' 

Lucy  also  pointed  out  that  many  beginners  “immedi- 
ately would  start  trying  to  say  what  they  thought  the  mentor 
wanted  them  to  say,  as  opposed  to  really  relying  on  their 
own  knowledge  about  what  they  need  to  be  doing  in  the 
classroom,”  if  the  mentors  were  “going  to  be  judgmental  of 
you,  especially  if  they  are  involved  in  a formal  type  assess- 
ment." SUE  made  a similar  comment:  “I  think  if  you're 
assessing  somebody  that  you're  mentoring,  that  person's 
going  to  tend  to  buy  into  your  technique.” 

The  participants'  most  common  reason  for  excluding 
evaluation  from  among  the  mentor's  roles  was  the  belief  that 
evaluation  is  incompatible  with  support  and  encouragement, 
"too  much  a conflict  of  interest"  (Carol).  RUTH  commented: 
"You’re  not  there  to  evaluate  or  assess  or  make  judgement. 
You're  there  to  help."  The  participants  persistently  suggested 
that  beginners  would  not  trust  mentors  and  be  open  with 
them  if  they  believed  that  they  were  evaluating  their  work. 
For  example,  ANN  talked  about  “a  certain  curtain  dropping 
down"  between  beginner  and  mentor  with  the  mention  of 
evaluation.  "You  need  someone  you  can  trust,"  Lisa  stated, 
"someone  who's  not  critical  and  someone  who  is  definitely 
on  your  side."  SUE  believed  that  “A  beginning  teacher's 
going  to  be  too  uptight  to  really  work  with  a mentor  in  the 
way  that  he  or  she  should,  if  that  beginning  teacher  thinks 
that  person's  also  is  going  to  be  watching  me.” 

Despite  general  agreement  among  the  participants  that 
mentors  should  not  provide  negative  feedback  to  the  begin- 
ners, there  was  also  some  evidence  to  the  contrary.  TAMML 
for  instance,  appreciated  her  mentor's  providing  “construc- 
tive criticism"  and  ANN  specified  as  an  important  goal  of  a 
mentoring  program  to  help  beginners  realize  their  strengths 


and  weaknesses.  IRMA  referred  to  observing  her  beginner 
teacher  to  “see  if  there  is  something  I can  suggest”  and 
TAMMI  indicated  a need  for  her  beginner  “to  come  in  and 
watch  me.”  Gail  regretted  not  having  more  feedback  from 
her  mentor.  She  said,  “I  probably  would've  enjoyed  hear- 
ing some  feedback  from  her  as  to  my  teaching  ability  or 
techniques. ...  1 felt  like  I was  probably  less  secure  by  not 
having  a convenient  opportunity  to  get  the  feedback  that  I 
was  looking  for.”  Rachel  believed  that  the  mentor  would  be 
a good  person  to  evaluate  the  beginner  because  he  or  she 
knew  tVe  beginner  better  than  anyone  else. 

Finally,  some  participants  believed  that  mentors  should 
prepare  beginners  for  their  own  formal  evaluation  by  the 
principal,  sometimes  by  conducting  “mock”  evaluations  of 
their  teaching.  For  example,  LORI  described  her  beginner 
coming  to  talk  with  her  as  she  was  “getting  ready  for  her 
evaluation.”  Connie  described  this  from  the  perspective  of 
the  beginner:  “The  evaluation — if  s so  impersonal.  When 
that  time  comes,  it  would  be  nice  to  just  sit  down  with  some- 
body and  go  over  what  exactly  is  going  to  transpire  from 
Step  One  until  the  time  that  the  state  receives  it  [final  evalu- 
ation].” 

In  general,  the  participants  associated  feedback  that 
mentors  might  provide  to  their  proteges  about  their  work  as 
a form  of  summative  evaluation  and  as  inherently  threaten- 
ing to  a positive,  productive  relationship  between  beginning 
and  experienced  professionals.  Participants  made  little  ef- 
fort to  associate  mentor  roles  with  non-traditional,  enabling 
forms  of  supervision  such  as  peer  coaching  (Glickman, 
1992).  At  the  same  time,  the  general  hesitancy  among  par- 
ticipants to  legitimize  the  evaluative  or  supervisory  role  of 
mentors  may  reflect  professional  limitations  in  the  work- 
place (Liebermann,  1988;  Little  & McLaughlin,  1993). 

Discussion 

The  participants  interviewed  in  this  study  supported 
providing  assistance  to  beginning  teachers,  counselors,  and 
librarians  in  the  form  of  a mentoring  program  pairing  begin- 
ners with  experienced  colleagues.  However,  their  view  of 
appropriate  mentor  roles  was  quite  narrow.  Most  of  the  par- 
ticipants defined  the  primary  roles  as  providing  beginners 
with  emotional  support  and  help  in  “paperwork”  and  other 
logistical  matters.  These  roles  are  important  ones  for  men- 
tors, as  evident  in  recent  analyses  of  mentoring  in  the  school 
setting  (e.g.,  Bey  & Holmes,  1992;  Dollase,  1992;  Wildman, 
Magliaro.  Niles,  & Niles,  1992).  Still,  the  participants  pro- 
vided little  evidence  that  mentoring  roles  could  or  should 
include  an  equally  important  focus  on  the  central  elements 
of  teaching,  such  as  curriculum  design  and  instructional  strat- 
egies. While  few  would  dispute  Tie  value  of  mentoring  as 
the  participants  described  it,  many  would  hope  for  more 
(Head,  Reiman,  & Thies-Sprinthall,  1992). 

One  key  factor  contributing  to  the  participants'  rela- 
tively limited  view  of  mentor  roles  may  be  that  their  partici- 
pation in  a program  of  one  year's  duration.  Research  on  the 
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development  of  beginning  teachers  shows  that  the  “survival” 
needs  of  beginning  teachers  during  their  first  years  of  teach- 
ing typically  justify  emotional  support  and  help  with  mun- 
dane details  of  the  job,  but  that  in  time  these  needs  give  way 
to  needs  related  more  directly  to  the  skills,  techniques,  and 
strategies  of  teaching  (Feiman-Nemser,  1983;  Fuller  & 
Bown,  1975;  Veenman,  1984). 

The  participants'  comments  suggested  a limited  un- 
derstanding of  mentoring  as  a role  related  but  not  identical 
to  teaching.  Their  persistent  call  for  mentor  training  or  at 
least  for  some  guidelines  for  mentoring  activities  may  ac- 
count for  their  limited  vision  of  mentoring  more  than  the 
brevity  of  the  programs.  It  appeared  that  little  guidance  was 
provided  to  the  experienced  professionals  or  the  beginners 
about  what  mentoring  might  involve,  including  the  various 
roles  that  mentors  could  play.  In  fact,  even  though  the  par- 
ticipants were  identified  by  school  officials  as  being  part  of 
a mentoring  program,  some  of  them  were  very  uncertain — 
even  near  the  end  of  the  school  year — that  they  had  ever 
been  part  of  a '‘program.’”  This  vagueness  accounted  for  the 
participants’  consistent  emphasis  on  the  need  for  more  guid- 
ance, in  the  form  of  written  guidelines,  orientations,  or  brief 
training  sessions  for  mentors. 

The  participants’  views  of  mentoring  revealed  that  they 
approached  it  intuitively,  primarily  because  the  roles  and 
responsibilities  of  mentor  and  of  beginner  were  left  unde- 
fined. Not  surprisingly,  their  vision  of  what  might  reason- 
ably be  expected  of  a mentor  generally  stopped  short  at  pro- 
viding emotional  support  and  help  with  the  more  superfi- 
cial, although  important,  aspects  of  teaching.  These  roles 
are  safe  versions  of  “extending  a helping  hand”  but  they  do 
not  push  mentoring  to  a higher  level  in  which  the  experi- 
enced professional  does  more  than  promote  the  survival  of 
the  beginner  beyond  the  first  year  of  work.  In  another  re- 
spect, the  participants’  remarks  supported  the  belief  that  the 
organization  of  teaching  and  the  structure  of  schools  create 
^n  inhospitable  environment  for  mentoring  roles  which  are 
directly  related  to  the  central  features  of  teaching  as  a pro- 
fession (Little,  1990;  Schlechty  & Whitford,  1989).  For  a 
variety  of  reasons,  the  participants  in  this  study  presented  a 
vision  of  mentoring  that  was  far  less  rich  and  varied  than  it 
might  otherwise  be,  but  which  is  reasonable  given  the  con- 
text in  which  their  mentoring  was  practiced. 
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The  Mid- Western  Educational  Research  Association's 


Annual  Meeting 

October  2-5,  1996 

Holiday  Inn  - Mart  Plaza,  Chicago,  Illinois 


Celebrating 
Our  20th  Anniversary! 


• New  Hotel  • 


• Expanded  Number  of  Sessions  • 


Look  for  us  on  the  World  Wide  Web! 

http://silver.ucs.indiana.edu/~abbbrown/MWERA.htiii! 


Featured  Speakers 


i 


Herbert  J.  Walberg 

Research  Professor  of  Education  at  the  University  of  Illinois  at  Chicago;  past  chairman  of  the 
Technical  Committee  on  International  Education  Indicators  for  the  Organization  for  Economic 
Cooperation  and  Development;  a founding  member  of  the  National  Assessment  Governing 
Board.  Along  with  numerous  contributions  to  educational  and  psychological  research  books 
and  journals,  he  frequently  writes  for  widely-circulated  practitioner  journals  and  national 
newspapers.  Professor  Walberg  is  one  of  three  U.S.  members  of  the  International  Academy 
of  Education. 


Carolyn  M.  Evertson 

Professor  of  Education  and  Chair  of  the  Department  of  Teaching  and  Learning,  Peabody 
College,  Vanderbilt  University.  Professor  Evertson  has  published  numerous  books,  handbook 
chapters,  and  articles  about  teacher  education,  learning  to  teach,  creating  and  managing 
learning  environments,  and  the  culture  of  the  classroom,  including  two  bodes.  Learning  from 
Teaching , and  Student  Characteristics  and  Teaching  with  Jere  Brophy.  Her  texts  for 
preservice  teachers,  Classroom  Management  for  Elementary  Teachers  and  Classroom 
Management for  Secondary  Teachers  (co-authored  with  Edmund  Emmer,  Barbara  Clements, 
and  Murray  Worsham)  are  soon  to  be  published  in  their  fourth  editions. 


Mary  M.  Kennedy 

Professor  and  the  Director  of  the  Institute  for  Research  at  Michigan  State  University.  She  has 
won  four  awards  for  her  work  on  the  nature  of  knowledge  needed  for  teaching.  Professor 
Kennedy  has  authored  numerous  journal  articles  and  book  chapters  in  these  areas,  and  has 
authored  reports  specifically  for  pdicy  audiences,  including  the  United  States  Congress.  She 
recently  edited  Teaching  Academic  Subjects  to  Diverse  Learners , a collection  of  articles 
examining  the  nature  of  knowledge  teachers  need  in  each  of  the  major  content  areas  and  the 
knowledge  they  need  about  students  as  learners. 


For  information  and  registration  materials , contact 


Kim  K.  Metcalf,  Program  Chair 
Teacher  Education  Laboratory  / 
School  of  Education  / 
Indiana  University 
Bloomington,  IN  47405  ' ' 
(812)  856-8123 
kmetcalf@ucs.indiana.edu 
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Proposal  Submission  Deadline  is  April  I*  1996 


New  Editorial  Team  to  Take  Over  in  1997 
Call  for  Manuscripts 


The  Mid-Western  Educational  Researcher  is  a scholarly  journal  that  publishes  research-based 
articles  addressing  a full  range  of  educational  issues.  The  journal  also  publishes  literature  reviews 
as  well  as  theoretical  and  methodological  discussions  that  make  an  original  contribution  to  the 
research  literature.  There  are  four  issues  of  the  journal  published  annually. 


The  new  editorial  team  is  now  accepting  manuscripts  for  review  and  possible  publication  in 
1997  and  beyond.  As  usual,  manuscripts  are  submitted  to  blind  reviews  by  at  least  two  researchers 
with  knowledge  of  the  literature  in  the  appropriate  area.  Furthermore,  the  editors  will  review  the 
manuscript  and  make  the  final  decision.  The  review  process  requires  approximately  three  months. 


Manuscripts  are  accepted  from  faculty,  students,  and  professionals  working  in  non-educa- 
tional  settings.  Membership  in  the  MWERA  is  not  required  in  order  to  submit  a manuscript  for 
review.  The  editors  encourage  the  submission  of  revised  papers  that  have  been  presented  at  the 
annual  meetings  of  the  MWERA,  AERA,  and  other  professional  organizations. 


Submit  four  (4)  copies  of  the  manuscript  with  a cover  letter  to  Deborah  L.  Bainer  (see  address 
below).  Manuscripts  should  conform  to  the  style  and  format  described  in  the  Publication  Manual  of 
the  American  Psychological  Association,  4th  edition.  All  manuscripts  should  be  typed,  double  spaced, 
on  8 1/2x11  paper  with  1 1/2  inch  margins  on  all  sides.  An  abstract  of  less  than  100  words  should 
accompany  the  manuscript.  The  author’s  name  and  affiliation  should  appear  on  the  title  page  only. 
Submissions  typically  are  less  than  20  double-spaced  pages  in  length.  If  the  manuscript  is  accepted 
for  publication,  the  author(s)  will  be  asked  to  provide  a disk  file  (WP5.1  or  WP6.0)  as  well  as  a 
printed  copy  of  the  final  version.  Please  note  that  the  editors  reserve  the  right  to  make  minor  modi- 
fications in  order  to  produce  a concise  and  clear  article. 


Questions  regarding  the  journal  or  the  submission  process  may  be  directed  to  the  new  editors  ( 1 997- 
1999). 


Deborah  L.  Bainer,  The  Ohio  State  University,  Mansfield 
1680  University  Drive 
Mansfield,  Ohio  44906 
(419)755-4287 
bainer.l@osu.edu 


Gene  A.  Kramer,  American  Dental  Association 
(312)  440-2684 
kramerg@ada.org 


Richard  M.  Smith,  Rehabilitation  Foundation,  Inc./ 
Marionjoy  Rehabilitation  Hospital 
(708)462-4102 

76662. 1062@compuservexom 
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MWERA  completes  20  years 


Terri  Strand,  MWERA  Archivist/Historian 


"The  heart  of  an  organization 's  memory  is  in  its  records.  If  an  organization  values  its  history , it  must 
act  to  save  the  original  letters,  minutes,  reports,  photos , publications,  and  other  documents  that  officers, 
members, have  produced  and  compiled  over  the  years.  ” (Society  of  American  Archivists) 


1996  is  a historic  year  for  MWERA.  According  to  our 
archival  records,  the  association  was  founded  on  June  19, 
1976  at  the  first  “organizational  committee  meeting”  con- 
ducted at  Loyola  University  in  Chicago.  This  meeting  was 
attended  by  1 1 members  representing  8 midwest  states:  Illi- 
nois, Indiana,  Iowa,  Michigan,  Minnesota,  Missouri , South 
Dakota,  and  Wisconsin. 

The  meeting  was  an  outcome  of  discussions  concern- 
ing the  need  for  a regional  midwest  educational  research 
association  that  occurred  during  preceding  annual  meetings 
of  the  American  Educational  Research  Association  (AERA). 
Recalling  the  meeting  two  years  later,  Judd  Harmon 
(MWERA's  fourth  president)  wrote: 


although  we  did  not  have  a formal  meeting 
with  officers  and  parliamentary  procedures,  we 
did  have  excellent  representation  from  the  States 
and  we  did  have  the  association's  first  name:  The 
Upper  Midwest  Educational  Research  Associa- 
tion. We  also  discussed  the  following  topics: 
Name,  Goals  and  Objectives,  Membership,  Offic- 
ers, Organization,  Liaison  with  other  Associations, 
Finances,  Activities,  and  Communication  and  Dis- 
semination. Various  people  were  given  topics 
upon  which  to  write  position  papers.  A good  sense 
of  purpose  and  leadership  was  experienced  by  all.” 


Now,  20  years  later,  MWERA’s  membership  has 
grown  to  720  members  representing  13  midwest  states,  25 
states  outside  the  midwest,  Washington,  D.C.,  and  Canada. 
MWERA’s  constitution  and  its  divisional  structure,  which 
are  patterned  after  those  of  AERA,  are  designed  to  encour- 
age, improve,  and  disseminate  information  about  theoreti- 
cal and  applied  educational  research.  Association  highlights 
include  an  annual  meeting,  workshops,  journal  and  other 
publications,  and  most  recently,  a home  page  on  the 
WWWcb. 


A narrative  historical  study  is  underway,  designed  to 
orient  new  and  current  members  to  MWERA,  facilitate  plan- 
ning activities,  acknowledge  members’  contributions  to  the 
association,  and  expand  regional  and  national  interest  in  the 
association.  Utilizing  the  archival  collection  of  documents 
by  Charles  Anderson  (Executive  Officer  1 980- 1994),  a new 
information  storage  and  retrieval  system  will  highlight  ar- 
chival categories  including: 


> Association  overview,  including:  organiza- 

tional structure;  membership  statistics ; 
lists  of  officers,  editors,  annual 
meetings,  etc.;  committees,  special 
interest  groups. 

> Official  documents:  articles  of  incorporation, 

annual  filing  reports,  and  other  docu- 
ments. 

Constitution  and  by-laws 

> Governance  and  membership 

> Minutes  of  meetings 

> Financial  statements  and  budgets 
V Journals  and  newsletters 

> Annual  conference  publications 

> Important  correspondence/documents 

> Association  relationships  (state  and  regional, 

and  other  associations) 

> Election/Ballot  and  Tally  documents . 


Based  on  detailed  content  analysis  of  the  documents, 
the  study  is  focusing  on  the  stability  and  growth  of  MWERA, 
and  other  identified  factors  leading  to  M WERA's  longevity 
and  outstanding  success  as  a professional  association. 


MWER  is  Now  on  the  World  Wide  Web 


Information  about  your  MWER  journal  is  now  available  for  browsing  and  downloading  on 
the  Web.  A Homepage  has  been  set  up,  courtesy  of  the  College  of  Education, at  The  Ohio  State 
University,  at  the  following  address:' 


http://www.acs.ohio-state.edu/units/education/docs/mwer.htm 


Browse  through  the  Index  of  Authors,  or  the  Index  of  Articles,  and  retrieve  the  abstract  of 
the  published  article.  Sorry,  the  complete  article  is  not  available  for  downloading  at  this  time,  for 
various  reasons,  one  of  them  being  that  we  need  our  membership  dues  to  keep  the  journal  afloat. 
Abstracts  posted  on  the  Web  are  limited  also  to  the  last  3 years. 


You  can  retrieve  the  Table  of  Contents  for  each  MWER  Issue  for  the  last  3 years,  or  find 
information  about  how  to  submit  a Manuscript  to  the  Editor,  how  to  become  a M WERA  member, 
or  receive  information  about  the  next  MWERA  annual  conference. 


Included  also  are  helpful  links  to  other  Web  sites  of  interest  to  educational  researchers,  such 
as  AERA,  ERIC,  AEA,  Buros  Institute,  Regional  Labs,  US  DOE,  etc.  Plans  are  underway  to 
develop  linkups  to  recent  authors  to  enable  you  to  make  requests,  suggestions,  or  comments,  or  to 
ask  questions.  We  want  to  develop  a forum  which  will  facilitate  educational  research  discussions, 
especially  among  faculty,  graduate  students  and  other  professional  interested  in  developing  re- 
search ideas  , teams  and  projects. 


Oops! 

On  page  26  of  the  Winter  1996  issue  of  MWER  we  printed  an  erroneous  World  Wide  Web 
address  for  the  unofficial  Home  Page  for  educational  research.  The  correct  address  is: 

http://bsuvc.bsu.edu/~OOgjmarchant/edresearch.html 

We  apologize  for  any  inconvenience  this  error  might  have  caused. 
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Mentoring  Education : An  Interview  with  Carolyn  M.  Evertson 

Gregory  J.  Marchant,  Ball  State  University 
Isadore  Newman,  University  of  Akron 


Carolyn  M.  Evertson  will  he  a featured  speaker  at  the  1996  annual  meeting  of  the  Mid-Western  Educa- 
tional Research  Association.  In  this  brief  interview  she  discusses  teacher  education,  educational  re- 
search and  policy,  mentoring  , and  teachers  and  classrooms. 

Carolyn  M.  Evertson  is  Professor  of  Education  and  Chair  of  the  Department  of  Teaching  and  Learning, 
Peabody 3 College,  Vanderbilt  University.  She  was  named  Harvie  Branscomb  Distinguished  Professsor 
in  1992.  She  has  published  numerous  books,  chapters,  and  articles  about  teacher  education,  learning  to 
teach,  managing  learning  environments,  and  the  culture  of  the  classroom.  Her  texts.  Classroom  manage- 
ment for  elementary  teachers  and  Classroom  Management  for  Secondary  Teachers,  ( co-authored  with 
Edmund  Emmer,  Barbara  Clements,  and  Murray  Worsham ) are  soon  to  be  published  in  their  fourth 
editions. 


MWER:What  do  you  see  as 
major  issues  facing  teacher 
education  today? 

CME:  One  of  the  issues  facing 
any  institution  that  is  prepar- 
ing professionals,  regardless 
of  whether  that  profession  is 
teaching  or  not,  is  the  bridge 
between  the  discourse  com- 
munities in  which  the  prepa- 
ration takes  place,  and  there 
may  be  more  than  one,  and 
the  discourse  communities  of 
the  workplace.  It  is  that  gap 
between  where  the  profes- 
sional receives  this  initial  in- 
troduction or  grounding  and 
where  they  apply  what  they 
learn.  I'll  is  issue  has  been  en- 
during. To  the  extent  that  we 
can  even  recognize  the  sepa- 
ration and  try  to  address  it, 
we  make  progress.  It  comes 
down  to  learning  to  under- 
stand these  worlds  from  mul- 
tiple perspectives. 

MWER:lt  sounds  like  you 
have  some  question  as  to  whether  or  not  universities  are 
the  best  place  for  teacher  education. 

CME:  I don't  have  any  doubt  that  they  are.  However  forg- 
ing these  links  with  the  world  of  practice  is  a tough  job  for 
universities  or  any  teacher  preparation  institution  largely 
because  of  the  conflicting  incentive  s\  stems  and  values 
within  those  institutions  with  those  of  our  system  of  pub- 
lic education.  Unless  we  can  broaden  our  understanding 
of  what  constitutes  scholarship,  much  of  the  work  done  in 
teacher  preparation  will  go  unacknowleged  and  misun- 
derstood. 


MWER:  How  can  that 

be  changed? 

CME:  One  way  is  in  the  way 
we  describe  v/hat  we  do.  I 
don't  think  we  talk  about  it  very 
well,  nor  are  we  able  to  create 
the  vivid  images  that  commu- 
nicate to  the  lay  person  who  has 
a stake  in  education.  Second,  I 
would  work  hard  within  col- 
leges and  universities  to 
broaden  the  definition  of  re- 
search and  scholarly  productiv- 
ity. The  late  Ernest  Boyer  ar- 
gued that  the  scholarship  of  ap- 
plication has  too  often  been  de- 
fined strictly  as  service  and  has 
been  discounted  as  a legitimate 
research  activity;  nevertheless, 
this  type  of  scholarship  asks  the 
question,  “How  can  knowledge 
be  responsibly  applied  to  con- 
sequential problems?"  What 
people  tend  to  forget  is  that 
many  of  our  great  universities 
were  founded  on  the  principle 
that  higher  education  must 
serve  the  interests  of  the  larger 
community.  We  have  gotten  away  from  this  basic  prin- 
ciple, 1 think.  Those  hired  to  work  with  schools  generally 
have  not  had  their  w'ork  respected. 

MWER: Unless  you  get  it  published. 

CME:  You  can  often  get  it  published,  but  you  have  to  frame 
it  in  a way  that  makes  the  article  look  like  it  contributes  to 
the  scholarship  of  discovery  or  integration,  The  trick  will 
be  to  broaden  the  definition  of  legitimate  research  to  in- 
clude the  scholarship  of  application  in  its  own  right. 
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MWER:What  trends  do  you  see  in  education  that  should  be 
of  concern? 

CME:  Our  tendency  is  to  prescribe  simple  solutions  to  com- 
plex problems.  There  is  also  the  tendency  to  endorse  or 
attack  labels  such  as  "whole  language,"  "character  educa- 
tion," or  "outcome-based-education"  withou*  accurately 
representing  the  principles  behind  them.  Often  these  at- 
tacks on  educational  practices  are  convenient  ways  of  gain- 
ing an  audience  for  another  agenda. 

MWER:  Why  don’t  legislators  and  policy-makers  pay  more 
attention  to  educational  researchers? 

CME:  I think  it's  because  we  are  seen  as  irrelevant.  A great 
deal  of  the  policy  governing  teachers  and  teacher  prepara- 
tion is  made  by  policy-makers  who  have  their  own  expe- 
riences with  public  school  education  and  their  own  anec- 
dotal evidence;  sometimes  that  is  not  positive.  Neverthe- 
less, we  all  have  a stake  in  our  schools  and  the  people  who 
work  in  them,  but  we  all  have  different  ideas  about  what  it 
will  take  to  fix  them.  Many  people’s  images  of  schools 
ate  drawn  from  what  it  was  like  when  they  were  students. 

MWER:Anita  Woolfolk  described  a presentation  in  which 
she  gave  a great  deal  of  educational  research  that  supported 
a particular  approach  and  had  one  person  raise  a hand  and 
erase  all  of  that  by  telling  a contradicting  personal  experi- 
ence. Berliner  has  said  the  same  thing  about  the  power  of 
stories.  That  is  exactly  what  you  are  saying  about  policy- 
makers. That  goes  along  with  your  changing  the  notion 
of  w'hat  research  is.  b ause  in  order  to  get  that  kind  of 
anecdotal  information  out  it  has  to  be  considered  part  of 
research. 

CME:  Policy-makers  have  heard  plenty  of  negative  personal 
stories.  The  positive  stories  are  too  often  buried  in  jour- 
nals that  are  not  easily  accessible. 

MWER:We  also  have  a tendency  to  avoid  overstating  our 
case  and  we  appear  very  wishy-washy  even  about  the 
things  that  we  are  pretty  sure  about.  We  always  include  a 
postscript  of  "but  more  research  is  needed."  Policy-mak- 
ers say,  "Well,  if  more  research  is  needed,  do  the  research 
and  come  back  and  tell  us  when  you  know  something." 
CME:  Yes.  and  that  is  a very  pragmatic  attitude  for  them  to 
assume.  I don't  see  it  changing  for  a while. 

MWER:How  do  philosophies  and  approaches  like  the  radi- 
cal constructivist  movement  (with  no  objective  reality), 
play  to  these  people? 

CME:  Again,  here  is  the  problem  of  labels  and  images.  The 
basic  question  for  most  citizens  and  parents  is,  "OK.  but 
will  they  learn  the  multiplication  tables?" 

MWER:  You  seem  to  be  in  touch  with  the  needs  of  teachers. 
CME:  I've  seen  that  we  can  make  lives  better  for  teachers, 
kids,  and  parents.  I have  seen  it  happen.  But  we  all  need 
to  keep  the  lines  ol  communication  open. 


MWER: What  has  the  expert/novice  research  contributed  to 
our  understanding  of  effective  teaching? 

CME:  One  of  the  real  contributions  of  this  line  of  research 
was  to  underscore  the  developmental  nature  of  learning  to 
teach.  We  had  unrealistic  expectations  of  new  teachers, 
namely  that  they  would  emerge  from  their  teacher  prepa- 
ration with  everything  they  needed  to  be  good  teachers.  1 
think  we  know  now  how  naive  that  was.  The  expert/nov- 
ice work  has  helped  to  provide  a theoretically  important 
base  for  continuing  professional  development. 

MWER:Your  mentoring  work  speaks  to  this  development. 
What  makes  a good  mentor? 

CME:  The  idea  of  mentoring  or  being  mentored  is  some- 
thing everyone  likes.  It  is  intuitively  appealing;  we  would 
all  like  to  have  a close  friend  and  knowledgable  supporter 
when  we  are  learning  something  new.  Nevertheless,  just 
because  it  is  a good  thing  to  do  doesn’t  mean  that  experi- 
enced teachers  know  how  to  do  this.  Teaching  another 
adult  or  being  a support  for  another  adult  requires  other 
skills  that  may  be  different  from  those  used  in  teaching  a 
classroom  of  children.  Just  because  one  is  experienced 
does  not  necessarily  mean  one  will  be  a good  mentor.  We 
have  found  that  there  are  some  attributes,  however,  such 
as  the  ability  to  take  the  perspective  of  another,  the  ability 
to  listen,  and  to  put  aside  personal  biases  so  that  the  other 
person  can  articulate  and  pursue  his  or  her  own  questions. 
These  things  are  often  hard  for  us  to  do,  especially  if  we 
have  a lot  of  experience  in  an  area. 

MWER:  What  would  you  see  as  the  key  for  beginning  teach- 
ers to  be  successful? 

CME:  To  have  local  support  within  the  school  community; 
not  just  by  word  but  by  action.  This  has  to  be  more  than 
informal  support  by  a few  kind  teachers  or  administrators. 
There  needs  to  be  a common  value  within  the  faculty  that 
says,  "It  is  important  to  support  the  beginning  teacher  in 
the  workplace." 

MWER:  In  a recent  article  (Randolph  & Evertson,  1994), 
you  described  the  changes  in  the  nature  of  classroom  man- 
agement associated  with  moving  conceptually  from  work- 
oriented  to  more  learning-oriented  classrooms.  Can  you 
give  some  specific  examples  of  changes  you  see  in  class- 
room management? 

CME:  1 think  there  are  changes  in  the  way  we  are  thinking 
about  classroom  management.  This  is  in  part  due  to  the 
emphasis  on  teaching  for  understanding  and  the  reempha- 
sis on  the  student  being  at  the  center  of  learning  in  the 
classroom.  The  questions  become  involved  with  how  we 
as  teachers  orchestrate  the  activities  in  classrooms  in  ways 
that  support  learning,  and  what  roles  and  responsibilities 
do  teachers  and  students  assume.  For  ? long  time,  class- 
room management  has  been  and  still  is  associated  with 
control  and  discipline,  and  with  questions  about  the  best 
wavs  to  get  students  to  comply.  We  are  simply  saying 

continued  on  page  3 1 
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Research  in  Action:  Becoming  a Better  Teacher 


Jack  Snowman,  Southern  Illinois  University,  Carbondale 

Abstract 

Greg  Marchant,  a past  editor  ofMWER,  and  now  an  Associate  Editor  of  the  Newsletter  for  Educational 
Psychologists  posed  the  following  question  to  anyone  who  cared  to  answei : “ Why  are  research  results 
in  educational  psychology  seldom  reflected  in  educational  policies,  and  what  can  be  done  to  improve  the 
application  of  research  findings  to  practice?  Several  respondents  noted  that  while  there  are  numerous 

examples  of  research  findings  that  can  easily  be  turned  into  useful  classroom  applications , many  of  them 
languish  in  our  academic  journals  because  they  are  written  by  researchers,  for  researchers , and  in  the 
language  of  researchers.  This  column  has  attempted  to  address  this  problem. 


Teacher  Expectancies  Subtly  Communicated  But  Usu- 
ally Understood 

In  1968  Robert  Rosenthal  and  Lenore  Jacobson  pub- 
lished a study  called  Pygmalion  in  the  Classroom  in  which  a 
group  of  first-  through  sixth-grade  teachers  in  a single  pub- 
lic school  were  led  to  believe  that,  on  the  basis  of  a special 
test  (called  the  Harvard  Test  of  Inflected  Acquisition),  cer- 
tain students  in  their  class  would  show  significant  academic 
gains  in  the  current  school  year.  In  fact,  the  test  was  the 
Flanagan  Test  of  General  Ability,  a standard 
group-administered  test  of  scholastic  aptitude,  and  the 
“high-scoring”  students  were  randomly  chosen.  At  the  end 
of  the  school  year,  all  students  were  again  given  the  Flanagan 
Test  of  General  Ability.  Rosenthal  and  Jacobson  reported 
that  those  students  who  were  identified  to  teachers  as  being 
on  the  verge  of  making  significant  academic  gains  scored 
significantly  higher  on  the  retest  than  did  those  students  who 
were  not  so  identified.  Presumably,  the  expectation  that  some 
students  were  primed  to  leam  led  teachers  to  interact  with 
these  students  in  highly  beneficial  ways,  and  these  interac- 
tions caused  the  students  to  score  significantly  higher  on  the 
Flanagan. 

Although  the  original  study  was,  to  say  the  least,  both 
controversial  and  strongly  criticized,  the  general  phenom- 
enon itself  is  now  well  accepted.  Dozens  of  studies  have 
found  sizable  positive  and  negative  teacher  expectancy  ef- 
fects on  classroom  achievement.  Marjorie  Wuthrick  {Phi 
Delta  Kappaiu  1990.  volume  71,  number  7),  for  example, 
found  that  primary  grade  teachers  react  differently  to  stu- 
dents in  the  fast-track  reading  group  than  to  students  in  the 
slow-track  group.  When  working  with  the  more  proficient 
readers,  teachers  tend  to  smile,  lean  toward  the  students,  and 
establish  eye  contact  more  often.  Criticism  tends  to  be  given 
in  friendlier,  gentler  tones.  The  oral  reading  errors  of  profi- 
cient readers  arc  often  overlooked.  When  corrections  are 


given,  they  are  made  at  the  end  of  the  sentence  or  other  mean- 
ingful unit  rather  than  in  the  middle  of  such  units.  And  com- 
prehension questions  are  asked  more  often  than  factual  ques- 
tions as  a means  of  monitoring  students’  attention  to  the  read- 
ing selection.  Less  proficient  readers,  on  the  other  hand,  are 
corrected  more  often  and  in  places  that  interrupt  meaningful 
processing  of  the  text,  are  given  less  time  to  decode  difficult 
words  or  to  correct  themselves,  and  are  asked  low-level  fac- 
tual questions  as  a way  of  checking  on  their  attention.  Teach- 
ers’ body  posture  is  often  characterized  by  frowns,  pursed 
lips,  shaking  of  the  head,  finger  pointing,  and  sitting  erect. 
In  sum,  through  a variety  of  subtle  ways,  teachers  commu- 
nicate to  students  that  they  expect  them  to  perform  well  or 
poorly  and  then  create  a situation  that  is  consistent  with  the 
expectation.  As  a result,  initial  differences  between  good 
and  poor  readers  either  remain  or  widen  over  the  course  of 
the  school  career. 

Just  how  subtle  and  far-reaching  teacher  expectancies 
can  be  was  demonstrated  in  an  ingenious  study  by  Elisha 
Babad  and  Paul  J.  Taylor  {Journal  of  Educational  Research , 
1992,  volume  86,  number  2).  These  researchers  had 
10-year-olds,  13-year-olds,  16-year-olds,  and  experienced 
high  school  teachers  from  New  Zealand  watch  a set  of  48, 

1 0-second  videotaped  segments  of  four  Israeli  teachers  talk- 
ing about  and  teaching  two  students  from  each  of  their  class- 
rooms. One  student  was  described  as  “a  good  student  of 
high  potential”  and  the  other  as  “a  weak  student  of  poor  po- 
tential.” In  each  segment,  only  the  teacher  was  seen  and/or 
heard.  On  16  of  these  brief  clips  only  the  teacher’s  voice 
was  heard  (the  picture  was  turned  off).  For  the  second  set  of 
1 6,  the  teacher  was  seen  but  not  heard  (the  sound  was  turned 
off).  For  the  final  16,  both  sound  and  picture  were  avail- 
able. The  purpose  of  these  conditions  was  to  see  whether 
teachers  communicated  any  expectancies  for  these  two  stu- 
dents through  such  subtle  cues  as  facial  expressions,  pos- 
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ture,  gestures,  and  tone  of  voice.  What  made  the  analysis  of 
voice  features  possible  was  the  fact  that  the  Israeli  teachers 
spoke  in  Hebrew,  a language  that  none  of  the  New  Zealanders 
understood.  When  the  teachers  in  the  videotaped  segments 
talked  about  their  students,  the  New  Zealand  judges  did  not 
detect  any  evidence  of  an  expectancy.  But  when  the  teach- 
ers talked  to  their  students  (who  were  present  but  could  not 
be  seen  or  heard)  in  the  picture  and  sound  plus  picture  con- 
ditions, the  judges,  including  the  10-year-olds,  detected 
strong  expectancy  differences.  Given  that  the  judges  were 
from  New  Zealand  while  the  teachers  were  Israelis,  it  ap- 
pears that  nonverbal  expectancies  are  so  powerful  that  they 
can  be  communicated  across  cultural  boundaries. 

From  the  Cooperative  Classroom  to  the  Cooperative 
School 

If  you  follow  the  research  literature  on  cooperative 
learning,  you  may  be  wondering  if  there’s  anything  left  to 
learn  about  its  effectiveness.  Over  the  last  20  years,  thou- 
sands of  studies  have  examined  its  ability  to  improve  learn- 
ing, motivation,  and  interpersonal  attitudes.  But  all  of  these 
studies  have  been  done  at  the  level  of  the  individual  class- 
room. Would  cooperative  learning  be  equally  successful  if 
it  were  implemented  throughout  an  entire  school?  Robert 
Stevens  and  Robert  Slav  in  ( American  Educational  Research 
Journal , 1995,  volume  32,  number  2)  put  that  question  to 
the  test. 

Their  study  sought  to  address  two  general  questions: 
(1 ) Is  cooperative  learning  an  effective  means  of  instruction 
when  used  in  many  subjects  by  all  teachers  in  a school  over 
a two-year  time  period?  (2)  When  cooperative  learning  is 
used  as  the  primary  mode  of  instruction  is  it  as  effective  as 
more  conventional  methods? 

The  cooperative  learning  program  was  implemented 
in  the  2nd  through  6th  grades  of  five  elementary'  schools.  In 
addition  to  the  usual  elements  that  make  up  cooperative  learn- 
ing, Stevens  and  Slavin  provided  opportunities  for  teachers 
to  collaborate  with  and  coach  one  another,  for  teachers  and 
building  principals  to  collaborate  with  one  another,  and  for 
principals  and  teachers  to  collaborate  with  parents. 

Two  specific  cooperative  learning  methods.  Coopera- 
tive Integrated  Reading  and  Composition  (CIRC)  and  Team 
Assisted  Individualization  - Mathematics  (TA1),  were  used 
most  often  and  by  all  teachers  because  they  have  been  shown 
in  numerous  research  studies  to  be  among  the  most  effective 
of  all  cooperative  learning  techniques  for  improving  achieve- 
ment. Other  techniques,  such  asTeams-Games-Toumaments 
and  Student  Teams-Achicvement  Divisions  were  used  as 
adjuncts  for  teaching  other  subjects  (e.  g.,  social  studies, 
spelling,  science)  as  teachers  saw  fit.  District-adopted  text- 
books for  language  arts  and  mathematics  were  used  as  supple- 
ments to  the  cooperative  learning  materials 

I hree  other  elementary  schools  served  as  comparison 
schools.  Teachers  in  these  schools  covered  the  same  sub- 


jects and  objectives,  but  did  so  by  using  their  normal  in- 
structional materials  (e.g.,  textbooks,  workbooks, 
worksheets)  and  methods  (e.g.,  ability-based  reading  groups, 
whole-class  instruction  with  follow-up  activities). 

The  results  after  two  years  can  be  fairly  characterized 
as  mixed.  Cooperative  students  scored  moderately  higher 
than  comparison  students  on  tests  of  reading  vocabulary, 
reading  comprehension,  language  expression,  and  math  com- 
prehension, but  not  on  tests  of  language  mechanics  and  math 
applications.  Attitudes  toward  reading,  language  arts,  and 
math  were  the  same  for  both  groups.  Although  perceived 
self-efficacy  for  reading  and  language  arts  increased  mod- 
estly for  the  cooperative  students,  there  was  no  correspond- 
ing increase  for  math.  Lastly,  students  in  the  cooperative 
learning  schools  listed  more  classmates  as  friends  than  did 
their  peers  in  the  comparison  schools. 

There  is  no  question  that  these  results  are  somewhat 
weaker  than  what  is  typically  found  when  cooperative  learn- 
ing is  tested  in  individual  classrooms  over  shorter  periods  of 
time.  But  given  the  scope  and  duration  of  this  project,  that’s 
not  surprising.  What  should  be  emphasized  is  the  fact  that 
cooperative  learning  can  be  substituted  for  more  conven- 
tional materials  and  methods  within  an  entire  school  with  no 
loss  of  achievement  in  some  areas  and  gains  in  others. 

Teaching  for  Transfer:  Helping  Students  Get  from  Here 
to  There 

Transfer  of  learning  has  always  been  one  of  education’s 
top  priorities.  Jerome  Bruner  expressed  the  belief  of  most 
educators  when  he  said  in  his  1960  book,  The  Process  of 
Education : “Learning  should  not  only  take  us  somewhere; 
it  should  allow  us  later  to  go  further  more  easily  ...  it  should 
serve  us  in  the  future.”  One  frequently  used  instructional 
tactic  to  help  students  use  what  they  know  to  solve  a current 
problem  is  to  provide  them  with  an  analogy  that  mirrors  the 
structure  of  the  target  problem.  While  this  tactic  can  work, 
early  research  suggests  that  it  has  its  limits.  During  the  eariy- 
to  mid-1980s,  Mary'  Gick  and  Keith  Holyoak,  for  example, 
found  that  for  students  to  recognize  the  usefulness  of  an  anal- 
ogy, it  must  mimic  the  target  problem  in  both  structure  and 
surface  details. 

In  their  initial  experiments,  Gick  and  Holyoak  had 
college  students  read  a story'  about  a general  who  wanted  to 
capture  a foitress.  If  the  general  used  his  entire  army,  the 
attack  would  succeed.  But  many  of  the  surrounding  vil- 
lages would  be  destroyed  during  the  attack  because  of  mines 
planted  along  the  roads  leading  to  the  fortress.  This  out- 
come was  unacceptable.  The  general’s  solution  was  to  di- 
vide his  army  into  smaller  groups  that  could  slip  through  the 
minefields,  send  each  group  along  a different  road,  and  have 
them  converge  on  the  fortress  at  the  same  time.  The  stu- 
dents were  then  given  a second  story  to  read  that  concluded 
with  a problem  for  them  to  solve.  The  second  story  was 
about  a patient  with  an  inoperable  stomach  tumor.  The 
patient's  doctor  could  destroy  the  tumor  with  abeam  of  high 
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intensity  x-rays,  but  healthy  surrounding  tissue  would 
be  destroyed  in  the  process.  Although  a beam  of  lower  in- 
tensity would  not  damage  healthy  tissue,  neither  would  it 
destroy  the  tumor.  The  problem  posed  to  the  students  was 
how  to  use  radiation  to  destroy  the  tumor  without  destroy- 
ing the  healthy  tissue  at  the  same  time.  Surprisingly,  only 
30  percent  of  the  students  realized  that  just  as  the  general 
solved  his  problem  by  dividing  his  forces  and  having  them 
converge  on  the  fortress  simultaneously,  the  doctor  could 
destroy  the  tumor  by  using  several  beams  of  low-intensity 
radiation  aimed  from  different  directions. 

In  a follow-up  study,  students  first  read  a story  about  a 
physics  lab  that  used  an  expensive  light  bulb.  The  filament, 
enclosed  in  a permanently  sealed  bulb,  was  broken.  It  could 
be  repaired  with  a high-intensity  laser  beam.  This  solution 
was  unacceptable,  however,  because  a high-intensity  beam 
would  also  shatter  the  glass.  The  problem  was  solved  by 
using  several  lower-intensity  beams  aimed  at  the  filament. 
As  before,  students  then  read  the  inoperable-tumor  story. 
Because  the  details  of  the  light  bulb  and  tumor  stories  were 
very  similar,  the  outcome  in  this  case  was  dramatically  dif- 
ferent. Almost  70  percent  of  these  students  were  able  to 
solve  the  tumor  problem.  This  figure  was  increased  to  75 
percent  when  the  subjects  were  told  that  the  first  story  could 
help  them  solve  the  problem  in  the  second  story. 

In  volume  87,  number  6 ( 1 994),  of  the  Journal  of  Edu- 
cational Research , Ines  Solomon  argues  that  most  of  the  sub- 
jects in  Gick  and  Holyoak’s  first  experiment  may  not  have 
understood  the  relationship  between  the  analog  and  the  tar- 
get task  because  the  former  was  presented  as  a story  whereas 
the  latter  was  a problem  to  be  solved.  To  test  this  hypoth- 
esis. Solomon  gave  ninth-grade  students  one  of  four  types 
of  analogies  to  help  them  solve  a science  problem  that  dealt 
with  the  theory  of  molecular  movement  (a  topic  the  students 
had  covered  in  class  two  months  earlier).  The  target  prob- 
lem consisted  of  a 250-word  passage  about  a school  labora- 
tory experiment  in  which  students  had  to  cool  a beaker  of 
melting  ice  because  it  had  gotten  too  hot,  and  six 
multiple-choice  questions  that  asked  about  aspects  of  the 
experiment.  The  analogy  given  to  Group  1 described  a group 
of  cheerleaders  who,  in  the  course  of  practicing  their  rou- 
tines, stepped  out  of  formation,  wandered  over  the  practice 
field,  and  bumped  into  each  other  as  the  marching  band  prac- 
ticed its  loud  and  lively  music.  Like  the  target  task,  the  anal- 
ogy concluded  with  a problem  (and  suggested  a solution). 
Subjects  in  Group  2 received  the  same  analogy,  but  it  was 
set  instead  in  a story  format.  The  analogy  given  to  Group  3, 
while,  set  in  a problem  format,  was  similar  to  the  target  prob- 
lem only  in  its  surface  details.  It  described  a science  class 
experiment  in  which  it  became  necessary'  to  cool  a beaker  of 
steaming,  bubbling  sugar.  Group  4 was  given  the  same  sur- 
face analogy  in  a story  format.  A fifth  group  of  subjects 
received  no  analogy  and  served  as  controls. 

Students  whose  analogy  was  set  in  a problem  format 
(Groups  1 and  3)  scored  significantly  higher  than  students 


whose  analogy  was  set  in  a story  format  (Groups  2 and  4). 
And  students  whose  analogy  was  structurally  similar  to  the 
target  problem  (Groups  1 and  2)  answered  more  of  the  six 
multiple-choice  questions  correctly  than  did  students  who 
received  a superficially  similar  analogy  (Groups  3 and  4). 
As  expected,  students  in  Group  I scored  significantly  higher 
than  the  other  three  analogy  groups  and  the  control  group. 

Multicultural  Education:  Do  We  Teach  What  We 
Preach? 

Pick  up  an  education  journal  or  attend  an  education 
conference  these  days  and  the  odds  are  high  that  you  will 
encounter  articles  and  papers  about  various  aspects  of 
multicultural  education.  And  over  the  last  three  years  doz- 
ens of  books  on  multicultural  education  have  been  published. 
It  is,  indeed,  a very  hot  topic.  But  does  all  of  this  heat  auto- 
matically produce  light?  Are  preservice  teachers  as  well 
informed  about  the  nature  of  multicultural  education  as  the 
above  activity  suggests?  The  answers  reported  by  A.  Lin 
Goodwin  in  volume  45,  number  2 of  the  Journal  of  Teacher 
Education,  might  surprise  you.  Goodwin  surveyed  80 
preservice  teachers  who  were  completing  their  teacher  edu- 
cation programs  in  1991  about  their  conceptions  of 
multicultural  education. 

The  first  of  three  open-ended  items  in  Goodwin’s  ques- 
tionnaire was,  “What,  in  your  opinion,  are  two  of  the  most 
important  goals  multicultural  education  should  seek  to  es- 
tablish?” Most  of  the  responses  (41%)  concerned  knowing 
others.  Students  could  be  helped  to  know  others  by  learning 
about  different  cultures  and  their  histories,  by  highlighting 
similarities  and  differences  among  cultures,  by  emphasizing 
the  nature  of  non-white  cultures,  and  by  pointing  out  the 
contributions  made  by  all  groups  to  human  progress.  The 
second  most  popular  response  to  the  above  question  was  that 
multicultural  programs  should  change  the  way  people  feel 
about  others  w'ho  are  different.  This  could  be  done  by  learn- 
ing to  empathize  with  the  perspective  of  others,  tolerate  dif- 
ferences, communicate  more  openly  with  others,  accept  dif- 
ferences, and  value  differences.  Other  responses  about  im- 
portant goals  concerned  addressing  the  needs  of  students  by 
fostering  pride  in  one’s  culture  and  building  self-esteem,  and 
producing  social  change  outside  the  classroom. 

The  second  item  in  the  questionnaire  asked  students 
to  “list  examples  of  multicultural  practices  you  have  observed 
or  implemented  in  your  student  teaching  placement(s)  ” Of 
the  193  responses  given  to  this  item,  39%  indicated  that 
multicultural  practices  were  embedded  in  normal  subject 
matter  (e.g.,  folktales,  mu$ic,  historical  facts).  Mosi  of  these 
implementations  (47  of  76)  were  judged  to  be  short-term 
and  ad  hoc  in  nature.  Only  29  responses  indicated  that  a 
multicultural  perspective  was  embedded  in  an  entire  unit  of 
study,  and  26  of  those  occurred  in  the  elementary  grades. 
The  second  most  frequent  implementation  (17°o  of  re- 
sponses) wa:  inviting  students  to  share  aspects  their  own 
cultural  backgrounds.  In  third  place  with  12%  of  the  re- 
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sponses  was  celebrating  special  events  or  holidays  (such  as 
Black  History  month  or  religious  holidays)  with  field  trips, 
guest  speakers,  and  festivals.  The  remaining  responses, 
which  were  all  in  single  digit  percentages,  were  bilingual 
education  programs,  establishing  a positive  classroom  cli- 
mate by  the  teacher  (e.g.,  acknowledging  students*  back- 
grounds as  important,  maintaining  a civil  classroom  envi- 
ronment, encouraging  cooperative  learning),  cooking  eth- 
nic foods,  emphasizing  the  history  of  marginal  groups  in 
American  history,  and  critically  analyzing  the  structure  of 
society  (e.g,,  racism,  stereotypes,  forced  immigration).  Per- 
haps the  most  surprising  response  came  from  almost 
one-fourth  of  the  respondents  (19  of  80).  They  reported  that 
they  had  neither  seen  nor  implemented  any  multicultural 
practices  during  their  student  teaching. 

The  third  questionnaire  item  asked,  “When  you  think 
about  multicultural  education,  what  are  two  questions  you 
would  like  answered  before  you  begin  teaching?’* 
Seventy-five  percent  of  these  responses  were  sorted  by 
Goodwin  into  two  categories:  concerns  with  instruction  and 
concerns  with  self.  Concerns  with  instruction  revolved 
largely  around  curriculum  issues.  For  example,  students 
asked  such  questions  as,  “How  can  1 incorporate  all  cultures 
within  the  curriculum?*’  “What  is  enough?'*  “How  does  one 
include  everyone  in  class?’*  and  “Is  there  evidence  to  show 
that  multicultural  education  benefits  the  students  it  serves?" 
A separate  but  related  issue  concerned  the  very  nature  of 
multicultural  education.  Twelve  percent  of  the  responses 
indicated  some  degree  of  uncertainty  about  what 
multicultural  education  is  with  such  questions  as,  “How  will 
I define  multicultural  education?”  and  “What  is  multicultural 
education?”  With  respect  to  personal  concerns,  students  had 
questions  about  such  issues  as  how  much  autonomy  they 
would  have  in  formulating  a multicultural  curriculum, 
whether  peers  or  administrators  would  approve  of  such  teach- 
ing, what  kinds  of  mistakes  or  misconceptions  they  needed 
to  avoid,  and  how  they  should  handle  racially  charged  situ- 
ations. 

It  is  tempting  to  conclude  that  the  diversity  of  concep- 
tions and  concerns  about  multicultural  education  displayed 
by  Goodwin's  sample  of  preservice  teachers  simply  mirrors 
the  diversity  of  conceptions  and  opinions  expressed  in  the 
literature.  While  there  may  be  some  truth  to  that  analysis,  it 
ignores  some  disturbing  aspects  of  these  students'  responses. 
For  the  most  part,  these  teachers-to-be  saw-  multicultural 
education  as  a stand-alone  component  that  one  plugs  into 
the  curriculum  at  appropriate  times  (e.g..  Black  History 
Month.  Cinco  de  Mayo,  Hanukkah).  And  the  scope  and 
duration  of  these  components  depends  largely  on  the  pres- 
ence of  such  external  constraints  as  attitudes  of  others,  avail- 
able material,  and  recognized  holidays  or  events.  But  the 
leading  proponents  of  multicultural  education  (such  as  James 
Banks.  Christine  1 Grant,  Daniel  Gollnick.  and  Sonia  Nieto) 
argue  that  teachers  should  constantly  integrate  such  lessons 
into  the  curriculum  because  all  individuals  benefit  from  un- 


derstanding the  characteristics  of  different  groups  of  people 
and  because  a multicultural  orientation  leads  one  to  adopt 
generally  effective  teaching  practices.  Thus,  well  trained 
teachers  do  not  wait  to  be  told  to  develop  multicultural  les- 
sons or  limit  the  scope  of  the  lessons  to  the  available  re- 
sources, but  recognize  that  multicultural  practices  are  an  in- 
herent and  constant  part  of  what  they  do  with  their  students 
every'  day. 

If  Goodwin’s  sample  of  preservice  teachers  are  repre- 
sentative of  that  population,  then  those  of  us  in  the  teacher 
education  business  who  agree  with  the  writings  of  Banks, 
Sleeter,  Grant,  etc.,  have  much  work  to  do. 


Carolyn  M.  Evertson 

continued  from  page  21 
that  these  notions  of  management  are  not  compatible  with 
building  the  kinds  of  learning  communities  we  are  trying 
to  build  where  students  have  a stake  in  their  own  learning 
and  their  own  school  community.  Still,  there  are  some 
enduring  principles:  Teachers  need  to  make  expectations 
explicit  to  students,  both  the  academic  and  the  social.  There 
needs  to  be  a level  of  trust  so  that  students  can  have  own- 
ership and  a stake  in  what  occurs  in  the  classroom. 

MWER:How  has  diversity  and  our  changing  social  contexts 
affected  learning  and  classroom  management? 

CME:  If  learning  is  the  goal,  we  cannot  only  deal  with,  but 
must  celebrate  diversity,  if  we  understand  it  as  different 
paths  to  the  same  goal.  Concerning  social  contexts,  may 
students  in  schools  today  have  competing  agendas.  Our 
society  and  our  schools  are  in  a real  dilemma  about  how 
to  teach  students  wrho  don’t  want  to  be  there,  and  the  prob- 
lem of  keeping  order  for  the  students  who  do  want  to  be 
there. 

MWER:Do  you  see  teachers  as  being  victims  of  the  system 
and  their  enviroment? 

CME:  1 don't  think  teachers  are  victims,  but  they  are  often 
the  ones  who  must  be  the  most  responsive  and  the  most 
creative  in  working  through  individual  problems  with  stu- 
dents. 

M\VER:How  can  this  be  changed? 

CME:  1 think  we  have  to  begin  to  rethink  our  old  notions  of 
authority  and  whose  responsibility  it  is. ..who  has  it,  who 
doesn't,  who  has  voice,  who  can  articulate  that  voice  and 
the  vision.  We  have  to  find  ways  to  work  together  with 
students,  parents,  and  community  to  build  a shared  vision 
of  what  kind  of  schooling  we  want  and  what  kind  of  school- 
ing we  need. 
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Transition  to  Graduate  Level  Elementary  Teacher  Preparation: 

A Formative  Analysis 

Susan  Kent,  The  Ohio  State  University:  Newark 


Abstract 

This  study  provides  a formative  evaluation  of  the  transition  from  a traditional  four -year  bachelor 's  level 
elementary * education  program  to  a fifth  year  master  of  education  (M.Ed.)  program  on  a regional  cam- 
pus of  a major  research  university . For  a three-year  period  the  newly  instituted  M.Eu.  program  ran 
concurrently  with  the  bachelor 's  certification  program  while  this  traditional  program  was  being  phased 
out . Comparisons  of  teaching  placement  rates  for  both  groups  indicated  the  M.Ed.  group  had  a place- 
ment rale  twice  as  high  as  the  bachelor ’s  graduates.  Other  factors  analyzed  include  enrollment  patterns, 
student  profiles,  staffing  and  cost  implications,  and  relationships  with  teachers  and  administrators  in  the 
schools  providing  field  and  student  teaching  placements . 


In  June,  1992,  seventeen  students  assembled  as  a co- 
hort group  to  enter  an  intensive  five-quarter  Master  of  Edu- 
cation (M.Ed.)  program  at  The  Ohio  State  University — New- 
ark (OSU-N).  Their  meeting  marked  the  beginning  of  the 
transition  from  undergraduate  to  graduate  level  elementary 
teacher  preparation  on  this  regional  campus. 

The  purpose  of  this  study  was  to  examine  the  impact 
of  this  transition  and  to  provide  a formative  evaluation  of 
the  first  three  years  of  the  new  M.Ed.  program.  Factors 
examined  included  enrollment  patterns,  student  profiles, 
staffing  implications  including  cost,  relationships  with  teach- 
ers and  administrators  in  K-8  schools  in  which  field  and  stu- 
dent teaching  placements  were  made,  and  teaching  place- 
ment data  from  those  completing  the  program. 

The  College  of  Education  at  The  Ohio  State  Uni- 
versity became  a charter  member  of  the  Holmes  Group  in 
1986  when  a majority  of  the  education  faculty  committed 
themselves  to  the  concept  of  graduate  level  teacher  prepara- 
tion as  promoted  by  this  consortium  of  approximately  one 
hundred  major  research  institutions  (Holmes  Group,  1986). 
The  elementary  education  program  area  was  the  first  in  the 
college  to  phase  out  its  undergraduate  teacher  certification 
program.  Replacing  it  was  a post-baccalaureate  certification 
program  referred  to  as  the  M.Ed.  certification  program.  A 
bachelor's  level  pre-certification  degree  program,  similar  in 
premise  to  pre-med  programs,  also  commenced  at  this  time. 
This  pre-certification  program  was  to  be  one  avenue  for  ad- 
mission into  the  fifth  year  M.Ed.  program  which  would,  upon 
completion,  meet  state  department  of  education  certification 
requirements.  Students  possessing  a bachelor's  degree  in 
any  field  would  also  be  eligible  to  apply  to  the  M.Ed.  pro- 
gram, so  the  M.Ed.  program  could  begin  before  graduates 
of  the  pre-certification  program  had  matriculated.  On  the 
Newark  campus,  the  M.Ed.  program  began  in  1992,  as  did 


the  pre-certification  program.  The  last  group  of  students 
already  enrolled  in  the  traditional  four  year  undergraduate 
elementary  education  certification  program  would  not  gradu- 
ate until  December  of  1995.  Thus  for  a three  year  period  the 
new  M.Ed.  program  would  run  concurrently  with  the  tradi- 
tional program. 

The  concept  of  post-baccalaureate  teacher  preparation 
is  not  new.  California  abolished  the  undergraduate  degree 
in  education  in  1 962  (Tierney  & McKibbon,  1993).  Although 
the  debate  regarding  teacher  preparation  has  been  heated  in 
this  era  of  educational  reform,  there  are  few  studies  compar- 
ing graduates  of  different  programs  (Andrew,  1991).  What 
literature  exists  has  produced  mixed  results,  as  tremendous 
variation  exists  among  programs  labeled  'alternative'  as  well 
as  among  those  termed  'traditional.1  Some  alternative  pro- 
grams are  'quick-entry*  programs,  in  which  candidates  are 
placed  into  classrooms  as  interns  without  prior  teaching  ex- 
perience. Academic  preparation  may  be  as  brief  as  a one 
summer  seminar.  In  such  programs,  certification  require- 
ments are  substantially  altered.  In  a review  of  such  quick- 
entry  routes,  Darling-Hammond  and  Goodwin  (1993)  re- 
ported teachers  thus  prepared  have  difficulty  with  many  as- 
pects of  teaching  and  are  less  able  to  meet  student  needs. 
The  weight  of  research  indicates it  fully  prepared  teachers 
are  in  fact  more  highly  rated  arfd  more  successful  with  stu- 
dents than  are  teachers  without  full  preparation  for  licensure 
(Darling-Hammond  & Goodwin,  1993.  p.  32). 

Two  recent  studies  lend  further  support  to  this  po- 
sition. In  a study  relating  time  of  preparation  to  teaching 
concerns,  a relationship  was  found  between  a candidate's 
degree  of  success  in  making  the  transition  from  student  to 
teacher  and  time  in  preparation  (Marso  & Pigge,  1995).  In 
another  study  comparing  undergraduate  and  graduate  stu- 
dent teachers,  McDermott,  Gormciy.  Rothcrbcrg,  and  Ham- 
mer (1995)  found  the  thinking  of  undergraduates  with  cx- 


32 


MtJ-Wcstvrn  Educational  Researcher  £ £ q 


Volume  9.  Number  2 * Spring  1996 


1 


tensive  field  experience  prior  to  student  teaching  had  ad- 
vanced through  more  stages  of  teacher  development  than 
the  thinking  of  graduate  students  without  prior  field  experi- 
ence. 

A few  studies  have  compared  graduates  of  tradi- 
tional undergraduate  programs  with  post-baccalaureate  pro- 
grams similar  to  the  OSU-N  program.  Shannon  (1993)  re- 
ported post-baccalaureate  graduates  at  one  institution  had 
higher  scores  on  all  four  sections  of  the  NTE  than  did  gradu- 
ates of  the  traditional  four  year  program.  Candidate  satis- 
faction with  the  post-baccalaureate  program  was  high,  as 
were  performance  evaluations  of  teaching  after  graduation. 
MacDonald,  Manning  and  Gable  (1994)  reported  that 
’schools  and  youth  benefit  significantly’  from  the  expertise 
of  graduates  of  a post-baccalaureate  teacher  education  pro- 
gram at  another  institution.  They  further  reported  a higher 
than  average  incidence  of  job  placement  for  these  gradu- 
ates. Another  ten  year  longitudinal  study  comparing  gradu- 
ates of  a traditional  four  year  program  with  graduates  of  a 
five  year  post-baccalaureate  program  at  one  institution  re- 
ported that  significantly  more  post-baccalaureate  graduates 
entered  and  stayed  in  teaching  than  graduates  of  the  four 
year  program.  The  post-baccalaureate  graduates  were  also 
more  satisfied  with  their  career  and  rated  the  quality  of  their 
program  higher  than  did  the  four  year  graduates  (An- 
drew, 1991), 

In  a study  of  the  post-baccalaureate  elementary  edu- 
cation preparation  program  on  the  OSU  main  campus  that 
was  the  prototype  for  the  M.Ed.  program  instituted  on  the 
Newark  campus,  Loadman  and  Gustafson  (1990)  found  the 
opposite  regarding  teacher  placement  of  post-baccalaureate 
graduates.  A follow-up  study  of  graduates  during  the  1987- 
89  academic  years  from  both  post-degree  and  traditional 
programs  found  a higher  percentage  of  the  post-baccalaure- 
ate  program  graduates  were  not  teaching.  The  graduates  of 
both  programs  were  similar,  however,  on  self  and  program 
ratings,  teaching  satisfaction,  and  views  of  teaching. 

In  a study  analyzing  the  marketability  of  Homes 
program  graduates  from  several  institutions,  Young  and  Jury 
(1994)  noted  that  the  extra  investment  these  students  had 
made  in  time  and  effort  did  not  produce  an  employment  ad- 
vantage over  graduates  of  traditional  certification  programs. 
The  Holmes  program  graduates'  chances  of  receiving  an  in- 
terview for  a teaching  position  were  no  greater  than  the 
chances  for  traditional  graduates. 

Among  these  conflicting  findings  there  is  one  area 
in  which  there  appears  to  be  a general  consensus.  A review 
of  alternative  programs  has  indicated  that  one  of  the  key 
features  contributing  to  their  success  is  collaboration  with 
K- 12  educators  during  all  phases  of  the  program,  beginning 
with  initial  program  planning.  MacDonald,  Manning  and 
Gable  (1994)  discussed  the  value  of  having  master  teachers 
as  an  integral  part  of  the  instructional  and  field  placement 
facets  of  the  program  and  the  willingness  of  collaborating 
school  districts  to  place  and  hire  the  alternative  program 


graduates.  Shannon  (1990)  reported  that  the  successful  al- 
ternative program  at  Virginia  Wesleyan  University  was  de- 
veloped after  extensive  consultation  with  local  school  dis- 
tricts and  an  assessment  of  their  needs.  Young  and  Jury 
(1994)  recommended  that  principals  be  apprised  of  the  ad- 
vantages associated  with  Holmes  graduates  and  that  candi- 
dates as  well  as  programs  be  aggressively  marketed. 

Data  and  Analysis 

Student  admission  records  were  examined  to  deter- 
mine M.Ed.  candidates'  undergraduate  degrees  and  other 
demographic  information.  Personal  inventories  completed 
by  students  admitted  into  the  program  provided  information 
on  their  former  work  and  educational  history,  in  addition  to 
personal  information  indicating  their  status  as  parents,  prior 
involvement  in  working  with  children,  etc.  As  candidates 
progressed  through  the  program,  advising  reports  provided 
information  on  their  academic  progress  and  field  placement 
evaluations  by  both  their  supervisors  and  cooperating  teach- 
ers indicated  their  progress  in  classroom  experience  and  prac- 
tice teaching.  After  completion  of  the  M.Ed.  program,  place- 
ment office  records  and  data  obtained  by  personal  commu- 
nication with  the  graduates  have  been  used  to  determine  their 
success  in  securing  teaching  positions. 

Reactions  of  teachers  and  administrators  to  the  M. 
Ed.  program  were  obtained  from  a variety  of  sources.  Min- 
utes from  the  quarterly  elementary  education  advisory  com- 
mittee consisting  of  educators  from  OSU-N  and  from  all 
seven  school  districts  in  which  field  and  student  teachers  are 
placed  recorded  concerns  and  questions  school  district  per- 
sonnel voiced  regarding  the  program.  A log  of  concerns 
raised  by  teachers  supervising  M.Ed.  students  in  field  and 
student  teaching  placements  was  kept  by  the  researcher  who 
supervised  M.Ed.  students  in  these  placements.  The  re- 
searcher also  conducted  focused  interviews  with  sixteen  se- 
lected cooperating  teachers  of  students  in  both  the  traditional 
undergraduate  program  and  the  M.Ed.  program.  In  the  in- 
terviews, perceptions  on  the  level  of  preparedness  of  the  stu- 
dent teachers  and  comments  about  the  teacher  education  pro- 
gram in  general  were  solicited. 

For  the  demographic  and  personal  inventory  data  ob- 
tained on  students,  descriptive  statistics  are  available;  for 
the  interview  data,  field  notes,  and  meeting  minutes,  a the- 
matic stra.egy  of  data  analysis  was  employed  in  which  simi- 
lar responses  were  clustered. 

Results 

Student  Profile 

OSU-N  draws  a large  proportion  of  non-traditional 
students  who  are  older  than  the  typical  undergraduate,  in- 
cluding many  who  have  had  extensive  work  experience  and 
many  who  are  parents.  The  group  of  M.Ed.  students  begin- 
ning the  program  from  1992  through  1994  were  similar  to 
the  undergraduate  education  population  for  these  factors.  The 
proportion  of  males  in  the  two  programs  was  also  similar,  at 
approximately  25%  for  both  groups. 
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Enrollment  Patterns 


Of  the  forty-four  students  who  entered  the  M.Ed. 
program  between  June  1992  and  June  1994,  two  clusters 
emerged.  One  group  consisted  of  twenty-six  students,  or 
approximately  60%  of  the  total,  who  were  recent  college 
graduates  still  in  their  twenties.  Some  of  these  students  had 
originally  planned  to  major  in  education  but  were  discour- 
aged from  doing  so  by  parents,  counselors,  and  peers.  This 
group  tended  to  have  less  experience  with  children  than  the 
second  cluster  of  students  that  emerged.  This  second  cluster 
of  eighteen  students,  equally  divided  in  age  between  their 
thirties  and  forties,  consisted  of  students  who  were  in  the 
process  of  switching  careers  and/or  parents  who  had  been 
out  of  the  work  force  raising  children.  Although  this  second 
group  had  more  experience  with  children  than  the  first  group, 
it  was  not  necessarily  in  an  instructional  capacity.  Under- 
graduate degrees  of  the  M.Ed.  students  were  wide-ranging 
but  tended  to  cluster  in  the  humanities  as  opposed  to  science 
and  technology  fields.  Over  a quarter  of  the  M.Ed.  students’ 
undergraduate  degrees  were  in  psychology,  sociology,  and 
criminology.  Nine  of  their  degrees  were  in  English,  Com- 
munication, and  Journalism.  Six  had  degrees  in  the  Sci- 
ences, followed  by  four  each  in  the  Arts,  Business,  and  Home 
Economics.  Three  had  degrees  in  History'  and  Political  Sci- 
ence, and  two  had  Genera!  Studies  degrees. 

Job  Placement 

Though  the  M.Ed.'s  and  undergraduate  students  shared 
certain  characteristics,  including  having  been  taught  by  the 
same  teaching  methods  instructors  and  placed  in  the  same 
district's  schools  for  their  field  and  student  teaching  experi- 
ences, there  was  a marked  difference  in  their  rates  of  place- 
ment in  teaching  positions  upon  graduation.  During  the  1992- 
93  academic  year,  seventeen  M.Ed.  students  received  their 
teaching  certificates  and  nine  found  permanent  K-8  teach- 
ing positions  immediately  upon  graduation.  Of  forty-five 
graduates  from  the  traditional  four-year  bachelor's  program 
during  the  same  year,  fourteen  found  placements.  Data  from 
the  second  and  third  years  of  the  M.Ed.  program  continue  to 
reflect  this  trend.  During  the  1993-94  year,  66.6%  M.Ed.'s 
found  teaching  positions  compared  to  18.4%  of  the  under- 
graduates, as  only  twelve  of  sixty-five  graduates  from  the 
bachelor's  program  secured  positions.  In  the  most  recent 
year  (1994-95)  from  which  data  is  available,  the  M.Ed.  gradu- 
ates still  have  the  advantage  in  securing  teaching  positions. 
Of  fourteen  graduates  In  1995,  seven  found  teaching  posi- 
tions (50%).  Among  seventy  undergraduates,  only  eighteen 
are  employed  as  teachers  (25%). 

An  initial  explanation  for  this  difference  in  job  place- 
ment rates  was  that  the  M.Ed.  students  may  be  less  place- 
bound  than  undergraduates,  and  therefore  they  may  have 
accepted  positions  in  a wider  geographic  area  having  greater 
teacher  demand.  In  analyzing  the  teaching  position  loca- 
tions of  both  groups,  however,  no  differences  were  noted  in 
the  percentages  of  students  from  either  the  traditional  four- 
year  program  or  M.Ed.  program  in  accepting  out-of-state 
positions.  The  overwhelming  majority  of  positions  (more 
than  92%)  have  been  secured  in  central  Ohio  for  both  groups. 


When  OSU-N  embarked  on  the  M.Ed.  program,  total 
education  enrollment  increases  were  expected  and  did  ma- 
terialize during  the  three  years  during  which  the  two  teacher 
education  programs  ran  concurrently.  It  was  projected, 
however,  that  enrollment  would  decrease  and  stabilize  after 
the  students  in  the  traditional  baccalaureate  program  had 
graduated.  This  has  not  been  the  case.  After  three  years  of 
M.Ed.  enrollment  in  the  mid-teens,  enrollment  for  the  1995- 
96  academic  year  has  increased  dramatically.  Forty-six  stu- 
dents began  the  M.Ed.  program  in  1995,  more  than  the  first 
three  years  put  together.  This  necessitated  the  formation  of 
two  cohort  groups  with  over  twenty  students  each.  About 
half  of  the  students  in  the  program  this  year  are  among  the 
first  graduates  of  the  pre-certification  program,  and  the  other 
half  are  similar  to  the  M.Ed.  students  enrolled  in  the  first 
three  years  in  the  program,  having  degrees  in  other  fields. 
Projected  enrollment  for  the  1996-97  academic  year  is  at 
least  as  high  as  enrollment  for  the  current  year.  An  addi- 
tional thirty-six  students  will  have  graduated  from  the  pre- 
certification program  by  spring  of  1996  and  will  be  eligible 
to  enter  the  M.Ed.  program  in  June  of  that  year.  Another 
thirty  students  with  degrees  in  other  fields  have  made  initial 
contact  with  the  education  advisor  to  seek  admission  into 
the  program  at  that  same  time.  It  is  conceivable  that  there 
would  be  enough  students  to  begin  three  M.Ed.  cohorts  for 
the  1 996-97  academic  year,  but  staffing  and  space  constraints 
would  make  the  addition  of  a-third  cohort  impossible.  Even 
with  two  cohorts  currently  enrolled,  resources  are  strained 
and  teaching  loads  have  been  maximized. 

Staffing  Implications 

The  transition  to  the  M.Ed.  program  has  created  two 
minor  staffing  problems.  Because  it  is  a master's  level  pro- 
gram, all  faculty  and  student  teaching  supervisors  for  the 
program  must  possess  a terminal  degree.  In  the  undergradu- 
ate program,  doctoral  students  or  retired  school  district  per- 
sonnel with  master's  degrees  had  been  hired  for  many  part 
time  positions  and  contributed  very  positively  to  the  teacher 
education  program.  Because  these  persons  do  not  possess  a 
terminal  degree,  they  can  no  longer  teach  or  supervise  in  the 
M.Ed.  program.  Finding  qualified  faculty  who  possess  a 
terminal  degree  has  been  difficult.  Cost  implications  also 
are  a factor  as  persons  with  Ph.D.'s  are  paid  at  a higher  level 
than  those  possessing  only  a master's  degree. 

A second  staffing  problem  relates  to  the  M.Ed.  cur- 
riculum. Certain  courses  from  other  College  of  Education 
departments  are  part  of  the  M.Ed.  core  curriculum,  whereas 
in  the  undergraduate  elementary'  program  being  phased  out, 
core  curriculum  was  derived  solely  from  the  department  that 
housed  elementary  education.  Faculty  eligible  to  teach  these 
core  courses  reside  on  the  main  campus.  It  has  been  diffi- 
cult to  find  main  campus  faculty  who  are  willing  to  drive  an 
hour  to  the  Newark  campus  to  teach  these  required  M.Ed. 
courses.  It  has  sometimes  been  necessary'  to  compromise 
the  M.Ed.  curriculum  sequence  in  order  to  find  a main  cam- 
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pus  faculty  member  to  teach  a required  core  course.  For 
example,  a course  on  pedagogical  methods  had  to  be  post- 
poned from  autumn  to  spring  quarter,  with  the  result  that 
M.Ed.  students  did  not  study  classroom  management  meth- 
ods until  the)  were  several  weeks  into  their  student  teaching 
experience. 

Cost  Implications 

In  addition  to  the  added  cost  of  hiring  faculty'  with 
terminal  degrees,  costs  for  advising  M.Ed.  students  are  also 
higher.  Advisors  need  time  to  analyze  undergraduate  tran- 
scripts of  prospective  M.Ed.  students  with  degrees  in  other 
fields  to  determine  which  courses  will  transfer  and  which 
courses  in  addition  to  those  in  the  M.Ed.  curriculum  will  be 
required  for  certification.  M.Ed.  students  can  opt  to  take  a 
master's  exam  or  to  complete  a master's  project.  Those  choos- 
ing the  project  option  require  an  advisor  and  significant  ad- 
vising time  since  the  M.Ed.  curriculum,  unlike  the  M.A. 
curriculum,  does  not  include  any  research  methods  courses. 

Another  issue  related  to  cost  has  yet  to  be  resolved. 
An  oft  repeated  argument  for  abandoning  undergraduate 
teacher  preparation  in  favor  of  graduate  level  preparation 
was  that  M.Ed.  students  would  be  subsidized  by  the  state  at 
a higher  level  than  that  for  undergraduates,  thus  any  loss  of 
subsidy  from  the  possibility  of  lower  enrollments  would  be 
offset . The  subsidy  model  is  complex  and  is  administered 
differently  on  regional  campuses,  so  that  no  clear  figures  as 
to  this  purported  advantage  have  yet  been  substantiated. 

Cooperating  Teachers'  Reactions  to  the  Program 

Although  the  M.Ed.  program  at  OSU-N  could  be 
broadly  labeled  an  alternative  program,  it  is  clearly  not  a 
quick-entry  program.  Depending  on  their  undergraduate 
degree,  most  M.Ed.  students  must  take  course  work  in  ad- 
dition to  the  five  full-time  quarters  of  study  the  program  re- 
quires in  order  to  meet  certification  requirements.  The  pro- 
gram also  meets  all  state  department  of  teacher  preparation 
requirements  for  hours  in  field  placements  and  student  teach- 
ing. Yet  a frustrating  and  unforeseen  aspect  of  the  M.Ed. 
program  has  been  a negative  reaction  and  attitude  from  some 
cooperating  teachers  and  administrators.  Some  teachers  have 
admitted  their  resentment  over  the  fact  that  M.Ed.  students 
can  receive  a master's  degree  in  education  in  a little  over  a 
year's  time  without  ever  having  been  a classroom  teacher. 
Their  resentment  is  not  quelled  by  the  explanation  that  the 
M.Ed.  degree  is  a practitioner’s  degree  and  not  identical  to  a 
master  of  arts  degree.  One  teacher  commented  while  being 
interviewed  that  the  M.Ed.  students  can  receive  a master's 
degree  more  easily  than  a practicing  teacher  can.  Her  per- 
ception was  echoed  by  others. 

In  assessing  the  abilities  of  M.Ed.  students  as  com- 
pared to  undergraduates  in  field  placements,  some  cooper- 
ating teachers  tended  to  be  more  critical  of  M.Ed.  students 
than  they  were  of  undergraduate  students  who  had  also  been 
placed  with  them.  One  comment  by  a cooperating  teacher 
illustrates  an  almost  defensive  attitude  regarding  M.Ed.  stu- 
dents: They  came  in  looking  for  what  was  wrong  [with  our 


teaching].'  This  perception  of  the  abilities  of  the  M.Ed.  stu- 
dents by  cooperating  teachers,  which  is  also  shared  by  some 
school  district  administrators,  is  opposite  from  the  percep- 
tion of  the  M.Ed.  faculty,  who  feel  the  M.Ed.  students  have 
generally  been  stronger  both  academically  and  in  their  stu- 
dent teaching  than  the  undergraduates. 

Discussion  and  Recommendations 

The  transition  to  graduate  level  teacher  certification  is 
now  complete  on  the  OSU-N  campus.  The  last  group  of 
students  to  receive  their  certification  in  an  undergraduate 
program  have  graduated.  Many  areas  of  concern  that  were 
discussed  as  the  transition  began  never  materialized.  Other 
emerging  aspects  of  implementing  the  M.Ed.  program  were 
totally  unforeseen.  One  major  concern  involved  sustaining 
an  adequate  enrollment  in  both  the  pre-certification  and 
M.Ed.  program.  There  was  some  trepidation  that  the  cost  of 
the  fifth  year  of  the  program  at  the  significantly  higher  gradu- 
ate tuition  level  would  send  prospective  students  to  other 
institutions  where  they  could  attain  teacher  certification  in 
four  years  instead  of  five.  Instead  of  having  a marginal  num- 
ber of  students  at  both  the  pre-certification  and  M.Ed.  lev- 
els, enrollments  for  the  current  year  are  more  than  twice  the 
projections,  and  at  least  as  many  students  are  expected  for 
both  programs  for  the  next  academic  year  as  well.  These 
higher  than  projected  enrollments  in  the  initial  teacher  certi- 
fication programs  have  produced  another  concern,  that  of 
adequately  staffing  the  Newark  campus  M.A.  education  pro- 
gram, as  faculty  loads  are  filled  by  M.Ed.  courses  alone. 

Another  concern  involved  M.Ed.'s  prospects  of 
finding  teaching  positions  upon  completing  the  program. 
There  was  concern  that  because  M.Ed.  graduates  would  com- 
mand a salary  at  the  master's  level,  administrators  would 
prefer  to  hire  graduates  from  bachelor's  degree  programs. 
This  has  not  been  the  case.  For  each  of  the  three  years  dur- 
ing which  the  undergraduate  program  ran  concurrently  with 
the  M.Ed.  program,  M.Ed.  graduates  have  had  a substantial 
advantage  in  securing  teaching  positions,  even  though  both 
groups  were  equally  place-bound.  Over  the  last  three  years, 
about  one  quarter  of  the  traditional  four  year  program  gradu- 
ates have  secured  permanent  teaching  positions,  compared 
to  over  half  of  the  M.Ed.  graduates. 

A possible  explanation  for  the  negative  attitudes  re- 
garding the  M.Ed.  students  and  program  expressed  by  some 
of  the  cooperating  teachers  may  relate  to  the  fact  that  school 
personnel  from  the  area  served  by  the  Newark  campus  were 
not  involved  in  any  aspect  of  ihe  planning  for  the  M.Ed. 
program.  The  program  was  conceptualized  and  first  imple- 
mented on  the  main  campus.  The  Ohio  State  University  has 
had  a long-standing  policy  that  requires  regional  campuses 
to  offer  education  programs  identical  to  those  on  the  main 
campus.  In  developing  the  M.Ed.  program,  this  'one  pro- 
gram, five  campus’  policy  did  not  allow  for  collaborative 
input  from  Newark-area  educators.  Instead,  the  Newark 
campus  adopted  the  program  designed  for  main  campus 
needs.  School  district  personnel  with  no  ownership  in  the 
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progr,  ay  have  found  it  easy  to  criticize.  Furthermore, 
not  being  involved  in  program  development  may  make  it 
more  difficult  to  recognize  advantages  a new  program  might 
offer. 

An  unresolved  but  critical  concern  is  whether  or 
not  the  M.Ed.  program  is  attracting  better  qualified  students 
and  preparing  higher  quality  teachers.  This  question  will  be 
the  subject  of  ongoing  research  involving  longitudinal  stud- 
ies comparing  the  success  in  teaching  and  career  paths  of 
graduates  from  the  traditional  program  with  M.Ed.  gradu- 
ates 

Many  other  possibilities  for  continuing  evaluation 
of  the  M.Ed.  program  exist.  Will  M.Ed.  students  continue 
to  have  a high  placement  rate  into  teaching  positions?  1 995 
data  from  the  Ohio  Department  of  Education  indicate  that 
only  1 6%  of  graduates  attaining  elementary  certification  from 
Ohio  institutions  during  the  1994-95  academic  year  found 
teaching  positions  in  Ohio.  The  M.Ed.  rate  has  been  consid- 
erably higher  than  this  figure.  Even  more  important  than 
teacher  placement  is  the  question  of  teacher  quality.  How 
successful  will  the  M.Ed.  teachers  be?  What  paths  will  their 
careers  take?  Will  they  remain  in  the  education  field?  Will 
they  be  more  likely  to  engage  in  action  research?  To  take 
continuing  education  course-work?  These  and  other  ques- 
tions will  need  to  be  answered. 

Further  investigations  can  be  conducted  compar- 
ing the  two  different  academic  backgrounds  of  students  that 
now  will  comprise  each  M.Ed.  cohort.  Beginning  with  the 
1 995-96  academic  year,  approximately  one  half  of  the  forty- 
six  students  entering  the  M.Ed.  program  matriculated  from 
the  pre-certification  program,  while  the  remaining  half  hold 
degrees  in  fields  other  than  education  and  therefore  were 
not  enrolled  in  the  pre-certification  program.  These  two 
groups  can  be  compared  both  while  enrolled  in  the  M.Ed. 
program  and  after  they  have  completed  it  and  enter  the  teach- 
ing field. 
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Abstract 

Survey  data  based  on  a random  stratified  sample  of  400  schools  were  utilized  to  compare  schools  that 
use  integrated,  interdisciplinary * or  multidisciplinary’  curriculum  (IC)  with  those  that  do  not  (No  IC). 
This  study • explores  the  extent  and  type  of  use  of  IC,  how  school  principals  rate  IC  success,  and  differ- 
ences between  IC  and  NoIC  schools  in  terms  of  their  characteristics,  and  teacher  involvement  and  sup- 
port across  different  school  levels . Selected  data  tables  and  analyses  are  presented  and  discussed. 


integrated  curriculum  is  central  to  the  contemporary 
vision  of  truly  effective  schools  designed  to  accommodate 
learner  diversity.  That  vision  comes  from  what  we  know 
about  teaching  and  learning.  Abundant  research  supports 
the  assertion  that  students  learn  best  when  instructional  tasks 
require  them  to  use  knowledge  in  meaningful  ways  (e.g., 
Bereiter  & Scardamalia,  1985;  Resnick,  1987;  Scardamalia 
& Bereiter,  1991;  Leinhardt,  1992).  Integrated  curriculum 
units  designed  to  involve  students  in  complex  thinking  pro- 
cesses such  as  problem  solving,  decision  making,  investiga- 
tion, experimental  inquiry  or  invention  provide  ideal  vehicles 
for  students  to  develop  and  meaningfully  use  knowledge 
(Bransford,  Vye,  Kinzer,  & Risko,  1990;  Marzano,  1992; 
Roth,  1990). 

Middle  level  educators  have  for  more  than  two  de- 
cades called  for  reform  of  their  educational  programs. 
Progress  has  been  made  in  changing  middle  school  climate 
and  institutional  features  (Beane,  1991).  On  a national  ba- 
sis, 57%  of  the  schools  responding  to  a survey  conducted  by 
the  National  Association  of  Secondary  School  Principals 
(Valentine,  Clark,  Irvin,  Keefe,  & Melton,  1993)  reported 
using  interdisciplinary  instructional  teams;  and  yet,  these  and 
other  middle  level  scholars  contend  that  curricular  reforms 
have  taken  a back  seat  to  organizational  changes  (p.  62,  Val- 
entine et  al.).  Beane  (1993),  however,  questions  the  validity 
of  this  perception.  He  reports  that  most  of  the  interdiscipli- 
nary' teams  in  middle  schools  begin  curricular  planning  by 
identifying  a theme  or  topic  and  then  asking  what  each  sub- 
ject area  can  contribute  to  that  topic.  He  argues  that  this 
type  of  planning  and  the  resultant  curriculum  would  more 
correctly  be  labeled  multidisciplinary  or  even  multi-sub- 
ject. 

t allowing  the  pilot  of  our  survey  instrument,  we  de- 
cided that  for  the  initial  data  collection  for  this  study,  the 
terms  integrated  . interdisciplinary , and  multidisciplinary, 
would  be  used  synonymously.  We  have  followed  the  same 
convention  in  this  article. 


Study  Purposes  and  Methods 

The  purposes  of  this  research  are:  (a)  to  ascertain  the 
extent  and  type  of  use  of  integrated,  interdisciplinary,  or 
multidisciplinary  curricula  (IC);  (b)  to  determine  how  these 
curricula  are  initiated  and  supported  at  the  building  level; 
and  (c)  to  explore  relationships  between  implementation  of 
integrated  curricula  (IC),  instructional  supervision,  teacher 
involvement  in  decisions,  and  principal  beliefs  about  knowl- 
edge and  learning.  Four  hundred  elementary,  middle  school/ 
junior  high,  senior  high,  and  other  schools  were  selected  as 
components  of  a stratified,  random  sample  representative  of 
the  population  of  public  and  accredited  private  schools  in 
the  state  of  Missouri.  These  schools  were  then  surveyed  us- 
ing items  designed  to  collect  both  qualitative  and  quantita- 
tive information. 

Of  the  400  schools  comprising  the  total  sample,  174 
returned  useable  surveys,  for  a response  rate  of  forty-four 
percent.  Responses  to  survey  items  were  tallied  and  ana- 
lyzed using  descriptive  statistics.  Analysis  of  variance  was 
used  to  determine  significance  of  differences  between  means 
on  selected  items.  Open-ended  survey  responses  were  ana- 
lyzed using  a constant  comparative  method  to  develop  emer- 
gent themes  and  categories  (Lincoln  & Cuba,  1985;  Miles 
& Huberman,  1 984).  These  themes  and  categories  were  de- 
veloped separately  by  each  of  the  investigators.  Data  sets 
were  then  compared  for  similarities  and  the  categories  col- 
lapsed to  eliminate  redundancy.  Follow-up  interviews  were 
then  conducted  with  a purposeful  sample  of  principals  to 
gather  more  in-depth  information  about  instructional  super- 
visory' practices  supportive  of  integrated,  interdisciplinary', 
or  multidisciplinary  curriculum  and  instruction;  to  probe  un- 
clear item  responses;  and  to  ascertain  principals’  epistemo- 
logical beliefs. 

This  paper  presents  base-line  data  specifically  collected 
in  response  to  the  following  seven  questions: 
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1 . What  are  the  characteristics  of  schools  report- 
ing some  level  of  use  of  integrated,  interdisci- 
plinary, or  multidisciplinary  curriculum  (1C 
schools)? 

2.  How  do  such  schools  differ  from  those  re- 
porting no  use  of  integrated,  interdisciplinary, 
or  multidisciplinary  curriculum  (Non-lC 
schools)? 

3.  What  is  the  type  of  use  (e.g.,  at  the  awareness 
or  experimentation  level  to  use  by  three  or 
more  teacher  teams)  of  integrated,  interdisci- 
plinary, or  multidisciplinary  curriculum  in  el- 
ementary, middle,  senior  high  and  other  Mid- 
western schools? 

4.  How  do  principals  rate  the  level  of  success  of 
their  teachers'  use  of  IC? 

5.  How  was  the  use  of  1C  initiated  in  the  schools? 

And,  who  initiated  the  use? 

6.  How  is  the  use  of  1C  supported  in  the  schools? 

7.  Do  IC  schools  and  Non-IC  schools  differ  with 
regard  to  teachers'  involvement  in  decision 
making?  If  so,  how? 

Results 

Extent  of  use 

Descriptive  statistical  analyses  of  data  indicate  that  the 
extent  of  use  of  integrated  curricu  lum  across  the  K- 1 2 schools 
in  Missouri  is  somewhat  less  than  the  50.8%  reported  in  Illi- 
nois (Irvin,  1993),  and  is  also  less  than  might  be  expected 
from  the  57%  of  middle  schools  reporting  involvement  with 
interdisciplinary  teams  on  a national  basis  (Valentine  et  aL, 
1993).  Use  of  integrated  curriculum  was  highest  at  the  el- 
ementary levei  (65. 1 2%),  and  lowest  at  the  high  school  level 
(30.3%),  with  the  other  schools  reporting  30.56%.  (see  Table 
1 ) This  percentage  of  use  of  integrated  curriculum  in  Mis- 
souri middle  schools  was  somewhat  surprising,  and  may  rep- 
resent a much  lower  level  of  use  than  in  middle  schools  across 
the  nation;  or,  as  is  more  likely,  it  may  simply  mean  that  the 
reported  57%  (on  a national  basis)  involvement  with  inter- 
disciplinary instructional  teams  is  not  synonymous  with  use 
of  integrated  curriculum. 

Table  1 

Numbers  and  Percentages  of  Schools  using  Integrated, 
Interdisciplinary,  or  Multidisciplinary  Curricula 


Ipjal 

IC  Schools 

Percent 

Elementary 

86 

56 

65.12 

Middle  School 

19 

7 

36.84 

High  School 

10 

30.30 

Other 

36 

1 1 

30.56 

All  Schools 

174 

84 

48.28 

Schools  using  integrated,  interdisciplinary,  or 
multidisciplinary  curriculum  were  generally  larger  than  those 
who  didn’t.  This  was  particularly  true  for  the  high  schools 
and  middle  level  schools.  See  Table  2. 

TaMe.2 

Means  and  F-values  of  School  Sizes 


Mean  IC 

Non-IC 

S.ChQ.Q.1 

School 

F 

Elementary 

426.20 

368.67 

1.993 

Middle  School 

776.00 

442.00 

9.533** 

High  School 

1215.80 

620.57 

12.684* 

Other 

208.27 

232.88 

.268 

All  Schools 

517.74 

403.49 

5.372* 

*p<.05  **p<.01 


School  Type 

Sample  schools  were  asked  to  describe  themselves  in 
terms  of  inner  city,  suburban,  rural,  or  other.  In  this  instance, 
other  was  exemplified  by  terms  like:  city,  urban,  affluent, 
etc.  IC  schools  and  Non-IC  schools  were  then  compared  to 
ascertain  characteristics.  Among  all  schools  using  integrated 
curriculum,  the  largest  percentage  (45. 1 2%)  described  them- 
selves as  rural,  followed  by  suburban  (32.93%),  then  inner 

TaMc-3 


Comparison  of  IC  and  Non-IC  Schools  by  School  Type 


School 

School 

IC 

Non-IC 

Classification 

Type 

Schools 

Schools 

Elementary  Schools  Rural 

41.07 

76.67 

Suburban 

32.14 

10.00 

Inner-City 

17.86 

13.33 

Other 

8.93 

0.00 

Middle  Schools 

Rural 

57.14 

81.82 

Suburban 

42.86 

O.OC 

Inner  city 

0.00 

18.18 

Other 

0.00 

0.00 

High  Schools 

Rural 

22.22 

75.00 

Suburban 

66.67 

15.00 

Inner-City 

11.11 

10.00 

Other 

0.00 

0.00 

Other  Schools 

Rural 

80.00 

100.00 

Suburban 

0.00 

0.00 

Inner  city 

20.00 

0.00 

Other 

0.00 

0.00 

All  Schools 

Rural 

45.12 

83.72 

Suburban 

32.93 

6.98 

Inner  City 

13.41 

9.30 

s.u 

Other 

8.54 

0.00 
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city  ( 1 3 .4 1 %),  and  finally.  Other  (8.54%).  Non-IC  schools, 
on  the  other  hand,  were  predominantly  rural  (83.7%)  with 
fewer  than  10%  describing  themselves  as  urban  (9.4%)  or 
suburban  (6.98%),  and  none  in  the  other  type.  Table  3 
presents  these  data. 

Student  Socio-Economic  Status 

Across  all  schools,  the  greatest  number  (46.77%)  de- 
scribed their  student  populations  as  primarily  low  socio-eco- 
nomic status  (SES),  the  second  largest  number  (41.94%) 
described  their  students  as  primarily  middle  SES,  while  only 
1 1 .29%  had  high  SES  students.  Among  all  Non-IC  schools, 
a much  larger  percentage  (65.96%)  described  their  students 
as  low  SES,  while  smaller  percentages  enrolled  middle 
(3  1 .91%).  and  high  (2. 1 3%)  SES  students.  Table  4 presents 
a summary  of  these  data.  It  should  be  noted  that  those  schools 
that  do  not  use  any  form  of  integrated  curriculum  are  more 
likely  to  be  populated  with  students  from  lower  socio-eco- 
nomic status  families  as  well  as  more  likely  to  be  rural. 


Table  4 

Comparison  oflC  and  non-IC  Schools  on  Socio-Economic 
Status 


School  Socio-Economic 

1C 

Non-IC 

Classification 

Status 

Schools 

Schools 

Elementary  Schools 

Low- 

45.95 

73.68 

Middle 

37.84 

26.32 

High /Affluent 

16.22 

0.00 

Middle  Schools 

Low 

42.86 

80.00 

Middle 

42.86 

20.00 

High  'Affluent 

14.29 

0.00 

High  Schools 

Low' 

44.44 

44.44 

Middle 

55.56 

44.44 

High 'Affluent 

0.00 

11.11 

Other  Schools 

Low- 

55.56 

64.29 

Middle 

44.44 

35.71 

High 'Affluent 

0.00 

0.00 

All  Schools 

Low 

46.77 

65.96 

Middle 

41.94 

31.91 

High  Affluent 

1 1.29 

2.13 

Level  of  Teacher  Involvement  with  1C 

Table  5 presents  the  numbers  of  teachers  by  school 
classification  using  integrated,  interd isc ipl inar>  or 
multidisciplinary  curriculum.  This  Table  seems  to  indicate 
that  in  schools  where  integrated  curriculum  is  used,  such 
use  is  not  confined  to  isolated  classrooms,  but  rather  is  a 
more  widely  used,  and  hence,  accepted  w ay  of  structuring 
teaching  and  learning  experiences.  For  example,  at  all  lev- 
els, more  than  fift\  percent  of  schools,  regardless  of  classifi- 
cation. report  front  2 to  10  teachers  involved  in  the  use  of 
inlegi ated  curriculum.  While  this  might  seem  discouraging 


at  first  glance,  knowing  that  a ratio  of  30  students  to  1 teacher 
is  not  uncommon  repudiates  that  impression.  When  the  data 
for  1C  schools  from  Table  1 is  taken  into  consideration,  it 
would  seem  that,  in  all  classifications  except  high  school, 
more  than  half  the  faculty  and  students  are  involved  in  the 
use  of  integrated  curriculum. 

Tables 

Percent  of  Teachers  Who  Use  Integrated  Curriculum 


Number  of 
Teachers 

2i5 

6i9 

10-14 

15-20 

21-30 

>22 

Elementary 

33.9 

19.6 

12.5 

19.6 

14.3 

Middle  School 

42.9 

14.3 

14.3 

14.3 

14.3 

High  School 

30.0 

40.0 

10.0 

20.0 

Other 

72.7 

27.3 

All  Schools 

39.3 

19.0 

13.1 

15.5 

10.7 

2.4 

Type  of  Teacher  Use 

Schools  were  queried  about  the  type  of  teacher  use  of 
integrated  curriculum.  See  Table  6.  These  data  seem  to  show' 
that  a relatively  large  percent  (69.5%)  of  teacher  involve- 
ment with  integrated  curriculum  in  Missouri  schools  is 
through  a team  approach  rather  than  use  by  individual  teach- 
ers in  isolated  classrooms.  However,  while  51.2%  of  all 
schools  report  three  or  more  teams  of  teachers  using  inte- 
grated curriculum,  this  extent  of  use  is  more  prevalent  at  the 
elementary  and  middle  school  levels,  with  61 . 1%  and  71 .4% 
respectively.  High  Schools  (70.0%)  and  other  schools 
(72.8%)  report  that  their  use  of  integrated  curriculum  in- 
volves individual  experimentation  or  only  one  or  two  teams 
involved  with  initial  experimentation  which  could  give  cre- 
dence to  an  earlier  assertion,  especially  at  the  high  school 
level,  that  a subject  centered  approach  stultifies  attempts  at 
curriculum  integration  (Beane.  1991). 

Table.  .6 

Type  of  Teacher  Involvement 

Elem  Middle  High  Other  All  Schools 

Little  awareness  or  experimentation. 

14.3%  10.0%  9.1%  3.7% 

Individual  teachers  aware/some  experimentation. 

25.9%  50.0%  27.3%  26.8% 

1-2  teams  involved  in  initial  experimentation. 

13.0%  14.3%  20.0%  45.5%  18.3% 

3 or  more  teams  use  1C  with  parts  of  some  curricular  units. 
25.9%  42.9%  10.0%  9.1%  23.2% 

3 or  more  teams  use  1C  with  more  than  one  complete  unit. 
35.2%  28  6%  10.0%  9.1%  28  0% 
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Level  of  Success  with  IC 

Principals  rated  the  level  of  success  of  their  staffs'  use 
of  integrated  curriculum.  These  ratings  were  collected  via  a 
four-point  scale  ranging  from  1 (low)  to  4 (high).  Table  7 
presents  these  mean  ratings  by  school  classification.  In  spite 
of  the  high  schools  reporting  a large  number  of  staff  using 
integrated  curriculum,  their  success  rating  is  low.  This  may 
be  due  to  the  fact  that  even  with  the  current  high  interest  in 
and  experimentation  with  block  schedules  at  the  high  school 
level,  most  high  schools  are  still  not  structured  in  ways  that 
facilitate  implementation  of  an  integrated  curriculum.  The 
prevalent  six  or  seven  period  high  school  day  in  which  stu- 
dents move  from  classroom  to  classroom  at  50-55  minute 
intervals  means  that  any  success  at  all  with  integrated  cur- 
riculum would  entail  heroic  efforts  on  the  part  of  both  staff 
and  students.  More  middle  school  principals  wrote  comments 
about  levels  of  success  than  did  principals  of  other  school 
categories.  For  example,  several  wrote  that  it  was,  Too  early 
to  determine  success  or  that  they  were,  Unsure  about  the 
criteria  for  judging  success.  These  responses  suggest  that 
perhaps  middle  level  principals  tended  to  be  a bit  more  cau- 
tious about  rating  the  level  of  success  of  their  use  of  inte- 
grated curriculum  than  did  their  colleagues  at  other  school 
levels.  Many  of  these  comments  came  from  principals  of 
schools  with  longer  histories  of  involvement  with  integrated 
curriculum. 

Table  7 

Principals'  Ratings  of  Level  of  Success  with  Use  of  Inte- 
grated Curriculum 


Mean  Elementary 

3.07 

Middle  School 

2.36 

High  School 

2.10 

Other 

2.91 

All  Schools 

2.88 

Initiation  of  Use  of  IC 

Principals  were  asked  to  describe  how  integrated  cur- 
riculum had  been  initiated  in  their  schools.  All  the  1C  schools 
reported  that  principals  or  central  office  administrators  were 
involved  at  some  level  in  large  percentages  of  the  initiation 
efforts  for  using  integrated  curriculum.  For  example,  initia- 
tion was  by  teachers  or  teams  of  teachers  and  the  principal 
in  45.7%  of  the  schools,  and  by  the  principal  in  12.3%  of  the 
schools.  Classroom  teachers  initiated  use  in  41.2%  of 
schools.  Three  1C  schools  reported  other  initiators  of  use, 
however.  One  said  that  their  school  became  involved  with 
integrated  curriculum  after  a district  cadet  teacher  introduced 
the  ideas  to  the  faculty;  one  reported  initiation  of  use  after 
the  superintendent  and  school  board  directed  them  to  begin 
use;  and  one  school  reported  that  they  initiated  use  of  inte- 
grated curriculum  as  a result  of  consortium  meetings  with 


local  college  faculty.  Among  the  elementary  schools,  prin- 
cipals were  involved  in  all  of  the  initiation  efforts. 

In  80%  of  the  schools  the  principal,  along  with  one  or 
more  teachers,  initiated  the  use  of  integrated,  interdiscipli- 
nary' or  multidisciplinary  curriculum;  in  only  20%  of  the  el- 
ementary schools  use  was  initiated  by  the  principal  alone. 
For  middle  schools  reporting  use  of  integrated  curriculum, 
principals  were  involved  in  initiation  efforts  with  one  or  more 
teachers  in  most  of  the  schools  (62.5%).  In  12.5%  of  the 
schools,  the  principal  initiated  the  use.  In  one  case,  this  ini- 
tiation occurred  after  the  principal  attended  several  state 
department  meetings  where  integration  was  being  encour- 
aged. Classroom  teachers  initiated  the  use  of  integrated  cur- 
riculum in  25%  of  the  middle  schools.  From  analysis  of  the 
total  sample  of  IC  schools,  the  following  patterns  appear  to 
be  emerging.  For  example,  elementary  and  middle  schools 
reported  that  principals  were  highly  involved  in  initiation  of 
use  efforts,  while  high  schools  and  other  schools  reported 
dramatically  less  involvement  by  the  principal  in  initiation 
efforts.  Teachers  appear  to  be  the  initiators  of  curriculum 
integration  efforts  without  the  involvement  of  principals  in 
increasing  numbers  as  we  look  at  schools  from  the  elemen- 
tary' to  high  or  other  classifications  of  schools. 

Support  Mechanisms  for  Use  of  IC 

Principals  were  asked  to  describe  the  methods  they 
used  to  support  integrated,  interdisciplinary,  or 
multidisciplinary  curriculum.  These  data  show  that  in  addi- 
tion to  the  expected  support  mechanisms  in  use  by  princi- 
pals (i.e.,  common  planning  time,  staff  development,  and 
material  resources),  several  less  frequently  reported  support 
mechanisms  were  also  being  used.  For  example,  policy 
statements  about  integrating  curriculum  and  instruction,  and 
initiation  and  encouragement  of  continuous  dialogue  about 
student  learning.  More  specifically,  among  all  1C  schools, 
principals  reported  the  following  support  mechanisms:  fre- 
quent classroom  visits,  observations  of  classes,  supportive 
conferences  with  teachers,  listening  to  their  success  stories 
and  problems,  provision  of  instructional  materials  and  sup- 
plies, scheduling  faculty  meetings  for  teacher  sharing  and 
problem-solving,  cross-referencing  Missouri  Mastery 
Achievement  Test  (MMAT)  objectives  with  units  as  they 
are  being  developed,  use  of  outside  consultants  to  help  in 
developing  curriculum  units,  participation  in  a research  group 
with  a nearby  university,  forming  a partnership  with  another 
school  to  establish  a focus  committee  for  curriculum  inte- 
gration, establishing  dialogue  structures  (e.g.,  study  teams, 
informal  forums,  etc.)  to  ensure  faculty  talk  about  learning, 
and  encouragement  of  teacher  use  of  whole  language  as  a 
vehicle  for  integration  and  of  cooperative  learning  as  an  in- 
structional model  that  facilitates  integration. 

Principals  also  reported  staff  development  on  integra- 
tive techniques,  common  planning  times  within  the  work 
day.  encouragement  of  interdisciplinary  teams,  promoting 
discussion  of  means  and  ideas  at  tegularK  scheduled  meet- 
ings (twice  per  month),  encouraging  innovative  thinking. 
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adopting  policy  statements  supportive  of  integrated  curricu- 
lum, and  establishing  an  acceptance  of  experimentation 
within  the  school  culture  as  ways  of  supporting  the  use  of 
integrated  curriculum.  Middle  school  principals  also  reported 
establishing  supplemental  team  planning  times,  block  sched- 
uling, and  teacher  involvement  in  shared  decision  making 
as  support  mechanisms  for  integrated  curriculum.  High 
school  principals  also  reported  encouragement  of  department 
chairs  to  plan  discussions  about  integrated  curriculum  at  de- 
partment meetings,  consideration  and  adoption  of  8-block 
schedules,  and  informal  promotion  of  the  idea(s)  during  staff 
evaluation  conferences  as  mechanisms  used  to  initiate  inte- 
grated curriculum. 

Teacher  Involvement  in  Building  Decisions 

Considerable  research  shows  that  the  amount  and  type 
of  teacher  involvement  in  decisions  at  the  building  level  can 
be  used  as  an  indicator  of  teacher  empowerment,  and  hence,' 
may  serve  as  a proxy  measure  of  the  progress  of  efforts  to 
implement  innovations  such  as  integrated  curriculum  (e.g., 
Husband  & Short,  1994;  Valentine  et  al.,  1993).  In  order  to 
ascertain  the  type  and  level  of  teacher  involvement  in  deci- 
sion making  processes  in  IC  schools  and  Non-lC  schools, 
principals  were  asked  to  categorize  the  nature  of  teacher  in- 
volvement on  sixteen  items  representing  seven  categories 
believed  by  the  researchers  to  be  important.  Principals  the 
level  and  type  of  teacher  involvement  in  these  decisions  by 
responding  to  a five-point  Likert-type  scale.  Mean  responses 
for  each  of  the  16  items  for  both  1C  schools  and  Non-lC 
schools  were  calculated  and  an  analysis  of  variance  was  used 
to  determine  the  significance  of  differences  between  means 
across  all  schools.  Seven  of  the  16  items  yielded  significant 
differences  between  means  across  ail  schools.  See  Table  8. 
Principal  responses  to  this  series  of  items  indicate  that  teach- 
ers appear  to  be  more  involved  in  building  decisions  in 
schools  that  use  integrated,  interdisciplinary,  or 
multidisciplinary  curriculum  than  they  are  in  Non-lC  schools. 

Table..? 


A Comparison  of  Differences  Between  Mean  Responses 
of  IC  Schools  and  Non-IC  Schools  on  Teacher  Involve- 
ment in  Decision  Making 


Mean  Item 

User 

Non-User 

■ F 

Selection  of  support  staff. 

2.167 

1.435 

1 3.384** 

Selection  of  teaching  staff. 

2.154 

1.557 

9.230*** 

Evaluation  of  support  staff. 

1.582 

1.287 

3.761* 

Budget  development 

at  the  building  level. 

2.455 

1.931 

4.946** 

Budget  allocation 

at  the  building  level. 

2.169 

1.557 

8.938*** 

Staff  development  content. 

4.141 

3.871 

2.867* 

Staff  development  format. 

4.091 

3.667 

6.082** 

Discussion,  Implications,  and  Conclusions 

This  study  presents  the  results  of  the  first  phase  of  a 
broad-based  research  effort  being  conducted  by  researchers 
at  the  University  of  Missouri-Columbia.  These  data  seem  to 
indicate  that  in  schools  where  an  integrated  approach  is  used, 
such  use  is  not  confined  to  isolated  classrooms,  but  rather  is 
a more  widely  used,  and  hence,  accepted  way  of  structuring 
teaching  and  learning  experiences.  Teachers  in  schools  that 
use  integrated  curriculum  tend  to  have  greater  involvement 
in  decision  processes  than  do  teachers  in  Non-lC  schools. 
Information  about  the  initiation  of  use  of  integrated  curricu- 
lum and  about  support  mechanisms  consciously  developed 
and  used  by  principals  are  also  reported. 

The  base-line  data  reported  in  this  paper  are  important 
to  the  development  of  both  regional  and  state  policy  regard- 
ing integrated  curriculum.  Given  that  the  state  of  Missouri, 
like  neighboring  states,  is  currently  in  the  process  of  devel- 
oping curriculum  frameworks,  and  that  these  curriculum 
frameworks  emphasize  integrated  or  interdisciplinary  cur- 
riculum. reports  describing  current  conditions  and  practices 
should  assist  policy  makers  as  well  as  practitioners  seeking 
guidance  for  future  actions  regarding  use  of  integrated  cur- 
riculum in  the  schools.  Non-IC  schools  are  mainly  rural 
(83.7%)  and  have  student  populations  with  large  numbers 
of  low  SES  students  (65.96%).  This  may  be  attributable  to 
the  fact  that  in  rural  areas  school  leaders  are  subjected  to 
less  pressure  from  parents  and  community  members  to  adopt 
innovations  that  may  be  readily  accepted  and  adopted  in 
suburban  or  urban  schools.  This  highly  rural  nature  of  the 
Non-IC  schools  may  also  reflect  the  fact  that  staff  develop- 
ment is  simply  less  available  to  school  staff  in  rural  areas. 
But,  for  whatever  reason,  given  the  high  percentage  of  rural 
and  low  SES  schools  that  are  NOT  involved  with  any  type 
of  integrated  curriculum,  policy  maker  attention  should  be 
drawn  to  the  potential  requirement  for  provision  of  special 
assistance  to  these  types  of  schools  if  they  are  expected  to  be 
successful  in  implementing  the  newer  research  on  teaching 
learning. 

References 

Beane  ,J.  A..  (1991).  The  middle  school:  The  natural 
home  of  integrated  curriculum.  Educational  Leadership , 
49(2),  9-13. 

Beane,  J.  A.  (1993).  Problems  and  possibilities  for 
an  integrative  curriculum.  Middle  School  Journal , 25(1), 
18-23. 

Bcreiter,  C.,  & Scardamalia,  M.  (1985).  Cognitive 
coping  strategies  and  the  problem  of  inert  knowledge.  In  S. 
S.  Chipman,  j,  W.  Segal,  and  R.  Glazer  (Eds.),  Thinkingand 
learning  skills:  t'ol.  2.  Current  research  and  open  ques- 
tions (pp.  65  - 80).  Hillsdale,  NJ:  Erlbaum. 

continued  un  page  44 


*p<.10 


**p<.05 


***p<.005 


****p<.000l 


S37 


Voices  in  Education 


Marlene  Schommer,  Wichita  State  University 


Veteran  leaders  of  education,  as  well  as  some  new  leaders \ were  directly  asked  by  the  author  to  respond 
to  the  following  two  questions.  Their  Reaction  and  Impact  estimates  are  summarized  below.  The  " leader " 
is  ident  ified  at  the  end  of  the  responses. 

1.  a.  What  are  the  two  most  critical  issues  in  K-  12  education  that  should  be 
addressed  in  the  next  five  years? 

b . Why  do  you  think  they  are  the  most  critical? 


"In  educational  research,  the  greatest  crisis  we  have  is 
our  current  ignoring  of  intelligence  (or  g).  Especially  this  is 
true  for  school  learning  from  k to  12th  grade.  Ignoring  in- 
telligence, we  are  suppressing  the  idea  of  readiness.  We 
are  collapsing  tracking  and  ability  grouping,  and  programs 
for  the  gifted  and  retarded.  Pretending  that  intelligence  does 
not  exist  changes  not  one  thing  about  its  underlying  impor- 
tance and  explanatory  power.” 

Ellis  B.  Page 
Duke  University 
Durham,  North  Carolina 


"Continued  inequality  in  schools  and  the  notion  of 
the  standards  as  panacea  in  education." 

“The  biggest  societal  problems  we  face  are  those  stem- 
ming from  inequalities,  and  schools  are  reflective  of  these 
societal  shortcomings.  Certainly  there  are  blatant  shortcom- 
ings in  most  urban  schools  regarding  basic  equipment,  cur- 
ricular innovation  and  adequate  facilities.  Vouchers  have 
been  trumpeted  as  a solution  to  these  problems,  but  in  actu- 
ality are  only  advantageous  for  middle  or  upper  class  par- 
ents and  students.  Though  city  schools  may  in  some  in- 
stances have  more  per  pupil  expenditures,  that  money  is  not 
being  spent  on  teaching  and  learning  so  much  as  on  admin- 
istration and  compliance. 

Mo.Jty  is  clearly  the  key  to  eradicating  inequalities 
in  schools,  but  money  well  spent.  In  addition,  there  must  be 
changes/demands  that  poorer  students  economically  (dis- 
proportionately students  of  color)  are  not  consigned  to  poorer 
teachers  and  lower  expectations.  Teacher-led  curricular 
change  cannot  only  go  on  in  suburban  schools.  Urban  teach- 
ers need  support  and  training  to  shape  programs  for  their 
students.  These  needed  innovations  require  financial,  com- 
munity and  administrative  support,  yet  these  are  being  un- 
dermined by  the  other  current  panacea — the  national  stan- 
dards movement.  There  arc  few  positives  that  can  outweigh 
the  negatives  of  this—  the  money,  time  and  effort  expended, 


the  logical  next  step  of  a national  curriculum,  and  the  ero- 
sion of  support  for  teacher  professional  abilities.  It  is  unfor- 
tunate that  the  Clinton  agenda  has  merely  extended  the  Bush 
agenda.  The  knee-jerk  response  to  lower  standardized  test 
scores,  unflattering  international  comparisons,  and  a “newly 
discovered''  ignorant  public  is  to  impose  standards  without 
examining  the  substance  of  the  claims  of  educational  short- 
comings." 

Murry  R.  Nelson 

The  Pennsylvania  State  University 

University  Park,  Pennsylvania 


“ In  iny  opinion,  the  two  most  pressing  problems  we 
face  in  education  today  are  directly  related  to  one  another. 
Many  teachers  lack  a clear  and  appropriate  vision  of  the 
meaning  of  academic  success  in  their  classrooms  because  of 
a lack  of  preparation  with  respect  to  the  important  achieve- 
ment targets.  And  for  this  and  other  reasons,  we  are  a na- 
tional faculty  that  is  unable  to  develop  or  implement  quality 
assessments  of  student  achievement  in  our  classrooms  on  a 
day-to-day  basis.  As  a result,  instruction  is  carried  out  in  the 
absence  of  dependable  information  about  student  needs  and 
communication  about  student  achievement  often  arises  from 
inaccurate  assessments  of  that  achievement.  We  are  a na- 
tional faculty,  administrative  staff  and  policy-setting  team 
unschooled  in  the  basic  principles  of  sound  assessments,  and 
students  suffer  great  harm  as  a direct  result  of  this  huge 
gap  in  our  collective  professional  competence." 

Richard  J.  Stiggins,  Director 
Assessment  Training  Institute 
Portland,  Oregon 


‘Two  important  issues  are  high-stakes  testing  and  in- 
equalities in  opportunity  to  learn.  Testing  concerns  me  for  a 
number  of  reasons:  restricted  paper-and-pencil  measures  that 
are  heavily  biased  toward  linguistic  and  logical  performance; 
imposition  of  measures  from  outside  the  classroom;  and, 
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perhaps  worst  of  all,  the  widespread  belief  among  teachers 
that  their  own  judgments  about  student  performance  are  less 
trustworthy  than  test  results.  As  regards  inequalities,  the 
disparity  in  per-pupil  expenditures  between  most  large, 
urban  districts  and  most  small,  suburban  ones  is  shocking. 
Jonathan  Kozol  calls  this  phenomenon  ‘rigging  the  game.’  “ 
Ruth  Gamer 

Washington  State  University 
Vancouver,  Washington 


"The  most  critical  issue  is  turning  schooling  into  edu- 
cation at  any  level  and  in  any  culture,  however  segmented." 

"Because  creativity  is  the  quality  which  will  facilitate 
the  ongoing  transmutation  of  consciousness  from  confor- 
mity into  developed  self-awareness." 

David  Tiedeman 

Vista,  California 


“The  two  most  critical  issues  facing  educators  are 
implementing  student-centered  instruction  and  giving  stu- 
dents access  to  new  technologies,  regardless  of  whether  they 
attend  large  urban  schools,  or  small  well-financed  suburban 
ones.  Most  technology  is  not  value-neutral,  and  like  other 
tools  of  educators  (e.g.,  activities,  curricula,  and  teaching 
environments)  can  elicit  hot  emotions.  Hot  emotions  toward 
technology,  for  instance,  may  be  the  initial  gatekeeper  of 
change  in  educational  environments.  For  those  teachers  who 
believe  technology  is  desirable,  that  belief  can  be  an  induce- 
ment to  try  new  teaching  strategies,  but  for  those  who  have 
negative  beliefs,  teachers  may  avoid  even  cursory  engage- 
ment of  technology.” 

Mark  Gillingham 
Washington  State  University 
Vancouver,  Washington 


"Two  factors  impede  all  educational  reform  efforts. 
First,  many  parents  have  abdicated  their  responsibility  for 
oversight  of  their  children’s  education.  Thus,  children  are 
often  loners  in  an  educational  system  that  cannot  express 
the  love,  concern,  and  direction  that  only  parents  can  pro- 
vide. This  is  not  the  fault  of  the  educational  system;  gov- 
ernmental bureaucracies  are  not  established  to  impart  per- 
sonal love,  concern,  or  direction;  but  to  provide  a fairly  ho- 
mogeneous service  to  a diverse  population.  It  is  the  fault 
of  parents;  it  is  parents  who  must  reclaim  an  educational 
vision  as  a mandator)’  aspect  of  rearing  children.  Parents  can 
and — if  any  reform  is  to  be  successful — must  assume  more 
responsibility  for  taking  what  schools  can  provide  and 
ensuring  that  the  results  arc  maximized  in  their  children's 
best  interests. 

The  second  critical  issue  that  must  be  addressed  is 
nested  within  the  first.  That  is,  even  if  parents  assume 


greater  responsibility  for  the  education  of  their  children,  their 
actions  will  lack  efficacy  if  they  must  be  embedded  in 
the  current  educational  system.  Thus,  a critical  issue  for 
reform  over  the  next  five  years  is  the  ability  of  the  educa- 
tional system  to  reform  tself.  That  may  be  an  unreasonable 
outcome  to  expect,  given  the  constraints  within  which  teach- 
ers must  currently  practice.  The  stifling  of  creativity  through 
the  frowning  upon  risk,  the  overwhelming  burdens  of 
bureaucratic  regulations,  the  constraining  context  of  union- 
ization, the  propensity  of  bureaucracies  to  serve  their  own 
interests  first;  all  of  these  elements  work  against  the  current 
system  being  able  to  induce  many  students  to  high 
accomplishment,  much  less  everyone  to  excellence. 

There  are  emerging  models  that  aspire  to  mitigate  these 
influences;  the  innovative  vision  of  the  Edison  Project  schools 
comes  to  mind  as  one  example.  For  real  educational  re- 
form— not  cosmetic  reform — to  take  place,  this  kind  cf  vi- 
sion must  catch  the  attention  of  teachers,  administrators, 
and  parents  on  a broad  scale.” 

Gregory  J.  Cizek 
The  University  of  Toledo 
Toledo,  Ohio 


"Developing  interprofessional  support  systems  for  stu- 
dents in  our  schools.  Evidence  abounds  that  support  pro- 
vided to  young  people  by  traditional  families  is  becoming 
more  the  exception  than  the  rule.  Violence  at  home,  eco- 
nomic deprivation,  contact  with  drug  users,  unsafe  neigh- 
borhoods, gang-related  activity,  and  nutritional  problems 
challenge  increasing  numbers  of  children.  When  these  young 
people  come  to  school,  they  bring  with  them  problems  go- 
ing well  beyond  the  service  capacity  of  traditionally  trained 
school  professionals.  It  is  critical  that  the  notion  of  the  full 
social  service  school  move  beyond  glitzy  discussions  at 
national  professional  meetings  to  a model  that  is  widely 
implemented.  Absent  a sea  change  in  the  daunting  array  of 
social  problems  facing  young  people  today,  tomorrow’s 
learners  must  be  provided  with  opportunities  to  experience 
education  in  a setting  that  attends,  at  once,  to  physical  health, 
mental  health,  personal  safety,  and  traditional  learning 
needs.” 

"The  middle  class  must  be  convinced  that  public 
schools  are  serving  its  children  well.  Over  a decade  of  nega- 
tive press  regarding  the  quality  of  the  nation’s  schools  has 
begun  to  undermine  the  traditional  confidence  of  the  middle 
class  in  public  education  as  the  bridge  to  a “better  life”  for 
its  daughters  and  sons.  Unless  this  trend  is  reversed,  broad- 
based  political  support  for  public  education  may  erode  . . . 
an  eventuality  certain  to  reduce  funding  levels  and  to  result 
in  poorer  school  quality  than  we  have  today.  In  time,  the 
public  schools  could  end  up  providing  highly  mediocre  ser- 
vices to  children  of  those  families  too  poor  to  opt  out  of  the 
public  system.  This  would  be  a terrible  blow  for  a system  of 
public  schools  that,  historically,  has  both  educated  large 
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numbers  of  people  well  and  served  as  a useful  “social  glue" 
that  has  bonded  Americans,  regardless  of  social  class,  in  a 
common  set  of  shared  experiences." 

David  G.  Armstrong 
Texas  A&M  University 
College  Station,  Texas 


"While  there  is  much  rote  learning  in  schools  through- 
out the  world,  in  some  countries  I find  great  emphasis  on 
problem  solving,  applications  of  principles,  analytical  skills, 
and  creativity.  Such  higher  mental  processes  are  emphasized 
because  it  is  believed  that  they  enable  students  to  relate  their 
learning  to  the  many  problems  encountered  in  day-to-day 
living.  These  abilities,  which  are  retained  and  used  long 
after  the  individual  has  forgotten  the  specifics  of  the  sub- 
ject-matter taught  in  the  schools,  are  regarded  as  essential 
characteristics  needed  to  continue  learning  and  to  cope  with 
a rapidly  changing  world.  Some  also  believe  that  higher 
mental  processes  are  important  because  they  make  learning 
exciting. 

In  these  countries,  subjects  are  taught  as  methods  of 
inquiry  into  the  nature  of  science,  mathematics,  the  arts,  and 
the  social  sciences.  These  subjects  are  taught  as  much  for 
the  ways  of  thinking  they  represent  as  for  their  traditional 
content.  Much  of  this  learning  makes  use  of  observa- 
tions, reflections  on  observations,  experimentation  with  phe- 
nomena, and  the  use  of  firsthand  data  and  daily  experi- 
ences as  well  as  primary  printed  sources.  All  of  this  is  re- 
flected in  the  materials  of  instruction,  the  learning  and  teach- 
ing processes  used,  the  questions  and  problems  used  in 
quizzes,  formative  testing,  and  final  summativ.e  evaluation. 

In  sharp  contrast  to  these  teaching  methods,  teachers 
in  the  U.S.  use  textbooks  that  rarely  pose  real  problems.  The 
textbooks  emphasize  specific  content  to  be  remembered,  and 
give  students  little  opportunity  to  discover  underlying  con- 
cepts and  principles,  and  even  less  opportunity  to  attack 
real  problems  in  their  environment. 

1 believe  that  the  higher  mental  processes  should  be 
taught  as  early  as  the  first  grade,  where  ideas  can  be  related 
to  day-to-day  situations  in  the  lives  of  the  children.  Even  at 
that  level,  the  higher  mental  processes  can  make  learning 
exciting,  constantly  new,  even  playful." 

Benjamin  Bloom 

The  University  of  Chicago 
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Assessing  Understanding 

continued  from  page  14 

ability  to  make  inferences,  understand  consequent 
events,  recognize  novel  instances,  and  detect  gross  errors 
are  necessary  for  transfer  of  learning,  critical  thinking  and 
problem  solving  by  adults  (Wilson,  1987).  More  research  is 
needed  to  see  if  children  comprehenders  have  similar  abili- 
ties. 
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GENERAL  INFORMATION 


Registration:  Everyone  participating  in  or  attending  the 
MWERA  annual  meeting  must  be  registered.  Those  planning  to 
attend  are  encouraged  to  pre-register  for  the  conference, 
workshops,  and  to  make  hotel  reservations  as  soon  as  possible 
(pre-registration  and  hotel  reservations  must  be  received 
by  September  10, 1006).  Registrations  mailed  after  Sept  1 0 
may  not  be  received  in  time  for  processing,  and  on-site  payment 

in.ttig.fcrm  of  aah .or,  osmnsLsiissks. MJ&s&sz if 
double  peyment  is  later  determined,  a refund  wW  be  issued.  On- 
site registration  snd  packet  pick-up  win  be  available  on  the  14th 
Floor  of  the  Holiday  Inn  Mart  Plaza  at  the  following  times: 

Wednesday,  Oct  2, 1 1 :00  a.m.-  4:00  p.m. 

Thursday,  Oct  3, 8:00  a.m.  - 4:00  p.m. 

Friday,  Oct  4,  8:00  a.m.  - 4:00  p.m. 

Name  tags  should  be  worn  to  an  sessions  (including 
workshops)  and  must  be  worn  for  admission  to  the  conference 
luncheon  on  Friday. 

Membership  provides  reduced  conference  registration  fees  and 
s subscription  to  the  MWERA  official  publication,  the  Mid- 
Western  Educational  Researcher.  Those  attending  the 
conference  are  encouraged  to  join.  Conference  presenters 
must  be  paid  members  for  1996. 

Selected  MWERA  publications  are  available  through  pre- 
registration. These  include  the  Directory  of  MWERA  members 
for  $7,  the  MWERA  1996  Meeting  Abstracts  for  $4  paper,  and 
$3  IBM  computer  disk.  These  publications  may  not  be  available 
at  the  conference  unless  ordered  through  pre-registration.  If 
they  are  available  at  registration,  cash  or  checks  will  be 
accepted. 

MWERA  lapel  pins  are  available  again  this  year.  The  pins  are 
your  way  to  show  others  that  you  support  MWERA,  and  they 
add  to  your  attire.  These  stylish  pins  were  made  available  to  us 
at  a special  discount,  snd  we  have  passed  along  that  discount  to 
you. 

This  year’s  Exhibit  Hall  will  feature  publishers  and  others 
providing  materials  and  services  to  educators  on  Friday,  in  the 
14th  Floor  Lobby  West  We  have  added  a sharing  table  for  you 
to  bring  job  announcements,  W-out  mentor  forms,  and  share 
other  information  which  he'.pe  aU  of  us.  Plan  on  stopping  by 
between  9 am  and  4 pm. 


EVENTS  AND  HIGHLIGHTS 


Dr.  Herbert  Walberg  will  be  the  featured  speaker  during  our 
Wednesday  evening  session  (Session  12).  Dr.  Walberg  will  be 
presenting  his  recent  research  in  a session  entitled, 

■Perspectives  on  Educational  Productivity."  Dr.  Carolyn  Evertson 
wiH  join  In  sn  Informal  discussion.  You  may  join  this  conversation 
Wednesday  evening  from  8:00  until  10:00  p.m.  In  the 
Sauganash  Ballroom  East 


New  Member  Welcome  takes  place  from  8:00  to  8:50  a.m. 
Thursday  in  the  Steamboat  Hotel  (Session  14).  Connie 
Bowman,  will  chair  this  informal  session.  Ail  MWERA  members 
and  conference  participants  are  welcome. 

Division  Meetings  will  be  held  from  9:00  until  9:50  a.m.  on 
Thursday  morning  (Session  15).  All  MWERA  members  are 
encouraged  to  attend  as  plans  are  made  for  the  1997 
conference. 

Dr.  Carolyn  Evertson  win  present  our  keynote  address  from 
1 0:00  to  1 1 :00  a.m.  on  Thursday  in  the  Sauganash  Ballroom 
East  (Session  16).  Dr.  Evertson’s  address  is  entitled,  “What 
Does  It  Mean  To  'Teach  for  Understanding?' " 

New  editors  of  the  Mid-Western  Educational  Researcher, 
Deborah  Bainer,  Gene  Kramer,  and  Richard  Smith,  wiN  hold  a 
“Meet  the  Editors”  session  on  Thursday  from  3:00  to  4:20  p.m. 
in  the  Mansion  House  (Session  33).  Those  interested  in  learning 
about  publishing  opportunities  are  encouraged  to  attend. 


The  Cracker  Barrel  Social  win  take  place  from  5:00  to  7:00 
p.m.  Thursday  in  Button's,  a private  room  off  of  Mad  Anthony's 
Lounge  on  the  15th  floor  (Session  41).  This  informal  event 
offers  a chance  to  relax,  mix,  and  mingle.  A cash  bar  wiH  be 
provided. 

MWERA  General  Business  Meeting  will  be  held  from  8:00  to 
9:20  a.m.  on  Friday  in  the  Sauganash  Ballroom  East  (Session 
42).  Ail  MWERA  members  are  urged  to  attend. 

Dr.  Mary  Kennedy  will  be  the  featured  speaker  at  the 
conference  luncheon  Friday  in  the  Sauganash  Ballroom  East 
from  11:00  a.m.  to  1:20  p.m,  (Session  53).  Dr.  Kennedy's 
address,  "Stability  and  Change  in  Education,"  wiH  examine 
developments  and  trends  in  educational  research.  The 
luncheon  is  free  to  ali  paid  conference  attendees. 

President  Greg  Marchant  will  host  the  President's  Reception 
on  Friday  evening  from  9:00  p.m.  to  midnight  in  the  Wolf  Point 
GriH  on  the  15th  Floor  (Session  72).  This  year’s  reception  will 
feature  a theme  (“Parrot  HeadVJimmy  Buffett),  so  come  and 
enjoy  the  fun.  Beer,  wine,  soft  drinks,  and  complimentary  hors 
d'oeuvres  wiH  be  served. 

The  MWERA  Conference  Program  Committee  will  meet  with 
Vice-President  Kim  Metcalf  and  Vice-President  Elect  Tom  Parish 
on  Saturday  from  8:00  to  9:20  a.m.  (Session  73).  All  program 
chairs  and  co-chairs  are  encouraged  to  attend  and  discuss  the 
1996  conference  and  make  plans  for  the  1997  conference. 

Greg  Marchant  will  make  his  Presidential  Address  on  Saturday 
morning  from  9:30  to  10:50  a.m.  in  the  Steamboat  Hotel 
(Session  81).  Dr.  Marchant  wiH  be  discussing  issues  and 
obstacles  for  teacher  education  in  his  address  entitled,  "Top  Ten 
Problems  in  Teacher  Education." 


MWERA  Association  Council  wiH  meet  from  8:00  to  9:50  a.m. 
on  Thursday  morning  In  the  Western  Stage  I louse  (Session  13). 
AN  Association  Council  members  are  urged  to  attend. 
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Getting  to  the  Conference 
Holiday  Inn  Mart  Plaza 
350  North  Orleans  Street 
Chicago,  Illinois  60654 
(312)  836-5000 


1.  Take  a CTA  train  to  downtown  for  about  $1.50.  Catch  the 
train  in  the  basement  of  Terminal  3.  Take  an  A or  B Line.  Get  off 
at  the  Clark/Lake  station.  Transfer  to  the  Brown  Line 
(Ravenswood),  and  take  this  to  the  Merchandise  Mart 

2.  Take  the  Continental  Airport  Bus  for  $13.50  one  way  or 
$25.00  round-trip.  No  reservations  are  required  from  the  airport 
See  the  agent  at  the  booth  in  the  lower  level  baggage  claim  area. 

3.  Take  a cab  for  around  $28.00  one-way.  Wait  in  the  cab  stand 
area.  In  off-hours  a ride  takes  about  30  minutes.  In  rush  hours 
(7-10:00  a.m.,  3-7:00  p.m.)  the  ride  could  take  an  hour  or  more. 
Tips  average  15-20%. 


1.  Take  a CTA  train  to  downtown  for  about  $1 .50.  Catch  the 
train  at  the  east  end  of  the  airport  Get  off  at  the  Clark/Lake 
station.  Transfer  to  the  Brown  Line  (Ravenswood),  and  take  this 
to  the  Merchandise  Mart. 

2.  Take  a Continental  Airport  Bus  for  $1 1 .50  one-way  or 
$19.50  round  trip.  No  reservations  are  required  from  the  airport 
See  the  agent  at  the  booth  for  tickets. 

3.  Take  a cab  for  around  $25.00  one-way.  See  O'Hare 
information  above  regarding  time. 
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1.  From  the  South,  East,  or  West:  Take  1-90/94  (Dan  Ryan). 
Exit  at  Washington  Street  East  (Exit  51C),  turn  right  on 
Washington.  Go  to  Wacker  Drive  and  turn  left.  Make  another  left 
at  Orleans  Street  and  cross  over  bridge.  The  hotel  is  on  the  left- 
hand  side. 


MrtORMK  k 
I 1 i 


2.  From  1-88: 1-88  connects  to  290  (Eisenhower).  Exit  at  Franklin 
Street.  FoHow  Franklin  until  it  turns  into  Orleans  Street  (just  over 
the  river).  The  hotel « on  the  left-hand  side. 

3.  From  the  North,  1-90/94  (Kennedy  Expressway):  Exit  at 
Ohio  Street  Go  to  WeHs  Street  (3rd  light).  Turn  right,  cross  the 
river  and  turn  right  on  Wacker  Drive.  Go  1 block,  turn  right  on 
Orleans,  and  cross  bridge.  The  hotel  is  on  the  left-hand  side. 


The  Holiday  Inn  Mart  Plaza  sits  atop  The  Apparel  Center. 
Take  the  elevators  on  the  first  floor  of  The  Apparel  Center  to 
the  15th  Floor  Hotel  Lobby. 
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Wednesday  October  2, 1996 

Conference  Registration 
11:00  ajn.  - 4:00  p.m. 
14th  Floor,  East  Lobby 

WORKSHOP  SESSIONS 

12:00  p.m.  -5:00  p.m. 

Session  1 

Western  Stage 

12:00-3:00 
(Fee:  $5) 

How  Do  We  Assess  Inquiry-Based  Science 
Education? 

This  workshop  provides  hands-on  experience  and 
guidance  in  using  authentic  assessment  techniques  in 
science.  Participants  wi id  also  learn  how  to  use  a newly 
developed  CD-ROM  computer  package  which  simulates 
scientific  discovery  in  seven  environmental  settings. 

Isadore  Newman,  University  of  Akron\ 
John  Hirechbuhl,  University  of  Akron ; 
Rowena  Hubler,  Ohio  Department  of 
Education ; Jim  Jackson,  University  of 
Akron ; Kathy  Sparrow,  Akron  Public 
Schools 

Session  2 

Mansion  House 

12:00-3:00 
(Fee:  $5) 

Process  and  Framework  for  Developing  Innovative 
Teacher  Education  Programs 

This  hands-on  workshop  will  guide  participants  in 
beginning  the  process  of  developing  innovative  teacher 
preparation  programs.  Participants  will  be  helped  to  create 
a framework  for  such  development,  concrete  ideas  on  how 
to  continue,  and  a continuing  support  system. 

Kenneth  Addison,  Beverty  Otto,  Vivian 
Walkosz,  Sharon  McNeefy,  Janet 
Fredericks,  Patricia  Schutt,  Joanne  Frey, 
Edward  Odisho,  Janet  Bercik, 
Northeastern  Illinois  University 

Session  3 

Bull’s  Head  Room 

12:00-3:00 
(Fee:  $15) 

What’s  New  In  Multiple  Comparison  Procedures 
The  main  purpose  of  this  workshop  is  to  introduce 
educational  researchers  to  new  developments  in  multiple 
comparison  procedures  (MCPs).  All  presentations  and 
examples  will  be  provided  in  a notebook  which  will  include 
a diskette  containing  the  computer  programs. 

Robert  Barcikowski,  Elizabeth 
Randolph,  Ronald  Elliott,  Suzy  Green, 
George  Johanson,  Ohio  University 

Session  4 

Lake  House 

12:00-4:00 
(Fee:  $10) 

Introduction  to  Structural  Equation  Modeling  (SEM) 
with  Amos 

Th*  workshop  win  provide  an  introduction  to  SEM  in  the 
Windows  environment.  Modern  advances  in  structural 
modeling  and  statistical  methods  win  be  presented  with  fully 
documented  examples  distributed  as  handouts  and  on 
diskette.  Some  experience  in  multiple  regression  or  factor 
analysis  is  recommended. 

Werner  Wothke,  SmallWaters,  Inc. 

Session  5 

Columbian  House 

1:00-2:30 
(No  Charge) 

Children  In  Stress  and  the  Adults  Who  Care  for  Them 
This  workshop  is  intended  for  those  who  work  with  children 
and  their  parents.  Participants  will  learn  about  the  nature  of 
stress  in  children's  lives,  how  to  identify  common  stressors 
and  signs  of  stress,  methods  of  helping  children  cope  with 
stress,  and  available  resources. 

Usa  Cutter,  Mary  McMullen,  Indiana 
University 

Session  6 

Fork's  House 

1:00-4:00 
(Fee:  $5) 

Making  Math  Multicultural  Using  the  Computer  as  a 
Tool 

The  objective  of  this  workshop  is  to  provide  educators  with 
methods  of  using  the  computer  and  math  concepts  to  help 
children  appreciate  cultural  differences.  Hands-on 
problem-solving  activities  and  handouts  will  be  used. 
Participants  may  bring  a diskette  for  copying  programs. 

Mian  Muhammad  Yusuf,  Weber  Stete 
University 

Session  7 

American  House 

1:00-4:00 
(No  Charge) 

A Five-Point  Framework  for  Setting  Up  Instruction  to 
Meet  Student  Learning  Styles 
The  workshop  wiN  include  a variety  of  activities  to  help 
participants  learn  more  about  their  own  and  their  students' 
learning  stylet,  Implications  of  learning  style  for  instruction, 
and  axampiee  of  how  the  five-point  framework  can  be  used 
to  design  more  effective  instruction. 

Tim  Green,  Indiana  University,  William 
Green,  Andrews  University 

sio 
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WORKSHOP  SESSIONS 

12:00  p.m.  • 5:00  p.m. 

Session  8 

Columbian  House 

2:45-3:30 
(Fee:  $10) 

Understanding  the  World  Wide  Web-Search 
Engines  and  Indexes 

This  workshop  is  intended  to  provide  education 
professionals  with  an  overview  of  the  World  Wide  Web. 
Participants  win  learn  how  the  World  Wide  Web  works 
and  how  to  use  Web-based  search  engines  and  search 
indexes  to  find  specific  information. 

Abbie  Howard  Brown,  Indiana  University 

Session  9 

Mansion  House 

3:30  - 5:00 
(No  Charge) 

Designing  and  Implementing  a New  Teacher 
Education  Program:  University-Based  and  School- 
Based 

This  workshop  is  designed  to  provide  participants  with  a 
realistic  view  of  what  can  be  achieved  with  a limited 
budget  to  provide  support  for  new  and  beginning 
teachers.  Specific  examples  and  techniques  win  be 
provided. 

Janet  Berdk,  Northeastern  Illinois 
University,  Judith  Henning,  East  Maine 
School  District  63  (IL) 

Session  10 

Bull’s  Head  Room 

3:30  - 5:00 
(No  Charge) 

“Clustering”:  A Tool  in  Creative  Writing;  A Power 
Tool  in  Research 

This  workshop  win  provide  participants  the  opportunity  to 
explore  “clustering*  as  a possible  interview  tool  for 
conducting  their  research.  Its  purpose  is  to  introduce  the 
"clustering'  technique,  demonstrate  its  application  in  data 
collection,  and  to  consider  its  value  and  utility  for 
research. 

Irene  Karpiak,  University  of  Oklahoma 

FEATURED  SPEAKER 
Session  12 

8:00  pm.  -10:00  p.m. 

Sauganash  Ballroom  East 

Perspectives  on 
Educational  Productivity 
Herbert  J.  Walberg 

University  of  Illinois  at  Chicago 

Notwmstanang  recent  optimistic  views  or  American  educational 
accomplishments,  the  U.S.  lags  behind  other  countries  in  many 
achievement  measures.  The  most  recent  comparisons  of 
participating  industrialized  countries  show  that  U.S.  students 
decined  in  reading  literacy  during  the  period  from  1970  to  1990  ‘ 
wttie  inflation-adjusted  educational  spending  rose  substantially. 
U.S.  students,  moreover,  appear  to  make  the  least  reading 
progress  from  ages  9 to  14  among  those  of  participating 
Organization  for  Economic  and  Cooperative  Development 
countries  even  though  U.S.  costs  are  highest  For  these 
reasons,  the  organization,  productivity,  and  consumer-orientation 
of  U.S.  schools  requires  review  and  reform. 

Research  Professor  of  Education  and  Psychology  at  the 
University  of  IHinois  at  Chicago,  Herbert  J.  Walberg  is  past 
chairman  of  the  technical  Committee  on  International  Education 
Indicators  for  the  Organization  for  Economic  Cooperation  and 
Development,  and  a founding  member  of  the  National 
Assessment  Governing  Board.  Professor  Walberg  is  one  of 
three  U.S.  members  of  the  International  Academy  of  Education. 
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BUSINESS/DIVISION  MEETINGS 
Session  13 


8:00  a.m.  - 9:50  a.m. 


MWERA  Association  Council  Meeting 
Greg  Merchant,  President 
8:00  a.m.  - 9:50  a.m. 
Western  Stage 


Session  14 


New  Member  Welcome 
Connie  Bowman,  Chair 
8:00  a.m.  - 8:50  a.m. 
Steamboat  Hotel 


Session  15 


Division  A 

MWERA  Division  Meetings 
9:00  a.m.  - 9:50  a.m. 
Rooms  listed  below 

Division  H 

Columbian  House 

Mansion  House 

Larry  McNeal,  Chair 

Division  E 

John  W.  Fraas,  Chair 

A William  Place,  Co-Chair 

Sauganash  Ballroom  West 

Kathleen  Sparrow,  Co-Chair 

Division  B 

Eddie  E.  Glenn,  Chair 

Division  1 

Fork's  House 

Sauganash  Ballroom  West 

Jay  C.  Thompson,  Chair 

Division  F 

Richard  M,  Smith,  Chair 

V.  EHen  Goodman,  Co-Chair 

Sauganash  Ballroom  West 

Pamela  A Kahlich,  Co-Chair 

Division  C 

Louise  E.  Fleming,  Chair 
Michael  Penrod,  Co-Chair 

Division  J 

American  House 

Sauganash  Ballroom  West 

Steven  Benton,  Chair 

Division  G 

Gloria  T.  Sandoval,  Chair 

Martens  Schommer,  Co-Chair 

Lake  House 

Wayne  VanZomeran,  Co-Chair 

Division  D 

Clara  New,  Chair 
Joan  Thrower  Timm,  Co-Chair 

Division  K 

Bull's  Head 

Steamboat  Hotel  House 

Thomas  S.  Parish,  Chair 

Carmen  Giebelhaus,  Chair 

Bruce  G.  Rogers,  Co-Chair 

Mary  Bendixon-Noe,  Co-Chair 
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FEATURED  SPEAKER 
Session  16 


10:00  a.m.- 11:00  a.m. 


Sauganash  Ballroom  East 


What  Does  It  Mean  to  MTeach  for  Understanding”? 
Carolyn  M.  Evertson 
Peabody  College,  Vanderbilt  University 


Teachers’  and  students’  voices  are  notabiy  absent  in  the  current 
debate  about  educational  reform,  yet  they  are  the  most  central 
participants.  Dr.  Evertson  will  use  information  from  a long  term 
study  of  new  teachers  to  highight  som  e of  the  dilemmas  inherent 
in  changing  teaching  practices. 

Professor  of  Education  and  Chair  of  the  Department  of  T eaching 
and  Learning,  Peabody  CoUege,  Vanderbilt  University,  Carolyn 
M.  Evertson  has  published  numerous  books,  handbook 
chapters,  and  articles  about  teacher  education,  learning  to  teach, 
creating  and  managing  learning  environments  and  the  culture  of 
the  classroom,  including  two  books,  Learning  from  Teaching, 
and  Student  Characteristics  and  Teaching  with  Jere  Brophy. 
Her  texts  for  preservice  teachers,  Classroom  Management  for 
Elementary  Teachers  and  Classroom  Management  for 
Secondary  Teachers  (co-authored  with  Edmund  Emmer, 
Barbara  Clements,  and  Murray  Worsham)  are  soon  to  be 
published  in  their  fourth  editions. 


— 

RESEARCH  SESSIONS 

11:00  A.M. -12:30  P.M. 

"■  -■ j 

Session  17 

Defining  Roles  and  Realities  In  Teacher  Education 

Paper  Session  (Division  K) 

Western  Stage 

Finding  Parts  Within  the  Theater  of  Education:  Roles 
Developed  by  Preservice  Teachers  During  Three  Field 

Jacqueline  Cotter,  Miami  University  (OH) 

Chair/Discussant 

Experiences 

Jay  Price 

University  of  Wisconsin- 

Earty  Clinical  Experiences:  How  Do  Teacher  Candidates 

Elizabeth  Wilkins-Canter,  Audrey  Edwards, 

Stevens  Point 

Spend  Their  Time? 

Eastern  Illinois  University 

Reform  in  Middle-Level  Education:  Roles,  Relationships, 

Linda  Morrow,  Kaye  Martin,  Muskingum 

and  Reality 

College 

Session  18 

Improving  Student  Teaching  and  Preservice 
Teacher  Education 

Forum  (Division  K) 

Steamboat  Hotel 

The  Dilemmas  of  Evaluating  Student  Teacher/Interns 

Jennifer  Fager,  Western  Michigan  State 

Chair 

University;  Marcy  Reisetter,  University  of 

Carmen  Giebelhaus, 

Nebraska-Uncoln ; Suzanne  Timmer, 

University  of  Dayton 

Western  Michigan  State  University, 
Thomas  DeHario,  Loy  Nomz  H.S.;  Jana 
EUingson,  Flandreau  H.S . 

Lenses  on  Reflection:  Enhancing  the  Professional 

Adrian  Rodgers,  Ohio  State  University, 

Development  of  Preservice  Teachers 

Annette  Thorson,  Ohio  Dominican 

College ; Debra  Mattonee,  Fairborn  City 
Schools  (OH);  Heather  Boggs,  Ohio  State 
University 
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Session  19  Socialization  of  Children  Paper  Session  (Division  E) 


Mansion  House  The  Relationship  of  Locus  of  Control  and  Self-Esteem  Stacey  Pfannenstiel,  Linda  Bakken, 

with  Academic  Achievement  of  Middle  Adolescence  Wichita  State  University 

Chair 

Dierdre  Jackson,  Bradley 

University  A Comparison  of  the  Role  of  Mexican-American  and  Linda  Lopez,  Minami  Hamilton,  Western 

Anglo-American  Family  Members  in  the  Socialization  New  Mexico  University 
Discussant  Process 

Donna  Waechter,  University 
of  Akron 


Session  20  Recent  Research  Based  on  Diverse  Perspectives  Paper  Session  (Division  D) 


Columbian  House 
Chair 

Gerald  Nunn,  Educational 
Services,  Inc. 


Gender,  Program,  and  National  Differences  in  Spatial 
Visualization 

Racial  and  Ethnic  Differences  in  the  Effect  of  Family 
Background  on  Educational  Attainment 


K.H.  Chen,  Ayres  D’Costa,  Ohio  State 
University 

Susan  McElroy,  Carnegie  Mellon 
University 


Discussant  Models  Comparing  Estimates  of  School  Effects  Based  Minsuk  Shim,  University  of  Illinois 

Christine  Fox,  University  of  on  Cross-Sectional  and  Longitudinal  Designs 
Toledo 


Session  21  Cognitive  interventions  for  Academic  Learning  Paper  Session  (Division  C) 


Bull’s  Head 
Chair 

Marlene  Schommer 
Wichita  State  University 

Discussant 

Anthony  Ambrosio 
Wichita  State  University 


Effect  of  Topical  Frequency  and  Position  on  Recall  of  Linda  Pallock,  John  Surber,  University  of 
Text  Wisconsin-Milwaukee 

Analogies  and  Reconstruction  of  Mathematical  Gerald  Fast,  University  of  Wisconsirh 

Knowledge  Oshkosh 

Investigating  the  Advantages  of  Constructing  Multidigit  Judith  Towne-Hankes,  University  of 
Numeration  Understanding  Through  Oneida  and  Ojibwa  Wisconsin-Oshkosh 
Native  Languages 

A Mnemonic  Intervention  for  All  Seasons  Yooyeun  Hwang,  Joel  Levin,  University  of 

Wisconsin-Madison\  Willy  Renandya, 
Akademi  Bahasa,  Semarang,  Indonesia 


Session  22  wDoing  History”:  Some  Tips  on  Obtaining  Job  and  Forum  (Division  F) 

Publishing  Opportunities  in  the  History  of 
Fork’s  House  Education 

Chair  How  to  go  about  a job  search;  how  to  get  published  Louise  Fleming,  Ashland  University, 

Elizabeth  Johnson  again  and  again;  and  how  to  keep  a position  once  it  is  Michael  Penrod,  Southeast  Kansas 

Eastern  Michigan  University  attained.  Education  Service  Center 
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RESEARCH  SESSIONS 


Thursday  October  3, 1996 


1 1 :00  a.m.  - 1 2:20  p.m. 


Session  23 
Lake  House 
Chair 

Wayne  Van  Zomeren 
NW  Missouri  State 
University 

Discussant 

Gloria  Sandoval 
Ohio  State  University 

Higher  Education  Potpourri 

Literacy  Practices  of  Undergraduate  Teaching  Assistants 
What  Experts  Think  About  Statistics  Education 

Paper  Session  (Division  J) 

M.  Cecil  Smith,  Northern  Illinois  University 

Mark  Earley,  University  of  Toledo 

Session  24 

Preschool  Issues 

Paper  Session  (Division  G) 

American  House 

The  Peer  Group  Dynamics  of  Six  Preschool  Boys 

Angela  Baum,  Iowa  State  University 

Chair/Discussant 

As  Long  as  It’s  Developmentalty  Appropriate 

Mandy  Cole,  Miami  University  (OH) 

Clara  New,  University  of 

Wisconsin-Parkside 

CALL  FOR  NOMINATIONS 

The  Nominations  Committee  of  the  Mid-Western  Educational 
Research  Association  is  accepting  nominations  for  offices  to  be 
elected  early  1997.  Vice-President/Program  Chair,  Member-at- 
Large,  and  Association  Council  Members  will  be  elected. 
Those  nominated  must  be  members  in  good  standing.  If  you 
are  interested  or  know  of  someone  who  is,  please  contact  Greg 
Marchant,  Department  of  Educational  Psychology,  Ball  State 
University,  Muncie,  Indiana  47306  (e-mail: 
SlyNIN@ix.  netcom . com) . 
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Session  26  Teacher  Education:  From  Beginning  to  End  Paper  Session  (Division  K) 


Steamboat  Hotel  The  Relationship  Between  Pre-  and  Post-Preparation  Ronald  Marso,  Fred  Pigge,  Bowling  Green 

Development  of  Teaching  Career  Attitudes,  Anxieties,  State  University 
Chair/Discussant  and  Confidence  and  Candidates’  Success  or  Failure  in 

Karen  Dutt  Making  the  T ransition  to  T eaching 

Indiana  State  University 

Admission  to  Teacher  Education:  An  Examination  of  George  Petersen,  Bowling  Green  State 
University  Standards  University,  Kathryne  Speaker,  Center  for 

Teaching  Excellence 

Prospective  T eacher  Educators  Speak  Out  T eacher  Joy  McCullough,  Trinity  Western 
Education  Programs  and  Preservice  Teachers  University 


Session  27  Legal,  Finance,  and  Privatization  Issues  in  Paper  Session  (Division  A) 

Education 

Mansion  House 

Judicial  Response  to  Discrimination  in  Education:  The  Lyndon  Furst,  Andrews  University 
Chair  Case  Study  of  the  Non-Public  Schools 

Mariiyn  Grady 

University  of  Nebraska-  Alternative  Education  Service  Delivery  Systems:  An  Scherie  Lampe,  University  of  Wisconsin - 

Lincoln  Examination  of  Choice  and  Privatization  Options  in  the  Oshkosh 

United  States 

Privatization  - Policy  Implications  for  Public  Education  Daniel  Raisch,  University  of  Dayton 

School  Referenda  Success  in  an  Environment  of  Fiscal  Randy  Dunn,  Southern  Illinois  University 
Limitations 


A History  of  Nebraska  Public  School  Finance  Law:  1 867-  Harriet  Gould,  University  ofNebraska- 
1 993  Lincoln 


Session  28 
Columbian  House 


Chair 

Thomas  Parish,  Kansas 
State  University 


Important  Ideas  Regarding  the  Teaching  of 
Statistics 

Comparison  of  Psychometric  Characteristics  of 
Instruments  Used  to  Assess  Attitudes  Toward  Statistics 

Thinking  Critically  About  Statistics 


Paper  Session  (Division  D) 

Susan  Cashin,  Patricia  Elmore,  Southern 
Illinois  University 

Linda  Lange,  Sacred  Head  University 


Discussant  The  Creation  and  Use  of  Videotaped  Computer  Tutorials  Patricia  Klass,  Illinois  State  University 

Peggy  Simpson,  University  Research  and  Statistics  Classes 
of  Cincinnati 
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Session  29  Educating  the  Professions  Through  School-Based 

Partnerships 

Buirs  Head 

Overview  of  School-Based  Partnerships 

Chair 

Deborah  Bainer,  Ohio  State 

University-Mansfield  Professional  Development  of  Resource  Professionals 

Through  Partnerships 

Discussant 

Ayres  D’Costa,  Ohio  State  Professional  Development  of  Business  Professionals 

University  Through  Partnerships 


Professional  Development  of  Health  Care  Professionals  Christine  Halon,  Deborah  Bainer,  Ohio 
Through  Partnerships  State  University-Mansfiefd 


Session  30 

Fork’s  House 

Chair 
Tom  Vontz 
Indiana  University 

Discussant 
Gloria  Sandoval 
Ohio  State  University 

Learning  Styles  and  Learning  Characteristics  in 
Higher  Education 

Tutoring  Needs  and  Locus  of  Control  in  College 
Students'  Predictions  of  Test  Results 

Four  Tasks  in  College:  A Case  Study  of  Student 
Motivation  in  an  Introductory  Course 

A Little  Chaos  in  our  Theories:  Postseceondary  Students 
with  Invisible  Disabilities 

Paper  Session  (Division  J) 

Peter  Brady,  Clark  State  Community 
College 

Edmund  Hansen,  Emporia  State 
University 

Jacqueline  Rickman,  Western  Illinois 
University 

Session  31 

Studies  in  Secondary  and  Post-Secondary 
Curriculum 

Paper  Session  (Division  B) 

Lake  House 

Curriculum  Change  in  Indiana’s  School-To-Work  Pilot 

Theodore  Kowaiski,  Ball  State  University, 

Chair/Discussant 

Site  High  Schools 

Susan  Beerman,  Bloomington  North  HS 

Linda  Behar-Horenstein 

(IN) 

University  of  Florida 

Measunng  the  Consistency  of  the  Attitudes  and 
Practices  of  College  Composition  Instructors 

James  Salzman,  Ursuhne  College 

The  Best  Predictor  Variables  of  Columbus  Public 
Schools’  Students’  Performance  on  the  Ohio  Ninth- 
Grade  Proficiency  T est 

Susanne  Granoff,  Ohio  State  University ; 

StarkNet  Boundary  Breakers 

Mary  Robinson,  Kris  Wyler,  Stark  County 
Educational  Service  Center  (OH) 

Examining  Systemic  Educational  Reform  in  Ohio  Symposium  (Division  H) 
from  Diverse  Perspectives:  Current  Status, 

Projected  Steps,  and  Ramifications  for  Statewide  William  Loadman,  Ohio  State  University; 
Reform  of  Public  Education  Susan  Streitenberger,  Ohio  Department  of 

Education ; Zana  Vincent,  Central  Ohio 

A presentation  of  the  current  stat jr  ^nd  future  Regional  Professional  Development 

projections  on  Ohio’s  Venture  initiative  from  a number  of  Center,  WiWiam  Wayson,  Synergetic 
organizations  involved  in  overseeing  the  project.  Systems ; Lenn  Turner,  Worthington 

Estates  Elementary  School  (OH) 


Symposium  (Division  I) 

Deborah  Bainer,  Ohio  State  University- 
Mansfield 

Deborah  Bainer,  Christine  Halon,  Ohio 
State  University-Mansfield 

Don  Williams,  Ohio  State  University 
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FEATURED  SESSION 

Session  33 

3:00  p.m.  -4:20  p.m. 

Mansion  House 

Meet  the  NEW  Editors 
of 

The  Mid-Western  Educational  Researcher 
Hosted  by; 

Deborah  Bainer,  Ohio  State  University-Mansfield 

Gene  Kramer,  American  Dental  Association 
Richard  Smith,  MarianJoy  Rehabilitation  Hospital 

RESEARCH  SESSIONS 

3:00  p.m. -4:20  p.m. 

Session  34 

Publishing  Student  Evaluations  of  Teacher 

Forum  (Division  K) 

Western  Stage 

Performance:  Debating  the  Issues 

Stephen  Blatt,  Carolyn  Benz,  University  of 

Live  debate  - Resolved:  That  Classroom  Teaching 

Dayton ; John  Pohlmann,  Southern  Illinois 

Chair 

Evaluations  be  Published.  Issues  and  evidence  that 

University,  Isadora  Newman,  University  of 

Jacqueline  Collier,  Miami 

support  the  logic  for  and  against  publishing  student 

Akron 

University  (OH) 

evaluations. 

Session  35 

Teachers  as  Adult  Learners 

Paper  Session  (Division  K) 

Steamboat  Hotel 

Teachers’  Professional  Development  An  Interview  Study 

Jay  Price,  University  of  Wisconsin- 

Chair/Discussant 
Mary  Eden  Schmktt 

Adult  Learning  Principles;  A Theoretical  Framework  for 

Stevens  Point 

Patricia  Koll,  University  of  Wisconsin- 

Ohio  State  University - 

Comparing  New  Teach er/Facutty  Induction  Programs  in 

Oshkosh ; Lee  Siudzinski,  John  Moore, 

Mansfield 

Pre  K-12  and  University  Settings 

KauKauna  School  District  (Wl);  Gregory 

Launching  School  Change  Through  Teacher  Study 

Wypiszynski,  University  of  Wisconsin- 
Oshkosh 

Heather  Boggs,  Ohio  State  University 

Groups:  An  Action  Research  Project 

Session  36  Validity  Issues 


Paper  Session  (Division  D) 


Columbian  House  Validation  of  Item  Difficulty  Models 


Dimiter  Dimitrov,  Kent  State  University 


Chair 

Donald  Boyd,  Arkansas 
Special  Education  Resource 
Center 

Discussant 

Bruce  Rogers,  U / ersity  of 
Northern  Iowa 


The  Restoration  of  Critical  Evaluation  to  Criterion- 
Referenced  Standard  Setting 

A Historical  Comparison  of  Validity  Standards  and 
Validity  Practices 


Gregory  Stone,  The  National  Certification 
Corp. 

Jessica  Jonson,  Barbara  Plake,  University 
of  Nebraska-Uncoln 


Session  37 
Bull's  Head 


A Place  for  Ideas:  A Description  of  Research  Taking  Forum  (Division  C) 
Place  at  the  Center  for  Creative  Learning  and 
Research  on  Crit i hinking  and  Creativity 


Chair 

Nelson  DuBoie 
SUNY-Oneonta 

Discussant 

Beveriy  Dretzke 
University  of  WisconsirhEau 
Claire 


The  creation  of  a center  to  facilitate  a local  community  of 
learners  for  the  purpose  of  nurturing  and  mentoring 
critical  thinking  and  creativity.  The  environment  strives  to 
nourish  and  promote  the  creative  process  as  well  as 
celebrate  the  development  of  creative  products. 


Ronald  Morgan,  Marlea  Edinger,  Loyola 
University  of  Chicago 
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RESEARCH  SESSIONS 

3:00  p.m. -4:20  p.m. 

Session  38 

Getting  to  Scale:  Focusing  on  the  Classroom 

Symposium  (Division  H) 

Fork’s  House 
Chair 

Zoe  Barley,  Western 
Michigan  University 

Issues  and  strategies  to  link  large-scale  reform  efforts  to 
focused  change  in  the  fundamental  conditions  of 
teaching  and  learning  for  students  and  teachers. 

Mark  Jenness,  Sharon  Dodson,  Cynthia 
Phillips,  Rebecca  Thomas,  Cynthia 
Halderson,  Western  Michigan  University 

Session  39 

Teenage  Pregnancy 

Paper  Session  (Division  G) 

Lake  House 

Composing  Ordinary  Lives:  Two  Perspectives 

Julie  Biddle,  University  of  Dayton 

Chair/Discussant 
Raquel  Farmer,  University  of 
Illinois 

A Comparison  of  Adolescent  Mothers  in  an  Alternative 
Education  Program:  A Focus  on  Motivation  and 
Persistence 

Barbara  Hutchison,  Moore  Public  Schools 
(OK):  Joe  Nichols,  Indiana  University 
Purdue  University-Fort  Wayne 

Session  40 
American  House 
Chair 

Larry  McNeal 
Illinois  State  University 

Sources  of  Miscommunlcation  in  Educational 
Reform 

The  Project  for  Educational  Democracy:  Creating  a 
Forum  for  Citizen  Participation  in  Education 

Elementary  Teachers  Engaged  in  Site-Based 
Management  Issues  Pertaining  to  Communication  and 
Shared  Commitment  to  Reaching  Established  Goals 

Paper  Session  (Division  A) 

Nicole  Roberts,  University  of  Illinois 
Lou  Anna  Moore,  Miami  University  (OH) 

Secondary  Teachers  Engaged  in  Site-Based 
Management  Issues  Pertaining  to  Communication, 
Consensus,  and  Time  Factors 

Catherine  Keener,  Miami  University  (OH) 

Secondary  Teachers  engaged  in  Block  Scheduling: 
Issues  Pertaining  to  Communication  and  Accountability 
in  Educational  Reform 

Beth  Muskopf,  Miami  Univeristy  (OH) 

Cracker  Barrel  Social 
Hosted  by: 

Gregory  Marchant,  MWERA  President 

5:00  p.m.  - 7:00  p.m. 

Button’s 

(off  Mad  Anthony’s  Lounge) 

15th  Floor 
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Morning  Hospitality  Service 
7:00  am  - 8:00  am 
14th  Floor,  West  Lobby 


Conference  Registration 
8:00  am -4:00  pm 
14th  Floor,  East  Lobby 


BUSINESS  MEETING 

Session  42  8:00  am  - 9:20  am 


MWERA  General  Business  Meeting 
8:00  am  - 9:20  am 
Greg  Marchant,  President 
Sauganash  Ballroom  East 


Session  43 


Exhibits 

9:00  am  - 5:00  pm 
14th  Floor,  West  Lobby 

RESEARCH  SESSIONS 

9:30  am -10:50  am 

Session  44 

Changing  Ideas,  Pedagogy,  and  Curriculum 

Paper  Session  (Division  K) 

Western  Stage 

Students’  Cognitive  Representations  of  Practical 
Knowledge  in  Case-Based  Teaching 

Mark  Mostert,  Moorhead  State  University 

C>'air/Discussant 

Mary  Campbell 

A Case  Study  of  the  Implementation  of  a Nongraded, 

C . Richele  O’Connor,  Ohio  State 

Saint  Xavier  University 

Multiage,  Continuous  Progress  Program 

University 

Issues  and  Influences  that  Shape  the  Teaching  of  U.S. 

Michael  Romanowski,  Ohio  Northern 

History 

University 

Session  45 

Beginning  Teachers 

Paper  Session  (Division  K) 

Steamboat  Hotel 

Developmental  Stages  of  Preseivice  and  Early  Career 

Charles  Runyan,  Rozanne  Sparks,  David 

TeachersThrough  Needs  Identification 

Hurford,  Richard  Lipka,  Pittsburgh  State 

Chair/Discussant 

University 

Clara  New 

University  of  Wisconsin- 

Support  for  Beginning  Teachers:  Present  Situations  and 

Lenore  Wineberg,  Beth  Rost,  University  of 

Parkside 

Prospects 

Wisconsin-Oshkosh 

The  Effects  of  Ethnicity  of  Candidate  Name  and 

William  Place,  University  of  Dayton:  Dazun 

Candidate  GPA  in  Teacher  Employment  Screening 
Decisions 

Luo,  Ball  State  University 

Session  46 

Issues  About  Sawing  Students  With  Disabilities 

Paper  Session  (Division  E) 

Mansion  House 

Mainstreaming  Revisited:  Twenty  Years  Later 

Daryi  Wilcox,  Wayne  State  University; 

Chair/Discussant 

Stanley  Wigle,  University  of  Tennessee- 

Thomas  Midgette, 

Martin 

AWD/ADL  Eddie  Glenn, 

Illinois  State  University 

Career  Planning  and  Development  for  Adolescents  with 

David  Staton,  Iowa  State  University; 

Disabilities 

Dierdre  Jackson,  Bradley  University; 
Thomas  Midgette,  AWD/ADL 
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RESEARCH  SESSIONS 


9:30  a.m.- 10:50  a.m. 

Session  47  Improving  Research  Methodologies 

Columbian  House  Return  Rates:  An  Investigation  of  Mathematical  Models 

Chair  A Comparison  of  Follow-Up  Strategies  in  Improving  the 

* James  Necessary,  Ball  State  Response  Rate  of  Mail  Surveys 
University 

Multiple  Mark  Items:  An  Alternative  Objective  Item 
Discussant  Format 

Dennis  Leitner,  Southern 

Illinois  University  Are  Opsn-Ended  Items  Performance  Assessments? 

Session  48  Testing  the  Effects  of  Classroom  Intervention: 

Attitudes,  Study  Skills,  and  Critical  Thinking 

Bull's  Head 

The  Effects  of  Classroom  Environment  Orientation  on 
Chair  the  Attitudes  and  Achievement  of  Developmental 

Wayne  Gordon  Readers 

Western  Illinois  University 

Exploring  the  Short-Term  and  Long-Term  Effects  of 
Discussant  College  Study  Skills  Courses  on  Performance  in  a 

Robbie  Scholes  General  Psychology  Course 

American  College  Testing 

Evaluating  the  Effects  of  a Critical  Thinking  Course  on 
Critical  Thinking  Skills  and  Dispositions  of 
Undergraduate  Students 

Session  49  The  Context  of  Teaching  in  Higher  Education 

Fork’s  House  Alternatives  for  Faculty  Workload 

Chair 

Pamela  Kahlich  A Survey  of  Administrators'  Perceptions  of  Campus 

KJ  Learning  Partners,  Inc.  Climate  and  Related  Issues 

Discussant 
Gloria  Sandoval 
Ohio  State  University 


Session  51 
American  House 
Chair 

Isadore  Newman 
University  of  Akron 


Standardized  Testing:  Don't  Throw  the  Baby  Out 
With  the  Bath  Water 

An  examination  of  the  performance  of  students  on 
standardized  tests,  with  focus  on  tests  used  to  measure 
intelligence. 


Paper  Session  (Division  D) 

Brgce  Rogers,  University  of  Northern  Iowa 

Christine  Fox,  Lynne  Johnson,  University 
of  Toledo 

Mark  ‘^ornplun,  Nita  Sundbye,  University 
of  Kansas 

Kim  Rasmussen,  University  of  Toledo 
Paper  Session  (Division  C) 


Tatia  Beckwith,  Northern  Illinois  University 


George  Overbey,  Kishwaukee  College ; 
Sarah  Peterson,  Northern  Illinois 
University 

Julie  Fisher-Robertson,  Donna  Rane- 
Szostak,  Northern  Illinois  University 

Paper  Session  (Division  J) 

Russell  Higham,  Edward  Hines,  Illinois 
State  University 

Abbie  Robinson-Armstrong,  University  of 
Toledo;  Mary  Clark,  Wayne  Sfafe 
University ; Lila  Curry,  Bowling  Green  State 
University 


Panel  Discussion  (Division  H) 


Isadore  Newman,  Ronald  McClendon, 
Celina  Echols,  University  of  Akron 
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ROUNDTABLE 
PRESENTATIONS 
Session  52 

9:30  a.m.  -10:50  a.m. 

Sauganash  Ballroom  West 

Table  1 
Division  A 

Illinois  Middle  Level  Grades  Initiative:  A Three  Year 
Follow-Up 

Frederick  Dawson,  Joyce  Flood,  Illinois 
State  Board  of  Education 

Table  2 
Division  B 

Practicing  What  We  Teach:  One  Approach  to  Modeling 
Best  Practice 

Joanne  Frey,  Northeastern  Illinois 
University 

Table  3 
Division  B 

The  Use  of  Professional  Development  in  Establishing  an 
Inclusion  Program  in  Indiana 

Doris  Speicher,  Ball  State  University 

Table  4 
Division  B 

The  Impact  of  Rotating  Class  Times  Upon  Students, 
Parents,  and  Teachers:  An  Alternative  Middle  School 
Schedule 

Mark  Seele,  Carroll  M.S.  (IN)\  Jay 
Thompson,  Ball  State  University,  Kenneth 
Fowble,  NW  Allen  County  Schools  (IN) 

Table  5 
Division  B 

TQM  in  Educational  Curriculum:  Implications, 
Applications,  and  Considerations 

Vicki  Harris,  New  Castle  Area  Vocational 
Center  (IN)\  Terry  Wiedmer,  Ball  State 
University 

Table  6 
Division  D 

Sources  of  Teacher  Stress  Associated  with  T eaching 
Students  with  Severe  Disabilities:  Contributing  Factors 
and  Management  Strategies 

H.  Lynn  Springfield,  Donald  Boyd, 
Arkansas  Special  Education  Resource 
Center 

Table? 
Division  D 

Creating  Overlap  Between  Teachers’/Professors’  Worlds 
and  their  Students'  Worlds 

Thomas  Parish,  Kansas  State  University, 
James  McCIuskey,  University  of 
Oklahoma 

Tabled 
Division  E 

Foreign  Language  Learning  Difficulties:  A Decade  of 
Cognitive,  Affective,  and  Linguistic  Research 

James  Javorsky,  Purdue  University, 
Richard  Sparks,  Mount  Saint  Joseph's 
College 

Tabled 
Division  E 

Issues  Regarding  Adolescent  Identity  Development 

Linda  Bakken,  Christy  Calvert,  E.  Jean 
Lytle,  Carlene  Jones,  Wichita  State 
University 

Table  10 

Subjective  Fourth-Grade  Responses  to  TV  and  Video 

Kenneth  Breti,  Governors  State  University 

Division  G 

Table  11 
Division  G 

Validation  of  a Self-Control  Rating  Scale  in  Chinese 
Preschool  Children 

Aimin  Wang,  Miami  University  (OH): 
Mingyi  Qian,  Peking  University,  Jeanne 
Thibo  Karns,  University  of  Nebraska 

Table  12 

Assessment  of  College  and  University  Students 

Louise  Fleming,  Ashland  University 

Division  K 

Table  13 
Division  K 

Alternative  Assessments:  Establishing  Benchmarks  in 
the  Preparation  of  Professional  Educators 

Charles  Manges,  Texas  A&M  University- 
Corpus  Christf,  Stanley  Wigle,  University 
of  Tennessee-Martin 

Table  14 
Division  K 

Directors  of  Field  Experience:  Perceptions  of  Their  Roles 
and  Responsibilities  in  the  Evaluation  Process 

Hema  Ramanathan,  Ohio  State  University 

Table  15 
Division  K 

Using  Action  Research  to  inform  Curriculum 
Deliberations  in  an  Early  Childhood  Teacher  Education 
Program 

Mary  Connolly,  Margaret  Dotson,  Sinclair 
Community  College 
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LUNCHEON 

FEATURED  SPEAKER 

Session  53 
ii — "■ - — 

11:00  a.m.  -1:20  p.m. 

Sauganash  Ballroom  East 
— — —11 

Stability  and  Change  in  Education 
Mary  M.  Kennedy 

Michigan  State  University 


Professor  Kennedy  will  address  the  relationship  between 
research  and  teaching  by  examining  a variety  of  contentions 
about  how  research  can,  should,  or  actually  does  contribute  to 
improvements  in  education.  Her  review  win  suggest  a surprising 
new  interpretation  of  the  relationship  between  research  and 
practice. 

Professor  and  the  Director  of  the  Institute  for  Research  at 
Michigan  State  University,  Mary  M.  Kennedy  has  won  four 
awards  for  her  work  on  the  nature  of  knowledge  needed  for 
teaching.  Professor  Kennedy  has  authored  numerous  journal 
articles  and  book  chapters  in  these  areas,  and  has  authored 
reports  specifically  for  policy  audiences,  including  the  United 
States  Congress.  She  recently  edited  Teaching  Academic 
Subjects  to  Diverse  Learners,  a collection  of  articles  examining 
the  nature  of  knowledge  teachers  need  in  each  of  the  major 
content  areas  and  knowledge  they  need  about  students  as 
learners. 


RESEARCH  SESSIONS  1 :30  p.m.  -2:50  p.m. 


Session  54  Using  Technology  in  Teacher  Education  Paper  Session  (Division  K) 


Western  Stage 


Chair/Discussant 
Sonja  Smith 

Mount  Vernon  Nazarene 
College 


Integrating  Technology  into  a College  of  Education  and 
Human  Services 

The  Use  of  Electronic  Communication  to  Develop 
Alternative  Avenues  for  Classroom  Discussion 

From  the  Bridge  of  the  Starship  Enterprise:  Utilizing 
Interactive  Distant  Learning  in  Graduate  Education 


Susan  Cramer,  Henry  Winterfeldt, 
University  of  Wisconsin-Oshkosh 

Karen  Dutt,  Susan  Powers,  Indiana  Sfafe 
University 

Richard  Lipka,  Brenda  LeTendre,  Pittsburg 
State  University 


Session  55 


Enhancing  the  Clinical  Preparation  of  Teachers  Paper  Session  (Division  K) 


Steamboat  Hotel 

Chair/Discussant 
Barb  Witteman 
Concordia  College 


The  Impact  of  Training  Cooperating  Teachers  on  the  Connie  Bowman,  Ohio  State  University, 
Professional  Development  of  Student  Teachers  Carmen  Giebelhaus,  University  of  Dayton 


Phases  of  the  Mentoring  Environment:  Developing  Jennifer  Fager,  Western  Michigan 

Cluster  Sites  in  Teacher  Education  University 


Combining  Quantitative  and  Qualitative  Methods  to  Anthony  Baxter,  Safem  State  Coliege 

Improve  the  Research  on  Clinical  Preparation 


TAM  ABLE 


0 ? ] 
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Session  56  Historical  Perspectives,  Lessons  Learned,  and 

Future  Directions  for  MWERA 

Mansion  House 

President  Marchant  has  invited  this  distinguished  panel 
Chair  of  former  MWERA  presidents  and  our  current 

Gregory  Marchant,  MWERA  Association  Historian  to  discuss  the  history  of  MWERA. 

President  These  individuals  witnessed  and  promoted  much  of  the 

growth  experienced  by  MWERA  In  an  open  discussion, 

Discussant  they  will  share  their  unique  perspectives  and  insights 

Charies  C.  Anderson,  JrM  about  MWERA 

Former  MWERA  Executive 
Officer 

Session  57  How  to  Measure  Up  in  Higher  Education  Special  Workshop  (Division  D) 

Columbian  House  This  session  wiH  assist  participants  in  developing  skills  Thomas  Parish,  Kansas  State  University, 

which  will  enable  them  to  obtain  and  thrive  in  positions  in  James  Necessary,  Ball  State  University, 
Chair  higher  education.  Specifically,  discussed  will  be  how  to  James  McCluskey,  University  of 

Thomas  Parish,  Kansas  use  technology,  publish,  and  successfully  work  as  Oklahoma 

State  University  professional  consultant 

Session  58  Designing  and  Scoring  Patient  Management 

Problems 

Bull's  Head 

Current  Practices  in  Scoring  Patient  Management 
Chair  Problems 

Gene  Kramer,  American 

Dental  Association  Alternative  Scoring  Methods  for  Patient  Management 

Problems 

Discussant 

Benjamin  Wright,  University 
of  Chicago 


Symposium  (Division  I) 


Dorthea  Juul,  American  Board  of 
Psychiatry  and  Neurology 

Kevin  Fuss,  Richard  Smith,  RFI/MarianJoy 
Rehabilitation  Network 


Featured  Panel  (MWERA  Special) 

Terri  Strand,  MWEFtA  Historian ; Past 
MWERA  Presidents  and  Officers 


Friday  dctober  4, 1996 


RESEARCH  SESSIONS 

1:30  p.m. -2:50  p.m. 

Session  61 

Social  Class  and  Schools 

Paper  Session  (Division  G) 

American  House 

A New  Look  at  the  Old  Schoolhouse 

Thomas  OkJenski,  University  of  Dayton 

Chair/Discussant 
Mary  Ann  Flowers, 
Cleveland  State  University 

Gender,  Ethnic,  and  Race  Differences  of  Attitudes  and 
Interest  in  Mathematics,  Science,  and  Computers  in 
Majority  Hispanic  Schools 

Bernard  Arenz,  Salty  Blake,  University  of 
Texas-EI  Paso 

Means  and  Effectiveness  of  Select  Pre-College 
Programs 

J.  Russell  Higham,  Illinois  State  University 

The  1996  MWERA  Conference  promises 
to  be  one  of  our  most  memorable  yet! 

Invite  your  Colleagues  and  Students  to 
become  involved. 
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ROUNDTABLE 
PRESENTATIONS 
Session  62 

1:30  p.m.  -2:50  p.m. 

Sauganash  Ballroom  West 

Table  1 

Substitute  Teachers:  A Vital  Link  in  School  Reform 

William  Hughes,  Ashland  University 

Division  A 

Table  2 
Division  B 

Establishing  Curriculum  Through  Effective  Public 
Relations 

Teresa  Finkbine,  Brad  Oliver,  Terry 
Wiedmer,  Ball  State  University 

Table  3 
Division  D 

Developing,  Implementing,  and  Evaluating  a Quality 
School  Program 

Gary  Louis,  Pamela  Ficke,  Cincinnati 
Public  Schools 

Table  4 

Division  D 

Two  Checklists  for  Determining  Teacher/Professor 
Effectiveness 

James  McCluskey,  University  of 
Oklahoma ; Thomas  Parish,  Kansas  State 
University 

Table  5 
Division  E 

A Systematic  Approach  to  Instructional  Delivery:  A 
Collaborative  Effort  Emphasizing  the  Input  of  School 
Psychologists 

Isadore  Newman,  University  of  Akron: 
Donna  Waechter,  Akron  Board  of 
Education  (OH) 

Table  6 
Division  E 

Mother-Infant  Attachment  Its  Relationship  to  Mother 
Sensitivity  and  Infant  Temperament 

Maribeth  Lenz,  Linda  Bakken,  Wichita 
State  University 

Table  7 
Division  H 

Community  Involvement  in  the  Implementation  of 
Funded  School  Improvement  Programs 

Jerry  Staggs,  William  Loadman,  Ohio 
State  University 

Table  8 
Division  H 

Disciplinary  Policy  and  Suspension  Rates:  A 
Quantitative/Qualitative  Analysis 

Joe  Nichols,  William  Ludwin,  Peter 
ladicola,  Indiana  University  Purdue 
University-Fort  Wayne 

Tabled 
Division  H 

Week  of  Welcome  (WOW  Week):  Preparing  Ninth 
Graders  for  the  High  School  Experience 

Josephine  CammaHarie-Kavert,  University 
of  Califomia-lrvine\  Karen  Guilden,  Ocean 
View  HS  (CA) 

Table  10 
Division  K 

Cooperative  Learning  with  Heterogeneous  Populations: 
Inservice  Teacher  Education 

Margaret  Carroll,  Saint  Xavier  University 

Table  11 
Division  K 

Distant  Elementary  Student  Teachers’  Concerns  as 
Evidenced  Through  Bi-Weekly  Journal  Reflections 

Susan  Clayton-Randolph,  Indiana 
University 

Table  12 
Division  K 

First-Year  Special  Educators’  Use  of  Differentiated 
Teaching  Strategies 

Patricia  Re  nick,  Wright  State  University, 
Jeffrey  Hecht,  Illinois  State  University 

Table  13 

Professional  Development  Schools 

Sandra  Bland,  Illinois  State  University 

Division  K 

Table  14 
Division  K 

Teachers'  Perspectives  on  the  Implementation  of 
Portfolio  Assessment  Views  from  the  Field 

Douglas  Feldmann,  Indiana  University 

Table  15 
Division  K 

The  Evaluation  Process  in  Early  Field  Experiences: 
Perceptions  of  Cooperating  Teachers  and  University 
Supervisors 

Hema  Ramanathan,  Ohio  State  University 
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RESEARCH  SESSIONS 


Session  63 
Western  Stage 
Chair 

E.  Marcia  Sheridan,  Indiana 
University-South  Bend 

Session  64 

Steamboat  Hotel 

Chair 

Kathleen  Maury,  Mankato 
State  University 

Session  65 

Mansion  House 

Chair 
Tom  Vontz 
Indiana  University 

Discussant 

Gloria  Sandoval 
Ohio  State  University 

Session  66 
Columbian  House 
Chair 

Charles  Rankin,  Kansas 
State  University 

Discussant 

Janet  Sheehan,  Northern 
Illinois  University 

Session  67 

Bull's  Head 

Chair 

Mariene  Schcmmer 
Wichita  State  University 

Discussant 
Orpha  Dueli 

Wichita  State  University 


3:00  p.m.  - 4:20  p.m. 

Case-Based  Pedagogy  in  Teacher  Education 

A summary  of  research  in  case  method  teaching, 
addressing  fundamental  instructional  differences  in  using 
cases  with  undergraduate  preservice  teachers  versus 
graduates,  and  raising  questions  about  current  practices 
and  emphases  in  case-based  pedagogy 

Voices  from  Afar:  Distance  Learning  in  Teacher 
Education 

An  overview  of  current  and  potential  applications  of 
distance  learning  technology  from  a national  perspective; 
with  particular  emphasis  on  applications  in  education. 


Technology  in  Higher  Education 
Technology  Use  by  Higher  Education  Faculty 


Technology  Integration  in  Higher  Education:  A Case 
Study  of  the  Networked  Classroom 


Program  and/or  Instrument  Evaluation 

The  Measurement  of  Self-Efficacy  for  Program 
Evaluations 

Developing  a Measure  of  Global  and  Content-Specific 
Efficacy  of  Preservice  Teachers 

Using  a Correlational  Aptitude-Treatment  Interaction 
Design  in  Educational  Research 


Educational  Psychology  and  Constructivism:  What 
Do  We  Know  and  What  We  Need  to  Find  Out 

Examination  of  constructivism  theory  and  its  role  in 
educational  psychology,  with  generation  of  ideas  for 
research,  as  well  as  the  introduction  of  new  ideas  for 
using  constructivism  in  the  classroom. 


Symposium  (Division  K) 

Mary  Sudzina,  University  of  Dayton\  Mark 
Mostert,  Moorhead  State 


Symposium  (Division  K) 


E.  Lynne  Weisenbach,  University  of 
Indianapolis 


Paper  Session  (Division  J) 

Perry  Schoon,  Illinois  State  University 


Danillo  Bayien,  Margaret  Bailey,  Northern 
Illinois  University 


Paper  Session  (Division  D) 

Everett  Smith,  Jr.,  Leslie  Curda,  Stephen 
Curda,  University  of  Oklahoma 

Stephen  Curda,  Leslie  Curda,  Paul  Kleine, 
University  of  Oklahoma 

Andrew  Ridenour,  Larry  Henrikaon,  Ball 
State  University 


Symposium  (Division  C) 


Sharon  McNeely,  Northeastern  Illinois 
University,  Anita  Wooffolk  Hoy,  Ohio  State 
University,  Gregory  Merchant,  Ball  State 
University 


KKST  copy  AVAILABLE 
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RESEARCH  SESSIONS 

3:00  pm  - 4:20  p.m. 

Session  63 

Aspects  of  Principals’  Influences  on  School  Culture 

Paper  Session  (Division  A) 

Fork's  House 

Readiness  for  Change  Among  Urban  School  Principals: 
Leadership  Style  and  Other  Potential  Influence 

Theodore  Kowalski,  Ball  State  University 

Chair 

Dianne  Ashby 

Succeeding  at  Succession:  Strategies  for  Principals 

Barbara  Brock,  Creighton  University 

//too/s  State  Universit\ f 

The  Relationship  Between  Gender  of  the  Superintendent 

Cynthia  Beektey,  LuAnn  Boyer,  Jocelyn 

and  Mate  and  Femate  Principals1  Perceptions  of  the 

Quinn,  Sharon  Smith,  Bowiing  Green 

Organizational  Culture  of  the  School  District 

State  University 

Collaboration  is  Not  Just  for  Teachers:  Special 

Theresa  Quigney,  Cleveland  State 

Education  Leadership  and  Regular  Education  Principals 
Working  Together 

University 

School  Administrators’  Perceptions  of  Training  as 

William  Sharp,  James  Walter,  Southern 

Related  to  Newly  Established  National  Standards 

Illinois  University 

Session  60 

Profiles  of  Successful  Educational  Researchers: 
Secrets  to  Their  Success 

Invited  Address  (Division  D) 

Lake  House 

Dr.  Kiewra,  former  President  of  The  Mid-Western 

Kenneth  Kiewra,  University  of  Nebraska- 

Chair 

Educational  Research  Association  will  discuss 

Lincoln 

Thomas  Parish,  Kansas 

approaches  used  by  successful  scholars  in  education 

State  University 

which  promote  productivity  and  success. 

Session  70 

Learning  to  Use  Data  for  Continuous  Improvement 
In  Schools 

Symposium  (Division  H) 

American  House 

Insights  and  examples  from  work  done  at  Western 

Sharon  Dodson,  Cynthia  Philips,  Mark 

Chair 

Michigan  University  regarding  the  learning  process  taking 

Jenness,  Cynthia  Halderson,  Zoe  Barley, 

Sharon  Dodson 

place  in  schools  attempting  to  drive  improvement  efforts 

Western  Michigan  University 

Western  Michigan  University 

through  the  use  of  data. 

Discussant 

Zoe  Barley 

Western  Michigan  University 

Help  us  prepare  for  the  1997 
conference 

Volunteers  are  always  welcomed  as 
preparations  are  made  for  the  1997 
MWERA  conference.  If  you  are 
interested  in  aassisting,  please  contact 
Thomas  Parish  or  your  division 
chairperson. 
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Wednesday  October  2, 1 996 

Conferanc*  Rtgkftration 
11 :00&m -5:00  p.m. 

1 4th  Floor,  East  Lobby 

WORKSHOP  SESSIONS'] 2:00  pjn.  - 5:00  p.m. 

Session  1 
Western  Stage 
12:00-3:00 

(Fee:  $5)How  Do  We  Assess  Inquiry-Based  Science  Education? 

This  workshop  provides  hands-on  experience  and  guidance  in  using  authentic  assessment  techniques  in  science. 
Participants  will  also  learn  how  to  use  a newly  developed  CD-ROM  computer  package  which  simulates  scientific  discovery 
in  seven  environmental  settings.  Isadore  Newman,  Universiy  of  Akron',  John  Hirschbuhl,  University  of  Akron; 

Rowena  Hubler,  Ohio  Department  of  Education;  Jim  Jackson,  University  of  Akron;  Kathy  Sparrow, 

Akron  Public  Schools 

Session  2 
Mansion  House 
12:00-3:00 

(Fee:  $5)Process  and  Framework  for  Developing  Innovative  Teacher  Education  Programs 
This  hands-on  workshop  will  guide  participants  in  beginning  the  process  of  developing  innovative  teacher  preparation 
programs.  Participants  will  be  helped  to  create  a framework  for  such  development,  concrete  ideas  on  howto  continue,  and 
a continuing  support  system.  Kenneth  Addison,  Beverly  Otto,  Vivian  Walkosz,  Sharon  McNeely,  Janet  Fredericks,  Patricia 
Schutt,  Joanne  Frey,  Edward  Odisho,  Janet  Bercik,  Northeastern  Illinois  University 

Session  3 
Bull’s  Head  Room 
12:00-3:00 

(Fee:  $15)What's  New  In  Multiple  Comparison  Procedur  s 
The  main  purpose  of  this  workshop  Is  to  introduce  educational  researchers  to  new  developments  in  multiple  comparison 
procedures  (MCPs).  All  presentations  and  examples  will  be  provided  in  a notebook  which  will  include  a diskette  containing 
the  computer  programs.Robert  Bartikowski,  Elizabeth  Randolph,  Ronald  Elliott,  Suzy  Green,  George  Johanson,  Ohio 

University 

Session  4 
Lake  House 
12:00-4:00 

(Fee:  $10)lntroduction  to  Structural  Equation  Modeling  (SEM)  with  Amos 
This  workshop  will  provide  an  introduction  to  SEM  in  the  Windows  environment.  Modem  advances  in  structural  modeling 
and  statistical  methods  will  be  presented  with  fully  documented  examples  distributed  as  handouts  and  on  diskette.  Some 
experience  in  multiple  regression  or  factor  analysis  is  recommended.  Werner  Wothke,  SmallWaters,  Inc. 

Session  5 
Columbian  House 
1:00-2:30 

(No  Charge)Children  in  Stress  and  the  Adults  Who  Care  for  Them 
This  workshop  is  intended  for  those  who  work  with  children  and  their  parents.  Participants  will  learn  about  the  nature  of 
stress  in  children's  lives,  how  to  identify  common  stressors  and  signs  of  stress,  methods  of  helping  children  cope  with  stress, 

and  available  resources.  Lisa  Cutter,  Mary  McMullen,  Indiana  University 

Session  6 
Fork’s  House 
1:00-4:00 

(Fee:  $5)Making  Math  Multicultural  Using  the  Computer  as  a Tool 
The  objective  of  this  workshop  is  to  provide  educators  with  methods  of  using  the  computer  and  math  concepts  to  help 
children  appreciate  cultural  differences.  Hands-on  problem-solving  activities  and  handouts  will  be  used.  Participants  may 
bring  a diskette  for  copying  programs.  Mian  Muhammad  Yusuf,  Weber  State  University 
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HOTEL  ROOM  RESERVATION  FORM 


Mail  this  form  to  hotal-to  ba  received  by  Saptsmber  10, 1996 
Organization:  Mid-West  Educational  Researchers  Association  (MWERA) 

To  make  your  hotel  room  reservation,  please  complete  and  send  this  form  to: 

Reservations  Manager 
Holiday  Inn-Mart  Plaza 
300  North  Orleans  Street 
Chicago,  IL  60654 

Or  Call: 

(312)  856-5000 

Specially  reduced  room  rates  are  available  to  conference  participants.  To  ensure  a room  at  the  special 
rate,  reservations  must  be  received  by  the  hotel  by  September  10.  1996.  After  that  date,  reservations  will 
be  made  at  the  prevailing  rate  on  a space  available  basis. 

Name: Phone: 

Company/Affiliation:  

Address: ■ 

City/St/ZIP: 

Sharing  room  with: 

Method  of  payment: Check  (attached)  Credit  Card  (No. ) 

Signature: Expiration  Date: 

Arrival  Date: Arrival  Time: Departure  Date: 

Reservations  will  be  held  until  6:00  p.m.  unless  guaranteed* 

Check  type  of  Accommodation  requested: 

Single  occupancy  (1  double  bed)  $96  Triple  occupancy  (2  double  beds)  $106 

Double  occupancy  (1  double  bed)  $96  Quad  occupancy  (2  double  beds)  $116 

No  Smoking  room  if  available 

•To  guarantee  your  reservation,  please  call  Holiday  Inn  reservations  at  the  number  above  or  complete  this  form  and  mail  it  with  a 
check  for  one  night's  cost  payable  to  the  Holiday  Inn-Mart  Plaza  Hotel,  or  provide  your  credit  card  (AMEX,  VISA,  or  MasterCard) 
information  in  the  above  space.  For- guaranteed  reservations  only,  I understand  that  I am  responsible  for  one  night's  room  and  tax 
charges  which  wM  be  deducted  from  my  deposit  or  charged  to  my  credit  card  If  I fall  to  cancel  my  reservation. 


Signature: 

All  rooms  subject  to  local  city  tax 

NOTE:  Hotel  parking  is  $12.00  per  day  (no  valet)  BEST  COPY  AVAILABLE 
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MEETING  REGISTRATION  FORM 
1996  MWERA  Annual  Meeting,  Chicago,  IL  - October  2-5, 1996 

Pt«a«*  comp We  «ach  — cflonof  the  form  into*.  All  attud— . Inctudtog  program  pr—otow,  went  wgtotr  and  p«y  appHcaMa  9— . PlMMctwriy 
print  or  typ*  your  nanwM  you  It  to  appear  on  your  mMting  badge.  Nonmarr^afa  wtohlrm  to  apply  for  mambarahip  may  raglafar  at  the  mambw'a  raU  K 

mambariNp  appfeaUoc  (bataw)  and  faa  «ra  anctoaad  wtoi  oontaranca  ragbtrattan.  (Note:  Ona  IndMduat  ragtetrabon  par  form;  duplcata  aa  nacaataty) 


Name: 

Affiliation: 
Address:  _ 


City/ST/ZIP: 


Phone:  Bus.  f L 

Highest  Degree:  _ 


Hm.i L 


Fax* L 


Institution  Awarding  Degree: 


Area  of  Specialization: 
E-mail  address: 


MWERA  Division  Preference:. 


It  this  your  first  MWERA  Conference? Yet No 


MEETING  REGISTRATION 


MWERA  Member 
Nonmember 

Student  member  (attach 
letter  from  advisor  or 
copy  of  student  ID) 
Attending  Luncheon  Only 


Postmarked  by  Sept.  1 0 

$45.00 

$50.00 


$30.00 


$25.00 


After  Sept.  1 G 

$55.00 

$60.00 


$35.00 

$28.00 

Total  Registration  Fee 
Enclosed: 


TheJFrjda^hjncheoinsJndudej^i^ 


PRE-CONFERENCE  WORKSHOPS 
(not  included  in  conference  registration  fee) 
*$ee  program  for  workshop  descriptions 


Assess  Inquiry- 
Based  Educ  ($5) 
Introduction  to 
SEM  ($10) 
Five-Point 
Framework  (N/C) 

“Clustering"  (N/C) 


Process  and 
Framework  ($5) 

Children  in  Stress 
and  Adults  (N/C) 

Understanding  the 
WWW  ($10) 


What's  New  in 

MCP's  ($15) 

Making  Math 

Multicultural  ($5) 

New  Teacher 

Education  (N/C) 

Total  Workshop  Fee 
Enclosed: 


MWERA  MEMBERSHIP  DUES 


1996  Membership  Dues 

(required  for  presenters) 

1997  Membership  Dues 
Life  Membership 


Regular  $18.00 
Regular  $18.00 


Student  $10.00 
Student  $10.00 

$130.00 

Total  Membership  Dues 
Enclosed: 


MWERA  Materials* 

(Please  indicate  quantity  desired) 

# Materials  must  be  picked  up  at  the  conference 
MWERA  Membership  Directory  $7.00  (ea.) 

MWERA  90  Annuel  Meeting  Abstracts  $4.00  paptr  $3.00  IBM 

MWERA  Lapel  Pin  $3.00  (ea.) 

Total  Metadata  Faa 

Endoaad: 


TOTAL  FEES  ENCLOSED: 


When  registering  and/or  joining,  please  make  check(s)  payable  to  MWERA,  and  mail  completed  form(s)  to:  Dr.  Jean  Pierce, 
Northern  Illinois  University,  Department  EPCSE,  DeKalb,  Illinois  601 1 5. 


931 


MWERA  1900  - 27 


Wednesday  October  2, 1996 

WORKSHOP  SESSIONS  (cont’d)12:00  p.m.  - 5:00  p.m. 


Session  7 
American  House 
1:00-4:00 

(No  Charge)A  Five-Point  Framework  for  Setting  Up  Instruction  to  Meet  Student  Learning  Styles 
The  workshop  will  include  a variety  of  activities  to  help  participants  learn  more  about  their  own  and  their  students'  learning 
styles,  implications  of  learning  style  for  instruction,  and  examples  of  how  the  five-point  framework  can  be  used  to  design 
more  effective  instruction.  Tim  Green,  Indiana  University,  William  Green,  Andrews  University 


Session  8 
Columbian  House 
2:45-3:30 

(Fee:  $10)Understanding  the  World  Wide  Web— Search  Engines  and  Indexes 
This  workshop  is  intended  to  provide  education  professionals  with  an  overview  of  the  world  wide  web.  Participants  will  leam 
how  the  World  Wide  Web  works  and  how  to  use  Web-based  search  engines  and  search  indexes  to  find  specific  information. 

Abbie  Brown,  Indiana  University 


Session  9 
Mansion  House 
3:30-5:00 

(No  Charge)Designing  and  implementing  a New  Teacher  Education  Program:  University-Based  and  School-Based 
This  workshop  is  designed  to  provide  participants  with  a realistic  view  of  what  can  be  achieved  with  a limited  budget  to 
provide  support  for  new  and  beginning  teachers.  Specific  examples  and  techniques  will  be  provided. 

Janet  Bercik,  Northeastern  Illinois  University,  Judith  Henning,  East  Maine  School  District  63  (IL) 


Session  10 
Bull’s  Head  Room 
3:30-5:00 

(No  Charge)MClustering”:  A Tool  in  Creative  Writing;  A Power  Tool  in  Research 
This  workshop  will  provide  participants  the  opportunity  to  explore  ‘clustering”  as  a possible  interview  tool  for  conducting  their 
research.  Its  purpose  is  to  introduce  the  ‘clustering’  technique,  demonstrate  its  application  in  data  collection,  and  to 
consider  it  value  and  utility  for  research.  Irene  Karpiak,  University  of  Oklahoma 


ROUNDTABLE 
PRESENTATIONS 
Session  71 

3:00  p.m.  - 4:50  p.m. 

Sauganash  Ballroom  West 

Table  1 

Induction  Programs  for  Beginning  Teachers 

Barbara  Brock,  Creighton  University 

Division  A 

Table  2 
Division  A 

State  Mandated  Reforms:  Utilizing  Required  Change  to 
Make  a Positive  Difference  in  the  Public  Schools 

Maria  Israel,  Illinois  Resource  Center 

Table  3 
Division  B 

Community  Relationships:  The  Keys  to  School  Success 
(An  Interview  with  Elaine  Griffin  - 1995  National  Teacher 
of  the  Year) 

Brad  Oliver,  Teresa  Finkbine,  Terry 
Wiedmer,  Ball  State  University 

Table  4 
Division  B 

Making  High  School  Curriculum  Come  Alive:  Creating 
Alphabet  Books 

Marian  Moeckel,  National  State  Teacher 
of  the  Year,  Edgewood  City  Schools  (O H)\ 
Terry  Wiedmer,  Ball  State  University 

Table  5 
Division  B 

The  Effects  of  Learning,  Course  Evaluation,  and  Team 
Evaluation  of  Changing  STAD  Teams  at  Midterm 

William  Gnagey,  Kirsten  Potter,  Illinois 
State  University 

Table  6 
Division  D 

Evaluation  of  Student  Services 

Charoula  Angeli,  Jennifer  Chow,  Maria 
Ferreira,  Valiy  Behjou,  Indiana  University 

Table? 
Division  E 

A Cross-Sectional  Comparison  of  Pre-  and  Early 
Adolescents:  Perceptions  of  Parenting 

Sharon  Paulson,  Cheryl  Sputa,  Ball  State 
University 

Table  8 
Division  G 

1 Hate  School!  Is  There  a Turning  Point  Between  Playing 
Teacher  and  Leaving  School? 

Adria  Karie-Weiss,  Lea  Lee,  Murray  State 
University 

Tabled 
Division  G 

Liberal  Rhetoric,  Conservative  Choices:  The  Pedagogical 
Preferences  of  Middle  Class  Mothers 

Ellen  Brantiinger,  Indiana  University 

Table  10 
Division  G 

Origins  of  African  and  European  American  Stereotypes: 
An  Analysis  of  Uncle  Tom's  Cabin  from  the  Perspective 
of  New  Historicity 

Joan  Timm,  University  of  Wisconsin- 
Oshkosh 

Table  11 
Division  1 

Performance-Based  Evaluation  in  a Predominantly  Black 
Medical  College 

Suzy  Green,  Ohio  University,  Pamela 
Williams,  Meharry  Medical  College 

Table  12 
Division  K 

A Three-Year  University/School  District  Collaboration  for 
Teacher  Preparation:  Comparing  Project  Opportunity 

Nadine  Kiilmer,  Kathy  Connor,  Iowa  State 
University 

Table  13 

Educational  Inquiry  as  a Path  to  Teacher  Empowerment 

Gayle  Allen,  Iowa  State  University 

Division  K 

Table  14 
Division  K 

Effective  Teacher  Characteristics:  A Qualitative  and 
Quantitative  Data  Analysis 

Joe  Nichols,  Indiana  University  Purdue 
University-Fort  Wayne 

Table  15 
Division  K 

The  Importance  of  Support  Through  Induction 
Programming  in  the  Teacher  Socialization  Process 

Karen  Peterson,  Governors  State 
University 
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October  4, 1996V”: 

PRESIDENT’S  RECEPTION 

Session  72 

9:00  pm.  - 12:00  p.m. 

President’s  Reception 

Hosted  by: 

Greg  Marchant,  President 

9:00  pjn.  - Midnight 

15th  Floor,  Wolf  Point  Grill 

Be  a “Parrot  Head”! 

Come  to  the 

President’s  Reception 

Hosted  by: 

Gregory  Marchant,  MWERA  President 


9:00  p.m.  - Midnight 

Wolf  Point  Grill 
15th  Floor 


MWERA  1996-5 


Saturday  October  5, 1 996  ::V;  . ■ : 


Morning  Hospitality  Service 
7:00  a.m.  - 8:00  a.m. 
14th  Floor,  West  Lobby 

PROGRAM  COMMITTEE 

Session  73 

7:30  a.m.  -9:20  a.m. 

MWERA  Conference  Program  Committee  Breakfast 
7:30  a.m.  - 9:20  am 
Kim  Metcalf,  Program  Chair 
Western  Stage 

RESEARCH  SESSIONS 

8:00  a.m.  - 9:20  a.m. 

Session  74 

Aggregating  and  Using  Research  on  Teacher 
Education 

Paper  Session  (Division  K) 

Steamboat  Hotel 

A Summative  Survey  on  the  Perceptions  of  Impact  II 

Anne  Marie  Thomas,  William  Loadman; 

Chair/Discussant 

Award  Recipients  in  the  State  of  Ohio 

Ohio  State  University 

Kent  Runyan 

Pittsburg  State  University 

Exploring  the  Relationship  Between  Teacher 

Beverty  Klecker,  Eastern  Kentucky 

Empowerment  and  Teacher  Job  Satisfaction 

University,  William  Loadman,  Ohio  State 
University 

Teacher  Supply  and  Demand  in  the  US:  Analysis  of 

Bret  Barnard,  Maureen  Wrteon,  Ohio  State 

ASCUS  Data 

University 

Session  75 

Bandwagon  Metaphor:  Belief  as  Truth  in  the 
Phenomenon  of  Facilitated  Communication 

Alternative  Session  (Division  E) 

Mansion  House 

Chair 

Mark  Mostert,  Moorhead  State  University 

Sandra  Miller 
Illinois  State  University 

Discussant 

Dierdre  Jackson 
Bradley  University 

Session  76 

The  Debate  About  Empirical  and  Narrative  Inquiry: 
Should  Researchers  Strive  for  Balance? 

Forum  (Division  D) 

Columbian  House 

Deconstruction  and  reconstruction  of  complex  issues 

Ronald  Morgan,  Loyola  University - 

Chair 

associated  with  complex  empirical  and  narrative  research 

Chicago ; Linda  Behar-Horenstein, 

Ronald  Morgan,  Loyola 

methodologies  within  the  context  of  traditional,  modern, 

University  of  Florida:  Thomas  Parish, 

University-Ch\caQo 

and  postmodern  views. 

Kansas  State  University,  Jennifer 
Haworth,  Loyola  University-Chicago 

Session  77 

Thinking  about  Complexities:  Epistemology,  Moral 
Reasoning,  Cognitive  Flexibility,  and  Adult 

Paper  Session  (Division  C) 

Bull's  Head 

Development 

Chair 

Epistemology  and  Moral  Reasoning 

Marlene  Schommer,  Amit  Bajaj,  Linds 

Sarah  Peterson 

Bakken,  Wichita  State  University 

Northern  Illinois  State 

University 

Construct  and  Criterion-Related  Validity  of  Cognitive 

Ronna  Dillon,  Michael  Whittier,  Southern 

Flexibility 

Illinois  University 

Discussant 

Jean  Pierce 

Integrating  Child  and  Adult  Cognitive  Development  and 

Thomas  Pourchot,  M.  Cedi  Smith, 

Northern  Illinois  State 

Learning:  A Vygotskian  Perspective  on  Theory  and 

Northern  Illinois  University 

University 

Practice 
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RESEARCH  SESSIONS 

8:00  a.m.  - 9:20  a.m. 

Session  78 

State  Efforts  of  Educational  Reform 

Paper  Session  (Division  A) 

Fork's  House 

Essential  School  Restructuring  in  Illinois:  Lessons 

Frederick  Dawson,  Illinois  State  Board  of 

Learned  and  Barriers  Encountered 

Education 

Chair 

Peggy  Simpson 

The  Restructured  Kentucky  Department  of  Education- 

Feng  Din,  Union  College 

University  of  Cincinnati 

Does  It  Operate  Differently? 

Discussant 

Educational  Reform  Through  the  Implementation  of 

Richard  Reynolds,  Eastern  Connecticut 

Larry  McNeal 
Illinois  State  University 

National  Standards:  A Response 

State  University 

The  Difficulty  of  the  Educational  Task  in  Ohio  Public 
Schools 

Rich  Hoffman,  Miami  University  (OH) 

What  Should  be  the  State's  Role  in  Improving  Local 

Paul  Baker,  Dianne  Ashby,  Ron  William, 

Schools?  A Study  of  State  Mandated  Accountability  for 
Educational  Reform 

Illinois  State  University 

Session  79 

Diversity  Intervention 

Paper  Session  (Division  G) 

Lake  House 

The  Effects  of  Cultural  Sensitivity  Training  on  the 

Judith  Jackson-May,  Eugene  Sanders, 

Perceptions  of  Preservice  Teachers 

Bowling  Green  State  University 

Chair/Discussant 

Joan  Tknm,  University  of 

Wisconsin  Educational  Institutions'  Knowledge  of 

Maureen  Smith,  University  of  Wisconsin- 

Wisconsin-Oshkosh 

Wisconsin  American  Indian  Cultures  and  Issues: 
Compliance  with  Act  31 

Oshkosh 

The  Effect  of  Multicultural  Education  on  College 

Joan  Timm,  University  of  Wisconsin- 

Students'  Perception  of  Diversity  Issues 

Oshkosh 

Session  80 

The  True  Partnership  in  Education:  Teachers  with 
Teachers 

Symposium  (Division  K) 

American  House 

A discussion  of  the  evolution  and  impact  of  a partnership 

Carmen  Giebeihaus,  Dan  Raisch, 

Chair 

between  a suburban  school  district  and  university  faculty 

University  of  Dayton,  Jane  Chance, 

Carmen  Giebeihaus, 
University  of  Dayton 

members. 

Sharon  Angel,  Miamisburg  City  School 
District ; Patricia  Ward,  Nancy  Hamilton, 
and  Grace  Wilcox,  Miamisburg  H.S.  (OH) 
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Saturday  October  5, 1996 


PRESIDENTIAL  ADDRESS 

Session  81  9:30  a.m.  - 10:50  a.m.  Steamboat  Hotel 


Top  Ten  Problems  Facing 

Teacher  Education 

Gregory  Marchant 

Ball  State  University 

There  are  many  issues  and  obstacles  related  to  producing 
quality  beginning  teachers.  This  presentation  offers  ten 
challenges  to  teacher  education.  The  list  was  developed  in 
collaboration  with  Gary  Griffin,  University  of  Arizona.  The 
session  will  include  discussion  time  to  pursue  the  issues 
presented  and  to  consider  other  challenges  and  possible 
directions. 

Gregory  Marchant  received  his  Ph.D.  in  Teaching-Learning 
Processes  from  Northwestern  University  and  is  currently 
Associate  Professor  of  Educational  Psychology  at  Ball  State 
University.  He  was  chair  for  the  Midwest  Association  of 
Teachers  of  Educational  Psychology  and  is  currently  the 
President  of  the  Mid-Western  Educational  Research 
Association.  He  served  for  three  years  as  the  co-editor  of  the 
Mid-Western  Educational  Researcher,  and  serves  on  the 
editorial  board  of  several  journals.  He  is  also  the  Associate 
Editor  of  the  Newsletter  for  Educational  Psychologists 
(APA/Div,  15).  He  has  more  than  20  articles  and  50 
conference  presentations  on  motivation,  cooperative 
learning,  home  schooling,  teacher  perceptions,  teaching 
educational  psychology,  and  other  topics.  His  current 
research  focus  is  on  the  interaction  effects  of  parents, 
teachers,  and  schools  on  student  achievement 
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RESEARCH  SESSIONS 

9:30  a.m.  - 10:50  a.m. 

Session  84 

Computer  Technology  in  Research 

Demonstration  Session  (Division  D) 

Columbian  House 

Incorporating  Graphics,  Audio,  and  Video  Into  Your 
Worldwide  Web 

Jeffrey  Hecht,  Illinois  State  University 

Chalr/Dlscussant 

James  McCluskey, 

Free  Form  Data-Base  Management 

Sandra  Bland,  Jeffrey  Hecht,  Illinois  State 

University  of  Oklahoma 

University 

Issues  Arising  from  the  Use  of  National  Data  Sets  in 
Educational  Research 

Peggy  SimpGon,  University  of  Cincinnati 

Session  85 

Significant  Issues  in  Professional  Development 
Schools 

Symposium  (Division  C) 

Bull’s  Head 

This  session  will  focus  on  the  concept  and  practice  of 

Gail  Shroyer,  Sally  Yahnke,  Kansas  State 

Chair 

professional  development  schools  from  varying 

University,  Doyle  Barnes,  Ogdon 

Steven  Benton 

perspectives.  Among  these  perspectives:  the  university 

Elementary  School  (Ml);  Ronald  Crowell, 

Kansas  State  University 

supervisor,  principal,  and  clinical  teacher. 

Western  Michigan  University,  Donna 
Schonveld,  Prairieview  Elementary  (Ml) 

Session  87 

Program  Implementation  and  Evaluation:  Public 
School  and  College  Issues 

Paper  Session  (Division  H) 

Lake  House 

An  Evaluation  of  Michigan's  Systemic  Reform  Initiative: 

Mark  Fenster,  David  Kingsley,  Western 

Chair 

The  Michigan  Educational  Leadership  Collaborative  in  its 

Michigan  University 

John  Fraas 

First  Year 

Ashland  University 

How  Special  Education  Services  are  Delivered  in 

Feng  Din,  Union  College 

Discussant 

Kentucky  Public  Schools 

Isadora  Newman 

University  of  Akron 

Venture  Capital:  Public  School  Restructuring  in  Ohio 

Soonhwa  Yoo,  William  Loadman,  Ohio 
State  University 

The  Implementation  and  Evaluation  of  an  Alternative 

Barbara  Wharton,  William  Loadman,  Ohio 

High  School  Program 

State  University 

Mission  Statements:  Are  They  Synthesized  with  College 

Bonnie  Dunwoody,  Jeff  Breese,  Saint 

Courses? 

Mary's  College 

Session  88 

Technology  in  Teacher  Education 

Paper  Session  (Division  K) 

American  House 

Integrating  the  Internet  into  the  Teacher  Education 
Curriculum 

Marcia  Sheridan,  Indiana  University-South 
Bend 

Chair/Discussant 
Susan  Brookhart 
Duquesne  University 

Successful  Use  of  Computers  to  Teach  Writing:  First- 
Year  Teachers,  Technology  Integration,  and  Assessment 

Danilo  Baylen,  L.  Ruth  Struyk,  Northern 
Illinois  University 

Transforming  Teacher  Education,  Teaching  and  Student 
Learning  in  a Professional  Development  School 
Collaborative 

Carole  Newman,  Barbara  Moss,  University 
of  Akron 
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Session  89  Pedagogy  and  Cultural  Awareness  Paper  Session  (Division  K) 


Western  Stage  Elementary  Teachers'  Pedagogical  Content  Knowledge  Roberta  Fuller,  University  of  South  Florida 

in  Mathematics 

Chair/Discussant 

Perry  Lanier  Evaluating  Multicultural  Awareness  in  Presetvice  Janet  Sharp,  Iowa  State  University 

Michigan  State  University  Mathematics  Education  Classes 

Comparing  Knowledge,  Skills,  and  Confidence  of  Cross-  Johnnie  Thompson,  Linda  Bakken, 
Cultural  Interactions  of  Field-Based  and  Campus-Based  Joseph  Mau,  Wichita  State  University 
Preservice  Teachers 


Session  90 


Reflecting  on  Teachers  and  Teaching 


Paper  Session  (Division  K) 


Steamboat  Hotel  A Longitudinal  Study  on  Reflection  of  Preservice  Maria  Elena  Galvez-Martin,  Connie 

Teachers  Bowman,  Margaret  Morrison,  Ohio  StaU 

Chair/Discussant  University 

Joy  McCuHough 

Trinity  Western  University  Team  Teaching  in  an  Urban  High  School:  Reflections  on  Elizabeth  Lokon,  Miami  University-Ohio 

Teachers'  Work 


Maria  Elena  Galvez-Martin,  Connie 
Bowman,  Margaret  Morrison,  Ohio  State 
University 


Session  91 
Mansion  House 
Chair 

Joan  McGuire 
LaSalle  Elementary  (IL) 

Discussant 

Paul  Baker 

Illinois  State  University 


Session  92 
Columbian  House 
Chair 

William  Place 
University  of  Dayton 

Discussant 
Larry  McNeal 
Illinois  State  University 


Promoting  Schools  and  Students  Paper  Session  (Division  A) 

A Plan  to  Increase  Student  Enrollment  in  a Small  Rural  Meiva  Owens,  Wichita  State  University 
District 

Why  Urban  Students  Succeed  When  School  Becomes  Frederick  Hampton,  Cleveland  State 
Their  Extended  Families:  Project  F.A.S.T.  University 

A Marketing  Study  for  Riverdale  School:  Serving  a Randall  Turk,  Wichita  State  University, 

Culturally  Diverse  Community  Kathleen  Patterson,  Wichita  Catholic 

Diocese ; Mary  Treaster,  Fairfield  West 
Elementary  (KS) 

A Critical  Analysis  of  Four  Preschool  Programs:  Gay  Shipley,  Stephen  Oborn,  University  of 

Implications  for  School  Leadership  Dayton 

Preparation  of  Superintendents  and  School  Board  Paper  Session  (Division  A) 

Members 

Transformational  Leadership  and  Change  in  Education  Brian  Hinrichs,  Illinois  State  University 

Preparation  for  School  Board  Membership  Marilyn  Grady,  University  of  Nebraska- 

Lincoln 

Organizational  Socialization  Practices  of  the  Urban  Eugene  Sanders,  Bowling  Green  State 

School  Deputy  Superintendent  University 

Faculty  and  Student  Perceptions  of  a Cohort  Structure  Linda  Wesson,  Youngstown  State 
on  an  Educational  Leadership  Doctoral  Program:  A Four  University,  David  Holman,  David  Cox, 
Year  Review  Arkansas  State  University 
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Session  03  Some  Statistical  Considerations  Paper  Session  (Division  D) 


Bull’s  Head 
Chair 

Michael  Penrod,  Southeast 
Kansas  Education  Services 
Center 


Discussant 

Stephen  Benton,  Kansas 
State  University 


Investigation  of  the  Base  Rate  Problem  in  Predictive 
Efficiency  Indices  Associated  with  Logistic  Regression 
Models 

Parametric  and  Nonparametric  Tests  of  Interaction  in  the 
Split-Plot  Design  Under  Conditions  of  Nonnormality  and 
Covariance  Heterogeneity 

Single  Group  Repeated  Measures  Analyses:  Multiple 
Comparisons  Under  Bradley’s  Stringent  Criterion 


Irina  Soderstrom,  Dennis  Leitner,  Southern 
Illinois  University 


Mark  Beasley,  Saint  John's  University 


Robert  Barcikowski,  Ronald  Elliot,  Ohio 
University 


Session  04  Program  Evaluation:  Statistical  and  Validity  Issues  Paper  Session  (Division  H) 

Analyzing  Data  in  a Repeated  Measures  Design:  A John  Fraas,  Ashland  University,  Isadore 

Procedure  Used  to  Determine  jf  Aggregate  Data  Should  Newman,  University  of  Akron:  Katherine 

be  Analyzed  Benfield,  Gary  Benfield,  Akron  Children's 

Hospital  Medical  Center 

The  Use  of  Values  Measurement  Models  in  Discerning  Kristen  Hovsepian,  Ashland  University, 

Subcultural  Differences  Between  Professions  Rose  Beeson,  University  of  Akron:  Mary 

Nuosce,  Tri-County  Employer  Assistance 
Program 

An  Empirical  Test  of  the  Construct  Validity  of  the  Child  Sharon  Latkovich,  Ashland  University 

Behavior  Checklist 

Estimating  the  Construct  Validity  of  the  Survey  of  James  Saizman,  Ursuline  College:  Isadore 

Attitudes  and  Practices  of  Freshman  Composition  Newman,  University  of  Akron 

Modeling  Student  Success  with  the  Learning  and  Study  Amy  Hendrickson,  Gary  Phye,  Iowa  State 
Strategies  Inventory  (LASSI)  University 

Session  95  Issu  as  in  Elementary  School  Curriculum  Paper  Session  (Division  B) 


Fork's  House 

Chair/Discussant 
Katherine  Sparrow,  Akron 
Public  Schools 


Lake  House  Four  Years  of  Elementary  Bilingual  Summer  School  with  Sharon  McNeely,  Northeastern  Illinois 

a Special  Curriculum:  What  Worked,  What  Didn't  University 

Chair/Discussant 

Virginia  Goodman  Elementary  Teachers’  Perceptions  of  Inclusion  Mary  Ellen  Bargerhuff,  Miami  University 

Chicago  State  University  (OH) 

Strategies  that  Work  in  Literacy  Instruction  in  Rose  Mary  Scott,  University  of  Wisconsin- 

Multicultural  Elementary  Classrooms:  A Word  from  Parkside 

Preservice  Teachers 

The  Effect  of  Instructional  Interactions  on  Gender  Shirley  Ann  Freed,  Andrews  University 

Participation 

Online  Collaborative  Learning  Environments:  Review  and  Abbie  Howard  Brown,  Sonny  Kirktey, 
Assessment  Indiana  University 


Session  96  Preservice  Teachers'  Perspectives 


Paper  Session  (Division  K) 


American  House  The  Global  and  Content-Specific  Efficacy  of  Preservice  Stephen  Curda,  Leslie  Curda,  Paul  Kleine, 

T each  era  University  of  Oklahoma 

Chair/Discussant 

Lany  Krengei  Teacher  Effectiveness:  Views  of  Preservice  Teachers  Tom  Ganser,  University  of  Wisconsin- 

Northern  Illinois  University  Whitewater 

Influence  of  Preservice  Teachers'  Beliefs  about  Pupils  Ellen  Brantiinger,  Indiana  University 
and  Learning  on  Attitudes  Toward  Inclusion 
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Missing  Cells  in  Developmental  Research 


John  Delane  Williams,  The  University  of  North  Dakota 


Abstract 

The  use  of  missing  cells  in  longitudinal  research  is  addressed  and  a sample  is  given  using 
multiple  linear  regression  for  the  solution.  Applications  of  longitudinal  research  are  discussed  wherein 
logically  missing  cells  occur. 


Xhe  use  of  missing  cells  in  educational/psycho- 
logical research  would  appear  to  be  an  area  to  be  avoided; 
this  may  be  due  to  the  perceived  difficulty  (or  perhaps  pre- 
sumed impossibility)  of  attaining  a useful  result.  Yet  miss- 
ing cells  occur  naturally  in  many  settings.  In  many  cases, 
the  cells  are  missing  for  logical  reasons.  As  an  example  of 
missing  cells  in  an  educational  situation,  if  student  absences 
are  recorded  over  a two-year  period  at  a middle  school,  the 
following  data  may  be  collected: 


Table  1 

Data  Collection  for  Two-Year  Study 


* 

Year  1 

Year  2 

Grade  6 

Cell  1 

Cell  2 

Grade  7 

Cell  3 

Cell  4 

Grade  8 

Cell  5 

Cell  6 

Also,  since  persons  (typically)  advance  one  year  at 
a time,  Year  1 sixth  graders  (Cell  1)  become  Year  2 seventh 
graders  (Cell  4);  so  also,  Year  1 seventh  graders  (Cell  3) 
become  Year  2 eighth  graders  (Cell  6).  The  data  in  Table  1 
can  be  recast  into  a Cohort-by-Year  analysis. 


Table  2 

Cohort  by  Year  Analysis  for  Longitudinal  Data 


Year  1 

Year  2 

Cohort  1 

Cell  1 (6th  Grade) 

Cell  4 (7th  Grade) 

Cohort  2 

Cell  3 (7th  Grade) 

Cell  6 (8th  Grade) 

Cohort  3 



Cell  2 (6th  Grade) 

Cohort  4 
1 

Cell  5 (8th  Grade) 

Note  that  in  Table  2,  two  cells  are  missing;  Cohort  3 (6th 
graders;  Year  2)  are  not  measured  in  Year  1,  because  they 
have  not  yet  begun  middle  school.  Also,  Cohort  4 (8th  grade, 
Year  1)  are  not  measured  in  Year  2 because  they  are  no  longer 
in  middle  school. 

One  additional  layout  can  be  considered  for  the  cells 
in  Table  1,  Cohort-by-Grade.  See  Table  3. 

Table  3 

Cohort  x Grade  for  Developmental  Data 


Grade  6 

Grade  7 

Grade  8 

Cohort  1 

Cell  1 (Year  1) 

Cell  4 (Year  2) 

Cohort  2 

Cell  3 (Year  1) 

Cohort  3 

Cell  2 (Year  2) 

Cohort  4 

These  three  models  taken  together  are  often  referred 
to  as  the  Schaie  (1965)  models  (though  Schaie  did  not  actu- 
ally analyze  data  with  missing  cells).  Also,  since  the  same 
persons  are  used  in  Cohorts  1 and  2,  more  precision  can  be 
gained  by  using  each  person  as  their  own  control.  In  terms 
of  using  a regression  solution,  a person  variable  can  be  ob- 
tained by  summing  the  criterion  measure  at  both  measure- 
ment periods:  P = Y,  + Y2  where 

Y,  = the  Year  One  criterion  measure 

(here,  number  of  absences); 

Y2  = the  Year  Two  criterion  measure. 

For  persons  in  the  cohorts  measured  once,  P = 0. 
(See  Pedhazur,  1977;  Williams,  1977b;  Newman,  Benz,  & 
Williams,  1980;  Williams  & Williams,  1985;  Williams, 
1991). 

For  a complete  solution  to  this  problem,  Williams 
(1991)  shows  a regression  solution.  It  would  be  helpful  to 
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Other  Uses  of  Missing  Cells 


address  one  of  the  layouts  with  missing  cells  to  get  a flavor 
of  the  solution.  To  fully  analyze  the  data,  all  three  layouts 
need  to  be  completed.  Also,  no  assumption  is  made  regard- 
ing proportionality;  it  would  most  likely  be  that  such  data 
will  be  disproportional  to  some  extent. 

Several  binary  variables  can  be  useful.  Six  binary 
variables  can  be  constructed  for  cells  of  the  form  X.  = 1 if 
from  Cell  i,  0 otherwise.  For  example,  for  i = 1 , = 1 if 

from  Cell  1,  0 otherwise.  Six  such  cell  variables  can  be 
defined.  A full  model  (or  cells  model)  could  be  given  by: 

Y = b0  + bjX,  + b2X2  +...+  b5X5  + er  (1) 

Note  that  equation  1 uses  only  the  first  five  cells,  as  the  sixth 
cell  is  defined  as  not  being  a member  of  the  first  five  cells. 
Also  Y refers  to  a criterion  score,  whether  it  be  Y,  or  Yr 

The  Person  effect  can  be  found  as 

Y = bjP  + e2.  (2) 

where  P is  the  summed  variable  described  earlier. 

A year  variable  can  also  be  used:  X7  - 1 if  from 
Year  1, 0 if  from  Year  2.  The  year  model  can  be  given  as: 

Y = b0  + b7X7  + e3.  (3) 

The  Cohort  effect  can  be  found  as: 

Y = b0  + b,C,  + b,C2  + b10C3  + e4.  (4) 

where  the  C.’s  represent  cohorts  1,  2,  and  3 as  binary  vari- 
ables, omitting  (as  redundant)  Cohort  4. 

The  restricted  model  for  the  interaction  effect  for 
Cohort  by  Year  can  be  found  as 

Y = b0  + b„X7  + bliC1+b13C2  + b14C3  + e5.  (5) 

Typically,  the  sum  of  squares  can  be  found  directly  from  the 
output  of  most  general  purpose  multiple  regression  programs. 
They  can  also  be  found  as: 

(SS-pX/fj1)  for  the  Person  effect; 

(SST)(J? ,2)  for  the  Cell  effect; 

(sstx*32>  for  Year  effect; 

(SStX*42  ) for  the  Cohort  effect;  and 

(SS-pX/fj1  - Rf ) for  the  Interaction  effect. 

The  hypotheses  tested  here  are  weighted  for  cell  size 
(Jennings,  1967;  Williams,  1972;  Williams,  1977a).  For 
unweighted  cell  sizes  (Timm  & Carlson,  1975)  see  Will- 
iams (1991).  Only  one  part  of  the  analysis  is  shown  here, 
for  the  Cohort  x Year  layout.  The  Grade  x Year  layout  pre- 
sents no  new  complications,  but  the  Year  x Cohort  layout 
has  several  missing  cells,  precluding  fi»  ..’mg  a Year  x Co- 
hort interaction. 


The  regression  solution  for  one  missing  cell  in  a 2 
x 3 layout  was  shown  in  Williams  (1981).  Logically  miss- 
ing cells  were  addressed  in  Williams  and  Wali  (1979)  to- 
gether with  the  way  multiple  missing  cells  can  affect  de- 
grees of  freedom. 

An  example  of  the  Williams  (1991)  regression  so- 
lution to  the  Schaie  (1965)  models  was  done  in  Williams 
and  Klug  (in  press).  The  longitudinal  data  addressing  cog- 
nition and  aging  collected  by  Schaie  (1983)  wherein  per- 
sons dr acp  25  woe  tested  cn  the  Thurstone  Primary 
Mental  Abilities  tests  in  the  Seattle  study.  The  study  was 
begun  in  1956  and  persons  were  tested/retested  every  seven 
years.  To  this  date,  six  testing  periods  have  been  completed. 
Williams  and  Klug  (in  press)  used  the  first  four  testing  peri- 
ods, contrasting  cross-sectional  outcomes  with  longitudinal 
sequential  outcomes  (where  persons  were  available  on  mul- 
tiple occasions)  and  longitudinal  cross-sectional  groups 
which  were  persons  chosen  at  each  time  of  measurement. 
The  latter  two  designs  were  analyzable  by  methods  described 
by  Williams  (1991);  all  three  methods  gave  clearly  different 
outcomes;  the  cross-sectional  method  yielded  results  that 
could  be  construed  to  be  consistent  with  Birren  (1959)  and 
Salthouse’s  (1985)  theory  of  cognitive  decline  with  aging. 
The  longitudinal  sequential  method  showed  that  cohorts  were 
relatively  stable  over  time,  showing  decline  for  the  most  p;>rt 
for  advanced  ages  (>  80).  The  longitudinal  cross-sectional 
method  yielded  results  intermediate  to  the  other  two. 
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Hierarchical  Modeling  Techniques 
to  Analyze  Contextual  Effects: 

What  Happened  to  the  Aptitude  by  Treatment  Design? 


Janet  K.  Sheehan  and  Tianqi  Han,  Northern  Illinois  University 


Abstract 


This  article  contrasts  two  analytical  methods  for  making  cross-level  inferences  between  individual-level 
factors  and  group-level  factors  in  school-effectiveness  research,  the  aptitude  by  treatment  interaction 
design  and  hierarchical  linear  modeling . Although  the  aptitude  by  treatment  interaction  method  is  suit- 
able for  making  cross-level  inferences  when  the  intraclass  correlations  are  low,  partitioning  the  interac- 
tion into  within-and  between-contexts  components  is  recommended  to  discern  if  the  interaction  is  due  to 
confounding  contextual  effects. 


Hierarchical  linear  modeling  is  the  recommended 

technique  when  intraclass  correlations  are  high,  because  the 
parameters  are  assumed  to  be  unique  for  each  context  and 
are  modeled  accordingly.  Further,  the  shrinkage  estimates 
of  the  parameters,  are  more  precise  than  those  estimated 
through  ordinary  least  squares  analysis. 

Contextual  Effects 

Educational  data  are  often  collected  at  the  individual 
level,  yet  a cluster  sampling  design  is  used  which  involves 
first  selecting  groups  of  schools  and/or  classes  and  subse- 
quently sampling  individuals.  This  results  in  hierarchical 
data  in  which  some  variables  are  measured  at  the  individual 
level  and  others  at  the  group  level.  Since  the  group-level 
variables  are  nested  within  specific  contexts  such  as  ciasses, 
schools,  or  neighborhoods,  it  is  reasonable  to  assume  that 
the  context  itself  exerts  some  influence  on  individual-level 
variables  resulting  in  positive  intraclass  correlations.  If  the 
context  is  ignored  in  the  statistical  model,  then  there  is  the 
strong  possibility  of  confounding  effects  operating  at  the 
class,  school,  or  neighborhood  level.  These  are  known  as 
contextual  effects. 

A plausible  school-effects  study  will  be  considered  as 
an  example  of  contextual  effects.  In  this  example  the  pur- 
pose is  to  investigate  the  effects  of  instructional  technology 
(a  nominal  variable  reflecting  multimedia  and  computer  tech- 
nology, computer  technology  only,  and  no  technology)  in 
the  schools  on  pupil  achievement.  It  is  further  expected  that 
the  effects  of  instructional  technology  will  be  different  de- 
pending on  the  type  of  home  environment  the  student  comes 
from  (a  composite  variable  including  such  factors  as  the  time 
spent  talking  with  parents  about  schoolwork,  reading  at  home, 
using  educational  computer  programs,  and  watching  educa- 
tional television).  The  outcome  is  the  student’s  composite 


score  on  a standardized  achievement  test.  Achievement  is 
being  modeled  as  a function  of  an  individual-level  variable, 
home  environment,  and  a group-level  variable,  level  of  in- 
structional technology.  However,  there  are  contextual  ef- 
fects operating  at  the  school  level  that  may  influence  achieve- 
ment other  than  instructional  technology.  The  level  of  vio- 
lence in  the  schools,  the  proximity  of  the  school  to  a major 
university,  and  whether  the  school  is  public  or  private  are  a 
few  of  the  other  possible  school-level  influences  on  achieve- 
ment. If  we  were  able  to  randomly  assign  schools  to  the 
different  instructional  technologies,  we  could  assume  that 
over  the  long  run,  the  influence  of  these  contextual  vari- 
ables on  achievement  would  be  equivalent  for  each  assigned 
group.  However,  the  practice  of  interest  is  not  often  ran- 
domly assigned  to  the  classes  or  schools  in  educational  re- 
search, and  therefore  is  confounded  by  other  contextual  ef- 
fects. 

The  purpose  of  this  paper  is  to  contrast  two  analytical 
methods,  the  aptitude  by  treatment  interaction  design  (ATI) 
and  hierarchical  linear  modeling  (HLM),  for  making  cross- 
level inferences  between  individual-level  factors  and  group- 
level  factors.  This  article  summarizes  the  important  issues 
surrounding  the  use  of  each  of  these  methods  and  discusses 
the  appropriateness  of  each  technique  in  school-effective- 
ness research. 

Aptitude  by  Treatment  Interaction 

One  common  analysis  method  that  has  been  used  for 
models  in  which  there  is  boih  an  individual-level  predictor 
and  a group-level  predictor  is  the  ATI  design.  In  the  ATI 
model,  the  individual-level  outcome  (achievement)  is  mod- 
eled by  an  individual- level  predictor  (aptitude),  a group-level 
treatment,  and  the  interaction  of  aptitude  and  treatment.  The 
interaction  term  is  usually  of  most  interest,  because  it  tests 

962 


Mid-Wettem  Educational  Researcher 


Volume  Number  4 • Fill  1996 


whether  the  relationship  between  aptitude  and  achievement 
varies  for  the  different  treatment  groups.  Using  the  school- 
effects  study  previously  mentioned,  the  ATI  is  the  differ- 
ence in  the  home  environment-achievement  relationship 
among  the  different  levels  of  instructional  technology. 

The  conventional  form  of  the  ATI  parameter  model 
that  is  employed  in  much  educational  research  is 

YrPt+|i,XI+p1Tj+|JJX1Tj+8s  (1) 

In  this  model  each  individual’s  outcome  score  is  a func- 
tion of  aptitude  (X),  and  treatment  group  (T)  and  the  inter- 
action of  treatment  and  aptitude  (XT).  However,  this  model 
disaggregates  the  data  to  the  individual  level,  since  the  con- 
text (classes  or  schools)  are  not  included  in  the  model.  The 
major  problem  that  disaggregation  poses  is  that  the  data  vio- 
late the  assumption  of  independence  of  observations.  There- 
fore positive  intraclass  correlations  are  being  ignored.  This 
is  a nontrivial  matter  resulting  in  underestimated  standard 
errors  and  inflated  type  I error  in  tests  of  significance  (Bryk 
& Raudenbush,  1992;  De  Leeuw  & Kreft,  1986;  Draper, 
1995;  Cheung,  Keeves,  Sellin&Tsoi,  1990). 

In  the  home  environment/instructional  technology 
example,  the  conventional  ATI  model  would  be  appropriate 
if  we  were  sure  that  the  different  schools  within  each  type  of 
instructional  technology  were  of  similar  contexts  and  inter- 
acted with  home  environment  in  a consistent  fashion.  How- 
ever, the  conventional  model  would  not  be  applicable  if  there 
were  contextual  effects.  A significant  interaction  due  to 
contextual  effects  may  erroneously  be  attributed  to  other 
group-level  variables.  Conversely,  the  interaction  of  apti- 
tude by  treatment  may  be  masked  by  different  contexts.  This 
occurs  because  in  the  conventional  form  of  the  ATI  model 
we  assume  the  (33  to  be  equal  for  all  contexts  (classes  or 
schools)  within  each  treatment  or  practice.  However,  this 
assumption  would  often  not  be  appropriate  because  of  dif- 
fering contextual  effects  in  the  classes  or  schools.  In  this 
example,  the  interaction  of  instructional  technology  and 
home  environment  on  achievement  may  differ  depending 
on  another  school-level  variable  such  as  the  school  climate 
(a  composite  variable  reflecting  such  factors  as  school  ab- 
senteeism, student  violence,  alcohol  and  illicit  drug  use,  gang 
prevalence,  weapon  prevalence,  and  teacher  abuse).  Per- 
haps a poor  school  climate  would  mask  the  interaction  of 
type  of  instructional  technology  and  home  environment.  In 
schools  with  a good  school  climate,  students  from  an  im- 
poverished home  environment  might  benefit  more  from  the 
use  of  instructional  technology  than  students  from  an  en- 
riched home  environment.  However,  when  the  school  cli- 
mate is  poor,  the  use  of  instructional  technology  may  not 
have  a beneficial  effect  on  achievement  for  any  of  the  stu- 
dents. In  this  example  we  cannot  assume  that  the  ATI  effect 
is  consistent  for  different  schools,  because  school  climate 
masks  the  ATI  effect  in  some  schools. 

Cronbach  and  Webb  (1975)  addressed  this  problem 
of  confounding  contextual  effects  by  partitioning  the  ATI 


interaction  into  between-context  and  with  in-context  com- 
ponents. The  between-context  component  is  determined  by 
aggregating  the  data  to  the  class  or  school  level  for  the  re- 
gression analysis.  Hence  the  mean  of  Y is  regressed  on  the 
mean  of  X,  the  treatment,  and  their  interaction  (2).  The 
within-context  regression  is  formed  by  first  deviating  the 
scores  of  the  individual-level  predictor  from  the  class  or 
school  mean  (X..-X),  and  regressing  the  outcome  on  the  de- 
viated scores,  the  treatment  variable,  and  their  interaction 

(3). 

(2) 

WftWWM  «> 

Cronbach  and  Webb  demonstrated  that  very  different 
conclusions  can  be  reached  when  the  conventional  ATI 
analysis  is  replaced  with  such  a partitioned  analysis.  They 
disconfirmed  the  findings  of  a previous  study  which  had 
detected  a significant  ATI  for  the  effects  of  instructional 
method  on  the  aptitude-math  achievement  relationship 
(Cronbach  & Webb).  Cronbach  and  Webb’s  reanalysis  of 
these  data  found  that  there  was  no  evidence  for  a within- 
classes  ATI  and  no  conclusion  could  be  reached  about  the 
between-classes  analysis. 

The  within-context  ATI  is  most  commonly  of  interest 
when  one  wants  to  investigate  the  interaction  effect  of  some 
type  of  class  or  school  practice  and  aptitude  on  an  outcome 
measure.  In  the  example  outlined  previously  the  within- 
context  interaction  would  be  the  difference  in  the  home  en- 
vironment-achievement relationship  between  students  receiv- 
ing different  levels  of  instructional  technology,  when  con- 
trolling for  the  average  home  environment  students  in  the 
school  come  from.  The  between-context  model,  on  the  other 
hand,  would  be  the  difference  in  the  average  home  environ- 
ment-achievement relationship  among  the  different  levels 
of  instructional  technology.  Since  scores  are  aggregated  to 
the  group  level,  the  within-school  information  is  lost.  Addi- 
tionally, aggregation  bias  often  results  in  a dramatic  increase 
in  the  correlation  between  variables  (Robinson,  1950).  De- 
spite this  limitation,  the  separate  analyses  approach  used  by 
Cronbach  and  Webb  (1975)  and  detailed  by  Cronbach  and 
Snow  (1977)  can  be  effectively  employed  to  interpret  ATI 
effects  from  hierarchically  nested  samples,  particularly  when 
intraclass  correlations  are  low. 

Multilevel  Modeling 

Another  technique  which  has  been  used  to  make  cross- 
level inferences  in  school-effects  study  is  multilevel  model- 
ing. Multilevel  modeling  has  particular  merit  when  analyz- 
ing data  which  has  high  intraclass  correlations  due  to  the 
hierarchically  nested  structure  of  the  data.  When  analyzing 
data  with  intraclass  correlations  using  conventional  regres- 
sion analysis,  the  data  are  forced  to  fit  a model  that  does  not 
reflect  how  they  were  collected.  Conversely,  multilevel  tceh- 
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niques  draw  strength  from  appropriately  modeling  the  data 
at  each  level  of  the  sampling  design.  In  multilevel  modeling 
a separate  micro-level  model  is  defined  for  each  macro  unit. 
In  a school-effects  study  this  would  mean  that  within-school 
regression  coefficients  are  modeled  by  school-level  variables 
(De  Leeuw  & Kreft,  1986). 

Random  Coefficients  Models 

A particular  type  of  multilevel  model  that  is  often  used 
to  make  cross-level  inferences  is  one  in  which  the  regres- 
sion coefficients  are  not  assumed  to  be  constant  for  all  con- 
texts. In  the  multilevel  analysis  literature  these  models  are 
alternately  called  random  line  models,  slopes  and  intercepts 
as  outcomes,  and  random  coefficient  models.  These  multi- 
level models  circumvent  a limitation  of  the  ATI  separate 
analyses  approach,  the  assumption  that  the  interaction  is  as- 
sumed to  be  homogeneous  for  all  contexts  within  a particu- 
lar group.  However,  logic  would  dictate  that  the  ATI  would 
be  different  across  schools,  because  strategies  and  policies, 
as  well  as  environmental  factors,  often  vary  from  school  to 
school.  In  random  coefficient  regression  models,  the  pa- 
rameters are  allowed  to  differ  over  the  different  schools  and 
are  treated  as  a function  of  school  characteristics  and  ran- 
dom but  unique  school  variations  that  are  assumed  to  be 
constant  in  the  ATI  model. 

In  addition  to  providing  a more  realistic  model  of  the 
data,  the  random  coefficients  model  is  technically  also  an 
improvement  over  the  conventional  multiple  regression 
model  because  it  calculates  the  correct  standard  errors. 
Moreover,  the  random  coefficients  model  improves  the  esti- 
mation of  the  parameters  for  the  separate  schools.  An  em- 
pirical Bayes  estimation  procedure  is  used  to  weight  the  re- 
gression coefficient  estimates  of  each  school  by  a reliability 
coefficient  calculated  for  each  school.  This  process  is  known 
as  shrinkage  because  the  estimates  are  “shrunk”  toward  the 
estimated  group  mean  coefficients.  Those  schools  provid- 
ing less  reliable  estimates  experience  the  most  shrinkage 
(Cheung,  Keeves,  Sellin  & Tsoi,  1990;  Raudenbush,  1988). 
The  resulting  shrinkage  estimates  are  more  precise  param- 
eter estimates  than  those  generated  through  ordinary  least 
square  methods. 

The  simplest  random  coefficients  model  is  one  in  which 
there  is  an  individual-level  predictor  (X),  but  no  group-level 
predictors  (Bryk&  Raudenbush,  1992). 

Y..=Pn.+p..(X..-X.)+r. 

y Koj  y y u 

Poj^00+U0j 

P,fY,o+u.j  <4> 

In  a school-effects  study,  the  first  equation  is  the  mi- 
cro-level model,  in  which  a student-level  outcome  variable 
is  a function  of  a student-level  predictor,  (X.-X.),  and  the 
unique  effect  of  the  student,  r.  The  subsequent  equations 


are  the  macro-level  models  which  illustrate  how  the 
microparameters,  p0  and  p,  are  modeled  by  school-level  ef- 
fects. P0.  is  modeled  as  a function  of  the  average  outcome 
across  tfie  schools,  y^,  and  the  unique  effect  of  school  j on 
the  mean  outcome,  m0j.  p/;  is  modeled  as  a function  of  the 
average  slope  of  the  predictor-criterion  relationship  across 
the  schools,  y/0,  and  the  unique  effect  of  each  school  j on  the 
predictor-criterion  slope,  mjr  This  model  can  be  extended 
to  include  other  variables  at  both  the  micro-level,  as  well  as 
the  macro-level.  Therefore,  these  models  can  be  very  useful 
for  modeling  cross-level  inference.  A random  coefficients 
model  that  would  appropriately  partition  the  ATI  into  within- 
and  between-context  components  is  (Raudenbush,  1989): 

Y.  =Pn.+P . .(X..-X.)+r.. 

U r0j  “lj'  y y y 

PorY  OO+Y  0 1 03^j^j+U0j 

P i 

In  this  multilevel  model,  yw  is  the  between-contexts 
interaction,  while  yn  is  the  within-contexts  interaction1. 
Therefore,  the  ATI  interaction  can  be  partitioned  into  within- 
and  between-contexts  components,  while  still  allowing  for 
unique  variation  among  schools.  Other  contextual  variables 
can  also  be  included  in  the  macromodels  to  account  for  some 
of  the  variation  unique  to  each  school.  For  instance,  school 
climate  might  be  included  in  the  example  previously  given 
to  determine  if  the  interaction  between  home  environment 
and  instructional  technology  is  masked  by  school  climate. 

Recommendations  and  Conclusions 

The  ATI  analysis  method  is  suitable  for  making  cross- 
level  inferences  when  the  intraclass  correlation  is  low,  and 
therefore  the  macro-level  units  are  assumed  to  have  a con- 
stant predictor-criterion  relationship  within  each  group.  If 
there  are  any  contextual  effects,  the  partitioning  of  the  inter- 
action into  within-  and  between-context  components  can  aid 
in  determining  what  factors  are  contributing  to  the  interac- 
tion. 

Hierarchical  linear  modeling  is  the  recommended  tech- 
nique when  intraclass  correlations  are  high,  and  are  not  as- 
sumed to  have  a constant  predictor-criterion  relationship 
within  each  group.  The  main  advantage  of  HLM  techniques 
in  this  situation  is  that  the  parameters  are  assumed  to  be 
unique  for  each  context  and  are  modeled  accordingly.  Fur- 
ther, the  shrinkage  estimates  of  the  parameters  are  more  pre- 
cise than  those  estimated  through  ordinaiy  least  squares 
analysis. 

Whichever  method  is  used  to  analyze  the  ATI  in 
school-effects  studies,  one  must  keep  in  mind  that  most 
school-effects  research  is  quasi-experimental.  Students  are 
not  randomly  assigned  to  schools,  and  schools  are  not  often 
randomly  assigned  to  treatment  or  practice.  Therefore,  con- 
founding effects  operating  at  the  student  level  and  the  school 


1 Simplifying  into  one  equation  we  arrive  at  V)^+YotX)+Yn5Tj+YnVXjT+Y1(,(Xij-X|)+Y11(X5-X|)T+u^+ulj(X  .-XJ)+rj 
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level  may  bias  variance  estimates  and  parameter  estimates. 
This  problem  is  exacerbated  when  one  cannot  define  a set  of 
reliable  and  valid  measures  to  assess  the  school  practice  that 
is  of  interest  (Raudenbush  & Willms,  1995). 
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Semi-Partial  Correlations : 

I Don ’t  Need  Them;  You  Can  Have  Them 

Thomas  R.  Knapp,  The  Ohio  State  University 

Prologue 

l have  been  teaching  statistics  and  associated  topics  ( measurement , research  design)  for  37 
years  and  have  contributed  to  the  methodological  literature  on  such  matters.  During  that  time  I have 
managed  to  get  along  without  knowing  or  caring  very  much  about  a variety  of  techniques , most  notably 
exploratory  data  analysis , Bayesian  inference ; expected  values  of  mean  squares,  and  item  response  theory. 
In  the  essay  that  follows  I talk  about  another  one:  semi-partial  correlations. 


What  are  semi-partial  correlations? 

As  explained  very  nicely  by  Cohen  and  Cohen  ( 1 983), 
Darlington  (1990),  and  others,  a semi-partial  correlation  be- 
tween an  independent  variable  X and  a dependent  variable 
Y,  is  the  correlation  between  Y and  the  “residualized”  vari- 
able X.W  for  which  the  effect  of  a covariate  W on  X has 
been  removed  (partialled  out,  statistically  controlled,  etc.) 
from  X (but  not  from  Y).  This  semi-partial  correlation  (called 
a “part”  correlation  by  some  authors,  e.g.,  McNemar,  1962) 
and  its  square  are  said  to  be  the  best  indicators  of  an  inde- 
pendent variable’s  “unique”  contribution  to  the  prediction 
or  explanation  of  the  dependent  variable.  Darlington  lists 
five  ways  for  determining  the  relative  order  of  importance 
of  independent  variables  in  a multiple  regression  analysis, 
and  he  comes  down  in  favor  of  focussing  on  semi-partial 
correlations. 

Cohen  and  Cohen  include  in  their  text  several  Venn 
diagrams,  or  “ballantines”  (named  after  the  logo  for  a beer 
that  is  no  longer  brewed),  that  are  alleged  to  be  helpful  in 
determining  “variance  accounted  for”  and  in  distinguishing 
semi-partial  correlations  from  partial  correlations. 


Why  1 don’t  need  them 

There  are  several  reasons  why  I have  little  or  no  inter- 
est in  semi-partial  correlations.  First  and  foremost,  an  inde- 
pendent variable’s  semi-partial  correlation  with  a dependent 
variable  can  be  shown  to  be  mathematically  identical  to  the 
square  root  of  the  difference  in  R-squares  for  the  “full  model” 
hierarchical  regression  in  which  the  variable  under  consid- 
eration is  entered  last  and  the  “reduced  model”  that  includes 
all  of  the  other  variables  (covariates)  that  are  to  be  statisti- 
cally controlled.  (See,  for  example,  Pedhazur  (1982),  pp. 
1 19-123.)  1 am  a strong  advocate  of  hierarchical  regression 
analysis.  1 believe  that  the  most  interesting  educational  re- 
search questions  are  of  the  form:  “What  is  the  effect  of 

over  and  above  the  effect  of ?”.  I accordingly  find 

change  in  R-square  to  be  a more  intuitively  appealing  no- 


tion than  a squared  semi-partial  correlation  coefficient,  and 
since  the  two  at£  mathematically  identical  I prefer  the  former. 

Another  reason  I don’t  like  to  emphasize  semi-partial 
correlations  has  to  do  with  the  concept  of  a residualized  vari- 
able. Intellectualizing  raw  variables,  deviation  variables, 
standardized  variables,  log-transformed  variables,  etc.  is  dif- 
ficult enough.  The  notion  of  “X  without  W”,  which  under- 
lies the  proper  interpretation  of  a semi-partial  correlation, 
boggles  my  mind. 

A third  reason  why  I don’t  get  excited  about  semi- 
partial  correlations  is  that  unlike  partial  correlations  they  seem 
to  be  useful  only  in  regression  analyses.  Everybody  cares 
about  the  partial  correlation  between,  say,  height  and  read- 
ing achievement,  with  age  partialled  out  from  both  variables, 
as  a device  for  detecting  spurious  relationships.  But  semi- 
partial  correlations  only  arise  in  a regression  context  where 
one  of  the  variables  is  a response  and  all  of  the  others  are 
explanatory. 

A fourth  reason  has  to  do  with  those  “ballantines”.  The 
variance  of  Y is  not  a thing  that  ca  be  sliced  up;  it  is  an 
abstract  statistical  entity.  By  depicting  overlapping  circles 
with  one  piece  “accounted  for”  by  this  and  another  piece 
“accounted  for”  by  that,  there  is  a serious  danger  of  imput- 
ing causality  that  may  not  be  warranted  (in  most  non-ex- 
perimental  research,  for  example). 

A fifth  reason,  associated  with  my  second  reason,  is 
that  I already  have  enough  important  statistical  concepts  to 
clutter  up  my  brain  without  adding  another  one  unless  it  is 
absolutely  necessary.  As  Yogi  Berra  once  said,  a baseball 
player  has  just  so  many  hits  coming  to  him  each  year,  so 
why  waste  any  of  them  in  spring  training. 


You  can  have  them  (if  you  want  them):  An  example 

Consider  the  simple  hypothetical  example  exploited 
by  Darlington  in  Chapter  2 of  his  excellent  regression  text. 
A researcher  is  interested  in  the  effect  of  exercise  on  weight 
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loss  over  and  above  (statistically  controlling  for)  food  intake. 
The  sample  data  for  10  subjects  are  displayed  in  Table  1. 

Table  1. 

Some  data  for  illustrating  semi-partial  correlation 
(Darlington,  1990,  p.  33) 


ID 

Exercise  (X)* 

Food  intake  (W)* 

Weight  loss  (Y) 

1 

0 

2 

6 

2 

0 

4 

2 

3 

0 

6 

4 

4 

2 

2 

8 

5 

2 

4 

9 

6 

2 

6 

8 

7 

2 

8 

5 

V 

8 

4 

4 

11 

9 

4 

6 

13 

10 

4 

8 

9 

* Darlington  calls  these  two  variables  Xt  and  X2,  respec- 
tively, but  I prefer  the  X and  W notation. 


At  the  end  of  Chapter  2 Darlington  gives  equivalent 
formulas  for  semi-partial  correlations,  as  well  as  formulas 
for  partial  correlations  and  beta  weights.  I don’t  need  those 
formulas  for  semi-partial  correlations  (do  you?),  but  in  fair- 
ness to  those  who  do,  it  is  instructive  to  note  the  similarities 
among  the  formulas  for  semi-partial  correlations,  partial 
correlations,  and  beta  weights  (same  numerators,  different 
denominators). 

Later  in  his  text  Darlington  discusses  hypothesis  test- 
ing and  estimation  for  various  regression  statistics  (Chapter 
5)  and  provides  his  argument  for  preferring  semi-partial  cor- 
relations (Chapter  9)  as  indicators  of  the  relative  importance 
of  independent  variables  in  a regression  (as  opposed  to 
change  in  R-square  and  three  other  methods  for  ranking  re- 
gressors). Reference  to  semi-partial  correlations  per  se  is 
interestingly  absent  in  Chapter  5,  but  he  does  provide  the 
formula  for  testing  the  significance  of  change  in  R-square 
(which  implicitly  tests  the  significance  of  a semi-partial  cor- 
relation). 


Epilogue 

The  probability  is  very  small  that  the  foregoing  re- 
marks will  sway  all  readers  of  this  journal  to  my  point  of 
view.  I am  a methodological  loner  (you  should  hear  me  ex- 
pound on  my  idiosyncratic  notion  of  validity!)  and  I rather 
enjoy  being  in  that  position.  But  if  nothing  else  I hope  that 
this  essay  may  serve  to  generate  some  interesting  discus- 
sion. Isn’t  that  what  it’s  all  about? 


Darlington  provides  the  reader  with  eight  informative 
plots  of  the  data.  The  first  is  a simple  scatter-plot  of  Y against 
W.  The  next  two  are  the  conventional  three-dimensional 
plots,  one  without  and  one  with  the  best-fitting  plane  super- 
imposed. The  fourth  figure  again  plots  Y against  W,  with 
the  X values  shown  by  parallel  lines  in  the  body  of  the  fig- 
ure; the  fifth  figure  plots  Y against  X,  with  the  W values 
shown  by  parallel  lines.  The  sixth  figure  is  a simple  scatter- 
plot  of  X against  W.  The  seventh  figure  plots  Y against 
W.X;  and  the  eighth  figure,  which  is  the  key  figure  regard- 
ing the  semi-partial  correlation  for  the  research  question,  plots 
Y against  X.W. 

I need  only  the  first  three  figures  to  make  geometrical 
sense  of  what  is  going  on.  (How  about  you?)  And  algebra- 
ically (or  arithmetically)  1 need  the  Pearson  r and  its  square 
for  the  reduced-model  first  plot  (they  are  .047  and  .002,  re- 
spectively— the  covariate  W actually  had  very  little  effect) 
and  the  multiple  R and  its  square  for  the  full-model  second 
and  third  plots  (they  are  .915  and  .838,  respectively).  There- 
fore the  magnitude  of  the  effect  of  X on  Y over  and  above 
W is  given  by  the  difference  between  the  .838  and  the  .002 
(.836,  which  is  equal  to  the  squared  semi-partial  correlation) 
and/or  the  square  root  of  that  difference  (.914,  which  is  the 
semi-partial  correlation  itself). 
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Precision  Power  and  Its  Application  to  the  Selection  of 

Regression  Sample  Sizes 

Gordon  P.  Brooks  and  Robert  S.  Barcikowski,  Ohio  University 


Abstract 

Because  of  contradictions  among  the  various  methods,  sample  size  selection  in  multiple  regres- 
sion has  been  problematic . For  example,  how  does  one  reconcile  the  difference  between  a 15:1  subject - 
to -variable  rule  and  a 30:1  rule?  The  purpose  of  this  paper  is  to  analyze  the  advantages  and  disadvan- 
tages of  the  various  methods  of  selecting  sample  sizes  in  regression.  A discussion  of  the  importance  of 
cross-validity  to  prediction  studies  will  be  followed  by  descriptions  of  the  three  categories  of  sample  size 
methods:  cross-validation  approaches,  rules-of-thumb,  and  statistical  power  methods:  A rationale  will 
then  be  developed for  the  application  of  precision  power  to  multiple  regression , leading  to  the  presenta- 
tion, through  multiple  examples,  of  the  precision  power  method  for  sample  size  selection  in  prediction 
studies. 


Most  researchers  who  use  regression  analysis  to  de- 
velop prediction  equations  are  not  only  concerned  with 
whether  the  multiple  correlation  coefficient  or  some  particu- 
lar predictor  is  significant,  but  they  are  also  especially  con- 
cerned with  the  generalizability  of  the  regression  model  de- 
veloped. However,  the  process  of  maximizing  the  correla- 
tion between  the  observed  and  predicted  criterion  scores  re- 
quires mathematical  capitalization  on  chance;  that  is,  the 
correlation  obtained  is  a maximum  only  for  the  particular 
sample  from  which  it  was  calculated.  If  the  estimate  of  the 
population  multiple  correlation  decreases  too  much  in  a sec- 
ond sample,  the  regression  model  has  little  value  for  predic- 
tion. Because  of  this  possibility,  researchers  must  ensure 
that  their  studies  have  adequate  power  so  that  results  will 
generalize;  the  best  way  to  ensure  this  power,  and  therefore 
stable  regression  weights,  is  to  use  a sufficiently  large  sample. 

Despite  encouragement  from  scholars,  many  research- 
ers continue  to  ignore  power  in  their  studies  (Cohen,  1992; 
Sedlmeier&  Gigerenzer,  1989;  Stevens,  1992b).  This  situ- 
ation is  compounded  for  multiple  regression  research  even 
though  several  methods  exist  for  choosing  sample  sizes  for 
power.  These  methods  can  be  grouped  loosely  into  three 
categories:  rules-of-thumb,  statistical  power  methods,  and 
cross-validation  methods.  Unfortunately,  as  Olejnik  noted 
in  1984  and  was  confirmed  recently  (Brooks  & Barcikowski, 
1994),  many  regression  textbooks  do  not  discuss  the  issue 
of  sample  size  selection  (e.g.,  Dunn  & Clark,  1974; 
Kleinbaum,  Kupper,  & Muller,  1987;  Montgomery  & Peck, 
1992;  Weisberg,  1985)  or  simply  provide  a rule-of-thumb 
(e.g.,  Cooley  & Lohnes,  1971;  Harris,  1985;  Kerlinger  & 
Pedhazur,  1973;  Tabachnick  & Fideli,  1989),  possibly  be- 
cause there  are  problems  and  contradictions  among  the  vari- 
ous methods. 

For  example,  how  does  one  reconcile  differences  be- 
tween a statistical  power  method  that  suggests  16  subject* 


and  a 15:1  subject-to-variable  ratio  rule  that  recommends 
60?  Furthermore,  the  many  rules-of-thumb  lack  any  mea- 
sure of  effect  size,  which  is  generally  recognized  as  a criti- 
cal element  in  the  determination  of  sample  sizes.  Cohen’s 
(1988)  methods  are  derived  from  a fixed  model  and  statisti- 
cal power  approach  to  regression;  however,  a random  model 
and  cross-validation  approach,  like  Park  and  Dudycha’s 
( 1 974),  may  be  more  appropriate  in  the  social  sciences,  where 
a prediction  function  is  often  desired.  This  is  because 
generalizability  is  the  primary  consideration  for  the  devel- 
opment of  a prediction  model,  whereas  statistical  power  is 
the  main  concern  when  regression  is  used  to  test  hypotheses 
about  relationships  between  variables. 

Therefore,  the  purpose  of  this  paper  is  to  analyze  the 
advantages  and  disadvantages  of  the  various  methods  of  se- 
lecting sample  sizes  in  regression.  A discussion  of  the  im- 
portance of  cross-validity  to  prediction  studies  will  be  fol- 
lowed by  descriptions  of  the  three  categories  of  sample  size 
methods:  cross-validation  approaches,  rules-of-thumb,  and 
statistical  power  methods.  A rationale  will  then  be  devel- 
oped for  the  application  of  precision  power  to  multiple  re- 
gression, leading  to  the  presentation,  through  multiple  ex- 
amples, of  the  precision  power  method  for  sample  size  se- 
lection in  regression  studies  designed  to  develop  prediction 
models. 

Cross-Validation  and  Shrinkage 

Because  the  expected  value  of  the  sample  multiple 
correlation  (i.e.,  an  average  correlation  over  many  samples) 
is  an  overestimate  of  the  population  multiple  correlation, 
researchers  have  employed  a number  of  methods  to  “shrink” 
R2  and  thereby  provide  better  estimates  of  true  population 
multiple  correlations.  Formula  methods  of  shrinkage  are 
typically  preferred  to  empirical  cross-validation  (data-split- 
ting)  so  that  the  entire  sample  may  be  used  for  model-build- 


10 


Mid- Western  Educational  Researcher 


Volume  9,  Number  4 • FalM996 


ing.  Indeed,  several  common  formula  estimates  have  been 
shown  superior  to  empirical  cross-validation  techniques 
(Cattin,  1980a;  1980b;  Kennedy,  1988;  Murphy,  1982; 
Schmitt,  Coyle,  & Rauschenberger,  1977). 


rion  when  applying  the  sample  regression  function  to  future 
samples. 


Two  types  of  formulas  have  been  developed:  shrink- 
age estimates  and  cross- validity  estimates  (see  Table  1). 
Shrinkage  formulas  are  used  to  estimate  more  accurately  the 
squared  population  mul- 
tiple correlation,  p2,  also  1 

called  the  coefficient  of  Examples  of  Cross-Valid; 
determination.  The  mul- 
tiple correlation,  p,  is  the 
correlation  between  the  Formula 

criterion  and  the  regres- 
sion function  if  both  are  Rt2  = 1 - fN-lVl-R^ 
measured  in  the  popula-  (N-p) 

tion  (Herzberg,  1969; 

Stevens,  1992a).  Forex-  Rt2  = 1 - (N-l)(l-R2) 
ample,  a researcher  who  (N-p- 1 ) 

calculates  a sample 
R2  = . 3322  with  121  sub- 
jects and  3 predictors 
might  use  an  adjusted  R2 
formula  to  conclude  that,  Rt2  = R2  - p (T-R2^ 

in  the  population,  the  (N-p-1) 

multiple  correlation  be- 
tween the  criterion  and  R#2  = R2  - p ( 1 ~R2) 
the  predictors  is  approxi-  (N-p’) 

mately  p = .5613,  since 

R 2 = .3151.  R 2 = 1 -rN-nrN+o+lHl-R2 


er  1977)  The  most  cornmon  estimate  of  shrinkage  reported  in 

the  literature  (and  in  statistical  packages)  is  an  adjusted  R2 
e been  developed:  shrink-  that  is  attributed  most  frequently  to  Wherry  (1931).  How- 

/ estimates  (see  Table  1).  ever,  when  researchers  are  interested  in  developing  a regres- 

itimate  more  accurately  the  sion  model  to  predict  for  future  subjects,  they  should  report 

both  Rb2  (for  descriptive 
Table  1 purposes)  and  Rc2,  which 

Examples  of  Cross-Validation  and  Shrinkage  Formulas  indicates  how  well  their 


(N-p-1) 


Rt2  = R2  - jiILlR!) 

(N-p-1) 

R2=R2-p.im 

(N-p’) 


(N-p-1)  N 


R 2 = 1 - 


R 2 = 1 - 


(N-p-1)  (N-p-2)N 


(N-p-1) 


Cross-validity  for- 

mulas,  which  are  based  RJ=,. m.n  fN-2~>  fN+n  H- 
on  estimates  of  the  mean  ‘ (N-p-1)  (N-p-2)N 

squared  error  of  predic- 
tion, provide  more  accu-  r 2 = j r\ 1+  wt  v2\ 
rate  estimates  of  the  c 
squared  population  ^ 

cross-validity  coeffi-  D2,  d:\ 

dent,  p 2.  The  values  of  R‘  1 ' n 1 

Rc2,  the  sample  estimates 
of  cross-validity,  will 

vary  from  sample  to  Notc:  R/  represents  an  estimate  c 

sample;  however,  the  ex-  p’  = p + 1 with  an  intercepi 

pected  value  of  Rc2  (that 

is,  the  average  over  many  samples)  approximates  pc2.  This 
cross-validity  coefficient  can  be  thought  of  as  the  squared 
correlation  between  the  actual  population  criterion  values 
and  the  scores  predicted  by  the  sample  regression  equation 
when  applied  to  the  population  or  to  another  sample 
(Kennedy,  1988;  Schmitt  et  al.,  1977).  For  example,  a re- 
searcher who  calculates  a sample  R2  = .3322  with  121  sub- 
jects and  3 predictors  might  use  a cross-validity  formula  to 
calculate  the  sample  cross-validity  coefficient  as  Rc2  = .2916. 
This  cross-validity  coefficient  implies  that  the  researcher 
would  explain  29%,  not  33%,  of  the  variance  of  the  crite- 


Wherry  (1931) 


Wherry  (1931); 

Ezekiel  (1930); 
McNemar  (1962); 

Lord  & Novick  (1968); 
Ray  (1982,  p.  69)  [SAS] 

Norusis  (1988,  p.  18) 
[SPSS] 

Dixon  (1990,  p.  365) 
[BMDPjl 

Nicholson  (1960) 

Lord  (1950) 

Stein  (1960) 

Darlington  (1968) 


purposes)  and  Rc2,  which 
indicates  how  well  their 
sample  equation  may  pre- 
dict in  subsequent 
samples  (Cattin,  1980b; 
Huberty  & Mourad, 
1980).  Indeed,  Uhl  and 
Eisenberg  (1970)  found 
that  a cross-validity  esti- 
mate (which  they  at- 
tribute to  Lord,  1950)  was 
consistently  more  accu- 
rate than  Wherry’s 
shrinkage  formula  in  this 
regard.  Some  of  the  more 
familiar  cross-validity 
formulas  are  those  by 
Stein  (1960),  Darlington 
(1968),  Lord  (1950), 
Nicholson  (1960),  and 
Browne  (1975). 


Multiple  Regression 
Sample  Size  Methods 


R/  represents  an  estimate  of  r2;  Re2  is  an  estimate  of  rcJ. 
p’  = p + 1 with  an  intercept,  p’  - p if  the  intercept  = 0. 


v — / There  are  three  pri- 

,,Q-ox  mary  types  of  sample  size 

^ methods  available  for 

multiple  linear  regression: 

TTf , 0 _ , cross-validation  ap- 

Uhl  & Eisenberg  (1970)  pnMches>  rule!W)f.tlnm5> 

(w  o cite  or  , ) an(j  statistical  power  ap- 

proaches.  The  following 

*;  Re2  is  an  estimate  of  rcJ.  sections  describe  each 

* = p if  the  intercept  = 0.  briefly,  with  emphasis  on 

the  aspects  of  each  that 

pertain  to  the  precision  power  method  described  later. 


Uhl  & Eisenberg  (1970) 
(who  cite  ford,  1950) 


Cross-Validation  Approach  to  Sample  Sizes 

Park  and  Dudycha  (1974)  took  a cross-validation  ap- 
proach to  calculating  sample  sizes.  They  noted  that  such  a 
cross-validation  approach  is  applicable  to  both  the  random 
and  the  fixed  models  of  regression;  however,  because  the 
fixed  model  poses  no  practical  problems,  they  emphasized 
the  random  model.  In  the  random  model,  both  the  predic- 
tors and  the  criterion  are  sampled  together  from  a joint  mul- 
tivariate distribution.  The  fixed  model,  on  the  other  hand. 
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assumes  that  the  researcher  is  able  to  select  or  control  the 
values  of  the  independent  variables  before  measuring  sub- 
jects on  the  random  dependent  variable.  The  random  model 
is  usually  more  appropriate  to  social  scientists,  because  they 
typically  measure  subjects  on  predictors  and  the  criterion 
simultaneously  and  therefore  are  not  able  to  fix  the  values 
for  the  independent  variables  (Brogden,  1972;Cattin,  1980b; 
Claudy,  1 972 ;Drasgow,  Dorans,  & Tucker,  1979;  Herzberg, 
1969;  Park  & Dudycha,  1974;  Stevens,  1986).  It  is  impor- 
tant to  recognize  that  the 
misapplication  of  fixed 
model  data  to  the  random 
model  may  cause  biased  es- 
timates of  the  population 
parameters  (Claudy,  1972). 

For  a more  complete  discus- 
sion of  the  random  and  fixed 
models,  the  reader  is  re- 
ferred to  Afifi  and  Clark 
(1990),  Brogden  (1972), 

Dunn  and  Clark  (1974), 

Johnson  and  Leone  (1977), 
and  Sampson  (1974). 

Park  and  Dudycha 
(1974)  derived  the  follow- 
ing sample  size  formula: 

N>iLW 

p2 

where  p is  the  anticipated 
population  correlation,  and 
5,2  is  the  noncentrality  pa- 
rameter for  the  t-distri- 
bution.  Researchers  deter- 
mine the  probability  with 
which  they  want  to  approxi- 
mate p within  some  chosen 
error  tolerance.  The  for- 
mula for  this  probability  is: 

P (P  - Pc  ^ e)  = Y 


The  researcher  chooses  (a)  an  assumed  p2  as  the  effect 
size,  (b)  the  absolute  error  willing  to  be  tolerated,  e,  and  (c) 
the  probability  of  being  within  that  error  bound,  y.  The  tables 
provided  by  Park  and  Dudycha  (most  of  which  were  reprinted 
in  Stevens,  1986,  1992a)  then  can  be  consulted  with  these 
values.  Unfortunately,  their  tables  are  limited  to  only  a few 
possible  combinations  of  sample  size,  squared  correlation, 
and  epsilon.  Also  unfortunately,  their  math  is  too  complex 
for  most  researchers  to  derive  the  information  they  would 
need  for  the  cases  not  tabulated.  Additionally,  there  is  no 
clear  rationale  for  how  to  determine  the  best  choice  of  either 
e or  the  probability  to  use  when  consulting  the  tables  (al- 
though Stevens,  1992a,  implied  through  examples  that  .05 
and  .90,  respectively,  are  acceptable  values). 


Rules-of-Thumb  for  Selecting  Sample  Sizes 

The  most  extensive  literature  regarding  sample  sizes 
in  regression  analysis  is  in  the  area  of  experiential  rules. 
Many  scholars  have  suggested  rules-of-thumb  for  choosing 
sample  sizes  that  they  claim  will  provide  reliable  estimates 
of  the  population  regression  coefficients.  That  is,  with  a 
large  enough  ratio  of  subjects  to  predictors,  the  estimated 
regression  coefficients  will  be  reliable  and  will  closely  re- 
flect the  true  population  pa- 
rameters since  shrinkage 
will  be  slight  (Miller  & 
Kunce,  1973;  Pedhazur  & 
Schmelkin,  1991;  Tabach- 
nick  & Fidell,  1989).  This 
is  true  because  as  the  num- 
ber of  subjects  increases 
relative  to  the  number  of 
predictors,  both  R2  and  pc2 
converge  toward  p2,  and 
therefore  the  amount  of 
shrinkage  decreases  (Cattin, 
1980a). 

Rules-of-thumb  typi- 
cally take  the  form  of  a sub- 
ject-to-predictor  (N/p)  ratio. 
Table  2 shows  that  statisti- 
cians have  recommended 
using  as  small  a ratio  as  10 
subjects  to  each  predictor 
and  as  large  a ratio  as  40: 1 . 
For  example,  Stevens 
(1986)  recommended  a 
15:1  subject-to- variable  ra- 
tio, which  he  based  prima- 
rily on  an  analysis  of  Park 
and  Dudycha’s  (1974) 
tables.  Harris  (1985)  noted, 
however,  that  ratio  rules-of- 
thumb  clearly  break  down 
for  small  numbers  of  pre- 
dictors. Some  scholars 
have  suggested  that  a mini- 
mum of  100,  or  even  200,  subjects  is  necessary  regardless 
of  the  number  of  predictors  (e.g.,  Kerlinger  & Pedhazur, 
1 973).  Indeed,  Green  (1991)  found  that  a combination  for- 
mula such  as  N > 50  + 8p  was  much  better  than  subject-to- 
variable  ratios  alone.  Additionally,  Sawyer  (1982)  devel- 
oped a formula  based  on  limiting  the  inflation  of  mean 
squared  error.  Sawyer’s  formula,  however,  easily  simpli- 
fies into  a combination  rule  once  the  inflation  factor,  k,  is 
chosen.  Finally,  perhaps  the  most  widely  used  rule-of-thumb 
was  described  by  Olejnik  (1984):  “use  as  many  subjects  as 
you  can  get  and  you  can  afford"  (p.  40). 

The  most  profound  problem  with  many  rules-of-thumb 
advanced  by  regression  scholars  is  that  they  lack  any  mea- 


Table  2 


Rules-of-Thumb  for  Sample  Size  Selection 


Rule 

Author(s) 

N>  10p 

Miller  & Kunce,  1973,  p.  162 
Halinski  & Feldt,  1970,  p.  157 
Neter,  Wasserman,  & Kutner,  1990,  p.  467 

N > 15p 

Stevens,  1992,  p.  125 

N > 20p 

Tabachnick  & Fidell,  1989,  p.  128 
Halinski  & Feldt,  1970,  p.  157 
(for  identifying  predictors) 

N > 30p 

Pedhazur  & Schmelkin,  1990,  p.  447 

N > 40p 

Nunnally,  1978  (inferred  from  examples) 
Tabachnick  & Fidell,  1989,  p.  129 
(for  stepwise  regression) 

N > 50  + p 

Harris,  1985,  p.  64 

N>  10p  + 50 

Thorndike,  1978,  p.  184 

N>  100  (or  200) 

Kerlinger  & Pedhazur,  1973,  p.  442 

N >(2KM).f  K2!? 
(KM) 

Sawyer,  1982,  p.  95  (K  is  an  inflation 
factor  due  to  estimating 
coefficients) 

Note:  In  the  formulas  for  sample  size  above,  N represents  the  suggested 
sample  size  and  p represents  the  number  of  predictors  (independent  vari- 
ables) used  in  the  regression  analysis. 
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sure  of  effect  size.  Indeed,  even  Sawyer’s  inflation  factor  is 
not  an  effect  size.  It  is  generally  recognized  that  an  esti- 
mated effect  size  must  precede  the  determination  of  appro- 
priate sample  size.  Effect  size  enables  a researcher  to  deter- 
mine in  advance  not  only  what  will  be  necessary  for  statisti- 
cal significance,  but  also  what  is  required  for  practical  sig- 
nificance (Hinkle  & Oliver,  1 983).  The  next  section  includes 
a more  complete  discussion  of  effect  size  and  its  importance 
in  power  analysis. 

Statistical  Power  Approach  to  Sample  Size 

“The  power  of  a statistical  test  is  the  probability  that  it 
will  yield  statistically  significant  results”  (Cohen,  1988,  p. 
1).  That  is,  statistical  power  is  the  probability  of  rejecting 
the  null  hypothesis  when  the  null  hypothesis  is  indeed  false. 
Several  scholars  have  proposed  regression  sample  size  meth- 
ods based  on  statistical  power  (e.g.,  Cohen,  1988;  Cohen  & 
Cohen,  1983;  Gatsonis  & Sampson,  1989;  Kraemer  & 
Thiemann,  1987;  Milton,  1986;Neter,  Wasserman,  & Kutner, 
1990). 

Statistical  power  analysis  requires  the  consideration 
of  at  least  four  parameters:  level  of  significance,  power, 
effect  size,  and  sample  size.  These  four  parameters  are  re- 
lated such  that  when  any  three  are  fixed,  the  fourth  is  math- 
ematically determined  (Cohen,  1992).  Therefore,  it  becomes 
obvious  that  it  is  necessary  to  consider  power,  alpha,  and 
effect  size  when  attempting  to  determine  a proper  sample 
size.  This  is  a fixed  model  approach  to  regression,  however, 
and  is  most  useful  when  researchers  use  regression  as  a means 
to  explain  the  variance  of  a phenomenon  in  lieu  of  analysis 
of  variance  or  to  determine  the  importance  of  individual  pre- 
dictors. It  is  useful,  though,  to  discuss  effect  size  regardless 
of  the  approach  to  regression  that  is  taken. 

In  any  statistical  analysis,  there  are  three  strategies  for 
choosing  an  appropriate  effect  size:  (a)  Use  effect  sizes  found 
in  previous  studies,  (b)  Decide  on  some  minimum  effect  that 
will  be  practically  significant,  or  (c)  Use  conventional  small, 
medium,  and  large  effects  (Cohen  & Cohen,  1983).  Cohen 
(1988)  defined  effect  size  in  fixed  model  multiple  regres- 
sion as  a function  of  the  squared  multiple  correlation,  spe- 
cifically 


Since  R2  can  be  used  in  the  formulas  directly,  Cohen 
also  defined  effect  sizes  in  terms  of  R2  such  that  small  effect 
R2  = .02,  medium  effect  R2  = .13,  and  large  effect  R2  = .26. 
Cohen’s  (1988)  sample  size  is  calculated  as 

,.  Ul-R2) 

N=  5T“. 

where  k is  the  noncentrality  parameter  required  for  the 
noncentral  F-distribution.  Cohen's  ( 1 988)  tables  provide  the 
k needed  for  the  sample  size  formula. 


For  prediction  studies,  the  fundamental  problem  with 
Cohen’s  (1988)  method,  and  Green’s  (1991)  formula  based 
on  Cohen’s  method,  is  that  it  is  designed  for  use  from  a fixed 
model,  statistical  power  approach.  And  although  Gatsonis 
and  Sampson  (1989)  use  the  random  model  approach,  their 
method  is  also  based  on  a statistical  power  approach  to  sample 
size  determination.  Unfortunately,  statistical  power  to  re- 
ject a null  hypothesis  of  zero  multiple  correlation  does  not 
inform  us  how  weil  a model  may  predict  in  other  samples. 
That  is,  adequate  sample  sizes  for  statistical  power  tell  us 
nothing  about  the  number  of  subjects  needed  to  obtain  stable, 
meaningful  regression  weights  (Cascio,  Valenzi,  & Silbey, 
1978).  Therefore,  selecting  a sample  size  based  on  statisti- 
cal power  tests  may  be  useful  in  selecting  predictors  to  in- 
clude in  a final  model,  but  it  will  not  ensure  adequate  sample 
size  to  allow  a regression  equation  to  generalize  to  other 
samples  from  the  given  population. 

Precision  Power 

While  several  scholars  have  used  the  term  predictive 
power  (e.g.,  Cascio  et  al.,  1978;  Kennedy,  1988;  Nunnally, 
1978;  Stevens,  1986,  1992a),  only  Cattin  (1980a)  has  pro- 
vided a formal  definition.  Cattin  (1980a)  noted  that  the  two 
common  measures  of  predictive  power  are  the  mean  squared 
error  of  prediction  and  the  cross- validated  multiple  correla- 
tion. However,  Cattin  was  discussing  predictive  power  in 
regard  to  the  comparison  and  selection  of  competing  regres- 
sion models.  Stevens  (1992a),  who  discussed  predictive 
power  as  an  aspect  of  model  validation,  used  the  term  to 
mean  how  well  a derived  regression  equation  will  predict  in 
other  samples  from  the  same  population.  Therefore,  a “loss 
in  predictive  power”  to  Stevens  is  simply  the  size  of  the  de- 
crease in  the  sample  R2  when  an  appropriate  shrinkage  or 
cross-validity  formula  is  applied. 

Although  both  Cattin’s  and  Steven’s  definitions  of 
predictive  power  could  be  applied  to  the  problem  of  sample 
size  in  some  fashion,  neither  would  provide  any  sense  of  the 
magnitude  of  error  as  compared  to  the  original  R2  value. 
For  example,  a loss  in  predictive  power  (as  Stevens  defines 
it)  of  .20  suggests  drastically  different  results  if  the  sample 
R2  is  .50  than  if  the  sample  R2  is  .25.  Because  they  desire  a 
regression  model  that  predicts  well  in  subsequent  samples, 
researchers  hope  to  limit  shrinkage  as  much  as  possible  rela- 
tive to  the  sample  R2  value  they  attained.  Therefore,  a con- 
cept is  required  that  provides  more  information  about  the 
magnitude  of  shrinkage  relative  to  sample  values. 

The  term  precision  power  is  proposed  to  indicate  how 
well  a regression  function  is  expected  to  perform  if  applied 
to  future  samples.  T c term  is  adapted  from  Darlington 
(1990),  who  used  the  phrase  “precision  of  estimates”  to  op- 
pose the  “power  of  hypothesis  tests”  (i.e.,  statistical  power) 
while  introducing  a chapter  on  choosing  sample  sizes  (p. 
379).  Precision  power  is  defined  more  precisely  as  Rt2/R2, 
which  can  be  inferred  and  adapted  from  an  example  used  by 
Stevens  (1992a,  p.  100).  With  a larger  sample,  this  fraction 
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would  be  larger  because  less  shrinkage  occurs  with  larger 
samples,  all  else  remaining  constant.  Using  Stevens’  ex- 
ample, a 61.8%  shrinkage  from  R2  = .50  to  Rc2  = .191  oc- 
curs with  a sample  size  of  50;  when  the  sample  is  increased 
to  150,  there  is  only  a 15.8%  shrinkage  from  R2  = .50  to 
Rc2  = .421 . The  precision  power  in  the  first  case  would  be 
.191/.50  = .382,  and  precision  power  in  the  second  case  is 
.421/.50  = .842. 

The  formulaic  definition  of  precision  power, 

R2 

PP  - — , (1) 

R2 


The  methods  described  earlier  in  the  paper  (a)  provide 
contradictory  sample  size  recommendations  (see  Table  3), 
(b)  either  oversimplify  the  issue  or  are  too  mathematically 
complex  for  many  researchers  to  use,  and  (c)  are  not  all  based 
on  the  random  model.  Indeed,  a Monte  Carlo  study  that 
examined  several  of  the  methods  from  a precision  power 
perspective  found  that  none  of  the  methods  provided  con- 
sistently accurate  power  rates  (Brooks  & Barcikowski,  1994). 
Therefore,  the  precision  power  method  was  developed  and 
verified  (Brooks  & Barcikowski,  1995).  The  precision  power 
method  was  determined  to  be  both  consistent  and  accurate 

across  all  levels  of  expected 


can  be  manipulated  algebra- 
ically into  the  formula 

(R2  - R 2) 

PP=l-~ S-L.  (2) 

R2 

The  fraction,  (R2  - Rc2)/R2, 
can  be  interpreted  as  the  pro- 
portional decrease,  or  propor- 
tional shrinkage  (PS),  in  the 
squared  multiple  correlation 
after  an  appropriate  cross-va- 
lidity estimate  is  made.  There- 
fore, i - PS  provides  an  esti- 
mate of  the  precision  power, 
and  therefore  generalizability, 
of  the  regression  equation. 
For  example,  if  sample 
R2  = .50  and  Rc2  = . 10,  the  pre- 
cision power  for  that  regres- 
sion model  would  be  1 - (.40/ 
.5)=  .20;  this  suggests  very' 
little  generalizability'  for  the 
regression  model  because  the 
R2  value  shrank  by  80%.  A 
precision  power  value  of  .90, 
on  the  other  hand,  would  in- 
dicate a highly  generalizable 
model. 


Precision  power  thus  nuiL 

describes  how  well  a regres- 
sion equation  will  predict  in  

other  samples  relative  to  its  ability  to  predict  in  the  deriva- 
tion sample.  Because  the  term  power  has  special  meaning 
in  the  research  literature,  a word  of  warning  may  be  prudent 
at  this  time.  Precision  power  as  defined  here,  1 - PS,  is  simi- 
lar in  form  to  the  theoretical  definition  of  statistical  power, 

1 - (3,  where  ft  is  the  probability  of  a Type  II  error.  How- 
ever, PS  is  not  the  probability  of  error  but  the  tolerance  level 
for  error,  or  more  precisely,  cross-validity  shrinkage.  Fur- 
thermore, the  term  statistical  power  is  used  in  reference  to  a 
lest  of  a hypothesis;  the  term  precision  power,  on  the  other 
hand,  applies  not  to  a statistical  test,  but  to  an  evaluation  of 
the  generalizability'  of  a regression  equation. 


Table  3 

Sample  Sizes  Suggested  by  Several  Methods 


R2,  numbers  of  predictors,  and 
actual  p2. 

Precision  Power  Method 


E(R2) 

K 

Method 

ji 

21 

ASi 

4 

Precision  Power  (8  = ,2R2) 

22 

55 

155 

455 

Precision  Power  (e  = .05) 

55 

105 

155 

305 

Park  & Dudycha  (p  = .90) 

37 

66 

93 

173 

Sawyer 

22 

30 

55 

130 

30:1 

120 

120 

120 

120 

50  + 8p 

82 

82 

82 

82 

15:1 

60 

60 

60 

60 

Cohen 

8 

16 

48 

144 

Gatsonis  & Sampson 

14 

25 

55 

165 

8 

Precision  Power  (s  = .2R2) 

39 

99 

279 

819 

Precision  Power  (8  = .05) 

99 

189 

279 

549 

Park  & Dudycha  (p  - .90) 

68 

124 

171 

311 

Sawyer 

38 

53 

98 

233 

30:1 

240 

240 

240 

240 

50  + 8p 

114 

114 

114 

114 

15:1 

120 

120 

120 

120 

Cohen 

12 

20 

61 

k83 

Gatsonis  & Sampson 

19 

32 

69 

205 

Note  K represents  the  number  of  predictors  in  the  model. 

The  theory  underlying 
E(R2)  the  precision  power  sample 

J5.  21  JuQ  size  method  is  that  the  re- 

searcher, knowing  shrinkage 
) 22  55  155  455  is  likely  to  occur,  can  set  a 

55  105  155  305  limit  as  to  the  amount  of 

37  66  93  173  shrinkage  that  will  result.  Al- 

22  30  55  130  gebraic  manipulation  and  sim- 

120  120  120  120  plification  of  a cross-validity 

82  82  82  82  formula  provides  the  tool 

60  60  60  60  needed  to  limit  this  expected 

8 16  48  144  shrinkage  (Brooks  & 

14  25  55  165  Barcikowski,  1995).  Restruc- 

turing the  cross-validity  for- 

) 39  99  279  819  mula  to  solve  for  sample  size 

99  189  279  549  yields: 

l 68  124  1 7 i 311  (p  + 1)  (2  - 2R2  + s) 

38  53  98  233  N>  — — - 

240  240  240  240  E 

114  114  114  114  where  p is  the  number  of  pre- 

120  120  120  120  dictors,  R2  is  the  expected 

12  20  61  k 83  sample  value  (i.e,,  an  effect 

19  32  69  205  size),  and  e is  an  acceptable 

amount  of  shrinkage, 

8 = R2  - Rc2.  This  value  of  8 
r of  predictors  in  the  model.  allows  researchers  to  decide 

how  closely  to  estimate  pc2 

from  expected  R2:  either  as 

an  absolute  amount  of  acceptable  shrinkage  (e.g.,  e = .05) 
or  a proportional  decrease  (e.g.,  s = .2R2,  which  represents 
shrinkage  of  20%).  This  is  similar  to  the  method  employed 
by  Park  and  Dudycha  (1974). 

Through  changes  in  the  shrinkage  tolerance,  e,  the  pre- 
cision power  formula  has  the  capacity  for  simplification.  For 
example,  if  the  researcher  does  not  want  the  sample  R2  to 
decrease  by  more  than  .05  no  matter  what  the  expected  value 
of  R2,  formula  (3)  simplifies  to 

N > 20  (p  + 1)  (2.05  - 2R2)  ; 
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or  if  the  researcher  does  not  want  sample  R2  to  decrease  by 
more  than  .03,  then 

N > 33  (p  + 1)  (2.03  - 2R2)  . 

For  example,  if  there  are  four  predictors  in  the  model 
and  expected  R2  = .50,  N should  be  chosen  greater  than 
33*5*(2.03  - 2*.50)  = 170.  If  a researcher  wants  an  esti- 
mate of  pc2  not  less  than  80%  of  the  sample  R2  value,  for- 
mula (3)  can  be  reformulated  using  e = R2  - .8R2  = .2R2,  such 
that 

(p  + 1)  (2  - 1.8  R2) 

N > ; 

.2  R2 

or  if  the  researcher  wants  a pc2  estimate  not  less  than  75%  of 
the  sample  R2  value,  the  formula  can  be  reformulated  such 
that  e = .25R2: 

N>  (P+ 0(2-1.75  R2) 

.25  R2 

As  an  example,  with  five  predictors  and  an  anticipated 
R2  of  .40,  at  least  78  subjects  should  be  used  to  attain  ex- 
pected precision  power  of  .75. 

Other  values  for  e can  be  chosen  by  substituting  s for 
the  quantity  (R2  - Rc2)  in  formula  (2).  Formula  (2)  can  be 
rewritten  as 


and  therefore 


(4) 


8 = R2  - (PP  * R2) . (5) 

For  example  then,  if  researchers  wanted  the  Rc2  after 
shrinkage  to  be  no  less  than  87%  (i.e.,  a decrease  in  R2  of  no 
more  than  13%)  of  the  expected  sample  R2  of  .53  with  four 
predictors,  they  would  set  FP  = .87,  and  calculate  s - .069 
to  use  in  sample  size  formula  (3).  Plugging  the  values  into 
formula  (3)  provides  a sample  size  of 


5 (2  - 2 (.53)  + .069) 

N > — 1 - — = 73 

.069 

Thus,  73  subjects  should  provide  a large  enough 
sample  so  that  expected  Rc2  > .46,  which  is  87%  of  the  as- 
sumed p2  = .53. 

Conclusions 

The  seriousness  of  concern  about  sample  sizes  and 
precision  power  in  regression  is  not  obvious-after  all,  re- 
searchers have  shrinkage  and  cross- validity  formulas  avail- 
able to  “correct”  for  inadequate  sample  sizes.  However,  a 
prediction  model  produced  using  a larger  sample  size  will 
better  estimate  both  p2  (using  Rg2)  and  pc2  (using  Rc2);  more 
importantly,  it  will  provide  more  stable  regression  weights. 
Therefore,  such  a model  will  predict  better  in  future  samples 
because  the  efficiency  of  a prediction  model  depends  not  on 


the  estimates  of  p2  and  pc2,  but  on  the  stability'  of  the  regres- 
sion coefficients. 

The  primary  goal  of  precision  power  analysis  is  to  re- 
duce the  upward  bias  of  R2,  thereby  better  estimating  both 
p2  and  pc2,  so  that  results  are  not  sample  specific.  The  preci- 
sion power  method  provides  researchers  with  a means  to 
determine  the  optimum  sample  size  for  prediction  studies. 
Assuming  the  researcher  can  make  a reasonable  estimate  of 
the  population  p2,  the  precision  power  method  provides  the 
most  consistent  precision  power  rates  of  all  existing  meth- 
ods. It  should  be  noted  that  Brooks  and  Barcikowski’s  ( 1 995) 
results  apply  only  to  standard  regression  analysis,  where  all 
predictors  are  entered  into  the  model  simultaneously.  Many 
researchers  agree,  however,  that  even  larger  samples  are  re- 
quired when  preselection  or  best  subset  regression  analyses 
are  used  (Halinski  & Feldt,  1970;  Nunnally,  1978; 
Tabachnick&  Fidell,  1989). 

Unfortunately,  no  sample  size  method  can  eliminate 
all  problems.  When  researchers  choose  an  expected  R2  that 
overestimates  p2  (either  explicitly  by  choice  of  an  inflated 
effect  size  or  implicitly  by  use  of  an  inappropriate  rule-of- 
thumb),  power  rates  are  unacceptably  low.  Similarly,  when 
researchers  choose  an  expected  R2  which  is  much  lower  than 
the  population  p2,  power  rates  are  unnecessarily  high  (more 
subjects  than  necessary  are  recommended).  Therefore,  if 
the  researcher  cannot  make  a reasonable  estimate  of  p2,  no 
sample  size  method  will  work  well.  In  other  words,  effect 
size  is  just  as  critical  when  choosing  sample  sizes  in  mul- 
tiple regression  as  it  is  with  other  statistical  methods,  be- 
cause all  methods  are  inadequate  when  expected  R2  deviates 
too  far  from  p2. 

Researchers  who  hope  to  develop  an  efficient  predic- 
tion model  using  multiple  regression  must  be  concerned  with 
the  size  of  their  derivation  samples,  starting  with  an  appro- 
priate effect  size,  probably  in  the  form  of  an  expected  R2.  It 
may  be  worth  noting  that  although  Stevens  (1 992a)  suggested 
an  effect  size  of  p2  = .50  as  a reasonable  guess  for  the  social 
sciences  when  a better  estimate  is  unavailable,  Rozeboom 
(1981)  believes  that  p2  = .50  may  be  an  upper  bound  and 
Cohen  ( 1 988)  offers  p2  = .26  as  a large  effect  size.  Of  course, 
the  best  choice  of  effect  size  is  based  on  evidence  from  the 
research  literature  or  from  past  research  experience.  Clearly, 
effect  size  impacts  the  selection  of  sample  size  in  complex 
ways.  Such  discrepancies  make  it  more  obvious  why  some 
scholars  have  recommended  sample  sizes  of  100,  200,  and 
even  500,  no  matter  how  many  predictors,  and  others  have 
suggested  subject-to-variable  ratios  as  large  as  40:1  (e.g., 
Kerlinger  & Pedhazur,  1973;  Nunnally.  1978;  Pedhazur, 
1982;  Tabachnick  & Fidell,  1989). 

Another  concern  that  researchers  must  consider  is  the 
question  of  a priori  precision  power  rate.  It  is  useful  to  re- 
member that  “for  both  statistical  and  practical  reasons,  then, 
one  wants  to  measure  the  smallest  number  of  cases  that  has 
a decent  chance  of  revealing  a significant  relationship  if. 
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indeed,  one  is  there”  (Tabachnick  & Fidell,  1989,  p.  129). 
Given  the  current  state  of  the  research,  there  are  no  clear 
guidelines  as  to  what  precision  power  rate  to  choose.  Simi- 
lar to  choices  regarding  statistical  power  and  Type  I error 
rates,  the  importance  of  generalizability  to  a study  must  be 
considered  by  researchers.  For  example,  if  it  is  critical  that 
the  expected  R2  value  not  shrink  much,  the  researcher  may 
wish  to  choose  a very  high  precision  power  rate. 

Summary 

Sample  sizes  for  multiple  linear  regression,  particu- 
larly when  used  to  develop  prediction  models,  must  be  cho- 
sen so  as  to  provide  adequate  power  both  for  statistical  sig- 
nificance and  also  for  generalizability  of  the  model.  It  is 
well-documented  and  unfortunate  that  many  researchers  do 
not  heed  this  guideline,  probably  often  choosing  instead  to 
abide  by  the  rule  cited  by  Olejnik  ( 1 984):  use  as  many  sub- 
jects as  you  can  get.  Possibly  more  tragic  are  the  cases  where 
researchers  have  used  a groundless  rule-of-thumb  to  choose 
their  sample  sizes  or  have  neglected  to  report  an  appropriate 
“shrunken”  R2;  these  studies  probably  provide  inaccurate 
conclusions  regarding  the  topics  under  investigation. 

For  whatever  reasons,  empirical  study  into  power  for 
multiple  regression  has  been  lacking.  Rules-of-thumb  have 
existed  for  decades  with  little  empirical  or  mathematical  sup- 
port. Indeed,  both  studies  by  Brooks  and  Barcikowski  ( 1 994, 
1995)  have  found  very  limited  value  for  rules-of-thumb  in 
regression.  Additionally,  sample  size  methods  offered  by 
Park  and  Dudycha  (1974),  Cohen  (1988),  Gatsonis  and 
Sampson  (1989),  and  Sawyer  (1982)  were  each  found  lack- 
ing in  some  way.  The  only  method  which  provided  consis- 
tently accurate  power  for  generalizability  was  the  precision 
power  method. 

It  is  hoped  that  the  information  presented  within  this 
paper  encourages  researchers  to  consider  more  seriously  the 
issues  of  power  and  sample  size  for  multiple  linear  regres- 
sion studies.  Because  power  in  prediction  studies  has  more 
meaning  than  for  other  statistical  designs,  it  is  an  even  more 
important  consideration.  Researchers  must  recognize  the 
potential  danger  of  choosing  an  inappropriate  effect  size  (ei- 
ther implicitly  or  explicitly)  or  ignoring  effect  size  entirely. 
Further,  no  statistical  analysis  or  correction  (such  as  an  ad- 
justed R2)  can  repair  damage  caused  by  an  inadequate  sample. 
Researchers  must  remember  that  a sample  must  not  only  be 
large  enough,  but  that  it  must  also  be  random  and  appropri- 
ately representative  of  the  population  to  which  the  research 
will  generalk  e (Cooley  & Lohnes,  1971;  Miller' & Kunce, 
1973). 
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Regression  Analyses  for  ARAB  Designs  in  Educational  Research 


T.  Mark  Beasley,  St.  John’s  University,  New  York 


Abstract 

Too  many  practitioners  interpret  ABAB  research  based  on  visual  inspection  rather  than  statistical  analy- 
ses. This  article  illustrates  the  techniques  and  importance  of  regression  analyses  on  a hypothetical  single- 
case study  group  given  Cooperative  Learning  as  an  instructional  strategy  for  increasing  cooperative 
behavior . 


The  ABAB  design  has  become  one  of  the  most  com- 
monly used  designs  in  single-case  research  because  it  is  be- 
lieved to  control  for  the  confounding  effects  of  history  and 
maturation  (Barlow  & Hersen,  1984).  Hence,  the  researcher 
can  be  reasonably  sure  that  the  results  cannot  be  attributed 
to  extraneous  factors  or  confounding  variables.  Unfortu- 
nately, most  practitioners  of  single-case  methodologies  take 
little  precaution  against  the  potential  of  their  results  being 
attributed  to  chance.  That  is,  they  overwhelmingly  interpret 
their  results  based  on  visual  inspection  rather  than  statistical 
analysis  (Busk  & Marascuilo,  1992). 

Though  practically  simple,  the  validity  of  visual  in- 
spection is  questionable  (e.g.,  Park,  Marascuilo,  & Gaylord- 
Ross,  1990).  Many  researchers  extol  the  virtues  of  visual 
inspection  and  graphic  analysis  of  data,  asserting  that  an  “im- 
portant” effect  will  be  manifest  in  an  obvious  manner,  and 
that  in  applied  settings  only  marked  effects  have  practical 
significance  (Baer,  1977).  However,  it  has  been  suggested 
that  the  presentation  of  both  visual  and  statistical  analyses 
gives  more  credence  to  research  findings  (Huitema,  1985; 
Park  et  al.,  1990).  Yet,  no  consensus  on  what  constitutes  an 
appropriate  analysis  has  been  reached.  Variants  of  the  re- 
peated-measures analysis  of  variance  (ANOVA)  have  been 
suggested  (Shine  & Bower,  1971;  Gentile,  Roden,  & Klein, 
1972).  However,  based  on  simulation  results  (Toothaker  et 
al.,  1983),  these  tests  are  not  recommended  because  they 
seriously  inflate  the  Type  I error  rate  when  there  is  nonzero 
autocorrelation.  Furthermore,  an  important  assumption  of 
linear  models,  however,  is  independence  of  error  terms  for 
all  observations.  Therefore,  statistical  analysis  of  single-case 
data  becomes  problematic  when  dependency  exists  in  the 
data  (see  Busk  & Marascuilo,  1992). 

To  circumvent  the  violation  of  the  independence  of 
errors  assumption  (i.e.,  autocorrelation),  interrupted  time- 
series  analysis  has  been  recommended  for  the  analysis  of 
single-subject  data  (Jones,  Vaught,  & Weinrott,  1977).  Al- 
though this  approach  has  the  advantage  of  accounting  for 
serial  dependency,  it  raises  new  difficulties.  Namely,  the 


modeling  process  may  become  quite  complex,  to  the  point 
that  it  is  difficult  to  make  inferential  decisions  or  even  iden- 
tify the  null  hypothesis  being  tested  (Gorsuch,  1983).  How- 
ever, many  single-case  researchers  contend  that  data  from 
behavioral  experiments  can  be  analyzed  with  the  simplest 
of  the  time-series  models  and  that  time-series  and  least- 
squares  methodologies  can  be  combined  (Home,  Yang,  & 
Ware,  1982). 

Huitema  (1985)  contends  that  little  evidence  exists  to 
indicate  that  serial  dependency  is  a major  threat  to  single- 
case  behavioral  researchers;  however,  this  contention  has 
met  with  substantial  resistance  and  rebuttal.  Moreover,  time- 
series  analyses  typically  require  a minimum  of  50  to  60  data 
points  per  phase  (Jones  et  al.,  1977),  yet  single-case  experi- 
ments provide  far  fewer  observations  for  the  entire  study. 
Several  nonparametric  approaches  to  time-series  data  have 
also  been  suggested  (see  Edgington,  1992;  Levin,  Marascuilo, 
& Hubert,  1978);  however,  most  of  these  tests  were  not  de- 
veloped to  assess  the  effects  of  treatment  on  trends.  Since 
the  detection  and  control  of  dependency  or  autocorrelation 
involves  an  investigation  of  overall  and  within-phase  trends, 
discussion  will  focus  on  regression-based  trend  models.  For 
the  sake  of  simplicity  and  to  make  these  suggestions  con- 
crete, an  ABAB  design  will  be  presented. 

Hypothetical  Example  of  an  ABAB  Design 

Based  on  an  experiment  using  Cooperative  Learning 
groups  as  an  instructional  strategy  for  integrating  autistic 
students  into  a fourth-grade  social  studies  class  (Dugan  et 
al.,  1995),  hypothetical  data  for  one  student  fron  an  ABAB 
reversal  design  were  created.  Suppose  data  were  obtained 
from  a three-week  initial  baseline  period  in  which  students 
received  a 40-minute  teacher  lecture  four  times  per  week. 
Five -minute  time-sampling  probes  were  systematically  con- 
ducted to  assess  the  cooperative  behavior  of  the  subject.  The 
number  of  seconds  engaged  in  appropriate  interaction  dur- 
ing the  probe  was  used  as  the  dependent  measure  of  the 
student's  ability  to  cooperate.  During  this  initial  baseline, 
n ) = 10  observations  were  made.  A four-week  Cooperative 
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Learning  (B)  phase,  which  involved  a 1 0-minute  whole  class 
lecture  followed  by  the  construction  of  Cooperative  Learn- 
ing groups  of  four  students,  yielded  «bI  - 12  data  points  for 
this  student.  A three-week  reversal  phase  yielded  = 8 
cooperation  measures.  A five-week  reinstatement  of  Coop- 
erative Learning  groups  yielded  2 = 9 data  points.  The 
total  time-series  of  T=  39  cooperation  measures  is  displayed 
in  Figure  1.  Descriptively,  the  Cooperative  Learning  condi- 
tions appear  to  increase  cooperation  for  this  student.  Dur- 
ing the  initial  baseline,  cooperation  was  at  a mean  level  of 
43.40  seconds  of  interaction  (SD  = 25.33).  After  the  initial 
Cooperative  Learning  intervention,  the  mean  number  of  sec- 
onds engaged  in  appropriate  interaction  drastically  increased 


to  212.92  (SD  = 77.68).  During  the  reversal  phase,  coop- 
eration reduced  to  a mean  of  21.88  (SD  = 17.51).  When 
Cooperative  Learning  groups  were  reinstated,  cooperation 
increased  to  a mean  level  of  217.22  (SD  = 46.04). 

Trend  Analysis  for  Single-Case  Data 

Similar  to  changes  in  level  and  slope,  autocorrelation 
is  frequently  difficult  to  detect  through  visual  inspection 
alone.  In  examining  the  cooperation  data  in  Figure  1,  the 
potential  confound  of  autocorrelation  is  plausible  when  we 
consider  the  nature  of  the  variables.  That  is,  the  reliability 
of  the  cooperation  may  be  questionable,  which  could  lead  to 
autocorrelated  errors.  Furthermore,  the  effects  of  coopera- 
tive groups  could  be  obscured  because  during  the  initial 
baseline  phase,  the  amount  of  interaction  may  be 


autocorrelated  due  to  the  subject’s  acclimation  to  the  class- 
room. which  is  substantiated  by  the  trends  in  the  first  Coop- 
erative Learning  phase  where  cooperation  measures  are 
trending  upwards  as  phases  are  changed.  This  being  the  case, 
we  cannot  be  completely  confident  that  the  apparent  results 
are  a function  of  the  treatment  and  not  merely  a function  of 
cycles  or  errors  that  are  correlated  with  these  variables. 
However,  because  of  the  small  number  of  observations  within 
each  phase,  one  must  consider  the  low  power  of  investigat- 
ing with  in-phase  autocorrelation.  Therefore,  autoregressive 
analyses  would  not  be  considered  valid  and  trend  models 
would  be  preferred. 

One  cause  of  autocorrelation 
in  single-case  observations  is  the 
failure  to  specify  elements  in  the 
model  which  represent  all  the  in- 
fluences at  work.  If  the  statistical 
model  is  a regression  analysis,  these 
trends  can  be  included  as  a 
covariate.  The  effect  of  an  inter- 
vention, however,  may  result  in  a 
change  in  slope  as  well  as  a change 
in  level,  or  in  some  cases  just  a 
change  in  slope  (Kazdin,  1984). 

Kelly,  McNeil,  and  Newman 
(1973)  proposed  a comprehensive 
approach  that  assesses  shifts  in 
level  and  slope.  This  approach  uses 
time  of  observation  (/)  as  a 
covariate,  dummy  codes  (Xp  to  rep- 
resent the  phases,  and  an  interac- 
tion term  involving  the  multiplica- 
tion of  t and  Xj  to  estimate  the 
change  in  slope.  However,  t and 
Xj  are  necessarily  correlated  in  the 
40  ABAB  design,  which  often  makes 
the  separation  of  baseline  and  post- 
treatment effects  difficult.  There- 
fore, the  use  of  a piecewise  regres- 
sion, akin  to  regression-discontinu- 
ity models  (Trochim,  1984),  has 

been  recommended.  Thus,  a researcher  interested  in  statis- 
tically controlling  autocorrelative  trends  and  assessing 
changes  in  slope  may  use  some  variant  of  the  following 
Model: 

Yt  ~ b0  + b,Xu  + b2X2l  + b,X3(  + b4t*  + b5X„  t*  + b6X2t  I*  + t*  + ct  , 

0) 

where  Xjr , X ^ and  Xit  are  dummy  codes  for  each  phase  fol- 
lowing the  initial  baseline.  That  is,  observations  belonging 
to  the  initial  baseline  received  zeros  on  all  three  dummy 
codes.  Based  on  the  idea  of  centering,  t is  rescaled  such  that 
t+  = 1 at  the  start  of  each  phase  thus  reducing  the  correlation 
of  t*,Xj,  and  the  interaction  (change  in  slope)  term.  For  the 
entire  time-series,  /*  ~ /.  For  observations  in  the  first  treat- 
ment phase,  /*  = (/-  «#l),  /*-(/-  «tI  - nh])  for  the  reversal 


Treatment  Sessions  (in  four  Phases) 

Figure  1.  Seconds  of  Interaction  (Cooperation)  as  a function  of  Treatment  phases. 

Dotted  lines  represent  the  within-phase  regressions  solved  in  Equations  2 through  6. 
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phase  observations,  and  t*  = (r  - «tl  - «bl  - h^)  for  the  fourth 
phase,  where  «ar  «b|,  and  are  the  number  of  data  points  in 

each  of  the  first  three  phases,  respectively.  It  should  be  noted 
that  other  approaches  to  rescaling  t have  been  suggested 
(Gorsuch,  1983;  Huitema,  McKean,  & McKnight,  1994; 
Kelley  et  al.,  1973);  however,  all  versions  lead  to  the  same 
full-model  R2  and  test  statistics,  only  the  interpretation  of 
the  regression  coefficients  and  tests  of  specific  hypotheses 
differ.  For  model  (1),  the  initial  baseline  level  of  behavior  is 
estimated  by  bQ.  Also  in  this  model,  bv  bv  and  63  estimate 
the  respective  changes  in  level 
as  compared  to  the  initial 
baseline.  The  three  interaction 
terms  (Z>5,  b6>  and  b7)  estimate 
changes  in  slope  as  compared 
to  the  baseline  regression  (b4). 

For  those  more  familiar  with 
other  types  of  analyses,  Model 
(1)  gives  parameter  estimates 
and  test  statistics  equivalent  to 
an  ANCOVA  with  time  (r)  as  a 
covariate.  It  should  be  noted 
that  in  ANCOVA  models,  a sig- 
nificant time  by  phase  interac- 
tion indicates  that  slopes  signifi- 
cantly change  (are  not  parallel) 
across  treatment  which  is  the  re- 
gression equivalent  to  rejecting 
the  following  null  hypothesis, 

H0;  b$  = b6  = b7  = 0.  This  sig- 
nificant heterogeneity  of  regres- 
sion effect  may  obscure  the  in- 
terpretation of  Phase  main  ef- 
fects in  single-case  designs. 

Through  the  regression 
approach,  pairwise  tests  of  re- 
gression coefficients  are  also 
available.  For  example  in 
model  (1),  the  test  of  bA  = 0 as- 
sesses whether  the  initial 
baseline  regression  significantly 
differs  from  zero.  Tests  of  b5  = 

0,  b6  = 0,  and  b7  = 0,  assess 
whether  the  slopes  of  the  first 
treatment  phase,  removal  phase, 
and  second  treatment  phase  sig- 
nificantly differ  from  the  initial 
baseline  regression  (&4),  respec- 
tively. Furthermore,  testing  b$ 

= b6  assesses  whether  the  slope 
changes  between  the  first  treat- 
ment and  removal  phases. 

Likewise,  testing  b6  = b7  as- 
sesses whether  slope  changes 
between  removal  phases  and  the 
second  treatment  phase.  It 


should  be  mentioned  that  if  a researcher  is  interested  in  mul- 
tiple comparisons,  corrections  for  the  inflation  of  Type  I er- 
rors (i.e.,  Bonferroni  adjustment)  is  strongly  suggested.  In 
this  case  with  four  phases,  six  pairwise  comparisons  are  pos- 
sible. Thus,  the  Bonferroni  adjusted  significance  level  is  a = 
.05/6  = .0083. 

For  the  cooperation  data  in  Figure  1 , the  statistical  trend 
Model  (1)  was  employed  to  control  dependency.  The  Ap- 
pendix gives  the  raw  data  in  Figure  1 and  the  SAS  (1993) 


Dependent  Variable:  COOP  Analysis  of  Variance 

Sum  of 

Mean 

Source 

DF  Squares 

Square 

F Value  Prob>F 

Model 

7 387087.71324 

55298.24475 

72.657  0.0001 

Error 

31  23593.72266 

761 

.08783 

C Total 

38  410681.43590 

Root  MSE  27.53782  R-square  0.9425 

Dep  Mean  131 

.25641 

C.V.  21.01827  Adj  R-sq  0 

.9296 

Parameter  Standard 

T for  HO: 

Varia'  * DF 

Estimate  Error 

Parameters 

Prob  > ] T] 

INTERCEP  1 

13.466667  18.84606907 

0.715 

0.4802 

XI  1 

73.881818  25.36661513 

2.913 

0.0066 

X2  1 

38.140476  28.58781834 

1.334 

0.1919 

X3  1 

139.172222  27.51108071 

5.059 

0.0001 

TSTAR  1 

5.442424  3.03731905 

1.792 

0.0829 

X1T  1 

13.875758  3.81413155 

3.638 

0.0010 

X2T  1 

-12.049567  5.22938292 

-2.304 

0.0281 

X3T  1 

7.474242  4.68082302 

1.597 

0.1205 

Dependent  Variable:  COOP 

Test:  INTERACT 

Numerator:  8549.6306 

DF: 

3 

F value : 

11.2334 

Denominator:  761.0878 

DF: 

31 

Prob>F : 

0.0001 

Test:  B5EQB6 

Numerator:  21820.3648 

DF: 

1 

F value  : 

28.6700 

Denominator:  761.0878 

DF: 

31 

Prob>F : 

0.0001 

Test:  B5EQB7 

Numerator:  1732.0356 

DF: 

1 

F value : 

2.2757 

Denominator:  761.0878 

DF: 

31 

Prob>F : 

0.1415 

Test:  B6EQB7 

Numerator:  9417.3669 

DF: 

1 

F value: 

12.3736 

Denominator:  761.0878 

DF: 

31 

Prob>F : 

0.0014 

Test:  IMPACTB1 

Numerator:  2348.1142 

DF: 

1 

F value : 

3.0852 

Denominator:  761.0878 

DF: 

31 

Prob>F : 

0.0889 

Test:  NB1EQ2 

Numerator:  5916.7740 

DF: 

1 

F value: 

7.7741 

Denominator:  761.0878 

DF: 

31 

Prob>F : 

0.0090 

Test:  NB1EQ3 

Numerator:  11648.5775 

DF: 

1 

F value: 

15.3052 

Denominator:  761.0878 

DF: 

31 

Prob>F : 

0.0005 

Test:  NB1EQ12 

Numerator:  98605.1992 

DF: 

1 

F value: 

129.5582 

Denominator:  761.0878 

DF: 

31 

Prob>F : 

0.0001 

Test:  IMPACTA2 

Numerator:  74059.4949 

DF: 

1 

F value: 

97.3074 

Denominator:  761.0878 

DF: 

31 

Prob>F : 

0.0001 

Test:  NA2EQ8 

Numerator:  17396.4649 

DF: 

1 

F value: 

22.8574 

Denominator:  761.0878 

DF: 

31 

Prob>F : 

0.0001 

Test:  IMPACTB2 

Numerator:  35023.3343 

DF: 

1 

F value: 

46.0175 

Denominator:  761.0878 

DF: 

31 

Prob>F : 

0.0001 

Test:  NB2EQ9 

Numerator:  91856.6676 

DF: 

1 

F value: 

120.6913 

Denominator:  761.0878 

DF: 

31 

Prob>F : 

0.0001 

Figure  2.  Edited  SAS  Output  for  Analysis  of  Data  in  Figure  1. 
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commands  for  performing  the  following  analyses.  Figure  2 
shows  a SAS  output  for  Model  (1),  which  yielded  the  fol- 
lowing regression  solution: 

Y , = 1 3 .467  + 1 9.458*If  - 8 1 .593^  - 24. 1 0 \Xy  + 5.442/*  + 

13.8762T,,  /*  - 12.050^  /*  + 7.474X3/  /*  . (2) 

As  can  be  seen  in  Figure  2,  the  first  two  interaction 
regression  coefficients  (X]  and  JQ  were  significantly  differ- 
ent from  zero  indicating  that  the  slopes  in  the  first  treatment 
phase  and  the  reversal  phase  changed  from  the  regression 
slope  of  the  initial  baseline,  respectively.  Also,  ANCOVA 
model  with  / as  the  covariate  showed  a statistically  signifi- 
cant interaction  of  time  and  phase  (HO:  b5  = b6  = bn  = 0), 
F(3,31)  = 1 1.23,/?  < .0001,  which  indicates  that  the  slopes 
changed  significantly  across  phases. 

With  this  statistical  interaction,  one  might  choose  to 
plot  each  phase  separately,  for  descriptive  purposes.  Fur- 
thermore, in  the  presence  of  significant  interactions  (i.e., 
changes  in  slope),  however,  one  should  be  cautious  in  inter- 
pretation of  changes  in  level.  Since,  in  the  dummy  coding 
process  baseline  observations  were  given  values  of  zero 
across  Xv  Xv  and  Xv  their  respective  regression  coefficients 
are  not  weighted.  Thus  for  the  baseline  data: 

Y M = 13.467  + 5.442/*  (3) 

For  the  data  in  the  first  Cooperative  Learning  phase, 
only  Xx  was  assigned  values  of  1 , X2  andX^  were  assigned  0; 
thus,  the  regression  equation  for  the  acquisition  phase  is: 

YB}  = 13.467  + 73.882  + 5.442/*  + 13.876/* 

Since,  /*=(/-  «tJ)  in  the  first  treatment  phase, 
yB}  =87.348  + 19.318/*  (4) 

Using  this  same  process,  the  regression  solution  for 
the  reversal  phase  is, 

Ya2  = 51.607  - 6.607/*  , (5) 

and  for  the  last  treatment  phase, 
fB2  = 152.639  + 12.917/*  ; (6) 

Other  pairwise  tests  show  that  the  slope  in  the  reversal 
phase  was  significantly  different  than  the  slopes  in  the  first 
[F(l,31)  = 28.67,  p < .0001]  and  second  treatment  phases, 
F(  1,31)=  12.37,/?  = .00 1 4.  The  slopes  of  the  two  treatment 
phases  did  not  sign ificantly  differ,  F(  1 ,3 1 ) = 2.28,  p - . 1 4 1 5, 
Therefore,  it  seems  that  the  removal  of  Cooperative  Learn- 
ing groups  changed  rate  of  cooperation  to  a negative  slope. 
When  Cooperative  Learning  groups  were  reinstated  the  rate 
of  cooperation  over  time  again  became  an  increasing  func- 
tion. Thus,  cooperative  behavior  increases  more  rapidly 
when  the  student  is  part  of  a Cooperative  Learning  group. 

As  in  ANCOVA  models,  when  a significant  interac- 
tion of  the  independent  variable  and  the  covariatc  is  present, 


the  use  of  some  follow-up  analysis  such  as  the  Johnson- 
Neyman  technique  is  suggested.  In  single-case  research,  this 
means  that  one  searches  for  observation  points  within  a phase 
where  the  values  of  the  dependent  variable  are  significantly 
changed  as  compared  to  some  other  phase,  while  statisti- 
cally controlling  the  effects  of  the  within-phase  regression. 
Rogosa  (1980)  contends  that  researchers  should  select  points 
of  theoretical  interest,  which  allows  for  tests  of  very  specific 
hypotheses.  In  single-case  research,  an  experimenter  may 
wish  to  test  all  observation  points  in  the  phase  for  statistical 
significance.  Thus,  Rogosa’s  (1980)  pick-a-point  method 
was  used  to  investigate  at  what  observation  point  after  chang- 
ing phases  did  cooperation  significantly  change.  However, 
this  requires  many  statistical  tests.  For  this  example,  a 
Bonferroni  adjustment  was  used  so  that  a = .0017. 

To  assess  the  immediate  impact  of  the  first  Coopera- 
tive Learning  phase,  one  must  compare  the  first  observation 
(/*  = 1)  of  the  treatment  phase  (6j)  as  compared  to  the  last 
observation  (/*  = 10)  in  the  initial  baseline  phase  (see  Equa- 
tions 1 and  2).  Thus,  a method  similar  to  regression-discon- 
tinuity analysis  (Trochim,  1984)  was  employed  to  test  the 
following  null  hypothesis: 

H0:  10 bA  = 6, + 1*4  +l*s  • (7) 

The  results  showed  that  the  first  treatment  phase  did 
not  immediately  increase  cooperation  over  the  last  observa- 
tion of  the  baseline,  F(l,  31)  ~ 3.09,  p = .0889.  To  test 
whether  significant  differences  occur  through  any  of  the  «bl 
points  in  the  first  treatment  phase,  null  hypotheses  of  the 
following  general  form  can  be  used: 

Ho:  W.A  = + + "bA 

Given  that  n%x  = 10,  testing  (8)  from  nb]  = 2 to  12, 
showed  that  the  amount  of  time  engaged  in  social  interac- 
tion did  not  significantly  increase  by  the  second  observation 
in  the  treatment  phase,  F(  1 , 3 1 ) = 7.77,  p - .0090.  However, 
cooperation  was  significantly  increased  over  the  last  baseline 
observation  by  the  third  treatment  observation,  F(  1,  31)  = 
15.31,  p - .0005  (see  Figure  2 for  results).  This  increased 
level  of  cooperation  continued  through  the  rest  of  the  first 
treatment  phase  (ps  < .0001).  This  indicates  that  the  imple- 
mentation of  Cooperative  Learning  groups,  which  has  strong 
effects  on  the  rate  of  cooperative  behavior,  had  a gradual, 
but  permanent  effect  on  the  level  of  cooperation. 

To  assess  whether  a statistically  significant  reduction 
in  cooperation  occurred  at  any  point  (nt2)  during  the  removal 
phase  as  compared  to  the  last  observation  of  the  first  treat- 
ment phase  (mm  = 12) , null  hypotheses  of  the  following  gen- 
eral form  can  be  tested: 

H0-  bt  + nbtbA  + nMbi  = b2  + n^b,  + nj>t . (9) 

Statistical  tests  for  h = 1 to  \ showed  that  the  removal 

&2 

of  Cooperative  Learning  groups  immediately  lowered  co- 
operative behavior  as  compared  to  the  last  observation  in 
the  second  baseline,  F(l,  31)  = 97.31,  p < .0001.  This  rc- 
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duction  in  cooperation  remained  statistically  significant 
throughout  the  reversal  phase  (see  Figure  2). 

To  assess  whether  a statistically  significant  increase 
in  cooperation  occurred  during  the  last  treatment  phase  as 
compared  to  the  last  observation  of  the  removal  phase  (n^  = 
8),  null  hypotheses  similar  to  (9),  with  substituted  for  nb] 
and  nh2  substituted  for  n were  formed.  The  results  indicate 
that  the  re- instatement  of  Cooperative  Learning  groups  im- 
mediately increased  cooperative  behavior  over  the  last  ob- 
servation in  the  second  baseline,  F(  1,  31)  = 46.02,  p < 
.0001  (see  Figure  2).  This  significant  increase  in  the  num- 
ber of  seconds  engaged  in  social  interaction  remained  through 
last  treatment  phase  (ps  < .0001).  The  reader  is  referred  to 
Rindskopf  (1984)  and  Rogosa  (1980)  for  more  details  on 
testing  specific  linear  hypotheses  of  this  form.  Jennings 
(1988)  provides  a very  usable  guide  to  ANCOVA  follow-up 
procedures  and  test  of  linear  hypothesis. 

In  summary,  despite  the  claims  that  single-case  data 
are  not  amenable  to  regression-based  methods,  the  models 
presented  provide  a flexible  approach  to  the  statistical  analy- 
sis of  single-case  data.  Furthermore,  regression-based  mod- 
els provide  a way  of  statistically  controlling  the  confound- 
ing effects  of  autocorrelation.  It  should  also  be  noted  that  if 
nonlinear  processes  are  suspected  within  phases  they  can 
also  be  modeled  statistically  (Kelly  et  al.,  3973;  Trochim, 
1984).  In  the  presence  of  autocorrelative  or  nonlinear  pro- 
cesses, as  with  other  analytic  models,  it  would  be  important 
to  obtain  a sufficient  number  of  baseline  observation  so  that 
the  within-phase  trends  could  be  modeled.  In  situations 
where  the  baseline  series  were  not  of  adequate  length,  non- 
parametric  tests  of  single  case  intervention  effects  may  be 
employed  (e.g.,  Edgington,  1992;  Levin  etal.,  1978).  Many 
studies  have  shown  the  benefits  of  nonparametric  and  ran- 
domization tests,  however,  least-squares  regression  ap- 
proaches to  analyzing  single  case  designs  have  fared  well  in 
simulation  studies  (Huitema  et  a!.,  1994).  Moreover,  regres- 
sion models  can  be  generalized  to  many  single  case  designs 
including  multiple  baseline,  and  alternating  treatment  de- 
signs (see  Kelly  et  al.,  1973).  One  caveat  that  must  be  ad- 
dressed, however,  is  that  the  assumptions  of  linear  regres- 
sion apply.  Therefore,  regression  diagnostics  such  as  in- 
spection of  residuals  and  tests/corrections  for 
heteroscedasticity  are  important.  Future  simulation  studies 
should  focus  on  comparing  the  statistical  properties  of  least- 
squares  regression  methods  to  nonparametric  and  random- 
ization tests  under  situations  that  occur  most  frequently  in 
single-case  research. 
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APPENDIX 

SAS  Commands  for  Analyzing  Data  in  Figure  1. 

data  one/options  ls=73; 
input  coop  @®; 
nal=10  ; nb  1 = 12  ; na2  = 8 ;nb2  = 9 ; 
t =_n_ ; 

if  t <=  nal  then  phase=l; 

if  t > nal  & t <=  (nal+nbl)  then  phase=2; 

if  t > (nal+nbl)  & t <=  (nal+nbl+na2)  then  phase=3 ? 

if  t > (nal+nbl+na2)  then  phased; 

xl=0 ;x2s0 ;x3=0 ; 

if  phase=2  then  xl-1; 

if  phase=3  then  x2=l; 

if  phase=4  then  x3=l; 

tstar-t; 

if  phase=2  then  tstar=t-nal; 
if  phase=3  then  tstar=t-nal-nbl; 
if  phased  then  tstar=t-nal-nbl-na2  ; 
xlt=xl* tstar ;x2t=x2* tstar ; x3t=x3* tstar ; 
cards ; 

10  5 52  25  75  30  50  80  55  52 

85  95  150  200  150  250  200  300  280  290  285  270 

50  35  40  20  10  5 10  5 

155  175  170  225  250  230  275  195  280 

proc  reg;model  coop=  xl  x2  x3  tstar  xlt  x2t  x3t? 
interact:  test  xlt-0, x2t=0 ,x3t=0; **  Test  of  interaction,  Ho:  b5=b6=b7=0 
b5EQb6 : test  xlt=x2t;**  Pairwise  test  of  b5  = b6  ; 
b5EQb7:  test  xlt=x3t ; **  Pairwise  test  of  b5  = b7  ; 


b6EQb7 : test  x2t=x3t;**  Pairwise  test  of  b6  - b7  ; 

**  Introduction  of  Treatment (Phase  2)  Compared  to  Initial  Baseline (Phase  1)  ; 


impactbl: 

test 

10*tstar  s l*tstar 

+ 

xl  + 

l*xlt;*Test 

of 

Eq. 

7, 

10b4=bl+b4+b5 ; 

nbleq2 : 

test 

10*tstar  = 2*tstar 

+ 

xl  + 

2*xlt ; *Test 

of 

Eq. 

8, 

nal=10 

nbl=2 ; 

nbleq3 : 

test 

10*tstar  = 3*tstar 

+ 

xl  + 

3*xlt ; *Test 

of 

Eq. 

8 , 

nal=10 

nbl=3 ; 

nbleql2:  test  10*tstar  =12*tstar  + xl  +12*xlt; 

**  Test  of  Eq.  8,  nal=10  nbl-12; 

**  Reversal  Effects  (Phase  3)  Compared  to  Treatment  (Phase  2) 
impacta2:  test  12*tstar  + xl  + 12*xlt  = l*tstar  + x2  + l*xlt; 

**  Test  of  Eq,  9,  nbl=12  na2=l; 


na2eq8:  test  12*tstar  + xl  + 12*xlt  = 8*tstar  + x2  + 8*xlt; 

**  Test  of  Eq.  9,  nbl=12  na2=8; 

***  Effect  of  Treatment  (Phase  4)  Compared  to  Reversal  ) Phase  3)  ***; 

impactb2:  test  8*tstar  + x2  + 8*x2t  - l*tstar  + x3  + l*x3t;**Test  of  Eq.  9, 
na2  substituted  for  nbl,  nb2  substituted  for  na2 , na2=8  nb2=tl; 


nb2eq9:  test  8*tstar  + x2  + 8*x2t  = 9*tstar  + x3  + 9*x3t;**Test  of  Eq . 9, 
na2  substituted  for  nbl,  nb2  substituted  for  na2 r na2=8  nb2=9; 


proc  glm; class  phase; 

model  coop*  phase  tstar  phase*tstar/solution ; 
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The  Use  of  Multiple  Regression  Models  to  Determine  if  Conjoint 
Analysis  Should  Be  Conducted  on  Aggregate  Data 


John  W.  Fraas,  Ashland  University 
Isadore  Newman,  The  University  of  Akron 


Abstract 

Conjoint  analysis  is  a statistical  procedure  often  used  by  marketing  researchers  to  measure  the  relative 
importance  of  various  characteristics  of  a product  or  service  as  perceived  by  consumers.  During  the  past 
ten  years,  conjoint  analysis  has  been  used  to  estimate  consumers ' preferences  for  many  different  types  of 
products  and  services  including  educational  services . In  a conjoint  analysis  study , a researcher  must 
determine  whether  the  product  factor  estimates,  which  are  used  to  measure  consumer  preferences , should 
be  calculated  and  interpreted  for  each  respondent  or  the  respondents  collectively.  The  purpose  of  this 
article  is  to  demonstrate  how  a researcher  can  use  multiple  regression  models  to  determine  whether  it  is 
appropriate  to  analyze  and  interpret  the  aggregate  data  by  examining  the  factor -respondents  interaction 
effects.  A hypothetical  example  is  used  to  clarify  how  this  technique  can  be  used. 


It  is  a common  task  for  marketing  researchers  to 
attempt  to  measure  the  relative  importance  of  various  at- 
tributes of  a product  or  a service  as  viewed  by  its  consum- 
ers. In  the  mid-1970s,  marketing  researchers  began  to  use 
conjoint  analysis  as  a tool  to  measure  the  relative  impor- 
tance of  a product’s  attributes  as  perceived  by  its  current 
and  prospective  buyers.  As  noted  by  Hair,  Anderson,  Tatham, 
and  Black  (1995),  “conjoint  analysis  is  best  suited  for  un- 
derstanding consumers’  reactions  to  and  evaluations  of  pre- 
determined attribute  combinations  that  represent  potential 
products  or  services”  (p.  557). 

Wittink  and  Cattin  ( 1 989)  documented  the  widespread 
use  of  conjoint  analysis  by  various  companies  and  institu- 
tions. It  should  be  noted,  however,  that  conjoint  studies  have 
not  been  restricted  to  just  the  business  arena.  Such  studies 
have  been  conducted  for  educational  institutions  as  well 
(Fraas  & Paugh,  1990).  With  the  increased  pressure  on  edu- 
cational institutions  to  market  their  services,  this  type  of  in- 
formation may  provide  valuable  information  on  how  to  mar- 
ket or  possibly  change  an  institution’s  educational  service 
to  match  the  preferences  of  its  potential  and  current  students. 

One  issue  that  a researcher  who  utilizes  conjoint  analy- 
sis will  face  is  whether  it  is  appropriate  to  analyze  the  re- 
spondents’ data  collectively.  That  is,  the  researcher  has  the 
choice  of  fitting  the  model  to  the  aggregate  of  the  consum- 
ers’ responses  or  fitting  a model  to  each  of  the  respondent’s 
data  separately.  As  noted  by  Hair  et  al.  (1995),  “unless  the 
researcher  is  definitely  dealing  with  a population  exhibiting 
homogeneous  behavior  with  respect  to  the  factors,  aggre- 
gate analysis  should  not  be  used”  (p.  579). 


Thus,  a researcher  who  has  collected  data  in  a con- 
joint study  must  decide  whether  the  population  exhibits  ho- 
mogenous behavior  with  respect  to  the  factors.  The  purpose 
of  this  article  is  to  demonstrate  how  a researcher  can  use 
multiple  regression  models  to  determine  if,  in  fact,  the  popu- 
lation exhibits  such  responses. 

Conjoint  Analysis 

As  previously  stated,  conjoint  analysis  is  an  analytical 
procedure  used  to  measure  the  relative  importance  of  vari- 
ous characteristics  of  a product  or  service  as  perceived  by 
consumers.  The  reader  is  encouraged  to  refer  to  Hair  et  al. 
(1995)  for  an  excellent  discussion  of  the  steps  that  a re- 
searcher should  follow  when  conducting  a conjoint  study. 
Only  a brief  discussion  of  the  essential  components  of  a con- 
joint analysis  study  is  presented  here. 

When  conducting  conjoint  analysis,  the  researcher 
must  first  identify  the  key  decision  criteria,  that  is,  the  fac- 
tors that  are  involved  in  the  choice  process.  Once  these  fac- 
tors are  identified,  the  researcher  must  determine  the  num- 
ber of  characteristics,  which  is  referred  to  as  the  number  of 
levels,  that  each  factor  will  contain.  Based  on  the  number  of 
factors  and  their  number  of  levels,  the  researcher  creates  the 
various  hypothetical  products.  These  hypothetical  products 
or  services  will  consist  of  different  combinations  of  factor 
characteristics. 


The  number  of  factors  and  factor  levels  dictate  the 
number  of  hypothetical  products  that  the  respondents  must 
evaluate.  When  the  number  of  different  products  or  services 
is  not  prohibitive^  ^r^e,  a full-factorial  design  could  be 
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used.  Often,  however,  a conjoint  study  will  include  a sig- 
nificantly large  number  of  factors  and/or  factor  levels.  In 
such  a case,  the  total  number  of  possible  hypothetical  prod- 
ucts would  far  exceed  a respondent’s  endurance  to  evaluate 
each  one.  To  illustrate,  if  a study  involved  four  factors  with 
four  levels  each,  a full- factorial  design  would  require  the 
respondent  to  evaluate  256  or  (4  x 4 x 4 x 4)  different  ser- 
vices. In  studies  such  as  this,  the  researcher  often  assumes 
that  a model  that  contains  only  the  main  effects  will  be  an 
adequate  model  and  then  uses  a fractional-factorial  design. 
The  use  of  such  a design  would  reduce  the  required  number 
of  hypothetical  products  from  256  to  16. 

Once  the  hypothetical  products  are  designed,  the  re- 
searcher has  the  respondents  evaluate  them  by  rating  each 
one  on  a given  point  scale,  such  as  a l-to-10  scale.  The  re- 
searcher uses  a conjoint  analysis  computer  program  to  esti- 
mate the  preference  or  utility  associated  with  each  value  of 
each  factor.  Two  such  computer  programs  are  produced  by 
Bretton-Clark  (1988a,  1988b,  & 1988c)  and  SPSS  (1990). 
These  preference  estimates  are  often  referred  to  as  part-worth 
values.  The  part-worth  values,  which  can  be  estimated 
through  a regression  procedure,  are  used  to  judge  the  impor- 
tance and  type  of  influence  that  the  factor  has  on  the  con- 
sumers’ preferences. 

As  previously  mentioned,  a key  question  that  the  re- 
searcher must  address  before  the  part-worth  values  are  esti- 
mated is:  Should  the  part-worth  values  be  estimated  and  in- 
terpreted for  each  respondent  or  for  the  respondents  collec- 
tively? The  following  section  discusses,  with  the  aid  of  a 
simplified  hypothetical  example,  a technique  that  a researcher 
could  use  to  judge  whether  the  population  is  sufficiently 
homogeneous  with  respect  to  the  influence  of  each  factor  on 
the  respondents’  ratings  to  analyze  their  data  collectively. 

The  Importance  of  the  Factor-Respondents  Inter- 
action Effects 

If  it  is  appropriate  to  conduct  a conjoint  analysis  on 
the  ratings  of  the  respondents  as  a group,  the  researcher  must 
assume  that  the  factors  do  not  interact  with  the  respondents. 
That  is,  the  relative  contributions  of  the  factors  remain  con- 
stant across  the  respondents.  If  this  is  not  the  case,  an  aggre- 
gate analysis  of  the  ratings  of  the  hypothetical  products  could 
be  misleading.  In  such  a case,  segmentation  of  the  respon- 
dents would  be  informative. 

To  determine  if  indeed  factor-respondents  interaction 
effects  are  present,  a researcher  can  use  multiple  regression 
models  that  utilize  person  variables.  Person  variables,  which 
are  discussed  by  Pedhazur  (1977),  Williams  (1977)  and 
McNeil,  Newman,  & Kelly  (in  press),  contain  zero  and  one 
values.  For  a given  person  variable,  a zero  indicates  that  the 
corresponding  criterion  value  was  not  obtained  from  the 
person  represented  by  this  person  variable.  And  a value  of 
one  indicates  that  the  corresponding  criterion  value  was  given 
by  this  person. 


Fraas  and  Newman  (1989)  have  demonstrated  that  a 
multiple  regression  model  that  contains  person  variables  can 
be  used  to  generate  part-worth  values  that  are  identical  to 
the  values  estimated  by  traditional  conjoint  analysis  com- 
puter programs.  Thus,  the  use  of  person  variables  will  not 
change  the  part-worth  estimates.  To  determine  whether  the 
factor-respondents  interaction  effects  are  present,  the  per- 
son vectors  must  be  used  along  with  the  factor  variables  to 
generate  variables  that,  when  used  in  conjunction  with  re- 
gression models,  will  estimate  the  amount  of  variation  in  the 
criterion  variable  that  is  associated  with  those  interaction 
effects.  How  such  variables  are  generated  and  incorporated 
into  the  appropriate  regression  models  can  best  be  explained 
through  the  use  of  a simple  hypothetical  conjoint  study. 

Hypothetical  Conjoint  Study 

Assume  that  a researcher  has  decided  to  use  conjoint 
analysis  to  estimate  the  part-worth  values  for  two  factors 
that  relate  to  the  students’  preferences  for  certain  offerings 
in  a continuing  education  program.  The  first  factor,  which 
consists  of  two  levels,  deals  with  the  number  of  sessions  that 
the  class  would  meet  per  week.  Since  this  factor  contains 
two  levels,  the  variable  that  represents  this  factor  would  con- 
tain zero  and  one  values.  A value  of  zero  represents  a class 
that  would  meet  one  day  a week  for  four  hours.  The  other 
level,  which  is  represented  by  a value  of  one,  indicates  that 
the  class  would  meet  two  days  a week  for  two  hours  each 
day. 


The  second  factor,  which  also  consists  of  two  levels, 
deals  with  the  location  of  the  class.  A value  of  zero  for  this 
location  variable  indicates  that  the  class  would  be  held  in 
Ashland,  Ohio.  A value  of  one  indicates  that  the  class  would 
meet  in  Medina,  Ohio.  The  four  hypothetical  continuing 
education  classes,  which  will  be  evaluated  by  the  prospec- 
tive students,  are  listed  in  Table  1 . 


Table  1. 

Hypothetical  Continuing  Education  Classes 


Hypothetical 

Courses 

Number  of  Class 
Meetings  Per  Week 

Class 

Location 

Course  1 

Two 

Medina 

Course  2 

Two 

Ashland 

Course  3 

One 

Medina 

Course  4 

One 

Ashland 

In  this  example,  we  are  assuming  that  three  prospec- 
tive students  are  asked  to  rate  the  four  hypothetical  classes 
using  a 10-point  scale.  It  should  be  noted  that  for  such  a 
study,  the  number  of  prospective  students  would  normally 
far  exceed  three.  For  the  sake  of  demonstrating  our  proposed 
technique  in  a clear  manner,  however,  the  number  of  respon- 
dents is  limited  to  three. 
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Table  3. 

Variables  Used  to  Generate  the  12  Interaction  Variables 


The  hypothetical  rating  given  to  each  of  the  four  hy- 
pothetical classes  by  each  prospective  student  is  listed  in 
Table  2 under  the  variable  entitled  Y.  The  values  for  the 
factors  that  contain  the  information  regarding  the  Number 
of  class  meetings  per  week  and  the  Location  that  corresponds 
to  these  ratings  are  listed  in  Table  2 under  the  symbols  N, 
and  L,,  respectively.  In  addition,  the  values  for  the  three- 
person  variables  are  also  listed  in  Table  2 under  the  symbols 
Pp  P2,  and  P3. 

Table  2. 

Variables  Used  in  the  Regression  Analyses 


Y 

N, 

Variables  and  Values 

n2  l,  l2  p, 

p2 

p3 

10 

1 

0 

1 

0 

1 

0 

0 

8 

1 

0 

0 

1 

1 

0 

0 

6 

0 

1 

1 

0 

1 

0 

0 

4 

0 

1 

0 

1 

1 

0 

0 

5 

1 

0 

1 

0 

0 

1 

0 

3 

1 

0 

0 

1 

0 

1 

0 

6 

0 

1 

1 

0 

0 

1 

0 

7 

0 

1 

0 

1 

0 

1 

0 

8 

1 

0 

1 

0 

0 

0 

1 

6 

1 

0 

0 

1 

0 

0 

1 

5 

0 

1 

1 

0 

0 

0 

1 

4 

0 

1 

0 

1 

0 

0 

1 

Interaction  Variables 

As  previously  mentioned,  interaction  variables  must 
be  generated  and  included  in  the  multiple  regression  model 
to  determine  if  factor-respondents  interaction  effects  exist. 
These  interaction  terms  are  generated  by  first  creating  a com- 
panion  variable  for  each  factor  variable  in  the  study.  The 
values  contained  in  the  variable  that  serves  as  the  compan- 
ion variable  to  the  Number  of  meetings  per  week  variable 
are  zero  when  the  value  for  N,  is  one.  And  the  value  is  one 
when  the  value  for  N,  is  zero.  The  values  contained  in  the 
variables  that  serve  as  the  companion  variable  to  the  loca- 
tion variable  are  generated  in  the  same  manner.  The  com- 
panion variables  for  the  Number  of  meetings  per  week  and 
the  Location  variables,  which  are  represented  by  the  sym- 
bols of  N2and  L2  respectively,  are  listed  in  Table  2. 

The  next  step  in  generating  the  variables  required  to 
test  the  factor-respondents  interaction  effects  requires  that 
each  of  the  person  variables  (P,,  P2  and  P3)  be  multiplied  by 
each  of  the  two  factor  variables  (N,  and  L,)  and  by  each  of 
the  two  companion  variables  (N2  and  L2).  The  12  interaction 
variables,  which  are  formed  by  multiplying  the  factor  and 
companion  variables  by  the  person  variables,  are  listed  in 
Table  3.  The  values  contained  in  each  interaction  variable 
are  listed  in  Table  4. 


Interaction  Variables 

X,o  = N:*P, 

Xn=N,*P2 

x12  = n,*p3 
x13  = n2*p, 
x14  = n2*p2 
x1s=n2*p3 
X,S  = VP, 
xn=VP2 
X,s  = L.*P3 

x„  = l2*p, 

X20=V*P2 
X:,  = VP3 


Table  4. 

Interaction  Variables  Used  in  the  Regression  Analyses 


*10 

X,. 

X.3 

Variables  and  Values 
X„  X,5  X,e  X„ 

x» 

x„ 

X 

N 

0 

1 

0 

0 

0 

0 

0 

1 

0 

0 

0 

0 

0 

1 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

0 

0 

0 

0 

1 

0 

0 

1 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

0 

0 

0 

0 

1 

0 

0 

0 

1 

0 

0 

0 

0 

0 

1 

0 

0 

0 

0 

0 

I 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

0 

0 

0 

0 

1 

0 

0 

1 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

0 

0 

0 

0 

1 

0 

0 

0 

1 

0 

0 

0 

0 

0 

1 

0 

0 

0 

0 

0 

1 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

0 

0 

0 

0 

1 

0 

0 

1 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

0 

0 

0 

0 

1 

Regression  Models 


Two  regression  models  are  required  to  statistically  test 
the  factor-respondents  interaction  effects.  One  model,  which 
is  referred  to  as  the  Full  Model  contains  the  eight  linearly 
independent  interaction  variables.  It  should  be  noted  that 
these  eight  variables  are  designed  to  measure  the  amount  of 
variation  in  the  ratings  associated  with  the  main  effects  of 
number  of  meetings  and  location,  and  the  respondents  as 
well  as  the  factor-respondents  interaction  effects.  The  Full 
Model  would  be  as  follows: 


Y = a + b10X10  + b,3X„  4 b,4X,4  4 b„XI5  4 b17X|7  + b„X„  4 
b.*x,.  + b»x»+« 


The  other  model,  which  is  referred  to  as  the  Restricted 
Model,  contains  the  two  variables  that  represent  the  Num- 
ber of  classes  per  week  factor,  the  Location  factor,  and  the 
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two  linearly  independent  person  variables.  The  Restricted 
Model  is  as  follows: 

Y - a + bjNj  + b2L,  + b3P.  + b4P2  + e 

When  these  regression  models  were  used  to  analyze 
the  respondents’  ratings  of  the  hypothetical  classes,  the  R2 
values  for  the  Full  Model  and  the  Restricted  Model  are  .943 
and  .390  respectively.  The  difference  between  these  two  R2 
values,  which  is  equal  to  .553,  is  attributed  to  the  factor- 
respondents  interaction  effects. 

This  difference  between  the  two  R2  values  is  statisti- 
cally tested  with  an  F test  by  using  the  following  formula: 


p_  qy-R^/dfo 

(1  -RpJ)/dfd 

where: 

1.  Rp2  represents  the  R2  value  for  the  Full  Model. 

2.  Rr2  represents  the  R2  value  for  the  Restricted  Model. 

3.  dfh  represents  the  value  that  is  equal  to  the  differ- 
ence between  the  number  of  linearly  independent  variables 
in  the  Full  Model  minus  the  number  of  linearly  independent 
variables  in  the  Restricted  Model. 


4.  dfd  represents  the  value  that  is  equal  to  the  number 
of  cases  minus  the  quantity  one  plus  the  total  number  of 
linearly  independent  variables  contained  in  the  Full  Model. 
It  should  be  noted  that  the  number  of  cases  is  equal  to  the 
number  of  respondents  multiplied  by  the  number  of  hypo- 
thetical products. 


Since  the  number  of  cases  in  this  example  is  12  or  (3 
respondents  x 4 products)  and  the  Full  and  Restricted  Mod- 
els contain  eight  and  four  linearly  independent  variables  re- 
spectively, the  dfh  value  is  4 or  (dfh  = 8-4)  and  the  dfd 
value  is  3 or  (dfd  =12-9).  Thus,  the  F value  for  the  differ- 
ence between  the  R2  values  (.553)  would  be  calculated  as 
follows: 


F= 


(.943  -.390)/ 4 

= 7.28 

(1  - .943)  / 3 


The  probability  .for  thxs  F value  is  .067. 


would  allow  the  researcher  to  conclude  that  it  may  be  mis- 
leading to  aggregate  the  data  when  interpreting  the  influ- 
ences of  the  various  factors  on  the  respondents’  ratings.  That 
is,  the  researcher  may  find  it  more  informative  to  segment 
the  respondents  based  on  the  differing  influences  of  the  fac- 
tors on  their  ratings. 

Discussion 

In  this  article  we  have  attempted  to  describe  a tech- 
nique that  a researcher  could  use  to  determine  whether  re- 
spondents’ ratings,  which  are  obtained  in  a conjoint  study, 
should  or  should  not  be  analyzed  and  interpreted  for  each 
respondent.  This  technique  is  based  on  the  position  that  the 
data  should  not  be  aggregated  when  factor-respondents  in- 
teraction effects  exist. 

To  determine  if  respondent-factor  interaction  effects 
are  present,  the  researcher  would  design  two  regression 
models.  The  first  model  would  include  a series  of  variables 
that  measure  the  amount  of  variation  in  the  ratings  that  is 
associated  with  the  factor-respondents  interaction  effects  as 
well  as  the  variation  associated  with  the  factors  and  the  re- 
spondents. The  second  model  contains  only  the  variables 
that  will  measure  the  amount  of  variation  in  the  ratings  asso- 
ciated with  the  factors  and  the  respondents. 

The  difference  between  the  R2  values  of  the  Full  and 
Restricted  Models  is  equal  to  the  proportion  of  variation  in 
the  ratings  of  the  hypothetical  products  that  is  associated 
with  the  factor-respondents  interaction  effects.  This  differ- 
ence is  statistically  tested  with  an  Ftest.  Since  the  denomi- 
nator degrees  of  freedom  value  will  tend  to  be  small  in  this 
procedure,  the  researcher  would  compare  the  probability  of 
this  F value  to  a liberal  alpha  value  of,  possibly  .25.  If  the 
probability  value  of  the  F test  is  less  than  the  alpha  value, 
the  researcher  would  question  the  appropriateness  of  ana- 
lyzing the  aggregate  data-set  and  interpreting  the  results. 

Only  one  simple  type  of  conjoint  analysis  was  used  in 
this  article  to  demonstrate  how  this  technique  could  be  used 
to  assist  the  researcher  in  determining  whether  it  is  appro- 
priate to  aggregate  the  data.  The  reader  should  be  aware  that 
the  technique,  as  presented  in  this  article,  may  need  to  be 
modified  if  it  is  to  be  appropriately  applied  to  more  compli- 
cated conjoint  studies. 


Since  the  denominator  degrees  of  freedom  value  will 
be  quite  small  when  this  technique  is  used,  the  power  of  the 
F test  used  to  test  for  the  factor-respondents  interaction  ef- 
fects will  tend  to  be  low.  To  increase  the  power  of  this  test, 
we  suggest  that  a researcher  use  a liberal  alpha  level,  such  as 
.25.  This  practice  is  similar  to  the  one  used  by  researchers 
who  set  a high  alpha  value,  usually  at  the  .50  level,  when 
attempting  to  determine  if  an  outlier  exists  in  a regression 
analysis  with  the  F tests  of  Cook’s  distance  measures  (Neter, 
Wasserman  & Kutner,  1985), 

Since  the  probability  value  of  this  F test  (F  = 7.28,  p = 
.067)  is  less  than  the  alpha  level  of  .25,  evidence  exists  that 


It  is  important  to  note  that  the  appropriateness  of  us- 
ing this  technique  to  determine  whether  the  analysis  should 
be  conducted  on  the  aggregate  data  is  not  restricted  to  just 
conjoint  studies.  We  believe  that  this  technique  would  be 
equally  valuable  for  researchers  who  utilize  repeated  mea- 
sures designs  and  the  study  involves  more  than  one  respon- 
dent. One  of  the  major  problems  researchers  encounter  when 
analyzing  aggregate  scores  for  respondents  with  repeated 
measures  is  the  possibility  of  not  being  able  to  identify  criti- 
cal incidences.  For  example,  consider  a repeated  measures 
study  in  which  the  scores  for  every  respondent  in  the  ic- 
peated  measures  design  exhibits  a roller  coaster  effect  over 
time,  but  the  peaks  and  valleys  occur  in  different  time  peri- 
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ods.  When  one  aggregates  such  scores,  the  analysis  may 
appear  to  be  linear,  although  not  one  of  the  respondent’s 
possesses  scores  that  are,  in  fact,  linear  over  time.  The  spe- 
cific techniques  that  could  assist  a researcher  in  determining 
whether  it  is  appropriate  to  analyze  the  aggregate  data  in 
such  studies,  although  beyond  the  scopt  of  this  article,  are 
similar  to  the  technique  that  we  have  discussed. 
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Estimating  the  True  Accuracy  of  Regression  Predictions 


Richard  B.  Darlington,  Cornell  University 


Abstract 

Given  the  lack  of  mathematical  proof  to  decide  upon  the  best  estimation  technique,  the  author  presents 
his  comparison  of  four  closed-formula  estimators  ( Burkett , Claudy,  Rozeboom,  Browne)  and  the  omit- 
one  method  for  estimating  TRS,  the  true  shrunken  correlation  (not  to  be  confused  with  TR , the  true 
multiple  correlation).  The  recommendations  are  based  on  artificial  populations  with  known  TRS . 


w e must  distinguish  between  two  concepts  that  are 

usually  confused:  the  true  multiple  correlation  that  I shall 
denote  77?,  and  the  true  shrunken  correlation  that  I shall  de- 
note TRS.  Both  of  these  differ  from  the  observed  multiple 
correlation  R,  which  is  simply  the  correlation  in  the  present 
sample  between  the  true  criterion  or  dependent  variable  Y, 
and  the  estimates  of  Y made  from  the  regression. 

TR  answers  this  question:  If  we  derived  the  same  re- 
gression in  the  total  infinite  population,  thereby  finding  the 
true  regression  slopes,  what  value  would  we  observe  for  /?? 

77?S  answers  a different  question:  Given  that  we  have 
derived  the  regression  in  the  sample,  and  have  presumably 
not  found  the  true  population  regression  weights,  what  cor- 
relation would  we  find  between  Y and  Y if  we  were  to  apply 
this  set  of  regression  weights  to  the  entire  population? 

The  first  question  asks  in  effect  how  good  these  vari- 
ables are  at  predicting  Y , while  the  second  asks  how  good 
these  weights  are.  When  we  ask  about  the  variables,  we 
pretend  we  could  find  the  true  population  weights.  But  when 
we  ask  about  the  weights,  we  are  asking  about  the  weights 
we  have  already  found. 

The  question  about  variables  (involving  TR)  is  usu- 
ally of  most  interest  in  questions  involving  cause  and  effect, 
e.g.,  How  important  is  education  in  determining  income  or 
attitude  toward  abortion?  The  question  about  weights  (in- 
volving TRS)  is  usually  of  most  interest  in  practical  predic- 
tion problems.  If  we  derive  a regression  in  one  sample,  and 
use  that  regression  to  estimate  the  future  performance  of  stu- 
dents or  workers  not  in  the  original  sample,  what  will  be  the 
correlation  between  our  estimates  and  their  actual  perfor- 
mance? 

TRS  is  always  below  77?,  because  in  estimating  TR  we 
are  asking  what  R would  be  if  we  found  the  true  population 
weights.  But  by  definition  those  weights  arc  the  best  weights 
for  the  population,  and  are  thus  almost  certainly  better  than 
the  weights  we  have  found  in  one  particular  sample.  TRS  is 
asking  how  well  those  sample  weights  would  work,  and  they 
almost  certainly  would  not  work  as  well  as  the  true  weights. 


Therefore  our  estimate  of  TRS  is  always  somewhat  below 
our  estimate  of  77?. 

The  standard  formula  for  estimating  77?  is 
Adjusted R 1 =ARS  =R2- 

N-P-l 

This  formula  is  used  in  nearly  every  standard  regres- 
sion program.  Note  that  N is  sample  size,  and  P is  number  of 
predictors. 

The  irrelevance  of  collinearity 

At  first  it  seems  obvious  that  77?  and  77?S  would  fall 
further  below  R when  collinearity  is  high  than  when  it  is 
low.  After  all,  collinearity  increases  the  errors  with  which 
individual  regression  slopes  are  estimated,  and  these  errors 
are  what  cause  77?  and  TRS  to  be  below  the  observed  mul- 
tiple correlation  R . Therefore  it  at  first  seems  obvious  that 
since  collinearity  increases  those  errors,  it  must  increase  the 
amount  by  which  77?  and  TRS  fall  below  R . 

Surprisingly,  however,  collinearity  can  be  ignored  in 
estimating  TR  and  TRS.  The  point  that  is  ignored  in  the  last 
paragraph  is  that  under  collinearity,  errors  in  individual  re- 
gression slopes  tend  to  cancel  each  other  out.  This  is  one  of 
the  most  remarkable  features  of  regression.  To  explain  it 
we  will  consider  the  simple  case  in  which  the  regression  has 
only  two  predictor  variables  X}  and  X2,  which  we  will  as- 
sume are  highly  correlated  positively.  Let  bl  and  b2  denote 
the  regression  slopes  of  these  two  variables. 

It  turns  out  that  the  errors  in  b,  and  b2  are  not  indepen- 
dent. In  samples  in  which  b{  overestimates  its  true  value,  on 
the  average  b2  underestimates  its  true  value,  and  vice  versa. 
But  since  X}  and  X2  are  highly  correlated  the  overestimation 
in  one  slope  tends  to  cancel  out  the  underestimation  in  the 
other  slope,  with  the  result  that  on  the  average  Y is  estimated 
as  accurately  as  if  there  had  been  no  collinearity.  The  greater 
the  collinearity,  the  more  errors  will  cancel  each  other  out. 

The  result  is  that  even  though  individual  slopes  tend 
to  be  estimated  less  accurately  under  collinearity,  Y and  R 
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ar  Tmated  no  less  accurately.  Thus  the  observed  mul- 
tip.  correlation  R tends  to  be  no  higher,  relative  to  TR  and 
TRS,  under  collinearity  than  when  the  predictor  variables 
are  mutually  independent.  There  are  rigorous  mathematical 
proofs  of  this  claim,  in  books  like  Draper  and  Smith  (1981) 
and  Graybill  (1961). 

Four  Closed-Formula  Estimators  of  TRS 


and  then  using  that  regression  to  estimate  Y for  the  one  case 
that  was  omitted.  Let  the  difference  between  the  actual  and 
estimated  Y-scores  for  that  one  case  be  denoted  DCR , for 
“deleted-case  residual”.  Imagine  computing  DCR  for  every 
case  in  the  sample,  by  running  the  regression  N times,  each 
time  with  one  case  omitted.  If  you  then  use  the  N values  of 
DCR  to  estimate  the  accuracy  of  the  regression  predictions, 
you  are  using  the  “omit-one”  approach. 


There  is  no  clear  agreement  about  the  best  way  to  es- 
timate TRS.  The  remainder  of  this  article  describes  and 
evaluates  five  estimates  of  TRS.  Three  of  the  formulas  are 
quite  simple.  One  by  Burket  (1964)  is 


Burket  estimate  = 


NR2-P 

\R(N-P) 


An  estimator  by  Claudy  (1978)  is 

Ciaudy  estimate  =2  JARS -R 


An  estimator  by  Rozeboom  (1978)  is 


Surprisingly,  it  turns  out  that  one  can  compute  the  N 
values  of  DCR  without  actually  computing  the  N omit-one 
regressions.  Nearly  every  standard  regression  program  com- 
putes residuals,  and  a great  many  programs  will  compute 
for  each  case  a value  that  is  called  either  LEVERAGE  or  H. 
This  value  measures  the  “atypicalness”  of  a case’s  scores  on 
the  predictor  variables;  a case  whose  predictor  scores  all  fall 
exactly  at  the  means  has  the  lowest  possible  value  of  LE- 
VERAGE. But  for  our  purpose  here,  the  important  fact  about 
LEVERAGE  is  that  it  can  be  used  to  compute  DCR  via  the 
formula 

DCR  = RESIDUAL/(1  - LEVERAGE) 


Rozeboom  estimate  1 - ^£^(1 

A slightly  more  complicated  procedure  by  Browne 
(1975)  requires  the  user  to  first  compute  an  estimate  of  the 
fourth  power  of  TR,  by  the  formula 


Rho4=ARS2- 


2P{\ -ARS)2 
(A/-1)(W-J°+ 1) 


If  this  formula  yields  a negative  value  for  Rho4,  then 
set  Rho4  = 0.  Then  TRS  is  estimated  by 


Browne  estimate  = 


N 


(N-P~3)Rho4+ARS 
C N-2P-2)ARS+P 


When  these  four  estimates  are  plotted  against  the  ob- 
served multiple  correlation  R for  fixed  values  of  N and  P, 
they  all  approach  R as  R approaches  l . Thus  the  right  end  of 
each  curve  approaches  a straight  line  with  a slope  of  1 . As  R 
declines,  all  four  curves  gradually  get  steeper  until  they  hit 
the  horizontal  axis.  It  is  unreasonable  to  estimate  a negative 
value  of  TRS , so  all  four  estimates  are  taken  to  be  0 if  the 
above  formulas  yield  negative  estimates  of  TRS  or  TRS2. 
When  the  estimators  are  ranked  from  most  liberal  to  most 
conservative,  they  generally  fall  in  the  order:  Burket  (most 
liberal),  Browne,  Claudy,  Rozeboom. 


The  Omit-one  Method  for  Estimating  TRS 

All  the  previous  formulas  assume  multivariate  normal- 
ity. We  now  describe  an  alternative  approach  that  dispenses 
with  this  requirement.  I call  it  the  omit-one  approach.  Its 
computation  is  considerably  more  complex  than  for  any  of 
the  previous  approaches. 

Imagine  omitting  one  case  from  a sample  of  N cases, 
fitting  the  regression  in  the  remaining  sample  of  N-l  cases, 


Then  Y - DCR  gives  the  estimates  of  Y computed  by 
the  omit-one  regressions,  but  without  the  work  of  actually 
repeating  the  regression  /V  times. 

At  first  it  would  seem  that  simply  correlating  these 
values  of  Y - DCR  with  the  actual  Y values  would  give  a 
good  estimate  of  TRS.  However,  it  turns  out  that  this  ap- 
proach actually  gives  an  overly  conservative  estimate  of  TRS. 
The  reason  is  that  if  one  case  has  an  exceptionally  high  value 
of  K,  then  omitting  it  will  lower  the  Y- mean  of  the  remaining 
sample,  and  will  thus  lower  the  estimate  of  Y for  that  one 
case.  This  will  tend  to  lower  the  correlation  just  mentioned. 
But  errors  in  estimating  means  do  not  lower  the  true  value  of 
TRS  at  all,  so  we  want  to  somehow  correct  for  this  lowering. 
You  can  do  this  with  the  help  of  the  formula: 

Mean  of  remaining  sample  = M*N/(N-1)  - Y/(N-1) 

where  the  “remaining  sample”  is  the  sample  after  the 
deletion  of  the  one  case,  and  M is  the  mean  of  the  total  sample. 
This  formula  shows  that  by  adding  Y/(N-1)  to  each  of  the 
(N- 1 ) other  scores,  we  would  change  their  mean  to  M*N/(N- 
1).  That  would  fix  the  problem,  since  that  value  is  indepen- 
dent of  Y.  But  adding  YI(N-\)  to  the  (AM)  other  scores 
changes  the  residual  of  the  deleted  case  Y by  that  same 
amount.  Thus  we  can  instead  adjust  the  residual  by  that 
amount.  But  we  use  the  residual  simply  to  compute  the  pre- 
dicted value  of  K,  so  we  can  instead  adjust  that  value  by  the 
same  amount.  The  “bottom  line”  of  this  reasoning  is  that  we 
can  compute  an  “adjusted  deleted-case  prediction”  ADC P 
for  each  case  from  the  formula 

ADCP  - K-  RESIDUAL/(1  -LEVERAGE)  + }7(AM) 

Correlating  these  ADCP  values  with  the  original  Y 
values  then  gives  an  estimate  of  TRS. 
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Comparison  of  the  five  estimators 

Sometimes  an  estimator  can  be  proven  mathematically 
to  be  the  best  possible  estimator.  No  such  proof  is  available 
for  any  of  the  estimators  of  TRS,  so  I have  compared  them 
numerically.  I used  a 7 x 6 x 1 6 array  of  values  of  the  sample 
size  N,  the  number  of  predictors  P , and  77?  respectively.  I 
let  N range  from  40  to  1 00  in  increments  of  1 0,  let  P range 
from  5 to  30  in  increments  of  5,  and  let  77?  range  from  .05  to 
.80  in  increments  of  .05.  For  each  of  these  7 x 6 x 16  or  672 
combinations  of  N,  P,  and  77?,  I drew  1000  samples  and  fit- 
ted a multiple  regression  in  the  sample.  Because  the  true 
population  regression  slopes  were  known  for  the  artificial 
populations  I used,  I could  compute  the  exact  value  of  TRS 
for  each  sample  regression.  I then  used  each  of  the  five 
estimators  in  turn  to  estimate  TRS.  For  each  estimator  I com- 
puted two  statistics,  LIBCOUNT  and  RMSE , for  each  of  the 
672  combinations.  LIBCOUNT  was  defined  as  the  number 
of  times  the  estimate  of  TRS  exceeded  the  true  TRS  for  that 
sample,  and  RMSE  was  the  root  mean  squared  difference 
between  true  and  estimated  values  of  TRS. 

In  a typical  problem  the  investigator  of  course  knows 
N and  P9  but  does  not  know  77?.  It  seems  unreasonable  to 
average  RMSE  or  other  measures  of  accuracy  across  the  vari- 
ous values  of  77?,  because  this  assumes  that  these  values  occur 
with  equal  frequency  in  real  problems.  Since  the  Burket 
and  Rozeboom  formulas  are  respectively  the  most  liberal 
and  most  conservative  of  the  four  closed-formula  estima- 
tors, Burket  tends  to  be  best  when  TR  is  high,  while 
Rozeboom  tends  to  be  best  when  77?  is  low.  To  avoid  this 
problem  I always  used  the  worst  value  of  LIBCOUNT  or 
RMSE  across  the  1 6 values  of  77?  studied  for  a given  combi- 
nation of  N and  P,  calling  these  worst  values  LIB  MAX  and 
RMSEMAX  respectively.  By  this  means,  the  672  values  of 
LIBCOUNT  and  RMSE  for  each  method  are  reduced  to  42 
values  of  LIBMAX  and  RMSEMAX. 

Clearly  the  worst  value  of  RMSE  is  the  largest.  For 
each  estimator  these  largest  values  always  occured  for  77? 
values  between  .30  and  .70;  they  were  never  at  the  highest 
or  lowest  values  of  TR  studied.  I also  defined  LIBMAX  as 
the  largest  of  the  16  values  of  LIBCOUNT \ rather  than  the 
value  farthest  from  500.  (500  is  half  the  number  of  samples 
used  for  each  combination  of  N and  P.)  This  seems  reason- 
able to  me  because  the  whole  puipose  of  estimating  TRS  is 
to  avoid  an  overly  liberal  estimate  of  a regression’s  predic- 
tive power,  and  RMSE  provides  an  alternate  statistic  that  treats 
overestimates  and  underestimates  equally. 

It  seems  reasonable  to  consider  LIBMAX  values  of 
550  and  below  as  acceptable.  This  allows  for  a little  random 
error  caused  by  the  fact  that  only  1000  samples  were  used, 
and  also  allows  a modest  amount  of  nonrandom  error.  By 
thr  criterion  all  42  values  of  LIBMAX  were  acceptable  for 
Browne  and  for  Omit-one;  their  highest  values  of  LIBMAX 
were  549  and  546  respectively.  For  all  five  methods  the 
highest  LIBMAX  value  came  at  the  highest  P and  lowest  N 


studied,  with  P = 30  and  N = 40.  For  Burket,  LIBMAX  was 
acceptable  only  if  P - 5,  or  if  P = 1 0 and  N > 80;  its  highest 
LIBMAX  value  otherwise  was  877.  For  Claudy,  LIBMAX 
was  acceptable  only  if  P = 5,  or  if  P = 10  and  N > 70,  or  if 
P=  15  and  N>  80;  its  highest  LIBMAX  value  otherwise  was 
759.  For  Rozeboom,  LIBNIAX was  acceptable  only  if  P - 5, 
or  if  P = 10  and  N>  60,  or  if  P = 15  and  N>  80;  its  highest 
LIBMAX  value  otherwise  was  730. 

For  each  of  the  42  combinations  of  N and  P,  I also 
identified  the  method  with  the  lowest  value  of  RMSEMAX. 
With  one  apparently  random  exception,  the  Burket  method 
was  always  best  by  this  criterion  when  P = 5;  and  with  two 
apparently  random  exceptions,  the  Omit-one  method  was 
always  best  by  this  criterion  when  P > 10.  When  the  Omit- 
one  method  is  ignored  as  too  complex,  it  turns  out  that  with 
one  exception  at  the  margin,  the  Burket  method  is  best  when 
N/P  >3.5,  while  the  Browne  method  is  best  when  N/P  <3.5. 

In  summary,  though  Claudy  and  Rozeboom  do  give 
moderately  good  estimates,  there  seems  to  be  no  good  rea- 
son to  use  those  estimators,  since  others  consistently  do  bet- 
ter by  both  the  LIBMAX  and  RMSEMAX  criterion.  The  re- 
maining three  methods  can  be  ranked  in  terms  of  simplicity, 
with  Burket  simplest,  Browne  next,  and  Omit-one  most  com- 
plex. When  multivariate  normality  can  be  assumed  and  N/P 
> 8,  the  simple  Burket  rule  is  quite  satisfactory  since  its 
LIBMAX  value  stays  below  550.  When  multivariate  nor- 
mality can  be  assumed  and  N/P  < 8,  Browne  seems  superior. 
All  42  of  its  RMSEMAX values  exceeded  those  of  Omit-one, 
but  never  by  as  much  as  1 0%.  But  if  computing  power  is  no 
major  obstacle  then  Omit-one  seems  the  clear  choice.  None 
of  its  RMSEMAX  values  exceed  those  of  Burket  by  more 
than  1 .5%,  and  none  at  all  exceed  those  of  Browne.  And 
Omit-one  has  the  further  major  advantage  of  requiring  no 
assumption  of  multivariate  normality — an  assumption  that 
is  quite  important  for  the  competing  methods. 
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Categorical  or  Continuous  Interaction? 


Keith  McNeil,  New  Mexico  State  University 
lsadore  Newman,  The  University  of  Akron 


Abstract 

McClelland  and  Judd  (1993)  concluded  that  many  interactions  have  been  found  with  categori- 
cal variables ; but  few  with  continuous  variables.  Using  a mathematical  point  of  view,  they  concluded  that 
investigating  interactions  with  continuous  variables  was  less  powerful  than  with  categorical  variables. 
This  article  analyses  the  issue  from  three  other  points  of  view:  design  of  the  study,  measurement  of  the 
independent  variable,  and  nature  of  the  question  asked.  Our  present  conclusion  is  that  the  choice  of 
either  categorical  or  continuous  interaction  depends  upon  the  research  hypothesis  being  posed  and  the 
desired  conclusions. 


While  many  statistics  texts  and  researchers  view 
interaction  as  either  a bothersome  assumption  or  a mettle- 
some outcome  clouding  the  interpretation  of  main  effects, 
some  researchers  realize  that  interaction  may  be  an  interest- 
ing phenomenon  in  its  own  right.  Those  who  do  not  believe 
in  panaceas  argue  that  what  works  best  may  depend  upon 
certain  other  factors  — implying  the  need  for  interaction. 

McClelland  and  Judd  (1993)  discussed  two  major  kinds 
of  interactions-those  resulting  from  categorical  data  and 
those  resulting  from  continuous  data.  They  pointed  out  that 
few  researchers  have  obtained  interactions  with  continuous 
variables,  and  they  presented  a mathematical  rationale  for 
why  this  is  the  case. 

While  we  do  not  disagree  with  their  mathematics,  the 
purpose  of  this  paper  is  to  point  out  the  differences  between 
categorical  interaction  and  continuous  interaction.  We  do 
this  by  focusing  on  three  areas:  (a)  design  differences,  (b) 
measurement  differences,  and  (c)  nature  of  the  interaction 
research  hypothesis. 

Design  Differences 

The  basic  design  difference  is  how  the  independent 
variable  is  conceptualized.  The  independent  variable  can  be 
conceptualized  as  either  distinct  levels  (categorical)  or  as  a 
continuum.  Categorical  variables  are  usually  studied  in  con- 
trolled situations  wherein  there  is  maximum  control  over  the 
nature  of  the  levels-often  maximizing  the  differences  be- 
tween the  levels  (as  in  studies  using  treatment  and  control 
groups).  Results  from  such  studies  can  be  generalized  to  those 
levels,  but  not  to  other  levels,  not  even  to  levels  between  the 
studied  levels.  Categorical  designs  are  often  set  up  such  that 
the  independent  variables  are  uncorrelated,  allowing  for  the 
additive  partitioning  of  the  sum  of  squares. 

Continuous  independent  variables  are  usually  obtained 
in  a field  setting  and  therefore  lack  the  rigor  of  laboratory 
control.  Continuous  variables  do  allow  for  the  generaliza- 
tion of  results  to  values  between  those  actually  sampled. 


Continuous  variables  are  usually  correlated,  but  this  is  the 
way  the  real  world  is  and  thus  how  the  real  world  should  be 
modeled. 

Measurement  Differences 

Categorical  variables  can  result  from  either  an  inher- 
ently nominal  variable  or  an  arbitrary  categorization  of  an 
inherently  continuous  variable.  A continuum  may  be  artifi- 
cially dichotomized,  trichotomized,  etc.  The  limits  of  these 
categories  are  usually  determined  from  the  data  (such  as  a 
median  split). 

Arbitrary  splits  in  the  data  limit  the  comparing  of  re- 
sults from  one  study  to  another.  For  example,  the  numerical 
value  of  the  median  split  in  one  study  is  unlikely  to  be  the 
same  as  in  another  study.  With  categorical  data,  the  gener- 
alizations are  limited  to  the  specific  levels  that  were  investi- 
gated, whereas  the  generalizations  with  continuous  data  can 
be  made  to  values  between  the  actual  numbers  observed. 

Continuous  variables  should  be  used  when  one  can 
assume  an  underlying  continuum.  Continuous  variables  al- 
low for  smooth  continuous  relationships  to  be  identified, 
whereas  categorical  variables  allow  only  for  differences  (not 
even  stair-step  kinds,  unless  a priori  trend  analyses  are  per- 
formed). Once  a smooth  relationship  is  found,  further  study 
must  identify  if  that  relationship  represents  the  true  func- 
tional relationship,  or  how  the  variables  are  scaled. 

Identification  of  the  true  functional  interaction  will 
likely  not  be  easy.  But  the  interactions  are  likely  to  be  con- 
tinuous, and  the  relationship  will  be  a function  of  how  the 
construct  is  measured.  The  GLM  approach  facilitates  inves- 
tigation of  various  types  of  interactions  (McNeil,  Newman, 
& Kelly,  1996),  as  will  be  shown  in  a later  section. 

Nature  of  the  Interaction  Research  Hypothesis 

Categorical  interaction  is  defined  as  “the  differences 
arc  different.”  As  a consequence,  the  test  is  usually 
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nondirectional,  simply  looking  for  any  interaction  whatso- 
ever. Categorical  interaction  research  hypotheses  are  usu- 
ally tested  to  make  sure  that  the  assumption  of  no  interac- 
tion is  tenable  so  that  the  main  effects  can  be  interpreted. 
That  is,  interaction  is  usually  not  viewed  as  an  interesting 
phenomenon  in  its  own  right. 

In  addition,  all  possible  interactions  are  usually  tested 
simultaneously.  This  can  be  determined  from  the  degrees  of 
freedom  associated  with  the  test  (4  degrees  of  freedom  in 
Table  1).  The  technique  of  planned  comparisons  can  be  ex- 
tended to  the  interaction  question,  but  seldom  is.  For  instance, 
trend  effects  could  be  planned  ahead  of  the  data  collection, 
and  could  be  the  focus  of  the  study  instead  of  the  main  ef- 
fects being  the  focus.  For  instance,  in  a two-treatment, 
pretest-posttest  design,  the  treatment-by-time  interaction  is 
the  only  interesting  hypothesis.  Both  the  time  and  treatment 
main  effects  are  smaller  than  what  might  otherwise  be 


Table  1. 

Source  Table  for  the  Data  in  Figure  1,  with  Specific 
Trend  Interactions 


expected-because  of  the  expectation  that  the  two  groups 
are  similar  at  pretest. 

Continuous.  The  definition  of  interaction  with  continu- 
ous variables  is  how  one  variable  effects  the  criterion  vari- 
able, depending  on  the  value  of  another  continuous 
variable-the  multiplicative  effect  of  two  predictors  on  the 
criterion.  Because  some  thought  is  put  into  the  test,  the  re- 
search hypothesis  is  usually  directional,  that  is  one  expects 
high  scores  on  one  variable  to  have  a catalytic  effect  on  the 
criterion  with  high  scores  on  the  other  variable.  Thus,  this 
catalytic  effect  is  expected,  and  the  researcher  hopes  to  dis- 
cover it. 


Figure  1. 

Data  analyzed  in  Study 
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Numerical  Example 

Figure  1 contains  fictitious  data  for  a 2 x 5 design.  The 
top  part  of  Table  1 is  the  source  table  resulting  from  these 
data.  Note  that  the  G*T  interaction  source  having  4 degrees 
of  freedom  is  significant.  The  bottom  part  of  Table  1 illus- 
trates the  source  table  when  all  possible  interaction  trends 
are  analyzed.  Note  that  all  of  the  sum  of  squares  is  attributed 
to  the  interaction  between  the  “linear  trend”  in  G and  T.  The 
global  interaction  term  in  Table  1 lumped  together  all  the 
interaction  sums  of  squares  and  produced  a global  test  of  the 
interaction.  Since  the  F is  significant,  the  conclusion  is  that 
there  is  interaction  somewhere,  but  the  “where”  cannot  be 
determined.  What  is  also  possible,  of  course,  is  that  the  glo- 
bal test  may  lead  to  no  significance,  while  a specific  source 
could  be  significant. 

Researchers  who  analyze  continuous  data  usually  only 
test  the  linear  interaction-the  Gl*T  interaction  in  Table  1. 
The  data  in  Figure  1 can  be  treated  as  continuous  by  assign- 
ing numbers  to  the  levels.  We  have  assigned  a “1”  to  the 
data  in  level  1 of  G,  a “2”  to  level  2 of  G,  a “3”  to  level  3 of 
G,  a “4”  to  level  4 of  G,  and  a “5”  to  level  5 of  G (and  a “ 1 ” 
to  level  1 of  T and  a “2”  to  level  2 of  T).  Thus  we  have  two 
continuous  variables,  G and  T,  as  well  as  the  trend  interac- 
tions. Figure  2 contains  the  General  Linear  Model  approach 
for  testing  the  linear  interaction.  The  G**T  linear  interaction 
is  tested  by  comparing  the  Full  Model  in  part  A with  the 
Restricted  Model  in  part  A.  Notice  that  the  F and  probability 
results  are  the  same  as  in  Table  1 . Part  B of  Figure  2 presents 
a slightly  different  approach,  testing  the  linear  interaction 
over  and  above  the  linear  effects  of  the  two  variables.  Part  C 
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indicates  another  way  to  test  the  interaction— which  will  be 
discussed  later.  Because  these  three  approaches  use  differ- 
ent models,  they  are  actually  testing  slightly  different  re- 
search questions.  One  would  not  want  to  make  the  error  of 
incorrectly  testing  the  “interaction  question”--a  type  VI  er- 
ror as  discussed  by  Newman,  Deitchman,  Burkholder,  Sand- 
ers, and  Ervin  (1976),  and  Newman  and  Newman  (1994). 

Figure  2. 

Various  GLM  Analyses  of  the  interaction  hypothesis. 


A.  Replication  of  the  categorical  approach 

Full  Model:  D = a*U  + t*T  + gl*G!  + g2*G2  + g3*G3  + 
g4*G4  + i 1*G5*T  + i2*G2*T  + i3*G3*T  + i4*G4*T  + El 
Want  il  < 0 Restrict  i 1=  0 

Restricted  Model:  D = a*U  +t*T  + gl  *G*  + g2*G2  + g3*G3 
+ g4*G4  + i2*G2*T  + i3*G3+T  + i4*G4*T  + E2 
Numerator  MS:60.00  df:  1 F value:  6000.00 

Denominator  MS:0.0 1 df:  20  prob:  0.000 1 


B.  Testing  linear  interaction  over  and  above  the  two  linear 
effects . 

Full  Model:  D = a*U  + t*T  + g*G  + i*G1+T  + E3 
Want  i < 0 Restrict  i = 0 

Restricted  Model:  D = a*U  + t*T  + g*G  + E4 
Numerator  MS:  60.00  df:  1 F value:  7800.00 

Denominator  MS:  0.007692  df:  26  prob:  0.0001 

C.  Testing  the  interaction  component 

Full  Model:  D - a*U  + i*G*T  + E5 
Want  i < 0 Restrict  i = 0 

Restricted  Model:  D = a*U  + E6 

Numerator  MS:  60.00  df:  1 F value:  8400.00 

Denominator  MS:  0.0071428  df:  28  prob:  0.0001 


Relying  on  the  trend  notions  discussed  above,  other 
kinds  of  interactions  can  be  studied.  One  would  want  to  in- 
vestigate such  interactions  for  one  of  two  reasons.  Either  the 
true  functional  relationship  between  the  independent  vari- 
ables and  dependent  variable  is  that  way,  or  there  is  a scal- 
ing problem  with  one  or  both  independent  variables,  and  the 
nonlinear  interaction  maps  the  scaling  problem. 

Just  as  with  the  categorical  variables  in  Part  C of  Fig- 
ure 2,  one  interaction  term  between  continuous  variables  may 
explain  all  the  variance.  McNeil  ( 1 970)  illustrated  how  New- 
ton might  have  obtained  the  Law  of  Gravity,  which  contains 
only  one  interaction  term,  and  no  main  effects  terms.  The 
interaction  term  is  between  the  linear  component  of  gravity 
and  the  squared  value  of  time  (D  = 1/2  G*T2). 


Conclusion 

Clearly  different  interaction  questions  are  being  asked 
with  categorical  and  continuous  data.  Since  all  of  the  inter- 
actions are  lumped  together  in  the  categorical  approach,  one 
would  expect  to  more  often  find  significant  interactions  with 
the  categorical  approach.  But  what  the  researcher  does  with 
those  interactions  (usually  ignores  them  and  looks  at  simple 
effects)  and  the  extent  to  which  the  researcher  is  really  inter- 
ested in  finding  them  (blast  it,  muddies  up  my  main  effects 
again!)  is  probably  more  important  than  whether  or  not  they 
are  found.  Replication  of  unexpected  interactions  is  another 
issue  that  should  be  considered,  but  unfortunately  is  not.  If 
you  don’t  expect  them  and  you  don’t  want  them,  why  would 
you  even  consider  replicating  the  research  to  find  out  if  they 
are  a stable  phenomenon? 

Testing  for  “interaction”  is,  after  all,  testing  a specific 
hypothesis,  and  that  should  never  be  forgotten-but  it  often 
is.  If  two  statistical  tests  are  testing  different  questions,  then 
they  should  not  be  compared  for  their  relative  power.  What 
they  should  be  compared  for  is  the  reasonableness  of  the 
research  question  that  is  being  tested.  If  one  is  only  inter- 
ested in  making  sure  that  the  assumption  of  no  interaction  is 
a reasonable  assumption,  then  the  use  of  categorical  interac- 
tions makes  sense.  If  one  is  interested  in  determining  func- 
tional relationships,  then  the  use  of  continuous  interactions 
makes  sense. 
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Effectiveness  Testing  Practices 

Educators’  Perceptions  of  the  Effectiveness  of 
Their  Schools’  Standardized  Testing  Practices 

Ronald  N.  Marso  and  Fred  L.  Pigge 
Bowling  Green  State  University 
Abstract 

This  study  was  designed  to  collect  and  then  to  compare  teachers' , principals' , supervisors' , and  testing 
directors'  ( N-484 ) ratings  of  the  effectiveness  of  selected  standardized  testing  program  management 
practices  in  their  schools.  It  was  found  that  these  educators,  who  were  selected  for  being  knowledge- 
able about  their  testing  programs , rated  their  schools ' performance  in  standardized  testing  higher  than 
in  meeting  other  district  responsibilities.  The  highest  rated  testing  practices  were  use  of  quality  tests 
and  materials,  maintenance  of  pupil  records,  and  use  of  understandable  scores  and  reports.  The  lowest 
rated  testing  practices  were  the  use  of  test  results  to  evaluate  instruction,  availability  of  written  policies, 
and  use  of  publisher  instructional  guides  accompanying  achievement  batteries.  Comparatively,  educa- 
tors assigned  to  secondary ! schools  tended  to  rate  the  testing  practices  lower  than  did  their  elementary > 
school  cohorts ; just  the  ratings  of  the  teachers  differed  significantly  among  the  various  job  assignment 
groups;  and  the  job  assignment  groups  provided  similar  relative  ratings  of  the  testing  practices  with 
most  Spearman  Rho  coefficients  being  +.73  or  higher. 


Educators  generally  do  not  have  a high  regard  for  stan- 
dardized testing  despite  the  increased  use  of  these  tests  in 
recent  school  reform  efforts  (Haney  & Madaus,  1989).  For 
example,  many  classroom  teachers  appear  to  have  an  unfa- 
vorable to  indifferent  attitude  toward  standardized  testing 
(Borg,  Worthen,  & Valcarce,  1986),  and  school  administra- 
tors tend  to  view  standardized  testing  as  being  a relatively 
unimportant  administrative  function  in  their  schools  (Sproull 
& Zubrow,  1981).  Additionally,  assessments  of  the  research 
literature  reveal  that  testing  and  evaluation  practices  receive 
less  attention  from  educational  researchers  than  many  other 
aspects  of  education  (Crooks,  1988). 

This  less  than  positive  regard  for  standardized  testing 
is  also  revealed  in  what  many  educators  believe  about  test- 
ing. Classroom  teachers  commonly  believe  that  standard- 
ized testing  skills  are  less  needed  than  are  other  testing  skills 
(Marso  & Pigge,  1988);  many  teachers  perceive  the  primary 
benefits  of  their  school  districts’  standardized  testing  pro- 
grams accrue  not  to  themselves  but  to  the  school  adminis- 
tration (Salmon-Cox,  1981);  building  principals  typically 
do  not  perceive  the  need  for  testing  specialists  to  be  involved 
in  the  selection  of  standardized  tests  (Kinney,  Brickell,  & 
Lynn,  1988);  and  school  counselors  frequently  feel  testing 
services  dominate  too  much  of  their  time  (Miller,  1977). 

Furthermore,  this  less  than  positive  attitude  of  educa- 
tors toward  standardized  testing  may  be  having  an  undesir- 
able impact  upon  standardized  testing  practices  in  the  K- 1 2 
schools.  For  example,  many  teachers  report  very  limited 
use  of  the  results  from  standardized  testing  in  their  class- 
room instruction  (Linn,  1990),  and  educational  administra- 
tors frequently  do  not  convey  the  results  from  standardized 
testing  to  their  teachers  (Wood,  1982).  Further  curtailing 


the  effective  use  of  the  results  from  standardized  testing,  the 
results  of  this  testing,  if  made  available,  typically  are  not 
available  to  educational  staff  until  six  or  eight  or  more  weeks 
after  test  administration  (Hall,  Carroll,  & Comer,  1988). 

Additionally,  some  researchers  have  attributed  the  rather 
recent  movements  toward  alternate  pupil  achievement  as- 
sessments to  the  belief  that  existing  standardized  measures 
are  too  narrow  in  scope  and  may  even  have  a negative  im- 
pact upon  classroom  instruction  (Miller  & Legg,  1993). 
Other  research  findings  have  suggested  that  recent  pressures 
in  schools  to  show  improved  achievement  scores  have  lead 
to  questionable,  if  not  unethical,  methods  of  raising  test  scores 
(Nolen,  Haladyna,  & Haas,  1992).  For  example,  observa- 
tions of  classroom  instruction  have  revealed  that  external 
testing  programs  may  substantially  reduce  time  available  for 
instruction  and  reduce  teachers’  use  of  the  variety  of  instruc- 
tional materials  and  methods  available  to  them  (Smith,  1991). 
Surveys  of  teachers  reveal  the  existence  of  perceived  pres- 
sures, particularly  in  lower  socio-economic  schools,  to  im- 
prove test  scores  by  planning  instruction  around  tests,  by 
increasing  time  spent  on  reviewing  previously  presented  con- 
tent, and  by  teaching  various  test-taking  strategies  (Herman  & 
Golan,  1993).  Relatedly,  surveys  of  adolescent  pupils  indi- 
cate that  they  have  become  suspicious  and  cynical  about  stan- 
dardized tests  and  commonly  do  not  respond  with  positive 
test-taking  strategies  when  being  tested  (Paris,  Lawton, 
Turner,  & Roth,  1991). 

In  brief,  the  existing  research  literature  does  not  spe- 
cifically address  the  effectiveness  of  K- 1 2 schools’  standard- 
ized testing  practices.  This  existing  research  literature  has 
indicated,  however,  that  educators  do  not  hold  standardized 
testing  in  high  regard,  that  limited  management  attention  is 


typically  provided  for  standardized  testing  activities,  that 
the  results  of  standardized  testing  may  have  little  impact  upon 
classroom  instruction,  and  that  the  management  of  standard- 
ized testing  practices  has  received  less  research  attention 
than  many  other  aspects  of  education.  In  light  of  these  re- 
search findings  and  concomitantly  the  increased  use  of  stan- 
dardized tests  in  recent  years,  it  appears  prudent  that  we 
know  more  about  typical  standardized  testing  practices  in 
the  K-12  schools  and  the  effects  of  these  testing  practices 
upon  the  schooling  process  (Paris,  Lawton,  Turner,  & Roth, 
1991).  The  present  study  was  designed  to  identify  and  then 
to  compare  and  contrast  various  educators’  perceptions  of 
the  effectiveness  of  10  researcher  selected  practices  related 
to  the  management  of  their  schools’  standardized  testing 
programs.  More  specifically,  this  study  was  designed  to 
answer  four  research  questions:  1)  To  what  extent  do  test- 
ing directors,  teacher  supervisors,  building  principals,  and 
classroom  teachers  perceive  their  schools’  standardized  test- 
ing practices  to  be  effective?  2)  Do  these  various  groups  of 
educators  differ  one  from  the  other  in  their  perceptions  of  the 
effectiveness  of  these  practices?  3)  Do  groups  of  educators 
assigned  to  elementary  and  secondary  grade  levels  differ  one 
from  the  other  in  their  perceptions  of  the  effectiveness  of  these 
practices?  4)  To  what  extent  do  educators  perceive  that  their 
schools’  testing  practices  encourage  the  use  of  results  from 
standardized  tests  in  classroom  instruction? 

Methods  and  Procedures 

The  data  gathered  for  this  paper  were  one  component 
of  a larger  state-wide  assessment  of  the  management  and 
operation  of  standardized  group  testing  programs  in  the  K- 
12  public  schools  of  Ohio.  Each  of  the  616  nonvocational 
school  districts  was  contacted  regarding  their  willingness  to 
participate  in  an  extensive  investigation  of  standardized  test- 
ing practices  and  of  their  uses  of  the  results  obtained  from 
standardized  testing.  This  inquiry  resulted  in  171  superin- 
tendents indicating  a willingness  to  have  their  school  dis- 
tricts participate  in  the  study.  From  these  171  school  districts. 
1 06  districts  were  randomly  selected  using  type  of  adminis- 
trative organizations  (city,  county  local,  and  exempted  vil- 
lage) of  the  school  districts  as  strata  in  the  selection  process. 
The  number  106  was  determined  to  provide  a sampling  tol- 
erance for  proportions  approximately  within  ±.05  while  also 
providing  a correct  proportion  of  school  organization  types. 
Of  these  106  randomly  selected  districts,  97  districts  (92#) 
ultimately  did  participate  in  the  study. 

Tlie  survey  assessment  instruments  were  mailed  directly 
to  the  participating  superintendents  who  in  turn  were  asked 
to  forward  the  sealed  packets  of  materials  to  their  districts’ 
designated  testing  director  and  to  selected  teacher  supervi- 
sors and  school  principals.  The  criterion  provided  to  the 
superintendents  for  these  selections  was  that  they  select  one 
of  their  elementary  principals,  one  of  their  secondary  prin- 
cipals, and  one  of  their  teacher  supervisors  who  would  be 
most  knowledgeable  about  and  who  could  best  inform  the 


researchers  about  the  practices  and  procedures  of  their  school 
districts’  standardized  group  testing  program. 

The  school  principals  receiving  the  survey  packets  from 
their  superintendents,  in  addition  to  completing  their  own 
assessment  of  their  district’s  testing  practices,  were  directed 
to  select  and  forward  enclosed  survey  materials  to  class- 
room teachers.  The  elementary  principals  were  directed  to 
select  and  to  forward  designated  survey  packets  to  one  class- 
room teacher  assigned  to  grades  one  through  four  and  to 
one  classroom  teacher  assigned  to  grades  five  or  higher.  In 
making  these  selections,  the  principals  also  were  directed  to 
choose  teachers  who  were  most  knowledgeable  about  and 
who  could  best  inform  the  researchers  about  the  practices 
and  procedures  associated  with  their  school  district’s  stan- 
dardized group  testing  program.  The  secondary  principals 
were  asked  to  follow  these  same  procedures,  but  they  were 
asked  to  select  one  classroom  teacher  teaching  in  the  math- 
science  and  one  teaching  in  the  English-social  studies  sub- 
ject areas. 

The  goals  of  this  subject  selection  procedure  were  first, 
to  solicit  assessment  responses  just  from  those  educators 
knowledgeable  about  their  districts’  testing  practices  and 
secondly,  to  insure  responses  from  educators  who  were  rep- 
resentative of  the  instructional,  administrative,  grade  level, 
and  academic  subject  diversities  found  in  the  K-12  schools. 
The  adoption  of  these  sampling  goals  was  deemed  neces- 
sary because  of  the  variety  of  instructional  and  administra- 
tive responsibilities  of  educational  personnel  within  school 
districts.  Furthermore,  variations  in  standardized  test  sched- 
uling frequencies  and  practices  in  the  use  of  the  results  of 
this  testing  from  school  district  to  school  district  result  in 
considerable  diversity  in  the  extent  of  experiences  a par- 
ticular educator  might  have  with  his/her  school’s  standard- 
ized testing  program.  For  example,  as  a consequence  of  test 
scheduling  decisions,  standardized  achievement  tests  and  ac- 
companying scholastic  aptitude  tests  might  not  be  sched- 
uled in  third,  fifth,  seventh,  and  tenth  grades  in  a particular 
school  district  over  a period  of  years  and,  due  to  school 
policy,  the  results  of  such  testing  may  or  may  not  follow 
pupils  into  the  next  grade.  Consequently,  teachers  at  these 
grade  levels  in  this  district  may  have  few  direct  or  even  in- 
direct experiences  with  their  school's  standardized  testing 
program,  whereas  their  cohorts  assigned  to  other  grades  may 
have  frequent  and  direct  involvement  with  their  school’s  stan- 
dardized testing  program. 

The  subject  selection  and  contact  procedures  re- 
sulted in  the  return  of  usable  survey  assessment  forms  from 
82  testing  directors,  1 55  principals.  47  supervisors  of  teach- 
ers, and  200  classroom  teachers.  Just  those  individuals  des- 
ignated as  testing  directors  by  their  superintendent  and  who, 
themselves,  acknowledged  that  title  were  included  in  the 
testing  directors  group.  Each  of  the  participating  97  dis- 
tricts reported  having  a testing  director  but  some  of  those 
individuals  did  not,  themselves,  acknowledge  that  designa- 
tion and  others  chose  not  to  participate,  resulting  in  82  sur- 


veys  (85%)  completed  by  the  testing  directors.  A check  of 
school  district  size  indicated  that  size  in  itself  did  not  influ- 
ence whether  or  not  a testing  director  participated  in  the  study 
(Marso  & Pigge,  1990).  Also,  just  those  teacher  supervi- 
sors employed  by  selected  school  districts  were  included  in 
the  supervisors  group.  Several  school  superintendents  re- 
ported either  that  no  formal  teacher  supervisor  positions 
existed  in  their  district  or  that  teacher  supervisory  services 
were  provided  through  their  county  offices  of  education. 

The  respondents  were  employed  in  schools  organized 
by  city  district  (42%),  local  county  district  (44%),  and  ex- 
empted village  district  (14%),  in  schools  located  in  geo- 
graphic settings  described  as  rural  (37%),  suburban  (57%), 
and  urban  (6%),  and  in  small  schools  (1 1 % with  fewer  than 
1,0170  pupils),  moderately  sized  schools  (34%  with  1 ,000  to 

2.000  pupils),  moderately  large  schools  (34%  with  2,001  to 

4.000  pupils),  and  large  schools  (21%  with  more  than  4,000 
pupils).  These  proportions  of  respondents  representing  dif- 
ferent types  of  school  settings  were  judged  to  be  approxi- 
mately similar  to  the  composition  of  all  such  schools  as 
reported  in  the  Ohio  Education  Directory. 

The  focus  of  the  present  report  is  upon  these  educators’ 
responses  to  10  survey  items  related  to  their  school  district’s 
practices  associated  with  the  management  of  standardized 
testing.  They  responded  to  each  of  the  10  testing  practices 
by  rating  the  “relative  effectiveness”  of  their  school  district’s 
testing  practices  or  procedures  during  the  past  year  or  two. 
The  reference  to  this  time  period  was  provided  to  create  a 
common  time  period  for  the  ratings  and  to  avoid  consider- 
ation of  proposed,  but  yet  to  be  implemented,  state-man- 
dated  high  school  proficiency  testing  in  the  schools.  The 
data  collection  for  this  study  was  completed  during  spring 
term  of  1989  prior  to  the  initiation  of  state-mandated  stan- 
dardized testing  programs;  therefore,  the  directions  to  the 
respondents  as  to  which  standardized  tests  to  consider  in 
their  ratings  were  not  necessary.  Previous  surveys  of  the 
public  schools  in  Ohio  had  indicated  that  group  standard- 
ized testing  primarily  consisted  of  the  scheduling  of  reading 
achievement,  achievement  batteries,  and  scholastic  aptitude 
tests  in  the  elementary  schools  and  of  interest  inventories, 
multiaptitude  tests,  and  very  limited  use  of  subject  area 
achievement  tests  in  the  secondary  schools. 

In  addition  to  the  time  reference,  the  educators  also  were 
provided  with  a second  common  rating  reference.  They  were 
directed  to  rate  their  schools’  effectiveness  in  performing 
the  10  testing  practices  compared  to  their  schools’  overall 
performance  in  meeting  responsibilities  as  educational  in- 
stitutions. It  was  assumed  that  most  respondents  would  lack 
a common  comparative  performance  reference  across  school 
districts  but  that  they  would  possess  knowledge  of  the  over- 
all performance  of  their  own  schools.  It  was  determined, 
therefore,  that  the  overall  district  performance  reference  point 
would  provide  much  more  meaningful  ratings  than  would 
allowing  the  respondents  to  bring  to  the  rating  task  what- 
ever unspecified  reference  point  that  occurred  to  them  at 
that  moment. 


A five-point  scale  with  narrative  descriptions  at  each 
'scale  point  and  with  an  accompanying  “DK”  response  op- 
tion, defined  as  “I  really  do  not  know,”  was  provided  with 
each  of  the  10  testing  practices  items.  The  “I  really  do  not 
know”  response  option  was  added  to  discourage  ratings  of 
testing  practices  about  which  the  respondents  might  feel 
uninformed.  This  was  deemed  to  be  consistent  with  the  re- 
searchers’ goal  of  seeking  ratings  just  from  educators  knowl- 
edgeable of  their  schools’  testing  practices.  This  scale  ranged 
from  “we  perform  well  below  our  average”  (1)  to  “we  ex- 
cel” (5). 

Three  sets  of  statistical  analyses  of  the  collected  data 
were  completed.  One  and  two-way  AN OVA  procedures  were 
used  to  identify  significant  rating  mean  differences  among 
the  teacher,  principal,  supervisor,  and  test  director  respon- 
dent groups  and  among  these  groups  when  classified  by  sec- 
ondary or  elementary  school  assignments.  The  job 
assignment  and  grade  level  interactions  were  also  tested  and 
discussed.  An  alpha  level  of  .05  was  selected  for  the 
ANOVA’s  while  a . 10  level  was  selected  for  the  pair-wise 
post-hoc  Scheffe  tests.  This  pair-wise  procedure  readily 
handles  unequal  n’s  and  is  the  most  conservative  of  these 
procedures  to  the  extent  that  Scheffe  recommends  use  of  the 
.10  level  (Hinkes,  Wiersma,  & Jurs,  1994).  These  ANOVA 
procedures  were  completed  on  the  data  derived  from  respon- 
dent ratings  of  each  of  the  10  testing  practices.  In  addition, 
Spearman  Rho  correlations  were  completed  between  the 
various  groups  of  educators’  ranked  rating  means  for  the 
selected  testing  practices  to  ascertain  the  extent  of  agree- 
ment among  the  educators  as  to  which  of  their  schools’  test- 
ing.practices  were  rated  to  be  more  or  less  effective. 

Results 

Each  of  the  four  groups  of  educators,  testing  directors, 
classroom  teachers,  teacher  supervisors,  and  principals  rated 
their  school’s  performance  of  the  selected  10  testing  prac- 
tices about  average  or  somewhat  higher  (3  or  higher  on  the 
five-point  scale)  compared  to  the  performance  of  their 
schools  in  meeting  their  overall  responsibilities  as  educa- 
tional institutions.  Only  when  the  teachers,  principals,  and 
supervisors  were  classified  by  elementary  and  secondary 
school  assignments  were  any  rating  means  found  below  the 
“about  average  performance  for  us”  or  ‘3’  level.  Just  two  of 
the  rating  means  of  the  secondary  teachers  and  one  of  the 
rating  means  of  the  secondary  supervisors  were  below  this 
average,  whereas  none  of  the  mean  ratings  of  the  secondary 
principals,  the  testing  directors,  and  the  elementary  level 
educators  were  below  the  “about  average”  or  ‘3’  level. 

The  testing  practices  rated  more  effective  by  the  educa- 
tors were  management  of  pupil  records,  use  of  quality  tests 
and  materials,  selection  and  administration  of  tests,  and  use 
of  understandable  scores  and  reports  (items  8,  3,  1,  and  5, 
respectively).  Practices  rated  less  effective  were  use  of  the 
results  of  achievement  battery  testing  to  evaluate  district 
classroom  instruction,  provision  of  instructional  guides  ac- 
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companying  achievement  batteries  to  aid  teachers  in  relat- 
ing test  results  to  instruction,  availability  of  school  policy 
regarding  access/dissemination/storage  of  test  results,  and 
prompt  availability  of  test  results  after  testing  (items  10,  6, 
7,  and  4,  respectively)  as  can  be  noted  in  Table  1. 

The  one-way  ANOVA  procedures  revealed  group  mean 
differences  in  ratings  of  four  of  the  10  testing  management 
practices  between  the  directors,  teachers,  supervisors,  and 
principals;  for  seven  of  the  10  practices  between  the  direc- 
tors and  just  the  elementary  teachers,  supervisors,  and  prin- 
cipals; and  for  seven  of  the  10  practices  between  the  directors 
and  just  the  secondary  teachers,  supervisors,  and  principals. 
These  differences,  however,  were  limited  to  differences  just 
between  ratings  of  the  teachers  and  one  or  more  of  the  other 


three  groups  of  educators.  In  other  words,  no  statistically 
significant  differences  were  identified  between  the  rating 
means  for  any  of  the  possible  mean  pairs  of  the  administra- 
tor groups  of  principals,  directors,  and  supervisors. 

Because  the  ratings  of  the  directors  did  not  differ  sig- 
nificantly from  those  of  the  principals  or  the  supervisors  for 
any  comparison,  the  one-way  ANOVA  tables  are  not  pre- 
sented. These  tables  may  be  obtained  by  contacting  the  au- 
thors. The  two-way  ANOVA  procedures  present  essentially 
the  same  information  with  more  brevity  (see  Table  1).  The 
highlights  of  the  significant  rating  differences  identified  in 
the  one-way  procedures  are  presented,  however,  in  the  next 
several  paragraphs. 


Table  1 


Analysis  of  Teachers’,  Principals’,  and  Supervisors’  Ratings  of  the  Effectiveness  of  Testing  Practices  When 
Classified  by  Elementary  and  Secondary  Grade  Levels 

Means  (N’s)  Means  (N’s) 

Practices  or  Job  Assignments  Grade  Level  Job  x Grade 


Procedures 

Teach 

Princ 

Supr8 

F 

P 

Elem. 

Sec.c 

F 

p 

F 

p 

1. 

Test  selection  and 

(190) 

(138) 

(29) 

(205) 

(152) 

administration 

3.55 

3.91 

3.97 

7.19 

.00 

3.71 

3.73 

.01 

.94 

.37 

.69 

Aa 

B 

B 

A 

A 

2. 

Test  scheduling 

(184) 

(140) 

(28) 

(200) 

(152) 

to  aid  decisions 

3.38 

3.67 

3.68 

5.68 

.00 

3.52 

3.61 

1.27 

.26 

.74 

.48 

A 

A 

A 

A 

A 

3. 

Quality  tests, 

(190) 

(139) 

(29) 

(206) 

(152) 

materials,  reports 

3.95 

4.16 

4.17 

2.86 

.06 

4.07 

4.03 

.02 

.89 

2.15 

.12 

A 

A 

A 

A 

A 

4. 

Results  available 

(196) 

(139) 

(29) 

(210) 

(154) 

promptly 

3.13 

3.47 

3.34 

4.17 

.02 

3.22 

3.36 

.17 

.68 

1.20 

.30 

A 

A 

A 

A 

A 

5. 

Understandable 

(193) 

(142) 

(26) 

(209) 

(152) 

scores,  reports 

3.74 

3.91 

3.77 

2.37 

.10 

3.96 

3.61 

2.53 

.11 

5.67 

.00 

A 

A 

A 

A 

B 

6. 

Instructional 

(191) 

(136) 

(26) 

(205) 

(148) 

guides  available 

3.23 

3.10 

3.42 

.90 

.41 

3.55 

2.70 

5.36 

.02 

8.75 

.00 

A 

A 

A 

A 

B 

7. 

Written  test 

(125) 

(130) 

(27) 

(162) 

(120) 

records  policies 

3.38 

3.14 

3.63 

1.71 

.18 

3.35 

3.22 

.21 

.65 

4.61 

.01 

A 

A 

A 

A 

A 

8. 

Student  permanent 

(195) 

(141) 

(26) 

(205 

(157) 

records 

4.26 

4.30 

4.15 

.31 

.73 

4.38 

4.11 

2.36 

.13 

.55 

.58 

A 

A 

A 

A 

A 

9. 

‘CR’  available 

(146) 

(125) 

(23) 

(173) 

(121) 

data 

3.85 

3.66 

3.70 

.29 

.75 

3.84 

3.64 

.05 

.83 

3.95 

.02 

A 

A 

A 

A 

A 

10. 

Evaluate  class 

(145) 

(133) 

(25) 

(168) 

(135) 

instruction 

3.08 

3.29 

3.00 

1.66 

.19 

3.29 

3.01 

4.09 

.04 

2.46 

.09 

A 

A 

A 

A 

B 

1 Unique  letters  indicate  significant  mean  differences,  similar  letters  indicate  nonsignificant  mean  differences,  Scheffc  alpha 
= .10.  Ns  varied  as  respondents  were  provided  with  the  option  of  *'l  really  do  not  know”  in  rating  each  practice. 
b Tcachcr-principal  Rho  = .77,  teacher-supervisor  Rho  = .88,  and  principal-supervisor  Rho  = .94. 

1 Rho  between  ranks  of  elementary  and  secondary  personnel  rating  means  = .77. 


The  one-way  ANOVA  procedures  indicated  that 
elementary  and  secondary  teachers  as  a collective  group  rated 
test  selection  and  administration  (item  1 ) significantly  lower 
than  did  the  combined  groups  of  elementary  and  secondary 
supervisors,  principals,  and  directors.  These  teachers  also 
rated  test  scheduling  at  times  to  aid  decision-making  and 
prompt  return  of  testing  results  (items  2 and  4)  lower  than 
did  the  supervisors  and  directors.  In  contrast,  the  teachers 
rated  the  provision  of  criterion -referenced  data  from  achieve- 
ment batteries  (item  9)  higher  than  did  the  testing  directors. 
When  these  means  were  rank  ordered,  the  directors’  ratings 
were  found  to  be  highly  related  to  those  of  the  principals 
(Rho  = +.93)  and  the  supervisors  (Rho  = +.93),  but  some- 
what less  so  with  the  teachers  (Rho  = +.73). 

The  one-way  ANOVA  and  Scheffe  procedures  just  for 
the  directors  and  the  elementary  educators  indicated  that  the 
elementary  teachers’  ratings  were  lower  than  the  directors’ 
ratings  of  practices  related  to  test  selection-administration 
(M’s  = 3.57  & 4.01 ),  test  scheduling  (M’s  = 3.40  & 3.90), 
and  prompt  return  of  test  results  (M's  = 3.13  & 3.70),  items 
1,2,  and  4,  respectively.  In  contrast,  the  elementary  teach- 
ers’ ratings  were  higher  than  the  directors’  ratings  for  the 
provision  of  criterion-referenced  data  (M’s  = 4.05  & 3.29) 
and  the  handling  of  pupil  permanent  records  (M’s  = 4.41  & 
4.03),  items  9 and  8,  and  the  elementary  teachers’  ratings 
were  higher  than  the  directors’  and  elementary  principals’ 
ratings  of  the  provision  of  instructional  guides  (M's  = 3.79, 
3.20,  & 3.23,  respectively)  and  the  availability  of  written 
school  policies  regarding  pupil  records  (M’s  = 3.65,  3.10, 
& 3.00,  respectively),  items  6 and  7.  The  Spearman  Rhos 
between  the  rank  ordered  rating  means  of  the  testing  direc- 
tors and  the  three  groups  of  elementary  educators  indicate 
that  the  elementary  teachers  perceived  their  schools’  rela- 
tive performance  of  the  various  testing  practices  somewhat 
differently  than  the  other  educators  but  that  considerable 
agreement  existed  among  the  other  groups  of  educators. 
Positive  Rhos  of  +.49,  +.55,  and  +.60  were  obtained  be- 
tween the  elementary  teachers  and  directors,  elementary  prin- 
cipals, and  elementary  supervisors,  respectively;  whereas 
Rhos  between  the  elementary  principals  and  supervisors, 
directors  and  elementary  supervisors,  and  directors  and  prin- 
cipals were  +.80,  +.85,  and  +.93,  respectively. 

The  one-way  ANOVA  procedures  just  for  the  directors 
and  the  secondary  educators  indicated  that  the  secondary 
teachers’  ratings  were  lower  than  the  secondary  principals’ 
ratings  of  the  use  of  understandable  scores  and  reports  and 
of  the  use  of  achievement  batteries  to  evaluate  district  in- 
struction (items  5 and  10).  The  secondary  teachers’  ratings 
were  lower  than  both  the  directors’  and  secondary  princi- 
pals' rating  of  the  practices  of  test  selection-administration 


(M’s  = 3.5 1, 4.01 , & 3.97,  respectively),  test  scheduling  (M’s 
= 3.36,  3.90,  & 3.87,  respectively),  test  and  materials  qual- 
ity (M’s  = 3.81,  4.17,  & 4.25,  respectively),  and  prompt- 
ness of  test  results  (M’s  = 3.14,  3.70,  & 3.67,  respectively) 
items  1, 2,  3,  and  4,  respectively.  Additionally,  the  ratings 
of  the  secondary  teachers  (M  = 2.42)  were  lower  than  both 
the  directors*  (M  = 3.20)  and  supervisors’  ratings  (M  = 2.92) 
for  the  provision  of  instructional  guides  to  aid  instruction 
(item  6).  Unlike  the  elementary  teachers’  ratings,  all  of  these 
ratings  of  the  secondary  teachers  were  lower  than  those  of 
the  other  noted  groups.  The  secondary  teachers,  however, 
perceived  the  relative  effectiveness  levels  of  their  schools’ 
performance  of  the  selected  testing  practices  more  similar 
to  the  other  secondary  education  groups  than  did  their  el- 
ementary teacher  cohorts.  The  Spearman  Rhos  between  the 
rating  means  of  the  secondary  teachers  and  directors,  sec- 
ondary teachers  and  principals,  and  secondary  teachers  and 
supervisors  were  +.87,  +.94,  and  +.92,  respectively.  The 
related  Rhos  among  the  secondary  pairs  of  directors  and 
principals,  directors  and  supervisors,  and  principals  and  su- 
pervisors were  +.95,  +.79,  and  +.84,  respectively. 

The  two-way  ANOVA  procedures,  completed  without 
the  directors  but  with  the  elementary-secondary  assignment 
classification  of  the  remaining  groups  of  educators,  revealed 
that  the  elementary  school  educators  (combined  principals, 
supervisors  and  teachers)  rated  higher  the  provision  of  in- 
structional guides  for  instruction  and  use  of  scores  forevalu- 
ation of  district  instruction  (items  6 and  10)  than  did  their 
secondary  cohorts  (see  Table  1).  The  job  assignment  main 
effect  comparisons  identified  significant  differences  in  the 
ratings  of  the  teachers,  principals,  and  supervisors  for  test 
selection  and  administration  (item  #1),  test  scheduling  (item 
#2),  and  making  test  results  available  promptly  (item  #4). 
In  each  case  the  rating  means  of  the  teachers  were  the  low- 
est of  the  three  groups;  however,  the  Scheffe  pair-compari- 
sons identified  a difference  among  the  rating  means  just  for 
the  test  selection  and  administration  practice. 

These  two-way  ANOVA  procedures  also  revealed  sig- 
nificant job-group  and  grade-level  interactions  among  the 
rating  means  for  four  items.  For  each  of  these  four  testing 
practices,  understandable  scores  and  reports,  availability  of 
instructional  guides,  presence  of  school  policies,  and  provi- 
sion of  criterion-referenced  test  data,  the  secondary  teach- 
ers’ ratings  (items  5,  6,  7,  and  9,  respectively)  were  sharply 
lower  than  those  of  the  elementary  teachers.  Additionally, 
the  ratings  of  the  elementary  supervisors  and  secondary  su- 
pervisor differed  sharply  on  the  effectiveness  of  the  provi- 
sion of  criterion-referenced  analysis  from  achievement 
batteries  (item  #9).  Figure  1 , the  graph  of  the  rating  means 
for  the  provision  of  criterion-referenced  data,  illustrates  the 
elementary  and  secondary  teachers’  differences  common  to 
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items  5,  6, 7,  and  9 and  the  elementary  and  secondary  super- 
visors’ difference  unique  to  item  #9.  Rather  surprisingly, 
the  elementary  supervisors,  who  as  instructional  leaders 
might  be  expected  to  be  strong  advocates  of  the  provision 
of  criterion-referenced  data  to  link  test  results  to  instruc- 
tional activities,  rated  this  practice  much  lower  than  did  the 
secondary  supervisors  and  also  much  lower  than  did  the  el- 
ementary teachers.  As  previously  noted,  for  most  other  prac- 
tices there  was  considerable  agreement  between  the  ratings 
of  the  elementary  supervisors  and  elementary  teachers.  None 
of  the  other  ratings  of  the  elementary  supervisors  and  el- 
ementary teachers  differed  significantly,  and  the  Rho  between 
their  ranked  rating  means  was  +.93. 

Figure  1 


Teacher*  Principal*  Supervist** 

Item  *9  Criterion-referenced  data  available 


Elementary 
— ■ — Secondary 


Summary  and  Discussion 

Somewhat  contrary  to  what  might  be  expected  from 
previous  studies  revealing  that  many  educators  have  a less 
than  positive  attitude  toward  standardized  testing  (Haney  & 
Madaus,  1989)  and  that  school  administrators  view  stan- 
dardized testing  as  a relatively  unimportant  management 
function  (Sproull  & Zubrow,  1981),  these  classroom  teach- 
ers, teacher  supervisors,  school  principals,  and  testing  di- 
rectors rated  the  effectiveness  of  their  schools’  performance 
of  the  10  selected  standardized  testing  program  manage- 
ment practices  as  being  average  or  above  average  in  com- 
parison to  their  schools’  performance  in  meeting  their  overall 
responsibilities  as  educational  institutions.  This  contrast  be- 
tween present  and  prior  findings  may  in  part  result  from  ihc 
selection  of  the  educators  for  this  study;  for  at  each  distri- 
bution level  of  the  survey  materials,  superintendents  and 
principals,  the  distributors  were  directed  to  forward  the  ma- 
terials to  individuals  most  knowledgeable  about  and  who 


could  best'  inform  the  researchers  about  the  standardized 
testing  programs  in  their  schools.  Additionally,  the  respon- 
dents were  provided  with,  and  many  used,  a “do  not  know” 
category  on  the  rating  scale.  Consequently,  the  findings  from 
this  study  are  likely  to  more  accurately  reflect  the  schools’ 
performance  of  these  tasks,  but  the  findings  may  be  less  rep- 
resentative of  typical  educators’  perceptions  of  the  effec- 
tiveness of  their  schools’  testing  practices.  This  procedure 
of  soliciting  just  informed  input  about  specific  testing  prac- 
tices was,  however,  consistent  with  the  researchers’  goal  of 
assessing  the  level  of  public  schools’  effectiveness  in  actu- 
ally operating  standardized  group  testing  programs.  Assess- 
ments of  specific  testing  management  practices  by 
knowledgeable  educators  have  received  little  attention  in  the 
existing  research  literature.  In  contrast,  the  investigation  of 
typical  educators’  attitudes  toward  testing  has  received  rela- 
tively more  research  attention  (Marso  & Pigge,  1993). 

The  high  relative  consistency  between  the  ratings  (Rho’s 
in  .90’s)  of  the  principals,  supervisors,  and  testing  directors, 
adds  further  confidence  to  the  interpretation  that  these  find- 
ings may  accurately  reflect  the  perceptions  of  educators 
knowledgeable  of  testing  program  management  practices. 
Those  differences  found  between  the  magnitudes  of  the  rat- 
ings of  the  teachers  and  the  three  administrative  groups  may 
reflect  differences  between  their  job  experiences  and  respon- 
sibilities. For  example,  the  ratings  of  the  teacher  supervi- 
sors, whose  responsibilities  are  more  closely  linked  to 
facilitating  classroom  instruction  as  compared  to  principals 
and  testing  directors,  were  somewhat  more  similar  in  a rela- 
tive sense  to  those  of  the  classroom  teachers  (Rho  = +.88) 
than  the  principals  (Rho  = +.77)  and  the  testing  directors 
(Rho  = +.73).  Furthermore,  just  two  testing  management 
practices  revealed  statistically  significant  differences  be- 
tween the  ratings  of  the  teachers  and  supervisors;  whereas 
eight  practices  revealed  differences  between  the  ratings  of 
teachers  and  ratings  either  of  the  principals  or  the  directors. 
There  also  was  less  consistency  found  between  the  ratings 
of  the  elementary  teachers  and  the  ratings  of  the  testing  di- 
rectors (Rho  = +.49)  than  was  found  between  the  ratings  of 
the  secondary  teachers  and  the  testing  directors  (Rho  = +.87). 
This  discrepancy  might  reflect  the  more  similar  background 
of  the  secondary  teachers  and  the  testing  directors  as  com- 
pared with  the  backgrounds  of  the  elementary  teachers  and 
the  testing  directors.  Most  of  the  testing  directors  cither 
had  prior  assignments  in  or  concurrently  held  assignments 
in  secondary  schools. 

The  secondary  teachers  rated  the  effectiveness  of  seven 
of  their  schools’  testing  practices  lower  than  did  one  or  more 
of  the  other  three  groups  of  secondary  educators,  In  con- 
trast, the  elementary  teachers  rated  three  practices  lower  and 
four  higher  than  did  one  or  more  of  the  other  three  groups  of 


elementary  educators.  The  ratings  of  the  testing  directors, 
supervisors,  and  the  principals  did  not  differ  significantly  one 
from  the  other  for  any  of  the  10  testing  practices,  and  the 
Rhos  between  the  ranked  rating  means  of  these  groups  all 
exceeded  +.90.  Also,  few  differences  were  identified  between 
the  respondents  when  grouped  as  secondary  and  elementary 
educators,  and  when  these  differences  were  identified  they 
resulted  from  differences  between  the  ratings  of  the  elemen- 
tary and  secondary  teachers  with  but  one  exception. 

The  differences  found  between  the  ratings  of  the  elemen- 
tary and  secondary  teachers  may  simply  reflect  the  differ- 
ences in  the  focus  of  standardized  testing  in  the  elementary 
as  compared  to  the  secondary  schools.  In  the  elementary 
schools,  the  focus  of  standardized  testing  is  upon  the  guid- 
ance of  pupil  instruction  with  reading  tests,  achievement 
batteries,  and  scholastic  aptitude  tests  being  most  frequently 
administered.  In  the  secondary  schools,  achievement  bat- 
teries and  general  aptitude  tests  are  less  frequently  sched- 
uled as  typically  the  focus  of  standardized  testing  has  changed 
from  instruction  to  career  selection  with  the  administration 
of  multiaptitude  batteries,  vocational  interest  inventories,  and 
college  admission  tests  (Mehrens&  Lehmann,  1987).  Con- 
sequently then,  one  might  expect  secondary  teachers  to  per- 
ceive standardized  testing  programs  to  be  of  less  use  to  them 
than  do  their  elementary  school  cohorts  as  was  the  case  in 
the  present  study. 

Similarly,  the  statistical  interactions  identified  between 
the  job  assignment  and  the  job  grade  level  classification  in 
the  present  study  might  also  be  explained  by  differences  in 
the  focus  of  the  standardized  testing  programs  in  the  sec- 
ondary and  elementary  schools.  For  example,  the  nature  of 
score  reports,  the  practices  related  to  the  storage  of  cumula- 
tive pupil  records,  the  availability  of  instructional 
remediation  guides,  and  the  provision  of  criterion-referenced 
data  after  achievement  battery  testing  are  all  practices  likely 
to  vary  considerably  between  elementary  and  secondary 
schools.  The  elementary  grade  aptitude  and  achievement 
test  reports  tend  to  be  less  complex  than  the  secondary  school 
vocational  aptitude  and  interest  test  reports;  remedial  instruc- 
tional guides  accompanying  achievement  batteries  are  less 
commonly  used  in  secondary  schools  than  in  elementary 
schools;  cumulative  pupil  records  typically  are  stored  within 
self-contained  elementary  classrooms  but  typically  arc  stored 
in  central  locations  in  secondary  schools;  and  typically  cri- 
terion-referenced data  arc  available  just  for  achievement 
batteries  which  arc  more  frequently  administered  in  elemen- 
tary schools  than  in  secondary  schools. 

The  pattern  of  high  and  low  rating  means  for  the  10 
testing  practices  noted  in  the  present  study  suggests  pos- 


sible implications  for  the  management  of  standardized  test- 
ing programs.  Certainly,  first  and  foremost,  the  ratings  of 
these  educators  suggest  that  standardized  testing  programs 
are  perceived  to  be  functioning  effectively  as  compared  to 
the  overall  performance  of  the  schools  in  meeting  their  over- 
all goals  as  educational  institutions.  Each  of  the  groups  of 
educators  in  the  present  study  appeared  to  be  satisfied  with 
the  quality  of  the  tests,  testing  materials,  report  forms,  and 
the  management  of  pupil  records.  On  the  other  hand,  these 
educators  appeared  to  be  less  positive  about  the  effective- 
ness of  the  use  of  achievement  battery  scores  in  part  to  evalu- 
ate classroom  instruction.  The  teachers  appeared  to  be  less 
satisfied  with  test  selection,  test  administration  and  sched- 
uling, and  the  prompt  availability  of  the  results  from  testing 
than  were  the  other  three  groups  of  educators.  Conversely, 
the  elementary  school  teachers  appeared  to  be  more  satis- 
fied with  the  effectiveness  of  the  guides  for  remedial  instruc- 
tion  and  of  criterion-referenced  data  accompanying 
achievement  batteries  than  were  the  other  three  groups  of 
educators. 

Practicing  testing  directors  might  prudently  build  upon 
the  present  satisfactions  of  their  administrative  cohorts  but 
strive  to  enhance  interactions  with  classroom  teachers  re- 
lated to  the  operation  of  their  testing  programs.  In  particu- 
lar, it  appears  that  these  testing  directors  along  with  the  other 
educational  administrators  ought  to  work  more  closely  with 
teachers  in  the  selection,  administration,  and  scheduling  of 
tests;  in  the  prompt  dissemination  of  test  results;  in  prepar- 
ing written  policies  for  school  testing  programs;  and  in  mak- 
ing available  to  teachers  remedial  instructional  guides 
accompanying  achievement  batteries  to  better  enhance  class- 
room instruction.  The  differences  in  typical  standardized 
testing  in  the  elementary  and  secondary  schools  and  the 
present  findings  suggest  that  these  collaborative  efforts  might 
be  more  essential  in  the  elementary  as  compared  to  the  sec- 
ondary schools.  Lastly,  it  would  seem  that  testing  directors 
should  investigate  the  major  discrepancy  that  appears  to  exist 
between  elementary  teachers’  and  elementary  teacher  su- 
pervisors’ perceptions  of  the  effectiveness  of  criterion-ref- 
erenced data  in  linking  testing  results  with  classroom 
instructional  activities.  Measurement  specialists  typically 
expect  those  educators  and  administrators  most  directly  re- 
sponsible for  classroom  instruction,  such  as  elementary 
teacher  supervisors,  to  be  the  strongest  advocates  of  the  pro- 
vision of  criterion-referenced  data  to  support  classroom  in- 
struction (Mehrcns  & Lehmann,  1987),  but  it  appeared  that 
this  may  not  have  been  true  of  the  elementary  supervisors  in 
the  present  study. 
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Appendix:  Rating  Form 


SECTION  IV.  School  Standardized  Group  Testing  Program  Practices  or  Procedures. 

Please  rate  each  of  the  following  group  testing  practices  or  procedures  in  terms  of  the  relative  effectiveness  of  what 
happens  in  your  school(s).  Please  respond  to  each  item  the  best  you  can  although  you  may  be  more  or  less  informed  about 
some  of  these  practices.  Please  circle  your  rating  of  effectiveness  using  the  code  below. 

Relative  Effectiveness*  Response  Codes 

4 1’  We  perform  well  below  our  average*  here 

‘2'  We  perform  below  our  average  here 

‘3’  About  average  performance  for  us 

‘4’  We  perform  somewhat  above  average  here 

‘5’  We  excel  here 

‘DK’  I really  do  not  know 

* Your  perception  of  your  school’s  performance  on  this  practice  relative  to  its  overall  performance  as  an  educa- 
tional institution. 


Practice  or  Procedure 

Relative  Effectiveness 

LOW 

HIGH 

(?) 

1. 

Effective  test  selection/administration/scheduling  for 
standardized  testing  program  (overall) 

1 2 

3 

4 

5 

DK 

2. 

Tests  are  scheduled  at  times  to  aid  decision-making 

1 2 

3 

4 

5 

DK 

3. 

Quality  tests,  materials,  and  reports  are  used 

1 2 

3 

4 

5 

DK 

4. 

Results  of  tests  are  available  promptly  to  aid  use  of  results 

1 2 

3 

4 

5 

DK 

5. 

Understandable  scores,  narrative  reports  and  pupil  profiles 
are  used  to  report  performance 

1 2 

3 

4 

5 

DK 

6. 

Teachers’  instructional  guides  are  made  available  to  all  teachers 
to  aid  instructional  use  of  achievement  battery  results 

1 2 

3 

4 

5 

DK 

7. 

Written  school  policies  are  available  for  access/dissemination/ 
storage  of  test  results 

1 2 

3 

4 

5 

DK 

8. 

Student  permanent  records  are  updated  periodically  (dated 
information  removed,  new  added,  etc.) 

1 2 

3 

4 

5 

DK 

9. 

Criterion-referenced  achievement  battery  results  are  provided 
as  well  as  norm-referenced  scores 

1 2 

3 

4 

5 

DK 

10. 

Achievement  battery  scores  are  used  in  part  to  evaluate  district 
classroom  instruction 

1 2 

3 

4 

5 

DK 
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Abstract 

At  this  writing,  federal  initiatives  for  education  reform  seem  to  be  taking  their  last  gasps.  There  is  a 
question  as  to  whether  Goals  2000  will  make  it  to  the  year  2000.  The  development  of  voluntary \ national 
standards  has  generated  considerable  debate  both  as  to  the  desirability > of  such  standards  and  the 
enlarged  federal  role  in  education.  What  is  killing  these  initiatives  and  are  they  worth  saving? 


Background 

Federal  initiatives  in  education  have  constitutional,  so- 
cial (including  economic)  and  political  implications.  These 
implications  concern  us  as  policy  makers  attempt  educational 
reform  based  upon  the  implementation  of  national  standards. 

It  can  be  argued  that  schools  already  have  the  resources, 
flexibility  and,  indeed,  the  responsibility  to  implement  the 
necessary  reforms.  Why  then  do  we  need  federal  interven- 
tion in  the  reform  process?  The  1994  Goals  Report  pro- 
vides this  answer: 

Public  dissatisfaction  with  low  levels  of  student  perfor- 
mance, increased  global  economic  competition,  and  con- 
sistently poor  showings  on  international  assessments  led 
policy  makers  to  conclude  . . . that  the  United  States  had 
been  spending  too  much  time  merely  practicing  and  had 
not  devoted  sufficient  time  to  improving  performance. 
The  National  Education  Goals  were  created  to  reverse 
that  trend  (Vol.  1,  p.  12). 

It  appears  that  federal  reformers  arc  working  from  an 
assumption  of  general  public  dissatisfaction.  They  believe 
that  schools  have  gravitated  toward  a minimum  competency 
curriculum  and  that  most  state  standards,  where  they  exist, 
provide  a floor,  not  a goal,  for  practice.  In  this  scenario  many, 
if  not  most,  schools  arc  below  standard,  a situation  which 
the  federal  reformers  view  as  politically  intolerable. 

The  United  States  has  never  had  explicit,  national  con- 
tent or  performance  goals,  thus  the  establishment  of  stan- 
dards represents  a profound  shift  in  educational  practice 
Not  until  recently  have  individual  states  set  challenging,  ab- 
solute standards  for  their  student  populations.  While  the  ab- 
sence of  common  standards  has  not  prevented  some  schools 
from  setting  their  own  ambitious  goals,  many  schools  set 
their  sights  too  low.  In  the  absence  of  common,  specified, 
demanding  content  standards  and  high  expectations  for  stu- 
dents, schools  have  gravitated  toward  a minimum  compe- 
tency curriculum.  This  trend  has  been  so  marked  that  some 
observers  have  suggested  that  what  we  now  have  is  a ‘de 
facto'  national  curriculum  of  basic  skills. 


The  notion  that  standards  arc  integral  to  educational 
reform  has  been  at  the  forefront  of  the  educational  and  po- 
litical debate  since  the  publication,  in  1983,  of  A Nation  at 
Risk:  The  Imperative  for  Educational  Reform . The  docu- 
ment recommended  that  “schools,  colleges  and  universities 
adopt  more  rigorous  and  measurable  standards”  (p.  27).  This 
popular,  and  in  some  respects  seminal,  document  set  a na- 
tional agenda  for  education.  Its  major  thrust  was  that  all  chil- 
dren can  learn;  schools  must  have  high  academic  standards; 
for  a school  to  achieve  its  goals,  texts,  tests  and  curricula 
must  be  tightly  coupled;  test  scores  will  ensure  that  schools 
and  teachers  are  held  accountable  (Cuban,  1993,  p.  25). 

President  Bush  gathered  the  state  governors  at  the  Edu- 
cation Summit  in  Charlottesville,  Virginia  in  1 989  where  they 
embraced  the  concept  of  national  goals  and  performance 
measurement  and  called  for  a greater  sense  of  direction,  com- 
bined with  competitiveness,  accountability  and  results  in 
education.  These  themes  were  contained  in  the  Bill,  America 
2000:  Excellence  in  Education  Act  sent  to  the  Congress  in 
May,  1991  (Mulcahy,  1995). 

A Nation  at  Risk  and  America  2000  were  the  result  of  a 
consensus  forged  among  national  political  and  business  lead- 
ers. Players  included  the  National  Governors’  Association 
(NGA),  the  Business  Coalition  for  Education  (an  umbrella 
organization  for  corporate  America),  and  the  National  Coun- 
cil on  Educational  Standards  and  Testing  (NCEST).  They 
concluded  that  tougher  and  better  schooling  would  boost  a 
sagging  economy  and  that  a fragmented  and  failing  educa- 
tion system  needed  centralized  guidance  as  well  as  incentives 
and  penalties  to  motivate  students  and  teachers  to  work  harder. 

In  1993  President  Clinton's  Bill,  Goals  2000:  Educate 
America  Act  may  have  softened  the  emphasis  on  accountabil- 
ity and  competitiveness,  but  the  commitment  to  standards  re- 
mained (Mulcahy,  1 995 ).  The  Act  gave  educational  standards 
a statutory  institutional  existence  in  the  form  of  the  National 
Educational  Standards  and  Improvement  Council,  NESIC. 

Driven  by  the  logic  behind  the  standards  movement  edu- 
cators and  policy  makers  have  sought  to  give  renewed  direc- 
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tion  to  the  very  fragmented  system  we  know  as  public  educa- 
tion. Standards  may  be  a start  in  the  right  direction,  but  they 
leave  us  pondering.  There  are  unanswered  questions,  uncharted 
directions  and  uncharacteristic  emphases  that  require  thought 
and  processing.  Are  national  standards  ever  feasible  in  a na- 
tion as  diverse  as  the  United  States  and  in  an  education  sys- 
tem with  a long  history  of  local  control?  Are  standards  simply 
a way  to  blame  the  teacher  and  the  learner  for  the  failure  of 
the  system?  Are  American  schools  failing  because  teachers 
and  students  aren’t  trying  hard  enough?  Have  we  entirely 
given  up  the  Deweyan  notion  of  making  the  school  fit  the 
learner?  What  will  these  new  standards  do  to  disadvantaged 
school  populations  who  are  just  now  beginning  to  show  mar- 
ginal gains  in  educational  achievement? 

What  Standards  are  We  Speaking  of? 

The  Reagan  and  Bush  plans  involved  a performance- 
based,  accountability  model  with  clearly  defined  outcomes 
for  schools,  i.e.  standards  for  content,  performance,  and 
teaching.  Clearly,  the  purpose  was  quality  and  excellence. 
The  Clinton  model  expanded  the  concept  of  accountability 
to  include  delivery  standards  which  provide  assurance  that 
each  student  has  a fair  opportunity  to  acquire  the  knowl- 
edge and  skills  set  out  in  the  standards.  The  addition  of  this 
element  shifts  the  focus  and  ensures  that  inputs  as  well  as 
outcomes  are  accounted  for.  Delivery  standards  explicitly 
introduce  equity  into  the  equation. 

It  is  important  to  account  for  both  inputs  and  outcomes 
in  any  measure  of  educational  achievement.  Almost  a cen- 
tury ago  John  Dewey  told  us  that  what  the  learner  brings  to 
the  learning  process  is  as  important  as  any  content  that  we 
may  wish  to  instill.  The  affective  and  social  objectives  of 
education  are  every  bit  as  important  as  the  curriculum  con- 
tent. A century  of  research  has  borne  out  the  truth  of  Dewey’s 
assertions.  Any  measure  of  educational  outcomes  judged 
against  national  norms  must,  realistically,  account  for  local 
differences  (inputs)  as  they  impact  opportunity  to  learn. 

The  Pros  and  Cons 

Typically,  supporting  arguments  equate  the  international 
standing  of  the  United  States  and  competitiveness  of  its 
economy  with  the  optimal  development  of  the  nation’s  hu- 
man capital.  Supporters  argue  that  national  educational  stan- 
dards will  ensure  the  nation’s  preeminent  position  in  trade, 
technology,  and  world  affairs. 

Proponents  hold  that  many  states  have  insufficient  re- 
sources, both  human  and  fiscal,  to  establish  their  own  stan- 
dards and  assessment  systems.  They  maintain  that  the 
establishment  of  challenging  national  standards  will  encour- 
age states  and  school  districts  to  raise  educational  expecta- 
tions; that  standards  will  help  improve  both  the  quality  of 
schools  and  teacher  professional  development  by  providing 
a clear,  common  set  of  challenging  goals;  and  that  national 


standards,  applicable  to  all  children,  will  help  to  provide  the 
impetus  for  equalizing  equality  of  educational  opportunity 
across  the  nation  (Smith  et  al.  1994,  p.  1 8). 

Contesting  the  position  arc  an  equally  explicit  set  of  ar- 
guments. The  collective  national  experience  with  centrally 
established  standards,  in  education  and  in  other  sectors,  has 
not  been  promising.  Standards,  generally,  are  “minimum  stan- 
dards’’ that  serve  to  drag  down  the  entire  system.  If  such  were 
to  be  the  case  with  education  standards,  the  entire  nation  would 
suffer.  Relatedly,  the  establishment  of  national  standards  would 
draw,  attention  away  from  the  many,  very  positive  state  and 
local  initiatives  now  underway.  Opponents  worry  that  if  chal- 
lenging national  standards  are  established  but  the  enabling 
strategies  and  resources  are  not  available,  the  result  will  be  a 
disservice  to  students.  Other  arguments  depict  national  stan- 
dards as  too  narrow  and  restrictive.  Critics  posit  that  national 
standards  will  lead  to  a national  curriculum,  inhibiting  local 
and  state  creativity  and  initiative.  Finally,  the  assertion  that 
the  great  cultural,  ethnic  and  regional  diversity  of  the  nation 
makes  it  unlikely  that  a common  set  of  educational  standards 
would  enjoy  widespread  acceptance. 

Are  Standards  the  Answer? 

The  national  standards  approach  to  educational  reform 
involves  both  misconceptions  and  untested  assumptions. 
Built  into  the  Reagan-Bush-Clinton  reforms  is  the  assump- 
tion that  rigorous  standards  will  eliminate  a crisis  in  educa- 
tion and  guarantee  the  achievement  of  national  goals.  No 
such  guarantees  exist.  What  is  guaranteed  is  centralized 
power  and  control  over  what  will  be  taught  and  who  will 
teach  in  the  nation’s  schools. 

The  terms  “quality”  and  “standards”  arc  borrowed  from 
industry  where  they,  in  fact,  denote  control.  In  the  context  of 
education,  a unified  system  of  quality  assurance  can  be  con- 
strued as  controlling  who  will  teach,  what  they  will  teach,  and 
how  this  content  will  be  taught.  In  this  industrial  metaphor  for 
education  the  curriculum  consists  of  content  fields  that  have 
standard,  measurable  outcomes.  Surely,  education  is  not  mass 
production;  teachers  are  not  in  the  business  of  administering 
uniform  treatments  and  delivering  a standardized  product! 

The  view  of  the  new  federal  reformers  may  be  too  nar- 
row. To  offer  standards  as  the  basis  of  educational  reform 
may  be  to  miss  the  point.  Arc  American  schools  failing  be- 
cause some  students  and  teachers  are  not  working  hard 
enough;  because  they  cannot  meet  proscribed  standards?  Do 
schools,  operating  in  a pluralistic  society,  have  the  right 
(never  mind  the  ability)  to  create  a homogeneous  product, 
while  ignoring  differences  in  the  cultural  and  life  experi- 
ences of  learners?  Would  the  new  age  federal  reformers 
have  us  revert  to  strategics  rejected  long  ago  by  John  Dewey, 
where  the  learners  have  to  meet  the  standards  set  by  the  school 
or  be  labeled  laggards?  Kenneth  Goodman  (1994)  who  takes 
an  uncompromising  stand  against  national  standards,  claims 
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that  the  movement  is  an  attempt  to  centralize  power  and 
privatize  education. 

The  standards  movement  promises  the  political  power  bro- 
kers that  by  controlling  outcomes  they  can  control  schools 
while  appearing  to  support  local  control  and  they  can  avoid 
spending  money  to  deal  with  the  real  needs  of  education. 
With  national  standards  in  place,  the  laws  of  the  market- 
place can  be  introduced  encouraging  profit  makers  to  com- 
pete with  public  schools  and  judging  all  in  terms  of  their 
ability  to  meet  standards  (p.  39) 

In  the  Face  of  History 

National  standards  become  a question  of  feasibility  in  a 
nation  as  diverse  as  the  United  States  and  an  education  system 
with  a long  history  of  local  control.  The  tradition  of  local  con- 
trol, dating  back  to  the  colonial  era,  has  generally  confined 
arguments  about  what  schools  should  teach,  to  localities.  Popu- 
lations tended  to  be  fairly  homogeneous  and  participants  in 
such  discussions  often  shared  similar  beliefs  and  traditions.  As 
O’ Day  and  Smith  (1993)  point  out,  “(e)ven  where  school  popu- 
lations reflected  greater  cultural,  linguistic,  or  religious  diver- 
sity the  political  disenfranchisement  of  large  groups  often 
resulted  in  decisions  (about  how  best  to  educate)  being  made 
by  fairly  homogeneous  groups  of  leaders”  (p.293). 

In  the  last  half  century  the  situation  has  changed  signifi- 
cantly. As  the  demand  has  broadened  for  social,  political  and 
economic  equality  among  groups  and  as  populations  within 
school  jurisdictions  have  become  more  diverse  and  educa- 
tionally aware,  debate  over  curricular  content  has  become 
more  intense.  In  these  newly  aware  constituencies,  arguments 
linking  curriculum  and  educational  standards  to  issues  of  po- 
litical power  or  cultural  legitimacy  have  erupted,  periodically, 
along  racial,  religious  or  ethnic  lines  (O’Day  & Smith,  1993). 

Politics  and  National  Standards 

The  U.S.  political  system  was  deliberately  designed  to  frus- 
trate central  power.  Institutional  checks  and  balances  and  shared 
authority  within  the  federal  system  were  constructed  to  thwart 
powerful,  centrally  coordinated  action.  In  education,  authority 
was  divided  among  local,  state,  and  federal  governments  with 
the  latter  having  only  marginal  influence.  The  very  size  and 
diversity  of  the  country  cemented  the  system  into  place. 

State  government  is  the  constitutional  center  of  US  edu- 
cation. To  this  point  in  our  history,  state  and  local  education 
authorities  have  been  only  modestly  constrained  by  federal 
initiatives  usually  stemming  from  categorical  aid  or  Supreme 
Court  decisions.  President  Bush,  seeking  a way  around  this 
constitutional  obstacle,  brought  together  the  state  governors 
at  the  Charlottesville  Summit  to  forge  an  agreement.  To  en- 
sure that  the  agreed-upon  standards  remained  constitutional, 
they  were  deemed  voluntary;  no  school  could  be  required  to 
adopt  standards  established  by  the  federal  government. 


Federally  instituted  standards  raise  fundamental  questions 
of  educational  politics  and  competing  public  values,  more  es- 
pecially in  terms  of  traditional  governance  arrangements  and 
multiple  control.  Implicit  in  the  new  standards  is  a critique  of 
the  traditional  mechanisms  that  have  produced  the  present 
fragmented  and  incoherent  standards.  These  reforms  rest,  at 
least  in  part,  on  a new  balance  of  power  including  a pronounced 
shift,  from  local  and  state,  to  national  control.  The  creation  of 
new  consensus  building  organizations  such  as  the  National 
Education  Goals  Panel  (NEGP),  the  National  Board  for  Pro- 
fessional Teaching  Standards  (NBPTS)  and  the  National  Edu- 
cational Standards  and  Improvement  Council  (NESIC) 
together  with  a reliance  on-federal  strategies  that  promote  co- 
operation between  the  states  is  bound  to  effect  a power  shift 
from  the  state  capitols  to  Washington. 

There  are  many  who  believe  that  the  present  decentral- 
ized structure  is  the  essence  of  American  education.  Con- 
versely, among  the  reformers  are  those  who  admire  countries 
with  strong,  centralized  ministries  of  education.  The  differ- 
ences are  rooted  deep  in  the  political  culture.  There  is  within 
the  nation  a deep  suspicion  of  government  coupled  with  a 
strong  democratic  desire  for  popular  participation  in  pursuit 
of  communal  goals.  Yet,  it  appears  that  the  nation  is  ready 
to  recognize  that  a lack  of  national  standards  has  cost  us 
dearly;  that  national  systemic  reform,  in  the  guise  of  national 
standards,  is  the  answer. 

The  political  dynamic  of  standard  setting  is  a puzzle. 
To  produce  the  consensus  necessary  for  national  standards  , 
it  appears  that  we  must  change  the  present  governance  ar- 
rangements. However,  experience  has  taught  us  that  the 
democratic  processes  that  produce  these  new  arrangements 
will  likely  yield  a whole  new  bureaucracy  that,  inevitably, 
will  distort  and  perhaps  frustrate  the  best  intentions  of  the 
reformers.  Ironically,  the  reformers  who  decry  the  current 
lack  of  structure  may  Find  structure  their  undoing. 

A National  Curriculum? 

Given  the  above  political  considerations  how  far  removed 
are  we  from  a national  curriculum?  Mulcahy  (1995)  reasons 
that  it  is  only  through  content  that  content  standards  can  be 
manifest.  And  it  will  be  the  acquisition  of  this  content  that 
will  signal  that  content  standard  has  been  met.  Therefore,  to 
specify  content  standards  is  to  specify  content  and  specified 
content  sounds  suspiciously  like  national  curriculum. 

While  standards  may  be  voluntary,  schools  that  prepare 
their  students  to  meet  such  standards  may  give  them  an  edge 
when  it  comes  to  college  entrance  and  employment.  In  these 
circumstances,  voluntary  national  standards  may  readily  be- 
come ‘de  facto’  national  curriculum. 

There  are  still  other  considerations  that  raise  doubts. 
The  national  goals,  as  currently  constituted,  identify  nine 
subject  areas  - math,  science,  English,  the  arts,  foreign  lan- 
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guages,  history,  geography,  civics  and  economics.  Originally 
fewer  were  presented  and  one  could  argue  that  others  could 
be  added.  This  raises  the  question  as  to  what  knowledge  and 
which  performance  skills  ought  to  be  included  and  excluded. 
Why  these  subject  areas  and  not  others?  The  current  legis- 
lation does  not  offer  an  explanation. 

There  is  an  assumption  in  the  Bush  and  Clinton  legisla- 
tion that  what  a student  should  know  and  be  able  10  do  is 
delimited  by  the  traditional  disciplines.  It  could  be  argued  that 
conventional  academic  knowledge  excludes  from  the  curricu- 
lum much  of  the  non-academic  knowledge  as  well  as  the  atti- 
tudes and  skills  that  lead  to  personal  and  group  fulfillment. 
Community  and  workplace  skills  that  build  harmony,  toler- 
ance, responsibility  and  cooperation  are  not  necessarily  in- 
herent in  conventional  academic  disciplines  (Mulcahy,  1995). 
There  remain  large  segments  of  the  population  of  school  pro- 
fessionals and  administrators  who  are  uncomfortable  with  the 
whole  concept  of  a national  curriculum. 

Control  and  Resources 

Both  control  and  resources  are  at  stake  in  any  restruc- 
turing of  educational  governance.  Proponents  of  local  con- 
trol argue  that  meaningful  standards  will  result  from 
adaptation  to  local  conditions  coupled  with  external  support 
and  assistance.  The  new  breed  of  systemic  reformers  has  a 
much  more  business  like  approach.  They  view  education  as 
public  investment.  In  this  scenario,  standards  serve  as  a start- 
ing point  for  a complex  political  process  aimed  at  securing 
greater  resources  for  education  in  return  for  greater  account- 
ability. Standards  are  the  political  basis  for  an  exchange  be- 
tween public  policy  makers  who  control  resources  and 
educators  who  control  instruction. 

What  if  national  standards  are  enacted  without  the  pro- 
vision of  necessary  resources?  Current  inequalities  in  the 
provision  of  resources  in  the  nation’s  schools  brings  this  sce- 
nario well  within  the  bounds  of  possibility.  The  specter  of 
unfunded  mandates  coupled  with  gross  inequalities  in  the 
provision  of  resources  will  lead  to  resistance,  if  not  rebel- 
lion, on  the  part  of  teachers. 

When  high  standards  are  proposed,  they  are  likely  to  be 
followed  by  educator  requests  for  more  resources.  Policy 
makers  are  wary  of  initiating  such  a cycle.  In  the  present 
tight  economy,  the  battle  for  higher  education  standards  is 
difficult  to  initiate  and  even  more  difficult  to  win.  Voters  are 
lukewarm  and  policy  makers  have  reason  to  be  cautious. 

Reform  and  Educational  Opportunity 

The  American  school,  quintessentially  a white,  middle 
class  institution  must,  increasingly,  accommodate  students 
from  outside  this  cultural  mainstream.  These  changing  de- 
mographics point  to  a sharpening  and  intensifying  of  cul- 
tural conflicts.  Nowhere  will  this  become  more  apparent  than 
in  the  contested  terrain  of  school  curriculum.  Critics  fear 


that  national  content  standards  will  not  reflect  the  culture  of 
students  from  minority  backgrounds. 

How  will  minority,  low-income  and  limited-English- 
proficiency  students  fare  under  new  national  standards? 
Proponents  of  national  standards  answer  that  well  designed, 
systemic  reform  intended  to  improve  the  overall  quality  of 
schooling  benefits  the  entire  school  population;  and  that  “a 
rising  tide  lifts  all  boats”.  Standards  are  a powerful  new 
policy  instrument  designed  to  promote  and  sustain  equality 
of  educational  opportunity.  Minority  advocates  worry  that, 
just  as  minority  students  are  beginning  to  succeed  in  terms 
of  the  standards  and  tests  currently  in  place,  elites  are  chang- 
ing the  rules  of  the  game.  The  fear  is  that  this  will  replicate 
the  cycle  of  failure  and  further  embed  social  stratification. 
Larry  Cuban  (July  14,  1993)  echoes  these  concerns  in  an 
article  written  for  Education  Week. 

With  the  evidence  drawn  from  big  city  schools  after  al- 
most a decade  of  effective-school  programs  and  tougher 
state  standards  and  tests,  one  predictable  outcome  is  that 
systematic  reform  will  miss  the  very  schools  that  are  most 
often  used  to  justify  the  strategy.  Thus  it  is  fair  to  ask 
Congress:  How  national  can  a national  strategy  be  that 
misses  almost  half  of  all  schools  in  the  country?  (p.  25). 

Some  advocates  for  disadvantaged  students,  frustrated 
by  the  failure  of  30  years  of  school  finance  reform  and  de- 
segregation in  education,  hope  that  national  standards  will 
provide  the  impetus  for  a new  round  of  court  litigation  based 
on  substantive  equity  (Myers,  1994).  Those  who  doubt  the 
value  of  the  present  reform  movement  quote  the  concerns  of 
poorer,  urban  school  districts  which  lack  the  human,  fiscal 
and  material  resources  to  achieve  higher  standards  (Darling- 
Hammond,  1994;  Kozol,  1991).  We  have  ample  evidence 
that  schools  serving  low-income,  minority  students  consis- 
tently have  fewer  resources  and  learning  opportunities. 

Consensus 

Specifying  standards  can  galvanize  opposition  across 
the  professional,  political,  and  social  spectrum.  Educators 
and  policy  makers  are  keenly  aware  of  the  problems  that 
result  when  notions  of  change  are  not  widely  shared  in  the 
community.  As  a result,  most  national  standards  projects  arc 
engaged  in  a broad  review  and  feedback  process  to  gather 
diverse  input.  The  hope  is  that  this  process  will  yield  a shared 
vision  and  a foundation  for  support  and  impart  legitimacy 
to  the  standards  (Massell,  1994). 

Goals  2000  recognizes  the  importance  of  consensus  build- 
ing and  speaks  of  “collaborative  efforts  . . . that  are  taking 
place  at  all  levels  of  governance  and,  hopefully,  in  every  com- 
munity” (1994.  Vol.  I . p.  14).  More  to  the  point,  it  is  prepared 
to  back  the  process  with  federal  dollars.  It  embraces  the  policy 
of  giving  subject  matter  professional  groups  a much  larger 
role  in  shaping  the  discussion.  In  December  1995,  the  Na- 
tional Academy  of  Sciences  released  the  final  version  of  the 
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national  science  standards.  Among  the  diverse  groups  involved 
in  the  delivery  of  these  standards  were  the  National  Science 
Teachers  Association,  National  Science  Foundation,  US  De- 
partment of  Education,  National  Aeronautics  and  Space  Ad- 
ministration, and  the  National  Institutes  of  Health  ( Education 
Week , Dec.  13,  1995,  p.  9), 

The  present  policy  may  give  the  subject  matter  profes- 
sionals a much  larger  role  in  shaping  the  discussion,  yet  con- 
sensus requires  more  than  agreement  among  professional 
groups.  The  National  Council  of  Teachers  of  Mathematics, 
which  has  lead  the  way  in  developing  standards,  went  through 
a lengthy  process  of  feedback  and  revision  following  initial 
development.  Their  standards,  when  published,  were  accom- 
panied by  the  caveat  that  professional  standards  are  to  “di- 
rect but  not  determine  practice;  to  guide  but  not  prescribe 
teaching”  and  that  “no  tight  implications  for  practice  may 
be  inferred”  (Ball,  1992,  p.  27). 

The  polarization  of  the  political  system,  the  power  of 
interest  groups  and  the  concomitant  access  to  financial  re- 
sources makes  consensus  more  necessary,  yet  more  prob- 
lematic. The  achievement  of  ambitious  and  challenging 
standards  can  be  at  odds  with  the  objective  of  broad  consen- 
sus. Juggling  public  opinion,  professional  status,  and  dollars 
will  provide  the  creators  of  the  standards  with  their  major 
challenge. 

World  Class 

The  1 99 1 report  of  the  National  Educational  Goals  Panel 
(NEGP),  in  language  that  was  incorporated  in  Goals  2000, 
sets  forth  the  criteria  that  national  content  standards  must 
be  “world  class”.  This  requirement  emerged  out  of  concern 
that  US  students  lag  behind  their  counterparts  in  other  coun- 
tries and  the  consequent  issue  of  America's  declining  com- 
petitiveness in  global  markets.  Such  considerations  have 
strongly  motivated  school  reformers  in  the  1 980’s  and  90’s. 

We  need  to  exercise  some  caution  in  judging  calls  for 
reform  based  upon  our  situation  relative  to  other  nations. 
For  example  the  British  Education  Reform  Act  of  1990  is 
sometimes  used  by  reformers  as  a basis  for  comparison.  This 
act  established  national  curricula  and,  although  it  did  leave 
room  for  some  local  input,  it  is  considered  to  be  highly  pre- 
scriptive. The  underlying  social  values  and  aspirations  wv ...  ■ 
motivated  the  British  legislation  may  be  at  odds  witu  tllc 
egalitarianism  and  the  social  rights  agenda  which  perme- 
ates public  school  education  in  the  United  States. 

Arguments  based  upon  international  comparisons  can 
be  of  doubtful  validity,  statistically  or  otherwise.  If.  forex- 
ample,  high  school  exit  exams  arc  the  basis  for  comparison, 
then  high  school  completion  rates  need  to  be  taken  into  con- 
sideration. Stevenson  and  Stigler  ( 1992)  maintain  that  school 
achievement  may  have  more  to  do  with  cultural  factors  than 
formal  standards.  They  point  out  that  American  parents  tend 


to  assume  that  learning  is  fundamentally  a matter  of  the 
child’s  innate  ability  rather  than  a child’s  effort  to  learn.  This 
widespread  attitude  is  in  marked  contrast  to  that  of  Asian 
parents  who  emphasize,  to  their  children,  the  necessity  of 
applying  themselves  diligently  and  who  consistently  invest 
their  time  and  resources  in  supporting  their  children’s  ef- 
forts. They  point  to  a further  cultural  limitation  in  the  man- 
ner in  which  the  high  or  low  status  of  teachers  positively  or 
negatively  affects  the  quality  of  the  talent  pool  from  which 
future  teachers  are  drawn. 

Standards:  A Narrow  View  of  Education 

Are  national  standards  simply  a code  name  for  outcomes 
based  education?  The  standards  movement  offers  political 
and  business  power  brokers  the  prospects  of  control  of 
schools  through  the  control  of  outcomes.  This  outcomes 
based  model  leaves  out  the  learner.  Instead  of  beginning 
where  the  learner  is,  national  standards  map  out  a preor- 
dained path  for  learners  as  determined  by  some  national 
committee  of  experts. 

The  notion  of  a standardized  product  is  inappropriate 
in  education.  The  Common  School  model  of  education  was 
designed  to  empower  us  to  play  an  informed  role  as  citi- 
zens. It  was  envisioned  as  the  forum  where  we  learned  the 
social  skills  and  strategies  necessary  to  become  participants 
in  a democratic  society.  Meeting  national  standards  does  not 
serve  these  important  goals.  They  may,  however,  serve  the 
laws  of  the  market  place.  Market  place  competition,  as  is 
invariably  the  case,  will  define  us  in  terms  of  “haves”  and 
“have  nots”  and  will  lead  inevitably  to  ethnic,  economic, 
and  ability  segregation. 

The  Limitations  of  Standard  Setting 

The  national  standards  strategy  may,  ultimately,  fa*  1 for 
it  attempts  change  within  the  existing  education  system.  So 
many  factors  that  influence  the  outcomes  of  education  lie 
outside  of  the  existing  system  and  as  such  will  not  be  influ- 
enced by  setting  standards.  Education  is  practiced  within  a 
social  and  economic  context.  Home  and  parental  expecta- 
tions cannot  be  subject  to  standards;  they  vary  enormously 
across  the  socio-economic  spectrum. 

The  national  standards  movement,  in  common  with  all 
education  reform  movements,  expresses  itself  in  egalitarian 
terms  (e.g.  “all  students”).  It  proposes  a common  structure 
and  measurable  national  outcomes.  However,  current  cur- 
ricula feature  a maze  of  structures  that  differentiate  students 
into  tracks,  ability  groupings,  special  and  regular  education, 
gifted  and  talented  programs,  remedial  and  enrichment  ex- 
periences, and  so  forth.  How  do  we  set  national  standards 
for  students  in  such  a differentiated  structure? 

Proponents  of  national  standards  may  set  their  criteria 
for  compliance  but  students  respond  to  signals  from  other 
sources.  The  labor  market  sends  signals  to  students  about 
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the  connection  between  their  educational  achievements  and 
their  economic  prospects.  An  economic  upturn  and  the  con- 
sequent prospect  of  employment  sends  a much  clearer  sig- 
nal to  students  than  the  possibility  of  meeting  mandated 
national  standards. 

The  legitimacy  and  effectiveness  of  the  standards  ap- 
proach may  depend,  ultimately,  on  the  ability  of  the  reform- 
ers to  strike  a balance  between  the  common  culture  and  the 
needs  of  the  diverse  elements  within  it.  In  the  past,  top-down 
reform  with  its  “cookie-cutter”  approach  has  not  been  par- 
ticularly successful  for  it  neglects  the  diverse  infrastructure 
and  the  local  discretion  that  are  integral  to  education.  Per- 
haps the  US  educational  enterprise  has  grown  to  be  so  vast, 
so  diverse  and  so  bureaucratic  that  it  is  unable  to  respond  to 
the  challenge  of  systemic  change  implied  by  national  stan- 
dards. In  1990,  Chubb  and  Moe  concluded  that  the  present 
democratic  governance  of  education  had  left  the  system 
overbureaucratized  and  unresponsive.  In  their  view,  educa- 
tion is  too  hierarchical,  too  rule-bound,  and  too  formalistic. 
Further,  the  specific  political  institutions  by  which  the  schools 
are  governed  actively  promote  and  protect  this 
overbureaucratization. 

In  Conclusion 

There  are  signs  that  educational  reform  under  the  aegis 
of  national  standards  is  not  about  to  happen.  Some  educa- 
tors are  breathing  a sigh  of  relief  while  others  are  bemoan- 
ing a lost  opportunity.  The  standards  - norms  - testing 
approach  is  a reductionist  view  of  education.  It  flies  in  the 
face  of  educational  theory  from  the  Deweyan,  student-cen- 
tered to  the  constructivist  approach  currently  occupying 
center  stage  in  educational  thinking.  A nation  as  culturally 
and  ethnically  diverse  as  the  United  States,  with  an  educa- 
tion system  rooted  in  traditions  of  state  and  local  governance, 
is  unlikely  to  reach  national  consensus  over  content  and  per- 
formance standards,  at  least  in  the  short  term. 

Inevitably,  the  use  of  national  standards,  for  account- 
ability p"voses>  will  lead  t0  conflict  between  levels  of  edu- 
cational governance.  If  local  educators  are  held  accountable 
for  performance  standards  those  schools  and  districts  that 
lack  resources  will  cry  foul.  The  addition  of  unfunded  man- 
dates to  the  existing  gross  inequities  in  tir.  [ : a vision  of  edu- 
cational resources  will  prove  disastrous. 

Finally,  the  deep  suspicion  of  government  that  is  almost 
integral  to  the  nation,  may  prove  the  undoing  of  the  whole 
enterprise.  The  implementation  of  national  educational  stan- 
dards can  be  viewed  simply  as  public  sector  officials  aiming 
to  expand  their  authority.  National  standards  take  us  into 


the  arena  of  congressional  debate  where  politics,  not  educa- 
tion, is  the  standard  fare.  Politicos  are  interested  in  the  ‘short 
term  fix’;  their  lives  are  bounded  by  considerations  of  re- 
election.  The  implementation  of  national  standards  is,  by  its 
very  nature,  a long  term  operation.  In  such  a mismatch, 
Washington  will  not  sustain  its  interest  in  education  reform. 
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Invitation  For  Proposals 

Annual  Meeting  of  the  Mid-Western 
Educational  Research  Association 

October  15-18, 1997 
Holiday  Inn  - Mart  Plaza,  Chicago,  Illinois 

Thomas  S.  Parish,  Program  Chair 

Proposal  Deadline:  April  15,  1997 

Plan  now  to  attend  the  exciting  1997  Annual  Meeting  of  the  Midwestern 
Educational  Research  Association.  The  1997  program  includes  a variety  of 
elements  which  reflect  the  tremendous  growth  and  energy  of  the  organization 
while  maintaining  the  strong  collegiality  and  support  for  which  MWERA  is 
known.  A wide  array  of  presentation  formats,  including  symposia,  panel 
discussions,  workshops,  and  fora  allow  authors  the  greatest  flexibility  in 
disseminating  their  work.  Plenary  sessions  will  feature  respected  scholars 
representing  a range  of  perspectives  on  education  and  research  Issues.  And 
for  the  second  year  the  convention  will  be  held  at  the  Holiday  Inn  at  Mart  Plaza. 
The  hotel  features  comfortable,  modern  conference  rooms,  spacious  guest 
rooms  offering  breathtaking  views  from  high  above  the  city,  an  indoor  pool  and 
exercise  facility,  and  hundreds  of  shops,  restaurants,  and  entertainment  only  a 
short,  safe  walk  away, 

Please  accept  this  invitation  to  participate  in  the  1997  Annual  Meeting.  The 
Mid-Western  Educational  Research  Association  offers  researchers,  scholars, 
and  students  of  all  types,  perspectives,  and  levels,  the  opportunity  to  share 
ideas  in  a supportive  yet  challenging  environment,  to  strengthen  existing 
professional  friendships,  and  to  build  new  ones. 
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General  Information 


1.  Any  educational  professional  may  submit  a proposal,  whether  or  not 

a mam  bar  of  MWERA.  Non-membere  must  Join  MW  ERA  upon 
notification  of  an  accaptad  proposal. 

Z Typical  pcaaantaBon  formats  include  paper  presentations, 
roundtatotee,  poster-paper  sessions,  and  symposia,  among  others. 
However,  aRemsUve  or  sKparlmantal  formats  which  may  be  batter 
suited  to  the  nature  of  the  research  are  welcomed.  Participants  are 
encouraged  to  propose  formats  which  beat  communicate  their 
scholarship  or  whioh  promote  tchotoriy  debate  about  research  and 
theoretical  jaauee.  The  Program  Committee  reserves  the  right  to 
make  final  decisions  concerning  presentation  format,  grouping,  or 
schedulng. 

3.  AM  proposes  must  be  received  by  the  appropriate  senior 
dMaton  chsir  not  lator  then  April  15, 19*7.  No  submissions  wtt  be 
accepted  by  FAX  or  e-mal.  Ptoses  note  that  this  date  Is 
approximately  one  month  earitor  then  in  the  pest 

4.  Papers  presented  at  MWERA  are  expected  to  present  original 
scholarship  conducted  by  the  authors)  and  which  has  not  been 
previously  pubtehed.  Further,  R is  a violation  of  MWERA  policy  to 
promote  oommerotoNy  available  products  or  services  (except  as 
Ertftfe)  which  go  beyi^  the  Rmlts  of  appropriate  arholariy/sctontiflc 
communication,  kncfvtdoais  who  wisMo  display  educationaly  rotated 
products oraofttoes  are  encouraged  to  contact  Dr.  Sharon  McNeety, 
Assistant  Program  Chair  for  Exhibits,  P.O.  Box  34421,  Chicago, 
tlnois  00034,  (312)  704-2788. 

5.  Al  persons  ettondtogtha  Annual  Moating,  whether  at  participants  or 
presenters  an  expected  to  register  for  the  meeting.  Afl  sessions 
Hsted  in  the  program  wti  be  open  to  any  registered  participant; 
however,  enrolment  may  be  limited  and  a smaB  additional  fee  may  be 
required  for  some  workshop  sessions.  Registration  materials  for  the 
Annual  Meeting  wti  be  pubBshed  in  the  MkLWastam  Educational 
Researcher er  can  be  obtained  by  contacting  the  Program  Chair  or 
the  Executive  .Officer. 

8.  Praesrttora  are  reeponatote  for  submitting  a completed  version  of  their 

c ^foranoa  paper  to  both  the  chair  end  deouscant  assigned  to  their 
^ session  on  or  before  September  15, it97.  Papers  not  available  to  the 
discussant  and  chair  may  be  aimineled  from  the  program  at  the 

discretion  of  the  program  chair. 

7.  Presenters  must  provide  complete  copies  of  their  papers  or  detailed 
handouts  to  attendees  at  their  sessions. 

8.  Overhead  projectors  end  screens  wM  be  provided  by  MWERA  in 
most  rooms.  Presenters  who  wM  need  additional  AV  equipment  are 
responses  for  arranging  such  vrth  the  hotel  and  at  the  presenter's 
expense. 

9.  MWERA  reserves  the  right  to  reproduce  and  (fistribute  summaries 
and  detracts  cf*  accepted  proposals.  Unless  expressly  prohibited 
in  wiflktg  by  the  atithor(s),  summaries  may  also  be  made  avaitabte  to 
the  preee  or  other  Interested  psrtits  upon  request  Such  limited 
distribution  does  not  preclude  subsequent  publication  by  the 
authors). 

10.  Authors  of  accepted  proposals  assume  the  ethical  and  professional 
rssponetotity  to  appear  at  the  Annual  Meeting  and  to  participate  in 
their  presentation  or  assigned  session.  When  circumstance* 
preclude  authors)  from  doing  so,  It  Is  the  responsibility  of  the  author 
to  arrange  a suitable  substitute  and  to  notify  the  Program  Chair  In 
advance. 


Session  Format  Descriptions 


Paper  Presentation:  Paper  sessions  are  intended  to  allow  authors  the 
opportunity  to  metre  short,  relatively  formal  presentations  in  which 
they  overview  thslr  papers  to  an  audience.  Three  to  five  individual 
papers  dating  v* h related  topics  are  grouped  Into  e single  session 
of  from  1-1/2  to  2 hours.  The  authors)  of  each  paper  lt(ari)  attowed 
approximately  15  mlnutoe  to  present  the  Ngftfghte  of  the  paper,  end 
atihjedtoouwt  la  totowad  15  minutes  to  comment  on  the  papers. 
Autwre  are  •peeled  to  provide  complete  copies  of  their  papers  to  si 
intonated  sudtonoe  members. 


Poster  Session:  Poster  sessions  allow  extended,  one-to-one  Interaction 
between  authors  and  interested  individuals.  Authors  of.  several 
papers  are  provided  space  in  which  they  can  display  stand-on-tabte 
posters  or  other  visual  materials  which  reflect  the  nature  of  their 
papers  for  45-50  minutes.  Interested  individuals  are  free  to  move 
from  poster  to  poster,  inquiring  of  or  talking  with  authors  of  theft 
choice.  Authors  are  expected  to  provide  complete  copies  of  the  paper 
on  which  the  poster  is  based  to  all  interested  individuate. 

Symposium:  A symposium  Is  Intended  to  provide  an  opportunity  for 
examination  of  specific  problems  or  topics  from  s variety  of 
perspectives.  Symposium  organizers  are  expected  to  Identify  the 
topic  or  issue,  identify  and  ensure  the  participation  of  individual 
speakers  vho  wi  participate,  prepare  any  necessary  materials  for  the 
symposium,  and  chair  the  session.  It  is  suggested,  though  not 
required,  that  the  speakers  or  symposium  organ tree  wffl  provide  to 
interested  individuals  one  or  more  papers  relevant  to,  reflective  of,  or 
drawn  from  the  symposium. 

Roundtable  Session:  Roundtable  sessions  are  Intended  to  provide 
opportunities  for  Interested  IndMduate  to  pertidpete  in  0 dialogue  with 
other  Interested  Mvfduals  and  the  authors)  of  a paper.  Authors  are 
provided  a small  table  around  which  interested  kxfiyktuals  can  meet 
to  discuss  the  authors)'  paper,  interested  individuals  are  free  to 
move  Into  and  out  of  these  discussions  as  they  wish.  Authors  are 
expected  to  make  avafebie  complete  copies  of  the  paper  on  vhlch  the 
roundtable  discussion  was  focused. 

Discussion  Group/Fomm:  These  sessions  are  intended  to  allow 

nradmum  Interaction  between  the  session  organizers  and  interested 
Individuals  on  a topic  or  issue  of  debate  or  interest  Unfflce  a 
symposkm,  wherein  the  otganlzer  Intentionally  Invites  Individuals  who 
represent  pertfcdar  points  of  view  to  speak  to  audience  members,  the 
discussion  or  forum  formats  are  designed  to  provoke  discussion 
among  ati  participants.  The  organizer  is  expected  to  identify  a topic 
or  issue  which  is  Maty  to  be  of  interest  and  a provocative  way  of 
initiating  the  discussion,  and  to  monitor  or  mediate  the  discussion. 

Workshop:  Worfahope  are  Intended  to  provide  an  extended  period  of  time 
during  which  the  workshop  feeder  helps  participants  develop  or 
improve  their  ability  to  perform  some  process  (e.g.,  how  to  provide 
clinical  supervision  or  appropriately  use  logHnesr  analysis). 
Organizers  may  request  from  1-1/2  to  3 hours,  and  are  responsible 
for  providing  att  necessary  materials  for  participants.  Workshops 
typtealy  are  scheduled  for  Wednesday  afternoon,  but  may  be 
scheduled  throughout  the  conference.  Organizers  may,  If  they  wish, 
receive  an  honorarium  based  upon  the  number  of  paid  participants  in 
their  workshop  and  the  fee  schedule. 

Alternative  Session:  The  form,  topics,  and  format  of  alternative  sessions 
are  Kmfted  only  by  the  imagination  and  creativity  of  the  organizer. 
These  options  are  intended  to  afford  the  most  effective  method  or 
approach  to  disseminating  scholarly  woric  of  a variety  of  types. 
Proposals  for  alt  amative  sessions  will  be  evaluated  on  their 
appropriateness  to  the  topic  and  audience,  their  sufcabUrty  to  meet 
limitations  of  time,  space,  or  expense  for  MWERA,  end  the  basic 
quality  or  value  of  thp  topic.  The  organizer  of  alternative  sessions  is 
responsible  for  identifying  all  major  participants  or  speakers, 
developing  and  provkfng  any  necessary  materials,  and  conducting  or 
mediating  the  session.  Because  a variety  of  approaches  may  be 
proposed  within  this  category,  alternative  session  proposals  should 
include  a brief  rationale  for  the  alternative  being  proposed. 


Guidelines  for  Submitting  individual  Proposals 


Individual  proposals  is  used  to  describe  any  proposal  intended  to 
present  a single  piece  of  scholarship  by  one  or  more  authors.  The  most 
basic  example  of  an  individual  proposal  would  be  one  in  which  an  Individual 
scholar  proposes  to  present  a paper  reporting  on  his  or  her  research.  This 
paper  could  be  assigned  to  a paper  session  with  other  similar  papers,  a 
roundtable  session,  or  a poster  session.  Similarly,  In  instances  where 
nxfopie  scholars  have  collaborated  on  a single  work,  an  individual  proposal 
would  bs  appropriate. 

The  presenting  or  toad  author  of  an  accepted  proposal  must  ensure 
that  the  paper  to  presented  at  the  Annual  Meeting.  If  the  toad  author  is 
unable  to  present  the  peper,  he  or  she  is  responsible  for  arranging  an 
aooeptabte  substitute  and  for  contacting  the  DMsion  or  Program  Chair  as 
soon  aa  possible. 


Materials  to  be  Submitted  With  an  Individual  Session 
Proposal 


Individual  Proposal  Cover  Sheet  (see  attached).  Six  (6)  copies  with  at) 
Hems,  including  subject  descriptors,  completed. 

Summary.  Six  (6)  copies  of  a 2-3  page  summary  for  use  In  judging  the 
merits  of  the  proposal  Summaries  can  be  single-spaced,  but  must  be  typed 
on  8-1/2x11"  paper  in  no  smaller  than  10  point  type,  with  1"  margins. 
Proposals  which  do  not  meet  these  criteria  may  bt  refused  by  ths  Division 
Chair  without  review. 

The  summary  should  explicitly  address  as  many  of  the  following  as 
appropriate,  and  preferably  In  this  order,  (a)  objectives,  goals,  or  purposes; 
(b)  perspectives)  and/or  theoretical  framework;  (c)  methods  and/or 
techniques  (data  source,  instruments,  techniques,  procedures);  (d)  results 
or  conclusions;  and  (f)  educational  or  scientific  importance  of  the  work. 
Individual  proposals  for  alternative  sessions  should  also  include  a brief 
rationale  for  ths  proposed  format 

For  three  copies  of  ths  summary,  the  heading  should  use  tha  following 
format  In  the  upper  left  comer,  type  the  title  of  the  submission,  authors), 
erri  institution^).  In  the  ipper  right  comer,  state  thenama  of  the  presenting 
or  lead  author  and  his  or  her  complete  malting  address  (inducting  e-mail). 
For  tha  remaining  three  copies,  only  the  title  of  the  paper  should  appear. 
Abstract  Three  (3)  copies  of  a 1 00-1 50  word  narrative  abstract  shoukJ  be 
prepared  for  publication  in  the  Annual  Meeting  Abstracts.  Abstracts  must 
be  typewritten,  single-spaced,  using  12-point  Ariel  or  Universal  font 
Use  clew,  precise  language  which  can  be  understood  by  readers  outside 
yourdedpine.  In  the  upper  left  comer,  type  the  title  of  the  paper,  the  name 
and  institutional  affiliation  of  each  author. 

Envelopes.  Four  (4)  stamped,  self-addressed,  business  sized  envelope#. 
These  wfl  be  used  to  inform  you  of:  (1)  receipt  of  the  proposal  by  ths 
division  chair,  (2)  ths  decision  about  your  paper's  acceptance;  (3)  your 
scheduled  session  time;  and  (4)  additional  Information  which  you  may  need 
prior  to  the  conference. 

Index  Cards.  Two  (2)  3x5"  index  cards.  These  should  contain  the 
foiowtng,  typewritten  information:  (a)  title  of  the  peper  IN  CAPS  across  ths 
top;  (b)  ths  fun  name,  institutional  affixation,  complete  matting  address  with 
zp  cods,  businese  telephone  number,  FAX  number,  and  e-mail  address  for 
the  toed  or  presenting  author;  end  (c)  full  name  and  Institutional  affiliation  of 
each  additional  author. 


Guidelines  for  Submitting  Multipie-Presenter 
Proposals. 


Muttipf+pns*nt$r  proposes  h used  to  refer  to  proposed  session 
form**  which  are  organized  to  allow  two  or  more  presenters  or  speaker*  to 
address  a single  topic,  Issue,  or  problem.  Examples  of  theee  atssioos 
would  Include  symposia,  panel  discussions,  or  forums,  and  alternative 
session  formats  meeting  the  above  criteria.  This  format  is  not  intended  to 
aHow  each  of  several  author*  to  address  his  or  her  contribution  to  a single 
work.  Rather,  the  multipie  presenters  should  reflect  several  perspectives, 
methodologies,  or  findings  regarding  the  particular  topic. 

Organizers  of  multipla-presenter  sessions  are  expected  to  have  tha 
consent  of  aX  presenters  before  submitting  the  proposal  and  to  chair  the 
session  or  specify  another  IndMdua!  to  do  so.  The  organizer  of  accepted 
multiple-presenter  proposals  Is  responsible  for  ensuring  that  each  parson 
named  at  a participant  wM  be  present  at  the  Annual  Meeting.  Should 
unforeseen  circumstances  prevent  a named  participant  from  attending,  the 
organtzar  must  Identify  a suitable  replacement,  notify  al  other  presenters  of 
the  change,  and  inform  the  DMsksn  Chair  or  Program  Chair. 


Materials  to  be  Submitted  With  a Multiple-Presenter 
Proposal 


MuMpIs  Preeantac  Proposal  Cover  Sheet  (ess  attached).  Sbr(6)  copies 
with  «l  tieme,  InckxXng  subject  descriptors,  completed. 

Summary.  Sk  (8)  copies  of  a 2-3  page  summery  for  uae  in  judging  the 
merito  of  tie  proposal.  Summarise  can  be  eingte-epsoed,  but  must  be  typed 


on  8-1/2x11*  paper  in  no  smatier  than  10  point  type,  with  1*  margins. 
Proposals  which  do  not  meet  theee  criteria  may  be  refused  by  the  DMeion 
Chair  without  review. 

The  summary  should  expticWy  address  aa  many  of  tha  fotowtog  aa 
approprirta,  and  preferably  In  this  order,  (a)  descriptive  Otis  of  tha  eeeeion; 
(b)  ths  Importance  of  ths  topic.  Issue,  or  problem;  (c)  names,  institutional 
•nwtooni,  inQ  spccinc  cowbwuo  or  piripMvVi  w o®  {hmkiumu  io  trio 
session  by  each  presenter,  (d)  an  eoqptawtion  of  tha  basic  format  or 
structure  of  the  session  and  why  It  Is  raievar*  in  fghj tef  the  topic;  (e)  a brief 
alienation  of  ths  rota  of  ths  chair,  organizer,  nadMor,  or  dtocueeent;  and 
(f)  anticipated  audit:  toe  and  arrfenoa  involvement 

For  aB  copier  of  the  summary,  the  heading  should  uae  tha  fofawing 
format  In  the  upper  left  comer,  type  the  ft*  name,  institutional  afllatton, 
mailing  address  including  zip  code,  business  telephone,  home  or  avar*\) 
telephone,  and  am ati  address  of  ths  eeieion  organizer. 

Abstract  Three  (3)  copies  of  a 100-150 word  narrative  abstract  should  be 
prepared  for  publication  In  the  Annual  Moating  Abstracts.  Abstracts  must 
be  type-written,  single  spaced,  using  12-point  Altai  or  Universal  font 
Uae  deer,  pro^langtMQevMoh  can  be  urxtocetood  by  leaden  outride 
yourdtodpine.  In  the  upper  left  comer,  type  the  titie  of  the  paper;  the  neme, 
hatituttonri  affiHflon,  trattng  address,  and  telephone  number  of  tha  session 
organizer;  and  ft*  name  and  Institutional  afllatton  of  each  presenter. 
Envelopes.  Four  (4)  stamped,  business  atzsd  envejopee,  proaddraseod 
to  the  organizer.  Theee  wtt  be  used  to  Inform  you  of:  (1)  receipt  of  the 
proposal  by  tha  dMrion  chair;  (2)  the  decision  about  tha  session's 
acceptance;  (3)  tha  scheriuiacl  session  time;  and  (4)  sckMonri  information 
which  may  be  needed  prior  to  the  oonforsnoe. 

Index  Cards.  Two  (2)  3x5"  index  cards.  These  should  contain  the 
folowlng,  typewritten  information:  (a)  title  of  tha  paper  IN  CAPS  across  the 
top;  (b)  the  futi  neme,  institutional  afllatton,  eomptato  maSng  address  vrith 
zip  code,  buekwes  telephone  number,  FAX  number,  end  e-mal  arid  see  for 
the  session  organizer,  if  other  than  tha  eeeeion  organtzar,  this  information 
must  also  be  included  for  the  eeeeion  ohalr,  medtator,  or  cRcouaaanL 


Guidelines  for  Submitting  Workshop  Proposals 


Workshop  topics  should  be  of  interest  and  use  to  a rizsabta  number  of 
M/VERA  members.  Presenters  may  elect  to  receive  an  honorarium  based 
ipon  the  number  of  participants  sttendtog  the  workshop.  Al  persona  feted 
as  presenters  are  required  to  appear  at  the  Annual  Meeting  and  to  conduct 
the  workshop  at  the  designated  time.  Moat  wortehope  wi  be  held  on 
Wednesday  afternoon. 


Materials  to  Be  Submitted  With  a Workshop  Proposal 


Workshop  Proposal  Cover  Sheet  (see  attached).  Stic  (8)  copies  with  al 
applicable  Hems,  including  descriptors,  completed. 

Summary.  Six  (6)  copies  of  a 2-3  pegs  summary  for  use  in  judging  the 
merits  of  the  proposal  Summaries  can  be  single-opeoed,  but  must  be  typed 
on  8-1/2x11"  peper  in  no  amafer  than  10  point  type,  with  1"  margins. 
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Chair  without  review. 

The  summery  should  expdeitiy  addreaa  as  many  of  the  fotaring  as 
appropriate,  and  preferably  In  this  order  (a)  descriptive  titie  of  tha  woriahop; 
(b)  objectives,  goals,  purposes  of  the  woriohop;  (c)  names,  Institutional 
affiliations,  and  specific  contributions  of  eech  workshop  leader;  (d)  tie 
importance  or  vriue  of  the  workahoo  for  Dartiotoanta  and  a attaemant  about 
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or  approaches  to  instruction  (eepedeffy  how  psrScipant*  y*  be  slowed  to 
apply  what  they  team);  and  (f)  a brief  description  of  the  presenter's*) 
relevant  experience. 

For  eH  copies,  the  heeding  of  the  2-3  pegs  summary  should  use  the 
following  format  In  the  upper  left  oomer,  type  the  ft*  neme.  Institutional 
aflfction,  malng  address  Inducing  zip  ooda,  bueinaea  telephone,  home  or 
evening  telephone,  end  e-mel  address  of  eeoh  workshop  leader  or 

AbebacL  Ttaea  (3)  copiee  of  a 100-150  word  nartritoo  rtabaot  should  be 
preperad  for  pubfoetion  In  the  Amuri  Merib^  Abebsofc.  Abebaoto  must 
be  type-written,  eingie-epaoed,  using  12-pobd  Arid  or  Urivarari  font 


Um  cfcar,  procto*  languag*  which  can  be  underttood  by  reader*  otftode 

your  dtodplne.  In  ttwuppw  tort  comw,  type  me  tibe  of  tfw  workshop,  the 
name  and  Institution^  afflfiaUon  of  the  workshop  organteer(s). 

Envelopes.  Four  (4)atomped,  buttoaee  staid  ewtoopee,  pwaddreeaed 
to  (he  workshop  organtzar  tor.  (1)  acknowledgement  of  receipt  of  (ha 
proposal  by  (ha  Workshop  Chair,  (2)  noUfleatton  of  (ha  acceptance  of  tha 
workshop  proposal;  (3)  echeduled  workshop  time;  and  (4)  addKkxtal 
IttfexmatioowMchnwy  be  needed  prior  to  the  conference. 

Index  Cards.  Two  (2)  3x6”  Index  cards,  typed  In  the  following  format: 
(a)  title  of  the  workshop  IN  CAPS  across  the  top;  (b)  full  name  of  the 
organizer,  followed  on  subsequent  lines  by  his  or  her  complete 
mailing  address  with  zip  code,  business  and  home  telephone 
numbers  with  area  code,  FAX  number,  and  e-mail  address. 

Workshop  proposals  should  be  submitted  to  Or.  Mary  Ann  Wham, 
Cotiaga  of  Education,  Unlvaralty  of  Wlaconsln-Whltewafar,  600  Was* 
Mato  Street,  Whtiawatar,  Wisconsin  63190. 


Where  To  Submit  Proposals 


Propottos  should  bs  srdnttad  to  tha  Chsir  of  lha  dMston  Mad  btiow  wkh 
which  K Is  most  ctoatoy  Monad.  Proposals  may  ba  submitted  to  only  ona 
dhriaton.  OMrtonOitoipareons  hold  the  rigid  to  forward  proposals  which 

tt»ey  belief*  ntight  beet  be  sutied  to  either  dMtoon  to  the  appropriate 
Division  Chair.  Qusationa  about  tha  appropriatonaaa  of  propoatoa  for 
particular  dMtoona  should  ba  dkactod  to  tha  OMtoon  Chain. 

For  consideration,  complete  proposal  materials  must  be  received 
by  the  Division  Chair  not  later  than  April  15, 1t§7. 


Division  A:  Administration  and  Leadership 

This  division  is  concerned  with  research,  theory,  development,  and  the 
improvement  of  practice  in  the  organization  and  administration  of 
education. 

Larry  McNeal 

Dept,  of  Educational  Administration  & Foundations 
Illinois  State  University 
PeGarmo  Hall,  Room  342 
Normal,  IL  61 7905900 
Voice:  (309)  438*5155 
Fax:  (309)  438-8683 
e-mail:  Imcneal@rs6000.emp.ilstu.edu 


Division  B:  Curriculum  Studies 


This  division  is  concerned  with  curriculum  and  instructional  practice, 
theory,  and  research 

James  H.  Powell 
Secondary  Education 
Teachers  College  825 
Ball  State  University 
Muncie,  IN  47306 
Voice:  (31 7)  285-5474 
Fax:  (317)285-5479 
e-mail:  OOjpowell@bsuvc.bsu.edu 


Division  C:  Learning  and  Instruction 

This  division  is  concerned  with  theory  and  research  on  human  abilities, 
learning  styles,  individual  differences,  problem  solving,  and  other  cognitive 
factors. 


Marlene  Schommer 
College  of  Education  #123 
Wichita  State  University 
Wichita,  KS  67260-0123 
Voice:  (316)  978-3326 
Fax:  (316)  9786102 

e-mail:  Schommer@twsuvm.uc.twsu.edu 

Division  D:  Measurement  and  Research  Methodology 

This  division  is  concerned  with  measurement,  statistical  methods,  and 
research  design  applied  to  educational  research. 

Bruce  G.  Rogers 

Educational  Psychology  and  Foundations 
College  of  Education 
University  of  Northern  Iowa 
Cedar  Falls,  1A  5061 4-0607 
Voice:  (319)2736115 
Fax:  (319)2736997 
e-mail:  Bruce.Rogers@uni.edu 


Division  E:  Counseling  and  Development 

This  division  is  concerned  with  the  understanding  of  human  development, 
special  education,  and  the  application  and  improvement  of  counseling 
theories,  techniques,  and  training  strategies. 

Eddie  E.  Glenn 
Illinois  State  University 
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How  Teachers  Connect  Research  and  Practice 

Mary  M.  Kennedy 
Michigan  State  University 


The  importance  of  teacher’s  prior  beliefs  and  values  as 
influences  on  teaching  practice  has  become  increasingly  ap- 
parent in  recent  years.  The  presence  of  these  ideas  raises  new 
questions  about  the  role  of  research  in  teaching.  If  teachers 
are  guided  mainly  by  their  own  belief  systems,  for  instance, 
how  can  we  expect  research  to  contribute  to  practice?  To 
examine  the  relationship  between  teachers  prior  beliefs  and 
their  responses  to  research,  I initiated  a study  called  the  Re- 
search and  Teacher  Learning  (RTL)  study.  As  it’s  name  sug- 
gests, it  is  about  the  relationship  between  research  and  teacher 
learning.  We  were  particularly  interested  in  how  research  can 
influence  teacher  learning.  The  study  addresses  two  very  broad 
questions: 

1 . What  and  how  do  teachers  learn  from  reading  research 

studies? 

2.  What  and  how  do  teachers  learn  from  conducting  re- 
search of  their  own? 

Before  going  into  some  of  the  findings  from  this  study, 
let  me  describe  the  study  in  more  detail. 

We  interviewed  a sample  of  just  over  100  teachers,  all  of 
whom  were  selected  because  they  were  participating  in  some 
form  of  continuing  education  or  professional  development  that 
involved  research.  Some  were  participating  in  a masters  de- 
gree program  and  read  research  in  their  classes,  some  were 
participating  in  a district-sponsored  teacher- research  program. 
All  teachers  were  participating  in  a program  that  included  some 
attention  to  research,  but  the  programs  differed  in  what  they 
did  with  research  and  in  whether  the  teachers  were  novices, 
working  on  their  initial  degree,  or  experienced  teachers  en- 
gaged in  continuing  education. 

The  interview  itself  consisted  of  four  main  parts.  First, 
because  we  knew  that  prior  beliefs  and  values  were  impor- 
tant, we  devised  a set  of  questions  that  we  hoped  would  en- 
able us  to  learn  about  these.  We  asked  them,  for  instance,  to 
describe  a teacher  whom  they  admired  and  to  say  why  they 
thought  this  teacher  was  admirable,  to  describe  a lesson  they 
had  done  recently  that  they  felt  very  satisfied  with,  and  to 
say  why  they  were  satisfied  with  it,  and  so  forth.  All  of 
these  questions  were  designed  to  reveal  their  beliefs  and 
values  about  teaching.  The  second  part  of  the  interview 
probed  their  beliefs  and  values  about  research,  and  for  simi- 
lar reasons.  We  thought  that  their  receptivity  to  research 
might  depend  not  only  on  how  the  study  squared  with  their 
own  their  views  about  teaching,  but  also  on  their  belief  in 
the  inherent  value  of  research  and  how  it  could  or  should 
contribute  to  their  work. 

The  third  and  fourth  sections  address  their  experiences 
conducting  their  own  research  and  their  responses  to  research 
other  people  had  done,  respectively.  About  three  quarters 


of  the  sample  had  conducted  teacher  research  as  part  of 
their  programs  and  we  queried  them  about  what  they  stud- 
ied, where  their  question  came  from,  how  they  gathered 
data,  how  they  analyzed  it,  and  what  they  learned  from  the 
whole  experience. 

To  learn  their  responses  to  research  conducted  by  oth- 
ers, we  actually  gave  them  five  research  summaries  to  read. 
Then,  when  we  met  with  them  again,  we  asked  them  their 
responses  to  these  studies.  We  spent  between  20  and  30 
minutes  on  each  piece  of  research,  asking  them  what  they 
thought  the  author’s  purpose  was  for  doing  the  study, 
whether  the  study  was  persuasive  to  them  or  not  and  why, 
what  they  thought  the  author’s  conclusions  were,  whether 
the  study  was  relevant  to  their  own  practice,  and  whether 
they  thought  the  study  would  be  useful  to  other  teachers. 

The  resulting  data  base  has  a tremendous  amount  of 
information  in  it.  In  this  paper,  I concentrate  on  only  a very 
small  segment  of  the  study  that  specifically  addresses  the 
way  teachers  connect  research  to  their  own  teaching,  and  I 
do  that  by  focusing  on  one  particular  study.  My  aim  in  this 
paper  is  to  illustrate  these  processes  with  just  two  examples 
of  teachers’  responses  to  one  study-Lisa  Delpit’s  ‘’Skills 
and  other  dilemmas  of  a progressive  Black  educator,”  pub- 
lished in  the  Harvard  Education  Review  in  1986.  Before 
discussing  the  ways  in  which  these  two  teachers  connected 
that  study  to  their  own  practices,  let  me  briefly  review  the 
study  itself. 

As  a genre  of  research,  Delpit’s  paper  could  be  called 
a teacher  reflection.  In  the  paper,  Delpit  reflects  on  a ten- 
sion she  feels  between  the  progressive  ideals  she  learned  in 
college  and  the  traditional  skills-based  education  she  her- 
self had  received  in  a segregated  Catholic  school  in  the 
south.  In  college,  Delpit  was  persuaded  that  students  should 
not  spend  their  time  rehearsing  meaningless  skills,  and  that 
she  should  focus  on  the  writing  process  for  teaching  writ- 
ing. By  the  time  she  graduated  she  was  a progressive  edu- 
cator, and  when  she  began  teaching  she  introduced  learning 
stations,  activity-based  instructional  materials,  and  a car- 
peted learning  area.  As  time  went  on,  though,  she  began  to 
sense  that,  although  her  White  students  were  learning,  her 
Black  students  were  playing.  So  she  gradually  re-intro- 
duced the  desks,  began  making  students  practice  handwrit- 
ing, and  in  general  becoming  more  traditional.  Then  she 
felt  guilty  because  she  wasn’t  as  progressive  as  she  wanted 
to  be,  and  guilty  because  she  wasn’t  teaching  her  Black 
students  as  much  as  she  wanted. 

This  story  goes  on  as  Delpit  returns  to  graduate  school 
and  gets  her  progressive  ideas  again  reinforced.  The  pivotal 
event  in  the  story,  though,  occurs  when  she  has  dinner  with 
an  old  friend  who  is  critical  of  the  writing  process.  The  friend 
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claims  it  was  designed  by  White  people  to  prevent  Blacks 
from  learning  the  skills  they  need  to  function  in  a White  soci- 
ety. The  friend  says  Black  students  aie  already  fluent,  and 
that  what  they  need  is  skills. 

That  dinner  had  a substantial  impact  on  Delpit,  and  she 
began  canvassing  educators  of  both  races  to  learn  more  about 
their  views.  She  learned  that  Blacks  rarely  participated  in 
the  writing  process,  and  that  even  when  they  did  it  was  usu- 
ally for  no  longer  than  a year.  She  learned  that  Blacks  felt 
excluded  in  writing  workshops,  and  felt  that  their  concerns 
about  skills  were  not  heard  or  addressed. 

Delpit  closes  her  narrative  by  saying  that  she  now  feels 
she  can  understand  both  sides  of  the  issue.  On  one  hand, 
minority  students  should  not  be  subjected  to  a daily  regimen 
of  rehearsing  meaningless,  decontextualized  subskills.  A mi- 
nority person  who  simply  acquires  basic  skills  becomes  a low- 
level  functionary.  On  the  other  hand,  minority  children  need 
the  skills  that  employers  and  guardians  of  higher  educational 
institutions  demand.  Helping  them  become  more  expressive 
in  their  writing  does  not  necessarily  mean  that  they  have  ac- 
quired the  skills  needed  to  improve  their  social  standing  once 
they  leave  school.  So,  Delpit  says,  we  need  to  find  a way  to 
teach  these  skills  in  the  context  of  critical  and  creative  think- 
ing. She  also  believes  that  there  is  a lot  to  be  gained  from 
opening  up  the  dialogue  between  advocates  and  critics  of  ei- 
ther approach,  and  that  it  is  particularly  important  that  lead- 
ers of  the  process  approach  pay  attention  to  the  legitimate 
concerns  of  minority  educators. 

Delpit’s  article  is  an  excellent  example  of  a teacher  re- 
flection, in  that  it  is  both  earnest  and  penetrating.  Delpit’s 
genuine  concern  is  apparent  throughout  the  article,  as  is  her 
intellectual  honesty  and  rigor.  It  also  is  a complex  story,  for 
it  addresses  tensions  between  structured  and  open  class- 
rooms, between  teaching  fluency  and  teaching  skills,  and 
between  Black  and  White  values.  It  certainly  should  stimu- 
late teacher  thinking  and  it  certainly  should  be  relevant  to 
most  teachers. 

To  learn  from  research-or  from  anything  else,  for  that 
matter-teachers  must  do  the  following: 

1 . Understand  what  the  main  message  is  from  the  study. 

2.  Test  the  validity  of  the  message  somehow. 

3.  Connect  that  message  to  their  own  situation. 

To  learn  what  teachers  learn  from  Delpit’s  reflection,  I 
first  wanted  to  know  what  teachers  understood  Delpit’s  mes- 
sage to  be.  One  of  the  questions  we  asked  was  what  conclu- 
sions they  thought  Delpit  had  drawn.  Some  teachers 
described  a conclusion  having  to  do  with  pedagogy,  some  a 
conclusion  having  to  do  with  race  relations,  and  some  listed 
both  types  of  conclusions.  Later,  we  reviewed  the  data  and 
grouped  teachers’  responses  into  a few  main  categories, 
shown  in  Table  L 

Table  1 suggests  that  most  teachers  did  correctly  un- 
derstand Delpit’ s main  messages.  With  respect  to  pedagogy, 
the  largest  fraction  understood  Delpit  to  be  saying  that  both 
sides  were  right,  that  teachers  need  to  teach  both  skills  and 


fluency.  With  respect  to  race,  some  thought  Delpit’s  main 
point  was  that  minority  views  need  to  be  attended  to  in  re- 
form movements,  and  some  though  it  was  that  different  races 
need  different  kinds  of  instruction.  Interestingly,  many  teach- 
ers, instead  of  articulating  a conclusion,  volunteered  that  they 
liked,  or  didn’t  like,  Delpit’s  treatment  of  the  race  issue. 

Table  1 


Conclusions  about  Pedagogy  Attributed  to  Delpit 


Percent 

Conclusion 

1 

Don’t  know 

14 

No  conclusion  about  pedagogy  mentioned 

56 

Both  sides  are  right,  need  to  do  both 

16 

Different  kids  need  different  pedagogies 

5 

Delpit  was  in  favor  or  (or  opposed  to)  the  writ- 

ing  process 

8 

Other  Responses 

Conclusions  about  Race  Attributed  to  Delpit 

Percent  Conclusion 

40  No  conclusions  about  race  are  mentioned 

20  Minority  views  need  to  be  attended  to 

25  Races  need  different  kinds  of  instruction  or  have 

different  needs 

15  I like/don’t  like  Delpit’s  treatment  of  the  issue 


Examples  of  “Other”  Conclusions  about  Pedagogy 

Ms.  Whalon’s  conclusion: 

Delpit  wants  minority  kids  to  succeed  and  yet  she  wants 
them  to  keep  their  cultural  heritage. 

Ms.  Woodland’s  conclusion: 

If  minorities  are  to  create  changes  in  society,  we  have  to 
help  them  get  to  that  point. 


At  the  foot  of  Table  1 I’ve  included  two  examples  of 
‘’other”  interpretations.  These  make  it  clear  that  some  teach- 
ers did  not  fully  understand  Delpit’s  message.  They’ve  in- 
serted some  different  ideas  into  the  text.  These  anomalous 
interpretations  are  important,  I will  return  to  the  problem 
these  pose  later  on. 

Once  teachers  understand  the  main  message  from  a 
study,  they  need  to  evaluate  the  validity  or  invalidity  of  that 
message.  To  learn  how  teachers  evaluated  these  studies,  we 
asked  if  they  agreed  with  the  author’s  conclusion  or  not,  and 
we  asked  them  why.  Again,  we  did  not  impose  any  catego- 
ries of  reasons  on  them,  but  instead  categorized  their  rea- 
sons later  on.  Table  2 summarizes  the  main  reasons  teachers 
offered  for  either  agreeing  or  disagreeing  with  the  conclu- 
sions they  had  just  attributed  to  Delpit.  In  addition,  it  shows 
the  reasons  they  gave  for  agreeing  or  disagreeing  with  all 
the  other  studies  they  had  read. 
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Table  2 


Reasons  for  Agreeing  or  Not  Agreeing 
with  a Study’s  Conclusions 

Reason  Percent  giving  this  Percent  giving  this 

Offered  reason  reason  for  the 


(across  all  studies)  Delpit  Reflection 


No  reason  given 

9 

8 

Conclusion  consistent 
with  values,  beliefs 

22 

25 

Consistent  with 
experience 

32 

38 

Consistent  with  other 
ideas  or  findings 

8 

5 

Evidence  supports 
conclusion 

15 

11 

Critique  of  evidence 

13 

14 

Study  is  factual, 
no  agreement  necessary 

1 

0 

Two  important  points  can  be  made  about  the  patterns  in 
Table  2.  One  is  that  teachers’  reasons  for  agreeing  or  disagree- 
ing with  Delpit’s  reflection  are  not  substantially  different  from 
the  reasons  they  used  to  agree  or  disagree  with  any  other  study, 
even  though  the  studies  were  quite  different.  That  is,  teachers 
who  read  Delpit’s  reflection  also  read  a survey  (Applebee,  Langer, 
Mullis,  & Jenkins,  1990),  an  experiment  (Collins,  Brown,  & 
Holcum,  1991;Scardamalia,Bereiter,&Steinbach,  1984),  a dis- 
ciplinary study  (Baron,  1982)  and  an  historical  analysis  (Coleman, 
1975).  Many  would  argue  that  Delpit’s  reflection  is  closer  to 
teaching  practice  than  any  of  the  others,  but  teachers  did  not  use 
remarkably  different  criteria  for  evaluating  it. 

The  second  important  trend  apparent  in  Table  2 is  that 
teachers  used  their  own  values,  beliefs  or  experiences  more 
often  than  any  other  criterion  to  test  the  validity  of  these  au- 
thors’ conclusions.  Table  2 makes  it  clear  that  teachers  are 
already  connecting  the  study  to  their  own  situations,  even  at 
the  stage  of  testing  its  validity.  That  is,  connections  to  practice 
are  not  a third  step  in  a process,  something  that  is  done  only 
after  the  study  is  understood  and  tested  for  validity.  Instead,  it 
is  something  that  is  done  early  on,  as  part  of  the  process  of 
testing  the  validity  of  the  study. 

This  creates  an  interesting  question,  for  if  studies  arc  per- 
ceived as  valid  mainly  when  they  are  consistent  with  teacher’s 
prior  beliefs  and  experiences,  how  can  teachers  ever  learn  some- 
thing new  from  research?  Clearly,  teachers  need  to  do  more 
than  simply  accept  or  reject  studies.  They  need  to  draw  some 
implications  from  them.  We  also  asked  teachers  what  implica- 
tions the  study  had  for  their  own  practice,  and  Table  3 shows 
teachers’  responses  to  that  questions.  Here  again,  I have  ag- 
gregated across  the  five  studies  in  the  language  arts  package, 
but  I have  also  given  their  responses  to  Dclpit’s  reflection.  Since 
Dclpit’s  paper  was  explicitly  aimed  at  provoking  thought  and 
dialogue,  we  might  expect  teachers’  responses  to  it  to  differ 


somewhat  from  the  others.  However,  the  implications  teachers 
drew  from  Delpit’s  reflection  were  not  noticeably  different  from 
the  implications  they  drew  from  entire  set  of  studies. 


Table  3 


Implications  Teachers  Saw  in  Delpit’s  Reflection 

Implications  Percent  of  Teachers 

Percent  of  Teachers 

Mentioned  Responding 

Responding 

to  all  studies 

to  Delpit 

No  Influence 

18 

14 

Gives  new 

information 

4 

3 

Validates 

existing  beliefs 

26 

29 

Sharpens  thinking 

17 

23 

Raises  questions. 

provokes  thought 

15 

18 

Suggests  a new  goal 

to  strive  for 

4 

2 

Suggests  changing 

practice 

3 

8 

Will  try  it  out 

10 

3 

Can  include  it 

in  my  curriculum 

3 

0 

These  findings  suggest  that  teachers  connect  research  to 
their  practice  in  two  very  different  ways.  On  one  hand,  they 
use  their  own  beliefs,  values,  and  experiences  to  evaluate  the 
validity  of  the  study,  but  on  the  other  hand,  they  also  take  some- 
thing new  from  the  study,  as  it  stimulates  their  thinking  and 
prompts  them  to  reinterpret  their  own  experiences  and  to  re- 
consider their  practices. 

Taken  together,  these  tables  suggest  that  teachers  are  quite 
able  to  connect  research  to  their  own  practices.  But  they  do  not 
explain  the  fact  that  some  teachers  misconstrue  the  conclusions 
from  research.  In  fact,  our  evidence  suggests  that  these  mis- 
conceptions derive,  at  least  in  part,  from  the  fact  that  they  are 
interpreting  the  studies  in  light  of  their  prior  beliefs  and  experi- 
ences. Teachers  in  this  study  were  more  likely  to  generate  un- 
usual or  idiosyncratic  interpretations  of  an  author’s  conclusions 
when  they  used  their  prior  beliefs  and  experiences  to  evaluate 
validity  than  they  were  when  they  relied  on  the  evidence  in  the 
study,  as  Table  4 shows.  Table  4 lists  again  the  main  reasons 
teachers  agreed  or  disagreed  with  a study’s  conclusions,  and 
then  shows  the  fraction  of  teachers  who  used  each  reason  who 
also  generated  an  idiosyncratic  interpretation  of  the  conclu- 
sion. That  is,  of  all  the  teachers  who  evaluated  a study  on  the 
basis  of  its  consistency  with  their  own  prior  beliefs  and  values, 
1 5 percent  offered  an  idiosyncratic  interpretation  of  the  study’s 
conclusion.  Of  all  those  who  critiqued  the  evidence  as  a way  of 
saying  why  they  agreed  or  disagreed,  only  two  percent  offered 
idiosyncratic  interpretations  of  the  conclusions. 
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Table  4 


Figure  1 


Percent  of  “Other”  Interpretations  of  Conclusions 
as  a Function  of  Reasons  for  Agreeing  or  Disagreeing 

Reason  Offered 

Percent  of  Conclusion 
Statements  that 
were  “Other” 

No  reason  given 

25 

Conclusion  consistent  with 
values,  beliefs 

15 

Conclusion  consistent  with 
experience 

12 

Consistent  with  other  ideas 
or  findings 

12 

Evidence  supports  conclusion 

4 

Critique  of  evidence 

2 

Study  is  factual, 
no  agreement  necessary 

0 

Table  4,  then,  suggests  that  the  teachers  who  relied  on  their 
prior  values  and  beliefs  or  on  their  experiences  were  more  likely 
to  formulate  idiosyncratic  interpretation  of  the  study’s  conclu- 
sions than  were  teachers  who  relied  on  the  study’s  evidence  or 
on  how  consistent  the  study  was  with  other  research  or  ideas 
they  were  familiar  with.  So  we  have  an  ironic  finding  here:  We 
know  that,  in  order  to  learn  from  a study,  teachers  need  to  con- 
nect it  to  their  own  situations,  but  we  also  see  that  when  they  do 
that  they  are  more  likely  to  interpret  the  study  idiosyncratically. 

To  illustrate  how  teachers  connect  research  to  their  prior 
beliefs  and  experiences  and  how  these  connections  influence 
their  interpretations  of  the  study,  I have  developed  a strategy 
for  graphically  representing  these  connections.  I include  here 
two  such  graphic  representations,  one  from  a teacher  whose 
interpretation  of  Delpit’s  conclusions  seemed  very  close  to 
Delpit’s  intention,  and  the  other  from  a teacher  whose  inter- 
pretation was  idiosyncratic.  These  schematics  are  shown  in 
Figures  1 and  2. 

In  these  figures,  the  different  shapes  represent  different 
parts  of  the  reasoning  process.  The  figure  in  the  center  rep- 
resents Delpit’s  reflection,  and  the  ovals  represent  the  teach- 
ers’ interpretation  of  Delpit’s  conclusions.  The  clouds 
surrounding  the  study  represent  the  teachers’  thoughts,  and 
the  rectangles  represent  particular  experiences  that  the 
teacher  has  related  to  the  study. 

The  first  figure  shows  Ms.  Foss’s  responses  to  the  Delpit 
reflection.  There  were  three  clusters  of  ideas  in  Ms.  Foss’s 
discussion.  One,  shown  in  the  upper  right,  includes  her  expe- 
riences, which  she  defines  as  similar  to  Delpit,  her  thinking 
that  she  and  Delpit  are  in  the  same  place,  her  realization  that 
her  Black  students  are  more  fluent  orally,  and  her  interpreta- 
tion of  Delpit’s  conclusion  that  we  have  to  teach  skills  in  the 
context  of  critical  thinking.  The  second  cluster  of  thoughts  is 
shown  in  the  lower  right,  where  Ms.  Foss  realizes  that  she  has 
not  actually  taught  in  a more  structured  way,  and  so  doesn't 
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really  know  if  these  particular  students  would  do  better  with 
that  approach  to  teaching.  In  this  cluster  of  thoughts,  she  also 
notes  that  research  indicates  that  whole  language  is  a more 
effective  teaching  method,  and  she  realizes  that  Delpit  has 
also  not  shown  any  evidence  that  Black  students  would  do 
better  in  a more  structured  situation.  This  second  cluster  of 
ideas,  then,  suggests  that  Ms.  Foss  has  evaluated  Delpit’s  re- 
flection for  its  evidence,  and  has  realized  that  Delpit  lacks  an 
adequate  comparison  group. 

Finally,  in  the  upper  left  corner  are  Ms.  Foss’s  ideas 
about  race.  She  is  dismayed  to  discover  that  Blacks  are  sus- 
picious of  the  process  writing,  and  comments  on  the  level  of 
paranoia  she  perceives  in  the  article.  She  correctly  inter- 
prets Delpit’s  argument  that  minority  views  need  to  be  at- 
tended to,  but  offers  a qualification  of  her  own  to  the  effect 
that  they  should  not  be  listened  to  any  more  than  any  one 
clse’s  views  are. 

After  considering  all  of  these  things,  Ms.  Foss  draws 
implications  for.  her  own  practice,  and  these  are  shown  in 
the  lower  left  portion  of  the  figure.  She  says  this  study  is  an 
extremely  important  article  and  that  she  plans  to  share  it 
with  colleagues,  particularly  her  Black  colleagues,  because 
she  wants  to  learn  their  views  on  this  issue. 

So  Ms.  Foss  has  done  all  three  of  the  tasks:  She  has  cor- 
rectly understood  both  aspects  of  Delpit’s  conclusion,  she  has 
evaluated  the  validity  of  Delpit’s  evidence,  and  she  has  drawn 
some  implications  from  the  article  for  her  own  practice. 

Now  let’s  consider  Ms.  Whalon.  Recall  that  I first  re- 
ferred to  Ms.  Whalon’s  interpretation  of  Delpit’s  conclusion 
in  the  context  of  Table  2,  where  her  interpretation  was  listed 
as  an  example  of  an  “other”  interpretation.  That  conclusion 
is  shown  in  this  figure  in  two  ovals.  In  the  upper  oval,  Ms. 
Whalon  says  that  Delpit  wants  children  to  write  in  a certain 
format.  In  the  lower  oval,  Ms.  Whalon  says  that  Delpit  wants 
minority  children  to  succeed  and  yet  she  wants  them  to  have 
their  roots  and  their  identity.  This  second  interpretation  is  the 
one  I listed  as  an  “other”  in  Table  2,  for  Delpit  never  said 
anything  in  her  paper  about  maintaining  Black  children’s  cul- 
tural heritage.  She  was  much  more  concerned  about  assuring 
that  they  learned  the  skills  they  would  need  to  succeed  in  a 
predominantly  White  society. 

Now  let’s  look  at  the  beliefs  and  experiences  that  Ms. 
Whalon  brings  to  this  study,  and  sec  if  they  help  us  under- 
stand her  misinterpretation.  At  the  top  right  of  the  page  is  a 
cluster  in  which  Ms.  Whalon  mentions  that  she  was  edu- 
cated in  the  same  way  Delpit  was,  and  she  thinks,  in  retro- 
spect, maybe  that  was  not  such  a bad  method  after  all.  From 
there,  she  moves  to  interpreting  Delpit  as  wanting  students 
to  write  in  a “certain  format,”  by  which  I think  she  means 
standard  White  English. 

The  most  important  cluster,  in  terms  of  Ms.  Whalon’s 
interpretation  of  Delpit,  consists  of  the  experiences  described 
in  three  boxes  on  the  right  side  of  the  figure.  In  these  boxes, 
Ms.  Whalon  tells  us  she  teaches  in  a school  with  a lot  of 
African-Americans;  she  corrects  their  grammar  and  tries  to 
teach  them  White  English;  and  she  also  makes  them  speak 
quietly  and  politely  and  doesn’t  let  them  yell.  At  the  same 


time,  she  tells  us  in  the  cloud  that  she  is  worried  that  perhaps 
she  is  biased.  Perhaps  she  is  trying  to  make  them  into  White 
people  and  denying  them  their  cultural  heritage.  She  is  very 
unsure  of  her  role  as  a White  teacher  of  Black  students  when 
it  comes  to  teaching  language  conventions.  Ironically,  she 
is  probably  teaching  the  kinds  of  skills  that  Delpit  wants  to 
make  sure  Black  students  get,  but  she  is  doing  it  with  a great 
deal  of  personal  angst.  Her  anxieties  about  her  own  role 
influence  her  interpretation  of  Delpit,  such  that  she  thinks, 
although  Delpit  wants  Black  kids  to  succeed,  she  also  wants 
them  to  have  their  roots  and  their  cultural  identity.  When  we 
viewed  Ms.  Whalon’s  interpretation  in  the  context  of  Table 
2,  it  seemed  idiosyncratic  and  inexplicable  relative  to  the 
interpretations  of  other  teachers.  But  when  we  view  it  in  the 
context  of  her  own  experiences,  values,  and  beliefs,  this  mis- 
interpretation is  not  difficult  to  understand. 

Interestingly,  Ms.  Whalon  also  has  less  to  say  about  the 
' alidity  of  this  article  a ..1  less  to  say  about  its  implications  for 
her  practice.  With  respect  to  the  validity  of  Delpit’s  study,  Ms. 
Whalon’s  assessment,  shown  in  the  upper  left  section  of  Figure 
2,  is  more  informal  than  Ms.  Foss’s.  She  likes  the  article  be- 
cause it  “has  heart.”  She  does  not  really  critique  the  article 
closely  at  all.  With  respect  to  its  implications  for  her  practice, 
she  says  it  is  provocative  and  that  she  is  trying  to  grow  in  this 
area,  but  indicate  anything  in  particular  that  she  has  drawn  from 
the  article  or  that  she  intends  to  do  with  the  article. 

So  Ms.  Whalon  has  mis-read  the  main  message  of  the  ar- 
ticle, and  evaluated  it  more  informally  than  the  other  teacher, 
and  her  connection0  to  her  own  experience  occur  more  when 
she  is  interpreting  die  article  than  when  she  is  drawing  implica- 
tions from  it. 

These  two  teachers,  then,  have  responded  to  Delpit’s  re- 
flection in  very  different  ways.  They  differed  in  how  accu- 
rately they  understood  the  main  message,  in  how  carefully 
they  evaluated  the  validity  of  the  argument,  and  in  how  fully 
they  teased  out  implications  from  the  study  for  their  own  prac- 
tice. They  illustrate  for  us  the  importance  of  teachers’  prior 
beliefs  and  experiences  in  interpreting  research  findings,  not 
just  in  drawing  implications  from  research,  but  in  assessing 
its  validity  as  well. 
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Schedules  and  Plans  and  Things  You  Should  Know 

Sharon  McNeely,  MWERA  President 
Northeastern  University 


The  Association  Council  and  the  Board  of  Directors  of 
MWERA  have  been  busy  dealing  with  a number  of  issues 
and  trying  to  meet  the  needs  of  association  membership.  In 
the  past  few  years  a number  of  important  initiatives  have 
taken  place  that  I would  like  you  to  know  about.  There  are 
also  a number  of  other  upcoming  events  you  should  mark 
on  your  calendar  and  be  ' ure  to  attend! 

AERA  is  in  Chicago  this  year.  We  are  hoping  that 
MWERA  membership  comes  to  AERA,  and  shows  every- 
one what  high  quality  work  our  members  do.  At  the  last  Board 
of  Directors’  meeting,  we  agreed  that  we  should  have  a so- 
cial hour  at  AERA  that  is  hosted  by  MWERA.  In  addition  to 
attendance  by  MWERA  members,  we  hope  that  we  will  at- 
tract potential  members,  and  friends  from  other  regions! 
Watch  your  AERA  schedule  for  the  time  of  this  event. 

The  Holiday  Inn  Mart  Plaza  has  been  kind  enough  to 
agree  to  provide  comparable  room  rates  for  AERA.  The  hotel 
may  not  be  listed  in  your  AERA  program.  Call  them  directly 
at  312-836-5000.  Please  make  sure  you  use  this  number  and 
not  the  number  that  was  listed  in  the  program.  That  was  a 
bad  typo!  If  you  were  thinking  that  the  Bismarck  might  be  a 
spot  to  stay,  you  need  to  know  that  the  Bismarck  is  closed 
for  business  as  of  January  1997. 1 am  not  sure  if  and  when 
they  will  reopen.  They  are  dealing  with  a number  of  build- 
ing-related issues. 

I am  so  glad  that  we  decided  to  change  hotels  this  past 
year.  I know  that  it  was  a bit  of  a problem  for  some  of  our 
members,  but  I think  that  the  vast  majority  were  pleased 
with  the  change.  I also  am  really  glad  that  we  aren’t  trying  to 
hotel-hunt  right  now,  with  the  Bismarck  closing.  Quality, 
inexpensive  hotel  space  for  an  organization  our  size  is  so 
limited  in  the  downtown  Chicago  area!  I don’t  want  to  re- 
hash the  numerous  problems  that  we  were  having  in  dealing 
with  constantly  changing  managements  at  the  Bismarck,  or 
the  lack  of  space,  or  the  issues  of  security,  etc.  Rather,  I 
would  like  to  take  a moment  to  dwell  on  the  positives.  After 
our  membership  told  us  that  they  want  the  convention  to 
stay  in  downtown  Chicago,  we  began  a number  of  initia- 
tives. We  toured  numerous  hotel  in  the  Chicago  area,  and 
sought  information  about  rates,  space,  etc.  We  considered 
the  ease  of  membership  traveling  to  hotels,  parking,  safety, 
and  cost.  We  also  wanted  a place  where  the  person  we  talked 
to  one  week  would  be  available  the  next  week,  and  our  con- 
tract would  still  be  valid  and  on  tne  books!  We  were  blessed 
with  the  wise  guidance  of  the  years  of  Charles  Anderson 
working  with  the  Bismarck  to  tell  us  what  issues  we  needed 
to  clarify  up  front,  and  what  problems  we  might  anticipate. 
When  we  found  the  Holiday  Inn  Mart  Plaza,  we  felt  we  had 
the  best  of  all  worlds. 


Chicago  is  an  expensive  city  to  visit.  The  average  hotel 
room  rates  arc  typically  50  to  75%  more  than  what  we  are 
able  to  book  for  the  conference.  Few  hotels  have  meeting 
space  that  is  not  outrageously  priced.  Few  hotels  would  let 
us  bring  in  equipment,  use  the  lobby  for  exhibits,  etc.  Few 
hotels  would  hold  rooms  so  late  before  a conference  be- 
cause so  many  of  our  members  get  materials  after  their  se- 
mesters or  quarters  start.  The  Holiday  Inn  provided  us  with 
the  best  offer.  Yes,  we  now  have  to  pay  for  meeting  space. 
However,  if  we  have  enough  sleeping  rooms  used  by  our 
membership,  that  cost  is  minimal.  There  were  some  prob- 
lems this  first,  year  at  the  Holiday  Inn  with  booking  rooms. 
The  problem  was  one  of  getting  the  word  out  that  the  hotel 
phone  number  was  printed  wrong,  and  getting  membership 
to  meet  the  deadline.  The  deadline  for  booking  rooms  is 
important.  The  number  of  rooms  booked  by  deadline  is  part 
of  what  goes  into  figuring  the  total  cost  of  using  the  hotel 
for  the  conference.  PLEASE  book  your  room  early.  In  fact, 
now  would  be  a great  time  to  make  that  reservation  for  the 
1997  meeting. 

Yes,  we  are  locked  into  the  hotel  for  1997.  Mark  your 
calendar  for  October  15-18!  Call  the  hotel  and  make  your 
reservation!  Also,  we  are  moving  to  lock  in  the  next  few 
years.  Mark  your  calendars  for  MWERA  to  be  October  14- 
17  in  1998,  and  October  16-19  in  1999.  We’ll  let  you  know 
about  the  year  2000  shortly! 

The  Board  of  Directors  knew  that  the  move  to  any  hotel 
would  be  expensive  for  the  organization  for  the  first  couple 
of  years.  We  have  new  costs  to  consider,  and  have  to  find 
some  new  ways  to  cover  those  costs  without  raising  the  rates 
of  membership,  registration  or  dues.  I hope  that  if  you  have 
some  ideas,  you  will  share  them  with  us.  One  of  the  hidden 
costs  to  us  that  is  not  a large  problem,  but  is  also  one  that  we 
want  to  acknowledge  and  try  to  deal  with,  is  the  problem  of 
cancellations  and  no  shows  for  the  program.  We  know  that 
we  will  have  to  cancel  certain  workshops,  etc.,  based  on 
enrollment.  However,  for  the  regular  program,  we  really  do 
expect  all  of  those  people  who  have  submitted  presentations, 
been  reviewed  and  accepted,  to  show  up  or  make  arrange- 
ments for  their  presentations  to  be  given.  The  submission 
rate  for  various  Divisions  has  been  high  enough  that  wc  have 
to  reject  some  quality  work.  It  is  a shame  that  there  arc  re- 
jections and  yet  some  accepted  works  arc  not  presented.  I 
know  that  people  get  ill  at  the  last  minute,  have  family  cri- 
sis, etc.  However,  when  someone  signs  the  proposal  and 
agrees  to  present,  he/she  needs  to  follow  through.  The  Board 
of  Directors  has  been  continuing  discussion  about  how  to 
be  supportive  of  our  membership  and  yet  deal  with  this  is- 
sue. If  you  have  suggestions,  wc  welcome  them! 


A couple  of  years  ago  the  Board  of  Directors  asked  Terri 
Strand  to  develop  the  history  and  archives  of  MWERA.  We 
knew  that  there  were  records  in  many  places,  and  that  we 
needed  to  pull  this  together  before  we  got  too  much  further 
along  in  our  development.  Terri  has  done  an  outstanding 
job  of  gathering  materials,  organizing,  archiving,  and  estab- 
lishing a system  for  retrieval  of  key  documents.  The  Board 
of  Directors  recently  received  a report  from  Terri,  and  we 
anticipate  that  you  will  be  hearing  more  about  this  in  the 
near  future. 

The  Association  Council  may  also  be  meeting  at  AERA. 
We  are  working  on  dealing  with  some  important  By-Laws 
changes,  and  may  need  the  time  to  finish  this  up,  although  I 
am  hoping  we  will  be  done  before  then.  The  change  in  the 
By-Laws  that  we  are  considering  has  to  do  with  moving  the 
election  of  the  Vice  President-Elect  ahead  by  one  year,  bring- 
ing that  person  “on  board”  a year  earlier.  As  you  know,  the 
Vice  President  is  in  charge  of  the  conference  program.  This 
is  a huge  job.  Currently,  the  election  of  that  person  happens 
a year  in  advance,  and  when  he/she  is  VP-Elect,  that  year  is 
used  for  learning  about  how  the  organization  works,  and 
planning  for  the  conference.  There  is  very  little  time,  actu- 
ally, as  conference  planning  goes,  to  get  on  board  and  make 
plans.  Let  me  use  this  year  for  an  example.  Tom  Parish  was 
elected  in  the  spring  of  1996.  His  first  Board  meeting  and 
conference  was  this  past  October.  He  had  a couple  of  weeks 
following  the  meeting  to  get  his  program  committee  orga- 
nized, get  his  call  for  papers  done,  and  plan  his  main  speak- 
ers. He  reports  to  the  Board  in  January,  and  we  move  ahead 
to  deal  with  issues  from  there,  for  him  to  have  the  1997 
meeting  in  place.  Tom  is  new  to  the  Board,  and  there  are  a 
great  many  procedures  and  policies  for  him  to  learn  and 
implement  in  a very  short  period  of  time.  I know  that  he  will 
work  very  hard  on  this. 

The  proposal  for  the  change  would  have  elected  Tom 
the  year  before,  using  the  example,  in  1 995.  That  would  al- 
low him  more  time  to  plan,  to  meet  with  the  Board,  to  lock 
in  speakers,  to  go  to  AERA  to  meet  with  people,  etc.  It  would 
also  give  the  membership  more  of  an  opportunity  to  know 
who  they  were  working  with,  and  to  make  plans  for  meet- 
ings that  best  met  the  multiple  needs  of  our  membership. 


At  the  Association  Council  meeting  there  was  some  dis- 
cussion about  changing  the  By-Laws  so  that  we  eliminate 
the  position  of  President-Elect,  or  have  the  President-Elect 
be  the  program  chair.  I am  not  in  favor  of  either  of  these 
because  it  puts  MWERA  at  risk.  The  President  is  the  person 
who  is  ultimately  in  charge  of  the  financial  affairs  of  the 
organization.  The  President  must  work  with  the  Executive 
Officer,  and  oversee  the  expenses  of  the  program  chair.  If 
the  position  of  program  chair  moved  to  immediately  (later 
in  that  program)  become  the  president,  he/she  could  poten- 
tially spend  whatever  he/she  wanted  to  and  then  sign  off  on 
it!  We  could  potentially  ruin  the  organization  in  one  swoop! 

I cannot  and  will  not  support  this  position.  Some  people  asked 
me  this  past  year  what  I did  as  President-Elect.  There  are  a 
lot  of  things  that  the  Board  oversees  on  an  ongoing  basis, 
and  a lot  of  things  that  have  to  be  taken  care  of  for  the  pro- 
gram. The  President-Elect  ends  up  doing  a great  many  small, 
but  important  jobs  for  the  organization.  I never  realized  how 
many  things  there  were  to  be  done! 

A few  years  ago,  when  we  knew  that  Charles  Anderson 
would  be  stepping  aside  as  the  Executive  Officer,  we  all 
worked  hard  at  trying  to  make  the  transition  go  smoothly. 
There  were  many  policies  and  procedures  that  had  been  in 
place,  but  were  not  written  down.  Additionally,  the  organi- 
zation was  growing  at  a tremendous  rate,  and  many  new 
members  probably  had  no  idea  about  the  day-to-day  opera- 
tions (nor  did  they  probably  want  to  know)!  I have  worked 
with  previous  presidents  and  Charles  to  draft  a policies 
manual.  The  current  Board  of  Directors  is  working  to  refine 
that  manual.  When  we  are  done,  we  will  have  a working 
document  that  should  be  helpful  for  our  membership  and 
future  leaders  to  keep  the  organization  running  in  the  pro- 
fessional, well-developed  manner  that  it  now  works. 

The  Association  is  you,  the  membership.  I am  delighted  to 
have  the  opportunity  to  serve  you,  and  to  try  to  meet  your  needs. 
I am  hoping  that  you  continue  to  provide  input  to  all  of  your 
elected  officers,  and  will  be  patient  as  we  move  ahead  with 
trying  to  help  the  organization  grow.  I am  also  hoping  that  you 
will  take  this  opportunity  to  share  the  call  for  proposals  with 
others,  and  to  bring  new  members  into  the  association.  We  know 
that  our  membership  joins  us  because  other  members  take  the 
time  to  share,  to  tell  about  MWERA,  and  to  encourage  others 


I wish  you  the  best  for  a great  year,  and  hope  to  see  you  soon! 


AERA  Annual  Meeting  Information 

MWERA  Association  Council  Meeting 

MWERA  Reception 

Wednesday,  March  26,  1997 

Thursday,  March  27,  1997 

8:15-  10:15  a.m. 

7:00  p.m. 

Addams  Room,  3rd  Floor,  West  Tower 

Erie  Room,  Level  2 

Hyatt  Hotel 

Sheraton  Chicago  Hotel  and  Tower 

Conference  Highlights 

Mid-Western  Educational  Research  Association  1996  Conference 


Kim  K.  Metcalf 
Indiana  University 


The  Holiday  Inn  at  Mart  Plaza,  Chicago,  played  host  to 
the  1996  annual  conference  of  the  Mid-Western  Educational 
Research  Association.  The  1996  conference,  in  addition  to 
the  new  hotel,  featured  a variety  of  expanded  session  formats 
and  offered  both  first  time  conference  attendees  and  return- 
ing MWERA  members  the  opportunity  to  experience  research, 
scholarship,  and  ideas  from  a wide  range  of  topics. 

Three  noted  educational  scholars  were  featured  across 
the  3 Vz  days  of  the  conference.  Dr.  Herbert  Walberg,  re- 
search professor  at  the  University  of  Illinois  - Chicago,  was 
featured  in  the  opening  Wednesday  evening  session.  Dr. 
Walberg ’s  presentation  on  educational  productivity  provided 
an  interesting,  thought-provoking,  even  unsettling  contrast 
to  speakers  featured  at  MWERA  conferences  in  recent  years. 

Dr.  Carolyn  Evertson  of  Peabody  College  at  Vanderbilt 
University  provided  the  Thursday  morning  keynote  address. 
Dr.  Evertson,  widely  recognized  for  her  research,  on  class- 
room management  and  effective  teaching,  addressed  her  most 
recent  line  of  scholarship  in  which  she  examines  what  it 
means  to  ‘‘teach  for  understanding.”  Her  work  with  teach- 
ers in  the  Nashville  area  and  with  the  Blue  Ribbon  Schools 
panel  provided  the  context  within  which  she  has  discovered 
much  about  the  unique  approaches  and  ways  of  thinking  re- 
quired by  teachers  when  they  attempt  to  help  students  un- 
derstand content  at  higher  levels. 

Friday  afternoon’s  luncheon  speaker  was  Dr.  Mary 
Kennedy  of  Michigan  State  University.  Dr.  Kennedy’s  most 
recent  work  and  that  on  which  she  spoke  focused  on  innova- 
tive ways  of  analyzing,  organizing  and  reporting  qualitative 
data  on  teachers’  thinking. 


MV/ ERA  Past  Presidents 


(from  left)  Ayres  D' Costa,  Ralph  Dorr,  John  Kennedy, 
Jean  Pierce,  Ken  Kiewera,  Isadore  Newman,  Richard 
Pugh,  Greg  Marchant,  Tom  Andre,  Charles  Anderson 


In  addition  to  notable  speakers,  the  1996  conference 
featured  a much  expanded  series  of  round  table  presenta- 
tions. The  new  facilities  at  the  Holiday  Inn  enabled  over  65 
authors  the  opportunity  to  spend  extended  time  explaining 
their  research  to  interested  individuals  and  interacting  with 
those  individuals  about  the  specific  aspects  of  their  work. 
Invited  speakers  and  special  sessions  included  a panel  dis- 
cussion by  past  MWERA  presidents,  an  intriguing  discus- 
sion of  successful  educational  researchers  by  Ken  Kiewera, 
‘‘The  Virtual  Library”  by  Molly  Nicaise  and  Humphrey  Loe, 
and  a ‘‘Meet  the  Editors”  session  with  the  incoming  editors 
of  the  Mid-Western  Educational  Researcher. 

Attendance  at  this  year’s  conference  was  surprisingly 
high  in  light  of  the  numerous  changes  from  past  years.  In 
addition  to  moving  from  the  Bismarck  to  the  Holiday  Inn, 
MWERA  members  dealt  with  a substantially  earlier  dead- 
line for  proposals  and  conference  dates  approximately  one 
week  earlier  than  in  past  years.  Among  the  most  exciting 
highlights  of  this  year’s  conference  was  the  surprisingly  large 
proportion  of  proposals  submitted  and  presented  by  first  time 
MWERA  conference  participants.  Roughly  60%  of  all  con- 
ference presentations  were  made  by  authors  who  had  not 
before  attended  or  participated  in  an  MWERA  conference. 

Conference  Program  Chair,  Kim  Metcalf,  repeatedly 
expressed  his  thanks  and  appreciation  to  the  many  individu- 
als who  helped  make  the  1 996  conference  a success.  Dr. 
Tom  Parrish,  Program  Chair  for  the  1997  Conference,  in- 
vites individuals  interested  in  assisting  in  preparing  next  years 
program  to  contact  him  directly. 


Vice  Presiaent  Kim  Metcalf  and  staff 


Sharon  McNeely , President-Elect  and  Isadore  Newman , fto 
President 


Carolyn  Evertson,  featured  speaker,  and  Greg 
Marchant , MV/ERA  President 


Charles  Anderson,  Executive  Office  Emeritus,  and  Jean  Mary  Kennedy,  featured  luncheon  speaker 

Pierce,  MWERA  Executive  Officer 


Presidential  Address 


Top  10  Issues  Facing  Teacher  Education 

Gregory  J.  Marchant,  Ball  State  University 
with  Gary  Griffin,  University  of  Arizona 


For  efficiency  of  reading  and  clarity,  I have  always  appreciated  articles  that  contain  brief  lists  which  in  single  state- 
ments encapsulate  the  main  points  of  the  article.  Coming  from  Ball  State  University,  the  alma  mater  of  David  Letterman, 
I also  have  a certain  predisposition  to  “top  ten”  lists.  With  this  in  mind,  a little  more  than  two  years  ago  I sat  down  with 
Gary  Griffin  while  meeting  at  Educational  Testing  Services  in  Princeton,  New  Jersey.  A year  later  we  continued  the 
discussion  of  issues  problematic  to  the  education  of  teachers.  What  follows  are  the  ten  points  we  discussed  that  served  as 
basis  for  discussion  during  my  presidential  address  at  this  years  annual  meeting.  I have  added  some  possible  approaches 
for  each  issue.  I welcome.your  comments. 


Number  Ten: 

Negative  public  perceptions  of  the  quality  of  U.S. 
education 

Criticism  of  the  U.S.  public  schools  was  documented  in 
a Nation  at  Risk  and  hit  extreme  political  tones  during  the 
Reagan  and  Bush  administrations.  Much  of  the  well  publi- 
cized decline  in  public  education  and  its  inadequacy  rela- 
tive to  other  countries  was  refuted  in  The  Manufactured 
Crisis  (Berliner  & Biddle,  1995),  and  presented  by  David 
Berliner  and  Gerald  Bracey  at  last  year’s  MWERA  annual 
meeting.  Although  this  year’s  presentation  by  Herb  Walberg 
echoed  the  old  themes  of  the  generic  woes  of  public  educa- 
tion, those  findings  were  again  questioned  by  the  audience. 
Regardless  of  whether  our  schools  are  in  academic  disre- 
pair or  not,  the  impact  of  the  perception  is  evident.  The 
status  of  teaching,  teachers,  and  teacher  education  has  taken 
a beating.  Universities  often  view  schools  of  education  as 
cash  cows  with  high  enrollment,  but  low  scholarly  value. 
Concern  has  been  raised  over  the  quality  of  college  students 
attracted  to  the  field  and  the  quality  of  their  teaching  when 
they  graduate.  Funding  and  policy  decisions  in  education 
often  reflect  more  of  a punitive  than  a supportive  approach. 

Possible  approach:  Teacher  education  programs  should 
exercise  damage  control  over  misinformation  about  our 
schools  and  teaching . Sound  educational  theory  and  re- 
search should  be  used  to  inform  those  inside  and  outside  of 
education  as  to  the  real  problems  and  likely  solutions . 
Teacher  education  programs  need  to  be  the  banner  wavers 
for  what  is  good  about  teaching  and  teacher  education. 

Number  Nine: 

Lack  of  foundations  in  education 

Education  as  a field  has  history  and  philosophy;  a foun- 
dation. For  those  who  make  the  field  their  career  this  foun- 
dation should  be  part  of  their  knowledge  base.  Unfortunately, 


far  too  often  everything  old  is  new  again  without  the  insight 
that  the  old  has  been  tried.  Dewey  is  rediscovered  without 
the  knowledge  that  he  was  discovered  in  the  first  place. 
Teachers  need  to  be  able  to  reflect  on  why  they  use  or  should 
not  use  certain  approaches.  Foundations  in  education  pro- 
vide foundations  for  professional  decision  making. 

Possible  approach:  Reverse  the  trend  of  reducing  and 
eliminating  foundations  courses.  Better  still,  infuse  foun- 
dations issues  throughout  the  teacher  education  curricu- 
lum. 


Number  Eight: 

Lack  of  teacher/scholar  orientation  of  college 
faculty 

Few,  if  any,  colleges  support  a true  teacher/scholar  model 
even  in  a traditional  sense,  let  alone  in  the  Ernest  Boyer 
Scholarship  Reconsidered  sense.  Quality  teachers  are  dis- 
missed from  universities  due  to  lack  of  scholarship  (research 
and  publication),  and  conversely  research  is  not  expected  or 
rewarded  at  some  colleges  emphasizing  teaching.  Under- 
graduate education  students  are  often  left  with  few,  if  any, 
models  of  inquiring,  reflective,  innovative,  quality  college 
teachers.  Without  these  models,  education  students  are  left 
to  conceptualize  action  research  and  reflective  practice  on 
their  own  and  often  after  they  leave  the  teacher  education 
program. 

Possible  approach : Colleges  and  universities  must  re- 
consider their  notion  of  scholarship  and  give  more  than  lip 
service  to  the  types  of  models  they  wish  to  support.  College 
faculty  will  not  and  should  not  involve  themselves  in  activi- 
ties which  will  leave  them  without  a future  in  the  profes- 
sion. Colleges  need  to  recognize  and  reward  the  teacher/ 
scholar  model 
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Number  Seven: 

Student  prior  knowledge  and  experience 

There  are  few  things  that  a college  student  has  more  of 
than  experience  as  a student.  This  is  both  a blessing  and  a 
curse.  The  knowledge  and  experience  gained  as  a student 
can  serve  as  the  basis  for  considerations  of  teaching  and 
learning.  Reflecting  on  past  teaching  and  learning  experi- 
ences can  be  a useful  exercise.  However,  this  knowledge 
and  experience  may  also  set  expectations  and  biases.  Often 
education  students  feel  they  know  how  students  learn  best 
because  they  know  (or  think  they  know)  how  they  learn.  They 
feel  they  know  how  they  should  teach  because  they  know 
the  kind  of  teachers  they  liked.  Their  subjective  interpreta- 
tions of  teaching  and  learning  can  undermine  efforts  to  pro- 
vide contemporary  approaches  that  take  into  account  a 
variety  of  aspects  of  learning. 

Possible  solution : Challenge  the  education  students' 
conceptualizations  of  teaching  and  learning  with  examples 
and  simulations.  When  appropriate , college  courses  should 
model  alternative  effective  teaching  approaches  rather  than 
rely  on  lectures. 

Number  Six: 

Failure  to  experience  meaningful  diversity 

A college  course  in  multicultural  education  does  not 
begin  to  deal  with  the  issues  of  diversity  that  teachers  face. 
This  is  often  the  extent  to  which  diversity  issues  are  ad- 
dressed, if  at  all.  Teaching  is  about  dealing  wiih  diversity; 
twenty  or  more  children,  all  with  different  backgrounds,  cre- 
ating different  constructions  of  the  world.  Teachers  try  to 
find  the  right  connections  and  bridges  to  help  children  learn. 
Central  to  that  task  is  understanding  the  variety  of  worlds 
the  children  come  from  and  the  different  forms  the  connec- 
tions and  bridges  might  take. 

Possible  approach:  Consider  diversity  as  a theme  run- 
ning throughout  teacher  education : diversity : in  familial  and 
cultural  background  of  children,  diversity  in  learning  and 
learners , diversity  in  teaching  and  teachers. 

Number  Five: 

Inadequate  and  inappropriat  t field  experiences 

Education  students  have  long  held  field  experiences, 
especially  student  teaching,  in  high  regard.  This  respect  has 
often  come  at  the  relative  discrediting  of  college  course  work 
in  education.  The  field  experiences  tend  to  be  viewed  as  the 
real  world,  and  course  work  viewed  as  information  to  be 
memorized  for  a test.  One  possible  suggestion  is  that  courses 
need  to  be  more  practical;  however,  another  implication 


might  be  that  education  students  face  too  many  inconsisten- 
cies in  field  experiences  without  the  support  to  make  con- 
nections to  course  work.  Specifically,  education  students 
are  usually  asked  to  observe  in  classrooms  without  knowing 
what  or  how  to  observe.  Brief  unguided  exposure  to  certain 
types  of  classrooms,  such  as  urban  and  inclusion  classes, 
can  do  more  to  reinforce  stereotypes  than  to  provide  insight. 
The  amount  of  involvement  and  responsibility  expected  in 
practicum  placements  can  vary  greatly,  as  can  teaching  ap- 
proaches (and  potentially  the  quality  of  teaching)  of  the  co- 
operating classroom  teacher.  The  amount  of  responsibility 
that  the  college  assumes  for  the  training  and  monitoring  of 
cooperating  teachers  varies,  but  in  most  cases  is  minimal. 

Possible  approach : The  number  of  field  experiences 
may  need  to  be  increased  in  most  teacher  education  pro- 
grams. These  experiences  need  to  be  belter  structured,  stra- 
tegically planned , and  monitored  for  quality  and  content. 

Number  Four: 

Student  maturity 

In  few  other  fields,  does  the  trip  from  high  school  stu- 
dent to  a fully  functioning  professional  occur  in  four  short 
years.  Education  students  must  mature  in  terms  of  ability  to 
comprehend  the  multitude  of  complex  variables  necessary 
to  make  professional  teaching  decisions  and  must  be  able  to 
assume  a level  of  responsibility  unheard  of  in  other  fields. 
Developmental  psychology  and  personal  experience  tell  me 
that  the  typical  college  undergraduate  may  not  be  ready  for 
much  of  what  we  are  attempting  in  most  teacher  preparation 
programs.  The  Holmes  Group  recognized  the  need  for  a 
firm  foundation  in  an  undergraduate  major  prior  to  teacher 
education,  and  Martin  Haberman  has  repeatedly  called  for 
alternative  teacher  certification  programs  as  a means  of  at- 
tracting more  mature,  experienced  people  to  teaching.  Eco- 
nomics suggests  that  the  expectation  of  significantly  longer 
training  prior  to  employment  in  teaching  may  not  be  a prac- 
tical solution,  and  alternative  certification  programs  have 
demonstrated  limitations  that  make  them  less  than  desirable. 

Possible  approach:  Teacher  education  programs  must 
be  carefully  structured  to  give  undergraduate  students 
knowledge  and  skills , but  especially  experience;  because 
these  students  must  not  only  gain  knowledge  and  skills,  they 
must  " grow  up"  and  gain  professional  experience.  Teacher 
education  programs  should  also  adopt  a role  in  the  contin- 
ued professional  development  of  the  teachers  they  produce , 
especially  for  the  first  few  years  they  are  in  practice. 
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Number  Three: 

College  turf  and  tradition 

College  courses  are  traditionally  viewed  as  the  income 
generating  properties  of  college  departments,  the  currency 
being  student  credit  hours  generated.  Because  jobs  and 
power  are  often  at  stake,  battles  and  compromises  are  made 
with  great  concern  by  departments.  The  political  battles  to 
get  and  keep  courses  are  legendary  in  some  colleges.  Illogi- 
cal arrangements  and  ownership  of  courses  are  frequently 
explained  with  history  rather  than  with  what  is  best  for  the 
education  student. 

Possible  approach:  Reevaluate  the  teacher  education 
program  strictly  in  terms  of  how  the  education  students  might 
be  most  efficiently  and  effectively  developed  into  quality 
teachers , then  look  at  the  real  limitations  of  the  college 
rather  than  the  other  way  around  ( i.e with  these  limita- 
tions, what  can  we  do?). 

Number  Two: 

Discrete  courses 

In  contemporary  elementary  school  curriculums,  sub- 
ject areas  are  often  linked  and  integrated  through  thematic 
instruction  and  reading  or  writing  across  the  curriculum. 
Increasingly,  secondary  curriculum  is  being  thought  in  terms 
of  blocks  of  time  and  related  subjects  with  team  teaching 
taking  place  at  all  levels— all  levels,  that  is,  except  the  col- 
lege level.  At  the  college  level  curriculum  continues  to  be 
thought  of  in  discrete  units  of  courses,  taken  once  and  pos- 
sibly forgotten.  Two  themes  which  have  consistently 
emerged  in  professional  education  standards  are  learning  and 
development.  Yet,  these  are  areas  that  are  typically  offered 
as  a course  offered  early  in  the  teacher  education  program 
(these  are  also  the  courses  which  are  on  the  chopping  block 
at  many  colleges).  Other  areas  of  importance  receive  much 
the  same  treatment,  if  offered  at  all.  It  is  not  unusual  for 
courses  in  multicultural  education,  special  education,  and 
reading  to  be  offered  once,  if  at  all,  in  the  teacher  education 
program.  The  inherent  message  to  education  students  is  to 
learn  what  is  needed  for  the  course  (which  may  or  may  not 
be  related  to  anything  else  in  teaching  or  learning),  pass  the 
exam,  and  move  on  to  the  next  course.  Little  coordination 
exists  across  departments  and  sometimes  even  across  courses 
within  departments,  leaving  some  content  ignored  because 
it  is  assumed  to  be  covered  elsewhere  while  other  content 
may  be  redundant.  The  end  results  are  programs  that  are 
fragmented  with  no  overall  sense  for  the  development  of  the 
future  teacher. 


Possible  approach:  Open  up  lines  of  communication 
and  coordination  within  and  across  departments.  Adminis- 
tration needs  to  be  open  to  providing  compensation  for  co- 
ordination time  and  to  be  willing  to  recognize  these  efforts 
within  the  reward  system.  Colleges  need  to  consider  blocks 
of  courses  and  the  integration  of  areas  across  the  program 
with  teams  of  instructors  working  with  cohorts  of  education 
students.  Among  other  things  this  will  help  build  account- 
ability for  the  overall  program  and  the  teachers  it  produces. 

Number  One: 

Failure  to  understand  the  nature  of  the  teaching- 
learning process 

Although  I receive  much  gratification  from  student  com- 
ments concerning  how  my  course  in  educational  psychol- 
ogy helped  them,  I also  feel  some  satisfaction  when  students 
inform  me  that  they  are  changing  their  major  from  educa- 
tion because  they  hadn’t  realized  what  all  was  involved  in 
teaching.  The  teaching-learning  process  is  very  complex. 
Efforts  to  oversimplify  the  process  do  a disservice  to  the 
future  teachers.  Teaching  is  not  a collection  of  activities  or 
lectures.  It  is  the  interaction  of  form  and  content  with  learner 
constructions  occurring  within  social  contexts.  It  is  curricu- 
lum, psychology,  and  sociology;  to  name  a few.  Lee  Shulman 
once  described  pedagogy  as  the  highest  level  of  Bloom’s 
taxonomy  of  die  cognitive  domain.  This  begins  to  get  to  the 
difficulty  of  the  task  of  effective  teaching.  To  successfully 
execute  the  task  of  teaching  requires  an  incredibly  high  level 
of  knowledge,  skill,  and  reflection.  To  be  a good  teacher  is 
a very  difficult  and  time-consuming  endeavor;  to  be  a great 
teacher,  a master  teacher,  requires  a competent  experienced 
individual  at  the  top  of  the  profession.  In  the  teaching  of 
educational  psychology  we  often  discuss  the  conflict  between 
the  breadth  of  content  we  need  to  cover  versus  the  need  to 
cover  concepts  with  a level  of  depth  that  is  meaningful  for 
the  education  students  all  within  a three-credit  hour  course. 
The  answer,  of  course,  is  simple  (actually  simply  impos- 
sible): we  must  do  both,  but  we  can’t. 

Possible  approach:  Teacher  education  programs  must 
be  viewed  not  as  a collection  of  courses,  but  as  one  step  in 
the  development  of  a good  teacher  It  is  not  the  first  step. 
Education  students  enter  the  program  with  a wealth  of 
knowledge  and  experiences  that  will  impact  their  ability  to 
grow  through  the  program.  It  is  by  far  not  the  last  step. 
Teaching  must  be  viewed  as  a developmental  process  that 
continues  throughout  practice . Professional  development 
must  be  viewed  as  internal  rather  than  insennee  offerings. 
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A Brief  Report1 


Fulfilling  Its  Promise,  a Content  Analysis 
of  20  Years  of  Research  at  MWERA 

Thomas  Andre 
Iowa  State  University 

Abstract 

Twenty  years  ago , an  ethnographic  research  study  of  MWERA  was  initiated . A team  of  ethnographers, 
posing  as  educational  researchers , began  attending  MWERA  and  engaging  in  participant  - observation 
research.  Artifacts , in  the  form  of  papers,  and  field  notes  on  the  interactions  and  activities  of  members 
were  collected.  The  present  paper  represents  an  attempt  to  summarize  the  twelve  major  research  con- 
clusions that  have  emerged  from  that  study. 


Introduction  and  Method 

This  study  reports  a long  term  study  of  MWERA  that  I 
have  been  conducting.  Starting  at  the  first  convention,  I 
arranged  to  have  ethnographic  colleagues  attend  MWERA 
and  pose  as  educational  researchers.  Over  the  past  twenty 
years,  this  team  has  randomly  and  representatively  sampled 
sessions  from  95%  of  the  meetings.  Artifacts,  in  the  form  of 
papers,  and  field  notes  on  the  interactions  and  activities  of 
members  were  collected.  This  study  focuses  on  the  rela- 
tionship between  presentations  and  the  educational  ideas  they 
promote.  It  also  represents  a content  analysis  of  the  major 
conclusions  of  presentation  given  over  that  interval.  The 
present  paper  shares  the  12  most  important  results  of  this 
study  with  you. 

Results 

Listed  below  are  12  major  conclusions  from  20  years 
of  research  at  MWERA. 

Across  the  sample  of  papers  obtained  and  examined: 

1 . 100%  of  presenters  concluded  that  further  research  was 
needed. 

2.  99.34%  of  MWERA  research  presenters  failed  to  take 
advantage  of  successful  instructional  procedures  they 
investigated  or  any  successful  instructional  interventions 
to  enhance  the  participatory  experience  of  the  audience 
in  their  session. 

3.  88.34%  of  presenters  that  reported  a non-significant 
finding  that  was  in  the  direction  of  their  hypothesis  in- 
terpreted and  discussed  that  finding  as  if  it  supported 
their  hypothesis. 

4.  Only  1 4.72%  of  the  researchers  in  the  point  above  cau- 
tioned that  the  result  was  non-significant. 

5.  86.95%  of  presentations  that  contain  overheads  had  an 
overhead  typed  in  elite  or  10  point  font  that  was  impos- 
sible to  read  at  a distance  of  more  than  20  inches  from 
the  screen. 


6.  82.2%o  of  the  presentations  were  self-described  as  re- 
porting preliminary  findings,  apparently  in  support  of 
conclusion  1. 

7.  7 1 .35%  of  presentations  that  contained  no  statistically 
significant  findings  orally  reported  significance  statis- 
tics to  4 decimal  places. 

8.  70.70%  of  presenters  brought  fewer  copies  of  their  pa- 
per than  recommended  by  MWERA.  The  number  of 
papers  brought  was  inversely  related  to  the  likely  popu- 
larity of  the  topic. 

9.  In  68.34%  of  oral  research  presentation  sessions,  a re- 
searcher was  in  the  middle  of  his/her  method  or  results 
section  and  stated  words  to  the  effect:  “One  minute  left?! 
But  I am  only  in  the  method/results  section!” 

10.  58.23%  of  qualitative  researchers  said  in  their  talk  that 
qualitative  research  is  about  the  specific  cases  it  studies 
and  is  not  intended  to  be  generalized. 

11.  88.3%  of  the  researchers  in  the  item  above  then  dis- 
cussed the  transferability  of  their  findings. 

12.  34%  of  MWERA  presenters  did  not  look  at  their  audi- 
ence more  than  three  times  during  their  presentation. 

Discussion 

In  honor  of  the  twentieth  meeting  of  MWERA,  it  seems 
appropriate  that  we  consider  the  humorous  aspects  of  our 
own  behavior.  While  the  serious  nature  of  the  research  re- 
ported at  MWERA  is  well  documented,  it  is  clear  that  occa- 
sionally laughing  at  ourselves  clears  our  collective  heads 
and  provides  a proper  perspective  in  which  to  further  pur- 
sue the  goals  of  life,  liberty,  statistical  significance,  construct 
validity,  or  triangulation.  With  this  I mind,  the  author  wishes: 
Happy  data  to  all  and  to  all  a good  night! 


•This  paper  is  a pack  of  nonsense  and  lies  that  should  only  be  used  in  the  humorous  manner  it  was  intended.  Any  use  of  the  present  report  in  situations  other  than  those 
intended  by  the  author  represents  a senous  ethical  violation  that  may  be  investigated  by  the  Guardians  of  !■  ndorc  or  the  l'cliowshtp  of  the  Ring. 


Voices  from  the  Past 

Deborah  L.  Bainer 
ChristineS.  Halon 

The  Ohio  State  University,  Mansfield 


This  year’s  annual  conference  of  the  Mid-Western  Educational  Research  Association  (MWERA)  in  Chicago  was  a 
milestone:  the  organization’s  20th  conference.  Already,  MWERA  has  a rich  and  productive  history.  The  organi- 
zation has  established  itself  as  a notable  regional  body  committed  to  building  collegial ity,  sharing  and  stimulating 
research  interests,  and  mentoring  graduate  students  and  new  faculty.  While  MWERA  limits  its  efforts  in  contact- 
ing members  to  13  midwestem  states  and  Canadian  provinces,  its  actual  membership  is  spread  throughout  the 
United  States,  Canada,  and  other  countries. 

This  seems  like  an  appropriate  time  to  reflect  on  M WERA’s  past,  and  to  ponder  the  future.  To  identify  benchmarks 
and  aspirations  of  the  organization,  past  presidents  were  contacted  and  asked  to  respond  to  two  questions.  Their 
responses  are  reported  below. 

1 . What  were  the  highlights  or  memorable  events  during  your  year  as  president  of  MWERA? 

2.  What  suggestions  “from  the  heart”  do  you  have  for  the  organization  and  its  future? 


Jean  Pierce , 1983-84 
Northern  Illinois  University 

“Perhaps  the  most  memorable  event  was  the  creation  of 
an  electronic  forum  for  mid-western  educational  research- 
ers, the  first  of  its  kind  in  the  nation.  The  EdRescarch  Fo- 
rum was  located  on  CompuServe,  since  the  Internet  had  not 
yet  started  to  grow.  The  idea  worked  fine  for  a handful  of 
MWERA  members,  but  in  1 983  computer  networking  was  a 
few  years  ahead  of  its  time.  More  use  by  network-literate 
researchers  was  needed  to  keep  the  space  available  to  us. 
By  1 985,  EdResearch  Forum  came  under  the  sponsorship  of 
AERA.  As  Mid- West  goes,  so  goes  the  nation! 

“Periodically  reexamining  our  mission  and  prioritizing 
our  goals  as  an  organization  are  crucial.  Currently,  a top 
priority  is  the  mentorship  of  graduate  students  and  new  fac- 
ulty. Perhaps  we  need  to  ensure  that  student  voices  are  rep- 
resented on  decision-making  committees.  If  the  main  goal 
is  to  create  a feeling  of  stability  and  ‘family,’  then  perhaps 
we  should  not  put  a lot  of  time  and  effort  into  membership 
recruitment,  and  wc  can  consider  five-year  presidency  track 
(Conference  Co-Chair,  Conference  Chair,  President-Elect, 
President,  Past  President).  If  a major  goal  is  to  promote 
communication  and  collaboration  among  researchers 
throughout  the  region,  then  wc  could  make  a stronger  effort 
to  ensure  that  members  from  a wide  variety  of  states,  prov- 
inces, and  cultures  arc  nominated  for  leadership  positions. 
If  a primary  purpose  is  to  promote  the  implementation  of 
research  in  classrooms,  more  could  be  done  to  attract  el- 
ementary and  high  school  educators  and  to  facilitate  com- 
munication between  practitioners  and  researchers." 

John  Kennedy , 1984-85 
The  Ohio  Stale  University 

“I  remember  bringing  the  conference  to  the  Bismarck 
Hotel  in  Chicago  for  the  first  time.  The  conference  had  heen 
held  in  various  places  up  until  then.  At  that  time  it  was  easy 


to  gel  accommodations  in  Chicago  but  the  plane  fares  were 
expensive.  Plane  fares  have  gone  down  so  it  is  now  a tradi- 
tion for  MWERA  to  be  held  in  Chicago, 

“Also,  I launched  membership  drive  that  brought  in 
some  key  people  such  as  Bob  Brennan,  Isadore  Newman, 
Don  Cruickshank,  and  Ayres  D’Costa.  The  conference  that 
year  was  attended  by  about  250  people. 

“MWERA  should  stay  in  Chicago.  Furthermore,  I en- 
courage the  organization  to  maintain  its  commitment  to  the 
presentation  of  data-based  research.  Avoid  being  overly  en- 
amored with  newer  non-cmpirical  research  strategies,  as  qual- 
ity will  suffer.  Non-data-bascd  research  is  like  intellectual 
cancer:  we  have  to  live  with  it  for  a while,  but  eventually  we 
must  get  rid  of  it.  It  must  be  contained  and  quarantined  to 
limit  the  degree  of  its  penetration.  MWERA  must  keep,  pro- 
mote, and  expand  a forum  that  presents  data-based  research. 
Respect  for  MWERA  will  grow,  unfortunately  at  the  expense 
of  AERA  and  other  organizations,  which  arc  being  clutched 
by  vacuous,  non-data-based  research." 

Isadore  Newman , 1988-89 
University  of  Akron 

“I  don’t  know  if  this  is  a highlight  (to  some  it  may  be). 
As  Program  Chair,  it  was  the  first  time  I experienced  total 
and  complete  academic  panic.  I totally  closed  down  for  a 
couple  of  hours.  It  was  from  this  experience  that  I learned 
to  be  more  appreciative  and  sensitive  to  what  program  chairs 
have  to  do  and  less  critical  of  minor  errors.  I learned  that 
people  like  Dennis  Leilner,  Ayres  D’Costa  and  Greg 
Marchant  are  some  of  the  most  supportive  people  I have 
ever  had  the  pleasure  of  working  with.  Another  highlight 
was  the  conceptualization  of  the  MWERA  journal  in  its 
present  format  by  Greg  and  myself.  I believe  it  would  not 
have  come  to  fruition  without  the  support  of  the  Executive 
Committee,  especially  Dennis  Leitner. 
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“I  think  the  MWERA  is  a wonderful  organization  to 
mentor  students  as  well  as  new  faculty  into  the  research  cul- 
ture, introducing  them  on  a first  name  basis  to  some  of  the 
leading  figures  in  the  world.  I would  like  the  organization 
to  support  these  informal  get  togethers-dinners,  conversa- 
tions, and  chat  hours  between  such  figures  and  our  mem- 
bership, especially  new  mentees 

Dennis  W.  Leitner,  1989-90 

Southern  Illinois  University  at  Carbondale 

“Sometime  during  my  ‘tour  of  duty,1  I got  tired  of  re- 
ceiving the  annual  billet-dous  (rhymes  with  ‘bill-is-due’) 
from  our  distinguished  Executive  Officer,  Charles  Ander- 
son, requesting  my  annual  dues.  So  I simply  threw  him  a 
check  for  ten  times  the  annual  dues  and  told  him  to  save  the 
postage.  If  you  know  Charles,  you  know  how  much  he  an- 
guished over  where  to  put  the  money.  After  two  or  three 
years  and  a revision  to  the  MWERA  by-laws,  we  now  have 
the  opportunity  for  LIFETIME  membership  in  MWERA  and 
37  people  (as  of  October  1996)  have  taken  advantage  of  it. 
Hopefully  this  will  provide  a type  of  financial  security  for 
MWERA  for  many  years  to  come.” 

Ayres  D’Costa,  1990-91 
The  Ohio  State  University 

“MWERA  has  evolved  through  some  little-publicized 
crises  over  the  years,  although  its  good  qualities  have  per- 
sisted despite  these  crises  or  perhaps  because  of  them.  One 
MWERA  crisis  had  to  do  with  its  journal.  The  old  mem- 
bership dues  were  insufficient  to  support  a journal  and  it 
was  also  a newsletter.  This  issue  had  caused  many  a heated 
debate  among  Board  members  and  prior  presidents.  Dur- 
ing my  tenure  on  the  Board,  we  presented  our  needs  to  the 
membership  and  received  strong  support  to  increase  dues 
and  to  continue  support  for  a professional  journal  under  the 
able  leadership  of  the  new  editors,  Isadore  Newman  and 
Greg  Marchant. 

“The  money  allocated  to  the  Journal  was  usually  not 
sufficient,  and  it  was  therefore  up  to  the  editors  to  find  ways 
to  supplement  their  budget.  Incidentally,  this  was  also  a 
problem  faced  by  incoming  program  chairs.  It  would  seem 
that  one  of  the  skills  needed  by  editors  and  program  chairs 
was  creative  financing.  Izzy  found  a supportive  dean  at  the 
University  of  Akron,  each  of  the  two  editors  found  other 
support  in  their  respective  departments,  and  a brand  new 
journal  concept  was  born.  Incidentally,  the  idea  of  selling  a 
cover  photo  and  write-up  to  a university  for  a small  fee  was 
part  of  this  creative  financing  scheme.  Also  emerging  was 
the  raising  of  money  through  publisher  ads  in  the  Journal 
and  exhibits  at  the  conference,  a scheme  that  Sharon 
McNeely  (current  president)  made  successful  through  her 
contact  work  with  publisher  representatives. 

“In  my  term  as  editor,  I found  similar  financial  support 
for  the  Journal,  most  prominent  of  which  was  Dean  Zimphcr's 
(The  Ohio  Stale  University)  grant  to  MWERAs  journal.  I 
hope  that  the  concept  of  a professional  journal  will  be  em- 


bedded in  MWERA  and  continue  to  receive  support  in  the 
future.  We  deserve  to  hold  our  heads  high  among  our  profes- 
sional communities,  and  our  journal  will  help  us  do  that. 

“One  of  the  endearing  privileges  I enjoyed  as  an  officer  of 
MWERA  was  the  trust  and  support  that  I received  from  mem- 
bers and  other  officers.  As  Program  Chair  and  later  in  another 
leadership  role  as  President,  there  was  never  a concern  in  my 
heart  that  my  motivation  or  dedication  were  ever  questioned. 
Past  presidents  would  come  to  tell  me  that  they  felt  good  about 
what  we  were  doing  for  MWERA,  and  that  a cardinal  rule  was 
for  the  old  guard  to  give  way  to  the  new  so  that  creativity  was 
never  stifled.  This  is  the  essence  of  my  suggestions  to  the  new 
Board.  Develop  this  trust  in  your  newer  officers  so  that  they 
can  pass  on  this  wonderful  torch  of  faith  to  their  colleagues. 
Trust  will  beget  trust,  and  I pray  that  MWERA  will  remain  small 
enough  to  retain  this  trusting  and  supportive  environment  as  its 
primary  organizational  quality.” 

Barbara  S.  Flake , 1991-92 
University  of  Nebraska,  Lincoln 

“I  recall  the  transition  of  our  research  publication  to  the 
Mid-Western  Educational  Researcher , thanks  in  great  part 
to  the  creative  ingenuity  of  Isadore  Newman  and  Greg 
Marchant.  The  quality  and  appearance  of  the  publication 
improved  dramatically! 

“Also,  we  implemented  a plan  to  encourage  more  par- 
ticipation by  graduate  students  in  the  annual  business  meet- 
ing. We  offered  a free  year  of  membership  through  raffle  at 
the  business  meeting  with  the  goal  to  encourage  more  gradu- 
ate students  to  attend  the  meeting.  However,  the  person 
whose  name  was  drawn  wasn’t  at  the  business  meeting!  It 
seemed  counter-productive  to  the  goal  of  encoura?.  :ng  more 
graduate  students  to  attend  the  meeting  to  award  the  prize  to 
someone  who  wasn’t  in  attendance.  But  we  did  anyway! 

“What  sticks  in  my  mind  about  the  organization  is  the  people 
who  constitute  the  organization.  So  many  supportive  folks! 
During  my  term  as  an  officer,  I suffered  some  very  severe  fam- 
ily crises  and  the  members  of  the  organization  were  wonder- 
fully supportive  and  helpful.  One  time  the  Board  of  Directors 
met  in  Lincoln,  Nebraska,  in  the  dead  of  winter  to  accommo- 
date my  restrictions  on  travel  due  to  family  constraints. 

“I  like  to  encourage  my  graduate  students  to  attend  the 
meetings  because  I know  they  will  be  treated  with  respect 
and  they  will  get  an  excellent  orientation  into  attending  and 
presenting  at  conferences.” 

Ken  Kiewera , 1992-93 
University  of  Nebraska,  Lincoln 

“What  was  most  memorable  was  organizing  the  confer- 
ence with  the  Executive  Committee.  We  made  some  changes 
and  tried  some  new  things.  Typically,  we  had  a keynote 
speaker  and  guest  speaker.  We  wanted  to  have  a slate  of 
invited  speakers  so  we  invited  Carol  Ames,  Michael  Pressley, 
and  Joel  Levin.  It’s  nice  to  sec  that  many  of  the  new  things 
we  tried  have  continued.  Also,  I had  a hand  in  assembling  a 


the  expense  down  was  important.  Many  people  had  strong 
feelings  for  the  nostalgia  of  the  Bismarck,  but  others  viewed 
it  as  a run  down  sleaze  pit.  Thus  the  change  was  accomplished 
with  much  soul-searching.  It  turns  out  to  have  been  a good 
decision,  especially  since  the  Bismarck  is  closing,  I hear. 

“The  IRS-tax  fiasco  was  also  a traumatic  experience. 
Essentially  we  thought  we  might  be  liable  for  considerable 
back  taxes.  As  it  turned  out,  we  had  tax  exempt  status  all 
along.  The  import,  maybe,  of  the  event  was,  don’t  worry 
too  much  until  you  are  sure  of  the  facts. 

‘The  most  memorable  events  of  the  past  few  MWERA 
conferences  for  me  have  been  the  quality  of  the  invited  speak- 
ers. Mike  Pressley,  Joel  Levin,  John  Bransford,  Jere  Brophy, 
Carol  Shakeshaft,  Carol  Ames,  Robert  Slav  in,  and  many  oth- 
ers have  given  exceptionally  fine  talks  which  extend  the  mem- 
berships’ knowledge  about  currently  important  events  and  issues 
in  educational  research.  After  the  trials  and  tribulations  of  com- 
mittee meetings,  faculty  meetings,  territorial  battles,  and  the 
other  minutia  of  faculty  life,  it  is  nice  to  be  reminded  of  the 
intellectual  elegance  that  attracted  one  to  this  profession.” 

Greg  Marchant,  1995-96 
Ball  State  University 


team  of  editors  and  I felt  really  good  about  that.  They  did  a 
great  job  of  taking  over  the  responsibility  from  Izzy. 

“We  should  keep  MWERA  our  own.  We  should  keep  it 
intimate,  unassuming  and  down-home.  It’s  a place  for  grad 
students  the  cut  their  teeth.  On  the  other  hand,  we  need  to  bring 
in  the  Big  Guns,  the  role  models  who  will  both  inform  and 
inspire  us.  I remember  my  having  a beer  with  Michael  Pressley 
in  the  lounge  and  learning  so  much  about  his  work.  I like  that 
we’re  concerned  about  taking  care  of  ‘our  own’  but  we  need  to 
get  a sense  of  prominent  ideas  that  are  out  there  and  how  the 
people  behind  these  ideas  go  about  doing  their  work.  MWERA 
is  where  we  rub  shoulders  with  the  big  names  in  our  field.” 

Richard  Pugh,  1993-94 
Indiana  University 

“My  memories  of  my  year  as  President  are  many  and 
were  very  professionally  rewarding.  The  number-one  high- 
light during  my  year  as  President  was  launching  the  histori- 
cal study  of  MWERA.  I remember  writing  the  RFP  and 
publishing  it  in  the  Mid-  Western  Educational  Researcher . I 
remember  appointing  a review  committee  to  consider  the 
proposals  which  we  received.  I remember  notifying  Terri 
Strand  that  her  proposal  was  the  one  selected  by  the  Review 
Committee.  The  presentation  from  the  study  by  Terri  at  the 
recent  annual  meeting  and  the  scheduling  of  a symposium 
on  the  historical  study  followed. 

“The  second  event  that  I remember  the  most  was  re- 
ceiving a phone  call  from  Charles  Anderson,  one  day.  He 
called  to  tell  me  that  he  had  become  ill  and  cbuld  not  con- 
tinue as  Executive  Officer.  After  our  conversation,  it  was 
evident  that  we  needed  to  move  ahead  and  identify  a new 
Executive  Officer.  I gave  a sigh  of  relief  when  I checked  the 
by-laws  and  found  that  the  MWERA  constitutional  repre- 
sentatives had  anticipated  such  an  event  and  had  included  in 
the  by-laws  the  procedural  steps  for  identifying  an  Execu- 
tive Officer.  Following  these  procedures,  the  President  and 
MWERA  were  permitted  to  move  smoothly  through  the  pro- 
cess of  appointing  Jean  Pierce  as  the  new  Executive  Officer. 
I wish  to  thank  the  constitutional  representatives  who  had 
developed  the  procedures  and  thank  Jean  Pierce  for  accept- 
ing the  offer  and  skillfully  handling  a transition  period  as 
the  responsibilities  shifted  to  her. 

“My  suggestions  ‘from  the  heart’. are  to  keep  the  invited 
speakers  in  the  program.  They  are  the  standard-setters.  Keep 
the  sessions  which  fall  under  the  category  of  social:  the  Cracker 
Barrel,  President’s  Reception,  and  luncheon.  These  arc  part 
of  the  MWERA  icon.  Finally,  always  try  new  things  at  the 
annual  meeting.  Take  a chance;  be  a risk  taker!” 

Thomas  Andre , 1994-95 
Iowa  State  University 

‘The  major  event  was  the  change  in  hotel.  The  Bis- 
marck had  been  our  home  and,  more  importantly,  offered 
cheap  hotel  rates  in  the  downtown  area.  As  MWERA  is  a 
second  and  unfunded  conference  for  many  people,  keeping 


“Six  years  ago  the  first  issue  of  the  Mid- Western  Edu- 
cational Researcher  was  published  as  a journal  instead  of  a 
newsletter.  Isadore  Newman  and  I took  on  the  task  as  edi- 
tors to  create  a journal  that  contained  articles  and  features 
that  would  be  ‘user-friendly*  to  our  membership.  Three  years 
later  Ayres  D’Costa,  Susan  Brookhart,  and  John  Surber  took 
the  reins.  It  fell  upon  me,  as  my  first  major  decision  as  Presi- 
dent, to  appoint  the  next  editors.  After  careful  review  of 
proposals  and  approval  of  the  Board  of  Directors,  I appointed 
the  team  that  produced  this,  their  first  issue:  Deb  Bainer, 
Richard  Smith,  and  Gene  Kramer. 

“Probably  some  of  the  most  memorable  events  for  any 
MWERA  President  actually  occurred  two  years  earlier  dur- 
ing the  term  as  Vice-President/Program  Chair.  The  confer- 
ence which  I organized  two  years  ago  included  some  of  the 
biggest  names  in  educational  research  and  attracted  over  400 
members,  the  largest  attendance  ever  for  a MWERA  annual 
meeting.  It  was  also  during  that  conference  that  the  need  to 
change  hotels  became  solidified.  It  was  gratifying  to  have 
the  first  annual  meeting  at  the  Holiday  Inn  Mart  Plaza  dur- 
ing my  presidency,  and  for  it  to  be  such  a success. 

“I  guess  my  suggestions  for  MWERA  is  not  that  differ- 
ent than  those  I would  have  for  any  organization,  depart- 
ment, or  group.  Know  and  respect  your  history,  but  dare  to 
be  bold  in  new  attempts.  Work  to  facilitate  inclusion,  rather 
than  practice  exclusion.  Trust  people  to  do  their  best  and 
what  is  right  until  they  prove  otherwise.  Never  underesti- 
mate the  possibility  that  things  can  go  wrong;  but  if  it  isn’t 
broken,  don’t  fix  it.  Remember  that  people  are  people,  to 
be  respected  as  professionals  and  cared  for  as  friends.  I 
believe  that  MWERA  already  operates  with  these  sugges- 
tions in  mind.  It  is  my  hope  that  the  Association  will  con- 
tinue to  attract  members  who  will  carry  on  this  tradition.” 
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Call  for  Manuscripts 


The  Mid-Western  Educational  Researcher  is  a scholarly  journal  that  pub- 
lishes research-based  articles  addressing  a full  range  of  educational  issues.  The 
journal  also  publishes  literature  reviews,  theoretical  and  methodological  discus- 
sions that  make  an  original  contribution  to  the  research  literature,  and  feature 
columns.  There  are  four  issues  of  the  journal  published  annually. 

The  journal  is  now  accepting  manuscripts  for  review  and  possible  publica- 
tion in  1997  and  beyond.  Manuscripts  are  submitted  to  blind  reviews  by  at  least 
two  researchers  with  knowledge  of  the  literature  in  the  appropriate  area.  Further- 
more, the  editors  will  review  the  manuscript  and  make  the  final  decision.  The 
review  process  requires  approximately  three  months. 

Manuscripts  are  accepted  from  faculty,  students,  and  professionals  working 
in  non-educational  settings.  Membership  in  the  MWERA  is  not  required  in  order 
to  submit  a manuscript  for  review.  The  editors  encourage  the  submission  of 
revised  papers  that  have  been  presented  at  the  annual  meetings  of  the  MWERA, 
AERA,  and  other  professional  organizations. 

Submit  four  (4)  copies  of  the  manuscript  with  a cover  letter  to  Deborah  L. 
Bainer  (see  address  in  left  margin).  Manuscripts  should  conform  to  the  style  and 
format  described  in  the  Publication  Manual  of  the  American  Psychological  As- 
sociation , 4th  edition.  All  manuscripts  should  be  typed,  double  spaced,  on  8 1/2 
x 11  paper  with  1 1/2  inch  margins  on  all  sides.  An  abstract  of  less  than  100 
words  should  accompany  the  manuscript.  The  author’s  name  and  affiliation  should 
appear  on  the  title  page  only.  Submissions  typically  are  less  than  20  pages  in 
length.  If  the  manuscript  is  accepted  for  publication,  the  author(s)  will  be  asked 
to  provide  a disk  file  (WP  5. 1 or  higher  on  a 3 1/2  inch  high  density  IBM  format- 
ted disk)  as  well  as  a printed  copy  of  the  final  version.  Please  note  that  the 
editors  reserve  the  right  to  make  minor  modifications  in  order  to  produce  a con- 
cise and  clear  article. 

Questions  regarding  the  journal  or  the  submission  of  feature  columns  should 
be  directed  to  the  editors. 

Deborah  L.  Bainer  (419)  755-4287  bainer.  1 @osu.edu 
Gene  A.  Kramer  (312)  440-2684  kramerg@ada.org 
Richard  M.  Smith  (630)  462-4102  jomca@rfi.org 
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A Field-Based  Introduction  to  Urban  Education  at  the  Middle  School 


Susan  M.  Brookhart 

School  of  Education,  Duquesnc  University 

Abstract 

Middle  school  teachers  developed  objectives  and  suggested  activities  for  a pilot  early  field  experience  to 
introduce  freshman  teacher  candidates  to  urban  education  at  the  middle  school  level . This  paper  presents 
these  objectives  and  activities  plus  data  about  the  effects  of  their  use  by  15  teachers  and  22  freshmen;  an 
additional  30  freshmen  placed  in  a traditional  (tutoring)  early  field  experience  formed  a comparison  group. 
Project fnshmen  demonstrated  higher  sense  of  personal  teaching  efficacy  and  flexibility  among  people  in  a 
multicultural  setting.  In  their  journals,  project  freshmen  reported  more  awareness  of  the  urban  environment; 
however,  comparison  group  freshmen  were  more  likely  to  report  a sense  of  accomplishment.  The  project 
experience  seems  to  have  provided  a “ big  picture  ” introduction  to  urban  education,  while  the  traditional 
experience  gave  students  a taste  of  success  at  one  small  teaching  task. 


The  needs  of  urban  schools  have  made  headlines,  prompted 
national  and  state  funding  initiatives,  and  caused  changes  in 
teacher  education  requirements,  especially  in  the  area  of 
multicultural  education  (Houston  & Newman,  1982).  School- 
university  collaboration  can  be  a powerful  strategy  for  educa- 
tional renewal  (Sirotnik  & Goodlad,  1988).  Because  of  the 
high  priority  of  both  collaboration  and  urban  education  in  the 
field  at  the  present  time,  there  is  a sizeable  descriptive  literature 
on  these  topics.  However,  educators  are  just  beginning  to  de- 
velop a research  base  in  these  areas.  This  study  contributes  to 
that  research  base. 

Changes  in  current  field  experiences  are  necessary  in  or- 
der to  better  prepare  teachers  for  urban  settings  (Meade,  1991). 
This  project  had  practicing  teachers  at  an  urban  middle  school 
design  objectives  and  activities  to  help  freshmen  at  an  urban 
university  learn  about  “understanding  what  it  means  to  be  com- 
mitted to  education,”  as  the  principal  remarked.  The  rationale 
behind  this  collaborative  project  was  that  the  teachers’  collec- 
tive expertise  was  an  excellent  source  for  an  answer  to  the  ques- 
tion, “What  should  entering  teacher  candidates  sec,  do,  and  learn 
in  an  early  field  experience?”  Desired  student  outcomes  in- 
cluded professed  willingness  or  desire  to  teach  in  an  urban  set- 
ting, understanding  of  culturally  diverse  pupil  populations,  and 
appreciation  of  methods  and  teaching  skills  appropriate  for  ur- 
ban middle  school  pupils. 

This  paper  reports  on  the  project's  effects.  The  study  was 
guided  by  the  following  research  questions: 

1 . What  objectives  and  activities  did  the  urban  middle  school 
teachers  design  for  the  early  field  experience? 

2.  What  were  the  (a)  level  of  commitment  to  teaching, 
(b)  willingness  to  work  in  an  urban  setting,  (c)  sense 
of  teaching  efficacy,  and  (d)  flexibility  in  a multicultural 
setting  among  freshmen  who  participated  in  the  col- 
laborative program?  Did  these  levels  differ  from  fresh- 
men who  participated  in  the  regular  field  experience, 
a tutoring  assignment  in  the  same  district  ? 

3.  What  lcamings/bcncfits  and  difficultics/problcms  did  the 
collaborating  teachers  report,  after  the  early  field  experi- 
ence project,  ior (a)  the  participating  freshmen,  (h)  the  middle 


school  pupils,  and  (c)  the  teachers  themselves?  What  did 

the  freshmen  describe  as  their  learnings  and  difficulties? 

Until  the  mid-1970s,  early  field  experiences  were  not  very 
common  (Houston  & Newman,  1 982).  Students  were  not  placed 
in  the  field  until  student  teaching.  Early  field  experiences  are 
now  quite  common,  both  for  the  professional  training  they  of- 
fer and  for  their  usefulness  in  career  guidance.  In  many  places, 
they  are  required  for  licensing  the  teacher  education  program. 
In  principle,  students  can  decide  whether  they  really  do  want  to 
be  teachers  and  can  begin  to  develop  professional  skills. 

But  early  field  experiences  differ  considerably  (Applegate 
&Lasley,  1983),  and  the  substance  of  field  experience  is  more 
important  than  the  length  of  time  spent  in  the  field  (McIntyre, 
Byrd,  & Foxx,  1996).  School-university  collaboration  is  not  as 
common  at  the  early  field  experience  level  as  at  the  student 
teaching  level  (Sirotnik  & Goodlad,  1988).  Therefore,  the  first 
research  question  called  for  a simple  description.  It  was  in- 
structive to  find  out  what  successful  urban  middle  school  teach- 
ers defined  as  the  important  “first  points”  to  introduce  to 
freshmen  and  how  they  proposed  to  proceed. 

The  effects  of  early  field  experiences  on  general  attitudes 
arc  positive  (Samson,  Borgcr,  Weinstein,  & Walberg,  1984). 
Preservice  teachers  expect  to  gain  practical  insights  and  enjoy 
student  contact  during  early  field  experiences  (Applegate  & 
Laslcy-,  1983).  It  is  not  clear  what  effects,  if  any,  early  field 
experience  has  on  career  choice  (Anderson.  1987;  Willems, 
Brown,  & Arth,  1982).  There  is  evidence  that  multicultural 
content  courses  effectively  change  both  knowledge  about  di- 
versity and  attitudes  toward  persons  who  represent  various  ra- 
cial or  ethnic  groups  (Bennett,  Niggle,  & Stage,  1990). 

Two  studies  reported  the  effects  of  school-university  col- 
laborative urban  teacher  training  programs  at  the  student  teach- 
ing level  on  willingness  to  teach  in  an  urban  setting.  McCormick 
(1990)  reported  47%  of  graduates  of  one  mid  western  univer- 
sity who  had  participated  in  the  Cooperative  Urban  Teacher 
Education  Program  in  Kansas  City  were  currently  teaching,  and 
46%  of  those  were  teaching  in  cities  of  more  than  50,000  people. 
Stallings  and  Martin  ( 1988)  reported  that  urban  Teaching  Acad- 
emy graduates  were  more  likely  than  comparable  graduates  of 
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the  regular  teacher  education  program  to  want  to  teach  in  an 
urban  setting.  This  variable,  willingness  to  teach  in  an  urban 
setting,  is  also  important  at  the  career  choice  level  and  is  appro- 
priate to  examine  in  the  early  field  experience. 

Sense  of  teaching  efficacy  has  been  included  as  a variable 
in  this  study.  There  is  evidence  that  teachers  who  expect  their 
teaching  to  make  a difference  in  student  learning  are  those  who 
are,  in  fact,  effective  teachers  (Ashton  & Webb,  1986).  Teach- 
ers who  do  not  believe  they  can  make  a difference  are  not  likely 
to  trust  students  or  support  student  problem-solving,  but  they 
are  likely  to  believe  that  external  rewards  arc  necessary  to  con- 
trol student  behavior  (Woolfolk,  Rosoff,  & Hoy,  1990).  These 
beliefs  are  antithetical  to  a classroom  environment  where  all 
students  can  maintain  dignity  and  develop  self-esteem.  One 
reason  urban  teaching  may  be  difficult  is  that  it  is  hard  to  de- 
velop a sense  of  teaching  efficacy  in  the  face  of  urban  poverty 
and  alienation.  One  of  the  goals  of  this  early  field  experience 
was  to  expose  students  to  committed  urban  teachers,  to  help 
develop  commitment  and  a sense  of  efficacy  among  the  teacher 
candidates. 

Method 

Sample 

The  urban  middle  school  chosen  for  this  study  was  se- 
lected because  it  had  an  enthusiastic  teaching  staff  and  princi- 
pal and  a diverse  student  body,  and  it  was  located  in  an  inner-city 
neighborhood  near  the  university.  The  school  served  about  860 
students,  approximately  60%  African-American  and  40%  white, 
with  a staff  of  64  teachers  and  over  40  administrators  and  sup- 
port staff.  The  investigator  secured  the  commitment  of  the 
school  principal  before  beginning  the  study. 

In  February,  nine  teachers  and  the  investigator  met  for  a 
two-hour  workshop.  The  teachers  volunteered  to  participate  in 
the  project  and  were  compensated  for  their  work.  All  had  at 
least  two  years  of  experience  at  the  school.  The  teachers  did 
brainstorming,  then  prioritizing,  and  finally  summarizing  ac- 
tivities; the  results  were  3 objectives  and  7 suggested  activities 
for  22  freshmen  Introduction  to  Education  students  who  would 
make  10  2-hour  visits  (in  March  and  April)  to  the  middjc  school 
as  part  of  their  assigned  course  work.  These  freshmen  consti- 
tuted the  project  group. 

The  comparison  group  consisted  of  30  freshmen  enrolled 
in  the  same  Introduction  to  Education  course,  who  made  10  2- 
hour  visits  to  other  schools  in  the  same  urban  district,  Pitts- 
burgh Public  Schools.  These  students  were  placed  mostly  in 
fourth  or  fifth  grades  at  elementary  schools;  the  logistics  of  place- 
ment made  it  impossible  to  confine  the  entire  cohort  of  fresh- 
men to  middle  schools.  All  of  the  elementary  schools  in  which 
the  comparison  group  freshmen  were  placed  had  diverse  stu- 
dent populations.  For  their  early  field  experience,  comi  arison 
group  freshmen  were  assigned  to  work  as  tutors  at  the  discre- 
tion of  the  host  teacher  or  principal.  Typically,  freshmen  would 
be  assigned  one  or  two  students  at  a time  and  given  a place  in  a 
hallway  or  empty  room.  The  teacher  would  provide  materials 
on  which  the  pupils  required  remediation:  stories  or  text  chap- 


ters the  pupils  had  difficulty  reading,  homework  or  worksheets 
the  pupils  could  not  complete,  and  the  like.  The  purpose  of 
most  of  the  comparison  group’s  tutoring  assignments  was  to 
help  the  pupils  keep  up  or  catch  up  with  the  class,  or  at  least  to 
make  progress  in  that  direction. 

This  study  thus  had  two  samples:  (a)  1 5 middle  school 
teachers,  9 of  whom  designed  the  project  field  experience  (8 
white  and  7 minority,  1 1 female  and  4 male),  and  (b)  52  fresh- 
men enrolled  in  Introduction  to  Education  who  were  assigned 
a field  experience  in  a large  urban  school  district  (5 1 white  and 
1 minority,  44  female  and  8 male). 

Data  Sources  and  Analysis 

Data  to  answer  the  first  research  question  consisted  of  the 
newsprint  brainstorm  sheets  used  in  the  teacher  workshop  and 
the  summary  objectives  and  activities  on  which  the  teachers 
agreed.  The  brainstorm  session  was  driven  by  the  questions: 
“What  should  entering  teacher  candidates  learn  in  an  early  field 
experience  in  an  urban  middle  school?”  and  “What  activities 
and  experiences  should  help  them  accomplish  these  objectives?” 

Data  to  answer  the  second  research  question  included  quan- 
titative indicators  of  (a)  level  of  commitment  to  teaching,  (b) 
willingness  to  work  in  an  urban  setting,  (c)  sense  of  teaching 
efficacy,  and  (d)  flexibility  in  a multicultural  setting.  The  fresh- 
men responded  to  paper-and-pencil  surveys  before  and  after 
their  field  experience;  50  provided  complete  enough  data  for 
analysis.  The  commitment  and  willingness  indicators  were 
single  items  on  the  Entering  Teacher  Candidates  Survey  (Free- 
man, 1983;  West  & Brousseau,  1987).  The  efficacy  measures 
used  were  two  scaled  items,  measuring  general  and  personal 
teaching  efficacy,  respectively,  developed  by  the  RAND  cor- 
poration (Ashton  & Webb,  1986;  Berman  & McLaughlin,  1977; 
Woolfolk  et  al.,  1990).  The  measures  of  flexibility  in  a 
multicultural  setting  were  two  five-item  scales  (Flexibility  in 
Instruction  and  Flexibility  with  People)  developed  for  this  study 
from  the  Edwards  Personal  Preference  Scale  (Edwards,  1953). 
Reliability  (alpha)  for  the  Flexibility  in  Instruction  scale  was 
.80  for  the  pretest  and  .82  for  the  posttest.  Reliability  for  the 
Flexibility  with  People  scale  was  .72  for  the  pretest  and  .87  for 
the  posttest.  Each  of  the  scaled  indicator  variables  was  ana- 
lyzed with  a two-factor,  mixed  design  ANOVA:  factors  were 
time  (pretest/posttest)  and  site  (project  sitc/other  site).  Mul- 
tiple choice  indicators  were  analyzed  with  chi-square  tests  of 
homogeneity  by  site. 

Data  to  answer  the  third  research  question  came  from  ver- 
batim transcripts  of  audiotaped  exit  interviews  of  the  1 5 middle 
school  teachers  and  from  written  field  site  logs  the  freshmen 
were  assigned  to  keep.  Content  analysis  was  done  by  category 
of  comment  (lcaming/bcncfit  or  difficulty/problem)  and  cat- 
egory' of  reference  (teacher,  freshman,  or  middle  school  pupil), 
thus  forming  six  cells  for  analysis.  Within  these  categories, 
subcatcgorics  were  developed  using  the  constant  comparative 
method  (Glaser  & Strauss,  1967).  Two  researchers,  the  author 
and  a graduate  assistant,  coded  the  data  and  discussed  discrep- 
ancies to  achieve  consensus. 
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Results 


Outcome  Variables 


Objectives  and  Activities 

Table  1 shows  the  objectives  and  activities  the  teachers 
planned.  These  objectives  are  notably  broad  and  comprehen- 
sive. The  teachers  were  concerned  that  students  experience  in- 
terpersonal relations  with  a diverse  group  of  pupils,  and  they 
listed  this  as  the  first  and  most  important  objective.  Addition- 
ally, they  wanted  students  to  be  introduced  to  some  instructional, 
practical,  and  management  concepts.  These  teacher-written  ob- 
jectives are  remarkably  similar  to  the  recommendations  of  Meade 
( 199 1)  for  reshaping  the  clinical  portion  of  teacher  education  to 
better  prepare  teachers  for  urban  settings. 

Table  1 

Objectives  and  Activities  Planned  by  Nine  Teachers  for  intro- 
ducing Early  Field  Experience  Students  to  an  Urban  Middle 
School 

Objectives: 

1.  The  early  field  experience  candidate  will  recognize  the 
importance  of  genuine  concern  for  each  student  as  a per- 
son and  participate  in  interactions  with  students. 

2.  The  early  field  experience  candidate  will  observe  the  or- 
ganizational aspects  of  the  school  and  teaching  and  the 
relationship  of  organization  to  content  area  proficiency. 

3.  The  early  field  experience  candidate  will  have  some 
“hands-on”  experience  in  the  classroom,  including  an  ori- 
entation to  the  concept  of  discipline  with  dignity. 

Suggested  Activities  (a  partial  list  of  things  the  early  field  ex- 
perience candidates  might  do  to  achieve  these  objectives): 

1 . observe  different  classes  and  students  in  different  groups, 
make  anecdotal  notes 

2.  make  notes  on  teacher-student  interactions 

3.  observe  an  academic  class,  noting  the  objective  on  the 
board,  classroom  activities,  and  student  reactions 

4.  make  a list  of  possible  ways  to  handle  discipline  in  a 
positive  way 

5.  keep  a journal  of  observations  of  positive  discipline 

6.  tutor  an  individual  student  or  a small  group 

7.  assist  in  the  classroom,  then  get  feedback  from  the  teacher 
and  an  opportunity  to  ask  questions 


What  the  teachers  meant  by  “organizational"  matters  were 
the  practical,  daily,  operational  routines:  taking  attendance, 
grading,  completing  paperwork,  scheduling,  collecting  and  du- 
plicating materials,  etc.  What  they  meant  by  “hands-on"  expe- 
rience was  that  the  freshmen  were  to  perform  some  of  these 
functions,  not  just  observe  die  teacher  doing  them.  These  clari- 
fications came  from  the  workshop  session. 


Level  of  commitment  to  teaching  was  high  both  before 
and  after  the  field  experience  for  both  project  and  comparison 
group  freshmen  (Table  2).  No  differences  were  found  for  site, 
time,  or  their  interaction. 

Table  2 

Level  of  Commitment  to  Teaching,  Project  and  Comparison 
Group  Students  Combined 


Item:  Which  of  the  following  best  describes  where  teaching  fits  into 
your  current  career  plans? 


Choice 

Pretest 

Posttest 

1 . Classroom  teaching  is  the  only  career 

fm  considering 

19(40%)  19(38%) 

2.  First  choice  of  careers  I’m  considering 

25  (53%)  25  (50%) 

3.  Has  some  appeal  but  not  first  choice 

3 (6%) 

3 (6%) 

4.  I do  not  intend  to  become  a 

classroom  teacher 

0 (0%) 

3 (6%) 

Total 

47 

50 

Willingness  to  work  in  an  urban  setting  was  low  both  be- 
fore and  after  field  experience  for  both  project  and  comparison 
group  freshmen  (Table  3).  There  were  no  differences  between 
project  and  comparison  group  responses  for  either  pretest  or 
posttest  measures. 

Table  3 

Willingness  to  Work  in  an  Urban  Setting , Project  and  Com- 
parison Group  Students  Combined 


Item:  Which  of  the  following  best  describes  the  school  setting  in 
which  you  would  prefer  to  work? 


Choice 

Pretest 

Posttest 

1.  Inner  city/Urban 

4 (9%) 

6(13%) 

2.  Suburban 

27  (60%) 

24  (53%) 

3.  Rural 

2 (4%) 

2 (4%) 

4.  No  preference 

12(27%) 

13(29%) 

Total 

45 

45 

Sense  of  teaching  efficacy  was  measured  with  two  items 
(Table  4).  Sense  of  general  teaching  efficacy  was  measured  by 
responses  to  “When  it  comes  right  down  to  it,  a teacher  really 
can’t  do  much  because  most  of  a student’s  modvation  and  per- 
formance depends  on  his  or  her  home  environment;”  the  scale 
for  this  item  was  l=strongly  agree  through  5=strongly  disagree. 
Sense  of  general  teaching  efficacy  was  moderately  high  for  both 
groups  and  unchanged  after  the  field  experience.  Sense  of  per- 
sonal teaching  efficacy  was  measured  by  responses  to  “If  I try 
really  hard,  I can  get  through  to  even  the  most  difficult  or  un- 
motivated students;”  the  scale  for  this  item  was  l=strongly  dis- 
agree * o 5=strongly  agree.  Sense  of  personal  teaching  efficacy 
was  high  for  both  groups.  This  variable  was  higher  after  the 
field  experience  for  the  project  group  and  unchanged  for  the 
comparison  group,  although  the  statistical  significance  of  this 
interaction  was  marginal. 
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Tabic  4 

Means  ( Standard  Deviations)  and  AN  OVA  Results  for  Sense 
of  Teaching  Efficacy 

Site  Pre  Post  n 

General  Teaching  Efficacy 

Other  3.89  (.8)  3.89  (1.1)  26 

Project  3.74  (.8)  3.79  (1.4)  19 

Effect  for  Site:  F(  1,43)  = .29 

Effect  for  Time:  F(  1 ,43)  = .02 

Site  X Time  F(  1,43)  = .02 

Personal  Teaching  Efficacy 

Other  '3.96  (.7)  3.89  (1.1)  26 

Project  3.74  (.9)  4,16(1.0)  19 

Effect  for  Site:  F(  1,43)  = .92 

Effect  for  Time:  F(  1,43)  =1.62 

Site  X Time:  F(  1 ,43)  = 3.40,  p=.07 

Note:  Scale:  1 =low,  5=high 

Flexibility  in  a multicultural  setting  was  measured  with 
two  different  summated  rating  scales  (l=never  true  of  me  to 
7=aiways  true  of  me)  of  Five  items  each  (Table  5).  Flexibility 
in  Instruction  items  included  “I  like  to  try  new  and  different 
instructional  methods,”  “I  like  to  present  the  same  classroom 
topics  several  different  ways,”  and  the  like.  Flexibility  with 
People  items  included  “I  like  to  meet  new  people  in  school,”  “I 
feel  comfortable  in  classes  with  people  from  different  ethnic 
groups,”  and  the  like.  Flexibility  of  both  kinds  was  moderate 
for  both  groups  of  freshmen.  Flexibility  in  Instruction  rose 
slightly  after  field  experience,  in  the  same  manner  for  both 
groups,  although  this  main  effect  did  not  reach  statistical  sig- 
nificance. Flexibility  with  People  rose  slightly  for  project  fresh- 
men and  dropped  slightly  for  comparison  group  freshmen.  This 
interaction  effect  also  did  not  reach  statistical  significance.  Since 
these  effects  were  in  expected  and  explainable  directions  and 
statistical  power  was  low,  they  will  be  discussed.  Conclusions 
should  be  avoided  until  results  can  be  replicated. 

Tabic  5 

Means  (Standard  Deviations)  and  ANOVA  Results  for  Flex- 
ibility in  a Multicultural  Setting 

Site  Prc  Post  n 

Flexibility  in  Instruction 

Other  25.54  (4.9)  26.81(5.0)  26 

Project  26.11(4.9)  26.95(4.4)  19 

Effect  for  Site:  F(  1,43)=  .08 

Effect  for  Time:  F(  1 ,43 ) = 2. 1 1 . p=.  1 5 

Site  X Time  F(  1,43)  = .09 

Flexibility  with  People 

Other  29.69  (4.0)  28.85  (5.8)  26 

Project  29.74  (3.9)  30.95(3.0)  19 

Effect  for  Site:  F(  1 ,43)  = .85 

Eftcet  for  Time:  Ft  1 ,43)  = .08 

Site  X Time:  Ft  1.43)  = 2.53,  p=  12 

Noie.  Scale:  5=1  ow,  35=high 


Reports  on  the  Process  and  Content  of  the  Project 

Teacher  interxuews.  Comments  from  exit  interviews  with 
project  teachers  are  summarized  in  Table  6.  A category  is  re- 
ported if  at  least  three  out  of  14  teachers  made  remarks  to  that 
effect.  One  teacher  was  dropped  from  the  analysis  because  his 
interview  transcript  indicated  he  was  a negative  case.  He  had 
not  implemented  the  objectives  and  activities  for  the  program 
but  rather  had  his  students  observe  his  classes.  Only  two  of  the 
remaining  1 4 teachers  did  not  state  directly  that  the  project  had 
merit,  and  all  of  the  teachers  made  at  least  one  favorable  com- 
ment about  the  freshmen. 

Table  6 


Teachers  (n=14)  Report  of  Benefits  mid  Difficulties  of  the  Urban 
Middle  School  Early  Field  Expedience  Summary  of  Categories 
(and  number  of  teachers  reporting) 


Leaming/Bencfits 

Oifficulties/Problems 

For  Teachers 

general  “good"  comments 

enjoyed  helping  freshmen  begin 
a carcer(5) 

scheduling  (3) 

help  in  class,  get  more 

accomplished,  e.g.  more  coopcralive 

one  student  per  teacher  (3) 

learning,  more  time  for  other 
students  (5) 

more  structure  (3) 

no  extra  work  (4) 
For  Freshmen 

better  match  of  students 
to  subjects  (3) 

overall  “good"  experience  ( 12) 

overwhelmed  by  student 
behavior  (5) 

conversations  with  cooperating 

too  young/  should  be 

teacher (6) 

opportunity  to  grow  from  “shy" 

junior  project  (4) 

to  “comfortable”  with  setting  (6) 
exposed  to  “real”  situation  and 
variety  of  experience  (4) 
opportunity  to  show  enthusiasm/ 
work  (3) 

For  Pupils 

too  short  a time  (3) 

achievement  up  (9) 

displaying  enthusiasm,  asking 
questions,  feeling  special  (8) 

motivitatcd  to  turn  in  work  (4) 

(none  reported) 

The  benefits  that  the  project  teachers  reported  for  fresh- 
men were  related  to  opportunities  to  interact  with  both  the 
teacher  and  pupils.  After  a general  “good  experience”  report, 
the  most  cited  benefits  for  freshmen  were  the  opportunities  to 
converse  with  the  teacher  and  opportunities  to  become  com- 
fortable in  the  setting.  The  opportunities  for  interaction  with 
students  were  so  great  that  five  teachers  reported  their  fresh- 
men were  overwhelmed  at  first. 

Student  logs.  Freshman  site  logs  were  coded  twice,  once 
for  what  activities  students  reported  doing  and  once  for  re  flee 
tivc  comments.  All  of  the  30  comparison  group  freshmen  did 
observation  and  individual  tutoring.  Activities  reported  hv 
project  freshmen  were  more  varied  and  reflected  the  range  of 
activities  listed  ahou\  Reflective  comments  were  coded  as 
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1 earn  ingsftenc  fits  or  difficulties/problcms  for  the  freshmen; 
within  these  categories,  particular  learnings  or  difficulties  arose 
as  themes  in  the  freshman  logs.  Table  7 presents  a summary  of 
the  reflective  comments. 

Table  7 

Students  ’ Reflections  on  Their  Early  Field  Experience  Ben- 
efits and  Difficulties , by  Site 

Theme  Project  Group  Comparison  Group 


(n=22) 

(n=30) 

Learnings/Benefits 

observe  pupil/teacher  interactions 
pupils  respond  positively. 

21  (95%) 

6 (20%) 

respectfully  to  freshmen 

18  (82%) 

15  (50%) 

confidcncc/casc  in  new  situation 

13  (59%) 

25  (83%) 

teacher  a positive,  directive  force 
understand  city  environs,  city  pupils. 

9 t4l%) 

13  (43%) 

and  cultural  differences  better 
as  a result  of  the  experience 

8 (36%) 

0 (0%) 

interest  in  teaching 
learn  that  teacher  sets  tone. 

8 (36%) 

23  (77%) 

directly  affects  learning 

8 (36%) 

8 (27%) 

helped  pupils  learn 

7 (32%) 

22  (73%) 

nurturing/understanding  pupils 

7 (32%) 

13  (43%) 

sense  of  accomplishment 
observe  pupils  atypical  of  what 

4 (18%) 

25  (83%) 

freshmen  expected  in  that  grade 
opportunity  to  observe  “real  world” 

3 (14%) 

3 (10%) 

situation 

2(9%) 

4 (13%) 

appreciate  the  need  for  patience 

1 (5%) 

4 (13%) 

exercise  authority 

1 (5%) 

2 (7%) 

Difficult  ics/Problcms 

disliked  physical  plant, 
csp.  open  ••lassrooms 
teacher  not  interested  in  freshmen. 

7 (32%) 

1 (3%) 

uncooperative 

6 (27%) 

0 (0%) 

general  uncertainty  or  nervousness 

4 (18%) 

11  (37%) 

pupils  disrespectful  of  freshmen 
pupils  nervous,  uncertain  about 

3 (13%) 

2 (7%) 

freshmen 

0(0%) 

2(7%) 

freshmen  unreceptivc  to 

teacher  stylc/pcrsonality 

0(0%) 

8 (27%) 

No  reflections 

1 (5%) 

5 (17%) 

The  differences  in  reported  benefits  between  project  and 
comparison  freshmen  fell  into  two  general  categories. 
Project  freshmen  wrote  much  more  often  than  did  compari- 
son group  freshmen  about  observing  pupil/teachcr  intci ac- 
tions, receiving  positive  responses  from  pupils,  and 
understanding  the  urban  setting.  This  cluster  of  reflections 
is  related  to  the  observations  of  teachers  (sec  Table  6),  lend- 
ing strength  to  the  claim  that  one  of  the  project's  biggest 
contributions  was  the  opportunity  it  gave  freshmen  to  have 
positive  interactions  with  pupils  and  teachers  in  an  urban 
setting. 

Comparison  group  freshmen  wrote  much  more  often 
than  project  group  freshmen  about  a sense  of  accomplish- 
ment, helping  pupils  learn,  or  an  interest  in  teaching.  This 
cluster  of  reflections  contrasts  with  the  results  for  the  per- 
sonal teaching  efficacy  measure,  which  was  marginally 
higher  lor  the  project  group  (see  Table  4).  The  only  group 


difference  in  reported  difficulties  was  about  the  physical 
plant.  The  middle  school  had  open  classroom  architecture. 
Seven  freshmen,  used  to  walled  classrooms,  did  not  like  the 
open  design. 

Some  comments  from  the  project  group’s  site  logs  il- 
lustrate how  the  project’s  objectives  were  addressed.  The 
freshmen  did  have  opportunities  to  recognize  the  importance 
of  genuine  concern  for  each  middle  school  pupil  and  to  par- 
ticipate in  interactions  with  them. 

• I had  a talk  with  one  girl  about  her  grades  - she  wasn’t 
doing  well  and  I gave  her  some  “uplifting”  words. 

• I just  kept  telling  him  he  could  do  it  if  he  tries  and  that 
I was  there  to  help  him  out. 

• (from  a science  class)  The  kids  seem  to  like  to  ask  me 
questions.. .They  wanted  to  hear  what  I have  dissected 
in  high  school.  They  seemed  fascinated  that  I dissected 
cats,  sharks,  and  pigs. 

• (from  an  English  class)  Today,  I got  up  in  front  of  the 
class,  for  the  first  time,  to  teach  simple  and  complete 
sentences.  I was  really  nervous  at  first,  but  began  to 
feci  more  comfortable  after  a while.  The  kids  weren’t 
very  responsive  at  first,  they  were  hardly  listening  to 
me.  I asked  them  to  treat  me  with  the  same  respect  they 
would  give  Mrs.  W. 

• 1 went  around  the  circle  and  listened  to  each  one’s  opin- 
ion. I enjoyed  hearing  their  comments  and  I think  they 
did  too.  It  made  them  feel  important. 

• Today  was  “Self  Esteem  Day”  in  the  homeroom  peri- 
ods. I found  this  to  be  quite  interesting. ..The  students 
were  more  honest  and  less  embarrassed  than  what  I 
would  have  been  at  that  age. 

• (from  a math  class)  The  last  day.  It  seems  silly,  but  I 
feel  kind  of  sad.  I’d  like  to  think  I made  a difference, 
not  only  in  their  math  class,  but  in  their  lives  as 
well. ..None  of  (he  students  know  it's  my  last  day.  I just 
hope  they  remember  that  mode  is  the  number  that  oc- 
curs most  often  — for  some  reason,  they  had  trouble 
with  that. 

There  were,  of  course,  a few  problems  and  difficulties 
reported.  One  particular  teacher  from  the  school  had  some 
difficulties  with  her  own  pupils  as  did  the  freshmen  teacher 
candidates.  But  the  log  entries  reflected  that  the  freshmen 
saw  the  difficulties  in  the  larger  context  of  the  whole  school 
atmosphere,  in  which  pupils  and  their  development  were 
important. 

The  freshmen  also  observed  the  organizational  aspects 
of  classroom  work.  The  most  frequent  paperwork  activity 
was  grading  papers,  as  might  be  expected. 

• Mrs.  C.  gave  me  a pile  of  papers  to  correct... I was  greatly 
horrified  to  sec  most  of  the  students  got  D's  and  E's.  There 
were  a few  C’s,  fewer  B's,  and  no  A's.  I realize  how 
different  students  are  in  inner  cities  (from  where  I went 
to  school)  and  how  much  the  teachers  have  to  deal  with. 
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• I think  I graded  too  easy;  I gave  everyone  A’s.  Mr.  S. 
asked  me  why  and  I thought  that  being  that  all  the  draw- 
ings [diagrams  of  the  circulatory  system]  were  neat  and 
all  the  labels  were  in  the  right  places,  it  was  only  right 
to  give  them  an  A. 

The  paperwork  assignments  came  in  the  context  of  on- 
going classroom  work  in  which  the  students  had  participated. 
In  class  on  campus,  students  discussed  pupil  differences  and 
the  importance  of  not  stereotyping  pupils. 

The  concepts  of  discipline  with  dignity,  respect,  and 
classroom  management  in  general  were  the  topics  of  some 
of  the  most  interesting  freshmen  log  entries.  Many  of  the 
freshmen  were  seeing  new  things;  their  own  high  schools, 
with  contrasting  climates,  were  fresh  in  their  memories. 

• Each  student  read  aloud  and  I purposely  called  on  those 
students  falling  asleep. ..it  annoyed  me  to  see  students 
falling  asleep  [while  I was  teaching]. 

• The  teachers  I observed  had  control  over  the  students 
because  they  were  friends  with  them  One  teacher  I 
observed  had  a hard  time  with  her  students  because  she 
didn’t  treat  them  as  friends.  Most  of  the  teachers  work 
their  control  by  establishing  mutual  respect. 

• (during  a period  when  a class  was  moved  to  accommo- 
date testing)  One  boy  slipped  out  a side  door  to  leave 
before  the  bell.  I went  after  him  and  brought  him  back, 

• Two  girls  came  to  class  arguing.  Ms.  Y.  put  them  on 
opposite  sides  of  the  classroom  to  keep  them  from  fight- 
ing. Ms.  Y.  taught  the  lesson  for  the  day,  then  gave 
them  the  ditto  sheets  to  work  on.  Just  when  Ms.  Y.  turned 
her  back,  the  two  girls  started  to  physically  fights.  Im- 
mediately we  broke  them  up.  Three  other  teachers  came 
over  to  help.  After  class,  Ms.  Y.  said  that  she  thought 
the  fight  (verbally)  was  over  when  she  split  them  up, 
obviously  it  wasn’t. ..Ms.  Y.  definitely  has  control  over 
her  class,  even  when  a fight  broke  out  between  two  girls. 
The  students  listened  when  she  spoke,  and  they  showed 
respect  to  her. 

In  this  pilot  project,  the  freshmen  learned  to  sec  epi- 
sodes of  classroom  management  as  opportunities  to  contrib- 
ute to  pupil  development.  The  freshmen  did  non  focus  on 
“discipline"  for  its  own  sake,  as  do  some  early  field  experi- 
ence students.  Their  logs  showed  the  project  freshmen 
thought  misbehavior  needed  to  be  curtailed  so  that  the  pu- 
pils were  respectful  and  respectable  and  so  that  classroom 
lessons  could  continue  effectively. 

Discussion 

The  field-based  introduction  to  urban  education  at  the 
middle  school  served  to  introduce  freshmen  to  the  urban 
setting  and  to  the  complexities  of  the  urban  classroom.  The 
comparison  group  tutoring  experiences,  in  contrast,  served 
to  introduce  freshmen  to  one  dimension  of  teaching.  The 
project  freshmen  were  more  likely  than  the  comparison  group 


to  report  learning  from  observing  pupil/teacher  interactions 
and  reported  a better  understanding  of  the  urban  setting.  The 
quantitative  results  suggest  the  project  experience  had  a 
positive  effect  on  the  freshmen’s  flexibility  in  instruction, 
flexibility  with  people,  and  sense  of  personal  efficacy;  these 
effects  will  lay  helpful  foundations  for  developing  confi- 
dence and  abilities  in  future  situations.  The  comparison 
group  freshmen,  however,  were  more  likely  to  report  an  in- 
terest in  teaching,  a sense  of  having  accomplished  some 
teaching,  and  an  interest  in  helping  students  learn.  This  dif- 
ference is  probably  attributable  to  the  fact  that  the  compari- 
son group  students  were  tutors,  and  teaching  individual 
students  formed  the  bulk  of  their  experience. 

There  is  an  interesting  contrast  between  sense  of  per- 
sonal efficacy  (“I  can  make  a difference’’),  which  was  higher 
for  the  project  group,  and  sense  of  accomplishment  (“I  did 
make  a difference’’),  which  was  reported  more  often  in  the 
comparison  group  tutors’  logs  than  in  the  project  group's 
logs.  Why  was  the  broad  exposure  of  the  project  experi- 
ence more  related  to  differences  in  the  efficacy  scores  than 
the  feelings  of  actually  having  accomplished  something  re- 
ported by  the  tutors?  One  possible  explanation  is  that  project 
objectives  specified  a broad  range  of  exposure  and  immer- 
sion in  the  urban  middle  school  classrooms.  Teachers  re- 
ported in  their  interviews  that  some  students  were 
overwhelmed  at  first.  But  the  broader  exposure  may  have 
given  project  students  the  perception  of  being  introduced  to 
the  big  picture  and  some  sense  of  life  and  work  in  the  urban 
classroom.  In  contrast,  the  smaller  scope  of  the  comparison 
group’s  tutoring  experiences  may  have  left  these  students 
with  a sense  of  having  helped  one  or  two  pupils  but  without 
a coherent  vision  of  the  enterprise  of  urban  education. 

The  benefits  reported  for  this  project  are  those  one  might 
hear  from  teachers  and  teacher  educators  in  most  settings: 
developing  positive  relationships  with  students;  learning 
about  the  practical,  daily  matters  involved  in  teaching;  and 
respecting  individuals.  The  difference  lies  in  the  diversity  of 
students  with  whom  one  must  form  relationships.  The  in- 
structional methods  the  teachers  had  the  freshmen  use  to  ac- 
complish the  objectives  included  observation  with  written 
reflection,  observation  with  verbal  feedback,  interactions  with 
one  or  a few  students,  and  interactions  with  a group  of  stu 
dents.  The  teachers  saw  opportunity  to  reflect,  especially  in 
writing,  as  important  to  development  for  the  freshmen.  These 
methods  arc  also  ones  many  teacher  educators  would  use. 

The  difference  between  introducing  freshmen  to  edu- 
cation in  general  and  to  urban  education,  in  this  project,  was 
a difference  in  context.  Diversity  of  pupil  backgrounds  made 
interactions  with  students,  presentation  of  lesson  content, 
class  organization,  grading,  and  classroom  management  more 
multidimensional  activities  than  they  would  be  if  the  pupil 
population  were  more  homogeneous.  This  pilot  field  expe- 
i icneo  illu.stiated  one  way  to  sti  ucture  an  introduction  to  this 
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multidimensional^.  The  freshmen  teacher  candidates  did 
learn  and  grow  from  their  experiences. 

An  important  limitation  of  these  results  is  that  the  project 
school  was  a middle  school,  and  most  of  the  comparison 
group  freshmen  tutored  in  the  fourth  or  fifth  grades  at  el- 
ementary schools.  Replication  of  the  study  with  both  project 
and  comparison  groups  at  the  middle  school  level  would  be 
helpful.  A further  suggestion  for  refining  the  introduction 
to  urban  education  at  the  middle  school  project  would  be  to 
increase  the  amount  of  time  allotted,  although  this  poses  the 
practical  problem  of  removing  something  else  from  the  al- 
ready crowded  teacher  preparation  curriculum.  An  inter- 
ested future  research  question  is  which  effects  are  more 
beneficial  for  developing  and  sustaining  teacher  interest  and 
abilities  in  urban  teaching:  the  feelings  of  accomplishment 
associated  with  a tutoring  experience  or  the  feelings  of  broad 
exposure  to  and  beginning  understanding  of  complex, 
multicultural  classrooms  associated  with  the  project  objec- 
tives and  activities. 
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Elementary  Teachers’  Pedagogical  Content  Knowledge  of  Mathematics 

Roberta  A.  Fuller 
University  of  South  Florida 

Abstract 

The  purpose  of  this  study  was  to  characterize  and  compare  novice  and  experienced  elementary  teach- 
ers' pedagogical  knowledge  and  pedagogical  content  knowledge  of  three  major  topics  in  mathematics: 
whole  number  operations , fractions,  and  geometry.  Twenty- six  preservice  elementary'  teachers  and  28 
experienced  kindergarten  through  sixth  grade  teachers  participated  in  this  study.  Data  were  collected 
via  the  Suri'ey  on  Teaching  Mathematics  (Rich,  Lubinski  & Otto,  1994),  a researcher-designed  instru- 
ment that  assists  in  describing  pedagogical  content  knowledge.  The  results  indicate  that  experienced 
teachers  possess  a greater  conceptual  understanding  of  whole  number  operations  than  do  novice  teach- 
ers, but  that  both  novice  and  experienced  teachers  possess  primarily  a procedural  knowledge  of  frac- 
tions. In  addition,  the  results  indicate  that  both  novice  and  experienced  teachers  think  that  a good 
teacher  is  one  who  shows  and  tells  students  how  to  do  the  work. 


When  it  was  in  its  infancy,  teacher  education  primarily 
focused  on  a teacher’s  knowledge  of  subject  matter  content 
(Shulman,  1986).  However,  for  the  past  decade  or  more,  teacher 
education  research  has  emphasized  the  effectiveness  of  gen- 
eral pedagogical  methods  independent  of  subject  matter  con- 
tent, such  as  how  teachers  manage  their  classrooms,  organize 
activities,  allocate  time  and  turns,  structure  assignments,  as- 
cribe praise  and  blame,  formulate  the  levels  of  their  questions, 
plan  lessons,  and  assess  student  understanding  (Ball  & 
McDiarmid,  1 990;  Onslow,  Bey  non,  &Geddis,  1992;  Shulman, 
1986, 1987, 1988).  In  addition  to  teachers’  subject  matter  (con- 
tent) knowledge  and  their  knowledge  of  general  instructional 
methods  (pedagogical  knowledge),  Shulman  (1986, 1987, 1988) 
has  suggested  that  teaching  expertise  should  be  described  and 
evaluated  in  terms  of  pedagogical  content  knowledge.  Accord- 
ing to  Shulman  (1986),  pedagogical  content  knowledge 

include[s] ...  the  most  useful  forms  of  representation 
of  . . . ideas,  the  most  powerful  analogies,  illustra- 
tions, examples,  explanations,  and  demonstrations  - 
in  a word,  the  ways  of  representing  and  formulating 
the  subject  that  make  it  comprehensible  to  others . . . 

[It]  also  includes  an  understanding  of  what  makes  the 
learning  of  specific  concepts  easy  or  difficult:  the 
conceptions  and  preconceptions  that  students  of  dif- 
ferent ages  and  backgrounds  bring  with  them  to  the 
learning  (p.  9). 

Pedagogical  con‘ent  knowledge  is  the  synthesis  or  inte- 
gration of  teachers’  subject  matter  knowledge  and  their  peda- 
gogical knowledge  into  an  understanding  of  how  particular 
topics,  problems,  or  issues  aie  organized,  represented,  and 
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adapted  to  the  diverse  interests  and  abilities  of  learners,  and 
presented  for  instruction  (Gudmundsdottir,  1987;  Shulman, 
1986,  1987,  1988).  It  is  that  form  of  knowledge  that  makes 
teachers  rather  than  subject  area  experts,  for  teachers  differ  from 
biologists,  historians,  writers,  or  mathematicians,  not  necessar- 
ily in  the  quality  or  quantity  of  their  subject  matter  knowledge, 
but  in  how  that  knowledge  is  organized  and  used.  The  teaching 
process  requires  teachers  to  “transform”  their  subject  matter 
knowledge  for  the  purpose  of  teaching  (Gudmundsdottir,  1 987; 
Shulman,  1986, 1987).  This  transformation  occurs  as  the  teacher 
engages  in  the  act  of  “pedagogical  reasoning”,  i.e.  examines 
and  critically  interprets  instructional  materials  in  terms  of  the 
teacher’s  own  understanding  of  the  subject  matter;  thinks 
through  the  key  ideas  and  identifies  alternative  ways  of  repre- 
senting them  to  students  as  analogies,  metaphors,  examples, 
demonstrations,  simulations,  etc.;  adapts  the  material  to  stu- 
dents’ characteristics  such  as  ability,  gender,  language,  culture, 
prior  knowledge,  conceptions,  misconceptions,  expectations, 
difficulties,  strategies,  etc.;  and  finally  tailors  the  material  to 
the  specific  students  in  a classroom  (Shulman,  1987). 

Studies  indicate  that  novice  teachers  have  major  concerns 
about  pedagogical  content  knowledge  and  that  they  struggle  with 
how  to  transform  and  represent  concepts  and  ideas  in  ways  that 
make  sense  to  the  specific  students  they  are  teaching  (Ball  & 
Wilson,  1990;  Borko  et  al.,  1992;  Onslow,  Beynon,  & Gcddis. 
1992).  Onslow,  Beynon,  and  Gcddis  (1992)  described  the  de- 
veloping pedagogical  content  knowledge  of  two  student  teach- 
ers enrolled  in  a one-year  elementary  teacher  education  program. 
They  focused  on  a dilemma  faced  by  the  student  teachers  as  they 
attempted  to  transform  their  understanding  of  a topic  in  math- 
ematics into  a form  that  could  be  understood  by  their  students. 

At  this  point  in  their  career,  student  teachers’  understand- 
ing of  pedagogy  is  gradually  being  molded  to  fit  a style  of  teach- 
ing with  which  they  feel  comfortable.  Often  the  style  of  teaching 
advocated  by  university  faculty  is  in  conflict  with  the  style  of 
teaching  remembered  by  student  teachers  during  their  own 
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schooling  (Onslow,  Bey  non,  & Geddis,  1992).  Many  student 
teachers  remember  mathematics  classrooms  in  which  the  teacher 
tells  and  the  students  remember.  Taking  on  the  role  of  facilita- 
tor to  help  learners  to  construct  conceptual  knowledge  emerges 
as  an  exciting  and  rewarding  alternative.  This  style  of  teach- 
ing, however,  involves  the  transformation  of  subject  matter 
knowledge,  and  so  requires  a firm  grasp  of  various  compo- 
nents of  pedagogical  content  knowledge. 

Herein  lies  the  student  teachers'  dilemma.  When  novice 
teachers  become  frustrated  with  the  difficulties  inherent  in  teach- 
ing mathematics  meaningfully,  the  time  constraints  involved  in 
covering  the  content  of  the  curriculum,  and  the  need  to  cope 
with  individual  differences,  they  often  resort  to  teaching  the 
way  they  were  taught  despite  their  desire  to  do  otherwise.  One 
student  teacher  wrote: 

1 found  that  it  was  difficult  to  compromise  my  new 
views  about  presenting  mathematical  concepts  with 
my  old  memories  about  how  1 learned  the  same  mate- 
rial. Perhaps  I was  surprised  and  even  a little  an- 
noyed at  how  much  my  own  education  may  influence 
how  I now  educate  (or  attempt  to  educate!)  others.  I 
intended  to  let  or  allow  students  to  discover  or  de- 
velop the  concept ...  on  their  own  as  much  as  pos- 
sible. What  interfered  with  this  intent  were  time 
constraints  and  the  relative  difficulty  of  this  approach 
as  opposed  to  simply  presenting  the  “rules"  for  stu- 
dents to  follow  and  apply  (Onslow,  Beynon,  & Geddis, 

1992,  p.  308). 

Similar  results  were  found  by  Borko  ct  al.  (1992),  who  fo- 
cused on  a single  episode  in  one  student  teacher’s  experiences. 
When  confronted  with  a student’s  question  that  required  a con- 
ceptual explanation,  the  student  teacher  attempted  tc  provide  a 
concrete  example.  However,  she  made  an  error  and  ultimately 
decided  to  abandon  the  attempt,  though  she  believed  that  good 
mathematics  teaching  primarily  involved  making  mathematics 
relevant  and  meaningful  for  students.  She  then  focused  on  com- 
putational procedures  by  demonstrating  the  use  of  the  algorithm 
and  providing  guided  and  independent  practice. 

This  concern  about  pedagogical  content  knowledge  is 
prc*cnt  even  in  new  teachers  who  possess  substantial  subject 
matter  knowledge.  Ball  and  Wilson  ( 1 990)  focused  on  the  un- 
derlying assumptions  of  “alternate  route"  teacher  certification 
programs.  First,  it  is  assumed  that  college  graduates  who  ma- 
jored in  liberal  arts  have,  in  general,  more  subject  matter  knowl- 
edge than  do  their  teacher  education  counterparts  since  they 
have  received  an  education  “uncluttered”  with  professional 
course  work.  Second,  it  is  assumed  that  subject  matter  knowl- 
edge is  the  only  professional  knowledge  one  needs  to  acquire 
in  formal  university  or  college  settings.  Other  types  of  knowl- 
edge necessary  to  teaching,  c.g.,  pedagogical  knowledge  or 
pedagogical  content  knowledge,  can  and  should  he  acquired 
through  practical  experience  as  a full-fledged  teacher. 

In  order  to  exanvnc  these  assumptions.  Ball  and  Wilson 
( | WO)  collected  data  on  two  groups  of  novice  secondary  math- 


ematics teachers.  The  first  group  consisted  of  22  undergradu- 
ate students  preparing  to  teach  and  majoring  in  mathematics  at 
one  selective  private  college,  one  mid-sized  university,  and  one 
research  institution.  The  second  group  consisted  of  21 
postbaccalaureate  mathematics  majors  entering  teaching 
through  an  urban  school  district's  alternate  certification  pro- 
gram. Little  difference  was  found  in  the  mathematical  under- 
standings between  novices  in  the  alternate  route  program  and 
teacher  education  candidates,  cither  when  they  entered  their 
program  or  when  they  finished.  These  results  not  only  revealed 
that  both  groups  possessed  minimal  knowledge  of  elementary 
topics,  but  also  that  the  novice  teachers  were  often  aware  that 
all  they  had  learned  were  rules  and  procedures,  which  they  had 
memorized  and  learned  to  use  in  algorithmic  ways.  No  one 
had  helped  them  develop  meaningful  understandings  of  the  rules 
and  procedure^.  One  of  the  teacher  education  mathematics 
majors  remarked: 

. . . here  I am  supposedly  this  math  wizard  and  I've  got 
a lot  of  knowledge  and  I’ve  probably  made  more  con- 
nections than  a lot  of  people,  but  there  are  a lot  of  con- 
nections that  I haven’t  made.  I haven't  seen  these  things 
before  and  1 don’t  know  where  I was  supposed  to  learn 
them  — in  high  school?  Or  middle  school?  (p.  11) 

To  analyze  the  validity  of  the  second  assumption,  two  as- 
pects of  the  novice  teachers’  developing  ideas  about  teaching 
were  examined:  their  notions  about  the  teacher's  role  in  help- 
ing students  learn  about  mathematics,  and  their  pedagogical 
perspective  on  the  content.  With  respect  to  role,  Ball  and  Wil- 
son ( 1 990)  saw  little  difference  in  the  teachers’  views  as  a group. 
When  the  teachers  entered  their  programs,  both  groups  thought 
that  a teacher  who  shows  and  tells  students  exactly  how  to  do 
the  work  is  most  likely  to  help  students  learn  mathematics.  By 
the  end  of  the  program,  more  novices  in  both  groups  had  shifted 
to  describing  good  teaching  in  terms  of  “leading”  and  “guid- 
ing" students  rather  than  telling.  But  in  neither  group  did  more 
than  one  or  two  people  favor  a more  facilitativc,  constructivist- 
oriented  style. 

Ball  and  Wilson  (1990)  saw  similar  trends  in  responses  to 
interview  questions  which  posed  pedagogical  problems  (c.g.,  a 
student  suggests  a nonstandard  algorithm,  asks  a question,  pre- 
sents an  error  on  a paper)  and  asked  respondents  how  they  would 
deal  with  the  situation.  In  every  case,  teacher  candidates  and 
teacher  trainees  ah  **  said  they  would  respond  directly  to  the 
student,  telling  the  student  if  the  idea  was  correct,  showing  him 
or  her  what  to  do,  answering  questions  directly.  And  there  was 
virtually  no  change  in  this  over  the  course  of  their  programs. 
Ball  and  Wilson  ( 1 990)  claim  that  teachers  who  themselves  arc 
tied  to  a procedural  knowledge  of  mathematics  arc  not  equipped 
to  represent  mathematical  ideas  to  students  in  ways  that  will 
connect  their  prior  and  current  knowledge  and  the  mathematics 
they  are  r*>  learn,  a critical  dimension  of  pedagogical  content 
knowiw.ee. 

While  this  literature  indicates  that  novice  teacher*  have 
major  concerns  about  pedagogical  content  knowledge  and  that 


they  struggle  with  how  to  transform  and  represent  concepts  and 
ideas  in  ways  that  make  sense  to  the  specific  students  they  are 
teaching  (Ball  & Wilson,  1990;  Borko  et  al.,  1992;  Onslow, 
Beynon,  & Geddis,  1992),  the  assumption  that  pedagogical 
knowledge  or  pedagogical  content  knowledge  can  be  acquired 
through  practical  experience  warrants  further  investigation. 

The  purpose  of  this  study  was  to  characterize  and  com- 
pare novice  and  experienced  elementary  teachers’  pedagogical 
knowledge  and  pedagogical  content  knowledge  of  three  major 
topics  in  mathematics:  whole  number  operations,  fractions, 
and  geometry. 

Method 

Participants 

Twenty-six  preservice  elementary  teachers  and  28  experi- 
enced kindergarten  through  sixth  grade  teachers  participated  in 
this  study.  The  preservice  teachers  were  elementary  education 
majors  at  a mid-sized  mid  western  university.  The  experienced 
teachers  are  employed  in  eight  schools  located  in  or  near  one 
midwestern  city.  The  schools  include  one  parochial  school  and 
seven  public  schools. 

All  teachers  in  the  sample,  preservice  and  in  service,  self- 
selected  to  participate  in  a five-year  research  project1  that  pro- 
vided information  about  mathematics,  mathematics  learning, 
and  mathematics  teaching.  Extending  pedagogical  content 
knowledge  was  a major  focus  of  the  project.  The  goal  of  the 
project  was  to  establish  learning  environments  with  experienced 
teachers  that  reflect  current  research  findings  on  how  children 
learn  mathematics  and  to  create  within  these  learning  environ- 
ments a cooperative  teaching  team  of  an  experienced  teacher 
and  an  inexperienced  teacher,  in  order  to  produce  a better  nov- 
ice teacher.  In  the  Spring  of  1 993,  interested  experienced  teach- 
ers from  four  school  were  asked  to  submit  a statement  reflecting 
their  reasons  for  wanting  to  participate  in  such  a project.  Se- 
lection was  based  on  recommendations  from  the  on-site  advi- 
sory board.  The  intent  of  the  selection  process  was  to  provide 
a group  of  experienced  teachers  that  was  representative  of  the 
population  in  relation  to  teaching  experience,  background  in 
mathematics,  gender,  and  ethnicity.  In  the  Spring  of  1994,  the 
same  procedure  was  used  to  select  a group  of  inexperienced 
teachers  from  a pool  of  students  who  volunteered  to  participate 
during  their  senior  year  in  the  university’s  elementary  educa- 
tion program.  Again,  the  intent  of  the  selection  process  was  to 
obtain  a representative  group  of  inexperienced  teachers. 

Data  Collection 

Baseline  data  regarding  pedagogical  content  knowledge 
were  collected  in  the  Spring  of  1993  for  the  inservice  teachers 
and  in  the  Spring  of  1994  for  the  preservice  teachers.  Data  for 
each  teacher  were  gathered  using  the  Suiwcy  on  Teaching  Math- 
ematics (Rich,  Lubinski,  & Otto,  1994),  a researcher-designed 
instrument  that  assists  in  describing  pedagogical  content  knowl- 
edge. The  survey  consists  of  1 2 questions  primarily  involving 
whole  number  operations,  fractions,  geometry,  number  sense, 


and  mathematical  reasoning.  The  open-ended  questions,  which 
focus  on  the  instructional  decisions  a teacher  would  make  in 
regard  to  specific  classroom  situations  involving  mathematics, 
are  intended  to  extract  information  regarding  the  participants’ 
own  knowledge  and  beliefs  about  mathematics.  This  data  pro- 
vided the  data  set  for  the  study.  In  order  to  simplify  data  analy- 
sis, one  survey  question  was  selected  from  each  of  the  following 
topics:  whole  number  operations,  fractions,  and  geometry.  The 
three  questions  were  chosen  based  on  the  type  of  information 
elicited.  That  is,  each  of  the  selected  questions  presented  a 
classroom  situation  in  which  the  students  had  made  a “com- 
mon” error  and  the  teacher  was  asked  how  he  or  she  would 
respond  and  why.  These  questions  seemed  particularly  appro- 
priate for  examining  the  teachers’  knowledge  of  instructional 
methods  (pedagogical  knowledge)  in  addition  to  their  peda- 
gogical content  knowledge. 

Data  Analysis 

The  data  were  analyzed  using  qualitative  research  meth- 
ods. The  teachers’  pedagogical  content  knowledge  was  ana- 
lyzed using  Shulman’s  (1987)  description  of  “pedagogical 
reasoning.”  According  to  Shulman  ( 1 987>  the  process  of  peda- 
gogical reasoning  involves  comprehension  and  transformation. 
Teachers  much  first  comprehend  the  content  of  instruction  and 
then  transform  the  comprehended  ideas  in  some  way  for  the 
purpose  of  leaching.  Consequently,  the  teachers’  interpreta- 
tions, representations,  and  adaptations  of  the  content  were  ex- 
amined. It  appears  that  teachers  who  possess  only  a procedural 
knowledge  of  mathematics  are  unable  to  transform  and  repre- 
sent mathematical  concepts  and  ideas  in  ways  that  make  sense 
to  their  students  (Ball  & Wilson,  1990;  Borko  et  al.,  1992; 
Onslow,  Beynon,  & Geddis,  1992).  Therefore,  the  participants' 
interpretations,  representations,  and  adaptations  of  the  content 
were  and  the  responses  coded  in  order  to  detenu ine  the  degree 
to  which  their  knowledge  was  procedural.  Four  main  catego- 
ries were  used  to  classify  responses:  procedural  only,  both  pro- 
cedural and  conceptual,  conceptual  only,  or  neither  procedural 
nor  conceptual. 

The  teachers’  pedagogical  knowledge  was  analyzed  in 
terms  of  their  approach  to  teaching  mathematics  as  identified 
by  Kuhs  and  Ball  (1986).  Thus,  within  each  main  category, 
responses  were  further  classified  using  the  following  three  cat- 
egories. In  the  learner- foe  used  approach  to  teaching  mathemat- 
ics, the  teacher’s  role  is  to  stimulate  student  learning  by  posing 
problems,  designing  experiences,  and  asking  questions  and  to 
facilitate  student  learning  by  listening,  probing,  accepting,  re- 
stating, and  encouraging.  The  learner  actively  participates  in 
the  exploration  of  ideas,  i.c.  the  learner  is  a creator  of  math- 
ematics. In  the  contcnt-focused  with  emphasis  on  understand- 
ing approach  to  teaching  mathematics,  the  teacher’s  role  is  both 
to  organize  the  content  and  to  guide  student  learning.  The  learner 
is  considered  to  be  a discoverer  of  the  mathematics  presented 
by  the  teacher  via  the  problems  posed  for  investigation.  In  the 
contcnt-focused  with  emphasis  on  performance  approach  to 
teaching  mathematics,  the  teacher’s  role  is  to  present  material 


A ltd  Hr.tfrm  Fdm'tuiimtil  Retetm  hr* y ^ 


Volume  10,  Number  2 Spring  IW 


11 


in  an  expository  style,  explaining  concepts  and  demonstrating 
skills.  The  learner  listens,  responds  to  teacher  questions,  and 
does  exercises  using  procedures  that  have  been  modeled  by  the 
teacher,  i.e.  the  learner's  role  is  to  imitate  the  teacher. 

Results 

Given  below  are  the  results  of  one  survey  question  from 
each  of  the  following  topics:  whole  number  operations,  frac- 
tions, and  geometry. 

Whole  Number  Operations . 

One  day  your  students  finish  working  on  addition  and 
subtraction  with  regrouping.  On  a written  test,  many 
of  them  ‘ forget ” to  regroup  when  they  need  to  in  sub - 
traction . Instead  they  do  this : 

. 60 
-28 
48 

a ) What  would  you  do  and  why  ? 

b)  Why  is  this  an  appropriate  thing  to  do? 

(N CTM,  1991) 

The  results  for  the  question  involving  whole  number  op- 
erations arc  summarized  in  Table  1 . Fifteen  of  the  preservice 
teachers  and  four  of  the  experienced  teachers  focused  exclu- 
sively on  the  procedure.  A common  response  for  this  group  of 
teachers  was  to  “review  how  to  subtract  from  back  to  front  with 
a 0.  Tell  them  to  make  the  zero  into  a ten,  turn  the  6 into  a 5. 
and  then  subtract.”  These  teachers’  approaches  to  teaching 
mathematics  seem  to  fit  with  the  content-focused  with  empha- 
sis on  performance  approach  described  by  Kuhs  and  Ball  ( 1 986), 
since  most  responded  that  they  would  tell  or  show  the  students 
what  to  do.  Nearly  all  of  the  teachers  in  the  study  interpreted 
this  as  a “straightforward”  regrouping  problem.  Only  two  of 
them,  both  prcscrvicc  teachers  in  this  group,  responded  directly 
regarding  their  interpretation  of  the  content.  One  teacher 
claimed  that  “we  . . . show  that  the  zero  in  60  is  a 1 0 and  8 have 
to  be  taken  away  from  it.”  The  other  responded  that  “I’ll  illus- 
trate how  to  make  the  zero  a 10  and  the  6 a 5.  I'll  explain  to 
them  how  the  10  is  borrowed  from  the  6.”  The  teachers  in  this 
group  tended  to  rely  primarily  on  the  symbolic  or  algorithmic 
representation  of  the  content.  However,  one  experienced  teacher 
did  indicate  that  he  or  she  would  also  “have  them  tell  me  if  the 
answer  is  reasonable.” 

Five  of  the  prcscrvicc  teachers  and  1 3 of  the  experienced 
teachers  provided  both  procedural  and  conceptual  responses 
to  this  question.  It  is  interesting  to  note  that  all  of  the  experi- 
enced teachers  in  this  group  except  two  said  that  they  would 
“go  back  to  manipulativcs”  first  and  “then  bring  [the  students] 
back  to  pencil  and  paper,”  whereas  only  one  of  the  prcscrvicc 
teachers  expressed  this  idea  and,  in  fact,  three  of  them  said  that 
they  would  “review  the  process”  and  then  “117  hands-on  meth- 
ods” if  necessary.  One  preservice  teacher  claimed  that  using 
base  ten  blocks  “gives  the  child  a physical  explanation  of  why 
\ou  cancel  the  six  and  make  the  zero  a ten.”  While  all  of  the 
teachers  m this  group  mentioned  the  use  of  manipulativcs  as  a 


way  to  represent  the  content  in  addition  to  the  algorithm,  four 
of  the  preservice  teachers  and  ten  of  the  experienced  teachers 
responded  that  they  “would  [use  the  manipulatives  to]  model 
the  procedure.”  One  experienced  teachers  also  mentioned  the 
use  of  a problem  solving  context.  Nevertheless,  this  approach 
to  teaching  mathematics  also  seems  to  fit  with  the  content-fo- 
cused with  emphasis  on  performance  approach  (Kuhs  & Ball, 
1986),  since  the  teacher  is  the  one  who  is  actually  doing  the 
manipulating.  Just  one  preservice  teacher  and  three  experi- 
enced teachers  in  this  group  mentioned  having  the  students  use 
the  manipulatives,  either  to  do  more  problems  involving  re- 
grouping or  to  check  the  problem  above,  “because  it  allows  the 
student  to  discover  his/her  own  error.”  Therefore,  these  teach- 
ers' approaches  to  teaching  mathematics  therefore  seem  to  fit 
with  the  content-focused  with  emphasis  on  understanding  ap- 
proach described  by  Kuhs  and  Ball  (1986),  though  only  the 
preservice  teacher  mentioned  the  use  of  cooperative  learning 
groups. 

Six  of  the  preservice  teachers  and  eight  of  the  experienced 
teachers  gave  only  conceptual  responses  to  this  question.  Like 
the  previous  group,  almost  all  of  the  teachers  in  this  group  men- 
tioned the  use  of  manipulatives  as  a way  to  represent  the  con- 
tent. Three  of  the  preservice  teachers  and  two  of  the  experienced 
teachers  said  something  like,  “I  would  get  out  the 
[manipulatives]  and  demonstrate  over  how  to  do  this  problem 
and  more  like  it.  Evidently  my  first  demonstration  was  too 
abstract.  It  needs  to  be  more  visual.”  Again,  this  approach  to 
teaching  mathematics  seems  to  fit  with  the  content-focused  with 
emphasis  on  performance  approach  (Kuhs  & Ball,  1986),  since 
the  teacher  is  the  one  using  the  manipulatives  and  the  students 
are  only  observers.  Two  preservice  teachers  and  five  experi- 
enced teachers  in  this  group  mentioned  having  the  students  use 
the  manipulatives  instead,  because  “they  would  understand  why 
they  need  to  regroup.”  Of  these,  one  preservice  teacher  and 
one  experienced  teacher  mentioned  the  use  of  cooperative  learn- 
ing groups  and  one  experienced  teacher  mentioned  the  use  of  a 
problem  solving  context.  Rather  than  using  manipulatives,  one 
experienced  teacher’s  conceptual  explanation  involved  the  use 
of  estimation  in  a problem  solving  context.  These  teachers' 
approaches  to  teaching  mathematics  seem  to  fit  with  the  con- 
tent-focused with  emphasis  on  understanding  approach  de- 
scribed by  Kuhs  and  Ball  (1986).  Just  one  participant  in  the 
entire  study,  a prcscrvicc  teacher  in  this  group,  mentioned  hav- 
ing the  “students . . . explain  their  thinking  to  better  understand 
where  and  why  they  were  making  this  mistake.”  Thus  this 
teacher’s  approach  to  teaching  mathematics  seems  to  be  the 
only  one  to  fit  with  the  learner- focused  approach  described  by 
Kuhs  and  Ball  (1986). 

Finally,  three  of  the  experienced  teachers’  responses  could 
not  be  categorized  as  cither  procedural  or  conceptual.  One 
teacher  simply  stated  that  he  or  she  would  “go  back  and  rcteach 
with  different  strategics.”  Another  teacher  in  this  group  said 
that.  “1  may  go  on  to  another  unit  and  come  back  to  it  (subtrac- 
tion) later  as  the  students  are  obviously  not  ready  for  subu  ac- 
tion with  regrouping  ” The  third  teacher  discussed  how  he  or 
she  would  assign  grades  for  this  test. 
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Table  1 

Results  for  Question  Involving  Whole  Number  Operations 


Response  Procedural  Only  Procedural  and  Conceptual  Conceptual  Only  Neither  Procedural  nor 

Categories  Conceptual 


Interpretation  of 
the  Content 


"Straightforward"  regrouping 
proble  m 


"Straightforward"  regrouping 
problem 


"Straightforward"  regrouping 
problem 


"Straightforward  ' regrouping 
problem 


Common  Response 


"Review  how  to  subtract 
from  back  to  front  with  a 0. 
Tell  them  to  make  the  zero 
into  a ten.  turn  the  6 into  a 5. 
and  then  subtract." 


Preservice  Teachers:  "Review 
the  process"  and  then  "try 
hands-on  methods"  if  necessary. 

Inservicc  Teachers:  “Go  back 
to  manipulaiivcs"  first  and 
"then  brtng  (the  students] 
back  to  pencil  and  paper." 


"1  would  get  out  the  [manipulaiives] 
and  dononstraic  over  how  to  do 
this  problem  end  more  like  t. 

Evideihly  my  first  demonstration 
was  too  abstract.  It  needs  to  be 
more  visual.” 


"Go  back  and  ret  each  with 
different  strategies." 

'Go  on  to  another  unit  and 
come  back  to  it  (subtraction] 
later  as  the  students  ate 
obviously  not  ready  for 
subtiaction  with  regrouping." 


Number  of  15  5 6 0 

Prescrvicc  Teachers 


Number  of 
Inservicc  Teachers 

A 

13 

8 

Approaches  to 

Teaching 

Mathematics 

Content-focused  with 
emphasis  on  performance 
(most  responded  that  they 
would  tell  or  show  the 
students  what  to  do) 

Content-focused  with  emphasis 
on  performance  (4  presemce 
and  10  inscrvice  teachers 
responded  that  they  “would 
luse  manipulaiives  to]  model 
the  procedure") 

Content-  focused  with  emphasis 
on  understanding  (1  preservice 
and  3 insetvicc  teachers) 

Content-focused  with  emphasis 
on  understanding  (2  preservice 
and  6 inservicc  teachers 
mentioned  having  students  use 
manipulatives) 

Content-  focused  with  emphasis 
on  performance  (3  prescrvicc 
and  2 inservicc  teachers) 

3 


Fractions 

Suppose  you  are  working  with  a group  of  stu- 
dents on  addition  and  subtraction  of  fractions.  Sev- 
eral of  them  are  solving  problems  as  shown  below: 

1/2  + 1/3  = 2/5 

When  asked  about  their  solution  they  respond . 

“ Jane  made  one  out  of  two  free  throws  in  the  first 
half  and  one  out  of  three  in  the  second.  So,  she  made 
two  out  of  five  in  the  game . " 

a)  What  do  you  respond? 

b)  Why  do  you  respond  this  way? 

Tabic  2 summarizes  the  results  for  this  fractions  question. 
Thirteen  of  the  prescrvicc  teachers  and  1 1 of  the  experienced 
teachers  focused  solely  on  the  procedure  by  relying  primarily 
on  the  algorithmic  representation  of  the  problem,  again  taking 
an  approach  to  teaching  mathematics  that  seems  to  fit  with  the 
contcnt-focuscd  with  emphasis  on  performance  approach  de- 
scribed by  Kuhs  and  Ball  (1986).  This  group  provided  four 
different  interpretations  of  this  problem.  Ten  prescrvicc  teach- 
ers and  six  experienced  teachers  gave  responses  involving  or 
related  to  the  idea  that  “when  adding  and  subtracting  fractions, 
you  must  find  a common  denominator."  Two  p.escrvice  teach- 
ers equated  this  with  “shooting"  the  same  “r  <nber  of  shots  in 


each  half."  One  prescrvicc  teacher  stated  that  “the  denomina- 
tor must  be  the  same  because  you  arc  adding  two  parts  of  a 
whole  and  not  two  separate  parts  of  two  separate  wholes."  Simi- 
larly, one  experienced  teacher  wrote  “wc  need  to  look  at  the 
total  number  of  shots  as  our  denominator  so  that  one  out  of  five 
and  another  one  out  of  five  gives  us  a total  of  two  out  of  five." 
One  prescrvicc  teacher  and  two  experienced  teachers  com- 
mented that  they  “would  explain  the  difference  between  ratios 
and  fractions."  One  prescrvicc  teacher  responded  that  “1/2 
could  also  be  used  to  represent  three  out  of  six  or  five  out  of  ten 
(which)  would  not  [give]  the  same  answer."  And  finally,  one 
experienced  teacher  gave  the  following  explanation:  “Jane  made 
1/2  of  her  free  throws  in  the  first  half  and  1/3  of  her  free  throws 
in  the  second  half.  What  fraction  of  her  free  throws  did  she 
make  during  the  game?  Did  she  make  more  than  1 /2  of  them  or 
less  than  1/2  of  them.”  One  prescrvicc  teacher  and  two  experi- 
enced teachers  in  this  group  avoided  interpreting  the  problem 
by  offering  comments  like  “I  would  have  to  agree  that  their 
logic  makes  sense,  but  I would  suggest  we  take  another  look  at 
the  process  of  adding  fractions  and  the  steps  we  needed  to  take." 

Four  of  the  prescrvicc  teachers  and  four  of  the  experienced 
teachers  provided  both  procedural  and  conceptual  responses 
to  this  question.  In  addition  to  using  the  algorithm,  three  of  the 
preservice  teachers  and  two  i ! ^ experienced  teachers  in  this 
group  said  that  they  would  draw  pictures  or  use  manipulaiives 
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to  represent  the  problem,  taking  an  approach  to  teaching  math- 
ematics that  also  seems  to  fit  with  the  content-focused  with 
emphasis  on  performance  approach  (Kuhs&  Ball,  1986).  The 
other  three  teachers  in  this  group  stated  that  they  would  have 
the  students  draw  a picture  or  try  using  manipulatives  in  order 
to  “lead  them  to  discover  you  have  to  have  a common  whole," 
thereby  taking  an  approach  to  teaching  mathematics  that  seems 
to  fit  more  with  the  content-focused  with  emphasis  on  under- 
standing approach  (Kuhs  & Ball,  1986).  This  group  also  pro- 
vided four  different  interpretations  of  the  problem.  Three 
preservice  teachers  and  two  experienced  teachers  claimed  “that 
in  order  to  add  fractions,  the  denominators  must  be  the  same." 
One  preservice  teacher  mentioned  that  “[fractions  are]  parts  of  a 
whole  . . . they  need  to  learn  the  difference  between  ratio  and  . . . 
fraction."  One  experienced  teacher  claimed  “that  this  answer 
would  show  percentage  rather  than  the  solution  to  the  fraction 
problem."  Another  experienced  teacher  said  that  he  or  she  “would 
. . . show  the  student  that . . . V2  is  not  necessarily  one  out  of  two 
but  may  be  two  out  of  four." 

Four  of  the  preservice  teachers  and  eleven  of  the  experi- 
enced teachers  gave  only  conceptual  responses  to  this  ques- 
tion. This  time  three  preservice  teachers  and  six  experienced 
teachers  in  this  group  mentioned  drawing  pictures  or  showing 
with  manipulatives,  an  approach  to  teaching  mathematics  that 
seems  to  fit  with  the  content- focused  with  emphasis  on  perfor- 
mance approach  (Kuhs  & Ball,  1986).  The  remaining  six  teach- 


ers in  this  group  suggested  having  the  students  draw  pictures  or 
use  manipulatives  in  order  to  “find  their  mistakes,”  an  approach 
to  teaching  mathematics  that,  as  previously  stated,  seems  to  fit 
with  the  content- focused  with  emphasis  on  understanding  ap- 
proach (Kuhs  & Ball,  1986).  This  group  provided  three  differ- 
ent interpretations  of  this  problem.  One  preservice  teacher  and 
four  experienced  teachers  gave  responses  like  “ratios  work  dif- 
ferently than  fractions  [which  are]  parts  of  a whole.”  One 
preservice  teacher  and  one  experienced  teacher  claimed  that 
“we  must  combine  like  things.”  Two  preservice  teachers  and 
five  experienced  teachers  offered  responses  related  to  the  idea 
of  using  the  same  whole.  One  experienced  teacher  in  this  group 
avoided  interpreting  the  problem. 

Five  of  the  preservice  and  two  of  the  experienced  teach- 
ers’ responses  could  not  be  categorized  as  either  conceptual  or 
procedural.  Four  preservice  teachers  and  one  experienced 
teacher  believed  that  the  student’s  solution  was  correct.  In  fact, 
one  preservice  teacher  commented,  “If  this  is  an  easy  way  for 
students  to  remember  how  to  add  fractions,  then  I would  use 
“fun”  examples  like  this  when  I explain  the  addition  of  frac- 
tions.” One  preservice  teacher  admitted  that  he  or  she  did  not 
know  how  to  respond,  since  “the  logic  is  rational”  but  the  an- 
swer is  wrong.  One  experienced  teacher  responded  mysteri- 
ously, “I  wonder  what  Jane  would  say  about  you  saying  that 
she  made  only  two  out  of  five  shots?  I think  she  might  be  a bit 
upset.  See  if  you  can  figure  out  why  I am  saying  this.” 


Table  2 


Results  for  Question  Involving  Fractions 


Response  Categories 

Procedural  Only 

Procedural  and  Conceptual 

Conceptual  Only 

Neither  Procedural  nor 
Conceptual 

Interpretation  of  the 

10  Pre service  and  6 Inscrvicc 

3 Prescrvicc  and  2 Inservicc 

2 Preservice  and  5 Inservicc 

4 Preservicc  and  1 Inservicc 

Content 

Teachers-  “When  adding  and 

Teachers:  “In  order  to  add 

Teachers:  Offered  responses 

Teacher:  Believed  that- the 

subtracting  tractions,  you  must 

fractions,  the  denominators 

related  to  the  idea  of  using  ihc 

student's  solution  was  correct, 

find  a common  denominator" 

must  be  the  same  “ 

same  whole 

1 Prescrvicc  Teacher:  The 

1 Pre  service  and  1 Inservice 

1 Prescrvicc  Teacher 

1 Prescrvicc  and  4 Inservicc 

logic  is  rational"  but  the 

Teachers:  Ratios  and  fractions 

"[Fractions  are]  parts  of  a 

Teachers:  “Ratios  work 

answer  is  w^rong. 

tire  dil fere m. 

whole  ...  ratio[s]  and 

differently  than  fractions 

fraction] s]“  are  different 

(which  arc]  parts  of  a whole." 

Number  of  Preservice 

13 

4 

4 

Teachers 

. 

Number  of  lnscrvice 
Teachers 

1 1 

4 

11 

2 

Approaches  to  Teaching 

Content -focused  with  emphasis 

Cental' focused  with  anphasis 

Content-focused  with  emphasis 

Mathematics 

on  performance  (relied 

on  performance  (3  prescrvicc  and 

on  performance  {3  prescrvicc 

primarily  on  the  algorithmic 

2 inscrvicc  teachers  responded 

and  6 inservicc  teachers) 

representation  of  the  problem) 

that  ihcyw-ould  draw  pictures  or 
use  rntripulativcs  to  represent  the 

Content -focused  with  emphasis 

problem,  in  addition  to  using  die 

on  understanding  ( 1 prescrvicc 

algorithm) 

and  5 inscrvice  tear  Ik  is 
mentioned  hav mg  students  draw 

Content'  focused  with  emphasis 
in  understanding  < 1 preservin' 

pictures  or  use  manipulatives) 

and  2 inservicc  leathers) 

1 Hr-  ^ 

x v , J h> 
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Geometry 

The  following  problem  is  posed  to  a group  of 
students.  “Suppose  you  had  64  meters  of  fence  with 
which  you  were  going  to  build  a pen  for  your  large 
dog,  Bones.  What  are  some  different  pens  you  could 
make  if  you  use  all  the  fencing  ? What  is  the  pen  with 
the  least  play  space?  What  is  the  biggest  pen  you 
can  make  - the  one  that  allows  Bones  the  most  play 
space?  Which  would  be  the  best for  running  ? " After 
considering  the  problems , the  students  explain  that  it 
doesn ’t  matter  since  all  the  pens  will  have  the  same 
perimeter  - 64  meters. 

a)  Explain  why  they  gave  this  response. 

b ) How  Vr}ould  you  respond  to  their  solution  ? 

c)  Explain. 

( NCTM , 1991) 

Table  3 shows  the  results  of  this  geometry  question.  Just 
one  experienced  teacher  provided  a response  to  this  question 
that,  was  both  procedural  and  conceptual,  since  he  or  she  was 
the  only  one  that  specifically  mentioned  an  area  formula.  “I 
would  first  of  all  draw  a picture  showing  the  different  areas  that 
have  a perimeter  of  64  meters.  I would  point  out  how  to  find 
area  — length  x width.”  This  teacher’s  approach  to  teaching 
mathematics  seems  to  fit  with  the  content-  focused  with  em- 
phasis on  performance  approach  (Kuhs  & Ball,  1986).  Though 
all  of  the  other  teachers  attempted  only  conceptual  responses, 
1 8 of  the  preserv'ice  teachers  and  seven  of  the  experienced  teach- 
ers mentioned  that  they  themselves  would  draw  pictures  or  use 
manipulatives  to  demonstrate,  an  approach  to  teaching  math- 

Table 3 


ematics  which  also  seems  to  fit  with  the  content-focused  with 
emphasis  on  performance  approach  (Kuhs  & Ball,  1986).  One 
preserv'ice  teacher  claimed  that  “an  example  from  the  teacher . 

. . lights  up  the  bulb!  Then  the  students  are  off  and  running.” 
Eight  of  the  preservice  teachers  and  1 8 of  the  experienced  teach- 
ers instead  suggested  having  the  students  engage  in  these  sorts 
of  activities,  thereby  taking  an  approach  to  teaching  mathemat- 
ics that  seems  to  fit  with  the  content- focused  with  emphasis  on 
understanding  approach  (Kuhs  & Ball,  1986).  One  experienced 
teacher  did  not  respond  to  this  question  at  all  and  one  experi- 
enced teacher’s  response  could  not  be  categorized.  He  or  she 
stated  that  “the  students  didn’t  want  to  go  to  the  work  of  figur- 
ing this  problem.” 

'there  were  three  different  interpretations  given.  Though 
19  preservice  teachers  and  12  experienced  teachers  specifically 
mentioned  something  to  the  effect  that  “[the  students]  were  con- 
fusing perimeter  with  area,”  13  preservice  teachers’  and  15  ex- 
perienced teachers’  responses  were  limited  to  the  consideration 
of  rectangular  pens  only.  One  preservice  teacher  claimed  that  of 
these,  the  “square  produces  [the]  most  area.”  Five  preservice 
teachers  and  one  experienced  teacher  at  least  included  the  possi- 
bility of  a circular  pen  and  three  preservice  teachers  and  one 
experienced  teacher  also  mentioned  the  use  of  other  polygonal 
figures.  One  experienced  teacher  focused  in  part  on  definitions 
of  perimeter  and  area,  by  “explain [ing]  to  them  that  area  is  the 
amount  of  space  an  object  covers  and  the  perimeter  is  the  length 
and  width  of  an  object.”  Finally,  two  experienced  teachers  claimed 
that  the  solution  was  correct.  For  example,  “While  they  are  cor- 
rect I would  encourage  them  to  look  at . . . what  would  be  an 
interesting  and  creative  way  to  use  an  area.”  Only  four  teachc.  i s 
mentioned  using  cooperative  learning  groups. 


Results  for  Question  Involving  Geometry' 


Response  Categories 

Procedural  Only 

Procedural  and  Conceptual 

Conceptual  Only 

Neither  Procedural  nor  Conceptual 

Interpretation  of  the 
Content 

1 Inscrvicc  Teacher.  Offered 
response  limited  to  the  consideration 
of  rcc tangular  pens  only. 

13  Preservice  and  15  Inscrvicc 
Teachers:  Offered  responses  limited 
to  the  consideration  of  rectangular 
pens  only. 

5 Prcscrviee  and  1 Inscrvicc  Teacher: 
Included  the  possibility  of  a circular 
pen 

2 Inscrvicc  Teachers:  Believed  dial 
the  student's  solution  v/as  correct 

1 Inscrvicc  Teacher:  Did  not  respond 
to  this  quesDon  at  all 
1 Inscrvicc  Teacher:  "The  audenis 
didn’t  want  to  go  to  the  work  ot 
figuring  this  pc  rblem  " 

Number  of  Prescrvicc 
Tfcachers 

0 

0 

26 

0 

Number  of  In  service 
Ttachcrs 

0 

1 

25 

2 

Approaches  to 
Teaching  Mathematics 

Cortcnt -focused  with  emphasis  on 
performance  (l  inscrvicc  teacher 
respond'd  that  "1  wojld  draw  a 
picture  showing  the  diffcrcrt  areas 
that  have  a perimeter  of  M meters  I 
would  point  out  how  to  ti nil  area- 
length  x width.”! 

Content -focused  vvidi  emphasis  on 
performance  ( 18  pre service  and  7 
mrervicc  teachers  respond'd  that 
thcywoild  draw  pictures  or  use 
manipulates  to  demonsnatc) 
Content-  focused  with  emphasis  on 
understanding  (8  prcscmec  anti  18 
iikctmcc  teachers  suggested  heaving 
students  demonstrate) 
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Discussion 

Approximately  one-half  of  the  preservice  teachers’  re- 
sponses to  the  questions  involving  whole  number  operations 
and  fractions  (57.7%  and  50%  respectively)  were  procedural 
only,  somewhat  supporting  the  findings  which  seem  to  indicate 
that  novice  teachers  possess  primarily  a procedural  knowledge 
of  mathematics  (Ball  & Wilson,  1990;  Borkoetal.,  1992).  The 
research  results  suggesting  that  novice  teachers  think  that  a good 
teacher  is  one  who  shows  and  tells  students  how  to  do  the  work 
(Ball  & Wilson,  1990;  Borko  et  al.,  1992;  Onslow,  Beynon,  & 
Geddis,  1 992)  were  also  supported,  since  more  than  two-thirds 
of  the  preservicc  teachers’  responses  to  all  of  the  questions 
(84.6%  for  whole  number  operations,  73. 1 % for  fractions,  and 
69.2%  for  geometry)  fit  with  the  approach  to  teaching  math- 
ematics that  emphasizes  performance  (Kuhs  & Ball,  1986). 

Unlike  the  preservice  teachers,  very  few  of  the  experienced 
teachers  ( 1 4.3%)  gave  strictly  procedural  responses  to  the  ques- 
tion involving  whole  number  operations.  The  fact  that  75%  of 
them  as  opposed  to  only  42.3%  of  the  preservice  teachers  sug- 
gested the  use  of  manipulatives  seems  to  indicate  that  experi- 
enced teachers  possess  a greater  conceptual  understanding  of 
whole  number  operations  than  do  novice  teachers.  However, 
many  more  experienced  teachers  (about  the  same  number  as 
preservice  teachers  ~ 39.3%)  gave  strictly  procedural  responses 
to  the  question  involving  fractions.  This  seems  to  suggest  that 
experienced  teachers  have  a greater  conceptual  understanding 
of  whole  number  operations  than  they  do  of  fractions.  In  addi- 
tion, more  than  one-half  of  the  experienced  teachers’  responses 
for  the  questions  involving  whole  number  operations  and  frac- 
tions (57. 1 % and  67.9%  respectively)  fit  with  the  approach  to 
teaching  mathematics  that  emphasizes  performance  (Kuhs  & 
Ball.  1986).  Together  these  results  seem  to  indicate  that  nei- 
ther pedagogical  knowledge  nor  pedagogical  content  knowl- 
edge is  necessarily  acquired  through  practical  experience. 

Though  nearly  all  of  the  teachers  provided  conceptual  re- 
sponses to  the  question  involving  geometry,  the  fact  that  a great 
many  of  their  interpretations  were  limited  to  the  consideration 
of  rectangular  pens  only  seems  to  suggest  that  their  understand- 
ing of  this  topic  is  severely  restricted.  One  wonders  whether 
more  procedural  responses  would  have  been  given  if  the  teach- 
ers had  thought  of  other  possibilities.  One  also  wonders  what 
effect  this  limited  interpretation  has  on  the  teacher's  approach 
to  teaching  mathematics,  since  more  experienced  teachers  gave 
responses  to  this  question  that  fit  with  the  approach  which  em- 
phasizes understanding  than  with  the  approach  which  empha- 
sizes performance  (Kuhs  & Ball,  1986). 

To  become  a good  mathematics  teacher  requires  thought- 
ful reflection.  Both  novice  and  experienced  teachers,  them- 
selves the  products  of  traditional  mathematics  classrooms,  need 


to  revisit  and  extend  their  own  mathematical  understandings. 

They  need  opportunities  to  explore,  identify,  and  challenge  their 

assumptions  about  the  teacher’s  role,  as  well  as  to  develop  peda- 
gogical content  knowledge. 
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Book  Review 


Dismantling  Desegregation 

Joseph  Watras 
University  of  Dayton 

Readers  are  asked  to  review  recently  published  or  classic  books  in  education  and  research . In  his 
review  ^/Dismantling  Desegregation,  Watras  acknowledges  the  authors  ’ contribution  to  the  discussion 
of  urban  education  but  challenges  their  indirect  approach  to  addressing  abstract  considerations  under- 
lying the  complex  issue  of  racial  integration  in  schools  and  communities . 


Orfield,  G.  & Eaton,  S,  E.  (1996).  Dismantling 
desegregation : The  quiet  reversal  of  Brown  v.  Board 
of  Education.  New  York:  New  Press.  Pp.  424. 

In  1993,  the  National  School  Boards  Association  issued  a 
report  from  the  Harvard  Project  on  School  Desegregation  cit- 
ing an  increase  in  racial  segregation.  For  example,  from  1986 
to  1991,  the  proportion  of  Black  students  attending  schools 
with  more  than  half  minority  students  rose  to  the  level  that  had 
existed  before  the  U.S.  Supreme  Court's  first  busing  decision 
in  1971 . During  the  same  period,  the  share  of  Black  students  in 
schools  with  90-100  percent  minority  students  rose. 

Calling  the  trend  the  “quiet  reversal"  of  Brown  v.  Board  of 
Education . Gary  Orfield,  Susan  E.  Eaton,  and  the  Harvard 
Project  on  School  Desegregation  build  on  the  data  they  pre- 
sented in  1992.  Their  new  book,  Dismantling  Desegregation , 
is  a series  of  eleven  essays  written  by  eight  people.  Orfield  and 
Eaton  wrote  six  of  the  chapters,  and  they  revised  the  others  to 
harmonize  their  structure,  analysis,  and  conclusions.  Some  chap- 
ters are  better  written  than  others.  Often,  the  same  information 
appears  in  several  places,  and  the  book  suffers  from  such  edit- 
ing problems  as  different  dates  cited  for  the  same  U.S.  Supreme 
Court  decision  and  misspelled  words.  Nonetheless,  the  argu- 
ments proceed  logically. 

Orfield  begins  with  a description  of  the  cases  on  which  the 
U.S.  Supreme  Court  built  federal  desegregation  law.  He  claims 
the  Detroit  case,  Milliken  v.  Bradley , was  the  first  major  blow 
against  school  desegregation.  He  contends  that  in  Milliken . the 
Supreme  Court  restricted  desegregation  in  the  North  by  mak- 
ing it  more  difficult  for  a court  to  join  suburban  and  urban  dis- 
tricts. However,  Orfield  believes  that  the  Supreme  Court  used 
three  decisions  to  allow  even  Southern  states  to  return  to  such 
segregative  practices  as  neighborhood  schools.  The  cases  were: 
Board  of  Education  of  Oklahoma  City  v.  Dowell  in  1991.  Free- 
man v.  Pitts  in  1992,  and  finally  Missouri  v.  Jenkins.  Orfield 
says  that  these  decisions  require  only  that  school  officials  claim 
that  their  policies  will  improve  education. 

In  the  next  chapter.  Orfield  argues  that  efforts  such  as  com- 
pensatory education  to  improve  segregated  schools  recall  Plessy 
v.  Ferguson's  inadequate  standard  of  separate  but  equal.  This 
occurs  because  courts  have  held  that  private  decision  making 
and  economics  may  cause  racial  segregation.  In  such  cases, 
segregation  appears  to  be  a normal  state  of  affairs.  The  unfor- 


tunate result  is  that  blame  for  the  failure  of  minority  children  in 
segregated  schools  falls  on  the  children,  their  families,  or  the 
school  teachers.  But  the  teachers  of  segregated  classes  cannot 
easily  create  a curriculum  that  compensates  for  the  students’ 
deficiencies.  More  frequently,  the  teachers  feel  they  must  “wa- 
ter down"  the  curriculum.  Citizens  may  blame  urban  school 
administrators,  who  are  usually  Black,  for  the  low  test  scores 
of  their  students.  As  a result  of  public  pressure,  urban  adminis- 
trators lose  their  positions  after  an  average  of  three  years  and 
rarely  have  time  to  carry'  out  any  reasonable  reforms. 

According  to  Orfield  and  Eaton,  segregation  is  dangerous 
because  racially  integrated  schools  have  better  resources  than 
segregated  facilities.  Further,  students  in  racially  integrated 
schools  bring  fewer  problems  to  the  buildings  than  do  the  stu- 
dents in  segregated  settings.  As  a result,  despite  efforts  to  make 
segregated  schools  effective,  African  American  or  Latino  stu- 
dents who  attend  racially  integrated  schools  have  a better  chance 
of  finishing  college  than  the  same  type  of  students  with  similar 
test  scores  from  segregated  high  schools. 

Some  sociologists  blame  federal  desegregation  efforts  for 
the  rising  tide  of  racial  isolation.  From  1972  to  1992,  the  en- 
rollment of  White  students  in  public  schools  fell  14  percent 
while  the  number  of  Black  students  rose  3 percent  and  Latino 
enrollments  soared  89  percent.  Citing  this  trend,  some  sociolo- 
gists contend  that  White  students  fled  public  schools  to  avoid 
busing.  Orfield  and  Eaton  disagree,  however,  because  White 
enrollments  in  private  schools  fell  over  the  same  twenty-year 
period.  For  Orfield  and  Eaton,  the  causes  of  increasing  segrega- 
tion were  more  basic.  First,  from  1968  to  1986,  the  total  number 
of  white  students  fell  sharply  as  birth  rates  dropped.  Second, 
most  White  students  attended  suburban  public  schools  rather  than 
urban  ones.  Each  year  from  1985  until  1990,  central  cities  lost 
1 .6  to  3.0  million  residents  while  the  surrounding  suburbs  gained 
1.9  to  3.2  million  persons.  Most  of  the  expansion  in  suburban 
communities  was  due  to  increased  numbers  of  middle  class  and 
White  residents.  Furthermore,  contrary  to  popular  belief,  the 
presence  or  the  absence  of  an  urban  school  desegregation  plan 
did  not  alter  the  migration.  New  York,  Chicago,  and  Houston 
never  had  busing  plans,  yet  the  White  population  declined  in 
those  cities.  Los  Angeles  had  a limited  busing  plan  for  a few 
months.  When  the  busing  ended.  White  flight  continued. 

Despite  these  dismal  findings,  schools  do  not  have  to  re- 
main segregated.  Orfield  and  Eaton  believe  that  metropolitan 
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desegregation  would  provide  urban  minority  students  access 
to  suburban  schools  with  middle  class  students.  Further,  with 
metropolitan  plans,  people  from  an  entire  area  may  participate 
in  the  reform  of  public  schools. 

Next,  Orfield  examines  four  misconceptions  that  justify  lift- 
ing a desegregation  order,  thus  allowing  a return  to  neighbor- 
hood schools  and  resegregation.  The  first  misconception  is  the 
view  that  segregated  classrooms  can  be  effective  with  the  proper 
administrative  or  instructional  model.  Anecdotal  evidence  for 
this  view  derives  from  such  highly  publicized  success  stories  as 
Marva  Collins  or  Jaime  Escalante.  However,  segregated  class- 
rooms function  worse  than  do  integrated  ones.  A second  mis- 
conception is  that  Whites  will  remain  in  a city  or  return  to  it  if  the 
courts  lift  a desegregation  order.  According  to  Orfield,  this  sim- 
ply does  not  happen.  A third  misconception  arises  when  school 
districts  present  themselves  as  free  from  discrimination.  The  in- 
crease in  the  number  of  Black  administrators  seemed  to  bolster 
this  view.  However,  Black  administrators  cannot  solve  the  sys- 
temic problems  of  city  schools.  Finally,  officials  often  present  a 
claim  that  costs  will  go  down  when  desegregation  mandates  end. 
However,  if  popular  innovations  such  as  magnet  schools  persist, 
costs  may  actually  increase. 

Chapters  five  through  ten  present  case  studies  of  such  cities 
as  Norfolk,  Virginia:  Detroit,  Michigan;  Little  Rock,  Arkansas; 
Charlotte,  North  Carolina,  Kansas  City,  Missouri;  and  Prince 
George’s  County,  Maryland.  These  show  the  problems  associ- 
ated with  monetary  compensation  for  disadvantaged  schools,  with 
local  control  of  schooling,  and  with  magnet  schools. 

In  the  last  substantive  chapter,  Orfield  returns  to  discuss 
housing  segregation.  Although  the  Nixon  and  the  Carter  admin- 
istrations considered  some  housing  dispersal  programs,  Orfield 
contends  that  these  programs  ended  before  they  could  prove  their 
utility.  The  Clinton  administration  has  been  unable  to  overcome 
congressional  resistance  to  such  intrusions  in  local  affairs. 

In  his  conclusion,  Orfield  offers  several  policy  suggestions 
to  make  desegregation  a step  in  the  transformation  of  segre- 
gated institutions  into  integrated  communities.  These  include 
asking  lawyers  and  citizens*  groups  to  represent  the  rights  of 
minority  children  in  courts.  He  calls  for  the  careful  monitoring, 
evaluation,  and  improvement  of  desegregation  plans.  Orfield 
asks  the  media  to  engage  in  careful  analysis  rather  than  to  ac- 
cept official  statements  uncontcstcd.  However,  he  acknowledges 
that  accurate  information  is  not  readily  available  in  part  be- 
cause neither  the  federal  government  nor  private  foundations 
offer  to  support  research  about  racial  desegregation.  Finally, 
Orfield  suggests  that  school  officials  and  housing  agencies  work 
together  to  foster  integration.  One  example  of  the  way  this  could 
happen  :s  to  build  neighborhood  schools  only  in  integrated 
neighborhoods. 

In  all,  Orfield  and  Eaton  seem  to  believe  that  good  social 
science  can  help  people  reform  society.  As  a result,  they  make 
a moral  plea  for  desegregation  without  delving  into  abstract 
considerations.  Unfortunately,  1 do  not  share  their  faith.  I think 


the  moral  or  religious  considerations  of  racial  integration  de- 
serve much  more  direct  attention.  In  general,  from  1954  until 
1963  the  battle  to  racially  integrate  schools  and  society  fol- 
lowed a legal  route.  For  example,  in' Little  Rock,  Arkansas,  the 
desegregation  of  Central  High  School  was  termed  a question 
of  state’s  rights.  When  Martin  Luther  King,  Jr.  expressed  his 
disappointment  with  legal  solutions,  he  encouraged  people  to 
resist  evil  without  violence.  However,  this  aim  did  not  offer 
clear  direction.  People  engaged  in  nonviolent  marches  to  ad- 
vance segregationist  policies  saying  they  wisned  to  fight  the 
evil  they  saw  in  court  ordered  racial  integration. 

Orfield  and  Eaton  observe  how  the  aims  of  multiculturalism 
and  meritocracy  can  reinforce  segregation.  However,  simply 
showing  that  something  causes  segregation  will  not  convince 
people  that  they  should  live  in  integrated  settings.  Nor  does  it 
help  to  show  that  minorities  suffer  under  racial  segregation. 
For  example,  from  1964  to  1974,  all  sides  in  the  controversy 
about  racial  desegregation  claimed  to  be  advancing  human 
rights.  Even  social  scientists  could  not  straighten  out  these  con- 
flicting claims.  More  important,  the  federal  government  rein- 
forced each  type  of  claim  at  one  time  or  another.  Liberals 
asserted  that  Black  children  have  a right  to  attend  racially  inte- 
grated schools,  and  the  1964  U.S.  Civil  Rights  Act  reinforced 
those  views.  Conservatives  argued  that  children  had  a right  to 
attend  a neighborhood  school,  and  the  U.S.  Congress  tried  to 
block  court  ordered  busing.  Black  activists  said  that  minority 
parents  have  the  right  to  control  their  children’s  schools,  and 
the  U.S.  Department  of  Health,  Education,  and  Welfare  offered 
Model  Cities  grants  to  develop  such  programs.  In  this  light,  it  is 
possible  to  read  Milliken  as  showing  that  the  U.S.  Supreme 
Court  did  not  block  desegregation  as  Orfield  believes.  The  de- 
cision could  reflect  the  unwillingness  of  the  justices  to  rein- 
force anyone’s  rights.  Instead,  the  justices  chose  to  correct  only 
illegal  acts. 

My  bias  is  that  if  wc  are  to  have  racial  integration,  people 
must  think  that  it  benefits  the  society  as  a whole  and  them  in 
particular.  On  the  other  hand,  Orfield  and  Eaton  see  policies  as 
more  important  than  philosophy.  They  point  to  Charlotte,  North 
Carolina,  as  a city  that  voted  out  the  plans  of  a superintendent 
to  resegregate  the  schools.  The  authors  contend  that  the  1971 
court  ordered  busing  convinced  the  community  that  desegre- 
gation and  academic  achievement  went  together.  Subsequent 
conservative  criticisms  of  busing  weakened  this  faith  but  never 
destroyed  it. 

From  such  histories,  Orfield  and  Eaton  seem  to  believe 
that  good  information  can  convince  people  that  there  are  a va- 
riety of  potentially  successful  techniques  to  desegregate  schools 
or  communities.  I think  that  most  people  know  that  those  meth- 
ods could  work.  Consequently,  I feel  that  it  is  most  important  to 
express  clearly  and  completely  the  reason  for  applying  these 
strategics.  Whichever  perspective  you  hold,  Orfield  and  Eaton's 
book  is  an  important  contribution  to  the  discussion  of  urban 
education. 
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Celebrating  Our  2 1 st  Anniversary! 

Mid-Western  Educational  Research  Association 

1997  Annual  Conference 
October  15-18,  1997 

In  the  modern  facilities  of  the 
Holiday  Inn  - Mart  Flaza 
Chicago , Illinois 


Featured  Speakers  Include: 

Robert  J.  Shoop  and  James  B.  Boyer 
Kansas  State  University 

Please  join  us  as  we  celebrate  the  21st  anniversary 
of  the  Mid-Western  Educational  Research  Association. 
The  1997  Conference  offers  a unique  blend  of  good 
research  and  cordial  collegiality  as  its  hallmark. 

It  is  little  wonder  that  M-WERA  is  one  of  the  most 
respected  regional  associations  in  the  country. 

So  make  it  a point  to  join  us  (or  renew  your  membership), 
for  in  so  doing  both  you  and  M-WERA  will  greatly  benefit. 

Proposal  Deadline:  April  15,  1997 

For  more  information  and  Call  for  Proposals, 
see  the  Winter  issue  of  the  Mid- Wes  tern  Educational 
Researcher  or  contact  Thomas  S.  Parish,  Program  Chair 
at  (913)  532-5537  or  tparish@coe.educ.ksu.edu 


Celebrating  Our  2 1 st  Anniversary! 


loot 


Mid-Western 

Educational 

Research 

Association 

Annual  Meeting 
Chicago , Hiinois 
Oct . 1518,  1997 

Dealing  With  the 
"Isms"  in  Education 


This  year  we'll  reach  a real  benchmark  since 
this  will  be  our  21st  meeting  of  M-WERAI  Yes, 
M-WERA  has  been  growing  and  developing, 
and  is  now  ready  to  grapple  with  some  mature 
topics  that  have  wide-ranging  social 
significance.  For  instance,  our  two  featured 
speakers  will  be  Dr.  Robert  Shoop  and  Dr. 
James  Boyer,  and  they  will  consider  some  of 
the  "Isms"  confronting  education  today. 
SpeciPcally,  Dr.  Shoop  will  deal  with  the  notion 
of  "Sexism  in  Education"  as  he  directs  his 
remarks  toward  the  growing  problem  of  sexual 
harassment  at  all  levels  of  education,  and 
what  we  need  to  do  to  prevent  and/or 
eradicate  it.  Then  Dr.  Boyer  will  seek  to 
summarize  the  ongoing  problem  of  racism  in 
education  as  he  examines  some  of  the  current 
trends  in  cultural  diversity  research  which 
everyone  should  be  aware  of  whether  they  are 
educators,  administrators,  and/or  other 
ancillary  personnel. 

For  more  information  and/or  registration 
materials,  please  contact: 

Thomas  S.  Parish,  M-WERA  Program  Chair 

College  of  Education 

Kansas  State  University 

363  Bluemont  Hall 

Manhattan,  KS  66506 

Voice  mail:  (913)  532-5537 

FAX:  (913)  532-7304 

E-mail:  tparish@coe.cduc.ksu.edu 


Featured 

Speakers: 


Dr,  Robert  J.  Shoop 

is  a professor  of  educational 
law  at  Kansas  State  Univer- 
sity. He  has  authored  more 
than  100  refereed  journal 
articles,  nine  books,  and 
several  monographs  and 
book  chapters  that  deal 
with  various  legal  issues. 

His  most  recent  books  are: 

Sexual  Harassment  in  Our  Schools,  How  To 


Stop  Sexual  Harassment  in  Our  Schools,  and 


Sexual  Harassment  on  Campus.  He  has  also 


produced  video  programs  regarding  ways  to 
eliminate  sexual  harassment  that  have  won 
n^Jonal  and  international  awards,  plus  Dr. 
Shoop  has  been  the  recipient  of  various 
teaching  excellence  awards,  has  served  as 
the  director  of  the  Education  Law  Associa- 
tion, and  has  frequently  served  as  an  expert 
witness  in  numerous  sexual  harassment  and 
abuse  cases. 


Dr.  James  B,  Boyer 

is  a professor  of  curriculum 
and  American  ethnic 
studies  at  Kansas  State 
University.  Since  he 
completed  his  Ph.D.  at  the 
Ohio  State  University,  he 
has  dedicated  his  efforts  to 
teaching  and  researching  J i 
the  field  of  Multicultural  Understandings  and 
Issues  of  Diversity.  His  most  recent  book 
(co-authored  with  Prentice  Baptiste)  is 
entitled  Transformina  the  Curriculum  for 


Multicultural  Understandings.  At  present.  Dr. 
Boyer  serves  as  President  of  an  independent 
multicultural  research  Firm,  plus  he  contin- 
ues to  serve  as  an  educational  consultant 
for  school  districts,  corporations,  govern- 
ment agencies,  and  other  organizations 
throughout  the  United  States  that  are  con- 
cerned with  providing  human  services  to  all. 

Other  Featured  Speakers 

may  be  invited  by  the  various  division  chairs 
within  M-WERA.  At  this  time,  however,  these 
speakers  have  not  been  selected. 


Meeting  Registration  Form 

1997  M-WERA  Annual  Meeting,  Chicago,  IL  - October  15-18,  1997 

Please  complete  EACH  section  of  the  form  below.  All  attendees,  including  program  presenters,  must  register  and  pay 
applicable  fees.  Please  clearly  print  or  type  your  name  as  you  wish  it  to  appear  on  your  meeting  badge,  rionmembers 
wishing  to  apply  for  membership  may  register  at  the  member's  rate  if  membership  application  (below)  and  fee  are  enclosed 
with  conference  registration.  (Note:  One  individual  registration  per  form;  duplicate  as  necessary.) 


Name:  

Affiliation: 

Address: 


City/State/Zip:  

Phone:  Business  ( 
Highest  Degree:  _ 


Home  ( 


FAX  ( 


Institution  Awarding  Degree: 


Area  of  Specialization: 
E-mail  Address: 


M-WERA  Division  Preference: 


Is  this  your  first  M-WERA  Conference?  □ Yes 


□ No 


MEETING  REGISTRATION 

M-WERA  Member 
Nonmember 

Student  Member  (attach  letter  from 
advisor  or  copy  of  student  ID) 
Attending  Luncheon  Only 


Postmarked  by  Sept*  20 

$45.00 

$50.00 

$30.00 

$25.00 


After  Sept*  20 

$55.00 

$60.00 

$35.00 

$28.00 


TOTAL  Registration  Fee  Enclosed: 


The  Friday  Luncheon  is  included  in  the  Registration  Fee. 

Will  you  be  attending  the  Luncheon?  □ Yes 

Will  a special  menu  be  required?  □ Yes 


□ No 

□ No 


M-WERA  MEMBERSHIP  DUES 

1997  Membership  Dues 

(required  for  Presenters) 

1998  Membership  Dues 
Lifetime  Membership  Dues 


Regular  - $ 1 8.00  Student  - $ 1 0.00 

Regular  -$  1 8.00  Student  -$  1 0.00 
$180.00 

TOTAL  Membership  Dues  Enclosed:  _ 


M-WERA  MATERIALS* 

* Materials  MUST  be  picked  up  at  the  conference.  (Please  indicate  quantity  desired.) 


M-WERA  Membership  Directory 
M-WERA  '97  Annual  Meeting  Abstracts 
M-WERA  Lapel  Pin 


$7.00  each 

$4.00  paper/$3.00  IBM 
$3.00  each 


TOTAL  Materials  Fee  Enclosed: 


TOTAL  FEES  ENCLOSED: 


When  registering  and/or  joining,  please  make  chcck(s)  payable  to  M-WERA,  and  mail  completed  form(s)  to:  Dr. 
Jean  Pierce,  Northern  Illinois  University,  Department  EPCSE,  DcKalb,  Illinois  601  15. 
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Hotel  Room  Reservation  Form 

Mail  this  form  to  the  hotel  - to  be  received  by  September  20,  1997, 
Organization:  Mid-Western  Educational  Researcher  Association  (M-WERA) 

To  make  your  hotel  room  reservation,  please  complete  and  send  this  form  to: 

Reservations  Manager 
Holiday  Inn-Mart  Plaza 
300  North  Orleans  Street 
Chicago.  IL  60654 

or  call: 

(312)  836-5000 

Specially  reduced  room  rates  are  available  to  conference  participants.  To  ensure  a room  at  the  special  rate, 
reservations  must  be  received  by  the  hotel  by  September  20,  1997.  After  that  date,  reservations  will  be 
made  at  the  prevailing  rate  on  a space  available  basis. 


Marne:  Phone:  

Company/Alliance:  

Address: 

City/State/Zip:  

Sharing  Room  With: . 

Method  of  Payment:  □ Check  (attached) 

□ Credit  Card  (Mo.  ) 

Signature: 

Expiration  Date:  


Arrival  Date:  Arrival  Time:  Departure  Date: 

Reservations  will  be  held  until  6:00  p.m.  unless  guaranteed* 

Check  Type  of  Accomodation  Requested: 


□ Single  Occupancy  ( 1 double  bed)  $101  □ Triple  Occupancy  (2  double  beds)  $111 

□ Double  Occupancy  ( 1 double  bed)  $101  □ Quad  Occupancy  (2  double  beds)  $121 

□ no  Smoking  Room,  if  available  □ Special  Accomodations  needed?  □ Yes  □ no 

If  Yes,  please  specify:  

*To  guarantee  your  reservation,  please  call  Holiday  Inn  reservations  at  the  number  above  or  complete  this  form 
and  mail  it  with  a check  for  one  night's  cost  payable  to  the  Holiday  Inn-  Mart  Plaza  Hotel,  or  provide  your  credit 
card  (AMEX,  VISA,  or  MasterCard)  information  in  the  above  space. 

For  guaranteed  reservations  only , / understand  that  1 am  responsible  for  one  night's  room  and  tax  charges 
which  will  be  deducted  from  my  deposit  or  charged  to  my  credit  card  if  I fail  to  cancel  my  reservation. 


Signature: 

All  rooms  subject  to  local  city  tax. 
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NOTE:  Motel  parking  is  $ 12  per  day  (no  valet). 


Explorations  of  Preservice  Teachers’  Learning  Strategy  Use 


M.  Kay  Alderman 
The  University  of  Akron 

Loretta  Wilkinson 

Northeastern  Ohio  Universities  College  of  Medicine 

Abstract 

The  objectives  were  to  identify  learning  strategy  strengths  and  weaknesses  of  p re  service  teachers  (n  = 
90)  in  an  entry  level  educational  psychology  course  that  incorporated  strategy  instruction.  Strategy  use 
way  assessed  at  the  beginning  and  end  of  the  course  by  the  Learning  and  Study  Strategies  Inventor y 
(LASSl),  a diagnostic  inventory  of  10  scales.  A comparison  of  w°an  percentiles  with  LASSl  norms  on 
all  scales  indicated  need  for  remediation  by  students.  The  results  indicated  that  learning  strategy  scores 
varied  according  to  student  GPA  and  final  course  grade.  Implications  for  preservice  teachers  as  learn- 
ers and  potential  teachers  of  strategies  were  discussed. 


What  do  we  know  about  strategy  use  of  college  stu- 
dents and  preservice  teachers?  With  the  onset  of  the  re- 
search on  cognition,  the  role  of  the  learner  in  acquisition  of 
content  has  received  increased  emphasis  (Weinstein  & 
Mayer,  1986),  that  is,  the  student’s  activities  or  strategies 
are  seen  as  a key  component  in  successful  learning.  This  in 
turn  has  led  to  an  increased  interest  in  learning  strategy  in- 
struction (Chipman  & Segal,  1985;  Phye  & Andre,  1986) 
including  increased  research  about  the  strategy  use  of 
postsecondary  students  and  programs  to  train  strategy  use  at 
this  level  (McKeachie,  1987;  Weinstein  & Underwood,  1985). 

The  initial  concern  for  the  need  for  strategy  instruction 
at  the  postsecondary  level  was  focused  primarily  on  the 
underprepared  or  at-risk  student  (McKeachie,  1987; 
Weinstein  & Underwood,  1985).  There  is  increasing  evi- 
dence that  many  college  students,  not  just  those  categorized 
as  “at-risk,”  arc  in  need  of  strategy  instruction  if  they  are  to 
perform  well.  Simpson  (1984)  reported  that  college  fresh- 
men were  deficient  in  several  areas;  possessed  restricted 
range  of  strategies,  lacked  an  understanding  of  why  a strat- 
egy was  important  to  their  own  learning  processing,  and  used 
one  strategy  for  most  learning  tasks  regardless  of  the  con- 
tent area.  In  a study  of  514  college  freshmen,  Hulick  & 
Higginson  (1989)  found;  students  scored  lower  than  the 
normed  sample  on  a measure  of  learning  strategy  use,  the 
Learning  and  Study  Strategies  Inventory  (LASSl);  students 
who  used  strategies  had  higher  grades  at  the  end  of  the  fresh- 
man year;  and  students  who  scored  lower  on  several 
subscalcs  judged  college  to  be  more  difficult.  In  support  of 
the  need  for  strategy  instruction  at  the  college  level,  only 
24*7c  reported  they  had  even  minimal  training  in  the  use  of 
learning  strategics  prior  to  college. 

This  concern  with  learning  strategy  proficiency  extended 
to  the  learning  strategy  use  of  students  who  arc  enrolled  in 
teacher  education  programs  in  this  university.  From  obser- 
vations and  informal  assessment  of  student  strategy  use,  it 
was  inferred  that  many  students  had  a limited  repertoire  of 
strategics.  On  this  basis  weekly  “mini-lessons”  in  strategy 


use  and  student  learning  logs  were  included  in  an  under- 
graduate educational  psychology  course.  Descriptive  data 
gathered  through  student  learning  logs  gave  a clearer  pic- 
ture of  the  preservice  teachers  as  learners  (Alderman.  Klein, 
Seeley  & Sanders,  1993).  The  students  were  categorized  as 
successful,  improving,  and  less  successful.  Students  identi- 
fied as  successful  and  improving  reported  more  use  of  spe- 
cific as  opposed  to  general  strategies,  set  specific  as  opposed 
to  general  goals,  and  engaged  in  more  self  monitoring  be- 
havior. From  these  data,  the  authors  concluded  that  there  is 
a need  to  identify,  through  assessment,  more  specific  strat- 
egy needs  in  order  to  provide  more  effective  instruction. 

The  present  approach  to  learning  strategy  assessment  is 
a reflection  of  the  cognitive  research  of  recent  years.  Focus 
of  cognitive  research  in  the  seventies  and  eighties  was  on 
remediation  of  learning  deficits  in  academically 
underprepared  students  (Weinstein,  1988).  This  led  to  a need 
to  identify  a means  of  assessing  student  deficiencies  in  order 
to  provide  appropriate  remediation. 

Prior  assessment  approaches  focused  on  traditional  “study 
skill”  areas  such  as  notetaking  and  test  taking  and  tended  to 
use  a “correlational  design”  (Svensson,  1977).  Since  items 
were  created  on  the  basis  of  how  well  they  distinguished  be- 
tween students  with  high  and  low  grade  point  averages,  they 
provided  little  information  about  how  students  study  or  learn. 
In  contrast,  a “functional  approach”  to  assessment  identifies 
differences  in  how  students  learn,  which  directly  affects  learn- 
ing and  academic  outcomes  (Svensson,  1977). 

The  Learning  and  Study  Strategies  Inventory  (LASSl) 
(Weinstein,  Palmer,  & Schulte,  1987)  was  developed  as  a 
functional  approach.  The  LASSl  consists  of  ten  scales:  at- 
titude --  attitude  and  interest  in  college;  motivation  - will- 
ingness to  work  hard  and  take  responsibility  for  own  effort; 
time  management  - organization  and  scheduling  of  time; 
anxiety  — degree  of  worry  about  school  and  performance; 
concentration  ability  to  pay  close  attention  to  academic 
tasks;  information  processing  - imaginal  and  verbal  elabo- 
ration; selecting  main  idea  - ability  to  pick  out  most  impor- 
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tanl  ideas;  study  aids  — use  of  support  techniques  or  materi- 
als; self-testing  — comprehension  monitoring;  test-taking 
strategies  --  preparation  for  exams.  The  scoring  manual  pro- 
vides norms  for  the  subscales  with  suggestions  that  students 
above  the  75th  percentile  do  not  need  remediation;  those 
between  75th  and  50th  percentiles  should  consider  improv- 
ing relevant  strategies  in  order  to  optimize  performance, 
while  those  below  the  50th  percentile  need  to  improve  in 
order  to  have  a chance  of  success  in  school  (Weinstein,  1987). 

The  functionality  of  the  LASSI  as  a measure  is  sup- 
ported to  some  degree  by  Hulick  & Higginson  (1989).  It 
was  found  that  low  and  high  GPA  (above  and  below  2.75) 
students  differed  significantly  on  six  subscales:  attitude, 
motivation,  anxiety,  concentration,  information  processing, 
and  test  taking  skills. 

Our  purpose  in  this  exploratory  study  was  to  determine 
the  learning  strategy  proficiency  of  preservice  teachers  to 
determine  if  course  success  could  be  predicted  by  strengths 
and  weaknesses  of  reported  learning  strategy  use.  If  differ- 
ences existed  between  successful  and  unsuccessful  student 
scores,  a second  purpose  was  to  identify  strategies  used  by 
the  successful  students.  Tne  specific  research  questions  ad- 
dressed were: 

1.  What  learning  strategy  patterns  are  reported  by 
preservice  teachers  and  how  do  these  compare  to  the 
established  norms  of  the  LASSI? 

2.  How  do  learning  strategy  patterns  of  preservice  teach- 
ers vary  according  to  specified  GPA  groups? 

3.  What  were  relationships  between  learning  strategy  pat- 
terns and  course  grade? 

4 Do  gain  scores  from  entry  to  exit  vary  according  to  GPA 
group  membership? 

Method 

Subjects  and  Assessment 

The  subjects  (n=90)  were  enrolled  in  two  sections  of  a 
sophomore  level  educational  psychology  course  in  an  open- 
admission  university.  Approximately  68  percent  of  these 
students  were  female.  The  course  is  required  for  all 
preservicc  teachers  although  most  students  had  not  applied 
for  admittance  to  the  College  of  Education  prior  to  taking 
the  course.  The  GPA  breakdown  for  all  sections  are  shown 
in  Table  1 . 

Table  1 

Subjects  by  GPA  Categories 


Percentage 

GPA  Category  of  Class 


3. 6-4.0 

12.2 

3. 1-3.5 

23.9 

2.6-3  0 

36.1 

2. 1-2.5 

22.4 

< 2.0 

5.4 

Instruments 

Survey.  During  the  first  week  of  the  semester,  students 
were  given  a preassessment  which  consisted  of  questions 
about  their  perceived  expectations  for  performance  in  the 
course,  course  difficulty  (Likert  scale  ranging  1-7  with  1 
low)  adequacy  of  learning  strategies  for  making  an  A or  a B 
(Likert  scale  1-7),  and  GPA. 

LASSI.  The  LASSI  (Weinstein,  Palmer,  & Schulte, 
1987)  was  administered  the  first  week  of  the  course  and  the 
last  week.  The  test  consists  of  77  items  distributed  across 
ten  scales.  Students  respond  to  each  item  from  “not  at  all 
typical  of  me"  to  very  much  typical  of  me."  Items  are  scored 
on  a likert  scale  of  1-5.  Total  scores  are  not  used  since  the 
instrument  was  designed  as  a diagnostic  one.  Test-retest 
reliability  coefficients  on  each  of  the  scales  run  from  .64  to 
.8 1 . Several  of  the  scales  have  been  validated  against  per- 
formance measures.  Scores  on  the  “selecting  main  idea" 
scale  have  been  compared  to  student’s  scores  on  selecting 
main  ideas  from  texts  and  other  readings  (r=.40).  The  scor- 
ing manual  provides  a graph  for  raw  scores  on  subscales  to 
be  converted  to  established  norms  in  order  to  use  established 
norms  for  comparisons  (Weinstein,  1987). 

Course  Description 

This  course  consisted  of  two  large  group  sessions  per 
week  and  one  small  group  session.  Major  goals  of  the  course 
were  for  students  to  learn  the  course  content  at  application 
level  and  become  effective  learners  themselves.  The  two 
primary  evaluation  criteria  were  five  multiple  choice  exams 
and  seven  case  studies.  The  grading  system  was  criterion 
based  allowing  the  first  four  exams  to  be  retaken  with  the 
two  grades  averaged  together.  Learning  strategy  instruction 
was  built  into  the  course  and  consisted  of: 

Weekly  strategy  mini-lessons . These  were  presented  in 
the  large  group  sessions  and  were  about  fifteen  minutes  in 
duration.  The  lessons  included:  PQ4R  (preview,  question, 
read,  recite,  reflect,  review)  (Thomas  & Robinson,  1972), 
goal  setting,  summarization,  keyword  and  other  mnemon- 
ics, and  test  taking  tips. 

STEPS  To  Successful  Performance  Manual  (Alderman, 
1989).  This  was  a motivation  and  learning  strategy  manual 
developed  for  the  course,  providing  expectations  for  per- 
formance and  suggestions  for  motivational  and  cognitive 
strategy  improvement. 

Learning  strategy  labs . These  were  voluntary  adjunct 
labs  offered  weekly  to  provide  more  extensive  strategy  train- 
ing for  students  who  opted  to  do  this. 

Learning  logs.  The  purpose  of  the  logs  was  to  foster 
mctacognitive  awareness.  Students  wrote  weekly  about  their 
learning  strategies  and  received  feedback  every  two  weeks 
from  their  instructor. 
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Results 

Survey 

The  preasscssment  data  of  rankings  of  course  difficulty 
(1-7)  and  adequacy  of  learning  strategies  for  making  an  A 
or  B (1-7)  found  that  the  three  upper  GPA  categories  (from 
2.6  - 4)  rated  course  difficulty  as  4.5  with  the  lower  two 
groups  rating  it  4.7  and  4.9  respectively.  All  GPA  groups 
except  those  below'  2.5  rated  adequacy  of  study  skills  for 
attaining  an  A or  B above  5.5.  Those  below  2.6  rated  ad- 
equacy 4.8  and  4.3  respectively. 

Norm  comparisons  - patterns.  What  learning  strategy 
patterns  do  preservice  teachers  report  and  how  do  these  com- 
pare to  the  established  norms  of  the  LASSI?  Entry  and  exit 
group  mean  percentiles  are  displayed  in  Figure  1 as  they 
compare  to  the  norms  for  the  LASSI.  Group  means  for  the 
LASSI  pretest  showed  that  these  students  scored  near  the 
50th  percentile  as  compared  to  the  norms  presented  on  the 
LASSI  graph.  Group  means  for  this  population  ranged  be- 
tween the  45th  percentile  and  the  60th  percentile.  As  a group 
the  highest  scores  were  on  the  Attitude  and  Concentration 
subscales  followed  by  Time  Management,  Use  of  Study  Aids, 
and  Self  Testing  strategies.  The  lowest  subscale  score  was 
Information  Processing.  Motivation,  Anxiety,  and  Select- 
ing the  Main  Idea  subscale  scores  fell  around  the  50th  per- 
centile. 


LASS’  Seal. 


Figure  I.  LASSI  entry  and  exit  mean  percentile  scores. 


LASSI  pattc ms  by  GPA  categories.  At  course  entry,  do 
learning  strategy  patterns  of  preservice  teachers  vary  accord- 
ing to  specified  GPA  groups?  A MANOVA  was  conducted 
to  determine  if  there  w ere  significant  differences  among  the 
four  GPA  groups  on  the  1 0 scales  of  the  LASSI.  The  results 
indicated  significant  differences  on  six  of  ten  scales.  The 
Wilk\s  lambda  approximate  F value  was  significant  F (4. 
69)  = 7.60.  p<  .0001. 


Following  a significantly  different  MANOVA, 
univariate  analyses  of  variance  were  performed  on  each  scale 
to  determine  which  variables  displayed  significant  mean  dif- 
ferences. The  variables  with  significant  differences  were: 
Attitude,  F (4,  69)  = 4.91, p<  .0015;  Motivation.  F (4,  69)  = 
3.21,p<  .018;  Time  Management,  F(4,  69)  = 3.16,p<  .02; 
Anxiety,  F (4,  69)  = 4.99,  p,  < .0014;  Concentration,  F (4, 
69)  = 5. 1 8,  p<  .0010;  Test  Strategies,  F (4,  69)  = 7.  60,  p.  < 
.0001.  Scheffe  post  hoc  tests,  with  an  alpha  level  of  .05, 
w-ere  performed  on  variables  showing  significant  differences. 
These  tests  indicated  upper  GPA  groups  scored  higher  than 
lower  groups  in  all  cases.  On  the  Attitude  scale,  GPA  3.1-3- 
5 had  higher  scores  than  2.1  - 2.5;  on  Anxiety,  GPAs  from 
3.1  to  4.0  were  higher  than  2.0  - 2.5  ; on  Concentration  4.0 
scored  higher  than  2. 1 -2.5;  on  Test  Strategies,  4.0  was  higher 
than  the  two  lowest  categories,  2.1  - 3.0. 

Of  major  interest  to  us  is  how  means  for  each  GPA  cat- 
egory compare  with  LASSI  norms.  When  means  were  placed 
on  the  normed  graph  (see  Figure  2)  each  GPA  group  had  a 
different  pattern  of  learning  strategy  use.  A very  exagger- 
ated pattern  difference  can  be  seen  between  students  above 
and  below  a GPA  of  3.0.  This  is  consistent  with  results  from 
the  MANOVA. 


to 
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LASSI  Scatc 

Figure  2.  LASSI  mean  entry  percentile  scores  for  each 
college  GPA  level. 

LASSI  patterns  and  relationships  to  final  course  grade. 
What  were  relationships  between  entering  LASSI  patterns 
and  course  grade?  A MANOVA  was  conducted  to  deter- 
mine if  there  were  significant  differences  among  the  course 
grade  groups  (A,  B,  C,  D)  on  the  10  scales  of  the  LASSI. 
The  results  indicated  significant  differences  on  three  of  ten 
scales.  The  Wilk's  lambda  approximate  F value  was  sig- 
nificant F (3,  63)  = 3.60,  p < .016. 

Having  found  ■ ign i fi cant  differences  using  the 
MANOVA,  univariate  analy*  *s  of  variance  were  performed 
on  each  scale  to  determine  which  variables  displayed  sig- 
nificant mean  differences.  To  determine  where  these  differ- 
ences were.  i.e.  between  which  course  grade  groups,  post 
hoc  analyses  using  the  Scheffe  test  w ere  performed  on  vari- 
ables where  significant  F-lcsts  had  been  found.  ‘I  hose  scales 
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with  significant  F's  follow:  Motivation,  F (3,  63)  = 6.22,  p 
< .0009;  Concentration,  E (3,  63)  = 3.42,  p < .022;  Test  Strat- 
egics,? (3,  63)  = 3.69,  p,  < .016.  For  each  of  the  significant 
differences  (alpha  05),  students  who  scored  higher  in  the 
course  had  higher  LASSl  scale  scores.  On  the  Motivation 
scale,  the  A students  had  higher  scores  than  both  the  C and 
D students;  the  difference  in  means  were  6.064  and  7.014 
respectively.  For  both  Concentration  and  Test  Strategies,  A 
students  had  scores  significantly  higher  than  C students;  the 
difference  in  means  were  6. 107  and  4.893  respectively. 

Predictors  of  final  grade.  To  determine  which  variable 
accounted  for  the  most  variance  in  final  grade,  each  of  the 
LASSl  entry  scores  was  regressed  on  the  final  grade.  The 
only  variable  which  accounted  for  a significant  amount  of 
variance  was  Motivation,  F (3,  63)  = 9.763,_p_  = < 0.0027. 
No  other  LASSl  variable  contributed  enough  variance  within 
the  final  grade  to  be  significant. 

When  each  of  the  LASSl  exit  scores  was  regressed  on 
the  final  grade,  this  changed.  Test  Strategies  accounted  for 
a significant  amount  of  variance  in  final  grade,  F (3,  63)  = 
31.657,  p < = 0.0001;  the  R2  full  model  = 0.5482  and  the 
R2  restricted  model  = 0.3857.  When  the  regression  proce- 
dure was  used  to  test  the  amount  of  variance  college  GPA 
accounted  for,  it,  too,  was  significant,?  (3, 63)  = 1 7.6428.  p 
= 0.0001.  R2  full  =0.4835  and  R2  restricted  = 0.3048. 

Do  gain  scores  from  entry  to  exit  vary  according  to  GPA 
group  membership?  When  pre-  and  posttest  scores  were 
plotted  on  the  normed  graph,  students  appeared  to  separate 
at  the  3.0  level.  GPA  groups  were  then  collapsed  to  two 
categories,  greater  and  less  than  3.0.  To  determine  whether 
one  GPA  group  or  other  gained  more  from  entry  to  exit,  mul- 
tivariate pair-wise  t comparisons  was  conducted.  None  of 
the  scales  produced  a significant  t indicating  that  neither  cat- 
egory gained  more  than  the  other  from  entry  to  exit. 

Discussion 

What  learning  strategy  patterns  were  reported  by  this 
population  of  preservicc  teachers  and  how  do  these  scores 
compare  with  national  norms?  Weinstein  (1987)  reports  that 
the  75th  percentile  is  a common  cutoff  score  for  determin- 
ing which  students  need  intervention.  Students  between  the 
50th  and  75th  percentiles  should  consider  improving  relevant 
strategics  in  order  to  optimize  performance,  while  those  be- 
low the  50th  percentile  need  to  improve  in  order  to  have  a 
chance  of  success  in  school.  When  LASSl  subscale  scores 
for  this  population  were  compared  to  the  national  norms, 
percentile  mean  scores  ranged  from  the  45th  to  the  60th  per- 
centile. This  indicates  that,  as  a group,  students  arc  in  need 
of  some  learning  strategy  improvement.  The  students  were 
weakest  in:  Motivation  - willingness  to  work  hard  and  take 
responsibility  for  their  own  learning;  Anxiety  - degree  of 
worry  about  school  and  performance;  Information  Process- 
ing - iinaginal  and  verbal  elaborations;  Selecting  The  Main 
Idea  - ability  to  pick  out  most  important  ideas;  and  Test  Strat- 
egics - preparation  for  exams. 


What  do  these  scores  mean  for  a group  of  predominantly 
sophomore  preservicc  teachers?  From  survey  of  strategy 
adequacy  and  entry  LASSl  score,  it  appears  that,  as  a group, 
these  students  were  somewhat  unaware  of  their  learning  strat- 
egy strengths  and  weaknesses  in  relation  to  course  difficulty. 
On  the  survey,  they  rated  adequacy  for  making  an  A or  B as 
4.3  or  higher  while  65  percent  had  a GPA  below  a 3. 1 . They 
tended  to  underrate  course  difficulty  while  overestimating 
their  strategy  proficiency.  Although  we  did  not  determine 
previous  learning  strategy  instruction  of  these  students,  in 
the  Hulick  and  Higginson  (1989)  study,  only  24  percent  re- 
ported having  had  even  limited  instruction  in  any  learning 
strategies  prior  to  college. 

in  the  present  study,  gioup  means  appeared  to  mask  in- 
formative data.  How  did  students  vary  across  GPA  groups? 
Once  the  entry  scores  were  plotted  by  GPA  group,  variabil- 
ity among  groups  was  evident.  It  appears  that  these  students 
tended  to  separate  into  two  groups,  at  the  3.0  GPA  level. 
Although  clear  differences  can  be  seen  between  these  two 
groups  on  the  motivational  scales,  the  actual  learning  strat- 
egy means  are  more  erratic  and  less  definitive  as  seen  in 
Figure  2.  The  erratic  pattern  on  learning  strategies  may  be 
an  indication  that  students  coming  into  this  course  lack  a 
core  set  of  learning  strategies. 

Which  LASSl  scores  indicated  differences  by  final 
grade?  Three  scales  which  showed  significant  differences 
by  final  grade  were  Motivation,  Concentration  and  Test  Strat- 
egics. On  each  of  these  three  scales,  students  making  an  A 
had  higher  entry  scores  than  other  grade  levels.  According 
to  descriptions  of  scales,  these  students  are  described  as 
willing  to  work  hard,  accept  responsibility  for  performing 
tasks  related  to  course  success,  focus  their  attention  on  the 
task  at  hand,  and  know  about  characteristics  of  tests,  test 
items,  and  test  preparation.  * 

How  do  end  of  course  LASSl  scores  compare  to  begin- 
ning scores?  For  the  whole  group,  all  scales  increased  ex- 
cept Time  Management,  Concentration,  Anxiety,  and  Test 
Strategies  and  no  scales  decreased.  One  important  finding 
is  that  students  above  and  below  3.0  GPA  gained  equally  on 
the  LASSL  Thus  high  and  low  GPA  categories  arc  in  need 
of  learning  strategy  instruction. 

The  patterns  described  in  this  study  reveal  that  students 
entering  teacher  education  cannot  be  assumed  to  possess  a 
repertoire  of  effective  learning  strategics.  Who  needs  inter- 
vention? From  this  data,  it  appears  that  almost  all  preservicc 
teachers  in  this  open  admission  university  were  in  need  of 
some  degree  of  strategy  intervention.  For  students  at  the 
upper  GPA  levels,  more  effective  strategies  will  enable  them 
to  optimize  performance  as  they  proceed  to  upper  level 
courses.  Students  at  the  lower  GPA  levels  need  more  effec- 
tive strategies  to  improve  chance  of  success  in  college  and 
to  do  more  than  “gel  through'’  their  teacher  education  pro- 
gram. If  preservicc  teachers  arc  to  become  teachers  of  learn- 
ing strategies,  teacher  educators  must  help  them  develop  this 
repertoire. 
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Minds-on  and  Hands-on  Activity:  Improving  Instruction 

in  Science  for  All  Students 

Thomas  Andre 
Iowa  State  University 

Abstract 

This  paper  briefly  reviews  evidence  on  gender  inequities  in  science  education.  It  argues  that  making  science 
instruction  more  effective  is  one  way  in  which  greater  equity  can  be  achieved  A line  of  research  conducted 
in  my  laboratory  dealing  with  conceptual  change  ( CC)  approaches  to  science  instruction  is  discussed  CC 
instruction  explicitly  activates  students'  pre-existing  conceptions,  leads  students  to  be  dissatisfied  with  less 
than  adequate  conceptions,  and  helps  students  construct  more  effective  conceptions . Across  several  studies, 
CC  instruction  was  found  to  be  more  effective  than  didactic  instruction . CC  features  added  to  science  text 
and  science  lessons  facilitate  learning  for  both  males  and  females.  Finally,  I argue  that  in  adopting  new 
mathematics  and  science  curriculum  standards,  it  is  important  to  recognize  the  need  to  promote  CC  and  that 
" minds-on  ’ as  well  as  u hands-on  ” approaches  are  essential  to  effective  learning. 


Once  upon  a time,  a quantitatively  oriented  cognitive  edu- 
cational psychologist  set  off  on  a journey  to  investigate  and 
contribute  something  to  research  in  science  education.  On  that 
journey,  he  probably  became  a little  less  “objectivist,”  more 
appreciative  of  alternative  research  approaches,  more  aware  of 
problems  in  teaching  science,  and  of  reasons  for  the  under-rep- 
rcsentation  of  women  and  minorities  in  some  domains  of  sci- 
ence. This  paper  is,  in  part,  a story  of  that  journey. 

I have  three  purposes  in  this  paper:  (a)  to  highlight  the 
problems  of  under-representation  in  some  domains  in  science, 
(b)  to  discuss  some  of  my  research  on  the  conceptual  change 
(CC)  model  in  science  education,  and  (c)  to  highlight  the  need 
to  include  CC  approaches  in  the  emerging  constructively  ori- 
ented, activity-  and  manipulative-focused  science  curricula. 

Let  me  begin  by  highlighting  some  data  on  under-repre- 
sentation  in  science.  Because  my  research  only  involves  gen- 
der, I will  focus  on  gender  under-representation,  but  I recognize 
that  ethnic  under-representation  deserves  equal  emphasis. 

A common  stereotype  is  that  women  show  less  interest  in 
science  and  that  women  perform  less  well  in  science.  Like  most 
common  stereotypes,  this  one  has  a grain  of  truth  but  is  less  than 
entirely  accurate.  Matthews  ( 1990)  reported  that  women  com- 
prise about  45%  of  the  bachelor's  degrees  in  the  life  sciences  and 
mathematics.  Thus,  gender  differences  are  not  large  in  these  ar- 
eas. However,  women  only  receive  about  35%  of  the  bachelor’s 
degrees  in  computer  science,  30%  in  physical  science,  and  1 5% 
of  in  engineering.  Clearly,  a more  serious  undcr-reprcscntation 
occurs  in  the  latter  areas.  Astin  and  Astin  (1992)  reported  that 
about  50%  of  first  year  students  and  graduates  in  biology  are 
women,  but  only  about  35%  of  first  year  students  and  graduates 
in  physical  science  and  20%  of  first  year  students  and  graduates 
in  engineering  arc  women.  Vetter  (1988)  reported  that  approxi- 
mately 1 2%  of  employed  physical  scientists  arc  women,  22%  of 
individuals  employed  in  mathematical  fields  are  women,  and  25% 
ol  individuals  employed  in  computer  programming  or  scientist 
positions  are  women.  The  reason  is  not  because  there  are  no 
women  applicants.  Vetter  (1988)  reported  that  a higher  propor- 
tion of  women  than  men  arc  seeking  employment  in  these  fields. 


The  math/science  “pipeline”  data  also  support  gender  un- 
der-representation. Berryman  (1983)  used  the  pipeline  meta- 
phor to  represent  the  flow  of  students  into  careers  that  require 
substantial  education  in  mathematics  and  science.  Leakage 
from  the  pipeline  was  large.  Of  the  20%  of  all  students  who 
report  some  interest  in  science/mathematics  careers  early  in 
high  school,  only  5%  complete  bachelor’s  degrees  in  these 
fields  and  only  0.2%  complete  doctoral  degrees  (Task  Force 
on  Women,  Minorities,  and  the  Handicapped  in  Science  and 
Technology,  1988).  Hilton  and  Lee  (1988)  reported  gender 
related  pipeline  data  from  the  “High  School  and  Beyond”  stud- 
ies. About  20-25%  of  the  males  are  in  the  pipeline  in  grade 
12;  this  drops  to  about  5%  of  males  graduating  college  in  the 
sciences  and  2-3%  in  graduate  school.  For  females  the  com- 
parable numbers  are  7%,  2-3%,  and  1-2%.  Clearly,  females 
represeni  a smaller  proportion  of  the  pipeline  than  do  males. 
In  one  of  the  most  sophisticated  of  the  pipeline  studies, 
Brookhart  (1994)  examined  individuals  who  left,  entered  and 
persisted  in  the  math/science/engineering  pipelines.  By  the 
first  year  of  college,  only  about  two  thirds  as  many  females 
( 1 0%)  as  males  ( 1 5%)  remained  in  the  pipeline.  Clearly,  women 
arc  underrepresented  in  physical  science  occupations  because 
fewer  traverse  the  pipeline. 

Why  is  it  important  that  women  elect  not  to  pursue  physi- 
cal science  or  engineering  fields ? Here  are  three  important 
reasons: 

1 . Physical  sciences  fields  arc  correlated  with  higher  paying 
positions  in  our  society,  thus,  under-representation  of 
women  contributes  to  gender  inequities  in  salaries  paid  to 
men  and  women. 

2.  It  is  likely  that  at  least  part  of  the  under-representation  of 
women  represents  structural  biases  that  inhibit  women 
from  selecting  physical  science  fields. 

3.  Science  loses  women’s  perspectives  women's  perspectives 
that  may  yield  advances  on  some  problems. 

Why  are  there  fewer  women  in  science ? Much  research 
supports  the  notion  that  women  receive  less  encouragement  in 
the  physical  sciences  and  that  the  climate  and  approaches  to 
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knowledge  in  the  physical  sciences  may  be  less  consistent  with 
the  average  woman's  characteristics  than  the  average  man’s. 
Several  sources  report  that  both  male  and  female  teachers  in- 
teract differently  with  boys  and  girls  when  teaching  science 
and  math.  They  call  on  boys  more  than  girls.  Compared  to 
boys,  girls  arc  more  likely  to  receive  lower  level  questions  and 
feedback  that  implies  lower  ability  and  provides  excuses  for 
mediocre  performance  (See  Kahle  & Mcece  ( 1 995)  for  a com- 
prehensive summary  of  research  on  gender  differences  in  sci- 
ence education.)  Keller  ( 1 982),  Rosser  ( 1 986,  1 990),  and  Rosser 
and  Kelly  (1994)  argued  that  structural  biases  inhibit  women 


from  pursuing  science  and  engineering.  These  biases  included 
glass  ceiling  labor  practices  that  prohibit  women  from  reach- 
ing decision  making  levels,  diminishing  of  “women’s”  scien- 
tific problems  (c.g..  menstrual  cramps,  breast  cancer),  use  of 
males  to  represent  the  species,  and  sexual”  harassment. 

Rosser  (1990)  argues  that  the  epistemological  approach 
of  science  is  inconsistent  with  women's  approaches  to  knowl- 
edge. Asa  result,  the  intellectual  atmosphere  of  science  is  chilly 
to  women.  She  argues  for  differences  between  typical  women's 
and  typical  men’s  approaches  to  science  (Figure  1 ). 

I disagree  partially  with  Rosser.  The  gender  differences 
in  ways  of  doing  science  arc  far  less  absolute  than  she  implies 
and  variance  within  genders  is  far  greater  than  between  gen- 
ders (see  pipeline  argument  below).  However,  she  does  make 
a case  that  typical  differences  exist  and  that  many  women,  par- 
ticularly in  higher  education,  stop  taking  science  because  of 
incompatibilities  in  ways  of  knowing.  Overall,  the  research 


literature  is  sufficiently  strong  to  support  the  conclusion  that 
differences  in  educational  treatment,  coinciding  with  differences 
in  social  expectations,  contribute  substantially  to  the  ler-rcp- 
resentation  of  women  in  physical  science. 

As  an  aside,  I will  comment  on  one  interpretation  of  the 
pipeline  data.  Rosser  ( 1990)  and  others  (c.g.,  Anderson,  1992; 
Bowen,  1 990),  have  argued  that  the  science  education  pipeline 
supports  the  hypothesis  of  differences  in  men’s  and  women's 
ways  of  knowing.  While  there  may  be  average  gender  differ- 
ences in  ways  of  knowing,  differences  between  the  genders  arc 


small  relative  to  individual  differences  within  the  genders. 
Moreover,  the  pipeline  data  make  clear  that  the  overwhelming 
majority  of  both  female  and  male  students  never  enter  or  leave 
the  scicncc/math  pipeline.  How  can  the  fact  that  over  90#  of 
both  males  and  females  elect  non-scicncc/math  careers  be  evi- 
dence of  gender  incompatibilities  in  ways  of  knowing?  Per- 
haps the  90#  plus  of  males  who  avoid  science  also  prefer 
women’s  ways  of  knowing.  If  so,  what  justification  is  there  for 
gender  labeling  such  ways  of  knowing?  I think  Tobias'  (1990) 
view,  that  both  women  and  men  in  the  “second  tier”  prefer  al- 
ternative classroom  approaches  to  those  typically  used  in  the 
physical  sciences  and  engineering,  is  probably  closer  to  the  truth. 
But  1 don’t  want  to  belabor  this  point;  a more  important  ques- 
tion to  me  is  how  to  help  all  students  understand  science  better 
and  how  to  remove  artificial  barriers  that  may  prohibit  female 
students  from  considering  or  pursuing  careers  with  mathemati- 
cal or  scientific  underpinnings. 


Women 

Men 

♦ 

Expansion  of  the  types  of  observations  used  in  science 

♦ 

Fewer  types  of  observations  used  in  science 

♦ 

Increasing  the  length  of  the  observ  ational  period 

♦ 

Shorter  observational  periods 

♦ 

Acceptance  of  personal  experience  as  part  of  sci- 
entific data 

♦ 

Rejections  of  personal  experience  as  part  of  scientific 
data 

♦ 

Deeming  women’s  problems  worthy  of  research 

♦ 

Focusing  oi . problems  related  io  men 

♦ 

Including  gender  as  part  of  scientific  hypotheses 

♦ 

Using  men  to  represent  the  species,  excluding  gen- 

♦ 

Adopting  a more  holistic  approach  to  scientific 

dcr  as  part  of  scientific  hypotheses 

problems 

♦ 

Adopting  a more  narrow*,  less  contextual  approach 

♦ 

Combining  qualitative  and  quantitative  methods 

to  scientific  problems 

♦ 

Greater  use  of  cross-disciplinary  research 

♦ 

Focusing  on  quantitative  methods 

♦ 

Including  females  as  research  participants 

♦ 

Less  emphasis  on  cross-disciplinary  rcseaich 

♦ 

Awareness  of  race,  class,  sexual  orientation,  and 

♦ 

Excluding  females  as  research  participants 

religious  biases 

♦ 

Ignoring  possible  race,  class,  sexual  orientation, and 

♦ 

Theories  that  are  relational,  interdependent  and 

religious  biases 

multi -casual,  instead  of  hierarchical  and  reductionist 

♦ 

More  reductionist,  less  situated  theories 

♦ 

Less  compc:itive  models  of  interaction  between 
scientists 

♦ 

More  competitive  models  of  interaction  between 
scientists 

♦ 

Greater  emphases  on  research  methods  that  em- 
phasize participants/rescarcher  interaction 

♦ 

Emphasis  on  research  methods  that  minimize  rc- 
sc arc h/partici pant  interaction 

Figure  J . Differences  between  typical  women’s  and  men’s  approaches  to  science. 
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What  should  we  do  about  gender  inequities ? Many  re- 
forms urged  by  feminist  writers  on  science  should  work  effec- 
tively for  both  female  and  male  students.  This  section  will 
focus  on  one  reform  related  to  my  research.  That  reform  is  to 
teach  science  more  effectively.  Science  often  is  taught  in  a way 
that  makes  it  difficult  for  students  to  understand.  Obviously,  many 
dedicated  elementary  and  secondary  science  teachers  lead  excit- 
ing and  intellectually  challenging  lessons.  However,  I think  that 
many  students  drop  out  of  the  science  pipeline  because  they  don’t 
find  science  either  exciting  or  understandable  as  it  is  taught. 

Science  classes  often  consist  of  students  memorizing  for- 
mulae to  compute  answers  to  word  problems.  Because  there  is 
little  emphasis  on  providing  students  with  a conceptual  under- 
standing of  the  underlying  theory  or  on  addressing  students' 
preexisting  ideas,  students  often  don’t  understand  the  formu- 
lae. So  students  adopt  an  approach  that  one  of  my  undergradu- 
ate assistants  called  “plug  and  chug.”  She  described  her 
performance  in  science  classes  as  grabbing  numbers  from  the 
problems,  plugging  them  into  some  memorized  formula,  and 
chugging  out  an  answer. 

Such  classes  don’t  help  students  focus  on  developing 
conccptuerts  reason  firsi  from  conceptual,  qualitative  models 
before  applying  quantitative  reasoning.  One  way  to  help  stu- 
dents understand  science  more  effectively  may  be  to  help  them 
develop  better  qualitative  models.  In  the  science  education  lit- 
erature, the  approach  called  conceptual  change  (CC)  has  focused 
on  helping  students  change  their  conceptual  qualitative  models. 
During  the  last  several  years,  I have  been  conducting  research  on 
CC  and  science  learning  and  education  (see  Wandcrsee,  Mintzes, 
& Novak  ( 1 995)  for  a review  of  the  CC  literature). 

Within  the  science  education  area,  conceptual  change  is 
jargon  for  an  approach  that  has  its  roots  in  Piaget’s  concept  of 
disequilibrium  and  philosophical  studies  of  Zeitgeist  change  or 
paradigm  shift.  The  fundamental  notion  is  that  the  learner  can 
have  pre-existing  conceptualizations  or  knowledge  structures 
that  may  be  inconsistent  with  the  knowledge  structures  the  cul- 
tures of  the  subject  matter  domain  have  constructed.  These 
pre-existing  knowledge  structures  may  interfere  with  the  learner 
constructing  new  knowledge  consistent  with  the  culture  that 
defines  the  subject  matter.  Put  more  simply,  the  learner  may 
have  beliefs  that  are  inconsistent  with  the  knowledge  beliefs  of 
subject  matter  experts.  In  this  case,  CC  theory  postulates  that 
learners  do  not  meekly  abandon  beliefs.  Instead,  they  may  re- 
interpret the  presented  message  in  a way  consistent  with  their 
beliefs.  Alternatively,  learners  may  engage  in  a kind  of  double 
think  and  hold  to  prior  beliefs,  but  memorize  sufficient  of  the 
subject  matter  knowledge  to  pass  school-based,  inauthentic  tests. 

For  example,  many  students  believe  that  heavier  things 
fall  faster  than  lighter  things.  According  to  CC  theory,  students 
do  not  simply  accept  the  physics  statement  that  objects  fall  at 
the  same  rate.  Rather,  students  memorize  a formula,  s=  1/2  gt\ 
which  allows  them  to  calculate  how  far  an  object  falls  in  a given 
amount  of  time  or  how  fast  it  is  falling  after  so  many  seconds. 
They  answer  quantitative  test  questions  correctly,  but  still  be- 
lieve that  heavier  things  fall  faster  than  lighter  things. 


CC  theory  holds  that  it  is  necessary  to  produce  what  Piaget 
called  disequilibrium  to  encourage  the  student  to  construct  a 
revised  conceptualization.  Posner  and  associates,  in  what  is 
probably  the  best  known  version  of  CC  theory,  argue  that  edu- 
cation needs  to  induce  dissatisfaction  in  the  learner  (Posner, 
Strike,  Hewson,  & Gertzog,  1982).  Once  the  learner  is  dissat- 
isfied, the  instruction  presents  a new  conceptualization  that  the 
learner  will  find  intelligible,  plausible,  and  fruitful.  An  intelli- 
gible, plausible,  and  fruitful  description  will  lead  the  dissatis- 
fied learner  to  construct  a revised  conceptualization. 

CC  theory  argues  that  traditional  instruction  does  not  di- 
rectly try  to  address  students’  misconceptions,  but  should. 
Activating  prior  knowledge  and  explicitly  addressing  and  chal- 
lenging alternative  conceptions  is  necessary  for  the  student  to 
construct  a revised,  understanding. 

My  students  and  I began  to  investigate  how  to  use  CC  in 
facilitating  learning  from  text.  The  work  was  influenced  by  the 
early  work  of  Roth  (1984).  Most  work  on  CC  had  involved 
small  groups  and  in-class  instructional  activities.  Working  with 
Charles  Anderson,  Roth  adapted  the  Posner  et  al.  (1982)  CC 
approach  to  text.  She  included  CC  features  in  existing  texts  on 
how  plants  produce  food.  Compared  to  students  using  the  origi- 
nal text,  students  using  the  CC  texts  were  more  likely  to  adopt 
CC  thinking  and  construct  understandings  of  plant  and  food 
consistent  with  botanist  culture. 

Reasoning  that  text  in  some  form  will  always  be  an  impor- 
tant component  of  instruction,  we  began  to  investigate  how  CC 
features  added  to  text  might  help  students  construct  more  com- 
plete understandings  of  series  and  parallel  circuits  in  electric- 
ity, In  an  early  study,  Wang  and  1 (1991)  modified  an  existing 
middle  school  physical  science  text  to  contain  CC  features.  Our 
modifications  were  straightforward.  Fredettc  & Clement  (1981), 
Osborne  (1983),  and  Shipstone  (1984)  had  identified  common 
misconceptions  students  had  about  scries  circuits.  For  example, 
adevelopmentally  early  misconception  is  called  the  sink  con- 
ception. Students  believe  a single  wire  connection  between  a 
battery  and  a bulb  will  light  the  bulb  because  electricity  flows 
like  water  from  the  battery  to  the  bulb.  To  activate  and  chal- 
lenge the  students’  misconceptions,  we  created  a prototypical 
situation  such  as  a picture  of  a battery  and  bulb  connected  by  a 
single  wire  connection,  and  asked  students  to  predict  if  the  bulb 
would  light.  This  is  shown  in  the  Figure  2. 

Next,  we  directly  addressed  the  misconception  in  the  text 
by  asserting,  “Some  students  believe  that  a single  wire  connec- 
tion between  a battery  and  bulb  will  cause  the  bulb  to  light. 
These  students  arc  wrong.’’  Then,  as  indicated  in  Figure  3,  we 
presented  evidence  that  the  bulb  would  not  light.  We  repeated 
this  basic  approach  for  each  of  the  identified  misconceptions. 
(Subsequently,  we  found  that  Alvermann  and  her  colleagues 
had  developed  a similar  approach  that  they  called  rcfutational 
text,  e.g.,  Hynd  & Alvermann,  1986.) 

To  control  ability  variance,  we  assessed  students’  verbal 
ability  and  obtained  a measure  of  their  experience  with  elec- 
tricity. Because  of  my  past  research  interests,  we  also  included 
or  did  not  include  adjunct  questions  in  text  that  students  had  to 
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answer.  The  adjunct  questions  focused  on  calculations.  So  our 
independent  variables  were:  two  types  of  text  (traditional  ver- 
sus conceptual  change),  presence  or  absence  of  adjunct  ques- 
tions, and  gender 


Will  it  light? 


Figure  2.  Question  designed  to  elicit  pre-existing  conception 
from  Wang  and  Andre  (1991). 


Conceptual 

Change 


Gender  Text  Type 

Figure  4.  Gender  and  Text  type  main  effects  in  analysis  without 
covariates  from  Chambers  & Andre,  1997. 


Will  it  light? 


Figure  3.  Example  of  dissatisfaction  inducing  text  diagram. 


What  did  we  find?  CC  features  produced  a significant 
positive  effect  on  conceptual  understanding,  but  this  main  ef- 
fect was  modified  by  a Text  Type  X Question  Type  X Gender 
interaction.  For  men  given  adjunct  questions  and  for  women 
not  given  adjunct  questions,  the  effect  of  CC  text  was  positive. 
For  women  given  adjunct  questions  and  men  not  given  ad- 
junct questions,  CC  was  neutral.  We  speculated  that  these 
effects  were  due  to  differences  in  motivation.  Women  have 
lower  reported  interest  in  physical  science  (Kahle  & Meece, 
1995).  The  adjunct  question  conditions  imposed  heavy  task 
demands  on  students.  Students  with  a lower  level  of  interest 
may  not  have  been  sufficiently  motivated  to  work  very  hard  to 
meet  those  demands,  but  students  with  a higher  level  of  inter- 
est may  have  been  sufficiently  motivated  to  meet  the  demands 
of  processing  adjunct  questions  and  CC  features.  I wasn't 
satisfied  with  this  explanation,  but  it  led  us  to  explore  the  lela- 
tionship  between  interest  and  CC  text. 

In  Chambers  and  Andre  (1997),  wc  replicated  the  Wang 
and  Andre  (1991)  study  but  added  a measure  of  interest  in 
electricity  along  with  the  experience  and  verbal  ability  mea- 
sures. The  independent  variables  were  gender  and  text  type. 
Wc  also  modified  the  text  and  the  posttest  slightly. 


Traditional  Conceptual 

Text  Change 

Text 

Figure  5.  Adjusted  means  for  men  and  women  given  tradi- 
tional and  conceptual  change  text  in  analysis  with  covariatcs 
(Chambers  & Andre,  1997). 

What  did  wc  find?  Wc  first  analyzed  the  data  without 
controlling  for  interest  or  experience.  There  were  significant 
main  effects  of  gender  and  text  type.  Figure  4 displays  the 
means.  Men  apparently  did  better  than  women  and  CC  text 
led  to  better  performance  than  the  traditional  text.  Next,  we 
analyzed  the  data  using  a covariance  analysis  that  controlled 
for  verbal  ability,  experience,  interest,  and  pretest  knowledge. 
Only  the  main  effect  of  text  type  remained  significant  (see 
Figure  5).  CC  text  led  to  better  performance  than  did  tradi- 
tional text  for  all  students.  In  other  words,  when  we  did  not 
control  for  interest  and  experience,  men  did  better  than  women. 
When  wc  controlled  for  pre-existing  differences,  women  scored 
about  the  same  as  men. 

Wc  replicated  these  findings  in  a second  study  (Cham- 
bers & Andre,  1996).  The  same  basic  variables  were  included. 
Again,  wc  first  analyzed  the  data  without  controlling  for  pre- 
existing differences.  This  analysis  yielded  significant  main 
effects  for  gender  and  for  text  type,  again  men  apparently  out- 
performed women  and  CC  text  led  to  superior  performance. 
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When  we  controlled  for  preexisting  differences,  again  only  the 
effect  of  text  type  was  significant.  Again,  gender  differences  in 
science  learning  seem  to  be  due  to  differences  in  experience 
and  interest. 

In  Chambers  ct  al.  (1994),  we  also  found  that  controlling 
for  the  effects  of  verbal  ability,  prior  experience,  and  interest 
eliminated  a main  effect  for  gender.  In  this  study,  we  had  five 
instructional  conditions.  The  first  was  a traditional  text  on  elec- 
tricity. In  the  second  condition,  students  received  the  traditional 
text  augmented  with  more  examples  and  diagrams.  In  the  third 
condition,  students  received  the  CC  text.  In  the  fourth  condi- 
tion students  received  a CC  text.  However,  instead  of  being 
told  that  circuits  would  or  would  not  work,  students  were  told  to 
turn  to  a computer  simulation  that  allowed  them  to  build  electri- 
cal circuits  and  to  determine  for  themselves  if  the  circuit  would 
or  would  not  work.  Finally,  in  a fifth  condition,  students  re- 
ceived CC  text,  but,  after  making  predictions,  were  told  to  turn 
to  actual  light  bulbs,  batteries,  and  wires  to  test  circuits. 

On  a delayed  posttest,  when  interest  and  experience  were 
not  used  as  covariates,  gender  produced  a significant  effect.  But 
when  interest  and  experience  were  covaried,  only  thr  effect  of 
CC  condition  was  significant  for  females,  but  not  males.  Fe- 
males receiving  CC  text  did  better.  Figure  6 displays  the  means. 
The  means  for  the  men  were  quite  high,  and  we  might  have 
failed  to  find  an  effect  because  of  ceiling  effects. 


Men 


25  -j 


] Women 


Figure  6.  Adjusted  means  as  a function  of  gender  and 
condition  from  Chambers  et  al.  ( 1 994)  TT-Traditional,  Text, 
ATT- Augmented  Traditional  Text,  CCT-Conceptual  Change 
Text,  CCTSIM-CCT  with  simulation,  CCTHO-CCT  with 
hands-on  experience 


One  other  of  my  studies  supports  these  findings.  Carlscn 
and  Andre  (1992)  used  CC  texts  in  conjunction  with  computer 
simulations  to  help  students  learn  about  elccU  icity.  When  prior 
experience  was  controlled,  there  were  no  gender  differences 
and  CC  texts  led  to  belter  pcrformanc  and  women  show  simi- 
larities in  how  they  learn  science.  In  each  of  these  studies,  gen- 
der differences  were  found  if  pre-existing  differences  in 
knowledge,  interest  in,  and  experience  with  the  subject  matter 
were  not  considered  in  the  analyses.  When  such  differences 
were  statistically  eliminated,  there  were  no  gender  differences 
in  how  men  and  women  learned  from  CC  text. 


These  results  are  consistent  with  the  results  of  a study  by 
Burbeles  and  Linn  (1988).  Burbeles  and  Linn  found  that  boys 
and  girls  both  profited  from  experiences  that  contradicted  their 
prior  expectations,  but  that,  probably  because  of  pre-existing 
experiential  differences,  girls  required  more  contradicting  ex- 
periences than  did  boys  to  reach  the  same  level  of  understand- 
ing. Finally,  a recent  metaanalysis  of  CC  approaches  reported 
by  Guzzetti,  Snyder,  Glass,  and  Gamat  (1993)  found  signifi- 
cant and  moderately  strong  effects  of  CC  approaches.  I think 
we  can  conclude  that  CC  approaches  do  help  both  male  and 
female  students  develop  better  conceptual  understandings  of 
physical  science  topics. 

Recently  NCTM  and  NSTA  published  new  standards  for 
science  and  mathematics  teaching.  These  new  standards  argue 
that  students  should  be  involved  in  learning  mathematics  and 
science  as  a thinking  activity.  Learning  to  “mathematicize”  or  to 
“science",  that  is  to  use  mathematical  thinking  to  recognize  pat- 
terns and  solve  meaningful  problems  or  to  use  scientific  proce- 
dures to  investigate  authentic  problems,  lie  at  the  core  of  the  new 
standards.  Viewing  the  student  as  an  active  participant  in  the 
construction  of  his/her  knowledge  is  central  to  the  new  standards. 

I heartily  encourage  this  approach  and  think  that  at  least  50% 
of  instructional  time  in  science  should  be  devoted  to  authentic  in- 
vestigative projects  in  which  students  do  science.  There  are  many 
lessons  and  curricula  being  developed  which  use  this  approach. 

But  I am  concerned  that  we  may  miss  the  CC  nugget  in  the 
gold  rush  to  activity-oriented  mathematics  and  science.  Based 
upon  their  research  with  teachers,  Anderson  and  Smith  (1988) 
describe  problematic  activity-oriented  and  discovery-oriented 
teachers  of  science.  Let  me  quote  their  descriptions. 

The  activity-driven  teachers  are  “uncomfortable  teaching 
science.  These  teachers  focus  primarily  on  the  activities  to  be 
carried  out  in  the  classroom:  textbook  reading,  demonstrations, 
experiments,  answering  questions,  and  the  like.  These  teach- 
ers arc  unsure  how  specific  activities  contribute  to  student  learn- 
ing" (p.  100). 

Discovery-oriented  teachers  “using  activity-based  pro- 
grams try  to  avoid  telling  their  students  answers,  encouraging 
them  instead  to  develop  their  own  ideas  from  the  results  of 
experiments.  They  ask  their  students  to  interpret  their  observa- 
tions in  open-ended  ways,  assuming  that  the  performance  of 
the  experiments  will  eventually  lead  students  to  develop  the 
appropriate  scientific  conceptions.  In  the  absence  of  direct  in- 
formation and  feedback  from  the  teachers,  however,  students 
generally  use  their  own  misconceptions  as  the  basis  for  inter- 
pretation of  activities"  (p.  100). 

I ain  concerned  that  without  an  adequate  understanding  of 
conceptual  change,  the  necessity  to  allow  students  opportunity 
and  time  to  accommodate  will  not  he  given.  Let  me  share  a 
case  reported  by  Champagne,  Klopfcr,  and  Gunstone  (1985). 
Seventh  graders  were  taught  a unit  on  falling  bodies  using  a 
conceptual  change  approach  and  much  hands-on  experience. 
But  even  after  several  weeks,  some  students  continued  to  argue 
for  their  original  preconceptions  and  propose  other  alternative 
experiments  that  might  show  that  heavier  bodies  would  fall  faster 
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than  lighter  bodies.  It  was  not  a simple  matter  for  the  students 
to  give  up  or  change  their  preconceptions.  Champagne  et  al.’s 
results  demonstrated  that  these  students  would  not  have  given 
up  their  preconceptions  by  simply  exploring  falling  bodies.  The 
students  needed  to  have  the  teacher  or  the  instruction  point  out 
the  contradiction  between  their  belief  system  and  the  results  of 
their  experiments.  The  students  needed  to  be  encouraged  to 
create  alternative  qualitative  models  that  encompassed  their  new 
observations.  Teachers  needed  to  be  somewhat  directive  in 
facilitating  students’  thinking  towards  construction  of  an  ap- 
propriate new  model. 

Conceptual  change  approaches  can  work  in  real  schools. 
In  1993,  with  sonic  colleagues,  I conducted  a workshop  deal- 
ing with  CC  in  the  areas  of  motion  and  electricity  for  middle 
school  teachers.  After  studying  CC,  teachers  planned  CC  les- 
sons for  their  students  based  upon  the  workshop  materials  (elec- 
tricity and  motion  simulations  and  hands-on  kits).  In  the 
following  academic  year,  the  teachers  taught  the  lessons  to  their 
pupils.  Their  students  displayed  a more  advanced  conceptual 
understanding  of  motion  and  electricity  compared  to  middle- 
school  students  taught  with  traditional  lessons. 

The  CC  approach  is  only  one  of  many  that  can  work  to 
help  students  construct  more  adequate  conceptual  understand- 
ings in  physical  science.  What  features  should  lessons  designed 
to  promote  conceptual  understanding  have?  Such  lessons  should 
contain  motivating  and  intellectually  challenging  activities  that 
lead  students  to  compare  their  preconceptions  with  the  content 
being  taught  and  direct  student  thinking  towards  constructing  a 
re^  :.sed  conceptual  model  similar  to  the  ideas  of  the  culture  of 
scientists.  Such  lesson^  emphasize  developing  the  conceptual 
model  before  developing  strength  in  quantitative  analysis. 
Overall,  the  focus  is  on  ensuring  the  instructional  activities  are 
minds-on  as  well  as  hands-on  (I  want  to  thank  whoever  first 
coined  the  wonderful  minds-on  phrase.)  Certainly,  authentic 
investigation  activities  are  a critical  component  in  reforming 
science  education.  But  education  should  not  adopt  the  obvious 
hands-on  features  of  inquiry  activity  without  incorporating  the 
less  obvious  minds-on  features.  Effective  instruction  needs  to 
incorporate  CC  features  to  achieve  the  full  benefit  of  the  pro- 
posed new  standards.  Instruction  that  incorporates  these  fea- 
tures can  help  to  improve  science  education  for  all  students  and 
can  thereby  contribute  to  reducing  gender  and  minority  inequi- 
ties in  participation  in  science. 

References 

Anderson,  B.  T.  (1992.  Fall).  Minority  females  in  the  science 
pipeline;  Activities  to  enhance  readiness,  recruitment,  and 
retention.  Initiatives , 55(3),  31-38. 

Anderson,  C.  W.,  & Smith,  E.  L.  (1987).  Teaching  science.  In 
V.  Richardson -Koehler,  (Ed.),  Educators'  handbook:  A re- 
search perspective  (pp.  84-111 ).  New  York:  Longman. 
Asiin,  A.  W.  Astin,  H.  S.  (1992).  Undergraduate  science 
education:  The  impact  of  different  college  environments 
on  the  educational  pipeline  in  the  sciences.  Los  Angeles, 
CA:  University  of  California  at  Los  Angeles,  Higher  Edu- 
cation Research  Institute.  (ERIC  Document  Reproduction 


Service  No.  ED  362  404). 

Berryman,  S.  E.  (1983).  Who  will  do  science : Minority  and 
female  attainment  of  science  and  mathematics  degrees: 
Trends  and  Causes.  New  York:  Rockefeller  Foundation. 

Bowen,  J.  R.  (1990).  What  will  be  the  engineering  pipeline  in 
the  1990s?  European  Journal  of  Engineering  Education , 
/5,  299-308. 

Brookhart,  S.  M.  (1994,  April).  Two  pipelines:  Studetits  pur- 
suing professional  and  technical  careers  in  science  and  tech- 
nology. Paper  presented  at  the  annual  meeting  of  the  Ameri- 
can Educational  Research  Association,  New  Orleans,  LA. 

Burbeles,  N.,  & Linn,  M.  (1988).  Response  to  contradiction: 
Scientific  reasoning  during  adolescence.  Journal  of  Edu- 
cational Psychology , <50,  67-75. 

Carlscn,  D.,  & Andre,  T.  (1992).  Use  of  a microcomputer  simu- 
lation and  conceptual  change  text  to  overcome  student  mis- 
conceptions about  electric  circuits.  Journal  of  Computer- 
Based  Instruction , 79,  105-109. 

Chambers,  S.  K.,  & Andre,  T.  (1996).  Are  conceptual  change 
approaches  to  learning  science  effective  for  everyone? 
Contemporary  Educational  Psychology , 2/,  101-113. 

Chambers,  S.  K.,  & Andre,  T.  (1997).  Gender,  prior  knowl- 
edge, interest,  and  experience  in  electricity  and  conceptual 
change  text  manipulations  in  learning  about  direct  current. 
Journal  of  Research  in  Science  Teaching , 34,  107-123. 

Chambers,  S.  K.,  Haselhuhn,  C.  W., & Andre,  T.  ( 1994,  April). 
The  acquisition  of  a scientific  understanding  of  electricity: 
Hands  on  experience  versus  computer  simulation  and  con- 
ceptual change  versus  didactic  text.  Paper  presented  at  the 
annual  meeting  of  the  American  Educational  Research  As- 
sociation, New  Orleans,  LA. 

Champagne,  A.  B.,Gunstonc,  R.  G.,&  Klopfcr,  L.  E.  (1985). 
Instructional  consequences  of  students  knowledge  about 
physical  phenomena.  In  L.  H.  T.  West  & A.  L.  Pines  (Eds.), 
Cognitive  structure  and  conceptual  change  (pp.  61-90). 
Orlando,  FL:  Academic  Press. 

Fredette,  N.  H..  & Clement,  J.  J.  (198 1 ).  Student  misconcep- 
tions of  simple  circuits:  What  do  they  mean?  Journal  of 
College  Science  Teaching,  77,  280-285. 

Guzzctti,  B.  J.,  Snyder.  T.  E.,  Glass,  G.  V.,  & Gamas,  W.  S. 
( 1993).  Promoting  conceptual  change  in  science:  A com- 
parative meta-analysis  of  instructional  interventions  from 
reading  education  and  science  education.  Reading  Research 
Quarterly,  28,  117-1 55. 

Hilton,  T.  L.  & Lee,  V.  E.,  (1988).  Student  interest  and  persis- 
tence in  science:  Changes  in  the  educational  pipeline  in  the 
last  decade.  Journal  of  Higher  Education,  59,  510-526. 

Hynd.  C.,  & Alvermann,  D.  E.  (1986).  The  role  of  refutation 
text  in  overcoming  difficulty  with  science  concepts.  Jour- 
nal of  Reading,  29,  440-446. 

Kahlc,  J.  B.,  & Mcccc,  J.  ( 1 995).  Research  on  gender  issues  in 
the  classroom.  In  D.  Gabel.  (Ed. ).  Handbook  of  research  in 
science  teaching  and  learning  (pp.  542-557).  New  York: 
Macmillan. 

Keller,  E.  F.  ( 1 985).  Reflections  on  gender  and  seiein  e.  New 
Haven:  Yale  University  Press. 


\A tli i try*  10  Niiimhi'r  ? Snnnn  W47 


MiiJWf.stcni  kdtuiiliotuil  Rcinmhrt 


33 


Matthews,  C.  M.  (1990).  Underrepresented  minorities  and 
women  in  science,  mathematics,  and  engineering:  Prob- 
lems and  issues  for  the  1990s.  Washington,  DC:  CP.S  Re- 
port for  Congress,  (ERIC  Document  Reproduction  Service 
No.  ED  337  525). 

Osborne,  R.  J.  (1983).  Towards  modifying  children’s  ideas 
about  electric  current.  Research  in  Science  and  Techno- 
logical Education , 7,  73-82. 

Posner,  G.,  Strike,  K.,  Hcwson,  P.,  & Gcrtzog,  W.  (1982). 
Accommodation  of  a scientific  conception:  Towards  a theory 
of  conceptual  change.  Science  Education , 66,  21 1-227. 

Rosser,  S.  V.  ( 1 986).  Teaching  science  and  health  from  a femi- 
nist perspective:  A practical  guide.  Elmsford,  NY: 
Pergamon. 

Rosser,  S.  V.  (1990).  Female-friendly  science:  Applying 
women  s studies  methods  and  theories  to  attract  students. 
New  York:  Pergamon  Press. 

Rosser,  S.  V.,  & Kelly,  B.  (1994).  Educating  women  for  suc- 
cess in  science  & mathematics.  Columbia,  SC:  University 
of  South  Carolina. 

Roth,  K.  J.  (1984,  April).  Conceptual  change  learning  and 
students'  processing  of  science  texts . Paper  presented  at 
the  annual  meeting  of  the  American  Educational  Research 
Association,  New  Orleans,  LA. 


Shipstone,  D.  M.  (1984).  A study  of  children's  understanding 
of  electricity  in  simple  DC  circuits.  European  Journal  of 
Science  Education , 6,  185-198. 

Tobias,  S.  ( 1 990).  They  're  not  dumb , they  're  different:  Stalk- 
ing the  second  tier.  Tucson,  AZ:  Research  Corporation. 

Vetter,  B.  M.  (1988).  Look  who's  coming  to  school,  changing 
demographics:  Implications  for  science  education.  (Occa- 
sional Paper  89-0).  Washington,  DC:  Commission  on  Pro- 
fessionals in  Science  and  Technology.  (ERIC  Document 
Reproduction  Service  No.  ED  313  223.) 

Wandersce,  J.  IT,  Mintzes,  J.  J.,  & Novak,  J.  D.  (1995).  Re- 
search on  alternative  conceptions  in  science.  In  Gabel,  D. 
L.  (Ed.),  Handbook  of  research  on  science  teaching  and 
learning  (pp.  177-210).  New  York:  Macmillan. 

Wang,  T.,  & Andre,  T.  (1991).  Conceptual  change  text  versus 
traditional  text  and  application  questions  versus  no  ques- 
tions in  learning  about  electricity.  Contemporary  Educa- 
tional Psychology , 16,  103-1 16. 

White,  B.,  and  Horwitz,  P.  (1987).  Thinker  tools:  Enabling 
children  to  understand  physical  laws  (Report  No.  6470). 
Boston:  BBN  Laboratories. 


Mid-Western  Educational  Researcher 

Call  for  Feature  Writers 

The  Mid-Western  Educational  Researcher  is  a scholarly  journal  that  publishes  research-based  articles  addressing 
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Conversations  in  Education 


From  Tourists  to  Citizens  in  the  Classroom: 
An  Interview  with  H.  Jerome  Freiberg 

Mary  R.  Sudzina 
The  University  of  Dayton 


H.  Jerome  Freiberg  is  Professor  of  Education,  College  of  Educa- 
tion, University  of  Houston,  and  Director  of  the  Consistency  Manage- 
ment and  Cooperative  Discipline  Project , Houston,  Texas . Dr.  Freiberg 
has  published  over  100  scholarly  works  including  the  books  Freedom 
To  Learn  (with  Carl  Rogers),  G/zdUniversal  Teaching  Strategies  (with 
Amy  Driscoll),  and  is  editor  of  the  book  School  Climate:  Measuring, 
Improving,  and  Sustaining  Healthy  Learning  Environments  (in press). 
He  is  also  editor  of  the  Journal  of  Classroom  Interaction.  Dr.  Freiberg 
received  the  1988-89  University  of  Houston's  Teaching  Excellence 
Award , and  the  College  of  Education ’s  J 996  Research  Excellence  Re- 
search Award.  Dr.  Freiberg  was  recently  named  a John  and  Rebecca 
Moores  University  Scholar. 


Q:  Dr.  Freiberg,  you’ve  successfully  applied  Consistency 
Management  & Cooperative  Discipline  (CMCD)  with  stu- 
dents in  some  urban  schools.  How  does  CMCD  differ  from 
other  approaches  to  dealing  with  inner-city  students? 

A:  CMCD  challenges  a number  of  assumptions  about  chil- 
dren and  youth  who  live  and  go  to  school  in  the  inner-cities. 
There  are  too  many  controls  and  not  enough  opportunities  for 
students  to  build  self-discipline. 

The  goal  of  most  teachers  is  to  encourage  self-discipline, 
but  the  path  many  teachers  take  to  this  goal  is  misdirected.  Too 
often  the  cooperation  teachers  seek  from  students  to  create  or- 
der does  not  allow  for  real  engagement  in  the  learning  process. 
Teachers  find  themselves  imposing  their  requirements  for  or- 
der without  relating  to  the  student  need  to  become  members  of 
a learning  community.  Discipline  becomes  mandated  rather 
than  developed.  The  differences  between  building  self-disci- 
pline and  imposing  discipline  is  the  balance  point  between  the 
traditional  classroom  and  a person-centered  learning  environ- 
ment. A person-centered  classroom  benefits  both  teacher  and 
student. 

Too  often  classrooms  are  tcachcr-ccntcrcd.  When  class- 
room are  teacher-centered,  students  loose  out  on  opportunities 
to  have  meaningful  participation.  I liken  this  to  being  “tourists'’ 
in  the  classroom.  Students  become  tourists,  passing  through 
schools  and  classrooms  without  engaging  in  or  positively  in- 
fluencing their  learning  environments.  The  CMCD  program 
encourages  students  to  become  “citizens”  of  the  their  class- 
rooms and  school,  taking  responsibility  for  each  other  and  the 
place  of  learning  that  they  enter  each  day.  The  schools  that 
foster  academic  and  social  citizenship  have  these  qualities  of 
active  learning  environments,  and  students  become  stakehold- 
ers in  their  own  learning. 

Q : What  would  that  look  like? 

A : The  following  figure,  which  appeared  in  Ftvcdom  to  Ixam, 
shows  the  distinctions  between  the  two  types  of  learning  envi- 


ronments (See  Figure  1).  A person-centered  environment  in 
the  Rogerian  sense  is  one  that  includes  and  benefits  both  teacher 
and  students. 


Teac  her-Centered 

Person- Centered 

Teacher  is  the  sole  leader 

Leadership  is  shared 

Management  is  a form  of  guidance 

Management  is  a form  of  oversight 

Teacher  takes  responsibility  for  ail 
paperwork  and  organization 

Students  facilitate  operations  of  the 
classroom 

More  students  are  "tourists"  than 
“citizens" 

More  students  arc  "citizens"  than 
"tourists" 

Discipline  comes  mostly  from  the 
teacher 

Discipline  comes  mostly  from  the 
self 

A few  students  arc  the  teacher’s 
helpers 

All  students  can  become  an  integral 
part  of  classroom  management 

Teacher  posts  the  rules 

Teacher  and  students  develop  rules 
in  the  form  of  a classroom 
constitution  or  Magna  Carta 

Consequences  are  fixed  for  all 
students 

Consequences  reflect  individual 
differences 

Rewards  are  mostly  extrinsic 

Rewards  are  mostly  intrinsic 

Students  arc  allowed  limited 
responsibilities 

Students  share  in  classroom 
responsibilities 

Students  sec  only  people  who  are 
paid  to  be  in  school 

Schools  recruit  business  and 
community  members  to  enrich 
opportunities  for  students  and 
present  positive  role  models  lor 
students 

Adapted  irom  Freedom  u»  U\irn  (Vd  cd  ) by  C Rogers  and  11  J Heiberg 
( IW4.  p 24th  Used  wuh  permission  of  H J Freiberg  tlWH 

Figuu  l.  Tcachcr-ccntcrcd  classrooms  vs.  person  centered 
classrooms. 
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Sclf-disciplinc  is  built  over  time  and  encompasses  mul- 
tiple sources  of  experiences.  There  is  no  one  path,  model,  or 
program  that  will  lead  to  self-discipline  in  all  students.  Self- 
disciplinc  requires  a learning  environment  that  nurtures  oppor- 
tunities to  learn  from  one's  experiences,  including  mistakes, 
and  to  re  licet  on  these  experiences. 

When  students  are  engaged  and  involved  and  teachers  and 
students  sec  each  other  as  partners,  the  instructional  climate 
improves  for  both  teachers  and  students.  When  students  be- 
come more  self-disciplined  and  teachers  have  greater  manage- 
ment and  discipline  repertoires,  referring  students  to  the  office 
becomes  unnecessary  or  the  last  resort.  The  CM  CD  program 
changes  the  learning  environment  by  asking  students  and  teach- 
ers to  collectively  establish  the  climate  in  which  they  will  teach 
and  learn.  We  provide  the  organizational  and  instructional  tools 
to  help  create  this  environment;  it  is  up  to  the  teachers  and 
administrators  to  adapt  and  adjust  to  their  own  local  needs. 

Q:  You’ve  spent  the  last  decade  looking  at  learning  envi- 
ronments in  school  and  achievement  with  “at  risk”  youth. 
What  are  your  conclusions?  What  works? 

A : From  my  experiences  working  with  urban  schools,  teach- 
ers. and  students.  I would  suggest  the  following: 

• Create  smaller  classes  to  hotter  support  children  who  have 
increasing  social  needs.  Most  secondary  school  shave  100- 
200: 1 studcnt/tcachcr  ratio’s  which  can  lead  to  increased 
discipline  and  management  problems. 

• Implement  much  higher  standards  for  the  preparation,  re- 
cruitment, and  hiring  of  teachers.  Most  states  have  higher 
standards  and  training  requirements  for  hairdressers  and 
animal  doctors.  Accordingtothc  1996  National  Commis- 
sion Report  on  Teaching  and  America's  Future,  more  than 
1 29r  of  newly  hired  “teachers"  enter  the  classroom  with- 
out any  preparation  and  159 f enter  without  having  fully 
met  state  standards.  Thirty  percent  of  secondary  math- 
ematics teachers  do  not  have  a college  minor  let  alone  a 
major  in  their  fields. 

• Create  safer  and  more  caring  learning  and  teaching  envi- 
ronments. According  to  the  1996  U.  S.  Department  of 
Justice,  Office  of  Juvenile  Justice  and  Delinquency  Pre- 
vention Study  juvenile  homicide  rates  (12-17  year  olds) 
have  increased  95  percent  from  1980  to  1994.  In  1994, 
law  enforcement  agencies  arrested  2.7  million  youth  un- 
der the  age  of  1 8.  The  study  reports  twelve  percent  of 
students  in  grades  6- 1 2 reported  being  victims  of  bullying, 
physical  attack  or  robbery  and  56  percent  of  the  students 
surveyed  reported  witnessing  such  acts.  Democracy  can- 
not grow  or  llourish  when  youth  live  in  fear.  A climate  of 
violence,  intolerance,  apathy,  isolation  and  dissolving  fami- 
lies leads  many  youths  to  have  a blank  vision  of  ihc  future. 

• Refurbish  school  building  infrastructures  throughout  the 
nation.  Schools  arc  literally  collapsing.  In  Houston,  it  was 
the  roof  an  elementary  .school  which  collapsed  onto  the 
enfetena  one  week  before  school  opened.  In  West  Virginia, 
the  extenor  brick  wall  of  a high  school  in  Preston  County 


collapsed  one  month  prior  to  the  start  of  the  new  school 
year  forcing  the  school  to  be  permanently  closed. 

Encourage  greater  parental  support  in  providing  chil- 
dren that  are  self-disciplined  and  able  to  learn  with  other 
children.  Babies  don’t  come  with  a parents’  guide.  In 
Arkansas,  new  mothers  who  receive  state  aid  also  re- 
ceive extensive  support  in  acquiring  the  knowledge  and 
skills  needed  for  raising  a healthy  child.  Child  abuse 
has  soared  in  the  last  decade.  We  have  learned  that  early 
intervention  is  the  key.  There  is  a need  for  all  parents  to 
have  the  opportunity  to  receive  education  on  raising 
healthy  children. 

Balance  reform  so  it  is  not  always  additive.  Nothing  is 
taken  away  from  the  impacted  school  curriculum  — 
only  added.  Teachers  by  necessity  cither  ignore  the 
new  reforms  or  begin  reducing  parts  of  the  curriculum 
in  a haphazard  fashion.  Changes  in  the  curriculum 
need  to  be  comprehensive  rather  than  piecemeal. 

Reform  efforts  need  time  to  occur.  We  tend  to  plant 
“trees  of  innovation,”  but  not  allow  them  time  to  take 
root.  We  keep  pulling  up  the  trees  and  are  puzzled  when 
they  haven’t  taken.  Veteran  teachers  quickly  learn  that 
they  can  outlast  the  latest  “changes”  because  next  year 
brings  another  program  to  reform  schools. 

Most  importantly,  wc  must  listen  to  the  students;  they 
have  a keen  sense  of  the  problems  and  many  of  the  so- 
lutions. In  one  inncr-city  middle  school,  students  rep- 
resenting a wide  range  of  views  were  asked  about 
solving  the  graffiti  problem  in  bathrooms.  The  students 
suggested  that  each  wall  be  given  to  a different  grade 
level  to  paint  a mural.  They  also  suggested  a large  panel 
he  painted  and  placed  over  the  wall,  enabling  new  stu- 
dents entering  each  year  to  have  their  own  wall  to  paint. 

• Build  reform  on  replicable  research.  Too  often  one  study 
with  limited  gencralizability  or  faulty  design  is  used  to 
support  educational  policy.  Walhcrg  (1986)  cites  the 
impact  of  a flawed  study  showing  open  education  did 
not  improve  learning  compared  to  traditional  educa- 
tion. 11  ic  s*udy  was  reported  in  the  New  York  Times 
and  other  media  sources.  The  study  findings  were  re- 
tracted, hut  only  after  significant  damage  had  occurred 
and  new  policies  were  developed. 

• Reduce  the  half-life  factors  of  improving  schools.  A study 
we  conducted  of  an  improving  inner-city  elementary 
school  that  moved  from  the  lowest  5 percent  in  the  state 
in  academic  achievement  to  receiving  the  Governor’s  ex- 
cellence award  four  years  later  lost  its  Chapter  I Federal 
funds  due  to  higher  achievement  scores.  It  also  lost  extra 
district  funds  for  the  same  reason,  improvement  for  this 
school  became  a disincentive. 

Q : A ACTE  recently  targeted  five  promising  practices 
in  teacher  education  for  1996  and  the  CMCD  program 
was  one  of  them.  A CMCD  project  was  also  highlighted 
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in  the  front  page  of  the  Houston  Chronicle  in  December, 
19%.  Can  you  tell  me  more  about  this? 

A:  Both  the  AACTE  recognition  and  the  article  which  ap- 
peared in  the  front  page  of  the  December  1 , 1 996,  Houston 
Chronicle  (“Sparing  the  Rod:  Student  self-discipline  shifts  bur- 
den for  classroom  order”)  indicate  a growing  awareness  of  the 
importance  of  new  ways  to  approach  the  realm  of  classroom 
environments.  I received  a request  from  AACTE  to  present  an 
overview  of  the  Consistency  Management  & Cooperative  Dis- 
cipline Program  at  the  Education  Commission  of  the  States' 
1996  National  Forum  and  Annual  Meeting  July  2,  1996. 1 was 
to  be  at  an  international  conference  in  Israel  at  the  time  and  Dr. 
Alma  Allen,  an  elected  member  of  the  Texas  State  Board  of 
Education,  presented  on  our  program.  She  has  been  a strong 
advocate  for  the  CMCD  program. 

The  newspaper  article  reflects  the  realization  of  many  in 
the  city  that  before  any  reading  and  mathematics  programs  can 
be  introduced  a climate  for  active  and  productive  learning  must 
be  in  place.  Most  of  the  newer  more  contructivist  curriculums 
emphasize  an  active  interface  between  the  students  and  the  cur- 
riculum. However,,  the  management  system  used  in  most  class- 
rooms reflects  a teacher-centered  model  of  order. 

Q : Could  you  give  me  an  example? 


A:  Yes,  the  following  figure  also  appeared  in  Freedom  to 
Leam  and  shows  how  classroom  management  must  change  to 
reflect  changes  in  instructional  models  (See  Figure  2). 


| Teacher-focuscd 

Teacher  dimension:  Teacher  directs 

Lecture 

and  externally  controls  student 
behavior. 

Questioning 

Teacher  role  is  directive. 

Drill  and  practice 

Dcmonstrat  ion 

Cooperative  dimension: 
Teacher/ students  cooperate  in 

Discussion 

designing  a positive  classroom 
learning  environment. 

Cooperative  groups 

Teacher  rote  is  semi- 

Guided  discovery 

direct!  vc/fa  cilitative. 

Contracts 

Role  play 

Seif -dimension.  Students  arc 

Projects 

internally  self-disciplined  and  need 
minimal  direct  adult  supervision. 

Inquiry 

Teacher  role  Is  non- 
dircctive/fncilitati>c. 

Self-assessment 

Stude  nt-focuscd 

Used  with  permission  of  H.  J.  Freiberg  (1997) 

Figure  2.  Classroom  management  reflecting  instructional 
models. 


Q : How  did  you  conic  to  work  on  the  book  Freedom  To  Learn 
with  the  humanitarian  and  psychologist  Cari  Rogers?  Why  is 
the  message  of  this  book,  first  published  over  two  decades  ago. 
still  contemporary  today? 


A : I worked  with  Carl  Rogers  on  the  second  edition  oi_Free- 
dom  to  Leam  in  the  early  1980’s.  I was  asked  to  update  his 
original  1969  edition  with  additional  cases  and  current  research. 
When  he  died  in  1987  I was  asked  by  the  publisher  and  his 
daughter,  Natalie  Rogers,  to  revise  Freedom  to  team  into  a 
third  edition.  The  project  took  nearly  three  years.  I visited  sec- 
ondary schools  in  Chicago,  Philadelphia,  Houston,  and  New 
Orleans,  and  I included  a colleague’s  work  in  San  Diego  to 
form  the  first  chapter:  “Why  Kids  Love  School”.  It  is  very  evi- 
dent that  schools  can  build  resilience  in  inner-city  children.  Many 
of  Rogers’  frameworks  are  evident  in  what  learners  in  the  inner 
cities  need' to  be  productive  citizens  in  a democratic  society. 

Q:  Freedom  to  Learn  was  translated  into  Spanish  in  1996 
and  the  Soros  Foundation  is  providing  resources  for  it  to 
be  translated  into  Russian  and  placed  in  15,000  libraries. 
Why  do  you  think  there  is  an  international  interest  in  your 
and  Rogers’  work? 

A : Many  of  the  principles  presented  in  Freedom  to  team  are 
universal.  Children  across  the  world  and  their  teachers  have 
similar  needs  to  enable  them  to  work  and  leam  in  healthy  learn- 
ing environments. 

Q:  This  past  summer  you  were  invited  to  speak  in  Israel 
with  David  Berliner,  Lee  and  Judy  Shulman,  Martin 
Haberman  and  Eliot  Eisner.  Are  other  countries  that  you’ve 
visited  confronting  similar  educational  and  social  issues? 

A:  I have  worked  with  educators  in  Italy,  Spain,  England 
Netherlands  and  Israel.  These  countries  are  beginning  to  sec  a 
deterioration  of  the  family  structure  and  subsequent  problems 
with  children.  England,  for  example,  has  a higher  child  poverty 
rate  than  the  United  Stales.  France  has  a similar  child  poverty 
problem  as  the  U.S.  Italian  secondary  teachers  in  small  towns 
and  rural  schools  cited  student  motivation  and  parent  involve- 
ment as  the  their  greatest  concerns.  I have  also  found  a com- 
mon thread  of  lowered  expectations  in  inner-city  schools 
throughout  the  world.  Believing  that  children  of  poverty  can 
leam  is  a prerequisite  to  learning.  We  have  been  asked  to  start 
our  CMCD  program  in  several  European  countries  to  help 
schools  become  resilient,  rather  than  another  risk  factor  in  the 
lives  of  children. 

Q : What  is  your  educational  prognosis  for  the  future? 

A : I actually  have  more  hope  now'  that  we  can  improve  learn- 
ing for  our  youth  as  I sec  real  change  and  improvement  in  some 
of  our  inner-city  schools.  What  I know  after  spending  much 
time  in  urban  schools  is  that  we  need  to  think  differently  about 
students  and  their  learning.  We  can't  change  for  the  hotter  con- 
tinuing to  think  in  the  old  ways. 

Teachers  need  to  be  given  better  tools  for  meeting  the  needs 
of  children  and  youth  and  meet  their  own  needs.  Educational 
reforms  must  begin  at  the  classroom  or  micro  levels  and  work 
toward  the  broader  messo  and  macro  levels.  Too  much  of  what 
has  occurred  to  dale  has  had  minimal  impact  on  the  classroom. 
If  w'c  refocus  our  efforts  to  make  schools  and  classrooms  a 
place  lor  citizens,  not  tourists,  then  we  will  begin  to  see  real 
and  sustainable  improvement. 
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Research  Results 


Consistency  Management  & Cooperative  Discipline  Program 

H.  Jerome  Freiberg 
University  of  Houston 

We’ve  conducted  a series  of  longitudinal  studies  to  determine  outcomes  of  the  Consistency  Management 
& Cooperative  Discipline  program.  The  findings  are  very  promising.  For  example,  students  of  teachers  using 
the  program  in  low-performing  inner-city  elementary  schools  earned  scores  that  are  statistically  significantly 
higher  on  national  standardized  tests  and  state-criterion  reference  tests  than  comparison  students.  Three  years 
after  their  schools  began  the  program,  students  with  CMCD  teachers  gained  on  average  three-quarters  of  a 
year's  achievement  over  comparison  students. 

Four  years  after  the  program  had  been  in  use,  we  found  statistically  significant  differences  in  how  students 
viewed  their  learning  environments.  Based  on  survey  data,  students  in  the  program  perceived  their  environ- 
ments to  be  more  positive  than  comparison  students.  In  addition,  the  following  were  all  significantly  higher  for 
program  students  than  for  comparison  students:  student  involvement,  task  orientation,  class  order  and  class 
rules,  instructional  learning  environment,  teacher  expectations,  and  achievement  motivation  and  academic 
self-concept. 

Program  schools  also  document  significantly  fewer  classroom  problems  and  discipline  referrals  to  the 
principal’s  office.  Before  beginning  the  program,  an  inner-city  elementary  school  with  only  276  students  had 
109  student  referrals  to  the  office  during  the  school  year.  A year  after  the  program,  there  were  19  discipline 
referrals,  9 of  which  were  from  substitute  teachers.  Further,  the  rate  of  suspensions  five  years  later  of  non- 
program  students  was  double  that  of  students  whose  teachers  used  the  program. 

A similar  pattern  is  evident  in  two  intermediate  rural  schools.  Over  three  years,  discipline  referrals  were 
down  40-60  percent,  and  students  made  statistically  significant  gains  in  achievement.  Both  schools  won 
awards  for  academic  excellence. 

When  implemented  school  wide  and  throughout  a feeder  pattern  of  schools  (K- 1 2),  Consistency  Manage- 
ment & Cooperative  Discipline  becomes  a collaborative  enterprise  in  which  teachers  and  administrators  help 
students  move  toward  self-discipline  as  they  progress  through  their  school  years.  The  program  is  currently 
being  replicated  with  nine  additional  inner-city  schools,  including  elementaiy,  middle  and  high  school.  Two 
elementary  schools  have  had  the  program  since  1993-94.  In  these  schools,  student  discipline  referrals  to  the 
office  are  down  78  and  72  percent  respectively.  The  middle  school  to  which  the  elementary  schools  send  their 
students  also  had  the  CMCD  program.  An  external  evaluation  showed  that  skipping  class,  fighting,  disrup- 
tions, defiance  and  disrespect  and  assaults  dropped  from  76  percent  to  24  percent.  The  greatest  drop  was  in 
assaults  of  students  and  teachers  by  students,  which  was  reduced  by  76  percent  in  one  year. 
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The  Mid-Western  Educational  Research  Association 

Gift  Membership 

A gift  membership  has  been  given  to  you, 

by  — 

Your  name  is  now  included  as  a member  one  of  the  most  recognized,  well 
respected,  educational  research  groups  in  the  United  States  and  Canada.  Your 
one  year  membership  includes  a subscription  to  the  Mid-Western  Educational 
Researcher,  the  Association's  journal  that  highlights  research  articles,  features, 
interviews,  and  Association  news.  Members  pay  reduced  registration  fees  for 
the  annual  meeting  held  in  Chicago  in  October.  This  conference  attracts  many 
nationally  recognized  leaders  in  educational  research.  Enjoy  your  membership. 




Thank  you  for  providing  your  colleague,  student,  or  friend  with  a special  one  year  gift  member- 
ship to  the  Mia-Western  Educational  Research  Association.  It  is  a gift  of  professional  involve- 
ment that  is  sure  to  be  appreciated  throughout  the  year.  To  give  your  gift  membership  fill  out  the 
top  portion  of  this  card  and  use  it  to  inform  the  recipient  of  the  gift  membership;  then  fill  out  the 
bottom  portion  of  this  card  and  mail  it  with  your  check  to:  Jean  W.  Pierce  - Dept  EDCSE  - 
Northern  Illinois  Univ,  - DeKalb,  IL  60115 

Person  Receiving  Gift  Membership  Person  Giving  Gift  Membership 


Name 

Address 


Affiliation  

Work  Phone  

Home  Phone  

E-mail  

Fax  

Division  

Preference  (optional) 


Check  one  below  and  make  check  payable  to  Mid-Western  Educational  Research  Association 

| | Professional  Membership  - $18  1 1 Student  Membership  - $1 0 

Student  must  be  currently  enrolled. 
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MWER  Subscriptions 
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Call  for  Manuscripts 


The  Mid-Western  Educational  Researcher  is  a scholarly  journal  that  pub- 
lishes research-based  articles  addressing  a full  range  of  educational  issues.  The 
journal  also  publishes  literature  reviews,  theoretical  and  methodological  discus- 
sions that  make  an  original  contribution  to  the  research  literature,  and  feature 
columns.  There  are  four  issues  of  the  journal  published  annually. 

The  journal  is  now  accepting  manuscripts  for  review  and  possible  publica- 
tion in  1997  and  beyond.  Manuscripts  are  submitted  to  blind  reviews  by  at  least 
two  researchers  with  knowledge  of  the  literature  in  the  appropriate  area.  Further- 
more, the  editors  will  review  the  manuscript  and  make  the  final  decision.  The 
review  process  requires  approximately  three  months. 

Manuscripts  are  accepted  from  faculty,  students,  and  professionals  working 
in  non-educational  settings.  Membership  in  the  MWERA  is  not  required  in  order 
to  submit  a manuscript  for  review.  The  editors  encourage  the  submission  of 
revised  papers  that  have  been  presented  at  the  annual  meetings  of  the  MWERA, 
AERA,  and  other  professional  organizations. 

Submit  four  (4)  copies  of  the  manuscript  with  a cover  letter  to  Deborah  L. 
Rainer  (see  address  in  left  margin).  Manuscripts  should  conform  to  the  style  and 
format  described  in  the  Publication  Manual  of  the  American  Psychological  As- 
sociation, 4th  edition.  All  manuscripts  should  be  typed,  double  spaced,  on  8 1/2 
x 11  paper  with  1 1/2  inch  margins  on  all  sides.  An  abstract  of  less  than  100 
words  should  accompany  the  manuscript.  The  author’s  name  and  affiliation  should 
appear  on  the  title  page  only.  Submissions  typically  are  less  than  20  pages  in 
length.  If  the  manuscript  is  accepted  for  publication,  the  author(s)  will  be  asked 
to  provide  a disk  file  (WP  5. 1 or  higher  on  a 3 1/2  inch  high  density  IBM  format- 
ted disk)  as  well  as  a printed  copy  of  the  final  version.  Please  note  that  the 
editors  reserve  the  right  to  make  minor  modifications  in  order  to  produce  a con- 
cise and  clear  article. 

Questions  regarding  the  journal  or  the  submission  of  feature  columns  should 
be  directed  to  the  editors. 


Deborah  L.  Bainer  (419)  755-4287  bainer.  1 @ osu.edu 


Gene  A.  Kramer  (312)  440-2684  kramerg@ada.org 


Richard  M.  Smith  (630)  462-4102  jomea@rfi.org 
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On  The  Cover 

Kansas  State  University 

Kansas  State  University,  located  in  Manhattan,  Kansas,  is  a comprehensive,  research,  land-grant 
Institution  with  a student  population  of  approximately  20,000  students.  K-State  has  been  termed  'the 
student  scholar  capital  of  America'  among  public  universities  in  the  past  decaf :e,  with  five  Rhodes,  seven 
marshall,  1 9 Truman,  27  Goldwater,  and  1 8 Fulbright  awardees.  The  university  is  committed  to  helping  all 
students  develop  the  knowledge,  skills,  and  understanding  of  educated  people  who  find  success  in  the 
workplace. 

The  College  of  Education  at  Kansas  State  University 

The  College  of  Education  at  Kansas  State  University  is  the  largest  teacher  preparation  unit  in  the  state, 
enrolling  nearly  2,000  undergraduate  and  about  1,000  graduate  students  each  year.  The  college  offers 
certification  in  40  areas,  with  two  undergraduate  degree  programs,  six  master's  degree  programs,  and 
nine  doctoral  degree  programs. 

These  efforts  are  guided  by  64  full-time  tenure  track  faculty,  1 1 full-time  non-tenure  track  faculty,  45 
part-time  and  temporaty  faculty,  37  graduate  assistants,  and  nine  clinical  instructors.  The  full-time  faculty 
are  assigned,  on  average,  slightly  over  60%  of  their  time  to  teaching,  with  the  remaining  time  dedicated  to 
research,  development,  and  professional  service.  Of  tenured  and  tenure-track  faculty,  94%  hold  doctor- 
ate degrees  and  S5%  have  P-12  experience.  Also,  they  produce  more  than  200  publications  each  year, 
serve  as  officers  or  board  members  of  about  25  professional  organizations,  and  serve  as  editors  or 
editorial  board  members  of  about  25  professional  journals.  In  addition,  the  faculty  has  participated  for 
25  years  in  a national  database  on  student  ratings,  and  faculty  members  are  consistently  rated  by 
students  above  nearly  85%  of  all  university  faculty  in  quality  of  Instruction. 

The  KSU  College  of  Education  Is  strong,  not  only  in  academics  and  research,  but  also  in  extramural 
funding.  Faculty  members  have  received  more  than  $ 13  million  in  external  funding  for  research,  techni- 
cal assistance,  and  development  over  the  past  five  years.  The  Midwest  Desegregation  Assistance  Center, 
supported  by  the  U.S.  Department  of  Education,  provides  assistance  to  school  districts  in  a four-state  area 
on  equity  issues  involving  race,  gender,  and  national  origin.  Another  project,  funded  by  the  DeWitt  Wallace 
Reader's  Digest  Foundation,  is  an  effort  to  provide  a national  database  for  facilitating  school-to-work 
transition.  Also,  Social  and  Rehabilitation  Services  supports  a project  to  develop  multimedia  instructional 
programs  to  teach  parenting  skills,  child  care,  and  support  for  children  In  school-related  matters. 

Through  all  of  its  programs,  the  KSU  College  of  Education  is  committed  to  preparing  knowledgeable, 
ethical,  caring  educators  who  will  serve  students  now  and  into  the  21st  century. 


Information  for  Contributors  to  the  Mid-Western  Educational  Researcher 

The  Mid-Western  Educational  Researcher  accepts  research-based  manuscripts  that  would  appeal  to  a 
wide  range  of  readers.  All  materials  submitted  for  publication  must  conform  to  the  language,  style,  and  format  of  the 
Fubiication  Manual  of  the  American  Psychological  Association , 4th  ed.,  1994 
(available  from  Order  Department,  American  Psychological  Association,  P.O.  Box  2710,  Hyattsville,  MD  20784). 

Four  copies  of  the  manuscript  should  be  submitted  typed  double-spaced  (including  quotations  and  references)  on 
8 1/2  x 11  paper.  Only  words  to  be  italicized  should  be  underlined.  Abbreviations  and  acronyms  should  be  spelled  out 
when  first  mentioned.  Pages  should  be  numbered  consecutively,  beginning  with  the  page  after  the  title  page. 
Manuscripts  should  be  less  than  20  pages  long.  An  abstract  of  less  than  1 00  words  should  accompany  the  manuscript 

The  manuscripts  will  receive  blind  review  from  at  least  two  professionals  with  expertise  in  the  area  of  the  manuscript. 
The  author's  name,  affiliation,  mailing  address,  telephone  number,  e-mail  address  (if  available),  should  appear  on 
the  title  page  only.  Efforts  will  be  made  to  keep  the  review  process  to  less  than  four  months.  The  editors  reserve 
the  right  to  make  minor  changes  in  order  to  produce  a concise  and  clear  article. 

The  authors  will  be  consulted  if  any  m^jor  changes  are  necessary. 

Manuscripts  should  be  sent  with  a cover  letter  to: 

Deborah  L.  Balner,  MWER  Co-Editor 

1680  University  Drive,  Ohio  State  University  at  Mansfield,  Mansfield,  OH  44906 

The  MkJ-Westcm  Educational  Researcher  (ISSN  1036*3997)  Is  published  quarterly  by  the  Midwestern  Educational  Research  Association  through  The  Ohio  State  Unlventy. 

The  Summer  issue  serves  as  the  annual  meeting  program.  Non-profit  postage  paid  at  Columbus,  Ohio,  wRh  permission  of  the  College  of  Education.  Nancy  ZJmpher.  Dean. 
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Donna  M.  Barron,  University  of  Dayton 
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Sharon  Kruse,  University  of  Akron 

Susan  Kushner,  University  of  Akron 

Sharon  Latkovich,  Ashland  University 

Susan  Locke,  northern  Illinois  University 

Monique  Manhal-Baugus,  Illinois  State  University 

Virginia  Marion,  Ursuline  College 

Ronald  N.  Marso,  Bowling  Green  State  University 

Judy  Jackson  May,  Bowling  Green  State  University 

James  J.  McCluskey,  Central  Michigan  University 

Larry  McNeal,  Illinois  State  University 

Kim  K.  Metcalf,  Indiana  University 

Jean  Morrow,  northern  Illinois  University 

Gilbert  Naizer,  The  Ohio  State  University 


Clara  New,  University  of  Wisconsin-Parkside 

Carole  Newman,  University  of  Akron 

Isadore  Newman,  University  of  Akron 

Melva  Newsome,  University  of  Dayton 

Tom  Oldenski,  University  of  Dayton 

Brad  Oliver,  Ball  State  University 

Laurie  O'Reilly,  Ball  State  University 

Abbot  L.  Packard,  University  of  northern  Iowa 

Joe  Parks,  Illinois  State  University 

Marshall  Parte,  Western  Illinois  University 

A.  William  Place,  University  of  Dayton 

Tom  Pourchot,  northern  Illinois  University 

Jay  Price,  University  of  Wisconsin-Stevens  Point 

Hema  Ramanathan,  Butler  University 

Michelle  Reed,  The  Ohio  State  University 

Jacqueline  Rickman,  Western  Illinois  University 

Nicole  Roberts,  University  of  Illinois 

Daniel  Robinson,  Mississippi  State  University 

Linda  Rosenboetter,  University  of  Akron 

Charles  Kent  Runyan,  Pittsburg  State  University 

James  A.  Sal z man,  Ursuline  College 

Nancy  Saunders,  Ball  State  University 

Janet  Sheehan,  northern  Illinois  University 

Margaret  "Peggy"  Simpson,  northwestern  University 

Kathy  Sparrow,  Akron  Public  Schools 

Mary  Sudzina,  University  of  Daydon 

John  Surber,  University  of  Wisconsin-Milwaukee 

Laurie  Thomas,  University  of  Illinois 

Jay  Thompson,  Ball  State  University 

Joan  Timm,  University  of  Wisconsin-Oshkosh 

Elizabeth  Timmerman  Lugg,  Illinois  State  University 

Avril  von  Minden,  Western  Illinois  University 

Donna  Waechter,  University  of  Akron 

James  Walter,  Texas  A&M-Corpus  Christi 

Mary  Ann  Wham,  University  of  Wisconsin-Whitewater 

Jean  Williams,  SERVE , Inc. 

Pat  Williams-Boyd,  Eastern  Michigan  University 
John  Zbikowski,  University  of  Wisconsin-Whitewater 


Note  to  Presenters 


M-WERA  will  be  providing  overhead  projectors  for 
presenters  to  use.  You  may  bring  other  AV  equipment  with 
you,  OR  rent  it  from  the  hotel.  Additional  AV  equipment 
may  cost  $ 100.00  to  $200.00  per  item.  Additional  AV  needs 
should  be  directed  to  Sharon  McNcely. 
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General  Information 


Registration:  Everyone  participating  in  or  attending  the 
M-WERA  annual  meeting  must  be  registered.  Those 
planning  to  attend  are  encouraged  to  pre-register  for  the 
conference,  workshops,  and  to  make  hotel  reservations  as 
soon  as  possible  (pre- registration  and  hotel  reservations 
must  be  received  by  September  15,  1997).  Registrations 
mailed  after  September  15  may  not  be  received  in  time  for 
processing,  and  on-site  payment  in  the  form  of  cash  or  per- 
sonal checks  will  be  expected.  If  double  payment  is  later 
determined,  a refund  will  be  issued.  On-site  registration 
and  packet  pick-up  will  be  available  on  the  14th  floor  of 
the  Holiday  Inn  Mart  Plaza  at  the  following  times: 

Wednesday , October  15,  11:00  a.m.  - 4:00  p.m. 

Thursday,  October  16,  8:00  a.m.  - 4:00  p.m. 

Friday,  October  17,  8:00  a.m.  - 4:00  p.m . 

Name  tags  should  be  worn  to  all  sessions  (including  work- 
shops) and  must  be  worn  for  admission  to  the  conference 
luncheon  on  Friday. 

Membership  provides  reduced  conference  registration  fees 
and  a subscription  to  the  M-WERA  official  publication,  the 
Mid-Western  Educational  Researcher.  Those  attending  the 
conference  are  encouraged  to  join.  Conference  presenters 
must  be  paid  members  for  1997. 

Selected  M-WERA  publications  are  available  through  pre- 
registration. These  include  the  Directory  of  M-WERA 
members  for  $7,  the  M-WERA  1997  Meeting  Abstracts  for 
$4  paper,  and  $3  IBM  computer  disk.  These  publications 
may  not  be  available  at  the  conference  unless  ordered 
through  pre-registration.  If  they  are  available  at  registration, 
cash  or  checks  will  be  accepted. 

M-WERA  lapel  pins  are  available  again  this  year.  The  pins 
are  your  way  to  show  others  that  you  support  M-WERA,  and 
they  add  to  your  attire.  These  stylish  pins  were  made 
available  to  us  at  a special  discount,  and  we  have  passed 
along  that  discount  to  you. 

This  year's  Exhibit  Hall  will  feature  publishers  and  others 
providing  materials  and  services  to  educators  on  Friday,  in 
the  14th  Floor  Lobby  West.  We  have  added  a sharing  table 
for  you  to  bring  job  announcements,  fill  out  mentor  forms, 
and  share  other  information  which  helps  all  of  us.  Plan  on 
stopping  by  between  9 a.m.  and  4 p.m. 


Events  and  Highlights 


Dr.  Robert  Shoop  will  be  the  featured  speaker  during  our 
Wednesday  evening  session  (Session  7).  Dr.  Shoop  will  be 
presenting  his  recent  research  in  a session  entitled,  "The 
Legal  Context  of  Sexuai  Harassment  in  Education". 
You  may  join  in  on  Wednesday  evening  from  8:00  p.m.  until 
10:00  p.m.  in  the  Sauganash  Ballroom  East. 

M-WERA  Association  Council  will  meet  from  7:30  a.m.  to 
8:50  a.m.  on  Thursday  morning  In  the  Western  Stage  House 
(Session  9).  All  Association  Council  members  are  expected 
to  attend. 

New  Member  Welcome  takes  place  from  7:00  a.m.  to  7:50 
a.m.  on  Thursday  in  the  Steamboat  Hotel  (Session  8),  Linda 


Bakken  will  chair  this  Informal  session.  All  M-WERA 
members  and  conference  participants  are  welcome. 

Division  Meetings  will  be  held  from  9:00  a.m.  to  9:50  a.m. 
on  Thursday  morning  (Session  10).  All  M-WERA  members 
are  encouraged  to  attend  as  plans  are  made  for  the  1998 
conference. 

Dr.  Jack  Levin  will  present  our  keynote  address  from  10 
a.m.  to  10:50  a.m.  on  Thursday  in  the  Sauganash  Ballroom 
East  (Session  1 1 ).  His  topic  will  be  "Youth  Violence  Qoes 
to  School". 

The  editors  of  the  Mid-Western  Educational  Researcher, 
Deborah  Bainer,  Qene  Kramer,  and  Richard  M.  Smith,  will 
hold  a "Meet  the  Editors"  session  on  Thursday  from  3:00 
p.m.  to  4:20  p.m.  in  the  Mansion  House  (Session  30).  Those 
interested  in  learning  about  publishing  opportunities  are 
encouraged  to  attend. 

The  Cracker  Barrel  Social  will  take  place  from  6:00  to 
8:00  p.m.  Thursday  in  Button's,  a private  room  off  of  Mad 
Anthony's  Lounge  on  the  15th  Floor  (Session  39).  This 
informal  event  offers  a chance  to  relax.,  mix,  and  mingie.  A 
cash  bar  will  be  provided. 

M-WERA  General  Business  Meeting  will  be  held  from  8:00 
a.m.  to  9:20  a.m.  on  Friday  In  the  Sauganash  Ballroom  East 
(Session  40).  All  M-WERA  members  are  urged  to  attend. 

Dr.  Janies  Boyer  will  be  the  featured  speaker  at  the 
conference  luncheon  Friday  in  the  Sauganash  Ballroom  East 
from  11:00  a.m.  to  1:20  p.m.  (Session  52).  Dr.  Boyer's 
address,  "An  Update  on  Research  Regarding  Multicultural 
Education"  will  examine  issues  related  to  diversity  in 
educational  research.  This  luncheon  is  free  to  all  pre-paid 
full  conference  registrants.  If  you  register  after  September 
15  or  on-site,  lunch  may  be  available,  but  is  not 
guaranteed. 

On  Friday  from  3:00  p.m.  to  4:20  p.m.  in  the  Western  Stage 
House,  a M-WERA  Special  Forum  will  feature  a discussion 
about  the  effects  of  policies  on  classroom  motivation 
(Session  69).  The  distinguished  panel  will  include  motiva- 
tion researcher  Martin  Maehr,  assessment  directors  Merv 
Brennan  and  Carole  Perlman,  and  other  policy-makers  and 
teachers.  Another  M-WERA  Special  Forum  will  be  held 
immediately  after,  from  4:30  p.m.  to  5:20  p.m.  in  the 
Western  Stage  House.  This  open  forum  will  Include 
opportunities  for  teachers  and  researchers  In  the  Midwest 
to  form  collaborative  partnerships  (Session  72). 

President  Sharon  McNeely  will  host  the  President's 
Reception  on  Friday  evening  from  9:00  p.m.  to  midnight 
in  the  Wolf  Point  Baliroom  on  the  15th  Floor.  (Session  76). 
Beer,  wine,  soft  drinks,  and  complimentary  hors  d'oeurves 
will  be  served. 

The  M-WERA  Conference  Program  Committee  will  meet 
with  Vice-President  Tom  Parish  and  Vice-President  Elect 
Jeffrey  Hecht  on  Saturday  from  7:30  a.m.  to  9:20  a.m.  in 
the  Western  Stage  House  (Session  77).  All  1998  Division 
program  chairs  and  co-chairs  are  encouraged  to  attend  and 
discuss  the  1997  conference  and  make  plans  for  the  1998 
conference. 

Sharon  McNeely  will  make  her  Presidential  Address  on 
Saturday  morning  from  9:30  a.m.  to  10:50  a.m.  In  the 
Steamboat  Hotel  (Session  87). 

logo 
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Getting  to  the  Conference 
Holiday  Inn-Mart  Plaza 
350  North  Orleans  Street 
Chicago,  IL  60654 
(312)  836-5000 


O'Hare  Airport  to  the  Holiday  Inn  (3  Options) 

1.  Take  a CTA  train  to  downtown  for  about  $ 1 .50. 
Catch  the  train  in  the  basement  of  Terminal  3.  Take  an 
A or  B line.  Get  off  at  the  Clark/Lake  station.  Transfer 
to  the  Brown  Line  (Ravenswood),  and  take  this  to  the 
Merchandise  Mart. 

2.  Take  the  Continental  Airport  Bus  for  $ 1 5.00  one 
way  or  $28.00  round  trip.  Mo  reservations  are  required 
from  the  airport.  See  the  agent  at  the  booth  in  the 
lower  level  baggage  claim  area. 

5.  Take  a cab  for  around  $28.00  one-way.  Wait  in  the 
cab  stand  area.  In  off-hours  a ride  takes  about  30 
minutes.  In  rush  hours  (7-10  a.m.,  3-7  p.m.)  the  ride 
could  take  an  hour  or  more.  Tips  average  15-20%. 

Midway  Airport  to  the  Holiday  Inn 
(3  Options) 

1.  Take  a CTA  train  to  downtown  for  about  $1.50. 
Catch  the  train  at  the  east  end  of  the  airport.  Get  off  at 
the  Clark/Lake  station.  Transfer  to  the  Brown  Line 
(Ravenswood),  and  take  this  to  the  Merchandise  Mart. 

2.  Take  a Continental  Airport  Bus  for  $ 1 1 .00  one 

way  or  $20.00  round  trip.  Mo  reservations  are  required 
from  the  airport.  See  the  agent  at  the  booth  for 
tickets. 

3.  Take  a cab  for  around  $25.00  one-way.  Wait  in  the 
cab  stand  area.  See  O'Hare  information  above 
regarding  time. 
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Driving  and  Parking  Downtown  (3  Options) 

1.  From  the  South,  East,  or  West:  Take  1-90/94  (Dan 
Ryan).  Exit  at  Washington  Street  East  (Exit  5 1C),  turn 
right  on  Washington.  Go  to  Wacker  Drive  and  turn  left. 
Make  another  left  at  Orleans  Street  and  cross  over 
bridge.  The  hotel  is  on  the  left-hand  side. 

2.  From  1-88:  1-88  connects  to  290  (Eisenhower).  Exit 
at  Franklin  Street.  Follow  Franklin  until  it  turns  into 
Orleans  Street  Gust  over  the  river).  The  hotel  is  on  the 
left-hand  side. 

3.  From  the  Nortk,  1-90/94  (Kennedy  Expressway): 

Exit  at  Ohio  Street.  Go  to  Wells  Street  (3rd  light).  Turn 
right,  cross  the  river  and  turn  right  onto  Wacker  Drive. 
Go  1 block,  turn  right  on  Orleans,  and  cross  bridge. 
The  hotel  is  on  the  left-hand  side. 


The  Holiday  Inn-Mart  Plaza  sits  atop  The  Apparel 
Center.  Take  the  Elevators  on  the  first  floor  of 
The  Apparel  Center  to  the  1 5th  Floor  Hotel  Lobby, 
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' Conference  Registration 

, i 1:00  a.m.  ■ 4:00  p.m.  1 4th  Floor,  East  Lobby 


WORKSHOP  SESSIONS  1 :00  p.m.  - 5:00  p.m. 

•Please  refer  to  the  workshop  reservation  information  on  the  M-WERA  Meeting  Registration  Form 


Session  1 

Bull's  Head  Room 
1:00  p.m.  - 4:00  p.m. 
(Fee:  $10) 


Session  2 

Columbian  House 
3:00  p.m.  - 4:30  p.m, 
(Fee:  $5) 


Session  3 

Lake  House 

1:00  p.m.  - 3:00  p.m, 

(Fee:  None) 


Session  4 

Mansion  House 
1:00  p.m.  - 5:00  p.m. 
(Fee:  $25) 


Session  5 

Columbian  House 
1:00  p.m.  - 2:30  p.m, 
(Fee:  None) 


Introduction  to  the  General  Linear  Model: 
Applications  for  Beginning  Users  and 
Demonstrations  of  Teaching  Techniques 

The  goal  of  this  workshop  is  to  demonstrate 
techniques  for  teaching  multiple  linear  regression 
hypothesis  testing  procedures,  while  minimizing  the 
need  for  mathematical  computations. 


Writing  Computer  Integrated  Diverse  Math 
Problems  for  the  Twenty- First  Century 

The  objective  of  this  workshop  is  to  help  math 
educators  of  all  levels  learn  to  write  diverse, 
interesting,  motivating,  and  sense-making  math 
problems;  connect  them  to  the  experiences  of  the 
students;  and  learn  to  use  the  computer  as  a tool. 


It's  All  Geek  to  Me:  Understanding  the  Terms 
and  Concepts  of  the  Internet 

The  purpose  of  this  workshop  is  to  help  individuals 
become  familiar  with  the  Internet  and  how  they  might 
utilize  it  for  research  and  teaching.  Participants  will  be 
exposed  to  the  terms  and  concepts  of  the  Internet 
through  explanations  and  demonstrations  of  World 
Wide  Web  sites. 


Application  of  the  Rasch  Measurement 

The  purpose  of  this  workshop  is  to  serve  as  a 
general  introduction  to  Rasch  measurement  through 
the  dichotomous  model.  Focus  will  be  on  practical 
applications  of  the  Rasch  models:  test  design,  test 
analysis,  test  equating.  Item  bias  detection,  score 
reporting,  and  computer  adaptive  testing.  Fee  includes 
cost  of  book  "Applications  of  Rasch  Measurement." 


An  Arts-Based  Public  Curriculum:  A Description 
of  the  Research  Taking  Place  at  a Place  for  Ideas 

Description  of  "A  Place  for  Ideas",  whose  mission  is 
to  provide  an  environment  that  nourishes  and 
promotes  creativity  and  critical  thinking  and 
celebrates  the  development  of  creative  products. 


Isadore  Newman, 

University  of  Akron; 

Keith  McNeil, 

New  Mexico  State  University 


Mian  Muhammad  Yusuf, 
Weber  State  University 


Abbie  H.  Brown  and  Timothy  D. 
Green,  Indiana  University 


Richard  M.  Smith, 

Rehabilitation  Foundations , Inc. 


Ronald  R.  Morgan  and  Marlea 
Edinger,  Loyola  University - 
Chicago ; Michael  Boyle,  Highland 
Park  High  School ; Anna 
Taskedska,  Chicago  Academy  for 
the  Arts 


Session  6 

Fork's  House 
1 :00  p.m.  - 2:30  p.m. 
(Fee:  None) 


If  We  Always  Do  What  We've  Always  Done... 
(Developing  An  Awareness  of  Students' 
Strengths  and  "Intelligence"  Profiles) 

This  workshop  applies  the  work  of  Gardner  and 
the  research  results  from  a study  of  gender  and 
developmental  differences  across  the  "multiple 
intelligences"  conducted  at  Southwest  Missouri 
State  University,  and  applies  that  information  in 
ways  that  have  a direct  effect  on  the  daily  lives 
of  students  and  their  teachers. 


Karen  Evans  and  David  Brown, 
Southwest  Missouri  State 
University 


(Please  duplicate  this  page  and  distribute  to  your  local  schools.) 
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KICK-OFF  SESSION 

Session  7 


8:00  p.m.  - 10:00  p.m, 


Sauganash  Ballroom  East 


CALL  FOR  NOMINATIONS 

The  nominations  Committee  will  accept  legitimate  nominations  of  members  for  council  or  officer  elections. 
The  elections  are  held  in  early  1998.  nominations  are  being  accepted  for: 

1)  Association  Council  (2  year  term  runs  late  1998  through  2000). 

2)  Member-at-Large  to  Board  of  Directors  ( 2 year  term  runs  late  1998  through  2000). 

3)  Vice-President  (1  year  term  as  Vice-President  in  late  1998,  then  becomes  President-Elect  the  following 
year,  President  the  following  year,  and  Past-President  the  year  after  that. 

Those  nominated  need  to  be  paid  members  in  good  standing.  If  you  are  interested,  or  Know  someone  who  is, 

please  contact  prior  to  October  18,  1997: 

Sharon  McNeely 

1996-1997  President 
northeastern  Illinois  University 
P.O.  Box  34421 
Chicago,  1L  60634 
Voice:  (773)  794-2788 
HP:  (773)  736-2340 
Fax:  (773)  736-7033 
e-mail:  S-Mcrieely@neiu.edu 
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Conference  Registration 
8:00  a.m.  - 4:00  p.m. 

1 4th  Floor,  East  Lobby 


Session  8 


— — 

New  Member  Welcome 

Linda  Bakken,  Member-at-Large 

7:00  a.m.  - 8:00  a.m. 

l 

Steamboat  Hotel 

— J 

Session  9 


(T — 

M-WERA  Association  Council  Meeting 
Sharon  McNeeiy,  President 
7:30  a.m.  - 8:50  a.m. 

- ^ 

V— 

Western  Stage 

=J 

M-WERA  DIVISION  MEETINGS 

Session  10 


9:00  a.m.  ■ 9:50  a.m, 


<r 


( • • • 

Division  A 

Division  H 

Columbian  House 

Division  E 

Sauganash  Ballroom  East 

Mansion  House 

Larry  McHeal,  Chair 

Kathy  Sparrow,  Chair 

Division  B 

Eddie  E.  Glenn,  Chair 

Division  I 

Fork's  House 

Division  F 

Sauganash  Ballroom  East 

Sauganash  Ballroom  East 

James  H.  Powell,  Chair 

Pamela  Kahlich,  Chair 

Division  C 

Elizabeth  Johnson,  Chair 

Division  J 

American  House 

Division  G 
Lake  House 

Sauganash  Ballroom  East 

Marlene  Schommer,  Chair 

Jacqueline  C.  Rickman,  Chair 

Division  D 

Joan  Timm,  Chair 

Division  K 

Bull's  Head 

Steamboat  Hotel 

Bruce  G.  Rogers,  Chair 

A 

Mary  Bendixen-Hoe,  Chair 

J* 

W/e  can't  be  S.„CCE55fUt.  without  U! 

5 o p/ease  plan  to  attend,  and  bring  a colleague  or  graduate  student 
to  the  M-WERA  Meeting  in  Chicago 
from  October  15-18,  1997! 
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Thursday,  October  1 <6,  1997 


KEYNOTE  SPEAKER 
Session  11 


10:00  a.m.  - 10:50  a.m.  Sauganash  Ballroom  East 


* Youth  Violence  Goes  to  School * 

Jack  Levin 

northeastern  University,  Boston 

Youth  violence  has  been  a growing  problem  in  every  sector  of  society,  including  schools.  In  re- 
sponse, many  school  systems  around  the  country  have  institutionalized  peer  mediated  conflict 
resolution  programs.  Although  such  programs  are  effective  in  limiting  mundane  and  conventional 
forms  of  violence,  they  hardly  touch  the  most  dangerous  and  violence-prone  youngsters.  To  be 
effective,  violence  prevention  programs  must  be  braodened  to  include  after-school  activities  and 
expanded  into  the  elementary  school  level.  In  addition,  we  must  find  some  method  for  monitoring 
and  supervising  the  behavior  of  students  who  are  expelled  or  suspended  for  their  violent  conduct, 
nothing  less  than  a cultural  revolution  will  do. 

Jack  Levin,  Ph.D.,  is  Director  of  the  Program  for  the  Study  of  Violence  and  Conflict  and  the  Brudnick 
Professor  of  Sociology  and  Criminology  at  northeastern  University  in  Boston.  He  has  authored  or  co- 
authored 18  books  and  published  more  than  100  articles  in  professional  journals,  magazines  and 
major  newspapers.  Levin  appears  frequently  on  television  programs  such  as  20/20,  48  Hours , 
Unsolved  Mysteries,  Today,  Qood  Morning  America,  Larry  King  Live  and  all  major  network  news- 
casts. He  has  served  as  a consultant  or  expert  witness  in  a number  of  trials  and  was  recently  named 
CASE  Professor  of  the  Year  in  Massachusetts. 


RESEARCH  SESSIONS 


1 1:00  a.tn.  - 12:20  p.m. 


Session  15 


"Prediction  and  Equity  Studies" 


Paper  Session  (Division  D) 


Columbian  House 

Chair: 

Dick  Tracy, 

University  of  Kansas 

Discussants: 

Tianqi  Han,  northern  iiiinois 
University; 

E.  Jane  Williams,  The  Ohio 
State  University 


The  Effects  of  Base  Rate,  Selection  Ratio, 
Sample  Size  and  Reliability  of  Predictors  on 
Predictive  Efficiency  Indices  Associated  With 
Logistic  Regression  Models 

Ohio  Ninth  Grade  Proficiency  Test  Predictors 


Irina  R.  Soderstrom  and  Dennis  Leitner, 
Southern  iiiinois  University 


Susanne  A.  Granoff,  The  Ohio  State 
University 


Is  "Does  Money  Make  a Difference  on  School  Jim  C.  fortune,  Virginia  Tech 

Achievement?"  an  Equity  Question?:  A Critique 

of  the  Answers  Given,  Methods  Used  and  the  Issues  Involved 


Session  16 


"Instruments  fie  Publications  in  Learning  Research"  Paper  Session  (Division  C) 


Bull's  Head 
Chair: 

John  Surber, 

University  of  Wisconsin- 
Milwaukee 

Discussant: 

Orpha  Duell, 

Wichita  State  University 


flexible  Combination:  A Component  of 
Cognitive  flexibility 

Construct  and  Criterion-Related  Validity 
of  flexible  Comparison 

Replicating  an  American  Epistemological 
Belief  Structure  with  Australian  University 
Students 


Productivity  of  Educational  Psychologists  in 
Leading  Educational  Psychology  Journals 


Ronna  Dillon,  Southern  iiiinois  University 


Ronna  Dillon,  Southern  Iiiinois  University 


Marlene  Schommer,  Wichita  State 
University;  Reis  Ohtsuka,  Joe  Mallamace, 
Marina  Milonas,  and  Anthony  Scicluna, 
Victoria  University, , Australia 

M Cecil  Smith,  Susan  G.  Locke,  Stephen 
J.  Boisse,  Peggy  A,  Gallagher,  Lawrence 
E.  Rrengel,  Judith  E.  Kuczek,  Joe  E. 
Mcfarland,  Brunnehilde  Rapoo,  and 
Cheruta  Wertheim,  northern  Illinois 
University 


Session  17 

Fork's  House 
Chair: 

Douglass  feldmann, 

Indiana  University 
Discussant: 

Patricia  Williams-Boyd, 
Eastern  Michigan  University 


"Constructing  Educational  Biographies:  Paper  Session  (Division  F) 

The  Process  and  the  Product" 

from  the  Classroom  to  the  Battlefield:  The  Ren  McDougle,  Pittsbuig  State  University 

Academic  and  Military  Career  of  John  L.  Chamberlain 

Practicing  Safe  Text:  Embracing  Life  Histories  Elizabeth  Johnson,  Eastern  Michigan 
as  Authentic  and  Responsible  Text  University 


Session  18 
Lake  House 
Chair: 

Avril  von  Minden, 

Western  Illinois  University 

Discussant: 

Georg  Gunzenhauser, 
Western  iiiinois  University 


"Innovative  Service  Delivery  Systems  Impacting  Paper  Session  (Division  J) 
Individual  Differences  in  Postsecondary  Education" 


The  Research  Component  in  Qraduate  Teacher 
Education  Programs:  Asking  the  Stakeholders 

Postsecondary  Students  With  Disabilities: 
Assessment,  Attitude  and  Pragmatics 

Learning  At  a Distance:  A Case  Study  of  a 
Graduate  Research  Course 

factors  Influencing  Interest  in  Teaching  As  A 
Career:  Implications  for  the  Recruitment  of 
Minority  Students  Into  Schools  of  Education 


Ruth  Ravid,  national  Louis  University 


J.  Rickman,  T.  Cody  and  T.  furman. 
Western  Iiiinois  University 

C.  Sorensen,  northern  Iiiinois  University; 

D.  Baylen,  Florida  Gulf  Coast  University 

Stanley  Wigle  and  Joyce  Rostelnik, 
University  of  Tennessee-Martin 
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a.m.  ' 12:20  p. 


Session  19 


American  House 


Issues  of  Caring' 


Paper  Session  (Division  G) 


Beyond  Silence:  Moral,  Epistemologica.  '.nd  Joan  B.  Lampert,  northern  Itlinois  University 
Expressive  Voices  Found  in  Bullying 


Chair/Discussant:  Experiences  of  Adolescent  Girls 

Mary  Ann  Wham, 

University  of  Wisconsin-  Diverse,  Caring  Community:  Social  Studies 
Whitewater  Centered  in  Moral  and  Multicultural  Education 


Gloria  T.  Alter,  northern  Illinois  University 


Piaget  and  Noddings:  A Working  Model 
Descriptive  of  Children's  Caring 


Parental  influence  on  Improving  Student 
Success  in  Remedial  Math  Classes 


Rich  Hofmann,  Miami  University ; Beth 
Stephens,  Fairborn  City  Schools;  Lydia 
Hofmann,  Edgewood  Schools 

Mary  Ann  Irwin,  Ball  State  University 


Follow-Up  Session-  Invited  Speakers  1 1 :00  a.m.  - 1 2:20  p.m.  Sauganash  East 

Session  20 


"Sexual  Harassment  and  Violence  in  America's  Schools" 

Robert  J.  Shoop,  Kansas  State  University 
Jack  Levin,  northeastern  University ; Boston 

A discussion  on  what  sexual  harassment  and  violence  are  doing  to  America's  schools  and 
prevention  and  intervention  strategies  to  help  ease  these  problems. 


RESEARCH  SESSIONS 


1:30  p.m.  - 2:50  p. 


Session  21 
Western  Stage 
Chair; 

Donna  Barron, 
University  of  Dayton 

Discussant: 

Lenore  Wineberg, 
University  of  Wisconsin- 
Oshkosh 


Session  22 
Mansion  House 
Chair: 

Gene  Kramer,  American 
Dental  Association 
Discussants: 

Gordon  White,  Southern 
Illinois  University; 

Terry  Schurr,  Ball  State 
University 


'Teacher  Education" 


Paper  Session  (Division  K) 


The  Care  Work  of  Teachers  and  Nurses:  Mutual  Judy  Pickle,  northern  Illinois  University 
Self-Realization,  Unreasonable  Demands,  or 
Uninformed  Choices 

Continuing  Research  on  the  Benefits  and  C.  Richelle  O'Connor,  Bluffton  College 

Challenges  Perceived  by  Nongraded  Multi-Age  Teachers 


Modeling  Best  Practices  in  Middle  Level 
Education:  Does  It  Make  a Difference  in  What 
Teachers  Believe 


"Judgements  and  Consistency" 

Utility  of  a Concept:  Focusing  Strategy  on 
Judgmental  Standard  Setting  Results 


Consistency  of  Angoff-Based  Predictions  of 
ItemPerformance  as  a Function  of  Item 
Difficulty 


Cheryl  K.  Kish  and  Denise  H.  Daniels, 
northern  Illinois  University 


Paper  Session  (Division  D) 

Melody  Hertzog,  Barbara  S.  Plake,  James  C. 
Impara,  Gerald  Giraud  and  Robert  Spies, 
University  of  nebraska 

Barbara  S.  Plake  and  James  C.  Impara, 
University  of  nebraska 


Reliability  of  G-Wise  Kappas  for  Multiple-Rater  Dimiter  M.  Dimitov,  Kent  State  University 
Agreements 
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Session  23 


"Perceptions,  Attitudes  and  Teacher  Education"  Paper  Session  (Division  K) 


Steamboat  Hotel 
Chair: 

John  Zbikowski, 
University  of  Wisconsin- 
White  water 

Discussant: 

Judy  Jackson  May, 
Bowling  Green  State 
University 


Exploring  Teacher  Job  Satisfaction  Across 
Years  of  Teaching  Experience 


The  Literacy  Orientation  Survey:  A Survey  to 
Examine  Teacher  Beliefs  and  Practices  as 
Related  to  the  Principles  of  Constructionism 

When  Will  1 Be  Ready?  Preservice  Teachers' 
Perceptions  of  Job  Readiness:  Replication  of 
a Qualitative  Study 


Beverly  Klecker,  Eastern  Kentucky  University; 
William  E.  Load  man.  The  Ohio  State 
University 

Mary  Ann  Wham,  University  of  Wisconsin - 
Whitewater;  Susan  Lenski,  Illinois  State 
University 

James  A.  Salzman,  Ursuline  College 


Session  24 
Columbian  House 
Chair: 

Gabriella  Caldwell-Miller, 
Illinois  State  University 

Discussant: 

Kathleen  Kearns, 

Illinois  State  University 


"Developmental  Issues  Which  Effect  Parents 
and  Children" 

Influences  of  Parental  Communication  About 
Sexuality  on  Sexual  Outcomes 

Applied  Experimental  Evaluation  of  a Conflict 
Resolution  Curriculum  and  Social  Skills 
Development 

Developmental  Differences  in  the  Relations 
Between  Participation  in  Extracurricular 
Activities  and  Adolescents'  Academic 
Achievement 


Paper  Session  (Divisions  A and  E) 

Cheryl  Sputa,  Eastern  Illinois  University 

Lea  Roseberry  and  Ronald  Morgan,  Loyola 
Uni  versity-Chicago 

Hatalie  Dove  and  Sharon  Paulson, 

Ball  State  University 


A Statistical  Approach  to  Deconstructing  Rich  Hofmann,  Miami  University 

Parental  Gender  in  Single  Parented  Households 

Implications  for  Schools  When  African  Delores  P.  Henry,  Buchanan  Elementary  School 

American  Parents  are  Involved  in  School  and 

Community 


Session  25 


"Education  In  the  Professions" 


Paper  Session  (Division  I) 


Bull's  Head 
Chair: 

Pamela  A.  Kahlich,  KJ 
Learning  Partners , Inc. 
Discussant: 

Dorothy  Jensen  KJ 
Learning  Partners , Inc . 


Admissions  Process  Change  In  A Life  Sciences 
Graduate  Program 

Evaluating  Teacher  Portfolios:  Hew  Paradigms 
for  Assessing  Growth 

Construct  Elucidation-  From  Items  to  Meaning 
and  Theory 


Margaret  A.  Simpson,  northwestern  University 

Merrie  Beth  Fisher,  Indiana  University 

Winifred  A.  Lopez,  International  Survey 
Research 


Session  26  "Lessons  Learned  From  State  Funding  of  Symposium  (Division  H) 

56 1 School  Improvement  Models:  The  Ohio 
Fork's  House  Perspective" 

Chair/Discussant:  LeAnn  Derby,  William  Loadman,  Francine  Michel,  and  Joyce  Miller, 

LeAnn  Derby,  The  Ohio  The  Ohio  State  University - Columbus , Off 
State  University 
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Session  27 
Lake  House 

Chair: 

Jim  Powell, 

Bali  State  University 


Session  28 
American  House 
Chair: 

Virginia  Marion, 
Ursuline  College 

Discussant: 

Sharon  Latkovich, 
Ashland  University 


'The  Utilization  of  Internet  Technologies  in  Symposium  (Division  B) 

Distance  Education:  An  Analysis  of  Issues, 

Perspectives,  and  Applications* 

Enhancing  Classroom  Interaction  in  Distance  Jay  Thompson,  Ball  State  University 
Education:  Utilizing  the  World  Wide  Web 

Expanding  Elementary  Curriculum  and  Brad  Oliver,  Ball  State  University 

Classroom  Interaction  Through  Internet 

Technologies 


Future  Proofing  of  Faculty:  Creating  Technical  Fred  Nay,  Ball  State  University 
Lifelong  Learners 


Student  Perspectives:  Responses  to  Internet  Nancy  Saunders,  Ball  State  University 
Opportunities  in  a Distance  Learning  Environment 


Observation  of  Instruction  Via  Distance  Bobby  Malone,  Ball  State  University 

Learning:  The  Need  For  a New  Evaluation  Paradigm 


Appropriate  Educational  Applications  of  the  Loren  D.  Malm,  Ball  State  University 
World  Wide  Web  Today 


'Alternative  Education  and  Collaboration* 

Perceptions  of  Parents  of  Children  With 
Disabilities  Regarding  School  District  Practices 

Is  Fluvanna's  Project  RETURN  No  Longer  in 
Need  of  Evaluation?  Will  Politics  Provide  the 
Answer? 


Junior  Achievement:  Where  Does  It  Fit  With 
Business  Education  Collaboration? 

Educating  Teenagers  on  Issues  of  Sexuality: 
Teenage  Sexuality  and  Pregnancy  Prevention 
Program  (TSAPPP)  in  the  State  of  Ohio 

Identification  of  Competency  Areas  Required 
of  Vocational  Evaluators:  A Commissioned 
Need  Assessment 


Paper  Session  (Division  31) 

Jane  W.  Andringa  and  David  Suddick, 
Governor's  State  University 

James  C.  Fortune,  Virginia  Tech ; Wayne 
White,  Delores  Anderson,  Linda  Samuel,  and 
James  Hodges,  Fluvanna  County  Public 
Schools 

Lisa  Persinger  and  LaKeisha  Bush,  Indiana 
University 

Ann  Marie  Thomas  and  William  E.  Loadman, 
The  Ohio  State  University 


Donna  Waechter,  University  of  Akron; 
Deborah  Nolte,  Kent  State  University ; and 
Patricia  Sitlington,  University  of  northern 
Iowa 


M-WERA  INVITED  SPEAKER 

Division  A 1:30  p.m.  - 2:50  p.m.  Shakespeare  Hotel 

Session  29 


if 


" The  Leadership  Challenge:  Being  in  the  Middle  in  the 
Middle  of  the  School  Reform  Era " 

Paul  Baker 

Illinois  State  University 


\ 


J 
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M-WERA  FEATURED  SESSION 

Session  30 


3:00  p.m.  ■ 4:20  p.m. 


Mansion  House 


V 


Meet  the  Editors 

of  the  Mid-Western  Educational  Researcher 

Hosted  by: 

Deborah  Bainer,  Ohio  State  University-Mansfield 
Gene  Kramer,  American  Dental  Association 
Richard  M.  Smith,  Rehabilitation  Foundation , Inc . 


j 


RESEARCH  SESSIONS 


3:00  p.m.  ■ 4:20  p.m. 


Session  3 1 
Western  Stage 
Chair: 

A.  William  Place, 
University  of  Dayton 

Discussant: 


"The  Changing  Environment  of  Schools* 

School  Administrators'  Perceptions  of  What 
Works  In  Reducing  Violence  in  Schools 

Joining  Forces  for  Safer  Schools:  Public 
Schools  and  Law  Enforcement  Agencies 

School  Administrators'  Perceptions  of  Trends, 


Margaret  "Peggy"  Simpson,  Issues  and  Responsibilities  Relating  to  the 
northwestern  University  Modern  Educational  Climate 

Principals  as  Cultural  Leaders:  Implications  for 
Preparation  Programs 


Paper  Session  (Division  A) 

George  J.  Petersen,  Southwest  Missouri 
State  University 

Barbara  L.  Brock,  Creighton  University 


William  L.  Sharp,  Southern  Illinois 
University;  James  K.  Walter,  Texas  A <Sc  M 
University 

Carla  Edlefson,  Ashland  University;  Janet 
Wilson,  Westland  High  School 


Session  32 

Columbian  House 
Chair: 

Maria  Elena  Galvez-Martin, 
Ohio  State  University-Lima 
Discussant: 

Charles  Kent  Runyan, 

Fitts  burg  State  University 


'Content  and  Teacher  Education* 

Shadowing  Reading  Specialists:  Learning 
Through  Cases  Developed  From  the  Field 

Students'  Prior  Knowledge  and  Perceptions 
of  Computers:  Implications  for  the  network 
Writing  Classroom 


Papier  Session  (Division  K) 

J.C.  Lambert  and  Michael  P.  Ford,  University 
of  Wisconsin -Oshkosh 

Danilo  M.  Baylen,  Florida  Qulf  Coast 
University;  Gary  McConeghy  and  Linda  M. 
Watson,  northern  Illinois  University 


Session  33 

“Discipline  and  Teacher  Education* 

Paper  Session  (Division  K) 

Steamboat  Hotel 

Discipline  By  negotiation:  An  Alternative 

Daniel  R.  Tomal,  Concordia  University 

Chair: 

Approach  to  Managing  Discipline 

Jean  Morrow, 

northern  Illinois  University 

Problematic  Student  Behaviors:  A Shift  In 

Barbara  J.  Witteman,  Concordia  University 

Discussant: 

Focus 

Bernard  Arenz, 

University  of  Texas-EI  Faso 

The  1997  M-WERA  Conference  promises  to  be  one  of  our  most 

memorable  yet! 


Invite  your  Colleagues  and  Students  to  become  involved. 
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Session  34 
Bull's  Head 

Chair: 

Jim  Powell, 

Ball  State  University 


"Embedding  Service  Learning  in  Curriculum  Symposium  (Division  B) 

fit  Embedding  Curriculum  in  Service  Learning" 

Toward  A Theory  of  Service  Learning  Tony  Santire,  University  of  Hebraska-Lincoin 

First  Year  Teacher  Development  and  Service  Beth  Briney,  University  of  H ebraska-Lincoin 

Learning 


Quantitative  Results 

A Teacher's  Perspective:  What  It  Was  Like 
Qualitative  Reflections/Metaphors 


Larry  Peterson,  University  of  Hebraska-Lincoin 
Bev  Routh,  University  of  Hebraska-Lincoin 
Gerald  Giraud,  University  of  Hebraska-Lincoin 


Session  35 


"Qualitative  Research  and  Program  Evaluation" 


Paper  Session  (Division  H) 


Fork's  House 


Strategies  to  Cope  With  Spiraling  Tuition  Costs  Sharon  Latkovich,  Ashland  University 


Chair: 

Kathy  Sparrow, 

Akron  Fublic  Schools 

Discussant: 

Isadore  Newman, 
University  of  Akron 


Evaluating  Classroom  Publishing:  A Discussion 
of  Methodological  Issues 

Using  Alumni  Satisfaction  Information  for 
Continuous  Program  Improvement 

The  Evaluation  of  an  Extended  Instruction 
Tutoring  Program 


Catherine  Knight,  University  of  Akron; 

Walter  J.  Kuleck,  The  Hennepin  Group , Inc. 

Craig  Wells,  Michael  J.  Subkoviak  and  Charlene 
E.  Tortorice,  University  of  Wisconsin-Madison 

Kelly  Walsh,  The  Ohio  State  University 


l Session  36 
Lake  House 

Chair/Discussant: 

Joan  Timm, 

University  of  Wisconsin - 
Oshkosh 


"Native  American  Education  and 
Interdisciplinary  Collaboration" 

Native  Culture  and  Learning:  Implications 
for  Teaching  American  Indian  Students 

Legislated  Learning  and  Multicultural 
Education:  A Case  Study 


Paper  Session  (Division  G) 


Maureen  Smith,  University  of  Wisconsin - 
Oshkosh 

Maureen  Smith,  University  of  Wisconsin- 
Oshkosh 


Listening  to  History:  A Qualitative  Research  Linda  H.  Chiang,  Anderson  University 
Study 


Session  37 
American  House 
Chair: 

Mary  Ann  Wham, 
University  of  Wisconsin - 
Whitewater 

Discussant: 

Tom  Andre, 

Iowa  State  University 


"Children's  Learning  and  Development  in 
Regular  and  Special  Education  Settings" 

Making  Conservationists  and  Classifiers  of 
Preoperational  Fifth  Grade  Students 


The  Long-Term  Effects  of  Feverstein's 
Instrumental  Enrichment 

The  Development  of  a Survey  Instrument  to 
Assess  Parental  Perceptions  of  Inclusionary 
Educational  Programs  for  Exceptional  Children 


Paper  Session  (Division  C) 


Linda  Bakken,  Frances  Clark,  Twyla  Sherman, 
and  Johnie  Thompson,  Wichita  State  University; 
Kimberlee  Dwyer,  Nancy  Johnson,  and  Higinio 
Peno  111,  Horace  Mann  Elementary  School 

Robert  G.  Harrington,  University  of  Kansas; 

Paul  Chin,  Blue  Valley  Fublic  Schools 

Robert  G.  Harrington  and  Elizabeth  Witt, 
University  of  Kansas 


Remember  LIFE  is  the  search  for  positive  alternatives, 
and  our  M-W /ERA  meeting  qualifies  as  one  of  them! 
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M-WERA  INVITED  SPEAKER 

Division  E 3:00  p.m.  - 4:20  p.m. 

Session  38 


Shakespeare  Hotel 


Bridging  the  Gap:  Multicultural  Perspectives" 


Gloria  Smith 

Michigan  State  University 


M-WERA  SOCIAL 
Session  39 


6:00  p.m.  - 8:00  p.m 


Button's 


r 

Cracker  Barrel  Social 

Hosted  by:  Linda  Bakken,  M-WERA  Member-at-Large 

6:00  p.m.  - 8:00  p.m. 

Button's  (off  Mad  Anthony's  Lounge)  15th  Floor 

, 
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Morning  Wake-Up  and  Coffee 
7:00  a.m.  - 8:00  a.m. 

1 5th  Floor  Lobby 


Conference  Registration 
8:00  a.m.  - 4:00  p.m. 
14th  Floor,  East  Lobby 


Session  40 


J 


M-WERA  General  Business  Meeting 
8:00  a.m.  - 9:20  a.m. 
Sauganash  Ballroom  East 


ROUNDTABLE 

PRESENTATIONS  8:00  a.m.  - 9:20  a.m. 

Session  41 

Sauganash  Ballroom  West 

Table  1 
Division  K 

One  Year  Later:  Follow-Up  On  Professional 
Development  School 

Sandra  J.  Bland  and  Jeffrey  B.  Hecht, 
IllinoisState  University 

Table  2 
Division  K 

Teacher's  Perceptions  of  Knowledge  and  Skills 
Mecessary  for  Beginning  Teachers 

Gregory  J.  Marchant  and  Benjamin  M. 
Lasky,  Ball  State  University 

Table  3 
Division  K 

Researcher's  Perspectives  on  What  Teachers 
Know  and  Should  Know  About  Adolescent 
Development 

Gregory  J.  Marchant  and  Sharon  E. 
Paulson,  Ball  State  University 

Table  4 
Division  K 

Are  We  Reflecting  Yet?:  Improving  Educators' 
Instructional  Methods  Through  Self-Evaluation 
and  Reflection 

Renee  W.  Campoy,  Murray  State 
University 

Table  5 
Division  E 

The  Two  faces  of  narcissism  and  Adolescent 
Mental  Health 

Matthew  Aalsma,  Bail  State  University; 
Nicole  M.  Varshney,  University  of  Ottawa ; 
Daniel  Arens  and  Daniel  Lapsey,  Bali 
State  University 

Table  6 
Division  E 

The  Interaction  Between  Play  and  Children's 
Representational  Abilities 

E.  Peter  Johnsen,  Dick  Tracy, 
and  Melinda  Russell, 
University  of  Kansas 

Table  7 
Division  E 

The  Power  of  Parents  During  Informal 
Interactions  With  Preschool  Teachers  - A Video 
Tape  Content  Analysis 

Shauna  Adams,  University 
of  Dayton 

Table  8 

Survey  Response  Comparison  of  Principals 
by  School  Level  in  the  Implementation  of 

Jerry  Staggs  and  William 
Loadman,  The  Ohio  State 

Division  H 

Funded  School  Improvement  Programs 

University 
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ROUNDTABLE 
PRESENTATIONS 
Session  4 1 

8:00  a.m.  - 9:20  a.m.  Sauganash  Ballroom  West 

Table  9 

Technological  Use  and  Challenge  for  Special 

Merrie  Beth  Fisher, 

Division  I 

Education,  Teacher  Education  Faculty 

Indiana  University 

Table  10 

Performance-Based  Assessment  and  the  Use  of 

Bonnie  Dunwoody, 

Division  J 

Portfolios  in  Postsecondary  Education 

St.  Nary's  of  Notre  Dame 

EXHIBITS 

Session  42 

9:00  a.m.  - 5:00  p.m. 

f 

Exhibits 

9:00  a.m.  • 5:00  p.m. 

....  . 

\ 

14th  Floor,  West  Lobby 

J 

RESEARCH  SESSIONS 

9:30  a.m.  - 10:50  a.m. 

Session  43 


'Reflection  and  Teacher  Education4 


Paper  Session  (Division  K) 


Western  Stage 
Chair: 

Judy  Jackson  May, 
bowling  Green  State 
University 

Discussant: 

James  A.  Salzman, 
Ursulina  College 


Who  Is  More  Reflective? 

Teaching  of  Reflective  Practice  in  a Field-Based 
Elementary  Teacher  Education  Program 

Guided  Preservice  Teacher's  Reflection 

Reflection  and  Pedagogical  Knowledge  Versus 
Pedagogical  Content  Knowledge 


Maria  Elena  Qalvez-Martin,  The  Ohio  State 
University-Lima 

Bernard  W.  Arenz,  University  of  Texas- El  Paso 


Maria  Elena  Galvez-Martin,  The  Ohio  State 
University-Lima;  Connie  Bowman,  The  Ohio 
State  University 

Maria  Elena  Galvez-Martin,  The  Ohio  State 
University-Lima 


Session  44 


"Mentoring  and  Teacher  Education" 


Paper  Session  (Division  K) 


Steamboat  Hotel 
Chair: 

Karen  M.  Dutt-Doner, 
Indiana  State 
University 
Discussant: 

Hema  Raman  athan, 
Butler  University 


Lessons  From  A First  Year  Professional 
Development  School  Partnership 

The  Study  of  Pathwise  Training  on  Cooperating 
Teachers:  Mentoring  Real  or  Imagined? 

Reshaping  the  Profession  One  Teacher  At  A 
Time:  Collaborative  Mentoring  of  Entry  School 
Teachers 


Carole  Newman  and  Barbara  Moss,  University  of 
Akron 

Carmen  Giebelhaus,  University  of  Dayton ; 

Connie  Bowman,  The  Ohio  State  University 

Donald  M.  Williams,  The  Ohio  State  University- 
Lima;  Connie  Bowman,  The  Ohio  State  University 


Never  worry  about  whether  or  not  you  have  a good  opportunity,  just  be  sure  to 
be  good  to  every  opportunity.  Our  NI-WERA  meeting  is  an  opportunity, 
but  it's  your  contributions  and  participation  that  will  maHe  it  a good  opportunity. 
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RESEARCH  SESSIONS 

9:30  a.m.  - 10:50  a.m. 

Session  45 
Mansion  House 
Chair: 

Theodore  Kowalski, 

Ball  State  University 

Discussant: 

Dianne  Ashby, 

Illinois  State  University 


"State  and  Regional  Educational  Reform 
Efforts" 

The  Impact  of  State  Mandated  Educational 
Reform  and  Accountability  on  Principal 
Leadership 

A Survey  of  School  Improvement  Efforts  in 
South  Texas  Elementary  and  Secondary  Schools 

Project  Q.U.E.S.T.:  A State  of  Ohio  Pilot  Project 
for  School  Reform,  Increased  Learner 
Outcomes,  and  Governmental  Deregulation 


Paper  Session  (Division  A) 


Dianne  Ashby,  Paul  J.  Baker,  and  William  Rau, 
Illinois  State  University 


Charles  D.  Manges  and  Linda  Avila,  Texas 
A & M University 

Steven  C.  Oborn  and  Gay  Lynn  Shipley, 
University  of  Dayton;  Susan  Owens,  Ripley 
Learning  Organization 


The  Effect  of  the  Religious  Right  on  Educational  Elizabeth  Timmerman  Lugg,  Illinois  State 

Reform:  Legal  Challenges  to  Curriculum  and  University 

OBE 


Session  46 

Columbian  House 
Chair: 

Thomas  Knapp,  The 
Ohio  State  University 


"Using  Playing  Cards  in  the  Teaching  of  Alternative  Session  (Division  D) 

Statistics" 


Schuyler  W.  Huck,  University  of  Tennessee 
Thomas  R.  Knapp,  The  Ohio  State  University 
Dennis  W.  Leitner,  Southern  Illinois  University ' 
Joel  R.  Levin,  University  of  Wisconsin-Madison 


Session  47 
Bull's  Head 


Chair: 

Steve  Benton, 

Kansas  State  University 

Discussant: 

Roberta  J.  Scholes, 
ACT,  Inc. 


-Recent  Advances  in  Cognitive  Strategy 
Research  and  Instruction- 

Mind  Mapping  as  an  Instructional  Strategy 
for  Complex  Concept  Development 

A Mnemonic  Matrix  for  Helping  Students 
Acquire  Science  Facts  and  Relationships: 
Snatching  Victory  From  the  Jaws  of  Defeat 

A Comparison  of  Solution-Finding  and 
Memorization  Approaches  to  Problem  Solving 


Paper  Session  (Division  C) 


Margaret  L.  Bailey,  northern  Illinois  University 


Robert  K.  Atkinson,  Laura  A.  Atkinson,  and  Joel 
R.  Levin,  University  of  Wisconsin-Madison 


Beverly  J.  Dretzke,  University  of  Wisconsin-Eau 
Claire;  Traci  L.  Jas  person,  Albert  Lea  Schools 


A Comparative  Analysis  and  Evaluation  of  Michael  L.  Carroll  and  Ronald  R.  Morgan, 

Knowledge  Structures  Between  Expert  Ho  vice  Loyola  University-Chfcago 
and  Struggling  Novice  Accounting  Students 


Session  48 
Fork's  House 
Chair: 

Margaret  "Peggy* 
Simpson, 

northwestern  University 

Discussant: 

Elizabeth  Timmerman 
Lugg,  Illinois  State 
University 


"Improving  Outcomes  for  Teachers  and  Paper  Session  (Division  A) 

Students' 


Induction  Programs  for  First-Year  Teachers: 
Responding  to  Diversified  Needs 


Barbara  L.  Brock,  Creighton  University; 
Marilyn  L.  Grady,  University  of  nebrasha 


Student  Assessment  Requirements  and  Kerry  Bibbins,  Illinois  State  University 

Expectations  for  Newly  Inducted  Teachers  in  Illinois 


Why  Central  Kansas  Citizens  Dropped  Out  of 
School  and  Returned  To  a Learning  Center  To 
Pursue  a High  School  Diploma 

Academic  Probation:  A Student  Perspective 


Randall  Turk,  Melva  Ownes,  and  Sarah  Falk, 
Wichita  State  University 

Martha  M.  Thomas,  Miami  University 


Comparison  of  Charismatic  Leadership  of  Charles  E.  Kline  and  Leo  R Philbln, 

Secondary  School  Principals  in  Low  SES/Low  Purdue  University 
Cognitive  Ability  Schools  and  In  High  SES/High 
Cognitive  Ability  Schools 
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RESEARCH  SESSIONS 


Session  49 
Lake  House 
Chair: 

Donna  Waechter, 

Akron  Board  of  Education 

Discussant: 

Kathy  Sparrow, 

Akron  Public  Schools 


"Data  Analysis  and  Evaluation  for 
Pre'Service  Teachers" 

Evaluating  the  Impact  of  the  FOCUS  Model  on 
the  Efficacy  Levels  of  Teachers 


Teachers'  Definition  of  Math:  Creating  and 
Implementing  an  Instrument 

4-Block  Scheduling:  A Case  Study  of  Data 
Analysis  of  One  High  School  After  Two  Years 

The  Test  of  Standard  Written  English:  An 
Effective  Tool  for  Identifying  Written  Samples 
to  Be  Evaluated 


Paper  Session  (Division  H) 


John  W.  Fraas,  Ashland  University ; 

Gary  Russell,  Center  for  Professional 
Development;  Isadore  Newman,  University  of 
Akron 

Lynne  M.  Pachnowski,  University  of  Akron 


Dave  Snyder,  Angola  High  School 


Peggy  Woodard,  David  Suddick  and  Jeanne 
Klockow,  Governor's  State  University 


Session  50 
Mansion  House 
Chair: 

Tom  Oldenski, 
University  of  Dayton 

Discussant 

Brian  Hinrichs, 

Illinois  State  University 


"Influencing  Administrator  Preparation:  New 
Ideas  From  the  Field" 

The  University  of  Cincinnati's  Administrator 
Development  Academy:  Active  Experiences 
in  the  Processes  and  Development  of 
Professional  Skills  Needed  for  Future 
Educational  Leaders 

Reforming  Education:  What  are  the  Implications 
for  Teachers? 

School  Leadership  and  Reflective  Practice 

Research  Requirements  in  Educational 
Administration  Doctoral  Programs:  Is  Reform 
Necessary? 


Symposium  (Division  A) 

Ted  A.  Zigler,  Wm.  Henry  tiarrison  high 
School ; Steve  McCafferty,  riewport  Middle 
School;  John  Hill  and  Robert  Fiinchbaugh, 
University  of  Cincinnati;  Gary  Leibold,  Glen 
High  School ; Cindy  Leibold,  Turpin  ti.S . 

John  Dares h.  University  of  Texas-  El  Paso; 
Kerry  C.  Bibbins,  Illinois  State  University 

Martin  H.  Jason,  Roosevelt  University 

Theodore  J.  Kowalski,  Ball  State  University ; 
A.  William  Place,  University  of  Dayton 


M-WERA  INVITED  SPEAKER 
Division  D 
Session  51 


9:30  a.m. - 10:50  a.m. 


Sauganash  West 


“Setting  Standards  Using  AngofTs  Method:  Does  the  Method  Meet  the  Standard ?" 

James  Impara 

University  of  Nebraska 


LUNCHEON  KEYNOTE  SPEAKER 

Session  52 


1 1 :00  a.m.  - 1 :20  p.m.  Sauganash  Ballroom  East 


"An  Update  on  Research  Regarding  Multicultural  Education " 

James  B.  Boyer 

Kansas  State  University 

James  Boyer  will  discuss  Issues  related  to  diversity  in  educational  research  activity  to  include 
research  dimensions,  research  production,  and  research  consumption.  He  will  elaborate  on 
concerns  of  "authentic"  research  and  its  essential  functions  as  America's  demographic  picture 
changes  so  rapidly.  He  will  also  cite  several  areas  of  needed  research  not  yet  undertaken  by 
America's  educators. 
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Session  53 
Western  Stage 


'“Using  Drama  as  a Tool  for  Reflection  in  Interactive  Session 

the  Preservice  Teacher  Education  Curriculum"  (Division  K) 

Presenters: 

Adrian  Rodgers,  Deborah  Bainer,  Terri  Godby,  Megan  Grimm,  and  Suzanne  Hayek, 

The  Ohio  State  University-Columbus 


Session  54 


"Beginning  Teachers  and  Teacher  Education"  Paper  Session  (Division  K) 


Steamboat  Hotel 
Chair: 

Carol  Ligon  Bentley, 

Discussant: 

Rick  A.  Breault, 

University  of  Indianapolis 


Balancing  Work  and  Family:  The  Entry  Years  of  Mary  K.  Bendixen-Hoe,  The  Ohio  State 
Teaching  University-Newark 

A Longitudinal  Study  of  Relationships  Between  Ronald  N.  Marso  and  Fred  L.  Figge,  Bowling 
Candidates'  Abilities,  Development  of  Teaching  Green  State  University 
Concerns,  and  Success  in  Entering  Teaching 

The  Impact  of  Preservice  Teachers  on  Early  John  Laut,  Coastal  Carolina  University 
Childhood  Students 


Session  55 
American  House 
Chair: 

Carole  Newman, 
University  of  Akron 

Discussant: 

John  Fraas, 
Ashland  University 


"Teacher  Evaluation,  Formative  Evaluation 
and  Professional  Development" 

Personal  and  School  Change  in  One  PDS 

A Study  of  the  Benefits  of  Collaborative 
Planning  Time  in  the  Elementary  Schools 

A Collaborative  Model  of  Teacher  Evaluation: 
Roles  and  Challenges  Faced  By  Various 
Constituent  Groups 

Students  as  Stakeholders  in  Teacher  Education: 
Teacher  Perceptions  of  a Formative  Feedback 
Model 


Paper  Session  (Division  H) 

Rick  A.  Breault,  University  of  Indianapolis 

David  W.  Brown,  Southwest  Missouri  State 
University 

Craig  A.  Mertler,  Bowling  Green  State 
University;  George  J.  Peterson,  Southwest 
Missouri  State  University 

Craig  A.  Mertler,  Bowling  Green  State 
University 


Session  56 


"Standard  Setting  and  Cut  Scores"  Paper  Session  (Division  D) 


Columbian  House 
Chair: 

Thomas  O'Neill, 
American  Society  of 
Clinical  Pathologists 
Discussant: 

Suzy  Green,  Ohio 
University;  Richard  M. 
Smith,  Rehabilitation 
Foundation , Inc . 


Effect  of  a Modified  Angoff  Strategy  For 
Obtaining  Item  Performance  Estimates  In  A 
Standard  Setting  Study 

Setting  Performance  Standards  on  Polytomously 
Scored  Assessments:  An  Adjustment  to  the 
Extended  Angoff  Method 

Cutscore  Validity  In  A Public  School  Setting 


Gerald  Giraud  and  Barbara  S.  Plake, 
University  of  Nebraska 

Melody  Hertzog,  Barbara  S.  Plake,  James  C. 
lmpara,  Gerald  Giraud,  and  Robert  Spies, 
University  of  Nebraska 

Gerald  Giraud,  James  C.  lmpara,  Barbara  S. 
Plake,  Melody  Hertzog,  and  Robert  Spies, 
University  of  Nebraska 


Session  57 
Fork's  House 

Chair  /Discus  sant : 

Elizabeth  Johnson, 
Eastern  Michigan 
University 


"Historical  Perspectives  and  Contemporary  Paper  Session  (Division  F) 
Responses" 

The  Origins  of  Modern  Civic  Education  in  the  Thomas  Vontz,  Indiana  University 
United  States 

Hometown  Pride:  Power  Structures  in  the  Douglas  Feldmann,  Indiana  University 

Development  of  the  American  Rural  Curriculum,  1897*1920 

Social  Services,  Public  Schools,  and  the  Poor:  Patricia  Wllliams-Boyd,  Eastern  Michigan 

Historical  Perspectives  and  a Contemporary  University 

Response 
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Session  58 
Bull  s Head 
Chair: 

Larry  McNeal, 

Illinois  State  University 

Discussant: 

A.  William  Place, 
University  of  Dayton 


"The  School  Community  Link:  Problems 
and  Challenges' 

Focusing  on  the  Big  Variables 


The  Contextual  World  of  Children  and  the 
School-Community:  James  Coleman  and  the 
Effective  Schools  Movement 

Critical  Leadership  for  Urban  Catholic  Schools 


Paper  Session  (Division  A) 


David  C.  Kingsley,  Wedgewood  Associates  and 
Western  Michigan  University ; Barbara  J.  Davis, 
Olivet  College 

Larry  McNeal,  Illinois  State  University 


Julie  K.  Biddle,  University  of  Dayton 


Slogging  Through  the  Muck:  Public  Education,  Nicole  K.  Roberts,  University  of  Illinois 
Democracy,  and  Participation 


Session  59 
Lake  House 

Chair/Discussant: 

Laurie  O'Reilly, 

Bail  State  University 


'Equity,  Human  Rights  and  Voice  in  the 
Curriculum' 

The  Politics  of  Democracy:  The  Place  of  Human 
Rights  in  the  Curriculum 

A Study  of  Equity  in  the  Curriculum  in 
Wisconsin,  Massachusetts,  and  Texas 


Paper  Session  (Division  B) 

Juan  Judikis,  Ball  State  University 

Kaetlyn  Lad  and  James  Walter,  Texas  A&M 
University ; Jay  Thompson,  Ball  State  University 


Who  Controls  the  Vision:  Restructuring  Student  Jim  Powell,  Bali  State  University 
Teaching  to  Meet  Performance-Based  Assessments 


Session  60 


'Hmong  Identity  and  Hmong  Education' 


Paper  Session  (Division  G) 


American  House 

Chair/Discussant: 

Maureen  Smith, 
University  of  Wisconsin- 
Oshkosh 


Identity  Development  in  Hmong  College 
Women:  The  Educational  Environment  as 
"Transitional  Space ' 

Ideologies  of  Literacy:  The  Historical 
Development  of  the  Reading  and  Writing  in 
Laos:  J 92 1-1975 


Jennifer  A.  Fendya,  northwestern  Memorial 
hospital 


John  M.  Duffy,  University  of  Wisconsin - 
Madison 


The  Relationship  Between  Culture  and  Cognitive  Joan  Timm,  University  of  Wisconsin - 

Style:  Implications  for  Teaching  in  a Diverse  Oshkosh 

Society 


M-WERA  INVITED  SPEAKER 

Division  A 1:30  p.m.  - 2:50  p.m.  Shakespeare  Hotel 

Session  6 1 
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M-WERA  invited  Speakers 


Robert  J.  Shoop 

Kansas  State  University 

Kick-Off  Session,  Wednesday,  October  15,  1997 
'The  Legal  Context  of  Sexual  Harassment 
in  Education ' 

Sauganash  Ballroom  East 
8:00  p.m.  - 10:00  p.m. 

Follow-Up  Session,  Thursday,  October  16,  1997 
'Sexual  Harassment  and  Violence 
in  America's  Schools' 
with  Jack  Levin 
Sauganash  East 
1 1 :00  a.m.  - 12:20  p.m. 

Jack  Levin 

Northeastern  University , Boston 
Keynote  Session,  Thursday,  October  16,  1997 
'Youth  Violence  Goes  to  School' 
Sauganash  Ballroom  East 
10:00  a.m.  - 10:50  a.m. 

Follow-Up  Session,  Thursday,  October  16,  1997 
'Sexual  Harassment  and  Violence 
in  America's  Schools' 
with  Robert  J.  Shoop 
Sauganash  East 
1 1:00  a.m.  - 12:20  p.m. 

James  B.  Boyer 
Kansas  State  University 
Luncheon  Keynote  Session 
Friday,  October  17,  1997 
'An  Update  on  Research  Regarding 
Multicultural  Education ' 
Sauganash  Ballroom  East 
1 1:00  a.m.  - 1:20  p.m. 

Follow-Up  Session,  Friday,  October  17,  1997 

'A  Question  and  Answer  Dialogue 
Regarding  Multicultural  Issues' 

Lake  House 
4:50  p.m.  - 5:20  p.m. 


M-WERA  Divisional  Invited  Speakers 


Paul  Baker 
Illinois  State  University 
Division  A Invited  Speaker, 

Thursday,  October  16,  1997 
'The  Leadership  Challenge:  Being  in  the  Middle 
in  the  Middle  of  the  School  Reform  Era' 
Shakespeare  Hotel 
1:30  p.m.  - 2:50  p.m. 

Gloria  Smith 
Michigan  State  University 
Division  E Invited  Speaker, 

Thursday,  October  16,  1997 
'Bridging  the  Gap:  Multicultural  Perspectives' 
Shakespeare  Hotel 
3:00  p.m.  - 4:20  p.m. 

James  Impara 
University  of  Nebraska 
Division  D Invited  Speaker, 

Friday,  October  17,  1997 
'Setting  Standards  Using  AngofFs  Method: 
Does  the  Method  Meet  the  Standard?' 
Merchant's  Hotel 
9:30  a.m.  - 10:50  a.m. 

Theodore  J.  Kowalski 
Bail  State  University 
Division  A Invited  Speaker, 

Friday,  October  17,  1997 
'Communication  Skills  in  the  Context 
of  School  Reform  ' 

Shakespeare  Hotel 
1:30  p.m.  - 2:50  p.m. 

Molly  Baker 

Western  Illinois  University 
Division  J Invited  Speaker, 

Friday,  October  17,  1997 
'An  Examination  of  Technology  Currently 
in  Use  in  Higher  Education ' 
Shakespeare  Hotel 
3:00  p.m.  - 4:20  p.m. 


Special  Forum 

'Effects  of  Policies  on  the  Motivation  of  Teachers  and  Students:  Dialogue  Between  Researchers > 

State  Assessment  Officers,  and  School  Policy  Makers' 

Western  Stage  House 
3:00  - 4:20  p.m. 

Martin  Maehr,  University  of  Michigan  Mervin  M.  Brennan,  Illinois  State  Board  of  Education 

Carole  Perlman,  Chicago  Public  Schools  Glen  W.  (Max)  McGee,  Deerfield  Public  Schools 

Jo  Anderson,  Illinois  Education  Association  Lawrence  Krengel,  northern  Illinois  University 
Mick  Wahl,  Western  Avenue  School 
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Hotel  Room  Reservation  Form 

Mail  this  form  to  the  hotel  - to  be  received  by  September  15,  1997, 
Organization:  Mid-Western  Educational  Researcher  Association  (M-WERA) 

To  make  your  hotel  room  reservation,  please  complete  and  send  this  form  to: 

Reservations  Manager 
Holiday  Inn-Mart  Plaza 
300  North  Orleans  Street 
Chicago,  EL  60654 

or  call: 

(312)  836-5000 

Specially  reduced  room  rates  are  available  to  conference  participants.  To  ensure  a room  at  the  special  rate, 
reservations  must  be  received  by  the  hotel  by  September  15,  1997.  After  that  date,  reservations  will  be 

made  at  the  prevailing  rate  on  a space  available  basis. 


Name: Phone:  

Company/Alliance: 

Address: 

City/State/Zip: 

Sharing  Room  With:  

Method  of  Payment:  □ Check  (attached) 

□ Credit  Card  (No.  ) 

Signature: 

Expiration  Date: 


Arrival  Date: Arrival  Time: Departure  Date: 

Reservations  will  be  held  until  6:00  p.m.  unless  guaranteed* 

Check  Type  of  Accomodation  Requested: 


□ Single  Occupancy  (1  double  bed)  $101**  □ Triple  Occupancy  (2  double  beds)  $ 1 1 1** 

□ Double  Occupancy  (1  double  bed)  $101**  □ Quad  Occupancy  (2  double  beds)  $121** 

□ No  Smoking  Room,  if  available  □ Special  Accomodations  Needed?  □ Yes  □ No 

If  Yes,  please  specify: 

*To  guarantee  your  reservation,  please  call  Holiday  * . c . -ervations  at  the  number  above  or  complete  this  form  and 
mail  it  with  a check  for  one  night's  cost  payable  tc  *'  , Holiday  Inn-Mart  Plaza  Hotel,  or  provide  your  credit  card 
(AMEX,  VISA,  or  MasterCard)  information  in  the  above  space.  Make  sure  you  get  a guarantee  confirmation  number. 

For  guaranteed  reservations  only , / understand  that  / am  responsible  for  one  night's  room  and  tax  charges  which 
will  be  deducted  from  my  deposit  or  charged  to  my  credit  card  If  l fail  to  cancel  my  reservation. 

Signature: 

* * Does  not  include  state  and  local  taxes. 

NOTE:  Hotel  parking  is  $ 12  per  day  if  registered  at  the  hotel,  plus  state  and  local  taxes  (no  valet). 
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M-WERA  Meeting  Registration  Form 

1997  N'WERA  Annual  Meeting,  Chicago,  5L  - October  15- 18,  1997 

Please  complete  EACH  section  of  the  form  below.  All  attendees,  including  program  presenters,  must  register  and  pay 
applicable  fees.  Please  clearly  print  or  type  your  name  as  you  wish  it  to  appear  on  your  meeting  badge.  Monmembers 
wishing  to  apply  for  membership  may  register  at  the  member's  rate  if  membership  application  (below)  and  fee  are 
enclosed  with  conference  registration.  (Mote:  One  individual  registration  per  form;  duplicate  as  necessary.) 


name: 

Affiliation: 

Address:  

City/State/Zip:  

Phone:  Business  ( ) Home  ( ) FAX  ( ) 

Highest  Degree: Institution  Awarding  Degree: 

Area  of  Specialization: M-WERA  Division  Preference: 

e-mail  Address: _ . 


Is  this  your  first  M-WERA  Conference?  □ Yes  □ Mo 

Are  you  planning  on  staying  at  the  Holiday  Inn-Mart  Plaza?  □ Yes  □ Mo 

If  Yes,  Arrival  date: 

MEETING  REGISTRATION 

Postmarked  by  Sept.  1 5 

After  Sept*  15 

M-WERA  Member 

$45.00 

$55.00 

Monmember 

$50.00 

$60.00 

vStudent  Member  (attach  letter  from 
advisor  or  copy  of  student  ID) 

$30.00 

$35.00 

Attending  Luncheon  Only 

$25.00 

$30.00  (if  available) 

TOTAL  Registration  Fee  Enclosed: 

The  Friday  Luncheon  Is  Included  and  guaranteed  In  the  Registration  Fee  if  you  pre-pay  the  full  registration  by  Sept.  15. 

It  Is  not  guaranteed  to  those  who  register  late  or  on-site 

Will  you  be  attending  the  Luncheon?  □ Yes  □ Mo  Will  a vegetarian  meal  be  required?  Q Yes  □ Mo 


PRE-CONFERENCE  WORKSHOPS  (not  Included  In  conference  registration  fee)  See  program  for  workshop  descriptions. 

□ Qeneral  Linear  Model  ($10)  □ Computer  Integrated  Math  Problems  ($5)  □ It's  All  Geek  to  Me:  Internet  (M/C) 

□ Rasch  Measurement  ($25)  □ Arts-Based  Curriculum  (M/C)  □ Awareness/Student  Strengths  (M/C) 

TOTAL  Workshop  Fee  Enclosed: 


M-WERA  MEMBERSHIP  DUES 

1997  Membership  Dues  (required  for  Presenters) 

1998  Membership  Dues 
Lifetime  Membership  Dues 


Regular-  $18.00 
Regular-  $18.00 
$180.00 


Student -$10.00 
Student -$10.00 


TOTAL  Membership  Dues  Enclosed:  


M-WERA  MATERIALS  ( Materials  MUST  be  picked  up  at  the  conference  - Please  Indicate  quantity  desired.) 


M-WERA  Membership  Directory 
M-WERA  '97  Annual  Meeting  Abstracts 
M-WERA  Lapel  Pin 


$7.00  each 

$4.00  paper/$3.00  IBM 
$3.00  each 


TOTAL  Materials  Fee  Enclosed: 


When  registering  and/or  joining,  please  make  check(s) 
payable  to  M-WERA,  and  mall  completed  form(s)  to: 

Dr*  Jean  Pierce,  Northern  Illinois  University, 
Department  EPCSE,  DeKalb,  Illinois  60115* 


TOTAL  FEES  ENCLOSED 


PRESENTERS!  M-WERA  will  be  providing  overhead  projectors.  You  may  bring  other  AV  equipment  with  you,  or  rent  It  from  the  hotel. 

Please  sec  page  3 for  more  details. 
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Notes  from  the  M-IVERA  President's  Desk 


I would  like  to  extend  a special  invitation 
to  everyone  to  attend  the 
M-WERfl  (President's  Reception 
on  Friday,  October  17,  1997 

in  the  Wolf  < Point  ballroom  on  the  15th  Moor  of  the ,Jioliday  Inn-Mart  ’Plaza 

from  9:00  p.m.  to  midnight 
and  to  attend  the 
M-WERf  Presidential'flddress 

entitled 

“Xeamingjlbout  Sex:  The  Missing  Paradigms  and  Challenges  to  Educational  Research” 

on  Saturday,  October  18, 1997 

in  the  Marquette  Room  on  the  16th  Moor  of  theJToliday  Inn-Mart  Plaza 

from  9:30  to  10:50  am. 

Dr.  Sharon  McNeely 
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Session  62 
Lake  House 
Chair: 

Dennis  Kirchen, 
Dominican  University 


"Professional  Development  and  Teacher  Paper  Session  (Division  K) 

Education" 

Teachers  and  the  Leadership/Followership  Craig  A.  Mertler,  Bowling  Green  State 

Dialectic  University;  George  J.  Petersen,  Southwest 

Missouri  State  University;  Sheri  Steyer, 
Shumaker  Elementary  School 


Discussant:  Teacher  Choices  About  Their  Own  Professional  Deborah  L.  Bainer,  The  Ohio  State  University- 

Susan  Cramer,  Development  Mansfield ; Dinah  Wright,  Dublin  City  Schools 

University  of  Wisconsin- 

Oshkosh  Developmental  Stages  of  Teaching:  Moving  Charles  Kent  Runyan,  Rozanne  Sparks,  David 

From  Establishing  Structures  to  the  Art  of  liurford,  and  Richard  Lipka,  Fittsburg  State 

Teaching  University 


Session  63 
Steamboat  Hotel 
Chair: 

nelson  Dubois, 
SUNY-  Oneonta 


"Towards  New  Directions  In  Self-Regulated  Symposium  (Division  C) 

Learning  Research" 

Kirsten  Connelly  and  nelson  Dubois,  SUNY - Oneonta 
Ken  Kiewra,  University  of  Nebraska 
Thomas  S.  Parish,  Kansas  State  University 
Marlene  Schommer,  Wichita  State  University 


Session  64 


"Teachers  and  Classrooms" 


Paper  Session  (Division  6) 


Bull's  Head 
Chair: 

nancy  Saunders, 
Ball  State  University 

Discussant: 

Jay  Thompson, 

Ball  State  University 


Teacher  Perceptions  of  Disruptive  Behavior:  Bobby  Malone,  Deborah  Bonitz  and  Matt 

Utilizing  Behavior  Management  Strategies  to  Rickett,  Ball  State  University 
Maintain  Instructional  Focus 

The  Experts  and  the  Teachers:  A Description  Susan  Berg,  Carolyn  Benz,  Tom  Lasley,  and 
of  Exemplary  Use  of  Technology  in  Elementary  Daniel  Raisch,  University  of  Dayton 
Classrooms 

Professional  Growth  Among  Teachers  Involved  Allison  Hoewisch,  University  of  Missouri- 

In  A Professional  Development  School  Summer  St.  Louis 

Institute 


Session  65 
Columbian  House 
Chair: 

Jay  Price,  University  of 
Wisconsin-  Stevens  Foint 

Discussant: 

Janet  Sheehan,  Northern 
Illinois  University; 

T.  Mark  Beasley, 

St.  John's  University 


"Factor  Analysis  and  Related  Studies 
Education" 

The  Factor  Structure  Stability  of  "Thoughts  on 
Thinking" 

An  Application  of  Confirmatory  Factor  Analysis 
Validation  of  An  Instrument  to  Follow-Up 
Preservice  Teacher  Education  Graduates 

Correspondence  Analysis  (CA)  and  Its 
Application  in  Educational  Research 

Introduction  to  Recent  Microcomputer  Versions 
of  SPSS  and  SAS  With  Special  Attention  to 
Multivariate  Statistical  Techniques 


Paper  Session  (Division  D) 

Marci  L.  Michols,  Miami  University 

Mohammed  A.  Rahman  and  William  E. 
Loadman,  The  Ohio  State  University 

Yanghua  Wang,  University  of  Kansas 

Kenneth  H.  Strand  and  Ong-Art  Maiyaptana, 
Illinois  State  University 


MAM  OVA,  Canonical  and  Discriminant  Analyses:  Kenneth  H.  Strand  and  Robert  J.  Ciszek, 

Selected  Issues  Illinois  State  University 
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RESEARCH  SESSIONS 


3:00  p.m.  - 4:20  p.m. 


Session  66 


"Reliability  and  Related  Studies" 


Paper  Session  (Division  D) 


Fork's  House 
Chair: 

Maria  Elena  Galvez-Martin, 
The  Ohio  State  University- 
Lima 

Discussant: 

Debra  Spearing,  The  Ohio 
State  University ; Michael 
Subkoviak,  University  of 
Wisconsin-Madison 


Test  Score  Change  Patterns  for  Schools 


Expectancy  Effects,  Attrition,  Treatment  Fidelity 
in  Longitudinal  Designs 

Combining  1RT,  Generalizability,  and  Cognitive 
Methods  in  the  Analysis  of  Standardized 
Mathematics  Achievement  Tests 


Md  Hafidz  Omar  and  Mark  R.  Pomplun, 

Uni versity  of  Kansas 

Linda  D.  Lange  and  Cheryl  Utley,  University  of 
Kansas 

Dimiter  M.  Dimitrov  and  Michael  P.  Gallagher, 
Kent  State  University 


Session  67 
American  House 
Chair/Discussant: 

MaLu  Dantas,  The  Ohio 
State  University 


"Multiple  Lenses  Focusing  On  School  Panel  Session  (Division  H) 

Improvement:  Three  Case  Studies" 

Adrian  Rodgers,  Emily  Rodgers,  Colleen  Griffiths,  and  MaLu  Dantas, 

The  Ohio  State  University-Col um bus 


Session  68 
Mansion  House 


"The  ABC's  of  Self-Esteem"  Interactive  Session  (Division  D) 

Presenters: 

James  R.  necessary.  Sail  State  University ; James  J.  McCluskey,  Central  Michigan  University 


M-WERA  SPECIAL  FORUM  3:00  p.m.  - 4:20  p.m. 

Session  69 


Western  Stage 
Chairs: 

Sarah  Peterson  and 

Jean  Pierce,  northern  Illinois 

University 

Discussant: 

Susan  Brookhart, 

Duquesne  University 

V ' 


"Effects  of  Policies  on  the  Motivation  of  Teachers  and  Students:  Dialogue 
Between  Researchers,  State  Assessment  Officers,  and  School  Policy  Makers" 


invited  Participants: 

Martin  Maehr,  University  of  Michigan 

Mervin  M.  Brennan,  Illinois  State  Board  of  Education 

Carole  Perlman,  Chicago  Fublic  Schools 

Glen  W.  (Max)  McGee,  Deerfield  Public  Schools 

Jo  Anderson,  Illinois  Education  Association 

Lawrence  Krengel,  northern  Illinois  University 

nick  Wahl,  Western  Avenue  School 


M-WERA  INVITED  SPEAKER 

Division  J 3:00  p.m.  - 4:20  p.m.  Shakespeare  Hotel 

Session  70 


SYMPOSIUM  SESSION  4:30  p.m.  - 5:20  p.m. 


Division  tl 


Session  7 1 "Evaluation  Models  and  Their  Applications" 

Columbian  House  Joseph  Marth,  nationwide  Training  Center;  Carole  liewman  and  Isadore  riewman, 

University  of  Akron;  Kathy  Sparrow,  Akron  Fublic  Schools 
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M-WERA  SPECIAL  FORUM  4:30  p.m.  - 5:20  p.m. 

Session  72 


t? 


Western  Stage 


Chair: 

Jean  Pierce,  northern 
Illinois  University 


"An  Open  Forum:  Forming  Collaborative  Partnerships  Among 
Teachers  and  Researchers" 

Invited  Participants: 

Mary  Bencini,  Western  Avenue  School 
Lori  Davis,  national  Louis  University 


RESEARCH  SESSION 


4:30  p.m.  - 5:20  p.m. 


Session  73 


'Qualitative  Research  In  Education' 


Paper  Session  (Division  C) 


Bull's  Head  A Qualitative  Study  Evaluating  Active  Learning 

in  Computer  Science 

Chair: 

M Cecil  Smith,  northern 

Illinois  University  Motivation  and  Gifted  Students:  A Qualitative 

Investigation 

Discussant: 

Jacqueline  Rickman,  Classroom  Assessment:  The  Relationship 

Western  Illinois  University  Between  Instruction  and  Practice 


Carol  L.  Spradling,  Gary  McDonald  and  Merry 
McDonald,  northwest  Missouri  State 
University 

Pamela  R.  Clinkenbeard,  University  of 
Wisconsin - White  water 

Cynthia  S.  Campbell  and  John  A.  Evans, 
Southern  Illinois  University 


Session  74 
Mansion  House 


'Applying  Modern  Motivational  Techniques  and  Interactive  Session  (Division  D) 

Philosophies  and  New  Self-  Esteem  Principles  to 
Challenge  Secondary  and  Post-Secondary  Students" 


Chair: 

James  J.  McCluskey, 
Central  Michigan 
University 


Panelists: 

James  J.  McCluskey,  Central  Michigan  University 
Thomas  S.  Parish,  Kansas  State  University 
James  R.  Necessary,  Ball  State  University 


Follow-Up  Session-  Invited  Speaker  4:30  p.m.  - 5:20  p.m.  Lake  House 

Session  75 


PRESIDENT'S  RECEPTION  9:00  p.m.  - 1 2 midnight  Wolf  Point  Ballroom 

Session  76 


<£>r.  Sharon  Me.  Neely  cordially  invites  you  to  attend  the 1 President's  ({peep t ion 

Wolf 'Point  Ballroom  - 15th  'floor 
9:00  p.m.  - midnight 
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Saturday,  October  18,  1997 


Morning  Wake-Up  and  Coffee 
7:00  a.m.  - 8:00  a.m. 

1 5th  Floor  Lobby 

_ J 

Session  77 

rr 

M-WERA  Conference  Program  Committee  Feedback  and  Planning  Session 

7:30  a.m.  - 9:20  a.m. 

Thomas  S.  Parish,  Program  Chair 

^ 

Western  Stage 

J 

RESEARCH  SESSIONS  8:00  a.m.  - 9:20  a.m. 


Session  78 
Lake  House 
Chair: 

Brian  Hinrichs, 

Illinois  State  University 

Discussant: 

Donald  Hackmann, 
Illinois  State  University 


"Promoting  Effective  Leadership  in 
Institutions  of  Higher  Education" 

Leadership  Behaviors  of  Allied  Health  Division 
Chairs  in  Two-Year  Community  Colleges 

The  Leadership  Role  of  the  Tribal  College 
President 

Enhancing  Administration  Through  Mission 
and  Goal  Development 


Paper  Session  (Division  A) 

Cynthia  A.  Beckett,  Sinclair  Community 
College 

Bernita  L.  Krumm,  University  of  Nebraska 
Brian  R.  Hinrichs,  Illinois  State  University 


Birth  Order  and  Leadership 


Bernita  L.  Krumm  and  Marilyn  L.  Grady, 
University  of  Nebraska 


Session  79 

Steamboat  Hotel 
Chair: 

Mary  Bendixen-Hoe, 

The  Ohio  State  University - 
Newark 


"Us  Versus  Them:  Reclaiming  A Role  For  Forum  Session  (Division  K) 

Teacher  Educators" 

Invited  Participants: 

Rick  A.  Breault  and  Stacy  McMullen,  University  of  Indianapolis 


Session  80 

American  House 
Chair: 

Mary  B.  Campbell, 

St.  Xavier  University 
Discussant: 

Douglas  A.  Feldmann, 
Indiana  University 


"Assessment,  Multiple  Intelligences  and 
Teacher  Education" 

Using  Portfolio  Assessments  in  Graduate  Level 
Courses  for  Teachers 

Levels  of  Use:  Multiple  Intelligences 


Paper  Session  (Division  K) 

Ervin  P.  Sparapani,  Saginaw  Valley  State 
University 

Susan  Cramer,  University  of  Wisconsin- 
Oshkosh 


Session  81 
Mansion  House 
Chair: 

Clara  Mew,  University  of 
Wis  consin-Fa  rksid  e 


"Inclusion  and  Multicultural  Perspectives 
in  the  Classroom" 

Inclusion  and  the  Perceptions  of  Labeled 
Students 

Questions  In  the  Classroom 


Paper  Session  (Divisions  E 8e  G) 

Prank  Pitch,  Miami  University 

Ruth  R.  Becker,  University  of  Wisconsin - 
Parltside 


Discussant: 

Kathleen  Kearns, 
Illinois  Slate  University 


The  Special  Education  Competencies  of 
General  Education  Administrators 

Gender  Bias  in  Children's  Books 


Stanley  E.  Wigle,  University  of  Tennessee * 
Martin;  Daryl  Wilcox,  Wayne  State  University 

Maty  Prances  Sanchez,  Ball  State  University 
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RESEARCH  SESSIONS  8:00  a.m.  - 9:20  a.m 

Session  82  'Technological  Applications*  Paper  Session  (Division  D) 

Columbian  House  Using  a PDA  for  Field  Data  Collection  Jeffrey  B.  Hecht,  Illinois  State  University 

Chair: 

Richard  Hofmann,  A Quantitative  Examination  of  World  Wide  Perry  L.  Schoon,  Illinois  State  University 

Miami  University  Web  Site  navigational  Efficiency 

Discussants: 

Terri  Strand,  Strand  The  Internet  and  Student  Use  Greg  Geise,  Ball  State  University 

Consulting  Services ; 

Abbott  Packard,  University 
of  northern  Iowa 


Session  83 
Bull's  Head 


Session  84 

Fork's  House 
Chain 

Elizabeth  Timmerman- 
Lugg, 

Illinois  State  University 
Discussant: 

Tom  Oldenski, 
University  of  Dayton 


'Using  the  Socratic  Seminar  to  Develop  Symposium  (Division  C) 

Critical  Thinking'' 

Invited  Participants: 

Marcia  E.  Sheridan  and  Dennis  W.  Rudy,  Indiana  University-South  Bend 

'Gender  and  Leadership  Issues  in  Education  Paper  Session  (Division  A) 

Women  Assistant  Superintendents  In  northeast  Norma  L.  Connor,  Cleveland  Heights/ 
Ohio:  A Qualitative  Study  of  the  Person,  the  University  Heights  Schools 
Position,  the  Power 

Transformational  Leadership  and  the  Pam  A.  Floit,  Dianne  Ashby,  and  Patricia 

Superintendency  Mass,  Illinois  State  University 


Session  85 
Western  Stage 


'Assisting  Teachers  In  Understanding  How 
To  Use  Data  To  Plan' 

Presenter: 

Pamela  A.  Kahlich,  KJ  Learning  Partners,  Inc. 


SYMPOSIUM  SESSION  8:00  a.m.  - 9:20  a.m. 


Alternative  Session  (Division  1) 


Division  H 


Session  86 
Merchant's  Hotel 

Chair/Discussant: 

William  Loadman, 

The  Ohio  State  University 


'Quality  Work:  Measuring  Student  Engagement,  Persistence  and 
Satisfaction  in  Performance -Based  Assessment' 

William  Loadman,  Julie  Fox,  Daniel  Hoffman,  Anne  Marie  Thomas,  and 
Barbara  Wharton,  The  Ohio  State  University 


M-WERA  PRESIDENTIAL  ADDRESS  9:30  a.m.  - 10:50  a.m.  Marquette  Room  (16th  Floor) 
Session  87 


* Learning  About  Sex:  The  Missing  Paradigms  and  Challenges  to  Educational  Research" 

Sharon  McNeely 

northeastern  Illinois  University 
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RESEARCH  SESSIONS 

Session  88 
American  House 
Chair: 

Thomas  Cody, 

Western  Illinois  University 

Discussant: 

Margaret  "Peggy"  Simpson, 
northwestern  University 


"Higher  Education:  Philosophical  Approaches  Paper  Session  (Division  J) 

to  Education" 

Neo-Pragmatism  and  the  Purposes  of  Life:  A Marshall  Parks,  Western  Illinois  University 

Reconsideration  of  the  Implications  of  Evaluating 

Others 

Learner-Centered  Practices  in  Higher  Education:  Jean  Pierce  and  Brunnehilde  Rapoo, 
Validation  of  Evaluation  Tools  northern  Illinois  University;  B.  McCombs 

and  P.  Lauer,  Mid-Continental  Regional 
Educational  Laboratory 


Interpreting  Scores  on  the  Student  Evaluation  B.  Wharton,  and  W.  Loadman, 
of  Instruction:  Identifying  Influences  Other  The  Ohio  State  University 

Than  Teaching  Performance 


Assessment  Skills  of  Community  College 
Faculty 


J.  Perney  and  Ruth  Ravid, national  Louis 
University 


Session  89 
Steamboat  Hotel 

"Enhancing  Learning  In  Training  and  Adult 
Education" 

Presenter: 

Ronald  Morgan,  Loyola  University-Chicago 

Alternative  Session  (Division  I) 

Session  90 

"Governance  Issues  In  Public  Education' 

Paper  Session  (Division  A) 

Mansion  House 

Formal  Evaluation  of  Indiana  School 
Superintendents:  Practices  and  Superintendent 

Theodore  J.  Kowalski,  Ball  State  Univeisity ) 
Peggy  Koryl,  Tort  Wayne. , Indiana  Fublic 

Chair: 

Donald  Hackmann, 

Perceptions 

Schools 

Illinois  State  University 

Discussant: 

A National  Study  of  School  Boards 

Bernita  L.  Krumm  and  Marilyn  L.  Grady, 
University  of  nebraska 

Theodore  J.  Kowalski, 
Rail  State  University 

The  Opportunities  and  Risks  of  Privatization: 
A Study  of  Ohio  Schools 

William  R.  Hughes,  Ashland  University 

Session  9 1 

'Block  Scheduling' 

Paper  Session  (Division  A) 

Columbian  House  Teacher  Perceptions  Regarding  Block  Edward  L.  Corley,  Miami  University 

Scheduling:  A Case  Study  of  Reactions  to  Change 

Chair/Discussant: 

Larry  McNeal,  An  Examination  of  the  Effectiveness  of  Block  Donald  Q.  Hackmann,  Illinois  State  University 

Illinois  State  University  Scheduling  in  a Small  Secondary  School 


Session  92 

'How  Fuzzy  Was  He?  An  Introduction  to 
Fuzzy  Logic  For  the  Social  Sciences* 

Alternative  Session  (Division  D) 

Bull's  Head 

Presenter: 

Jeffrey  Hecht,  Illinois  State  University 

Session  93 

Fork  s House 
Chair: 

Ayres  G.  D'Costa, 

The  Ohio  State  University 
Discussant: 

John  Q.  Kennedy, 

The  Ohio  State  University 


'Optimizing  Test  Development  and  Alternative  Session  (Division  D) 

Interpretation' 

Presenters: 

Ayres  D Costa,  Sunanta  Viragoontavan,  Wen-da  Cheng,  and  Gwo-Jen  (Gerald)  Guo, 

The  Ohio  State  University 
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RESEARCH  SESSIONS  1 1:00  a.m.  - 12:20  p. 

Session  94  "Curriculum  and  Learning"  Paper  Session  (Division  B) 

Lake  House  Metacognitive  Tools  In  Art  and  Science  Mike  nelson  and  William  Chandler, 

University  of  Wisconsin-Whitewater 

Chair: 

Juan  Judikis,  Correlates  of  Self-Concept  in  Collaborative  William  Gnagey,  Richard  Sarles,  and  Tracy 

Ball  State  University  Learning  Sarver,  Illinois  State  University 

Discussant:  Student  Attitudes  Toward  An  Interactive  Web  Haney  Saunders,  Ball  State  University 

Cindy  Bowman,  Site  Supplementing  A Multimedia  Distance 

Ball  State  University  Learning  Experience 

A Constructivist  Interpretation  of  Attitude  Edward  L.  Corley,  Miami  University 

Towards  Science 


Session  95  "Putting  the  Rigor  in  Action  Research:  Creating  an  Infrastructure" 


Merchant's  Hotel  James  Salzman,  Ursuline  College 

Carolyn  Bruce  and  Diane  Weiland,  Howland  Elementary  School 
James  Hardy  and  Isadore  Newman,  University  of  Akron 

Michael  Loovis,  Lauren  Thibodeau,  Jane  Zaharias  and  Deborah  Zawislan,  Cleveland  State  University 
Donna  Snodgrass,  South  Euclid-Lyndhunst  Board  of  Education 
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SUBJECT 

SESSION(S) 

SUBJECT 

SESSION  (S) 

Achievement 

22 

Inservice  Teachers 

44 

Action  Research 

21,  95 

Instructional  Strategies 

48 

Administrator  Preparation 

50 

Internet 

27,  82 

Adolescent  Development 

41(3).  41(5) 

Alcohol  Abuse  Issues 

14 

Leadership  Issues 

29,  78,  84 

Alternative  Education 

28 

Learning  Strategies 

63 

Angoff  Method 

51 

Literacy 

67 

Assessment  and/or  Evaluation 

25,  37,  47,  88 

Logic 

92 

Attitude  Toward  Education 

94 

Management 

33 

Beginning  Teachers 

41(2),  54 

Measurement 

56 

Behavior 

33 

Memory 

48 

Block  Scheduling 

91 

Mentoring 

45 

Methodology 

95 

Cating 

19 

Moral  Education 

19 

Children 

24.  41(6) 

Motivational  Techniques 

63,  69,  73,  74 

Classroom  Assessment 

73 

Multicultural  Education 

19,  36,  52,  75 

Cognitive  Development 

37 

Multicultural  Perspectives 

38 

Cognitive  Flexibility 

1G 

Multiple  Intelligences 

80 

Cognitive  Style 

36,  60 

Collaboration 

28,  36,  72,  79, 

narcissism 

41(5) 

95 

Native  American 

36 

Communication  Skills 

61 

Computer  Science 

73 

Parents 

24,  41(7) 

Computers 

32 

Pathwise 

45 

Concern  Theory 

54 

Performance-Based  Assessment 

41(10),  86 

Cooperating  Teachers 

13 

Policy 

56 

Critical  Thinking 

83 

Portfolio 

41(10),  80 

Curriculum 

34,  59,  94 

Postsecondary  Education 

18,  41(10),  74 

Prediction 

15 

Data  Analysis 

49 

Preschool  Teachers 

41(7) 

Developmental  Issues 

24 

Preservice  Teacher  Education 

53 

Discipline 

33 

Preservice  Teachers 
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Abstract 

Current  practices  regarding  the  roles  of  cooperating  teachers  and  university  supervisors  and  the  goals 
of  student  teaching  were  examined  through  an  analysis  of  student  teaching  handbooks  from  midwest 
teacher  education  programs.  Handbooks , representing  61  of  the  340  teacher  education  programs  in  13 
midwest  states , were  analyzed  to  determine  the  roles  assigned  to  cooperating  teachers  and  university 
supervisors  and  to  compare  the  goals  of  these  programs  to  the  outcomes  measured  in  their  evaluation 
instruments.  The  study  found  that  student  teaching  materials  lacked  clear  statements  of  program  goals 
and  objectives  and  lacked  clear  definitions  of  the  roles  of  cooperating  teachers  and  university  supervi- 
sors. Correlation  analysis  indicated  a lack  of  congruence  between  the  stated  program  goals  and  the 
outcomes  assessed  in  evaluative  criteria.  Recommendations  relate  to  the  clarity  in  defining  roles  and 
tasks  and  consistency  between  goals  and  outcomes. 


Introduction 

Resounding  support  is  given  to  the  belief  that  student 
teaching  is  singularly  the  most  influential  experience  in 
preservice  teacher  education.  However,  student  teaching 
generally  is  not  accorded  the  attention  warranting  such  sup- 
port and  rarely  is  it  implemented  in  a strategic  manner  com- 
mensurate with  its  perceived  importance. 

A number  of  studies  have  revealed  entrenched  prob- 
lems in  the  structure  of  student  teaching.  They  call  attention 
to  incongruent  role  expectations  of  cooperating  teachers  and 
the  university  supervisors  and  a lack  of  congruence  between 
the  perceptions  of  participants  in  the  triad  (cooperating 
teacher,  university  supervisor,  and  student  teacher)  concern- 
ing the  goals  of  student  teaching  (Grimmett  & Ratzlaff,  1986; 
Guyton  & McIntyre,  1990).  It  is  these  problems  that  have 
been  identified  as  constraining  the  successful  implementa- 
tion of  student  teaching  programs  that  serve  as  the  foci  of 
this  study. 

Objectives 

The  purpose  of  this  study  was  to  investigate  the  stated 
practices  in  student  teaching  as  reflected  in  the  supervision 


handbooks  of  midwestem  colleges  and  universities.  The 
two  major  areas  examined  were  (a)  the  roles  of  university 
supervisors  and  cooperating  teachers,  and  (b)  the  goals  of 
the  student  teaching  practicum  and  their  corresponding  out- 
comes derived  from  the  institutions*  evaluative  instruments. 
The  findings  were  compared  to  current  theoretical  frame- 
works of  student  teaching  and  to  the  extant  reform  propos- 
als in  order  to  generate  recommendations  that  will  define 
practice  in  student  teaching  programs. 

In  order  to  conduct  tliis  investigation,  it  was  necessary 
to  operationalize  the  terms  “roles”  and  “tasks.**  Roles  sub- 
sume a related  group  of  tasks,  and  conversely,  tasks  define 
the  major  role  categories.  For  the  purpose  of  this  study,  role 
and  task  were  defined  as  follows: 

1 . Role:  An  essential  function  performed  in  student  teaching 
which  is  descriptive  of  the  relationship  intended  between 
a cooperating  teacher  or  university  supervisor  and  a stu- 
dent teacher.  For  example,  a cooperating  teacher  might 
take  on  the  role  of  an  instructor  to  student  teachers. 

2.  Task:  Any  prescribed  activity  that  a cooperating  teacher 
or  university  supervisor  undertt*.^  in  reference  to  the 
student  teaching  experience.  F unple,  in  the  role 
of  instructor,  a cooperating  teaci>, . might  be  assigned 
lhcUakofuguiding  student  teachers  in  their  planning.” 


Additionally,  the  following  questions  were  addressed: 

1 . What  tasks  were  specified  for  cooperating  teachers  and 
university  supervisors  in  student  teaching  handbooks, 
and  consequently,  what  roles  could  be  inferred  from  the 
tasks  assigned  to  these  individuals? 

2.  Were  the  goals  of  student  teaching  specified  in  cooper- 
ating teacher  and  university  supervisor  handbooks  con- 
gruent with  the  intended  outcomes  reflected  in  the 
evaluative  instruments  found  in  those  same  handbooks? 

Review  of  Literature 

Student  teaching  is  commonly  viewed  as  the  key  element 
in  the  development  of  prese:  vice  teachers  and  a ‘‘critical  site 
for  the  implementation  of  any  educational  reform  agenda” 
(Borko  & Mayfield,  1 995,  p.  502).  Teachers  consistently  sup- 
port this  view  by  ranking  student  teaching  as  the  most  benefi- 
cial element  of  their  preservice  preparation  (Guyton  & 
McIntyre,  1990).  Indeed,  77%  of  university  supervisors  and 
70%  of  cooperating  teachers  surveyed  believe  that  student 
teaching  prepares  students  more  than  adequately  for  their  first 
full-time  teaching  assignment  (American  Association  of  Col- 
leges for  Teacher  Education,  [AACTE],  1991). 

In  view  of  the  perceived  importance  of  student  teach- 
ing to  the  development  of  preservice  teachers,  it  is  reason- 
able to  believe  that  the  goals  of  student  teaching  and  the 
roles  of  cooperating  teachers  and  university  supervisors 
would  be  well  defined  and  clearly  articulated.  However,  stu- 
dent teaching  programs,  in  general,  lack  clearly  stated  ex- 
pectations regarding  the  roles  and  tasks  of  the  cooperating 
teacher  and  university  supervisor  and  typically  lack  goals 
that  are  congruent  with  proposed  outcomes  (Guyton  & 
McIntyre,  1990).  Guyton  and  McIntyre  have  observed  that 
“The  members  of  the  triad  experience  intrapersonal  and  in- 
terpersonal role  confusion  during  student  teaching,  uncer- 
tainty about  their  own  and  others  roles,  and  divergent  role 
expectations  of  themselves  and  others”  (p.  523).  Conse- 
quently, the  potential  for  student  teaching  to  produce  disap- 
pointing outcomes  is  high,  and  it  is  unlikely  in  such  a setting 
that  participants  would  experience  a sense  of  accomplish- 
ment of  goals. 

Role  of  Cooperating  Teachers 

Members  of  the  triad  typically  hold  conflicting  views 
regarding  the  roles  of  cooperating  teachers  and  university 
supervisors  (Duquette,  1994).  A survey  by  Grimmett  and 
Ratzlaff  (1986)  revealed  that  student  teachers,  cooperating 
teachers,  and  university  supervisors  disagreed  in  35  of  50 
categories  defining  the  tasks  of  cooperating  teachers.  Where 
they  did  agree,  participants  perceived  the  role  of  cooperat- 
ing teachers  to  include  tasks  of  evaluation,  orientation,  and 
professional  development  and  assistance  in  planning  and 
instruction.  The  findings  of  Grimmett  and  Ratzlaff  confirmed 
similar  findings  from  previous  studies  by  Castillo  (1971) 
and  Copas  (1984).  Although  their  specific  findings  varied, 
these  studies  in  general  revealed  conflicting  perceptions 


among  members  of  the  triad  regarding  the  role  of  cooperat- 
ing teachers. 

Agreement  concerning  the  essential  function  of  coop- 
erating teachers  has  not  been  forthcoming  through  national 
efforts  to  standardize  the  roles  and  responsibilities  of  stu- 
dent teaching  participants.  The  National  Council  for  Accredi- 
tation of  Teacher  Education  (1995)  requires,  in  the  Category 
I standards,  that  field  experiences  encourage  reflection  and 
provide  feedback  from  the  university  and  school  faculty  and 
peers  and  that  such  experiences  should  be  a minimum  of  ten 
weeks  or  equivalent.  It  also  stipulates  that  student  teaching 
be  a joint  agreement  between  the  schools  and  cooperating 
professionals.  Category  III,  Professional  Education  Faculty, 
notes  that  unit  faculty  who  supervise,  have  preparation  and 
experience  in  school  settings.  Graduate  students  who  have 
responsibility  for  field  experiences  should  be  qualified  in 
terms  of  study,  experience,  and  training.  Lastly,  Category 
III  limits  1 full-time  faculty  member  to  18  full-time  students. 
No  mention  is  made  of  the  roles  and  responsibilities  that  the 
different  members  of  the  triad  should  play.  Similarly,  the 
1986  Association  of  Teacher  Educator’s  (ATE)  national 
guidelines  contained  only  general  descriptions  of  the  tasks 
for  cooperating  teachers  and  university  supervisors,  advanc- 
ing no  specific  tasks  (Guyton  & McIntyre,  1990).  Typical 
of  the  ATE  (1986)  guidelines  are  statements  such  as  “estab- 
lish and  maintain  open  channels  of  communication”  (p.  17). 
Guyton  and  McIntyre  point  out  that  such  broad  statements 
promote  a variety  of  interpretations  by  members  of  the  triad 
who  bring  individual  role  expectations  to  their  experience. 

While  the  intended  role  of  cooperating  teachers  remains 
poorly  defined,  the  effect  of  the  role  assumed  by  cooperat- 
ing teachers  in  student  teaching  reveals  a consistently  both- 
ersome pattern.  As  social  agents,  cooperating  teachers  exert 
the  most  profound  influence  on  student  teachers  (Borko  & 
Mayfield,  1993;  Calderhead,  1988)  yet  often  exert  negative 
influences  (Richardson-Koehler,  1988).  Richardson- 
Koehler’s  study  found  that  after  two  weeks  in  student  teach- 
ing, preservice  teachers  had  aligned  their  practice  with  their 
cooperating  teacher.  In  general,  student  teachers’  attitudes 
become  more  custodial  and  negative  during  field  experiences 
(McIntyre,  1984).  In  addition,  cooperating  teachers  also 
exercise  influence  through  their  evaluation  of  student  teach- 
ers. However,  the  value  of  cooperating  teachers’  assessment 
of  student  teachers  is  questionable  since  they  place  a pre- 
mium on  being  positive  in  their  relationships  with  student 
teachers  in  an  effort  to  bolster  their  confidence  (Dunne  & 
Dunne,  1993).  Therefore,  given  the  potential  of  cooperat- 
ing teachers  to  impact  the  development  of  preservice  teach- 
ers, there  is  substantial  reason  to  define  and  clarify  their  role 
in  student  teaching. 

Role  of  University  Supervisors 

The  place  and  value  of  university  supervisors  in  stu- 
dent teaching  is  difficult  to  define  given  the  varied  conclu- 
sions of  individuals  who  have  investigated  this  subject.  Some 
studies  suggest  that  the  effectiveness  of  student  teaching  is 
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related  to  the  assistance  and  mentoring  provided  by  the  co- 
operating teacher  and  university  supervisor  (Glickman  & 
Bey,  1990),  and  that  university  supervisors  improve  a stu- 
dent teacher’s  performance  (Zahorik,  1988)  and  are  an  es- 
sential component  of  student  teaching  (McIntyre,  1984). 
However  other  research  indicates  that  the  potential  of 
mentoring  relationships  in  student  teaching  frequently  goes 
unrealized  (Smith,  1990). 

University  supervisors  report  different  views  of  their 
importance,  seemingly  based  on  their  role  perceptions.  When 
university  supervisors  perceive  their  role  to  be  evaluative, 
they  experienced  little  satisfaction  or  accomplishment  in  their 
work  (Koehler,  1984).  However,  when  university  supervi- 
sors consider  their  role  to  be  one  of  providing  intellectual, 
professional,  and  emotional  support  to  student  teachers,  they 
experienced  a strong  sense  of  satisfaction  and  efficacy 
(Koehler). 

The  traditional  evaluative  role  of  university  supervisors 
may  very  well  hinder  their  ability  to  provide  real  assistance 
to  student  teachers  since  they  are  perceived  by  student  teach- 
ers more  in  an  assessment  role  than  an  assistance  role 
(Calderhead,  1988).  Regarding  this,  Borko  and  Mayfield 
(1993)  recommended  that  university  supervisors  should 
spend  their  limited  time  in  the  field  to  help  cooperating  teach- 
ers develop  knowledge  and  skill  in  serving  as  teacher  edu- 
cators. In  this  role,  university  supervisors  would  spend  their 
time  modeling  appropriate  supervisory  strategies  and  facili- 
tating the  supervision  process. 

Goals  and  Outcomes 

In  addition  to  the  confusion  that  exists  in  student  teach- 
ing regarding  the  roles  and  responsibilities  of  participants, 
there  is  a similar  lack  of  clarity  with  regard  to  the  goals  of 
student  teaching.  The  expectations  of  cooperating  teachers 
and  university  supervisors  in  student  teaching  was  studied 
by  Applegate  and  Lasley  (1986).  They  found  little  agree- 
ment among  the  triad  in  terms  of  common  goals  or  shared 
expectations.  In  addition,  Applegate  and  Lasley  found  that 
cooperating  teachers,  university  supervisors,  and  student 
teachers  focus  upon  different  problems  and  view  specific 
problems  with  different  levels  of  concern.  Guyton  and 
McIntyre  (1990)  assert  that  this  finding  is  an  indication  of 
the  triad’s  lack  of  shared  expectations.  This  lack  of  congru- 
ence in  the  expectations  of  triad  members  contributes  to  their 
confusion  over  perceived  goals  of  student  teaching  (Guyton 
& McIntyre,  1990;  Grimmett  & Ratzlaff,  1986)  and  presents 
a significant  obstacle  in  the  successful  implementation  of 
student  teaching  programs. 

Clinical  Supervision 

A strong  argument  for  clearly  identified  and  well  estab- 
lished roles  for  cooperating  teachers  and  university  supervi 
sors  has  been  made  in  the  research  substantiating  a clinical 
approach  to  student  teacher  supervision,  involving  a team 
effort  between  the  cooperating  teacher,  the  university  super- 
visor, and  the  student  teacher  and  focusing  on  systematic 


and  formative  evaluation  (Glickman  & Bey,  1990).  In- 
creased control  (Armstrong  & Ladd,  cited  in  Guyton  & 
McIntyre,  1990);  positive  self-assessment  (Cook,  cited  in 
Guyton  & McIntyre,  1990);  improved  supervision  (Shuma, 
cited  in  Guyton  & McIntyre,  1990);  and  improved  teaching 
and  attitude  towards  teaching  (Krajewski,  cited  in  Guyton 
& McIntyre,  1990)  are  outcomes  related  to  a clinical  super- 
vision approach.  Gitlin,  Ogawa  and  Rose  (1982)  found  that 
shared  evaluation  among  members  of  the  triad  promoted 
self  analysis  and  reflection  on  the  part  of  student  teachers 
and  resulted  in  more  complex  analyses  of  teaching  and  in 
more  favorable  attitudes  toward  pupils.  However,  this  gulf 
between  what  is  known  about  the  clinical  approach  to  su- 
pervision and  what  actually  is  practiced  in  the  supervision 
of  student  teachers  persists. 

In  summary,  the  student  teaching  experience  seems  to 
lack  agreed  upon  purposes  and  is  plagued  with  a confusion 
over  the  roles  and  corresponding  responsibilities  that  par- 
ticipants should  assume.  Solutions  to  these  problems  seem 
to  involve  the  convergence  of  goal  perceptions  among  stu- 
dent teaching  participants  (Guyton  & McIntyre,  1990).  An 
obvious  key  to  such  convergence  is  clear  communication  in 
providing’  detailed  and  “better  explicated  guidelines,  role 
definitions,  and  instructions’’  (Guyton  & McIntyre,  523). 
However  participants  must  have  common  goals  and  purposes 
and,  in  order  to  build  agreement  and  a shared  commitment 
to  goals,  participants  need  to  interact  in  discussing  the  pur- 
poses of  student  teaching  and  their  perception  of  one 
another’s  roles  (Guyton  & McIntyre). 

Methodology 

Sample 

This  study  focused  on  a content  analysis  of  student  teach- 
ing handbooks.  Accredited  institutions  offering  teacher  edu- 
cation programs  in  the  Midwest  were  identified  from  lists 
obtained  from  the  state  department  of  education  in  the  target 
states.  Midwest  was  defined  to  comprise  the  following  states: 
Illinois,  Indiana,  Iowa,  Kansas,  Michigan,  Minnesota,  Mis- 
souri, Nebraska,  North  Dakota,  Ohio,  South  Dakota,  and 
Wisconsin.  The  340  state-accredited  institutions  were  placed 
into  categories  using  four  major  Carnegie  classification  lev- 
els (liberal  arts  colleges,  comprehensive  colleges  and  univer- 
sities, doctoral  granting  institutions,  and  research  institutions), 
and  a stratified  random  sample  of  110  teacher  preparation 
programs  was  selected.  Student  teaching  handbooks  and  in- 
formation and  policies  pertaining  to  cooperating  teachers  and 
university  supervisors  were  requested  by  telephone  from  each 
institution  in  the  sample.  From  this  appeal,  61  handbooks  were 
obtained  representing  one-fifth  of  the  midwestem  teacher 
education  programs.  In  this  sample,  the  Carnegie  classifica- 
tion levels  were  represented  in  percentages  equivalent  to  those 
found  in  the  larger  population  of  midwestem  institutions:  lib- 
eral arts  colleges  (34%),  comprehensive  colleges  and  univer- 
sities (38%),  and  doctoral  granting  institutions  (12%),  and 
research  institutions  (15%). 
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Instrumentation 


Findings 


Two  instruments  were  used  for  the  purpose  of  system- 
atically coding  handbook  statements.  The  first  was  designed 
to  record  task  statements  found  in  the  handbooks.  This  in- 
strument was  organized  according  to  the  six  major  roles  (as- 
sumed by  either  the  cooperating  teacher  or  the  university 
supervisor): 

1.  Orienter  - Describes,  interprets,  the  student  teaching 
program  to  participants,  and  acquaints  student  teachers 
to  school  culture. 

2.  Counselor  - Engages  student  teacher  as  a colleague. 

3.  Instructor  - Organizes,  plans,  and  facilitates  learning 
experiences  for  the  student  teacher  during  the  practicum. 

4.  Facilitator  - Promotes  effective  interaction  of  triad  mem- 
bers in  order  to  achieve  the  goals  of  student  teaching. 

5.  Model  - Demonstrates  professional  practices  to  the  stu- 
dent teacher. 

These  roles  had  been  identified  through  a review  of  the 
literature  and  preliminary  content  analysis  of  student  teach- 
ing handbooks.  The  task  subcategories,  which  were  com- 
piled from  the  pilot  study,  were  organized  within  the  major 
role  categories  according  to  the  established  definitions  for 
these  roles. 

The  second  instrument  was  designed  to  record  the  pres- 
ence of  goals  and  outcomes  in  the  handbooks.  Similar  to  the 
development  of  the  first  instrument,  categories  of  goals  and 
outcomes  (see  Table  3)  were  compiled  from  a pilot  study. 
Goals  were  defined  as  statements  found  in  student  teaching 
handbooks  concerning  the  knowledge  and  skills  student 
teachers  were  expected  to  achieve.  Outcomes  were  defined 
as  statements  found  in  evaluative  instruments  of  handbooks 
concerning  the  exit  competencies  necessary  for  successful 
completion  of  the  student  teaching  program.  The  rationale 
for  documenting  and  comparing  the  relationship  between 
stated  goals  and  measured  outcomes  in  student  teaching  pro- 
grams was  based  on  the  idea  that  congruence  between  ob- 
jectives and  the  evaluation  of  those  objectives  is  indicative 
of  consistency  of  purpose  and  practice  in  a program. 

The  handbooks  were  analyzed  by  considering  separate 
statements  within  the  text  of  the  handbooks.  Prior  to  the 
analysis,  four  handbooks  (not  included  in  the  sample)  were 
analyzed  to  establish  rater-reliability,  and  the  four  raters  were 
able  to  achieve  an  inter-rater  reliability  of  90%  agreement 
on  coded  statements.  Raters  were  initially  asked  to  code  five 
handbooks  along  with  one  that  was  coded  by  all  four  indi- 
viduals. The  analysis  of  the  common  handbook  was  used  as 
a further  reliability  check.  This  procedure  was  repeated  in 
two  more  coding  cycles  until  all  of  the  handbooks  were 
coded.  Inter-rater  reliability  (percent  agreement  of  coded 
statements)  for  the  coding  of  the  common  handbooks  fell 
between  85%  and  90%. 


Descriptive  statistics  were  generated  for  the  combined 
role  categories  and  goals  and  outcomes.  These  data  are  sum- 
marized in  Tables  1,  2,  and  3.  An  examination  of  Table  1 
reveals  that  of  the  836  statements  coded  for  the  cooperating 
teacher,  34%  involved  instructing  tasks,  28%  involved  evalu- 
ating tasks,  and  27%  involved  orienting  tasks. 

Table  2 presents  data  for  the  university  supervisor’s  role 
and  reveals  that  of  the  394  statements  coded , 46%  involved 
evaluating  tasks,  21%  involved  instructing  tasks,  15%  in- 
volved facilitating  tasks,  and  14%  involved  orienting  tasks. 

Table  3 shows  that  the  observed  frequencies  of  outcomes 
stated  in  the  handbooks  were  consistently  higher  than  the 
observed  frequencies  of  corresponding  goal  statements.  Out- 
comes were  coded  nearly  twice  as  frequently  as  goals.  The 
total  of  outcome  observations  was  608,  while  goals  were 
coded  337  times. 

Correlation  analysis  was  performed  on  the  data  gath- 
ered through  the  coding  of  goals  and  outcomes.  Since  both 
correlates  were  dichotomous,  a phi-coefficient  (<J))was  gen- 
erated for  the  observations  on  each  of  the  handbooks.  Ad- 
ditionally, a coefficient  of  determination  (r2)  also  was 
calculated  to  reflect  the  degree  of  interdependence  of  these 
two  variables.  It  should  be  noted  that  19  of  the  61  hand- 
books did  not  include  goals  or  outcomes  and  therefore  could 
not  be  analyzed.  This  analysis  is  summarized  in  Table  4 
and  reveals  that  statistically  significant  correlations  (p<.05) 
were  found  between  the  goals  and  outcomes  in  seven  hand- 
books (.21  < r2^  .33).  The  correlations  (r2)  for  the  other 
35  handbooks  ranged  from  .00  to . 13.  Therefore,  this  analy- 
sis indicates  that  in  35  handbooks  (84%)  no  statistically 
significant  correlation  was  found  between  the  stated  goals 
and  outcomes  of  those  handbooks,  and  even  the  strongest 
interrelationship  of  goals  and  outcomes  (r2  = .33)  reflects 
a rather  weak  link  between  program  goals  and  outcomes. 

Other  findings  include  the  following: 

• In  the  sample  of  handbooks,  7%  (n=4)  directly  described 
the  role  of  cooperating  teachers  and  5%  (n=3)  directly 
described  the  role  of  the  university  supervisors. 

• Over  twice  as  much  space  or  attention  is  devoted  to  the 
tasks  of  cooperating  teachers  as  is  given  to  the  tasks  of 
university  supervisors. 

• All  of  the  handbooks  delineate  the  tasks  for  cooperat- 
ing teachers, 

• Although  84%  of  the  handbooks  (n=5 1)  define  the  tasks 
of  university  supervisors,  in  16%  of  the  handbooks  no 
mention  was  made  of  the  university  supervisors’  tasks. 
In  another  16%  of  the  handbooks  the  university  super- 
visors’ tasks  were  limited  to  one  or  two  paragraphs. 

• Less  than  15%  of  the  handbooks  contained  a formal 
statement  of  the  goals  of  their  student  teaching  program. 


vUomt  10.  Nttnber  4 • Fall  1997 


Mid-Wuttm  Educational  kexecrcktr 


1 i 4 


5 


Freq.  % of  % of 
Total  Role  Total 


Table  1 

Frequencies  of  Coded  Statements  for  Cooperating  Teachers7  Responsibilities  (N~61) 


Orienter 

Describes,  interprets  ST  goals  to  ST 
Describes,  interprets  ST  goals  to  CT, 
Principal 

Describes  & interprets  roles,  tasks  of  CT,  US 
Acquaints  ST  w / school’s  philosophy 
Acquaints  ST  w/  school’s  procedures 
Acquaints  ST  to  CTs  classroom  procedures 
Introduces  ST  to  students 
Acquaints  ST  to  school’s  physical  environ. 
Acquaints  ST  to  school’s  social  environment 
Provides  workspace,  materials,  resources 


Counselor 

Assists  in  job  search/writes  letters  of 
recommendation 
Accepts  ST  as  partner 
Inquires  w / ST  into  teach. -learning  process 

Total 

Instructor 

Schedules  teaching  experiences 
Guides  ST  in  planning  & implementation 
Promotes  application  of  theory  into  practice 
Involves  ST  w/  clerical  aspects  of  teaching 
Promotes  ST’s  extra-curricular  involvement 
Arranges  for  ST  to  observe  other  classrooms 
Provides  opportunity  for  prof,  growth 
Promotes  reflection  & self-evaluation 
Helps  CT  schedule  activities  for  ST 
Helps  ST  develop  personal  teaching  style 
Mentors  ST  in  classroom  management 
Serves  as  resource  person  for  CT 
Promotes  ST’s  experimentation  & 
innovation 

Promotes  professional  relationships  w / 
students,  parents  & faculty/staff 
Helps  ST  develop  pedagogical  skills  in 
teaching 

Conducts  seminar  for  STs 
Promotes  use  of  correct  written  & oral 
expression  in  instruction 


Freq.  %of  %of 
Total  Role  Total 


2 1 
0 0 


37  16 

39  17 

39  17 

33  15 

38  17 

29  13 


40  14 

44  15 


23  8 


29  10 

0 0 


15  5 

14  5 

0 0 
2 1 

285  34% 


Evaluator 

Conferences,  gives  feedback  to  ST 
Provides  ratings  & written  assessment  of  ST 

Confers  w / US  regarding  ST’s  progress 
Confers  w / CT  regarding  ST’s  progress 
Confers  w/  US  regarding  ST’s  problems 
Confers  w 1 CT  regarding  STs  problems 
Conducts  triadic  conferences  other  than 
midterm  & final 

Conducts  extended  conferences  w/  US  & ST 
to  review  midterm  & final  evaluations 
Conducts  extended  conferences  w/  CT  & ST 
to  review  midterm/  final  evaluations 
Periodic  evaluation  of  ST  by  CT  apart  from 
midterm,  final  evaluation 
Periodic  evaluation  of  ST  by  US  apart  from 
midterm,  final  evaluation 
Assigns  final  grade  for  ST 
Manages  the  formal  evaluations 
Manages  the  pre/  post  conference  cycle 
Conducts  mid-term,  final  evaluation 


Facilitator 

Promotes  achievement  of  goals  of  STg 
Promotes  teamwork  between  triad  members 
Promotes  solution  to  problems  in  STg 
Schedules  supervisory  visits 
Maintains  communication  w / Principal 
Serves  as  a resource  for  ST 


Model 

Demonstrates  reflective  approach  in 
teaching 

Demonstrates  professional  behavior  in 
relational  skills 

Demonstrates  effective  teaching  & 
pedagogical  practice 

Totals 


231  28% 

3 17 

3 17 

3 17 

0 0 
0 0 
9 50 


Discussion 

The  problems  cited  in  the  review  of  literature  regarding 
the  confusion  of  cooperating  teacher  and  university  super- 
visor roles  and  the  lack  of  agreement  concerning  the  goals 
and  outcomes  of  student  teaching  may  in  part  be  rooted  in 
the  materials  disseminated  to  cooperating  teachers  and  uni- 
versity supervisors.  A significant  finding  from  this  study 
involves  the  paucity  of  information  concerning  the  roles  and 
tasks  of  cooperating  teachers  and  university  supervisors  pro- 
vided in  student  teaching  handbooks. 

These  handbooks  appear  to  provide  little  assistance  in 
helping  cooperating  teachers  and  university  supervisors  to 
understand  their  essential  roles  in  student  teaching,  includ - 


Total  Statements  Coded  for  CTs  836 

ing  the  kind  of  relationship  they  are  expected  to  develop 
with  each  other  and  with  student  teachers.  Five  of  the  61 
handbooks  included  formal  role  statements  for  both  coop- 
erating teachers  and  university  supervisors.  None  of  these 
five  contained  definitions  of  the  stated  roles.  An  average  of 
1 3.7  statements  per  handbook  related  to  the  tasks  of  coop- 
erating teachers,  and  an  average  of  6.5  statements  per  hand- 
book related  to  the  tasks  of  university  supervisors.  This 
suggests  that  a rather  limited  amount  of  information  con- 
cerning participants'  responsibilities  is  available  in  student 
teaching  materials.  When  one  recognizes  that  cooperating 
teachers  and  university  supervisors  do  not  effectively  com- 
municate about  their  respective  expectations  and  goals 
(Bhagat,  Clark,  <fc  Combs,  1989;  Hoover,  O'Shea,  & Carroll, 
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Table  2 

Frequencies  of  Coded  Statements  for  University  Supervisors’  Responsibilities  (N-6J) 


Freq. 

%of  %of 

Freq. 

% of  % of 

Total 

Role  Total 

Total 

Role  Total 

Orienter 

Evaluator 

Describes,  interprets  ST  goals  to  ST 

14 

26 

Conferences,  gives  feedback  to  ST 

36 

20 

Describes,  interprets  ST  goals  to  CT, 

23 

43 

Provides  ratings  & written  assessment  of  ST 

33 

18  . 

Principal 

Confers  w/  US  regarding  STs  progress 

1 

1 

Describes  & interprets  roles,  tasks  of  CT,  US 

12 

22 

Confers  w/  CT  regarding  ST’s  progress 

23 

13 

Acquaints  ST  w / school’s  philosophy 

2 

4 

Confers  w/  US  regarding  ST’s  problems 

0 

0 

Acquaints  ST  w / school’s  procedures 

1 

2 

Confers  w i CT  regarding  ST’s  problems 

4 

2 

Acquaints  ST  to  CT  s classroom  procedures 

0 

0 

Conducts  triadic  conferences  other  than 

11 

6 

Introduces  ST  to  students 

0 

0 

midterm  & final 

Acquaints  ST  to  school’s  physical  environ. 

0 

0 

Conducts  extended  conferences  w/  US  & ST 

0 

0 

Acquaints  ST  to  school’s  social  environment 

2 

4 

to  review  midterm  & final  evaluations 

Provides  workspace,  materials,  resources 

0 

0 

Conducts  extended  conferences  w/  CT  & ST 

10 

6 

Total 

54 

14% 

to  review  midterm/  final  evaluations 
Periodic  evaluation  of  ST  by  US  apart  from 

9 

5 

Counselor 

midterm,  final  evaluation 

Assists  in  job  search/writes  letters  of 

9 

60 

Periodic  evaluation  of  ST  by  CT  apart  from 

0 

0 

recommendation 

midterm,  final  evaluation 

Accepts  ST  as  partner 

4 

27 

Assigns  final  grade  for  ST 

31 

17 

Inquires  w / ST  into  teach.-leaming  process 

2 

13 

Manages  the  formal  evaluations 

14 

8 

Total 

15 

4% 

Manages  the  pre/  post  conference  cycle 

5 

3 

Instructor 

Conducts  mid-term,  final  evaluation 

3 

2 

Schedules  teaching  experiences 

3 

4 

Totals 

180 

46% 

Guides  ST  in  planning  & implementation 

20 

24 

Facilitator 

Promotes  application  of  theory  into  practice 

7 

8 

Promotes  achievement  of  goals  of  STg 

6 

10 

Involves  ST  w/  clerical  aspects  of  teaching 

1 

1 

Promotes  teamwork  between  triad  members 

11 

19 

Promotes  ST s extra-curricular  involvement 

1 

1 

Promotes  solution  to  problems  in  STg 

7 

12 

Arranges  for  ST  to  observe  other  classrooms 

0 

0 

Schedules  supervisory  visits 

13 

22 

Provides  opportunity  for  prof,  growth 

1 

1 

Maintains  communication  w/  Principal 

7 

12 

Promotes  reflection  & self-evaluation 

9 

11 

Serves  as  a resource  for  ST 

14 

24 

Helps  CT  schedule  activities  for  ST 
Helps  ST  develop  personal  teaching  style 

8 

1 

10 

1 

Totals 

58 

15% 

Mentors  ST  in  classroom  management 

2 

2 

Model 

Serves  as  resource  person  for  CT 

8 

10 

Demonstrates  reflective  approach  in 

0 

0 

Promotes  STs  experimentation  & 

2 

2 

teaching 

innovation 

Demonstrates  professional  behavior  in 

2 

67 

Promotes  professional  relationships  w/ 

3 

4 

relational  skills 

students,  parents  & faculty/staff 

Demonstrates  effective  teaching  & 

1 

33 

Helps  ST  develop  pedagogical  skills  in 

5 

6 

pedagogical  practice 

teaching 

Conducts  seminar  for  STs 

13 

15 

Totals 

3 

1% 

Promotes  use  of  correct  written  & oral 

0 

0 

expression  in  instruction 

Total  Statements  Coded  for  CTs 

394 

Totals 

84 

21% 

1988),  the  absence  of  programmatic  expectations  is  even 
more  glaring. 

The  tasks  assigned  to  cooperating  teachers  cast  these 
individuals  primarily  in  the  notes  of  evaluator,  instructor, 
and  orienter . The  role  of  evaluator  seems  to  focus  on  for- 
mal and  informal  critiquing  of  the  student  teacher's  perfor- 
mance, including  a strong  emphasis  on  the  process  of  formal 
midterm  and  final  evaluations.  The  role  of  instructor  seems 
to  focus  primarily  on  practical  concerns  such  as  organizing 
student  teaching  experiences;  assisting  student  teachers  with 


planning;  and  mentoring  them  in  the  craft  of  teaching.  Simi- 
larly, the  role  of  orienter  focuses  on  acquainting  students 
with  practical  procedures  of  the  school  and  classroom. 

Given  less  attention  than  the  cooperating  teacher,  the 
university  supervisor  is  cast  primarily  in  the  role  of  evalua- 
tor and  secondarily  in  the  roles  of  instructor,  facilitator,  and 
orienter . The  tasks  predominating  in  the  role  of  evaluator 
are  essentially  the  same  as  the  cooperating  teacher’s  evalu- 
ative tasks:  to  conference,  to  provide  feedback,  and  to  pre- 
pare periodic  written  evaluations. 
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Table  3 

Goals  and  Outcomes  Frequency  Totals  and  Ratios  by  Categories  (N=61) 


Goals 

Outcomes 

Total 

Ratio 

of 

Hndbks 

Total 

Ratio 

of 

Hndbks 

Develop  confidence  in  assessment 

23 

.38 

39 

.64 

Develop  ability  to  analyze  & reflect  on  teaching 

13 

.21 

9 

.15 

Link  theory  to  practice 

19 

.31 

5 

.08 

Accept  and  act  on  criticism 

11 

.18 

26 

.43 

Develop  skill  in  the  use  of  instructional  technology 

8 

.13 

18 

.30 

Develop  skill  in  reflectivity  and  self-evaluation 

18 

.30 

20 

.33 

Develop  an  individual  teaching  style 

10 

.16 

6 

.10 

Develop  correct  use  of  written  & oral  expression 

10 

.16 

34 

.56 

Demonstrate  the  desire  to  be  a life-long  learner 

12 

.20 

3 

.05 

Develop  competence  in  planning 

31 

.51 

47 

.77 

Develop  sensitivity  for  individual  differences 

22 

.36 

40 

.66 

Develop  skill  in  classroom  management 

24 

.39 

51 

.84 

Develop  professional  behavior  (responsibility/collegiality) 

31 

.51 

38 

.62 

Maintain  professional  appearance 

16 

.26 

28 

.46 

Gain  competence  in  using  a variety  of  methods 

16 

.26 

36 

.59 

Develop  competence  in  questioning  skills 

4 

.07 

31 

.51 

Develop  competence  in  instructional  skills 

12 

.20 

30 

.49 

Develop  effective  communication  skills  with  students 

9 

.15 

34 

.56 

Develop  communication  skills  with  parents  and  colleagues 

13 

.21 

31 

.51 

Develop  competence  in  motivational  techniques 

6 

.10 

26 

.43 

Develop  ability  to  determine  content  to  achieve  objectives 

10 

.16 

19 

.31 

Demonstrate  competence  in  content  knowledge 

19 

.31 

37 

.61 

There  were  two  important  distinctions  between  the 
cooperating  teachers  and  the  university  supervisors  concern- 
ing the  evaluation  of  student  teachers: 

*(  1 ) Eighty -six  percent  of  the  handbooks  specifically  require 
the  cooperating  teacher  to  conduct  midterm  and  final 
evaluations  while  only  5%  assign  this  task  for  the  uni- 
versity supervisor. 

(2)  The  handbooks  do  not  charge  cooperating  teachers  with 
assigning  the  final  grades  for  student  teachers  but  rather 
assign  this  task  to  university  supervisors. 

It  appears  contradictory  that  the  cooperating  teacher 
would  be  assigned  the  task  of  summative  midterm  and  final 
evaluations  and  not  the  university  supervisor  who  is  respon- 
sible for  assigning  final  grades  for  the  student  teachers.  Since 
these  handbooks  do  not  explain  the  ways  in  which  student 
teaching  participants  are  expected  to  work  together  in  the 
student  teacher's  evaluation,  the  overlapping  tasks  of  evalu- 
ation and  the  contradiction  in  the  assignment  of  the  final 


grade  may  contribute  to  the  kind  of  role  confusion  found  in 
the  research  cited  earlier. 

There  are  indications  that  the  handbooks  in  this  study 
do  not  establishformal  structures  to  enhance  teamwork  and 
to  create  an  understanding  of  the  cooperating  teacher  and 
university  supervisor  roles.  Only  14  of  the  61  handbooks 
charge  cooperating  teachers  and/or  university  supervisors 
with  the  responsibility  to  promote  teamwork  within  the  triad. 
The  major  portion  of  the  university  supervisors'  orienting 
ar  d facilitating  roles  were  concerned  with  organizing  and 
interpreting  the  student  teaching  experience.  How  ever,  only 
12  of  the  61  handbooks  specifically  state  that  the  university 
supervisor  is  to  interpret  the  student  teaching  program  to 
school  personnel  and  to  student  teachers. 

In  addition  to  a lack  of  clearly  stated  and  well  defined 
roles,  this  study  revealed  a lack  of  congruency  between  ar - 
ticulated  goals  and  their  corresponding  outcomes  provided 
in  evaluative  instruments  in  the  student  teaching  handbooks. 
Only  42  of  the  61  handbooks  articulated  programmatic  goals. 
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Table  4 


Correlation  Coefficients  by  Institution 


Institution 

<t>* 

/*> 

Institution 

Handbook  #1 

.351 

.12 

Handbook  #22 

.289 

.08 

Handbook  #2 

.010 

.00 

Handbook  #23 

.567 

.32* 

Handbook  #3 

.226 

,05 

Handbook  #24 

.462 

.21* 

Handbook  #4 

.024 

.00 

Handbook  #25 

.243 

.06 

Handbook  #5 

.000 

.00 

Handbook  #26 

.140 

.02 

Handbook  #6 

.179 

.03 

Handbook  #27 

.140 

.02 

Handbook  #7 

.216 

.05 

Handbook  #28 

.218 

.05 

Handbook  #8 

.025 

.00 

Handbook  #29 

.189 

.04 

Handbook  #9 

.574 

.33* 

Handbook  #30 

.283 

.08 

Handbook  #10 

.118 

.01 

Handbook  #31 

.466 

.22* 

Handbook  #11 

.332 

.11 

Handbook  #32 

.356 

.13 

Handbook  #12 

.482 

.23* 

Handbook  #33 

.277 

.08 

Handbook  #13 

.108 

.01 

Handbook  #34 

.199 

.04 

Handbook  #14 

.087 

.01 

Handbook  #35 

.056 

.00 

Handbook  #15 

.540 

.29* 

Handbook  #36 

.187 

.03 

Handbook  #16 

.199 

.04 

Handbook  #37 

.094 

.01 

Handbook  #17 

.462 

.21* 

Handbook  #38 

.059 

.00 

Handbook  #18 

.149 

.02 

Handbook  #39 

.089 

.01 

Handbook  #19 

.092 

.01 

Handbook  #40 

.302 

.09 

Handbook  #20 

.325 

.11 

Handbook  #41 

.059 

.00 

Handbook  #21 

.262 

.07 

Handbook  #42 

.138 

.02 

Note,  n = 42  Only  42  of  the  61  handbooks  contained 
statements  of  program  goals. 


'<)>:  phi  coefficient.  b r2:  coefficient  of  determination. 

*p  <. 05 

Moreover,  the  frequency  of  outcomes  found  in  the  student 
teaching  handbooks  examined  was  consistently  higher  than 
the  corresponding  goals  (see  Table  3).  Consequently,  these 
student  teaching  handbooks  demand  more  of  students 
through  the  evaluative  instruments  than  through  what  is  ex- 
plicated in  the  goals  found  in  the  same  materials.  This  find- 
ing raises  a serious  question:  How  can  student  teachers  be 
held  accountable  for  expectations  not  established  in  the  goals 
of  the  student  teaching  program?  This  finding  may  also  help 
to  explain  the  lack  of  agreement  among  triad  members  re- 
garding program  goals  in  the  student  teaching  experience 
(Applegate  & Lasley,  1986;  Castillo,  1971;  Copas,  1984; 
Grimmett  & Ratzlaff,  1986;  Guyton  & McIntyre,  1990). 

Recommendations 

The  analysis  of  the  handbooks  in  this  study  provides 
additional  insight  into  the  findings  of  other  researchers  who 
have  documented  role  confusion  within  the  triad  and  a simi- 
lar confusion  in  the  goals  and  outcomes  of  student  teaching. 


Given  the  limited  information  found  in  the  handbooks  con- 
cerning the  roles  participants  are  intended  to  play  and  the 
established  goals  of  student  teaching,  it  is  not  surprising  that 
cooperating  teachers,  university  supervisors,  and  student 
teachers  hold  conflicting  perspectives  on  their  collective 
roles  and  express  confusion  over  the  goals  and  outcomes  of 
student  teaching. 

In  the  absence  of  explicitly  written  materials  to  guide 
cooperating  teachers  and  university  supervisors,  individu- 
als are  left  to  establish  their  own  priorities  based  on  their 
respective  experiences.  Given  the  constraints  upon  commu- 
nication between  cooperating  teachers  and  university  super- 
visors (AACTE,  1991;  Bhagat  et  al.,  1989;  Hoover  et  al., 
1988),  it  is  unlikely  that  supervisors  will  establish  stable 
expectations  for  student  teaching.  However,  it  is  quite  pos- 
sible that  clear  and  formal  articulation  of  programmatic  goals 
and  related  participant  roles  would  facilitate  communica- 
tion within  the  triad. 

The  current  “state  of  the  art”  in  the  supervision  of  stu- 
dent teachers,  as  reflected  in  student  teaching  handbooks, 
does  not  project  the  rigor  or  integrity  one  would  expect  of 
such  a key  program  element.  In  general,  the  program  mate- 
rials analyzed  in  this  study  were  quite  traditional  in  philoso- 
phy and  structure  and  did  not  reflect  an  application  of  the 
research  and  theory  which  supports  the  effectiveness  of  a 
clinical  approach  to  supervision. 

In  order  to  make  student  teaching  as  meaningful  and 
beneficial  as  possible,  teacher  educators  must  know  what 
contributes  to  the  success  of  the  student  teaching  process. 
One  step  in  that  process  is  to  know  what  roles  cooperating 
teachers  and  university  supervisors  should  play.  In  order  to 
reach  such  an  understanding,  current  practice  must  be  as- 
sessed and  compared  with  theoretical  models  of  ideal  prac- 
tice. Guyton  and  McIntyre  (1990)  suggest  three  necessary 
conditions  to  produce  appropriate  roles,  tasks  and  goals:  (a) 
written  role  definitions  of  triad  members  and  written  goals 
for  student  teaching,  (b)  interpretation  of  roles  by  triad  mem- 
bers, and  (c)  implementation  of  these  roles. 

It  is  incumbent  upon  professional  organizations  and 
accrediting  bodies  to  trumpet  the  significance  of  student 
teaching  supervision.  As  the  single  most  influential  experi- 
ence in  preservice  preparation,  student  teaching  should  be 
accorded  a prominent  position  in  professional  standards.  As 
the  data  suggests,  when  it  comes  to  actual  practice,  student 
teaching  supervision  has  been  neglected  and  not  given  the 
thoughtful  attention  befitting  the  culminating  experience  of 
preservice  training. 

A prudent  response  to  the  concerns  addressed  in  this 
paper  would  be  for  teacher  education  faculty  to  engage  K- 
12  teachers  in  a collaborative  development  of  student  teach- 
ing program  goals  and  the  related  roles  and  responsibilities 
of  student  teaching  participants.  Additionally,  effective 
means  of  communicating  these  structures  to  various  partici- 
pants in  student  teaching  should  be  developed  in  order  to 
insure  that  the  goals  of  student  teaching  programs  arc  in- 
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deed  realized.  Well-conceived  and  well-communicated  pro- 
gram purposes  and  structures  that  are  developed  between 
university  and  K-12  faculty  have  the  potential  to  promote 
two  vital  interests  in  teacher  education: 

1 . Collaboration  around  program  goals  has  the  potential 
to  promote  reform  in  student  teaching  wherein  univer- 
sity and  K-12  faculty  work  collaboratively  to  marry  the 
cultures  of  both  institutions  in  a concerted  effort  to 
maximize  the  development  of  prospective  teachers.  Such 
teamwork  in  student  teaching  would  likely  foster  a more 
open  exchange  of  ideas  and  stimulate  the  development 
of  new  insights  and  a richer  understanding  of  teaching 
and  learning  for  all  participants. 

2.  Valuing  the  expertise  of  K-12  teachers  and  engaging 
them  as  true  colleagues  in  program  development  and  in 
mentoring  student  teachers  has  the  potential  to  promote 
the  professional  development  of  cooperating  teachers 
and  thereby  furnish  a piece  of  the  reform  puzzle. 

Thus,  the  student  teaching  experience  should  be  thought 
of  as  much  more  than  just  a bridge  from  preservice  to 
inservice;  it  should  be  conceived  as  an  essential  structure  to 
span  the  rather  imposing  chasm  that  separates  the  cultures 
of  universities  and  K-12  classrooms. 
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Some  Cautions  Concerning  Inferences  about  Proportions , 
Differences  Between  Proportions,  and 
Quotients  of  Proportions 
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Hak  P.  Tam 

National  Taiwan  Normal  University 

Abstract 

The  purpose  of  this  article  is  to  bring  to  the  attention  of  the  educational  research  community  several 
cautions  regarding  the  use  of  inferential  statistics  for  single  proportions,  differences  between  propor- 
tions, and  quotients  of  proportions.  The  user  of  such  procedures  is  urged  to  pay  particular  attention  to 
the  selection  of  the  appropriate  formula  for  the  standard  error  and  to  the  assumption  of  the  indepen- 
dence of  the  observations. 


Among  the  statistical  procedures  that  are  frequently  en- 
countered in  the  educational  research  literature  are  tests  of 
hypotheses  about,  and/or  interval  estimates  for,  single  popu- 
lation proportions,  differences  between  two  population  pro- 
portions, and  quotients  of  two  population  proportions.  In 
survey  research  or  in  educational  testing,  for  example,  one  is 
often  interested  in  estimating  a population  proportion  based 
upon  a proportion  obtained  for  a random  sample  drawn  from 
that  population.  Testing  the  significance  of  the  difference 
between  or  the  quotient  of  two  sample  proportions  is  even 
more  common.  But  despite  the  ubiquity  of  those  procedures 
and  the  supposed  simplicity  of  carrying  them  out,  there  are  a 
number  of  problems  associated  with  applying  such  techniques. 
This  paper  addresses  some  of  the  problems  that  may  have 
escaped  the  notice  of  many  applied  researchers. 

Single  proportions 

Hypothesis  testing  vs.  interval  estimation 

It  is  reasonably  well  known  that  for  many  population 
parameters  it  is  possible  to  do  hypothesis  testing  “for  free”, 
so  to  speak,  by  first  getting  a two-sided  100(l-alpha)%  confi- 
dence interval  for  the  parameter  and  then  seeing  whether  the 
null-hypotbcoized  value  of  the  parameter  is  or  is  not  in  the 
interval.  (See,  for  example,  Wilcox,  1996,  p.  118.)  Unfortu- 
nately, things  can  get  complicated  when  the  parameter  of  in- 
terest is  a proportion.  The  problem  is  the  appropriate  formula 
for  the  standard  error.  It  is  in  conjunction  with  the  choice  of 
standard  error  that  a number  of  difficulties  arise. 

Hypothesized  p vs.  sample  p 

For  hypothesis  testing,  one  must  use  the  hypothesized 
population  p,  not  the  obtained  sample  p,  in  the  formula  for 
the  standard  error,  whereas  in  interval  estimation  there  is  no 
hypothesized  p so  one  has  no  choice  but  to  use  the  sample  p. 
The  traditional  (and  approximate — see  below)  formula,  [p(  1 - 
pVn]-5,  for  the  standard  error  of  a single  proportion,  when 
doing  hypothesis  testing,  is  incorrectly  specified  in  at  least 
one  recent  textbook  (Hinkle,  Wiersma,  & Jurs,  1994).  They 
use  the  sample  p rather  than  the  hypothesized  p in  their  for- 


mula. [On  page  216  of  that  text,  Hinkle  et  al.  (1994)  ac- 
knowledge the  problem  in  a footnote  but  make  matters  worse 
by  using  the  population  size  N rather  than  the  sample  size  n 
in  the  correct  formula  for  the  standard  error.  They  go  on  to 
give  two  worked-out  examples  using  the  wrong  formula.] 

It  can  be  argued  that  for  p’s  near  .5  it  doesn’t  make  much 
difference  whether  you  use  the  sample  p or  the  hypothesized 
p,  since  the  product  of  p and  1-p  is  very  close  to  .25  in  the 
middle  of  the  p scale.  But  for  a sample  p near  the  high  or 
low  end  and  a hypothesized  p near  the  middle  (a  not  uncom- 
mon combination),  or  vice  versa,  it  can  make  a very  big  dif- 
ference indeed.  Tam  and  Kuo  (1996)  give  examples  of 
hypothesized  p’s  and  sample  p’s  for  which  one  can  easily 
arrive  at  opposite  decisions  regarding  rejection  or  non-re- 
jection of  the  hypothesized  p,  depending  upon  which  for- 
mula for  the  standard  error  is  used. 

As  an  illustration  of  this  problem,  consider  testing  a hy- 
pothesized p of  .5  for  a sample  p of  .7  and  a sample  n of  36. 
Using  the  hypothesized  p in  the  formula  for  the  standard  error 
yields  a “critical  ratio”  of  (.7-.5)/.083  = 2.40,  a value  that  is 
not  statistically  significant  at  the  .01  level,  two-tailed.  Using 
the  sample  p yields  a ratio  of  (,7-.5)/.076  = 2.63,  which  is 
statistically  significant  at  that  level.  The  latter,  incorrect  pro- 
cedure would  lead  to  the  rejection  of  the  null  hypothesis 
whereas  the  former,  correct  procedure  would  not. 

n vs.  n-1 

It  has  been  argued,  g.,  by  Blommers  and  Forsyth 
(1977),  that  the  formula  for  the  standard  error  of  a propor- 
tion should  have  n-1  in  the  denominator  rather  than  n,  since 
a proportion  is  a special  case  of  a mean  (where  the  data  are 
all  0’s  and  1 ’s)  and  the  well-known  formula  for  the  standard 
error  of  a mean  has  n-1  in  the  denominator  (when  the  popu- 
lation standard  deviation  is  unknown).  For  purposes  of  de- 
scriptive statistics,  a proportion  is  in  fact  a special  case  of  a 
mean,  but  that  similarity  docs  not  extend  to  inferences  re- 
garding mear  s.  proportions,  and  using  n- 1 rather  than  n 
is  incorrect.  Similar  to  the  above  argument,  for  large  n it 
doesn't  make  much  difference  whether  you  use  n or  n- 1 , but 
it  can  matter  for  small  n. 
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The  derived  formulas  vs.  the  usual  approximation 

As  Reiss  (1981,  pp.  13-15)  and  some  other  authors  (e.g., 
Ghosh,  1979;  Blyth,  1986)  point  out,  the  popular  formula 
for  the  standard  error,  [p(l-p)/n]J,  using  the  hypothesized  p 
for  hypothesis  testing  and  the  sample  p for  interval  estima- 
tion, is  an  approximation  to  more  complicated  formulas. 
[Hays  (1994)  provides  a similar  argument  but,  like  Blommers 
& Forsyth  (1977),  he  subtracts  1 from  the  sample  size  in  the 
formula  for  the  approximation.]  If  the  sample  p is  used  in 
conjunction  with  the  approximate  formula  for  hypothesis 
testing,  the  problem  is  exacerbated. 

The  normal  approximation  to  the  binomial  ( the 
continuity  problem ) 

Even  if  the  correct  formula,  involving  the  hypothesized 
p,  is  used  for  hypothesis  testing  in  conjunction  with  the  nor- 
mal sampling  distribution,  it  must  always  be  kept  in  mind 
that  the  continuous  normal  sampling  distribution  approxi- 
mation to  the  discrete  binomial  sampling  distribution  only 
“works”  for  values  of  np  and  n(l-p)  that  are  not  too  small. 
Moore  & McCabe  (1989)  recommend  the  use  of  the  approxi- 
mation when  both  are  greater  than  or  equal  to  10,  but  some 
authors,  e.g.,  Agresti  (1996)  claim  that  the  approximation  is 
sufficiently  accurate  for  np  and  n(l-p)  greater  than  or  equal 
to  5.  Reiss  (198 1 , p,  13)  insists  that  a correction  for  conti- 
nuity should  also  be  incorporated  in  the  numerator  of  the 
formula  for  the  critical  ratio  (z)  whenever  the  absolute  dif- 
ference between  the  sample  p and  the  hypothesized  p is 
greater  than  (2n)”1. 

The  articles  by  Peizer  and  Pratt  (1968);  Pratt  (1968); 
Blyth  (1986);  and  Ramsey  and  Ramsey  (1988)  provide  good 
discussions  regarding  the  accuracy  of  the  normal  approxi- 
mation. A particularly  interesting  situation  arises  in  small 
samples  in  which  the  sample  p is  equal  to  0 or  1 . In  either  of 
those  cases  the  usual  standard  error  formula,  [p(l-p)/np  , 
yields  a value  of  0,  which  is  of  course  a ridiculous  under- 
estimate of  the  amount  of  sampling  error.  Wilcox  (1996) 
provides  a good  discussion  of  a one-sided  confidence  inter- 
val approach  to  this  problem. 

Differences  between  proportions 

Most  of  the  cautions  just  cited  for  single  proportions 
extend  to  the  case  of  differences  between  proportions  as  well 
(using  the  right  p;  being  aware  of  the  approximate  nature  of 
the  usual  formulas  for  the  standard  errors;  etc.).  In  addition, 
there  are  the  following  issues. 

“Pooled”  vs.  “unpooled” p's 

The  traditional  formula  for  the  (approximate)  standard 
error  of  the  difference  between  two  independent  sample  pro- 
portions, when  testing  the  null  hypothesis  of  equality  of  the 
corresponding  population  proportions,  involves  the  “pool- 
ing” of  the  two  sample  p’s  (pt  and  p2)  in  order  to  get  an 
estimate  of  the  p that  the  two  populations  have  in  common, 
if  the  null  hypothesis  is  true.  [The  formula  for  the  pooled  p 
is  (n^j+n^V^j+n^).]  For  interval  estimation  there  is  no 
pooling  (again,  Reiss,  1981,  p.  29),  and  the  correct  formula 
for  the  standard  error  is  not  for  the  faint  of  heart,  although 
its  approximation,  [p^l-PjVn,  + p2(l-p2)/n2))J,  is  often  quite 


good.  Reiss  goes  on  to  provide  an  alternative  to  the  critical 
ratio  test  that  doesn’t  involve  the  “pooled”  p’s. 

The  connection  with  chi-square 

It  is  also  reasonably  well  known  that  the  significance  of 
the  difference  between  two  independent  sample  proportions 
can  be  tested  by  applying  the  chi-square  test  of  independence 
to  a 2x2  table  displaying  the  appropriate  frequencies,  but  the 
equivalence  of  the  chi-square  to  the  square  of  the  normal  z 
holds  only  for  the  “pooled”  case  and  without  any  continuity 
correction,  unless  the  corresponding  correction  is  incorpo- 
rated in  the  chi-square  formula.  (The  same  argument  holds 
for  the  connection  between  the  z test  for  a single  proportion 
and  the  chi-square  goodness-of-fit  test  for  a dichotomy.) 

Independent  vs.  dependent  sample  proportions 

If  the  two  samples  are  “matched”  in  any  one-to-one  fash- 
ion (same  people,  paired  people  in  a randomized  block  de- 
sign, etc.)  all  of  the  formulas  are  different  (but  there  remains 
the  connection  with  chi-square  via  McNemar’s  test — see 
Pratt  & Gibbons,  1981),  since  they  must  take  into  account 
the  dependence  of  the  samples  by  virtue  of  the  pairing.  One 
occasionally  encounters  certain  applications  in  which  the 
pairing  is  a feature  of  the  design  but  is  not  incorporated  in 
the  analysis,  i.e.,  the  independent-samples  test  is  used  in- 
stead of  the  dependent  samples  test.  The  aiticle  by  Wild 
and  Seber  (1993)  is  particularly  good  for  explaining  the  pro- 
cedures for  testing  hypotheses  about  the  difference  between 
proportions  for  matched  pairs  and  for  determining  interval 
estimates  for  such  differences. 

Other  issues 

Two  other  methodological  articles  are  of  special  rel- 
evance to  the  investigation  of  the  difference  between  two 
sample  proportions.  The  first,  by  Beal  (1987),  compares 
five  competing  methods  for  getting  confidence  intervals  for 
the  difference  between  two  independent  sample  proportions 
for  very  small  samples  (where  the  normal  approximation  is 
not  good).  The  second,  by  Storer  and  Kim  (1990).  com- 
pares seven  competing  methods  for  testing  hypotheses  about 
differences  between  proportions,  with  an  emphasis  on  the 
relative  power  of  those  methods. 

Quotients  of  sample  proportions 

In  most  comparisons  of  sample  proportions  in  epide- 
miological research,  and  in  an  occasional  study  of  two  pro- 
portions in  educational  research,  the  emphasis  is  placed  on 
the  quotient  of  the  proportions  (the  so-called  “relative  risk”) 
rather  than  the  difference  between  the  proportions  (which 
the  epidemiologists  sometimes  call  the  “attributable  risk”). 
There  are  a number  of  advantages  and  a compensating  num- 
ber of  disadvantages  for  emphasizing  the  quotient  instead 
of  the  difference,  as  a descriptive  statistic.  For  example,  if 
the  two  proportions  being  compared  are  .006  and  .002  for 

large  sample  sizes,  a statement  such  as  “the  risk  of is  three 

times  greater  for than  for ” may  be  more  defensible 

than  “the  difference  in  risk  is  four-tenths  of  a percent”.  On 
the  other  hand,  for  small  samples  and  for  p’s  near  the  middle 
of  the  scale  the  difference  may  be  more  communicative. 
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MWERA:  Promise  and  Fulfillment 


Theresa  Strand,  MWERA  Archivist/Historian 
Charles  C.  Anderson,  Jr.,  MWERA  Executive  Officer  (Ret.) 

Introduction 

This  historical  study,  commissioned  by  the  Executive  Board,  was  designed  to  provide  a broad  perspective 
of  the  Mid-Western  Educational  Research  Association  (MWERA),  from  the  events  which  led  to  its  founding  in  the 
1970s  and  its  subsequent  growth  and  development  through  1994.  The  study  focuses  on  the  promise  inherent  in  the 
founding  of  the  association  and  the  fulfillment  of  that  promise. 

The  first  step  in  conducting  the  study  was  to  review  and  systematically  restructure  the  extensive  collection 
of  association  documents  assembled  over  many  years  by  retired  Executive  Officer  Charles  Anderson.  Guided  by 
recommendations  to  the  Executive  Committee  by  Robert  Brennan,  MWERA’s  1 0th  president,  a detailed  classification 
system  was  developed  by  Archivist/Historian  Theresa  Strand,  Association  documents  were  organized,  cataloged,  and 
stored  in  the  MWERA  Archives  which  were  designed  to  serve  as  a multi-functional  information  storage  and  retrieval 
system. 


Sources  of  information  utilized  in  the  study  included  official  documents,  minutes  of  meetings, 
correspondence,  conference  publications,  association  journals  and  newsletters,  and  other  records  and  reports, 
supplemented  by  members’  recollections.  Methods  used  to  conduct  the  study  included  content  analysis,  and  telephone 
and  on-site  interviews.  The  study  which  follows  is  presented  in  three  major  parts:  (1)  The  Promise:  MWERA’s 
Mission  and  Goals;  (2)  MWERA  Today:  An  Association  Portrait;  and  (3)  MWERA’s  Growth  and  Development. 


1.  The  Promise:  MWERA’s  Mission  and  Goals 

Association  Background 

Database  reports,  published  annually  by  the  State  and  Regional  Educational  Research  Association  (SRERA), 
indicate  that  MWERA  was  one  of  eight  regional  educational  research  associations  (ERAs)  which  were  founded  from 
1969  through  1979.  SRERA  is  a Special  Interest  Group  (SIG)  of  the  AERA.  Perceived  advantages  of  regional  ERAs 
were  that  they  were  easier  to  participate  in  than  the  national  ERA,  provided  increased  opportunities  for  professional 
communication,  facilitated  professional  training,  and  reduced  travel  expenses. 

In  recalling  MWERA’s  early  formative  years,  Jean  Pierce,  MWERA  Charter  Member  and  the  association’s 
sixth  president,  observed: 

"Some  of  the  original  founders ...  commented  on  the  excitement  they  felt 
in  forming  an  organization  which  would  enable  members  to  meet  with 
others  who  had  similar  interests  and  to  encounter  quality  presentations-all 
this  at  locations  that  would  be  reasonably  close  to  them.  It  was  felt  that 
national  associations  can  be  too  overwhelming,  and  that  state  associations 
were  too  narrowly  focused  ...  And  so  our  regional  association  was  up  and 
running."  (MWER,  December  1985). 


1973-1975.  Archival  documents  indicate  that  the  idea  for  an  upper  midwest  educational  research 
association  was  sparked  and  fanned  at  successive  AERA  annual  conferences.  In  1973  (New  Orleans),  the  idea  was 
broached;  in  1974  (Chicago),  the  needs  for  the  new  ERA,  its  merits,  and  its  possibility  3 were  discussed  informally; 
and  in  1975  (Washington,  D.C.),  discussants  made  plans  to  survey  potential  member  interest  within  their  respective 
states. 

1976- 77.  At  the  1976  AERA  annual  conference  in  San  Francisco,  planning  for  the  new  ERA  began  in 
earnest.  Results  of  the  state  surveys  of  potential  membership  interest  were  reviewed  at  the  SRERA  SIG  session. 
Attendees  discussed  their  mutual  interest  in  forming  an  upper  midwest  educational  research  association  and  made 
specific  plans  to  hold  an  organizational  meeting  independent  of  AERA,  later  that  year. 

On  June  19,  1976,  the  first  meeting  of  the  Organizational  Committee  was  held  at  Loyola  University  in 
Chicago.  Eight  midwest  states:  Illinois,  Indiana,  Iowa,  Michigan,  Minnesota,  Missouri,  South  Dakota,  and  Wisconsin 
were  represented  by  the  1 1 participants.  Recalling  the  meeting  two  years  later,  Judson  Harmon,  MWERA’s  fourth 
president,  stated  in  his  paper,  MWERA:  A Brief  Account  of  Progress  Over  the  Past  Four  Years: 

"It  may  be  correct  to  say  the  association  was  founded  on  that  day  for, 
although  we  did  not  have  a formal  meeting  with  officers  and  parliamen- 
tary procedures,  we  did  have  excellent  representation  from  the  States  and 
we  did  have  the  association’s  first  name:  the  Upper  Midwest  Educational 
Research  Association . We  also  discussed  the  following  topics:  Name, 

Goals  and  Objectives,  Membership,  Officers,  Organization,  Liaison  with 
other  Associations,  Finances,  Activities,  and  Communication  and 
Dissemination.  Various  people  were  given  topics  upon  which  to  write 
position  papers.  A good  sense  of  purpose  and  leadership  was  experienced 
by  all"  (Unpublished  paper,  February  14,  1978). 

At  the  1977  AERA  annual  conference  in  New  York  City,  an  organizational  meeting  was  conducted  at  which 
four  primary  subcommittees  were  formed:  Constitution,  Membership,  Convention  Program,  and  Convention 
Arrangements.  The  subcommittee  members  included  five  future  MWERA  presidents:  Frank  Farley,  Edward  Griffin, 
Judson  Harmon,  Randall  Isaacson,  and  Samuel  Mayo  (MWERA’s  first  Immediate  Past  President).  Specific  member 
assignments  were  made.  A casual  note  by  Richard  Stiggins  indicated  that  he  considered  this  meeting  to  be  MWERA’s 
actual  founding  meeting. 

On  July  23,  1977,  seven  members  representing  five  states  attended  the  meeting  of  the  Organizational 
Committee  at  Loyola  University  of  Chicago.  Informal  elections  were  conducted  and  four  association  officers  pro  tem 
were  selected:  Edward  Griffin  and  Samuel  Mayo  as  Co-Chairpersons,  Judson  Harmon  as  Secretary,  and  Steve  Colby 
as  Treasurer.  The  business  meeting  was  focused  on  naming  the  new  association,  scheduling  the  first  annual 
conference  in  1978,  planning  outreach  activities  using  AERA  and  NCME  mailing  labels  for  targeted  states  and 
Canadian  provinces,  and  financial  management.  Finally,  members  received  specific  assignments. 

The  meeting  agenda  referred  to  the  association  as  MWERA  or  the  Mid-Westem  Educational  Research 
Association.  However,  members  considered  changing  the  name  to  the  Great  Lakes  Association  for  Research  in 
Education  (GLARE).  The  MWERA  Archives  contain  an  application  for  the  incorporation  of  GLARE  as  a not-for- 
profit  association  which  was  prepared  on  October  20,  1977  but  never  submitted. 

1977- 78.  Prior  to  the  association’s  first  annual  conference  in  May  1978,  two  additional  planning  meetings 
were  held.  On  December  3,  1977,  the  Association  Council  pro  tem  met  in  Oshkosh,  Wisconsin  in  conjunction  with 
the  annual  ■ , ifercnce  of  the  Wisconsin  Educational  Research  Association  (WERA),  and  on  February  18,  1978  met 


at  Loyola  University  of  Chicago.  Attendees  at  the  meetings  focused  on  formalizing  the  association’s  name,  applying 
for  incorporation  as  a non-profit  association  in  Illinois,  refining  the  association’s  constitution,  obtaining  member 
commitments  to  serve  as  state  representatives,  and  preparing  for  the  association’s  first  conference  and  first  formal 
election  to  be  held  at  the  conference. 

At  the  1978  AERA  annual  conference  in  Toronto,  outreach  activities  to  encourage  potential  member  interest 
in  the  new  association  continued.  Richard  Stiggins  presented  a paper  on  the  founding  of  the  new  association,  and 
about  25  interested  persons  later  visited  MWERA’s  hospitality  suite. 

On  May  12,  1978,  MWERA  conducted  its  first  annual  conference  at  the  Indian  Lakes  Country  Club  in 
Bioomingdale,  Illinois.  The  one-day  conference  was  jointly  sponsored  with  the  Northern  Illinois  Association  for 
Educational  Research,  Evaluation  and  Development  (NIAERED).  The  conference  which  was  titled  "Symposium  on 
Education"  emphasized  the  interaction  and  exchange  of  experience  between  producers  and  consumers  of  educational 
research  (Conference  Program,  April  10,  1978). 

The  conference  attracted  185  attendees-many  more  than  the  40  attendees  initially  anticipated  by  the 
Association  Council  members  at  the  December  3,  1977  meeting  in  Oshkosh.  In  each  of  the  conference’s  eight 
meeting  rooms,  on-going  sessions  in  well-defined  areas  of  interest  were  conducted  throughout  the  day.  These  areas 
included:  Predicting  Academic  Success/Non-Verbal  Instructional  Approaches,  Affective  Domain,  Measurement, 
Reform  in  Higher  Education,  Program  Evaluation,  Counseling  and  Guidance/Outreach  Groups,  Statistics/Moral 
Aspects  of  Education,  and  Curriculum  and  Instruction.  The  presenters  included  future  MWERA  presidents  Thomas 
Andre,  Judson  Harmon,  Barbara  Hutson,  and  Dennis  Leitner,  and  MWERA  Secretary  Nona  Tollefson. 

The  conference  included  both  a day  and  an  evening  program.  The  registration  fee  was  $20  for  the  day 
program  and  $8  for  the  evening  program.  The  day  program  included  conference  sessions,  breakfast,  and  luncheon. 
The  evening  program  included  MWERA’s  first  annual  business  meeting  and  formal  election,  dinner,  and  an  invited 
address.  The  election  of  association  officers  at  the  conference  was  the  only  election  in  which  a full  slate  of  officers 
appeared  on  the  election  ballot.  All  future  annual  elections  were  conducted  by  mail.  Elected  officers  included: 
Edward  Griffin,  President;  Samuel  Mayo,  Immediate  Past  President;  Judson  Harmon,  Vice-President;  Jean  Pierce, 
Secretary;  and  Steven  Colby,  Treasurer.  Also,  MWERA’s  constitution  was  reviewed  and  approved. 

An  enthusiastic  letter  affirming  the  success  of  the  conference  was  sent  to  Co-Chairpersons  Edward  Griffin 
and  Samuel  Mayo  on  May  15,  1978  by  Lesley  Steinkellner,  Assistant  Professor  at  Indiana  University  Northwest,  who 
stated: 

"The  number  of  persons  who  htve  joined  MWERA  and  the  group 
attending  the  business  meeting  were  certainly  indicators  that  there  is  a felt 
need  for  such  an  organization.  I want  to  thank  you  all  for  the  effort  you 
have  expended  in  making  MWERA  a reality.  I also  want  to  congratulate 
you  and  your  colleagues  on  an  excellent  conference,  ...  I went  to  the 
meeting  hoping  there  would  be  an  opportunity  for  interaction  and 
conversation  with  colleagues  who  were  interested  in  and/or  working  in 
areas  such  as  I am  investigating.  That  did  indeed  prove  to  be  the  case." 

In  a letter  to  Stephen  Colby  and  Judson  Harmon  on  March  14,  1979,  Edward  Griffin  reviewed  MWERA’s 
development  and  commented: 
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"The  real  founding  of  the  Mid- Western  Educational  Research  Association 
took  place  at  the  Illinois  convention,  1978.  I credit  the  early  summer 

meetings  at  Loyola  University  as  a major  factor  in  our  success The 

AERA  is  a great  organization  as  it  stands. ...  However,  the  credit  for  [the] 

MWERA  association  relates  directly  to  our  people." 

The  date  of  MWERA’s  founding  was  associated  with  various  milestones,  including:  (a)  the  first 
organizational  meeting  held  at  Loyola  University  on  June  19,  1976;  (b)  the  organizational  meeting  held  at  the  1977 
AERA  Annual  Meeting  in  New  York  City  at  which  four  pivotal  subcommittees  were  formed;  and  (c)  MWERA’s 
first  annual  conference  in  Bloomingdale,  Illinois  on  May  12,  1978  at  which  the  association’s  first  formal  election 
was  held.  These  events  were  all  significantly  related  to  MWERA’s  founding.  However,  MWERA’ s official  status 
was  established  on  August  17,  1978  when  MWERA’s  Application  for  Incorporation  was  filed  with  the  Illinois 
Secretary  of  State.  MWERA  was  authorized  as  a not-for-profit  corporation  in  Illinois  with  an  address  at  the  office 
of  Jean  Pierce,  MWERA’s  first  formally  elected  Secretary,  at  Northern  Illinois  University. 

MWERA  acquired  266  charter  members  during  a six- week  charter  membership  period.  Many  of  the  charter 
members  played  leading  roles  in  MWERA’s  growth  and  development.  The  Executive  Board  held  three  planning 
meetings  in  1978:  on  July  28th  and  October  13th  in  Kalamazoo,  Michigan,  and  on  December  1st  in  Chicago. 

A survey  of  MWERA  membership  indicated  member  preference  for  a fall  conference  schedule.  Accordingly, 
the  association  officers  made  this  transition  by  conducting  both  a spring  and  fall  conference  in  1979.  Both 
conferences  were  conducted  jointly  with  other  ERAs:  the  spring  conference  with  the  Michigan  Educational  Research 
Association  (MERA)  on  March  21-23  in  Kalamazoo,  Michigan,  and  the  fall  conference  with  the  Wisconsin 
Educational  Research  Association  (WERA)  on  November  15-16  in  Milwaukee. 

Mission  of  the  Association 

MWERA’s  Application  for  Incorporation  filed  on  August  17,  1978  indicates  that  the  purpose  or  mission 
of  the  association  is  " ...  to  improve,  promote,  and  disseminate  educational  research."  Association  methods  for 
accomplishing  the  mission  are  stated  in  the  1981  amendment  to  MWERA’s  bylaws:  "The  methods  used  will  be  the 
publication  of  research  in  a newsletter/joumal,  presentation  of  research  findings  at  an  annual  convention,  and  other 
professional  activities  deemed  appropriate  by  the  association," 

Association  Goals 

At  the  Association  Council’s  meeting  on  December  1, 1978  in  Chicago,  MWERA  President  Edward  Griffin 
identified  four  major  association  goals:  (1)  enhance  communication  among  educational  research  and  evaluation 
personnel,  (2)  provide  in-service  training,  (3)  serve  as  liaison  with  other  professional  groups  and  organizations,  and 
(4)  promote  educational  problem  solving.  In  considering  the  importance  of  the  goals  to  MWERA’s  future,  Edward 
Griffin  affirmed: 


"....  [it]  must  be  concluded  that  a research  association  designed  to  serve 
the  broad  perspective  of  researchers  in  a wide  variety  of  settings  by 
providing  tools  for  communication,  sharing  common  problem  solving  and 
regional  development  efforts,  new  opportunities  for  professional  skill 
development,  socialization,  and  better  procedures  for  the  dissemination  of 
educational  research  would  indeed  be  serving  a valuable  and  unique 
function."  ( MWER,  May  1981). 
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Additionally,  founding  members  had  strong  feelings  about  the  appropriate  social  climate  of  the  new 
association.  In  a letter  to  Richard  Stiggins  on  June  16,  1977,  Judson  Harmon  wrote: 

"...  I think  this  association  should  be  different  from  the  others  with 
respect  to  the  constraint  and  tensions  I have  felt  in  other  professional 
associations.  This  ought  to  be  an  association  where  the  lowly  novice  is 
made  to  feel  welcome,  and  where  the  high  and  mighty  occasionally  get 
roasted.  This  ought  to  be  an  association  where  there  are  some  traditions, 
some  bizarre  ceremonies,  some  pageantry,  some  song  and  laughter...." 

2.  MWERA  Today:  An  Association  Portrait 

MWERA  is  a regional  association  of  professional  educational  researchers  primarily  from  13  states  located 
in  the  midwestem  region  of  the  United  States.  These  core  states  include:  Illinois,  Indiana,  Iowa,  Kansas,  Kentucky, 
Michigan,  Minnesota,  Missouri,  Nebraska,  North  Dakota,  Ohio,  South  Dakota,  and  Wisconsin.  Additionally,  MWERA 
has  an  open  membership  policy  regarding  those  living  in  other  states,  Canada,  or  other  countries. 

Membership  is  open  to  faculty,  students,  and  administrators  from  any  university,  college,  and  school.  Also, 
the  association  encourages  membership  by  college  and  university  students  engaged  in  educational  research,  as  well 
as  by  educational  researchers  from  business  and  industry,  government  and  private  agencies,  and  other  organizations. 
Although  there  are  three  types  of  membership  dues:  Professional,  Graduate  Student,  and  Lifetime,  all  MWERA 
members  enjoy  the  same  rights  and  privileges,  and  are  subject  to  the  same  conditions  and  restrictions. 

Members’  rights  include  the  right  to  vote  by  mailed  ballot  or  at  meetings  as  appropriate,  attend  division  and 
general  business  meetings  at  the  conference,  serve  on  committees,  hold  elective  office,  listen  to  and  make  conference 
presentations,  enroll  in  professional  training  workshops,  attend  social  activities  scheduled  at  the  annual  conference, 
and  receive  a subscription  to  the  association’s  professional  journal,  the  Mid-Western  Educational  Researcher. 

MWERA’s  bylaws,  purposes,  and  divisional  structure  are  patterned  after  those  of  the  American  Educational 
Research  Association  (AERA).  Both  associations  are  designed  to  encourage,  improve,  and  disseminate  information 
about  theoretical  and  applied  educational  research.  MWERA  promotes  and  disseminates  educational  research  through 
its  annual  conference,  professional  journal,  and  its  scholarship  program.  MWERA’s  governance,  structure,  and 
operations,  as  defined  by  the  association’s  bylaws,  are  described  below. 

Governance 

The  policy-making  body  of  the  organization  is  the  Association  Council  which  consists  of  a six-member 
Executive  Board  or  Board  of  Directors  and  15  elected  Councilors.  The  Board  which  serves  as  the  executive  arm  of 
the  Association  Council  includes  four  presidential  members  (President,  Vice-President,  President-Elect,  and 
Immediate  Past  President),  Secretary,  and  Member-at-Large.  Other  non-elected  members  of  the  Board  who  serve  in 
an  ex  officio  capacity  include  the  Executive.  Officer,  Journal  Editors),  and  Historian. 

A new  Vice  President  is  elected  each  year  to  serve  a four-year  presidential  commitment.  In  the  year 
immediately  following  his/her  election,  the  Vice-President  serves  as  Program  Chair  for  the  annual  conference.  In 
consecutive  yean,  the  Vice-President  moves  up  one  presidential  level  from  Vice-President  to  President-Elect,  then 
to  President,  and  finally  to  Immediate  Past  President.  The  Secretary,  Member-at-Large,  and  Councilors  are  elected 
for  two-year  terms.  However,  eight  Councilors  are  elected  in  one  year,  and  seven  Councilors,  the  following  year. 
Thus,  while  approximately  half  the  Councilors  are  serving  the  first  year  of  their  term  of  office,  the  other  Councilors 
are  serving  their  second  year.  Ex  officio  members  of  the  Board  serve  a three  year  term  and  may  be  reappointed. 
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Structure 


MWERA’s  division  and  committee  structure  includes  1 1 division  areas  and  four  committee  types,  as  follows: 

Association  Divisions.  MWERA’s  1 1 division  areas  correspond  to  those  of  AERA  and  include:  (A) 
Administration,  (B)  Curriculum  Studies,  (C)  Learning  and  Instruction,  (D)  Measurement  and  Research  Methodology, 
(E)  Counseling,  Human  Development,  and  Special  Education,  (F)  History  and  Philosophy  of  Education,  (G)  Social 
Context  of  Education  and  Motivation,  (H)  School  and  Program  Evaluation,  (I)  Professional  and  Medical  Professions, 
(J)  Post-secondary  Education,  and  (K)  Teaching  and  Teacher  Education. 

For  each  division  area,  the  V ice-President/Program  Chair  appoints  a Chair  and  Co-Chair  to  serve  on  the 
Program  Committee  for  a two-year  term.  The  Chairs  and  Co-Chairs  represent  their  respective  division's  professional 
interests,  needs,  and  goals.  They  receive,  review,  and  approve  proposals  for  conference  papers/symposia  under  the 
direction  of  the  Program  Chair, 

Association  Committees.  MWERA’s  committee  structure  includes  six  permanent  standing  committees, 
other  standing  committees  which  are  discontinued  at  the  completion  of  their  missions,  subcommittees  which  may 
be  appointed  by  any  committee  chair,  and  other  ad  hoc  committees.  The  responsibilities  of  the  six  permanent  standing 
committees  are  briefly  described  below: 

► Membership  Committee  is  responsible  for  all  developmental  and  public  relations  efforts  with  potential 
members.  The  committee  which  is  chaired  by  the  Member-at-Large  includes  Councilors  and  other  persons 
who  may  be  appointed  by  the  President. 

► Nominating  Committee  is  responsible  for  conducting  nomination  procedures,  including  presentation  of 
a slate  of  potential  officers  who  are  able  and  willing  to  serve.  The  Committee  includes  the  President, 
President-Elect,  and  Immediate  Past  President. 

► Tellers  Committee,  a three-member  committee  chaired  by  the  Secretary,  is  responsible  for  conducting  the 
association’s  elections,  including  preparation  of  ballots,  mailing,  and  determining  results  of  the  election  and 
issues  presented  on  the  ballot. 

► Editorial  Board  is  responsible  for  overseeing  all  association-related  publications.  The  Journal  Editor  serves 
a^ehair  of  the  Editorial  Board. 

► Program  Committee  is  responsible  for  arranging  program  content  and  for  making  local  arrangements  for 
the  annual  conference.  The  committee  includes  the  V ice-President/Program  Chair,  Division  Chairs  and  Co- 
Chairs,  and  Coordinator  for  Local  Arrangements.  The  V ice-President/Program  Chair  arranges  for  conference 
speakers  and  makes  decisions  about  papers  to  be  presented.  Division  Chairs  and  Co-Chairs  are  responsible 
for  conducting  blind  reviews  of  papers  and  symposia  utilizing  MWERA  members  as  reviewers. 

► Awards  Committee  is  responsible  for  all  awards  presented  at  the  annual  conference.  The  committee 
includes  the  Immediate  Past  President  and  the  President-Elect. 

Operations 

MWERA’s  major  association  activities  revolve  about  scheduled  meetings  of  the  Board  of  Directors  and 
Association  Council,  functional  roles  of  MWERA  officers,  association  elections,  annual  conference,  and  publication 
of  the  association  journal.  These  are  described  below. 
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Scheduled  Meetings.  The  term  of  office  generally  begins  immediately  after  the  close  of  the  annual 
conference  and  continues  through  the  next  annual  conference.  The  new  Board  of  Directors  meets  at  the  conference 
site  on  Saturday  afternoon  to  review  and  coordinate  plans  for  the  coming  year.  Additional  scheduled  meetings  include 
an  interim  winter  meeting  of  the  Board  of  Directors,  usually  in  Chicago.  An  Association  Council  meeting  and  a 
General  Business  meeting  are  conducted  during  the  annual  conference  in  October.  Informal  meetings  which  may  be 
held  at  other  times  during  the  year  include  telephone  conference  calls  and  e-mail  correspondence. 

Functional  Roles  of  Officers.  MWERA’s  bylaws  designate  the  functional  roles  of  MWERA’s  elected  and 
appointed  officio  officers: 

► Vice-President  as  Program  Chair,  implements  Board  of  Directors’s  guidelines  for  appointing  all  Division 
Chairs  and  Co-Chairs;  and  manages  the  program  for  the  annual  conference,  including  preparation  of  the  Cali 
for  Proposals,  the  Special  Program  Issue  of  the  Mid-Western  Educational  Researcher,  and  the  Conference 
Abstracts. 

► President  as  chief  officer  of  the  association,  ensures  implementation  of  MWERA’s  bylaws,  conducts  all 
official  meetings,  takes  whatever  actions  are  deemed  appropriate  by  the  Board  of  Directors  and  Association 
Council,  appoints  committees  and  task  force  groups  or  delegates  such  authority  to  other  officers,  and  presents 
the  presidential  address  at  the  annual  conference. 

► President-Elect  prepares  the  association  budget  for  approval  by  the  Association  Council  and  conducts 
official  meetings  in  the  absence  of  the  President. 

► Immediate  Past  President  serves  as  Chair  of  the  Awards  Committee. 

► Member-at-Large  serves  as  Chair  of  the  Membership  Committee  and  conducts  the  annual  conference 
evaluation. 

► Secretary,  under  direction  of  the  President,  prepares  the  agenda  and  minutes  for  the  respective  meetings 
of  the  Board  of  Directors  and  Association  Council,  presents  proposed  constitutional  changes  to  the 
membership  at  the  annual  conference,  conducts  the  annual  election,  including  preparation  and  mailing  of 
the  ballots;  and  chairs  the  Tellers  Committee  which  tallies  election  returns. 

► Councilors  serve  on  the  Membership/Recruitment  Committee  r other  committees.  The  Councilors 
represent  membership  and  constituency  interests  at  all  levels  of  governance.  They  review  and  approve  all 
policy  and  constitutional  issues,  and  approve  all  budgets,  financial  reports,  and  dues  assessments. 

► Executive  Officer  maintains  membership  records  and  association  accounts,  receives  all  monies  for  the 
association,  manages  finances  and  bank  accounts  under  the  direction  of  the  Board  of  Directors,  and  prepares 
and  presents  the  association’s  annual  financial  statements.  This  position  carries  with  it  an  honorarium  and 
expense  account  approved  by  the  Board  of  Directors. 

► EditorisI  and/or  Co-Edit  oris)  appoints  an  Editorial  Board  under  guidelines  established  by  the  Board  of 
Directors;  solicits  manuscripts  for  publication  in  the  association  journal;  prepares,  publishes,  and  distributes 
the  association  journal  to  members  and  others,  as  approved  by  the  Executive  Committee;  and  solicits  funding 
and  financial  support  as  approved  by  the  Board  of  Directors. 

► Historian  collects,  categorizes,  and  maintains  the  holdings  of  the  MWERA  Archives;  provides 
informational  services  and  products;  and  prepares  historical  studies. 
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Elections 


Each  year,  the  membership  votes  for  a new  Vice-President  and  for  seven  or  eight  Councilors,  and  any 
proposed  amendments  and/or  resolutions,  and  every  other  year,  the  membership  vote  i for  a new  Secretary  and  new 
Member-at-Large.  The  Secretary  conducts  the  elections  by  mail  ballot.  Each  election  envelope  mailed  to  a MWERA 
member  includes  a cover  letter  prepared  by  the  Secretary,  the  election  ballot  displaying  candidates’  names  and 
proposed  amendments  and/or  resolutions,  candidates’  biographies,  and  a return  envelope.  The  Tellers  Committee 
which  tallies  the  election  returns  is  chaired  by  the  Secretary. 

Annual  Conference 

MWERA’ s annual  fall  conference  is  the  association’s  major  event  of  the  year.  The  conference  involves  the 
cooperation  of  many  indivkk  's  in  numerous  activities  involving  conference  planning,  implementation,  and 
evaluation.  Conference  presentations  include  invited  addresses,  paper/symposia,  various  types  of  interactive  sessions, 
and  the  presession  professional  development  workshops.  Other  scheduled  activities  include  fhe  conference  luncheon; 
association  meetings  of  the  council,  general  business,  and  divisions;  and  social  events,  including  the  President’s 
Reception  and  the  informal  Cracker  Barrel  Social. 

Association  Publications 

The  Mid-Westem  Educational  Researcher  is  MWERA’s  official  publication.  The  professional  journal  is 
published  three  times  a year  and  includes  research  articles  and  reports,  overviews  of  annual  conferences,  invited 
addresses,  and  other  features.  Journal  issues  devoted  to  special  topics  are  published  on  an  occasional  basis.  Also, 
MWERA’s  annual  conference  program  is  published  as  the  Special  Program  Issue  of  the  journal.  The  Vice-President/ 
Program  Chair  serves  as  editor  of  the  special  program  issue,  and  also  prepares  the  Annual  Conference  Announcement, 
Call  for  Program  Proposals,  and  the  Conference  Abstracts.  Other  association  publications  include  the  MWERA 
Brochure  and  the  MWERA  Membership  Directory. 

3.  MWERA’s  Growth  and  Development 


The  MWERA  Timeline,  on  pages  20-24,  traces  the  association’s  growth  and  development  from  the 
pioneering  spirit  of  the  seventies,  through  the  association  challenges  of  the  eighties,  and  the  organizational 
adjustments  in  the  early  part  of  the  nineties.  An  overview  of  developmental  changes  that  occurred  in  the  areas  of 
membership,  constitutional  amendments,  annual  conferences,  and  association  journals  follows. 

Membership 

As  Treasurer/Executive  Officer  from  1980  through  1995,  Charles  Anderson  developed  and  maintained  a 
MWERA  membership  database  which  facilitated  preparation  of  statistical  data  reported  in  this  study.  Membership 
data  were  generated  consistently  by  calendar  year,  from  January  1st  through  December  31st.  MWERA  members 
include  those  in  three  primary  membership  categories:  professional,  graduate  student,  and  lifetime.  Also,  MWERA 
members  are  typically  located  in  the  13  midwest  regional  states  or  in  other  states  and  Canada. 

Table  1,  on  the  next  page,  presents  annual  membership  data  for  1 1 years,  from  1984-1994.  Findings  indicate 
that  total  memberships  more  than  doubled  in  size  from  314  in  1984  to  673  in  1994.  Annual  memberships  ranged  in 
size  from  a low  of  222  in  1985  to  a high  of  673  members  in  1994.  Sizable  drops  in  membership  occurred  in  1985 
and  1988  which  were  offset  by  sizable  increases  in  1986  and  1989.  In  1989,  memberships  began  to  accelerate, 
resulting  in  an  increase  of  203  members  by  1994. 
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Table  1 

Annual  MWERA  Membenhips  from  1984-1994,  by 
Regional  State,  Other  Statee/Canada,  and  Total  Membenhips 


Regional  States 

19S4 

1985 

1986 

1987 

1988 

1989 

1990 

1991 

1992 

1993 

1994 

Illinois 

96 

63 

124 

114 

115 

127 

138 

164 

173 

197 

207 

Indiana 

16 

16 

35 

38 

29 

35 

51 

54 

61 

66 

84 

Iowa 

11 

13 

29 

30 

15 

11 

22 

16 

19 

27 

23 

Kansas 

21 

16 

27 

24 

30 

28 

23 

29 

29 

27 

35 

Kentucky 

i 

1 

2 

5 

2 

1 

2 

3 

3 

3 

6 

Michigan 

24 

19 

30 

24 

26 

25 

26 

33 

26 

16 

23 

Minnesota 

6 

4 

5 

5 

5 

5 

8 

8 

8 

9 

6 

Missouri 

7 

1 

5 

U 

11 

10 

16 

19 

24 

19 

18 

Nebraska 

10 

3 

10 

8 

6 

12 

24 

17 

16 

19 

17 

N.  Dakota 

8 

3 

5 

3 

1 

1 

1 

1 

1 

1 

4 

S.  Dakota 

1 

1 

2 

1 

2 

6 

3 

Ohio 

78 

54 

96 

113 

113 

146 

175 

162 

136 

160 

157 

Wisconsin 

32 

25 

31 

74 

44 

47 

47 

49 

40 

37 

36 

Total  Rag*  States 

310 

218 

399 

452 

398 

450 

533 

556 

538 

587 

619 

Other  States/Cacada 

4 

4 

8 

9 

11 

20 

30 

41 

49 

53 

54 

Total  Memberships 

314 

222 

407 

461 

409 

470 

563 

597 

587 

640 

673 

Figure  1 

Comparison  of  MWERA  Membenhips  from  Regional 
States  and  Other  States/Canada,  by  Year  from  1984-1994 
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The  annual  membership  pattern  across  all  regional  states  is  similar  to  total  MWERA  memberships.  States 
with  the  most  MWERA  memberships  include  Illinois  and  Ohio,  followed  by  Indiana,  Iowa,  Kansas,  and  Michigan. 
In  1994,  there  were  207  members  from  Illinois,  157  from  Ohio,  84  from  Indiana,  35  from  Kansas,  23  from  Iowa, 
and  23  from  Michigan. 

Figure  1 , included  on  the  preceding  page,  displays  the  comparative  number  of  MWERA  memberships  across 
all  regional  states  with  MWERA  memberships  from  other  states  and  Canada.  Findings  affirmed  that  total  membership 
across  all  regional  states  was  predominantly  higher  than  total  membership  for  other  states  and  Canada,  However, 
there  was  a small  but  steady  increase  in  memberships  from  other  states  and  Canada  from  4 in  1984  to  54  in  1994. 

Graduate  student  memberships  are  considered  vital  to  MWERA’ s continuing  success  as  a regional 
educational  research  association.  Table  2,  on  the  following  page,  presents  comparative  membership  data  for  graduate 
students,  professionals,  and  total  members  by  regional  state,  from  1992  through  1994.  Findings  indicate  that  total 
MWERA  membership  across  all  regional  states  increased  by  81 -from  538  members  in  1992  to  619  member*  in 
1994.  Of  the  619  members,  421  were  professionals  and  198  were  graduate  students,  suggesting  an  approximate  ratio 
of  2.12  professional  memberships  for  each  graduate  student  membership. 

Figure  2,  on  the  following  page,  displays  the  comparative  number  of  total  professional  and  total  graduate 
student  members  by  year.  Figures  3a-3c  display  the  comparative  membership  of  professionals  and  graduate  students 
by  regional  state  and  year.  Findings  indicate  that  Illinois  and  Ohio  which  had  the  highest  number  of  MWERA 
memberships  also  had  the  highest  number  of  graduate  student  memberships,  followed  by  Indiana. 

Association  members  in  general  appear  to  have  ambivalent  feelings  concerning  continuing  growth  in 
MWERA  membership.  Although  increased  membership  size  may  have  its  advantages,  there  is  some  concern  that 
MWERA’s  unique  qualities  as  a smaller  organization  may  undergo  change. 

Constitutional  Amendments 

MWERA’ s original  constitution  was  reviewed  and  approved  by  membership  at  the  first  formal  election 
conducted  at  the  May  12,  1978  conference.  Preceding  events  included:  formation  of  a four-member  Constitution 
Committee  at  the  1977  AERA  annual  conference;  transmittal  of  a draft  version  of  the  constitution  and  a cover  letter 
dated  June  16,  1977  from  Judson  Hannon  to  Edward  Griffin  and  Richard  Stiggins;  and  review  of  the  draft 
constitution  by  participants  at  the  December  3,  1977  meeting  in  Oshkosh,  and  the  February  18,  1978  meeting  in 
Chicago. 

Subsequent  revisions  to  the  association’s  bylaws  were  made  by  proposed  amendments  which  were  listed  on 
the  election  ballot  and  voted  upon  by  the  MWERA  membership  in  the  annual  elections.  Archival  records  of  proposed 
and  approved  amendments  beginning  in  1981  are  included  in  the  MWERA  Archives.  Highlights  of  the  amendments 
to  the  bylaws  appear  below: 

► Committees.  The  Editorial  Board  and  Membership  Committee  were  given  status  as  Permanent  Standing 
Committees  in  1981  and  1984,  respectively.  ...  Appointment,  composition,  and  responsibilities,  as 
appropriate,  were  designated  for  the  Membership  Committee,  Tellers  Committee,  Nominating  Committee, 
and  Division  Chairs. ...  In  1990,  MWERA’s  Divisions  were  restructured  to  correspond  with  those  of  AERA. 

► Elected  and  Appointed  Officers.  Officer  appointees  were  classified  as  ex  officio  (non-voting)  members. 
In  1987,  the  appointed  position  of  Executive  Officer  and  his/her  designated  responsibilities  were  established. 
Also,  the  elective  office  of  Treasurer  was  replaced  by  an  elected  Member-at-Largc  whose  major 
responsibility  was  serving  as  Chair  of  the  Membership  Committee.  ...  Terms  of  office  for  elected  and 
appointed  officers  were  designated. 


Table  2 


Comparison  of  Graduate  and  Professional  MWERA  Memberships, 
by  Regional  State  and  Total  Regional  States,  by  Year  from  1992-1994 


1992 

1993 

1994 

Regional  States 

Grad. 

Prof 

Total 

Grad. 

Prof. 

Tottl 

Grad. 

Prof. 

Total 

Illinois 

65 

108 

173 

70 

127 

197 

75 

132 

207 

Indiana 

13 

48 

61 

22 

44 

66 

35 

49 

84 

Iowa 

1 

18 

19 

L 7 

20 

27 

9 

14 

23 

Kansas 

4 

25 

29 

5 

22 

27 

6 

29 

35 

Kentucky 

3 

3 

3 

3 

6 

6 

Michigan 

6 

20 

26 

7 

9 

16 

7 

16 

23 

Minnesota 

8 

8 

1 

8 

9 

1 

5 

6 

Missouri 

10 

14 

24 

7 

12 

19 

3 

15 

18 

Nebraska 

8 

8 

16 

8 

11 

19 

4 

13 

17 

N.  Dakota 

1 

1 

1 

1 

1 

3 

4 

S.  Dakota 

1 

1 

2 

6 

6 

3 

3 

Ohio 

46 

90 

136 

60 

100 

160 

52 

105 

157 

Wisconsin 

40 

40 

3 

34 

37 

5 

31 

36 

Total  Reg.  States 

154 

384 

538 

191 

396 

587 

198 

421 

619 

t 


Figure  2 

Comparison  of  MWERA  Graduate  and  Professional 
Memberships  Across  All  Regional  States:  1992-1994 
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Figure  3a 

MWERA  Graduate  and  Professional 
Memberships,  by  Regional  State  and  Year:  1992 
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Figure  3b 

MWERA  Graduate  and  Professional 
Memberships,  by  Regional  State  and  Year:  1993 
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Figure  3c 

MWERA  Graduate  and  Professional 
Memberships,  by  Regional  State  and  Year:  1994 
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► Nominations  and  Elections.  Specific  procedures  used  in  conducting  the  mail  elections  were  modified. 
Policies  in  filling  vacancies  in  officer  positions  were  designated. 

► Meetings  and  Business.  In  1985,  an  amendment  specified  that  at  least  one  convention  be  held  each  year 
and  that  at  least  one  session  at  the  convention  be  set  aside  for  an  open  business  meeting  for  the  entire 
membership  ...  In  1991,  professional  membership  dues  were  increased  to  $18  to  help  cover  rising 
organizational  expenses  and  those  associated  with  the  new  association  journal.  (This  represented  the  first 
increase  in  dues  since  1982.)  Annual  membership  dues  for  graduate  students  remained  at  $10. ...  In  1992, 
Lifetime  membership  dues  were  established  at  10  times  the  annual  professional  membership  dues. 

Annual  Conferences 

From  1978  through  1994,  MWERA  conducted  18  annual  conferences,  and  also,  initiated  several  important 
changes  along  die  way.  MWERA’s  first  annual  conference  was  conducted  in  spring  of  1978.  However,  a decision 
was  made  to  change  to  a fall  conference  schedule  which  was  accomplished  by  conducting  both  a spring  and  fall 
conference  in  1979. 

In  its  early  developmental  years,  MWERA  established  liaisons  with  other  organizational  ERAs  in  the 
midwest  and  co-sponsored  six  annual  conferences  in  different  cities  and  states:  in  1978  and  1982 , in  Bloomingdale 
and  Chicago,  respectively,  with  the  Northern  Illinois  Association  for  Educational  Research,  Evaluation,  and 
Development  (NIAERED);  in  Spring  1979 , in  Kalamazoo  with  the  Michigan  Educational  Research  Association 
(MERA);  in  Fall  1979 , in  Milwaukee  with  the  Wisconsin  Educational  Research  Association  (WERA);  in  1981,  in 
Des  Moines  with  the  Iowa  Educational  Research  and  Evaluation  Association  (IEREA);  and  in  1983 , in  Kansas  City 
with  the  Psychological  and  Educational  Researchers  of  Kansas  (PERK), 

In  1980,  MWERA  held  its  first  independent  annual  conference  in  Toledo,  Ohio.  Beginning  in  1984, 
MWERA  made  its  transition  to  independently  conducted  conferences  to  be  held  on  a regular  basis  in  Chicago  at  the 
Bismarck  Hotel.  The  hotel,  conveniently  located  and  affordable,  was  well-received  by  members  and  continued  to  be 
the  site  of  MWERA’s  annual  conferences  through  1995. 

MWERA  regularly  offers  professional  development  workshops  on  Wednesday,  preceding  the  regular 
conference.  Additionally,  a concerted  effort  has  been  made  to  increase  student  membership  through  incentives,  such 
as  dedicated  sessions,  scholarship  program  which  provides  a fee  waiver  and  complimentary  membership  for  three 
students  each  year,  and  a Certificate  of  Graduate  Student  Participation  to  students  who  author  a paper  presented  at 
the  conference. 

MWERA’s  annual  conference  structure  is  stabilized.  The  two  and  one-half  day  conference  begins  on 
Thursday  morning  and  ends  at  Saturday  noon.  Conference  highlights  include  featured  speakers  (conference  opening 
on  Wednesday  evening,  keynote  address  on  Thursday  morning,  conference  luncheon  on  Friday,  and  the  Presidential 
Address  usually  on  Saturday  morning.  Other  conference  features  include  scheduled  meetings  of  the  MWERA  Council, 
General  Business  meeting  open  to  the  membership,  and  Division  meetings,  and  the  Exhibit  Hall  for  publishers 
displaying  materials  and  offering  services  to  educators. 

Association  Journals 

MWERA’s  official  publication  is  its  association  journal  which  has  been  published  in  three  different  formats: 
(1)  as  a mini-journal,  the  Mid-Western  Educational  Researcher,  from  October  1980  through  Spring  1987;  (2)  as  a 
newsletter,  MWERA  Researcher , from  Spring  1988  through  Fall  1990;  and  (3)  as  a full-size  professional  journal, 
Mid-Western  Educational  Researcher , from  Winter  1991  through  the  present.  Each  of  the  association  publications 
has  had  its  own  unique  characteristics,  in  terms  of  journal  layout,  format,  and  institutional  support. 


Northern  Illinois  University  in  DeKalb  was  the  home  base  for  the  mini-journal,  and  Leonard  Kise  served 
as  editor  for  its  duration,  from  1980  through  1987.  During  these  years,  his  co-editors  included  Jean  Pierce  (1980- 
1981);  Roberta  Starkey  (1982);  and  Robert  Rcsemier  (1983-1987).  The  mini-journal,  SVz  by  854  inches  in  size,  was 
published  three  times  a year.  Its  content  included  conference  abstracts,  association  news,  presidential  addresses, 
invited  addresses,  and  other  articles.  Publication  problems  included  shortage  of  manuscripts,  difficulty  in  obtaining 
reviewers,  and  sizable  increases  in  expenses.  Tne  mini-journal  ceased  publication  after  its  final  issue  in  Spring  1987. 

The  home  base  for  the  MWERA  newsletter  was  Kent  State  University  in  Ohio,  where  Sonya  Blixt  and 
Thomas  Dinero  served  as  newsletter  editors  for  three  years,  from  1988  to  1990.  The  buff-colored  newsletter,  814  by 
1 1 inches  in  size,  was  published  three  times  a year.  Each  issue  had  a special  focus:  the  first  concentrated  on  the 
previous  conference;  the  second  on  the  Call  for  Proposals;  and  the  third,  prepared  by  the  Vice-President/Program 
Chair,  was  the  Program  Issue  for  the  upcoming  conference.  Newsletter  content  included  conference  highlights, 
presidential  addresses,  invited  addresses,  and  other  articles. 

The  new  and  current  full-size  journal  made  its  debut  in  Winter  1991.  The  journal  is  published  by  a team 
of  editors  who  serve  a three-year  term.  The  first  team  of  editors  included  Isadore  Newman,  University  of  Akron, 
Ohio  and  Gregory  Marchant,  Ball  State  University,  Indiana.  The  second  team  of  editors,  whose  term  began  in  1994, 
included  Editor  Ayres  D’Costa,  The  Ohio  State  University,  and  Associate  Editors  Susan  Brookhart,  Duquesne 
University,  Pennsylvania,  and  John  Surber,  University  of  Wisconsin.  This  study  covers  MWERA’s  history  through 
1994  but  since  then,  the  journal  has  continued  in  its  established  format  and  now  has  its  third  team  of  editors. 

The  journal  is  published  three  times  a year.  A fourth  issue,  the  Special  Program  Issue,  is  prepared  by  the 
Vice-President/Program  Chair.  Journal  features  include  an  Editorial  Board,  blind  reviews  of  submitted  manuscripts, 
and  institutional  support.  Photographs  of  sponsoring  institutions  are  featured  on  the  journals’  front  covers  (see  page 
2)  and  brief  descriptions  of  their  respective  educational  programs  are  reported  inside.  Journal  content  is  focused  on 
association  business,  research  and  other  articles  of  interest  to  the  membership,  and  featured  columns.  Occasional 
journal  issues  may  be  devoted  to  a specific  topic,  such  as  the  Special  Multicultural  Issue  (MWER,  Spring  1992). 

Association  business  content  has  generally  included:  overviews  of  annual  conferences,  summaries  of 
conference  evaluations,  election  results,  general  announcements,  membership  applications,  Call  for  Program 
Proposals,  and  Requests  for  Nominations.  Research  and  other  articles  of  interest  have  included:  book  reviews; 
interviews  with  leaders  in  education,  such  as  Benjamin  Bloom,  Robert  Slavin,  and  Robert  Sternberg;  presidential 
addresses;  and  other  invited  addresses.  Featured  columns  have  included:  Research  Alive , practical  applications  of 
recent  educational  research;  Voices  in  Education , responses  of  noted  educators  to  a series  of  questions;  and  Both  Sides 
Now , presentation  of  opposing  reactions  to  a targeted  issue.  Journal  features  are  subject  to  change  with  each  new 
team  of  editors. 

Fulfillment  of  the  Promise 

The  pioneering  members  of  the  association  deserve  special  recognition  for  their  efforts  in  actualizing 
MWERA  and  guiding  it  toward  future  success.  They  envisioned  the  midwest  regional  ERA,  were  committed  to 
gradually  moving  from  the  early  exploratory  phases  through  the  planning  phases,  and  finally  shifting  into  the 
implementation  mode.  MWERA’s  first  annual  conference  on  May  12,  1978  is  associated  with  the  successful 
launching  of  the  association. 

MWERA’s  operational  guidelines  over  the  years  have  remained  remarkably  faithful  to  the  organizational 
guidelines  generated  by  the  founding  members.  MWERA’s  mission  and  methods  for  their  accomplishment,  as 
specified  in  the  association  bylaws,  have  clearly  been  addressed.  MWERA’s  activities  have  centered  on  improving, 
promoting,  and  disseminating  educational  research. 

With  respect  to  association  goals,  MWERA  has  enhanced  communication  among  educational  research  and 
evaluation  personnel  through  its  annual  conferences  and  publications,  including  the  professional  journal,  conference 


abstracts,  directory  of  membership,  and  opportunities  for  socialization.  MWERA’s  annual  conferences  feature  a wide 
array  of  presentation  formats  which  allow  authors  great  flexibility  in  disseminating  their  work.  Professional  inservice 
training  opportunities  have  been  provided  by  workshops  generally  presented  on  the  day  before  the  conference  sessions 
begin. 

The  Mid-Western  Educational  Researcher,  the  association’s  official  journal  is  professionally  respected  and 
is  now  among  periodicals  deposited  in  the  Library  of  Congress.  In  addition,  all  substantive  articles  from  the  Mid- 
Western  Educational  Researcher  are  now  indexed  in  the  ERIC  Current  Index  to  Journals  in  Education  (CIJE).  Thus, 
communication  also  has  been  enhanced  at  the  national  level. 

Efforts  to  establish  effective  relationships  with  other  ERAs  were  more  important  during  MWERA’s  early 
years  when  it  conducted  jointly-sponsored  annual  conferences  with  other  ERAs.  MWERA  has  maintained  its 
professional  ties  with  AERA  and  SRERA,  the  AERA/SIG  of  State  and  Regional  ERAs.  Associations  which  have 
merged  with  MWERA  include  the  Wisconsin  Educational  Research  Association  (WERA)  and  the  North  Central 
Regional  Association  for  Community-Junior  College  Research  (NCRA).  Earlier  approaches  to  promoting  educational 
problem  solving  through  regional  research  collaboration  have  been  modified  by  alternate  approaches  such  as 
electronic  and  conference  forums. 

MWERA  may  be  characterized  as  a member-friendly  association.  Members’  opinions  are  typically  sought 
through  membership  surveys  and  annual  conference  evaluations.  MWERA’s  social  climate  may  be  characterized  by 
its  friendliness  and  relaxed  atmosphere  for  scholarly  communication  and  graduate  student  supportiveness.  Planned 
social  events  include  the  New  Member  Welcome,  Cracker  Barrel  Social,  conference  luncheon  which  is  included  in 
the  conference  registration  fee,  and  the  President’s  Reception. 

MWERA’s  prestige  and  success  as  a professional  association  may  be  viewed  from  many  perspectives.  The 
association’s  basic  strength  lies  in  its  membership  size  and  diversity  of  members’  geographic  locations  and 
institutional  affiliations.  MWERA’s  1 6 presidents  from  1 978-79  through  1 993- 1 994,  are  representative  of  eight  states, 
and  its  councilors,  14  states.  MWERA’s  annual  conference  in  1993  was  attended  by  colleagues  from  27  states, 
Canada,  Germany,  South  Africa,  and  Taiwan;  graduate  students  comprised  approximately  one-third  of  the  attendees, 
and  nearly  100  different  institutions  were  represented  by  the  presenters  (MWERf  Summer  1994). 

MWERA’s  success  may  be  associated  with  factors  relating  to  its  membership:  the  founding  members’ 
dedication,  insight,  and  perseverance;  the  conscientious  pro  bono  work  of  MWERA  members;  and  MWERA 
members*  continuing  commitment.  Twenty-six  (10%)  of  MWERA’s  266  charter  members  are  still  active  members 
in  good  standing.  Also,  54  charter  members  have  served  as  MWERA  officers,  including: 

► MWERA’s  first  Immediate  Past  President,  Samuel  Mayo,  Co-Chairperson  of  die  Association  Council  pro  tem. 

► Nine  MWERA  Presidents:  Thomas  Andre,  Frank  Farley,  Edward  Griffin,  Judson  Harmon,  Barbara  Hutson, 

Randall  Isaacson,  John  Kennedy,  Isadore  Newman,  and  Jean  Pierce. 

► Seven  Officers,  including:  Treasurer/Executive  Officer  Charles  Anderson,  Treasurer  Steven  Colby,  and  Secretaries 

Patricia  DcJamette,  Orpha  Ducll,  Mary  Link,  Jay  Price,  and  Nona  Tollefson. 

► Two  Journal  Editors:  Roberta  Starkey  and  John  Surber. 

► Thirty-five  Councilors  identified  in  Archives  documents.  Additionally,  MWERA’s  life  members  include  five  Charter 

members:  Bobbie  Anthony,  Oipha  Ducll,  Marcia  Mentkowski,  Jean  Pierce,  and  Bruce  Rogers. 

The  historical  study  concludes  with  two  additional  documents:  the  first  is  correspondence  from  Past 
President  Thomas  Andre  in  which  he  recollects  some  historic  highlights  of  his  experience  as  a MWERA  member, 
followed  by  the  five-page  MWERA  Timeline,  a chronological  overview  of  MWERA’s  history  from  1973  - 1994. 
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One  Past  President  Recollects  20  Years  of  MWERA  ... 


Thomas  Andre,  Ph.D. 

Department  of  Psychology 
and  of  Curriculum  and  Instruction 
Iowa  State  University 

October  1,  1996 

While  I am  the  most  recent  past  president  of  MWERA,  (Greg  will  take  that  honor  in  about  24  hours),  by 
chance  I was  also  involved  in  the  first  MWERA  convention.  In  1978, 1 was  a fairly  new  assistant  professor  at  Iowa 
State  University.  I had  recently  moved  from  SUNY,  Cortland  I had  two  young  children,  a recently  purchased  house, 
and  a relatively  low  salary. 

While  my  career  was  going  OK,  I was  feeiing  a sense  of  isolation.  As  many  new  assistant  professors  do, 

I could  recall  the  great  research  team  I had  worked  with  in  graduate  school.  There  were  at  least  10  of  us,  faculty 
and  graduate  students,  working  on  the  same  types  of  research,  talking  nightly  about  similar  studies,  and  stimulating 
each  other’s  curiosity  and  intellects. 

Then  came  graduation  and  the  first  job.  And  a funny  thing  happened.  While  I had  great  colleagues  at 
Cortland  and  an  office  mate  who  had  somewhat  similar  interests  to  mine,  it  wasn’t  the  same.  Everybody  was  pretty 
much  following  his  or  her  own  research  paths  and,  while  we  could  talk  about  each  other’s  work,  the  same  level  of 
intellectual  excitement  that  had  been  engendered  by  my  graduate  school  research  team  was  gone.  I thought  maybe 
it  was  that  Cortland  didn’t  have  a graduate  program. 

So  when  a job  opened  at  Iowa  State  University  (ISU)  in  Ames,  we  moved  there.  As  I am  sure  you  can 
guess,  while  ISU  helped,  the  intellectual  experience  of  graduate  school  was  still  not  reconstructed.  I had  attended 
AERA  and  knew  that  conferences  engender  some  of  the  excitement  I was  missing,  but  without  grant  funds,  I couldn’t 
afford  more  than  one  conference  a year. 

And  then  I received  a letter.  It  discussed  a new  organization  to  be  formed  and  announced  the  first  annual 
meeting.  By  chance,  Richard  C.  Anderson,  my  graduate  school  advisor,  was  to  be  the  first  invited  speaker.  The 
meeting  would  be  in  Chicago;  I could  drive  there  and  it  would  cheap!  Clearly  I had  to  go.  So  I submitted  a paper; 
it  was  accepted  and  on  May  12,  1978,  1 was  at  the  Indian  Lakes  Country  Club  for  the  first  meeting.  That  first 
meeting  had  its  strengths  and  weaknesses,  but  it  did  rekindle  some  of  the  intellectual  excitement  I was  looking  for. 
Here  was  a second  conference  I could  afford! 

The  first  business  meeting  was  held  in  a sunken  bar;  I sat  there,  sipping  white  wine,  and  was  enthralled  by 
the  process  of  putting  together  the  organization.  I have  to  admit:  it  was  the  most  pleasant  MWERA  business  meeting 
I have  ever  attended.  Maybe  they  should  all  be  held  in  sunken  bars.  While  I don’t  remember  the  details  of  the 
meeting,  I do  remember  we  reviewed  the  constitution  or  bylaws.  I thought,  we  could  do  this  in  Iowa  also.  When  I 
got  back  to  Iowa,  I talked  it  over  with  colleagues  and  we  ended  up  creating  an  Iowa  Educational  Research  and 
Evaluation  Association,  in  part  on  the  MWERA  model.  I guess  Bandura  really  does  have  some  validity  in  his 
theorizing. 

One  of  the  interesting  things  to  me  during  the  first  years  of  MWERA  was  that  we  moved  from  city  to  city. 
The  young  adventuresome  lad  I was  then  enjoyed  the  adventure  of  discovering  a new  city.  Kalamazoo  had  the 
greatest  variety  of  restaurants  for  a city  of  its  size  that  I had  encountered  to  that  time;  Milwaukee  had  a great  seafood 
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restaurant  on  the  lake;  Toledo  had  an  incredible  art  museum  and  we  ate  in  Tony  Packo’s,  home  of  Hungarian  hot 
dogs,  Klinger’s  (of  MASH  fame)  favorite  restaurant.  If  you  think  I judged  a city  by  its  food,  you  probably  are  right! 


Of  course,  not  all  members  of  MWERA  had  the  same  interest  in  new  cities.  By  the  time  of  the  Kansas  City 
convention  when  about  65  MWERA  members  attended,  it  was  clear  our  moves  around  the  region  were  prohibiting 
too  many  members  from  coming.  Wiser  heads  than  mine  decided  to  fix  us  in  Chicago.  Of  course,  they  were  right. 
Much  of  our  growth  as  an  organization  can  be  attributed  to  that  decision. 

MWERA  prides  itself  on  nurturing  new  faculty  and  graduate  students.  But  I also  think  we  should  realize 
that  one  of  the  major  intellectual  contributions  of  MWERA  has  been  to  provide  a forum  for  presentations  by  some 
of  the  major  figures  in  educational  research.  It  would  be  a fascinating  exercise  to  trace  the  intellectual  themes  in 
MWERA’s  invited  presentations  over  the  past  20  years.  Let  me  just  recall  some  highlights: 

► David  Bennett,  Deputy  Superintendent  of  Milwaukee  Schools,  in  1979,  discussed  the  schools’  research 
needs.  The  theme  of  his  speech  is  echoed  in  the  action  research  and  design  experiments  of  today. 

► Barbara  Hutson,  in  1981,  critiqued  the  overmarketing  in  education,  of  pseudo-science  views  about 
hemispheric  differences  and  other  supposedly  brain-related  educational  curricula, 

► Herbert  Walberg  applied  synthetical  research  review  procedures  to  research  on  teacher  effectiveness  in 
his  1982  Luncheon  Address.  Given  the  commonness  of  meta-analytic  procedures  nowadays,  this  may  not 
seem  like  much,  but  meta-analysis  was  still  controversial  in  1982. 

► Jean  Pierce  introduced  MWERA  to  electronic  communication  in  a talk  on  MAEJER  in  1983.  It  wasn’t 
the  WWW,  but  it  was  fun  and  produced  some  interesting  and  stimulating  research  discussions. 

► Benjamin  Bloom  discussed  the  concept  of  automaticity  in  the  development  of  intellectual  talent  in  his 
1985  address. 

► Ken  Kiewra  talked  about  the  idea  of  producing  more  independent  learners  in  his  1990  address.  This 
theme  is  echoed  in  all  of  the  new  curriculum  standards  that  are  appearing. 

These  and  other  wonderful  addresses  and  many  symposia  and  paper  sessions  kept  MWERA  membership 
and  graduate  students  who  attended  the  MWERA  conference  informed  on  the  current  research  issues  of  their  day. 
The  latter  reflects  one  of  the  major  contributions  of  MWERA.  By  providing  an  inexpensive  and  intellectually  friendly 
forum  for  sharing  intellectual  ideas  and  by  encouraging  participation  by  graduate  students,  I believe  we  have 
contributed  to  the  productivity  of  several  generations  of  educational  researchers. 


"The  heart  of  an  organization's  memory  is  in  its  records.  If 
an  organization  values  its  history,  It  must  act  to  save  the 
original  letters,  minutes,  reports,  photos,  publications,  and 
other  documents  that  officers,  members  ...  have  produced 
and  compiled  over  the  years.”  (Society  of  American 
Archivists) 
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Mwera  Timeline 


PIONEERING  SPIRIT  OF  THE  SEVENTIES 


1973-75  Exploration: 

Founding  of  a new  educational  research  association  (ERA)  in  the  midwest  is  discussed  informally 
at  consecutive  AERA  annual  conferences  in  New  Orleans,  Chicago,  and  Washington,  D.C 
Discussions  focus  on  perceived  need,  merits,  and  potential  membership . 

1976- 77  Laying  the  Foundation: 

The  Organizational  Committee  is  formed  at  the  1976  AERA  annual  conference  in  San  Francisco . 
Follow-up  meetings  take  place  in  Chicago  at  Loyola  University  and  at  AERA  annual  conferences. 
Outreach  activities  are  conducted  to  encourage  potential  member  interest  Quest  for  an  official 
association  name  begins. 

June  19,  1976.  At  planning  meeting  in  Chicago,  attendees  discuss  association  goals  and 
objectives,  governance,  finances,  membership,  communication,  and  dissemination. ...  Association  is 
temporarily  named  Upper  Midwest  Educational  Research  Association  (UMERA). 

April  1977.  Four  subcommittees-Constitution,  Membership,  Convention  Program,  and  Convention 
Arrangements  are  formed  at  meeting  at  AERA  conference  in  New  York  City. 

July  23,  1977.  Informal  election  is  conducted  at  meeting  in  Chicago.  Four  officers  are  elected  to 
serve  on  the  Association  Council  pro  tem;  Chairpersons  Edward  Griffin  and  Samuel  Mayo, 
Secretary  Judson  Harmon,  and  Treasurer  Steven  Colby. 

1977- 78  constructing  the  Framework: 

Association  Council  Pro  Tem  begins  more  intensive  planning  Council  continues  quest  for  an 
association  name,  reviews  draft  constitution,  secures  member  commitments  to  serve  as  state 
representatives  (councilors),  and  plans  MWERA ’s  first  annual  conference  and  formal  election. 
Outreach  activities  are  conducted  with  potential  members  and  other  educational  research 
associations. 

December  3,  1977.  Council  meets  in  Oshkosh  in  conjunction  with  the  annual  conference  of  the 
Wisconsin  Educational  Research  Association.  ...  Constitution  undergoes  review  process.  ... 
Planning  for  MWERA* i first  annual  conference  and  formal  election  begins. 

February  18,  1978.  Planning  for  conference  and  election  continues  at  meeting  at  Loyola 
University.  Members  decide  to  hold  first  election  at  conference  and  subsequent  elections  by  mail. 
...  Constitution  review  process  continues. 

April  1978.  At  AERA  annual  conference  in  Toronto,  Richard  Stiggins  presents  his  paper  about 
the  founding  of  MWERA.  ...  About  25  persons  visit  MWERA’s  hospitality  suite. 
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1978 


Opening  Events: 

MWERA  conducts  its  first  annual  coherence  and  first  formal  election.  The  constitution  is 
approved,  and  the  quest  for  an  official  name  is  fulfilled  During  the  months  which  follow,  MWERA 
obtains  legal  status  as  a not-for-profit  association  in  Illinois,  conducts  a membership  drive,  and 
acquires  266  charter  members . 

May  12,  1978.  MWERA’s  first  annual  conference,  co-sponsored  with  the  Northern  Illinois 
Association  for  Educational  Research,  Evaluation  and  Development  (NIAERED),  is  held  at  the 
Indian  Lakes  Country  Club  in  Bloomingdale,  Illinois.  The  one-day  conference  attracts  185 
attendees.  The  conference.  Symposium  on  Education,  emphasizes  interaction  between  producers 
and  consumers  of  educational  research. 

The  election  is  conducted  at  the  conference,  as  scheduled. ...  This  is  the  only  election  to  be  held  at 
a conference;  and  the  election  ballot  is  the  only  ballot  to  contain  a fell  slate  of  officers.  ...  Elected 
officers  include:  President  Edward  Griffin,  Immediate  Past  President  Samuel  Mayo,  President 
Elect  Ram  U Isaacson,  Vice  President  Judson  Harmon,  Secretary  Jean  Pierce,  and  Treasurer 
Steven  Colby.  ...  Constitution  is  approved. 

Spring  1978.  Charter  membership  is  available  for  an  annual  membership  fee  of  $5.00  during  a 
six-week  period.  Afterwards,  dues  are  increased  to  $7.50.  ...  The  266  charter  members  include 
many  future  MWERA  officers  and  Councilors. 

August  17,  1978.  Quest  for  association  name  ends  with  expressed  preference  for  Mid-Western 
Educational  Research  Association  (MWERA).  MWERA  files  its  Application  for  Incorporation  and 
receives  official  status  as  a not-for-profit  association  in  Illinois. 

1978'79  The  Late  1970s: 

1978.  Three  Executive  Board  planning  meetings  are  held  on  July  28th  and  October  13th  in 
Kalamazoo,  Michigan,  and  on  December  1st  in  Chicago.  ...  Major  association  goals  are  identified. 
...  Membership  survey  indicates  preference  for  a fell  conference  schedule,  and  the  transition  is 
made  by  conducting  two  conferences  the  following  year. 

1979.  MWERA’s  second  conference,  co-sponsored  with  the  Michigan  Educational  Research 
Association  (MERA),  is  held  on  March  21-23  at  the  Kalamazoo  Center/Hilton  in  Kalamazoo. 
MWERA’s  third  conference,  co-sponsored  with  the  Wisconsin  Educational  Research  Association 
(WERA),  is  held  on  November  15-16  at  the  Marc  Plaza  Hotel  in  Milwaukee. 
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CHALLENGES  OF  THE  EIGHTIES 


Overview: 

During  the  80s,  MWERA  addresses  many  important  organizational  issues,  including:  location  of 
future  conferences,  independent  vs.  joint  conferences,  publication  of  an  association  journal  or 
newsletter,  fluctuations  in  membership , optimal  membership  she,  graduate  student  participation, 
fine  tuning  MWERA’ s bylaws  to  facilitate  association  governance,  and  financial  support. 
Resolution  of  issues  reinforces  organhational  stability. 
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1979-80  MWERA  ENTERS  THE  EIGHTIES 


197f-80.  Randall  Isaacson  serves  as  MWERA’s  second  president  ...  In  1979,  MWERA’s  second 
and  third  conferences  are  conducted  as  previously  reported, ...  Dr.  Isaacson  affirms  that  MWERA 
is  fulfilling  its  original  goal  of  bringing  together  people  from  all  areas  of  education  to  share  ideas 
for  advancing  education  and  educational  research,  and  recognizes  major  issues  and  dilemmas  being 
faced  in  the  new  decade  at  all  levels  of  public  education.  ...  MWERA  becomes  a member  of 
SRERA,  an  AERA  SIG  of  state  and  regional  ERAs,  whose  advisor  is  MWERA’s  first  president, 
Edward  Griffin. 

1980-83  the  £ARLY  1980s: 

1980- 81.  Judson  Hannon,  Wisconsin  Department  of  Public  Instruction,  serves  as  MWERA’s  third 
president.  ...  In  1980,  MWERA’s  4th  annual  conference  is  conducted  independently  in  Toledo, 
Ohio  on  October  15-17.  Two  invited  speakers  address  issues  to  be  faced  in  the  new  decade:  Frank 
Farley,  AERA  President,  presents  the  opening  address:  MProspects  for  the  Educational  Research  in 
the  1980s  and  Beyond"  and  John  Kennedy  presents  the  luncheon  address:  "Training  of  Researchers 
for  Education  in  the  1980s."  Also,  two  training  workshops  are  presented:  "Survey  Design: 
Theoretical  to  Practical"  and  "Sources  of  Funding  and  General  Approach."  ...  A committee  on 
regional  research  is  formed  following  a conference  session  on  this  topic. 

An  ad  hoc  committee  explores  and  makes  recommendations  concerning  publication  of  an 
association  journal.  ...  Leonard  Kisc  and  Jean  Pierce,  colleagues  at  Northern  Illinois  University, 
offer  to  serve  and  are  appointed  Co-editors.  They  publish  a mini-journal,  Mid-Western  Educational 
Researcher,  whose  first  issue  is  published  in  October  1980  on  a shoe-string  budget  of  $250.  The 
mini-journal,  is  published  three  times  a year. 

1981- 82.  Barbara  Hutson,  Virginia  Polytechnic  Institute  and  State  University,  serves  as 

MWERA’s  4th  president. ...  In  1981,  MWERA’s  5th  annual  conference  is  conducted  on  November 
19-21  in  Des  Moines  at  the  Hotel  Des  Moines.  The  conference  is  co-sponsored  with  the  Iowa 
Educational  Research  and  Evaluation  Association  (TEREA). 

In  1982,  the  annual,  regular  membership  dues  are  increased  from  $7.50  to  $10.00.  However, 
graduate  student  dues  remain  the  same.  The  dues  increase  is  associated  with  rising  conference  and 
journal  costs.  ...  Jean  Pierce  is  elected  Vice  President  and  Roberta  Starkey,  Northern  Illinois 
University,  replaces  her  as  Co-Editor  of  the  mini-journal  for  one  year. 

1982- 83.  Frank  Farley,  University  of  Wisconsin,  serves  as  MWERA’s  5th  president.  ...  In  1982, 
MWERA’s  6th  annual  conference  is  conducted  on  October  14-16  in  Chicago  at  the  Midland  Hotel. 
The  conference  is  jointly  sponsored  with  the  Northern  Illinois  Association  for  Educational 
Research,  Evaluation  and  Development  (NIAERED). 
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1983-86  The  Meddle  1980s 


1983- 84.  Jean  Pierce  serves  as  MWERA’s  6th  president.  ...  In  1983,  MWERA’s  7th  annual 
conference  is  conducted  on  September  29  - October  1 at  the  Hilton  Plaza  Inn  in  Kansas  City.  The 
conference  is  co-sponsored  with  the  Psychological  and  Educational  Researchers  of  Kansas 
(PERK).  ...  Robert  Rosemier,  Northern  Illinois  University,  assumes  the  post  of  Co-Editor  of  the 
mini-journal  and  continues  in  that  role  for  five  consecutive  years.  ...  Dr.  Pierce  launches  an 
electronic  forum  for  midwestem  researchers.  The  forum,  first  of  its  kind,  later  comes  under  the 
sponsorship  of  the  AERA.  ...  An  AERA/SIG,  North  Central  Regional  Association  for  Community- 
Junior  College  Research  (NCRA),  active  from  1971-1984,  merges  with  MWERA. 

1984- 85.  John  Kennedy,  The  Ohio  State  University,  serves  as  MWERA’s  7th  president.  ...  In 
1984,  MWERA’s  8th  annual  conference  is  conducted  on  September  27-29  in  Chicago  at  the 
Bismarck  Hotel.  ...  Die  hotel  is  conveniently  located  and  affordable,  and  is  well  received  by 
MWERA  members.  MWERA  continues  to  hold  its  annual  conferences  at  the  Bismarck  for  1 1 
more  consecutive  years,  through  1995. ...  A membership  drive  is  conducted  which  results  in  more 
than  100  new  MWERA  members,  some  of  whom  who  later  become  MWERA  officers. 

1985- 86.  Ralph  Darr  Jr.,  University  of  Akron,  serves  as  MWERA’s  8th  president.  ...  MWERA’s 
9th  annual  conference  is  conducted  in  1985  on  October  17-19.  ...  Plans  are  underway  to  modify 
MWERA’s  governance  structure  by  establishing  "one  or  two"  permanent  positions  in  order  to 
obtain  greater  continuity.  ...  Dr.  Darr  appoints  an  ad  hoc  publications  committee  consisting  of 
three  past  presidents  to  explore  different  options  for  an  official  association  publication. 

1986-89  The  Late  1980s: 

1986- 87.  Fredric  Wolf,  University  of  Michigan  Medical  School,  serves  as  MWERA’s  9th 
president. ...  In  1986,  MWERA’s  10th  annual  conference  is  conducted  on  October  16-18.  The  final 
issue  of  the  mini-journal  is  published  in  Spring  1987.  Leonard  Kise  and  Robert  Rosemier  complete 
their  terms  of  office  as  Co-editors. 

1987- 88.  Robert  Brennan,  American  College  Testing  Program  (ACT),  serves  as  MWERA’s  10th 
president.  ...  In  1987,  MWERA  conducts  its  11th  annual  conference  on  October  15-17.  Sonya 
Blixt  and  Thomas  Dinero,  Kent  State  University,  serve  as  Co-editors  of  the  newsletter,  MWERA 
Researcher,  for  a three-year  term.  The  first  issue  of  the  newsletter  is  published  in  Spring  1988. 
Three  issues  are  published  annually. 

An  amendment  replaces  the  elected  position  of  Treasurer  with  the  elected  position  of  Member-at- 
Large  and  the  appointed  position  of  Executive  Officer.  ...  MWERA  Treasurer,  Charles  Anderson, 
becomes  MWERA’s  first  Executive  Officer,  and  E.  Peter  Johnsen  is  elected  MWERA’s  first 
Member-at-Large. 


1988-89.  Isadore  Newman,  University  of  Akron,  serves  as  MWERA’s  1 1th  president. ...  In  1988, 
MWERA  conducts  its  12th  annual  conference  on  October  13-15.  ...  The  Wisconsin  Educational 
Research  Association  (WERA)  merges  with  MWERA. 
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THE  NINETIES:  GROWTH  AND  DEVELOPMENT 


1989-90 


1990-91 


Overview: 

Many  organizational  changes  occur  during  the  early  part  of  this  decade,  including:  calendar 
change  in  term  of  office;  new  association  journal  which  replaces  the  newsletter ; support  by  a 12- 
member  editorial  advisory  board;  publisher  exhibits  at  annual  conference ; Lifetime  membership ; 
and  launching  of  historical  study . 

Mwera  Enters  the  Nineties: 

1989- 90.  Dennis  Leitner,  Southern  Illinois  University,  serves  as  MWERA1  s 12th  president.  ...  In 

1989,  MWERA’s  13th  annual  conference  is  conducted  on  October  19-21. ...  Dr.  Leitner  overviews 
MWERA’s  previous  three  years  and  observes  tremendous  growth  in  conference  program  quality, 
official  publications,  and  active  membership  involving  more  graduate  students.  He  foresees  a new 
official  publication,  awards/scholarships/honors  for  graduate  students  and  a history  of  MWERA. ... 
An  amendment  is  passed  which  modifies  MWERA’s  divisions  to  correspond  with  those  of  AERA. 

The  Early  1990s: 

1990- 91.  Ayres  D’Costa,  The  Ohio  State  University,  serves  as  MWERA’s  13th  president.  ...  In 

1990,  MWERA’s  14th  annual  conference  is  conducted  on  October  17-20.  ...  An  amendment  is 
passed  which  adjusts  the  dates  of  the  term  of  office  from  "September  1 through  August  31  of  the 
following  year”  to  Mclosing  of  the  annual  conference  through  the  close  of  the  next  annual 
conference."  Thus,  Dr.  D’Costa  is  also  president  during  MWERA’s  15th  annual  conference  which 
is  conducted  in  1991  on  October  16-19. ...  Isadore  Newman  and  Gregory  Marchant  are  appointed 
Co-editors  of  the  new  association  journal,  Mid-Western  Educational  Researcher,  for  a three-year 
term,  from  1991  through  1993.  Three  journals  are  published  each  year,  and  an  additional 
conference  program  issue  is  prepared  by  the  Vice-President/Program  Chair.  ...  First  issue  of  the 
new  journal  is  published  in  Winter  1991. 

1991- 92.  Barbara  Plake,  University  of  Nebraska-Lincoln,  serves  as  MWERA’s  14th  president.  ... 
In  1992,  MWERA’s  16th  annual  conference  is  conducted  on  October  14-17.  ...  MWERA’s  annual, 
regular  membership  dues  are  increased  to  $18.00,  but  graduate  student  dues  remain  unchanged.  ... 
A MWERA  Lifetime  Membership  category  is  established  with  dues  at  10  times  the  annual,  regular 
membership  dues. 

1992- 93.  Kenneth  Kiewra,  University  of  Nebraska-Lincoln,  serves  as  MWERA’s  15th  president. 
...  In  1993,  MWERA’s  17th  annual  conference  is  conducted  on  October  13-16.  Nearly  100 
different  institutions  are  represented  by  presenters  at  the  conference.  The  new  team  of  journal 
editors  selected  to  serve  from  1994  through  1996,  include  Editor  Ayres  D’Costa  and  Associate 
Editors  Susan  Brookhart  and  John  Surber,  First  issue  of  new  journal  is  published  in  Winter  1994. 

1993- 94.  Richard  Pugh,  Indiana  University,  serves  as  MWERA’s  16th  president.  ...  In  1994, 
MWERA’s  18th  annual  conference  is  conducted  on  October  12-15. ...  Dr.  Pugh  gets  the  historical 
study  of  MWERA  underway  with  preparation  of  RFP,  appointment  of  review  committee,  and 
proposal  acceptance.  ...  Charles  Anderson  completes  his  term  of  office  as  Executive  Officer,  and 
Dr.  Pierce  accepts  three-year  appointment  as  MWERA’s  next  Executive  Officer.  □ 
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For  inferential  statistics,  the  chi-square  significance  test 
for  the  quotient  of  two  proportions  is  the  same  test  as  the 
significance  test  for  their  difference  (the  null  hypothesis  of 
a quotient  of  1 is  conceptually  equivalent  to  a null  hypoth- 
esis of  a difference  of  0),  whereas  the  interval  estimation 
formulas  for  the  quotient,  and  for  the  “odds  ratio”  approxi- 
mation to  that  quotient,  are  considerably  more  complicated 
(see  Fleiss,  1981,  pp.  71-75  and  Bedrick,  1987). 

Independence  of  observations 

Since  all  of  the  inferential  procedures  for  proportions 
and  for  their  differences  and  quotients  are  based  on  the  bi- 
nomial sampling  distribution  for  independent  “trials”,  it  is 
essential  to  consider  that  assumption  when  applying  such 
procedures  to  real  data.  Researchers  (e.g.,  Chase,  1996; 
Feldt,  1996)  who  use  hypothesis  testing  in  conjunction  with 
criterion-referenced  measurement,  in  order  to  test  a sample 
proportion  of  correct  answers  against  a hypothesized  “cut- 
off' proportion  necessary  for  “passing”  an  examination,  are 
in  an  especially  vulnerable  situation.  Here  the  inference  is 
for  a single  person  being  measured  on  a sample  of  n items 
that  usually  correlate  with  one  another,  not  for  n persons 
being  measured  on  a single  item.  In  using  the  normal  ap- 
proximation to  the  binomial  to  test  the  null  hypothesis  that  a 
person  below  the  cutting  point  is  actually  a “passer”  such 
researchers  are  apparently  appealing,  consciously  or  uncon- 
sciously, to  the  assumption  of  local  independence  that  is  made 
in  conjunction  with  item  response  theory. 

Summary 

Proportions  come  up  fairly  often  in  educational  research. 
(So,  of  course,  do  their  corresponding  percentages — just 
multiply  by  100  and  add  a % sign).  They  are  allegedly  simple 
to  use  and  to  interpret.  But  as  we  have  tried  to  point  out  in 
this  article,  they  are  subject  to  all  sorts  of  statistical  prob- 
lems, some  more  serious  than  others.  The  following  cau- 
tions need  to  be  observed  when  employing  inferential 
statistics  for  proportions: 

1 . Always  use  the  appropriate  p or  p’s  in  the  formula  for 
the  standard  error,  even  when  that  formula  is  an  approxi- 
mation. 

2.  Be  prepared  to  face  up  to  very  complicated  formulas 
for  the  appropriate  standard  errors  for  interval  estima- 
tion. 

3.  When  applying  these  procedures  to  unconventional 
inferential  situations  such  as  criterion-referenced  mea- 
surement, be  aware  that  the  assumption  of  independent 
observations  may  be  violated.  In  order  to  test  that  as- 
sumption, we  suggest  that  the  interested  researcher  fol- 
low Lord’s  (1980,  p.  21)  recommendation  for  testing 
the  assumption  of  unidimensionality  (from  which  local 
independence  follows):  Compare  the  first  three  eigen- 
values of  the  inter-item  tetrachoric  correlation  matrix. 
If  the  largest  eigenvalue  is  much  higher  than  the  second 
largest  and  the  second  largest  is  not  much  different  from 
the  third  largest,  local  independence  can  be  assumed. 
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Abstract 

The  purpose  of  the  study  was  to  identify  the  characteristics  that  will  describe  an  internationalized  state 
extension  system.  The  study  used  a modified  Delphi  technique  to  explore  and  describe  the  character- 
istics  of  an  internationalized  state  extension  system.  By  consensus  of  the  Delphi  Panel,  five  critical 
elements  were  identified.  Extension  systems  can  use  these  as  criteria  to  make  initial  assessments  on 
the  level  of  internationalization  present. 


“America  }s  future  rests  on  its  ability  to  understand  and  com- 
pete in  a world  which  year  by  year  moves  rapidly  toward 
economic,  political  and  social  interdependence. " 

Ping  (1990,  p.  27) 

Introduction 

Extension  has  existed  in  the  U.S.  as  part  of  the  Land-Grant 
College  system  since  1914.  Over  time  the  mission  and  focus  of 
Extension  has  changed  from  outreach  education  from  the  uni- 
versity targeted  toward  agricultural  producers  to  include  a 
broader  social  orientation.  An  increased  interest  in  interna- 
tionalization of  Extension  has  occurred  (Henson,  Noel,  Gillrad- 
Byers  & Ingle,  1990;  Ingle  & Gage,  1990;  Somersan,  1992). 
This  interest  appeared  to  be  a result  of  many  factors  and  influ- 
ences, both  within  and  outside  Extension  and  the  university. 
America  2000  targeted  the  need  for  an  educated  citizenry  who 
have  the  knowledge  and  skills  to  compete  in  a global  economy. 
The  report  stated  “all  our  people,  not  just  a few,  must  be  able  to 
think  for  a living,  adapt  to  changing  environments,  and  to  un- 
derstand the  world  around  them”,  (U.S.  Department  of  Edu- 
cation, 1990,  p.  35). 

A review  of  literature  indicated  that  internationalization  is 
frequently  viewed  in  general,  rather  amorphous  terms  that  are 
difficult  for  some  to  understand  and  comprehend  (Henson,  Noel, 
Gillrad-Byers  & Ingle,  1990).  Arum  and  Van  de  Water  (1992), 
in  their  book  Bridges  to  the  Future:  Strategies  for  Internation- 
alizing Higher  Education , supported  this  view.  In  article  after 
anicle,  report  after  report,  and  at  conference  after  conference  the 
terms  used  to  characterize  the  international  dimension  of  educa- 
tion vary  tremendously. 

Purpose 

The  purpose  of  the  study  was  to  identify  the  characteristics 
of  an  internationalized  state  university  Extension  system. 

Broad,  but  often  ambiguous,  goal  statements  are  frequently 
used  related  to  internationalization  of  Extension  (ES-USDA, 
1989;  Ingle,  1990;  King  & Martin,  1991).  Some  ideas  have 


been  formulated  for  internationalizing  (ES-USDA,  1989; 
Henson,  Noel  Gillrad-Byers  & Ingle,  1991;Knox,  1987;Patton, 
1984;  Somersan,  1992;  York,  1984),  but  there  has  been  little 
emphasis  on  implementation  by  Extension  systems  across  the 
country  (Andrew  & Lambur,  1986;  Poston  & O’Rourke,  1991 ; 
Rosson  & Sanders,  1991).  Few  studies  have  been  conducted 
related  to  internationalization  of  the  Extension  component  of 
the  land-grant  university  system.  None  defined  international- 
izing in  terms  of  objectively  verifiable  indicators  of  success.  A 
need  to  examine  and  improve  the  understanding  of  internation- 
alizing of  a state  university  Extension  system  became  apparent 
through  a review  of  literature.  If  the  characteristics  of  an  inter- 
nationalized Extension  system  could  be  identified,  then  an  or- 
ganization might  focus  available  resources  to  create  changes 
needed  to  achieve  internationalization. 

Kaufman  (1982,  1992)  suggested  putting  problems  into 
the  context  of  what  is  and  what  should  be  when  dealing  with 
organizations.  The  Organizational  Elements  Model  (OEM) 
developed  by  Kaufman  (1982,  1992)  provided  a framework 
for  the  study.  Kaufman’s  model  used  a holistic  framework  in 
looking  at  organizations  and  what  those  organizations  use,  do 
and  deliver  as  well  as  the  impact  on  clients  and  society  in  gen- 
eral. The  current  study  was  limited  to  examining  organiza- 
tional efforts  and  organizational  results. 

Methodology 

The  study  used  a three-round,  modified  Delphi  technique 
to  explore  and  describe  the  characteristics  of  an  international- 
ized state  Extension  system.  Delphi,  a group  process,  utilized 
individual  written  responses  to  three  researcher  developed  in- 
struments as  opposed  to  bringing  individuals  together  for  oral 
discussion.  The  process  was  further  characterized  by  multiple 
iterations  or  feedback  designed  to  accomplish  convergence  of 
opinion.  Participants’  anonymity  was  maintained  during  the 
three  rounds  of  the  study. 

Linstone  and  Throff  (1975)  outlined  situations  where  the 
use  of  the  Delphi  was  indicated.  Situations  included:  (1)  pre- 
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rise  analytical  methods  were  not  suitable  for  studying  the  prob- 
lem, but  subjective  judgment  on  a collective  basis  could  pro- 
vide beneficial  information  relative  to  the  problem;  (2)  time 
and  cost  limited  the  ability  to  convene  group  meetings  involv- 
ing the  individuals  needed  to  address  the  problem;  (3)  the  indi- 
viduals needed  to  contribute  to  examination  of  a broad  and 
complex  problem  represented  different  backgrounds  with  re- 
spect to  experience  or  expertise;  (4)  anonymity  assured  that 
disagreements  among  individuals  which  might  result  in  a face- 
to-face  interaction  could  be  referred;  and  (5)  domination  by  a 
group  or  individual  was  avoided.  All  of  these  situations  were 
evident  in  the  problem  to  be  addressed. 

Panel  Selection 

The  Delphi  Panel  members  were  purposefully  selected 
following  a nomination  process.  An  accessible  population  was 
identified  following  a review  of  authors  of  significant  publica- 
tions, solicitations  of  nominations  during  consultations  with 
professional  leaders  in  the  field,  and  personal  knowledge  of 
outstanding  contributions  made.  A review  panel  consisting  of 
three  faculty  members  with  extensive  knowledge  of  the  topic 
was  used  to  assist  the  researcher  in  the  selection  process.  A 
total  of  1 5 individuals,  well  known  and  respected  for  their  con- 
tributions to  Extension  or  land-grant  colleges  or  universities  in 
the  area  of  internationalization,  was  identified.  The  partici- 
pants selected  by  the  review  panel  met  at  least  three  of  the  cri- 
teria established  for  selection.  The  criteria  were:  (1 ) national/ 
international  reputation;  (2)  familiarity  with  the  topic;  (3)  has 
conducted  research,  written  or  lectured  on  the  topic;  (4)  was 
considered  to  have  a deep  interest  in  the  problem  and  impor- 
tant knowledge  or  experience  to  share. 

Instrument  Development  and  Data  Collection 

Specialized  instruments  were  developed  following  a re- 
view of  the  literature  to  clarify  the  concepts  being  studied  and 
suitability  of  the  modified  Delphi  research  technique  to  assess 
these  concepts.  In  the  modified  Delphi,  position  statements 
were  used  in  place  of  an  unstructured  questionnaire  on  the  first 
round.  Three  rounds  were  planned  and  three  instruments  were 
developed.  The  development  and  administration  of  question- 
naires is  interconnected  in  the  Delphi  technique. 

Instrument  Development 

The  initial  instrument  contained  39  position  statements 
derived  from  the  literature  and  structured  interviews  with  inter- 
national experts.  Face  and  content  validity  of  the  initial  instru- 
ment were  assured  through  the  use  of  a content  validity  panel. 
The  reviewers,  six  faculty  from  universities  in  the  U.S.,  Europe 
and  Africa  who  were  familiar  with  the  U.S.  Extension  system 
were  advised  of  the  objectives  of  the  study  and  the  purpose  of 
the  instrument  Each  was  asked  to  review  and  refine  the  alter- 
natives stated  and  identify  additional  important  positions  per- 
taining to  the  study.  Comments  and  suggestions  related  to  clarity 
and  content  were  solicited.  Given  the  nature  of  the  Delphi  tech- 
nique, additional  types  of  validity  and  reliability  estimates  were 


not  appropriate  for  the  instrument  (Dalkey,  Rourke,  Lewis  and 
Snyder,  1972;  Hughes,  1993). 

The  Delphi  Panel  was  asked  to  identify  the  degree  to  which 
they  believed  each  item  oh  the  instrument  contributed  to  the 
internationalization  of  a state  university  Extension  system.  A 
seven-point  Likert-type  scale  was  used  with  0 indicating  “no 
importance”  and  6 indicating  “critical  importance”.  Delphi 
Panel  members  were  asked  to  support  their  opinion  with  a ra- 
tionale. Space  was  also  provided  for  panel  members  to  add 
new  statements.  Delphi  Panel  responses  were  incorporated  in 
successive  instruments. 

Instrument  II  was  developed  based  on  responses  to  the 
first  instrument  and  suggestions  for  new  statements  made  by 
the  Delphi  Panel.  During  Round  I,  consensus  was  not  achieved 
on  any  statement  based  on  the  criteria  established.  Consensus 
on  a statement  was  considered  to  have  been  reached  when  80% 
of  the  ratings  (12  panel  members)  fell  within  two  rating  catego- 
ries on  a seven-point  scale  (Ulschak,  1983).  The  instrument 
used  in  Round  II  repeated  the  39  items  from  Round  I.  Based 
on  suggestions  from  the  Delphi  Panel,  12  new  items  were  added 
and  9 items  were  reworded  so  that  a total  of  51  items  were 
considered. 

Two  types  of  feedback  were  provided  the  Delphi  Panel  in 
Instrument  H The  first  was  statistical  feedback  in  the  form  of 
group  response  using  a frequency  table  for  each  statement  and 
the  individual’s  own  response  on  each  statement.  Neither  the 
mean  nor  median  was  reported  as  a descriptive  statistic.  The 
dispersion  of  scores  indicated  these  statistics  could  be  mislead- 
ing to  the  Delphi  Panel.  In  addition  to  statistical  feedback,  all 
comments  by  the  Delphi  Panel  for  each  statement  in  Round  I 
. were  anonymously  reported.  The  instruments  used  in  the  sec- 
ond and  third  rounds  contained  items  on  which  a predetermined 
level  of  consensus  was  not  achieved  during  the  previous  round. 
Consensus  was  achieved  on  nine  items  during  the  second  round. 

Instrument  m was  developed  based  on  responses  to  the 
Round  13  instrument  and  suggestions  made  by  the  Delphi  Panel. 
The  round  ID  instrument  contained  42  items  on  which  consen- 
sus was  not  achieved  in  Round  EL  Two  types  of  feedback  were 
used  in  Round  IH.  The  first  was  statistical  feedback  in  the  form 
of  group  response  using  a frequency  table  for  each  statement 
and  the  individual’s  own  response  on  each  statement  The  mode 
was  identified  as  well.  In  addition  to  statistical  feedback,  all 
comments  by  the  Delphi  Panel  for  each  statement  in  Round  II 
were  anonymously  reported.  In  Round  m,  the  Delphi  Pane! 
was  asked  to  l ;ew  each  statement,  re-evaluate  their  position 
and  rerate  using  the  same  seven  point  Likert-type  scale.  Dur- 
ing Round  m,  consensus  was  reached  on  29  items. 

Data  Collection 

The  Delphi  instruments  were  mailed  to  the  Delphi  Panel 
using  regular  U.S.  mail  or  air  mail  to  international  locations. 
The  mailed  packet  consisted  of  the  instrument,  an  individually 
addressed  cover  letter  and  a self-addressed  stamped  return  en- 
velope. A variety  of  techniques  was  used  to  ensure  mainte- 
nance of  interest  and  participation  in  the  study. 


4 m iw 


Mul-Wemem  EdmcmHoml  Rtstmrrher 


« A 


IS 


Table  1 

Characteristics  Having  Importance  to  Extension  Internationalization 


Clientele  develop  a fundamental  understanding 
of  global  and  national  interdependence. 

Extension  educational  programs  within  in  the 
U.S.  stress  the  impact  of  international  economic 
forces  on  agricultural  markets. 


Mean  SD  Category 


5.85  .38  R 

5.69  .86  R 


SD  Category 


Extension  educators  incorporate  international  5.54  .66  R 

perspectives  into  on-going  educational  activities. 

Extension  faculty/agents  recognize  the  relationships  5.54  .66  E 

between  basic  international  issues  (e.g.  knowledge  of 
international  agriculture,  commitment  to  human 
development,  significance  of  privatization)and  the 
Extension  mission. 

Personnel  evaluation  systems  recognize  international  5.50  .76  E 

efforts. 

Key  leaders  participate  in  interdisciplinary  5.36  .74  R 

international  experiences. 

Sensitivity  to  diversity  issues  by  Extension  clientele  is  5.36  .63  R 

enhanced. 

Reward  structure  recognizes  internationalization  in  5.3 1 .63  E 

its  system  of  rewards.  These  include  merit  adjust- 
ments, tenure,  promotion,  and  peer  recognition. 

Financial  support  for  internationalizing  activities  is  5.21  .43  E 

available. 

Administrators  clearly  communicate  support  for  5.14  .66  E 

internationalization. 

A person(s)  is  identified  to  provide  leadership  to  5.14  .53  E 

internationalizing  efforts. 

International  experiences  are  provided  for  county  5.08  .64  E 

agents  who  do  not  have  faculty  status. 

Policy  and  operating  procedures  facilitate  5.07  .62  E 

international  program  efforts. 

The  organization  culture  expects  international  5.07  .62  E 

activity. 

Extension  educators  assist  communities  in  building  5.07  .62  R 

a sense  of  responsibility  for  wise  use  of  natural 
resources  in  the  context  of  global  trends. 

Faculty  increas-,  their  expertise  by  interacting  5.07  .47  E 

with  faculty  and  scholars  from  other  cultures. 

Human  and  physical  resources  arc  allocated  to  5.07  .47  E 

support  the  integration  of  international  activities 
in  the  overall  institution  effort. 

Opportunities  for  international  experiences  are  5.00  .55  E 

provided  for  administrators. 

The  central  mission  of  the  Extension  system  includes  5.00  .55  E 

a commitment  to  international  education. 


Professional  improvement  activities  increase 
activities  increase  knowledge  of  global  issues. 

4.93 

.47 

E 

Extension  is  involved  with  international  development 
activities. 

4.93 

.92 

E 

Local  business  persons  are  trained  for  participation 
in  international  markets. 

4.93 

.62 

R j 

i 

Specific  groups  (i.e.  commodity  groups)  arc 
targeted  for  public  policy  education  on  global 
decision-making. 

4.86 

.66 

i 

R 

! 

The  organization’s  best  junior  faculty/agents 
are  identified  to  participate  in  overseas  assignments. 

4.86 

.36 

E 

i 

! 

Administrators  engage  in  experience  which  will 
internationalize  their  own  professional  lives. 

4.86 

.53 

E 

Regular  encouragement/accommodation  of 
visitation  by  scholars  from  other  countries  occurs. 

4.86 

.66 

E 

Proposals  for  international  work  are  developed 
and  funded. 

4.77 

.44 

E 

The  organization’s  best  senior  faculty/agents  are 
identified  to  participate  in  overseas  assignments. 

4.64 

.63 

E 

Exchange  programs  with  extension  organizations 
in  other  countries  arc  institutionalized. 

4.64 

.74 

E 

i 

Rural  clientele  are  targeted  for  educational 
programming  related  to  the  current 
international  marketplace. 

4.64 

.74 

R 

Educational  programs  planned  by  Extension  help 
clientele  secure  a better  understanding  of  complex 
worldwide  issues. 

4.57 

.76 

R 

Extension  educational  programs  offered  to  4-H 
members  help  develop  international  awareness. 

4.57 

.76 

R 

Fduv^tional  programs  increase  participant’s 
understanding  of  other  cultures. 

4.57 

.76 

R 

A committce(s)  is  established  to  guide 
internationalization  efforts. 

4.57 

.65 

E 

Exchange  programs  with  extension  organizations 
in  other  countries  arc  planned  and  conducted  on  an 
on-going  basis. 

4.50 

.65 

E 

Training  programs  are  provided  for  foreign 
immigrants  living  in  the  United  States. 

4.50 

.52 

R 

! 

Urban  clientele  are  targeted  for  educational 
programming  related  to  the  current  international 
marketplace. 

4.50 

.65 

R 

Extension  clientele  interact  with  visiting  scholars 

4.31 

.75 

R 

and  students  to  become  more  globally  aware. 


Scale:  0 = No  Importance;  1 = Slight  Importance;  2 = Limited  Importance;  3 = Moderate  Importance; 

4 = Moderately  High  Importance;  5 = High  Importance;  6 = Critical  Importance 

Categories:  E = Organizational  Effort;  R = Organizational  Result 
Note:  Round  1;  N = 14;  Round  2:  N = 13;  Round  3:  N = 14 
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Data  Analysis 

Descriptive  statistics  were  calculated  for  each  round. 
The  computer  program  SPSS  was  used  for  data  analysis. 
For  each  round,  items  on  which  consensus  was  reached  were 
identified.  Consensus  on  an  item  was  considered  to  have 
been  reached  when  80%  of  the  ratings  fell  within  two  cat- 
egories on  a seven-point  scMe. 

Frequency  counts  and  percentages,  along  with  the  mode 
and  median  were  reviewed  in  determining  consensus.  For 
each  round,  those  items  not  meeting  the  criteria  for  consen- 
sus were  included  in  the  following  round  as  well  as  new 
items  generated  from  suggestions.  Suggested  items  were 
compiled  and  content  analysis  was  conducted  following  pro- 
cedures outlined  by  Altschuld  (1993)  and  Delbecq,  Van  de 
Ven  & Gustafson  (1975).  Following  Round  III,  statistics  of 
central  tendency  and  variability  were  calculated  for  all  items 
on  which  consensus  had  been  reached.  The  mean  was  used 
to  describe  the  level  of  importance  of  the  item  to  an  interna- 
tionalized state  Extension  system  as  determined  by  consen- 
sus of  the  Delphi  Panel  and  variability  was  described  through 
standard  deviations. 

Results 

The  results  of  the  study  represent  the  collective  opinion 
of  the  experts  participating  in  the  Delphi  Panel  at  a single 
point  in  time  and  cannot  be  construed  to  be  representative 
of  any  other  population  or  situation.  Fourteen  of  the  15  par- 
ticipants responded  to  each  round,  a 93%  response  rate. 
Fifty-one  items  were  considered  during  the  three  rounds  of 
the  Delphi.  Consensus  was  achieved  on  38  items  which  were 
identified  as  having  moderately  high  importance  to  critical 
importance  for  the  internationalization  of  a state  university 
Extension  system.  Table  1 reports  the  items  where  consen- 
sus was  reached.  Consensus  was  not  achieved  on  thirteen 
items  after  three  rounds.  Comments  made  by  the  Delphi 
Panel  during  each  round  and  reported  anonymously  provided 
additional  information  to  describe  the  ratings  and  clarify  is- 
sues. Three  hundred  and  sixteen  comments  were  received. 

Following  Kaufman’s  model  (1982,  1992),  the  results 
were  categorized  as  Organizational  Efforts  and  Organiza- 
tional Results.  Organizational  efforts  were  comprised  of 
inputs  and  processes.  Inputs  were  identified  as  the  existing 
starting  conditions  affecting  organizational  activities  and 
processes  as  the  means,  methods  and  procedures  necessary 
for  man  aging  inputs.  Organizational  results  were  comprised 
of  products  and  outputs.  Products  were  defined  as  the  inter- 
nal results  accomplished  through  the  application  of  inputs 
and  processes;  outputs  were  the  products  the  organization 
delivered  to  external  clients. 

By  consensus  of  the  Delphi  Panel,  the  most  critical  char- 
acteristic of  a state  university  extension  system  which  had 
internationalized  was  the  output  or  end  product  of  clientele 
who  developed  a fundamental  understanding  of  global  and 
national  interdependence.  Educational  programming  efforts 


having  high  importance  to  internationalization  included  pro- 
grams that  help  clientele  understand  complex  worldwide  is- 
sues, programs  that  train  local  business  persons  for 
participation  in  international  markets  and  interdisciplinary 
international  experiences  for  key  leaders.  The  Delphi  Panel 
placed  high  importance  on  targeting  commodity  groups  for 
public  policy  education  on  global  decision  making  and  ru- 
ral clientele  for  education  on  the  international  marketplace. 

Critical  Elements 

Five  critical  elements  were  identified  by  the  Delphi 
Panel  as  being  present  in  an  internationalized  state  univer- 
sity Extension  system: 

• Clientele  develop  a fundamental  understanding  of  global 
and  national  interdependence. 

• Extension  educational  programs  within  the  U.S.  stress  the 
impact  of  international  economic  forces  on  agricultural 
markets. 

• Extension  educators  incoiporate  international  perspectives 
into  on-going  activities. 

• Extension  faculty/agents  recognize  the  relationship  between 
basic  international  issues  and  the  Extension  mission. 

• Personnel  evaluation  systems  recognize  international  efforts. 

The  absence  of  any  one  of  these  critical  elements  would 
mean  that  the  Extension  system  could  not  be  considered  to 
be  internationalized.  An  internationalized  state  university 
Extension  system  would  exhibit  other  important  character- 
istics as  described  in  Table  1 . Not  all  the  important  charac- 
teristics identified  by  the  Delphi  Panel  need  to  be  present 
for  the  Extension  system  to  be  considered  to  be  internation- 
alized, but  many  are  likely  to  be  evident.  Each  important 
characteristic  provides  a building  block,  process  or  program- 
ming goal  which  will  enable  the  Extension  system  to  de- 
velop and  maintain  the  five  critical  elements  identified. 

Conclusions  and  Implications 

The  study  brought  greater  clarity  and  focus  to  the  defi- 
nition of  internationalization  of  an  Extension  system.  Inter- 
nationalization was  not  seen  as  a fourth  dimension:  teaching, 
research,  service  and  international  efforts.  Instead,  successful 
internationalization  efforts  were  identified  as  integrating 
global  perspectives  into  the  basic  mission  and  mandate  of 
Extension.  Using  the  definition  of  university  international- 
ization developed  by  Henson  and  Noel  (1989)  as  a starting 
point,  a three-part  definition  is  proposed  for  discussion  and 
debate.  The  definition  is  based  on  results  of  the  current 
study  and  reflects  the  five  critical  elements  identified. 

Internationalization  of  Extension  is  the  incorpora- 
tion of  international  dimensions,  content  and  con- 
siderations into  Extension  teaching,  research,  and 
service  to  enhance  their  relevance  in  an  increas- 
ingly interdependent  world. 
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Participation  in  Extension  educational  activities 
assist  clientele  to  develop  a fundamental  under- 
standing of  global  interdependence  and  interna- 
tional economic  forces  as  they  relate  to  the  issue 
areas  within  Extension's  mission. 

Institutional  commitment  is  evidenced  by  the  de- 
velopment of  a structure  and  capacity  to  support 
staff  development  and  reward  accomplishments. 

Poston  and  O'Rourke  (1991)  reported  80%  of  Extension 
directors  indicated  their  state  had  achieved  either  a low  level  or 
had  not  achieved  any  level  of  globalization.  For  these  Exten- 
sion systems,  internationalization  will  represent  a significant 
organizational  change.  Identification  of  characteristics  essen- 
tial to  an  internationalized  Extension  system  can  assist  Exten- 
sion leaders  and  university  administrators  to  identify  and  focus 
available  resources  where  the  greatest  impact  or  change  can  be 
realized.  A clear  sense  of  direction,  strong  leadership  in  inter- 
nationalizing and  enthusiasm  from  leaders  of  the  organization 
will  help  to  ensure  concerted  and  sustained  action.  Policy  and 
resource  decisions  such  as  the  incorporation  of  fiscal  support 
into  the  ongoing  Extension  budget  and  placing  a person  “in 
charge”  of  internationalization  to  support  and  coordinate  Ex- 
tension program  and  activities  are  necessary  implementation 
strategies.  Assessment  must  focus  on  the  outcomes  achieved. 
Organizational  change  is  a slow  and  often  discontinuous  pro- 
cess in  a complex  organization.  Ongoing  assessment  of  the 
progress  being  made  will  be  necessary. 

One  outcome  of  the  current  study  was  the  generation  of 
additional  questions  and  avenues  for  research.  Research  in  the 
area  of  internationalization  of  Extension  has  been  limited  and 
it  is  hoped  that  the  results  of  the  current  study  have  raised  addi- 
tional questions.  Suggestions  for  further  study  are  illustrative 
of  the  types  of  problems  yet  to  be  addressed.  Replication  of  the 
current  study  is  suggested.  Other  issues  to  be  explored  include: 
Can  the  factors)  which  stimulated  an  uninvolved  Extension 
system  to  change  and  begin  the  process  of  becoming  interna- 
tionalized be  identified?  What  are  the  societal  impacts  of  an 
internationalized  state  Extension  system?  What  characteristics 
do  state  Extension  systems  have  which  by  reputation  are  con- 
sidered internationalized  exhibit?  How  do  these  characteris- 
tics compare  with  the  five  identified  by  the  current  study? 

In  closing,  a comment  made  by  one  of  the  Delphi  Panel 
members  is  appropriate.  The  panel  member  indicated  “Inter- 
nationalization should  not  be  viewed  as  a fourth  dimension: 
teaching,  research,  service  and  international.  Instead  success- 
ful internationalization  efforts  will  integrate  global  perspectives 
into  the  basic  mission  and  mandate  of  Extension”. 
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Mentoring:  Help  or  Hindrance? 

Mary  Bendixon-Noe 
The  Ohio  State  University,  Newark 

Carmen  Giebelhaus 
University  of  Dayton 

The  research  literature  shows  mentoring  programs  in  education  to  be  highly  complex  and  situational. 
While  there  are  potential  advantages  for  both  the  mentor  and  the  novice  teacher,  several  issues  remain 
problematic  and  presently  limit  the  effective , widespread  use  of  mentoring  as  a way  of  inducting  new 
teachers  into  the  profession. 


When  we  finished  our  preservice  teacher  education  pro- 
grams, we  were  awarded  teaching  certificates  and  were  thought 
to  be  competent  in  all  classroom  endeavors,  including  teach- 
ing, discipline,  and  establishing  classroom  climate  and  envi- 
ronment. We  had  only  one  field  experience,  our  student 
teaching.  After  securing  a teaching  position,  we  entered  the 
classroom  excited  yet  apprehensive.  Noone  was  assigned  to 
help  us  cope  with  any  ensuing  problems  or  to  help  us  with  school 
policies  and  procedures.  Luckily,  we  attached  ourselves  to 
experienced  teachers  who  were  kind  enough  to  help  us  muddle 
through  our  first  year  of  teaching. 

Not  everyone  is  so  lucky,  though.  Linda  Darling-Hammond 
noted  in  a recent  issue  of  Kappan  (1996)  that  the  lack  of  effec- 
tive mentoring  is  one  of  the  barriers  to  having  competent  teach- 
ers for  every  child.  She  suggested  that  teachers  *\ . . who  do  get 
hired  are  typically  given  the  most  difficult  assignments  and  left 
to  sink  or  swim,  without  the  kind  of  help  provided  by  intern- 
ships and  residencies  in  other  professions.  Isolated  behind  class- 
room doors  with  little  feedback  or  help,  as  many  as  30 % leave 
in  the  first  few  years,  while  others  leant  merely  to  cope  rather 
than  to  teach  weir*  (p.  195).  Rosenholtz  (1989)  and  Veeman 
(1984)  support  Darling-Hammond ’s  assessment  regarding  the 
astoundingly  high  attrition  rate  of  beginning  teachers  after  just 
a few  years  of  service.  Whether  beginning  teachers  experience 
frustration  and  difficulty  in  the  profession  because  they  are  ex- 
pected to  be  responsible  for  the  same  work  that  experienced 
veterans  do  (Lortie,  1975),  or  because  they  are  frequently  given 
the  most  difficult  or  undesirable  teaching  situations,  educators 
from  across  the  country  have  responded  by  initiating  teacher 
mentoring  programs. 

In  recent  years,  we  have  worked  with  public  school  sys- 
tems and  their  mentoring  programs  for  beginning  teachers.  From 
our  discussions,  there  appear  to  be  wide  latitudes  regarding  the 
processes  and  procedures  in  developing  and  maintaining  men- 
tors and  mentoring  programs.  Our  observations  are  verified  by 
the  National  Association  of  State  Directors  of  Teacher  Educa- 
tion (NASDTEC)  who  notes  variance  in  programs  across  states. 
Mentoring  programs,  or  “Beginning  Teacher  Support  Systems” 
(BTSS)  as  they  are  referred  to  by  NASDTEC,  are  described  in 
the  1996- 1997  NASDTEC  Manual.  Currently,  it  is  noted  that 
only  28  states  have  BTSS  programs  and  of  those,  just  over  half 
(15)  have  all  of  their  beginning  teachers  involved  in  the  pro- 
grams. Most  include  some  type  of  training  and/or  inservice  pro- 
grams for  beginning  teachers  (20),  but  only  16  states  provide 


additional  funding  for  the  BTSS  programs.  The  elements  of 
each  state  program  vary  widely  with  regard  to:  (a)  criteria  and 
processes  for  selection  to  the  BTSS,  (b)  criteria  and  processes 
for  the  selections  of  mentors,  (c)  policies  regarding  evaluation 
of  the  BTSS,  (d  ) policies  regarding  second  year  support,  and 
(d)  funding  of  the  BTSS.  Further,  the  report  notes  that  only 
eight  states  require  support  for  beginning  teachers  by  the  teacher 
education  institutions. 

The  original  mentor  is  found  in  the  classic  poem  The  Od- 
yssey by  Homer.  When  Odysseus  leaves  to  fight  in  the  Trojan 
Wars,  he  entrusts  his  son,  Telemachus,  to  an  old  and  dear  friend 
named  Mentor.  Mentor  was  to  nurture  and  educate  Telemachus 
during  Odysseus's  absence.  Telemachus  was  to  respect  Men- 
tor. Therefore,  a mutual  relationship  developed  where  an  older, 
experienced  individual  helped  a younger  novice  to  develop  and 
grow.  From  this  Greek  myth,  the  process  of  helping  entry  per- 
sons into  a profession  by  utilizing  more  experienced  and  val- 
ued employees  has  been  labeled  mentoring.”  The  established 
programs  are  based  on  the  premise  that  a positive  emotional 
attachment  exists  between  two  individuals.  The  older  or  more 
experienced  persons  share  their  wisdom  and  insights,  while  the 
younger  or  novice  individuals  value  such  knowledge  and  learn 
from  it.  Business  and  government  introduced  mentoring  in 
their  worlds  beginning  in  the  1970s.  Schools,  colleges  and 
universities,  and  states  developed  mentoring  programs  in  the 
1980s  in  an  attempt  to  help  acclimate  new  teachers  nationwide 
(Gold,  1996;  Tellez,  1992). 

The  literature  reviewed  for  this  article  was  very  perplex- 
ing and  compounding.  One  thing  is  clear.  There  is  wide  vari- 
ance in  how  the  term  mentoring  is  used  and  in  the  programs 
described.  Its  implementation  appears  to  be  highly  dependent 
upon  the  leadership  of  the  organization,  the  interest  generated, 
and  available  funds.  There  are  numerous  articles  that  described 
in  detail  how  the  various  programs  use  mentors,  including  se- 
lection and  training.  The  literature  was  much  more  limited, 
however,  regarding  how  mentors  or  mentoring  programs  sig- 
nificantly improved  an  individual's  performance. 

The  Impact  of  Mentors 

The  limited  research  available  does  indicate  mentoring  gen- 
erally has  a positive  impact  on  both  mentor  and  prot£g6.  Kram 
(1983),  in  her  study  of  18  business  mentoring  relationships, 
concluded  these  relationships  can  enhance  a novice's  dcvelop- 
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ment.  The  phases  of  development  she  identified  were  similar 
to  those  of  Fuller  and  Bown  (1975)  or  others.  They  included 
initiation,  cultivation,  separation,  and  redefinition.  She  also 
found  the  positive  impact  was  influenced  by  the  individuals 
and  the  type  of  interpersonal  relationship  that  ultimately  devel- 
oped Kram  did  note,  however,  that  under  certain  circumstances, 
the  mentoring  relationship  could  become  destructive  for  one  or 
both  individuals.  Head,  Reiman,  and  Thies-Sprinthail  (1992) 
concur,  warning  that  in  facilitating  the  professional  growth  and 
development  of  teachers  inadequate  or  nominal  mentoring  pro- 
grams may  actually  be  worse  than  no  program  at  all.  It  ap- 
pears, therefore,  that  mentoring  programs  can  have  either 
positive  or  negative  effects. 

In  recent  years,  mentoring  research  has  focused  on  educa- 
tional inductees  at  various  levels.  For  example,  individuals  in 
higher  education  who  have  been  involved  in  a mentoring  pro- 
gram learned  political  skills,  risk-taking  behaviors,  and  com- 
munication skills  viewed  as  important  to  their  profession. 
Researchers  concluded  that  mentoring  relationships  we re  criti- 
cal for  developing  quality  professionals  in  higher  education 
(Bova  & Phillips,  1984).  Ganser  (1994)  reported  that  princi- 
pals in  public  school  systems  viewed  mentors  as  a helpful 
supplement  to  their  staffs.  They  also  wanted  to  be  involved  in 
selecting  the  mentors  who  worked  with  beginning  teachers. 

The  primary  focus  of  the  research  literature,  however,  has 
been  beginning  teachers.  Bainer  and  Didham  (1994)  reported 
that  mentoring  was  viewed  as  an  important  dimension  of  sup- 
port in  education.  Some  research  indicates  that  beginning  teach- 
ers involved  in  mentoring  programs  engage  in  more 
conversations  regarding  teaching  than  beginning  teachers  who 
do  not  have  mentors.  Additionally,  they  are  more  likely  to  en- 
gage in  action  research  and  are  more  willing  to  work  in  col- 
laborative contexts  for  teacher  learning  (Stanulis  & Jeffers, 
1995).  Teachers  who  are  involved  in  mentoring  programs  were 
identified  as  more  collaborative  in  both  professional  and  social 
context  (Powell  & Mills,  1995). 

Ballantyne,  Hansford,  and  Packer  (1995)  reported  that 
beginning  teacher  and  mentor  journals  revealed  four  major  func- 
tions of  mentoring,  including:  (a)  personnel  support,  (b)  task- 
related  assistance  and  advice,  (c)  problem-related  assistance 
and  advice,  and  (d)  critical  reflection  and  feedback  on  prac- 
tice. In  their  analysis  of  mentor  teacher  component  of  the  North 
Carolina  Beginning  Teacher  Program,  Huffman  and  Leak 
(1986)  concluded  that  “Mentor  teachers. ..provided  'positive 
reinforcement*,  ‘guidance  and  moral  support’,  ‘patience  and 
understanding’  and  even  a ‘shoulder  to  cry  on’”(p.  23). 

Personal  and  emotional  support  is  valued  by  beginning 
teachers,  but  mentors  also  gain  a great  deal  of  personal  satis- 
faction from  the  relationship.  Beginning  teachers  reported  that 
the  most  important  aspect  of  an  induction  program  was  having 
a mentor  because  it  gave  them  someone  to  turn  to  when  prob- 
lems arose  (Huling-Austin,  Putman,  & Galvez-Hjomevik, 
1986).  Researchers  link  the  aspect  of  “mentor  satisfaction”  to 
the  generativity  stage  in  adult  development  based  on  Erikson’s 
theory  (Stevens,  1995).  Findings  from  a qualitative  study  con- 
firm the  importance  of  mutual  respect  and  trust  necessary  for  a 
successful  mentoring  relationship  (Abell,  1995). 


Especially  in  the  early  weeks  of  teaching,  beginning  teach- 
ers value  the  advice,  resources,  and  ideas  that  a mentor  shares, 
information  about  school  routines  and  curriculum  content,  as- 
sessment and  evaluation  of  students,  and  innumerable  other  is- 
sues and  concerns  (Ballantyne  et  al„  1995).  It  also  has  been 
reported  that  both  the  curriculum  content  and  instructional 
methods  are  significantly  influenced  by  mentors  (Hamish,  1994; 
McNamara,  1995).  Beginning  teachers  reported  receiving  help 
from  their  mentors  in  14  areas,  according  to  Huling-Austin  and 
Murphy  (1987).  Among  the  most  mentioned  were:  someone  to 
talk  to/listen  to,  locating  materials,  help  with  clerical  work  related 
to  district  policies  and  procedures,  lesson  planning,  classroom  or- 
ganization, and  discipline  (p.  33).  Wilkinsons’  1994  survey  of 
286  first  year  teachers  found  that  beginning  teachers  reported  as- 
sistance with  classroom  procedures,  lesson  planning,  teaching  strat- 
egies and  methods,  and  discipline  as  most  helpful  to  them. 
Wilkinson  also  noted  that  when  the  teaching  situation  was  more 
challenging,  the  beginning  teachers  wanted  more  assistance. 

An  appropriate  time  for  mentoring  to  begin  to  focus  on 
critical  reflection  and  feedback  on  practice  is  during  the  later 
stages  of  a beginning  teacher’s  first  year  (Ballantyne  et  al.,  1995). 
They  note  that  during  the  second  term,  most  beginning  teach- 
ers report  growing  confidence  in  task-  and  problem-related  ar- 
eas. This  “naturally  occurring  shift  in  focus”  (p.  302)  is  from 
teaching-centered  concerns  to  student-learning  concerns  and  a 
willingness  to  take  risks  regarding  teaching  strategies  and  styles. 

Problems  in  Paradise 

While  research  suggests  many  benefits  of  mentoring,  many 
individuals  continue  to  express  concerns  regarding  mentors  and 
mentoring.  Areas  of  concern  include  the  lack  of  definition  of 
mentoring  and  mentors,  the  amountand  type  of  training  neces- 
sary for  mentors,  and  what  characteristics  mentors  need  to  be 
successful. 

One  of  the  biggest  concerns  regarding  mentors  and 
mentoring  is  the  wide  latitude  given  to  how  individuals  define 
the  two  terms.  If  we  are  to  utilize  Homer’s  guide,  many  of  the 
current  programs  implemented  do  not  fit  the  term  of  mentor. 
Often  what  we  see  is  one  individual  labeled  as  a “mentor”,  when 
actually  they  serve  as  a resource  person  or  “buddy”  for  new 
teachers.  This  occurs  when  a school  or  district  identifies  one 
teacher  to  serve  as  mentor  to  all  beginning  teachers  in  a par- 
ticular school  building.  This  role,  although  formally  established, 
has  no  allocated  time  for  implementation.  Therefore,  informa- 
tion regarding  policies  and  procedures  is  relayed,  but  no  per- 
sonal relationships  are  established.  True  mentoring  takes  time 
and  effort.  It  is  virtually  impossible  for  an  individual  with  his/ 
her  own  classroom  duties  to  find  the  time  to  establish  personal 
relationships  with  several  beginning  teachers.  Other  school 
mentoring  programs  pair  one  experienced  teacher  with  a nov- 
ice during  the  induction  year.  Again,  the  teachers  may  or  may 
not  have  common  planning  times  where  a relationship  could  be 
established.  These  are  just  two  mentor  program  configurations. 
However,  there  are  as  many  configurations  along  the  spectrum 
between  these  two  models  as  there  are  institutions  or  people 
who  develop  such  programs.  Perhaps  this  is  why  several  defi- 
nitions for  mentor  and  mentoring  are  found  (e.g.  Gehrkc  & 
Kay,  1984;  Kay,  1990;  Little,  Galagaran,  & O’Neal,  1984). 
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Healy  and  Welchert  (1990)  believe  a common  definition  must 
be  established  because  "without  such  definitional  consensus, 
efforts  to  develop  a knowledge  base  relevant  to  mentorships  in 
education  has  been  haphazard”  (p.  17). 

Another  issue  is  the  amount  or  absence  of  training  given 
to  mentors.  Some  school  districts  have  elaborate  systems  de- 
veloped for  the  selection  and  preparation  of  mentors.  At  the 
other  extreme,  some  do  nothing  beyond  identifying  the  mentor. 
Training  is  an  important  aspect  of  any  mentoring  program. 
O’  Dell  ( 1 987)  emphasizes  that  mentor  training  should  be  based 
on  the  literature  about  teacher  development,  beginning  teacher 
problems,  effective  teaching,  supervision,  and  adult  develop- 
ment. Research  supports  this,  as  beginning  teacher  concerns 
were  the  area  most  handled  by  mentors  (Wilkinson,  1994). 
Kilgore  and  Kozisek  (1988)  concluded  from  their  studies  that 
when  mentors  received  no  training  or  compensation,  their  role 
was  not  fulfilled. 

Hart  (1985)  found  that  teacher  mentors  were  most  suc- 
cessful as  supervisors  when  they  were  trained  in  supervision. 
Research  indicates  that  the  role  of  mentoring  is  difficult  to  per- 
form and  that  teachers  want  more  time  and  specific  training 
before  they  are  comfortable  with  and  competent  in  that  role 
(Ganser,  1995;  Hawley,  1990;  Warren-Little,  1988).  Thies- 
Sprinthall  (1986)  is  adamant  in  her  belief  that  mentor  training 
and  follow-up  activities  are  critical  to  the  success  of  the 
mentoring  program.  In  a preliminary  study,  Giebelhaus  and 
Bowman  (1997)  found  that  preservice  teachers  who  worked 
with  trained  mentor  teachers  exhibited  stronger  skills  in  plan- 
ning and  demonstrated  greater  reflective  and  analytical  skills 
about  teaching  and  learning  than  did  those  student  teachers 
whose  cooperating  teachers  had  no  mentor  training.  Further, 
they  found  that  although  mentor  training  which  included  gen- 
eral principles  and  strategies  of  supervision  produced  good  re- 
sults, even  better  results  occurred  when  the  training  was  coupled 
with  knowledge  of  and  skill  in  recognizing  specific  effective 
pedagogical  practices. 

Kennedy  (1991)  describes  one  program  which  she  found 
to  be  highly  successful  with  more  than  700  teachers  and  teacher 
candidates.  Components  of  this  mentoring  program  included: 
(a)  mentor  teachers  being  temporarily  released  from  their  full- 
time teaching  load,  (b)  mentors  received  training  in  the  task  of 
mentoring  and  on-going  assistance  afterwards  to  discuss  the 
challenges  of  mentoring,  and  (c)  preparation  and  assistance 
focuses  on  the  goals  and  purposes  of  teaching,  on  academic 
content,  and  on  how  to  critically  analyze  teaching. 

Wilson  and  Ireton  (1995-1996)  studied  the  competencies 
which  a master  or  mentor  teacher  should  possess  in  order  to 
model,  guide,  and  assist  a beginning  teacher.  Eleven  compe- 
tencies viewed  as  important  to  fulfilling  the  role  of  mentoring  a 
beginning  teacher  were  identified  by  mentor  teachers.  Of  the 
eleven  competencies  ranked,  classroom  management  was  iden- 
tified as  the  most  important.  Other  competencies  necessary  for 
effective  mentor  teachers  included  good  communication  skills, 
ability  to  respond  to  individual  differences,  ability  to  maintain 
a "close  day  to  day  liaison”  with  the  beginning  teacher,  enthu- 
siasm, willingness  to  accept  constructive  criticism,  and  ability 
to  provide  positive  feedback.  Personal  characteristics  neces- 
sary for  successful  mentoring  relationships  are  also  noted  in 


the  literature.  In  their  list  of  essential  mentor  characteristics, 
Butler  (1987)  and  O’Dell  (1987)  included  the  following:  (a) 
successful  teaching  experience,  (b)  willingness  to  commit  time, 
(c)  ability  to  redefine  roles  as  the  other  teacher  grows  and  de- 
velops, and  (d)  responsiveness.  Huling-Austin,  Putman,  and 
Galvez-Hjomevik  (1986)  stated  that  "The  assignment  of  an 
appropriate  support  teacher  is  likely  to  be  the  most  powerful 
and  cost-effective  intervention  in  an  induction  program”  (p.  50). 
More  recently,  Fletcher  ( 1 995)  indicates  that  mentors  must  have 
the  ability  to  work  as  a partner  in  a shared  learning  process  with 
another  adult.  Ballantyne  et  al.  (1995)  found  mentor  teachers 
who  did  not  have  the  knowledge  of  progressive  teaching  meth- 
ods or  the  ability  to  aid  their  prot6g6  in  critical  reflection  were 
not  successful  in  their  role.  Therefore,  attention  must  be  given 
to  the  characteristics  and  selection  of  mentors. 

The  Bottom  Line 

Effective  mentoring  is  highly  complex.  This  is  evidenced 
by  the  mentoring  principles  developed  and  adapted  by  the  Asso- 
ciation of  Teacher  Educators  in  1991  (Bey  & Holmes,  1992). 
Three  areas  are  identified  and  elaborated.  These  are:  the  actual 
mentoring  process,  the  establishment  and  maintenance  of 
mentoring  programs,  and  the  selection  and  preparation  of  men- 
tors. Research  indicates  that  there  are  potential  benefits  for  both 
individuals  involved  in  a mentoring  relationship.  However,  many 
issues  remain  problematic.  Many  of  these  problems  deal  with 
the  definition  of  mentoring,  the  role  of  the  mentors,  and  the  se- 
lection of  the  mentors.  Schools  report  that  they  are  unsure  about 
how  to  resolve  these  problems  (Bradley  & Gordon,  1994).  If 
these  are  the  biggest  issues  in  the  mentoring  process,  it  is  not 
surprising  that  schools  cannot  solve  them  alone.  There  appears, 
however,  to  be  tremendous  potential  in  inducting  novices  into 
the  teaching  profession  by  using  mentors.  By  working  together 
teacher  education  institutions  and  school  districts  may  be  able  to 
make  mentoring  the  best  possible  opportunity  for  ‘"passing  the 
torch  to  the  next  generation  of  teachers”  (Head  et  al.,  1992,  p.  5) 
and  realizing  America’s  goal  of  providing  "all  students  with  what 
should  be  their  educational  birthright:  access  to  competent,  car- 
ing and  qualified  teachers”  (National  Commission  on  Teaching 
and  America’s  Future,  as  cited  in  Darling-Hammond,  1996). 

References 

Abell,  S.  K.  (1995).  “Somebody  to  count  on:”  Mentor/intem 
relationships  in  a beginning  teacher  internship  program. 
Teaching  and  Teacher  Education,  11  (2),  173-188. 

Bainer,  D.  L.,  & Didham,  C.  (1994).  Mentoring  and  other 
support  behaviors  in  elementary  schools.  Journal  of  Edu- 
cational Research  87  (4),  240-247. 

Ballantyne,  R.,  Hansford,  B.,  & Packer,  J.  (1995).  Mentoring 
beginning  teachers:  A qualitative  analysis  of  process  and 
outcomes.  Educational  Review,  47  (3),  297-307. 

Bey,  T.M.,  & Holmes,  C.T.  (Eds.).  (1992).  Mentoring:  con- 
temporary principles  and  issues.  Rcston,VA:  Association 
of  Teacher  Educators. 

Bova,BM.,& Phillips,  RR.  (1984).  Mentoring  as  a learning  expe- 
rience for  adults.  Journal  of  Teacher  Education,  55(3),  16-20, 


22 


Mid-Wesitm  Educational  Reseanhtr 


t 1 fio 


Volume  10.  Number  4 Pull  1997 


Dariing-Hammond,  L.  (19%).  What  matters  most:  A competent 
teacher  for  every  child  Phi  Delta  Kappan,  78  (3),  193-200. 

Fletcher,  S.  (1995).  Caveat  mentor.  Language  Learning  Jour- 
nal  11  39-40. 

Fuller,  F.,  & Bown,  O.  (1975).  Becoming  a teacher.  In  K. 
Ryan  (Ed.),  Seventy-fourth  yearbook  of  the  National  Soci- 
ety for  the  Study  of  Education  (pp.  176-184).  Chicago: 
University  of  Chicago  Press. 

Ganser,T.  (1994).  The  perceptions  of  school  principals  about 
a mentoring  program  for  newly  hired  urban  school  teach- 
ers. Teacher  Educator , 30  (2),  1 3-23. 

Ganser,T.  (1995).  What  arc  die  concerns  and  questions  of  mentors 
of  beginning  teachers?  NASSP  Bulletin,  79  (575),  83-9 1 . 

Gehrke,N.J.,  &Kay,R.S.  (1984).  The  socialization  of  begin- 
ning teachers  through  mentor-prot£g£  relationships.  Jour- 
nal of  Teacher  Education,  35  (3),  21-24. 

Giebelhaus,  C.,  & Bowman,  C.  (1997,  February).  Tne  impact 
of  clinical  mentor  training  on  the  professional  development 
of  student  teachers.  Paper  presented  at  the  meeting  of  the 
Association  of  Teacher  Educators,  Washington,  DC. 

Gold,Y.  (19%).  Beginning  teacher  support  InJ.Sikula(Ed.), 
Handbook  of  research  on  teacher  education  (pp.  548-594). 
New  York:  Simon  & Schuster  Macmillan. 

Hamish,D.  (1994).  Mentoring  strategies  for  faculty  develop- 
ment Studies  in  Higher  Education,  19(2),  191-201. 

Hart,A.W.  (1985,  April).  Formal  teacher  supervision  by  teach- 
ers in  a career  ladder.  Paper  presented  at  the  meeting  of  the 
American  Educational  Research  Association,  Chicago. 

Head,  F.,  Reiman,  A.,  & Thies-Ssprinthall,  L.  (1992).  The 
reality  of  mentoring:  Complexity  in  its  process  and  func- 
tion. In  T.  Bey  & C.T.  Holmes  (Eds.),  Mentoring:  Contem- 
porary principles  and  issues  (pp.  5-24).  Reston,  VA:  As- 
sociation of  Teacher  Educators. 

Healy,C.C.,&Leak,S.  (1986).  Beginning  teachers’ perceptions 
of  mentors.  Journal  of  Teacher  Education,  37  (1),  22-25. 

Huling-Austin,  L„  &Murphy,  S.  C.  ( 1987).  Assessing  the  impact 
of  teacher  induction  programs:  Implications  for  program  de- 
velopment Paper  presented  at  the  meeting  of  the  American 
Educational  Research  Association,  Washington,  DC.  (ERIC 
Document  Reproduction  Service  No.  ED  283  779). 

Huling-Austin,  L.,  Putman,  S.,  & Gal  vez-Hjomevik,  C.  (1986). 
MTIP  Satellite  Conference  Proceedings  (Report  No.  7209). 
Austin,  TX:  University  of  Texas  at  Austin,  Research  and 
Development  Center  for  Teacher  Education. 

Kay,  R.W.  (1990).  A definition  for  developing  self-reliance. 
In  T.M.  Bey  & C.T.  Holmes  (Eds.),  Mentoring:  Develop- 
ing successful  new  teachers  (pp.  51-64).  Reston,  VA:  As- 
sociation of  Teacher  Educators. 

Kennedy,  M.  (1991).  Some  surprising  findings  on  how  teachers 
leam  to  teach.  Educational  Leadership , 49  (3),  14-17. 


Kilgore,  M.,  & Kozisek,  J.  A.  (1988).  The  effects  of  a planned 
induction  program  on  first  year  teachers:  4 research  re- 
port. Paper  presented  at  the  meeting  of  the  Association  of 
Teacher  Educators,  San  Diego,  CA. 

Kram,K.E.  (1983).  Phases  of  the  mentor  relationship.  Acad- 
emy of  Management  Journal,  26  (4),  608-625. 

Little,  J.  W.,  Galagaman,  P.,  & O’Neal,  R.  (1984).  Profes- 
sional development  roles  and  relationships:  Principles  and 
skills  of  “advising”.  San  Francisco:  Far  West  Laboratory  of 
Educational  Research  and  Development.  (ERIC  Document 
Reproduction  Service  No.  ED  267  515). 

Lortie,  D.  (1975).  Schoolteacher:  A sociological  study.  Chi- 
cago, IL:  University  of  Chicago  Press. 

McNamara,  D.  (1995).  The  influence  of  student  teachers’  tutors 
and  mentors  upon  their  classroom  practice:  An  exploratory  study. 
Teaching  & Teacher  Education,  11  (1),  51-61. 

National  Association  of  State  Directors  of  Teacher  Education 
(1996-1997).  Section  K.  In  T.  Andrews  (Ed.),  The 
NASDTEC  Manual  1996-1997  (pp.  1-10).  Dubuque,  IA: 
Kendall/Hunt 

O’Dell,  S.  J.  (1987).  Mentor  teacher  programs.  Washington, 
DC:  National  Education  Association. 

Powell,  R.,  & Mills,  R.  (1995).  Professional  knowledge  shar- 
ing among  interdisciplinary  team  teachers:  A study  of  intra- 
team mentoring.  Research  in  Middle  Level  Education  Quar- 
terly, 18  (3),  27-40. 

Rosenholtz,  S.  (1987).  Workplace  conditions  of  teacher  qual- 
ity and  commitment:  Implications  for  the  design  of  teacher 
induction  programs.  In  G.A.  Griffin  & S.  Mills  (Eds.),  The 
first  years  of  teaching:  Background  papers  and  a proposal 
(pp.  26-33).  Chicago,  IL:  University  of  Illinois  at  Chicago. 

Stanulis,R.N.,&  Jeffers,  L.  (1995).  Action  research  as  a way  of 
learning  about  teaching  in  a mentor/student  teacher  relation- 
ship. Action  in  Teacher  Education,  16  (4),  14-24. 

Stevens,  N.  H.  (1995).  R and  R for  mentors:  Renewal  and 
reaffirmation  for  mentors  as  benefits  from  the  mentoring 
experience.  Educational  Horizons,  73(3),  130-137. 

Tellez,  K.  (1992).  Mentors  by  choice,  not  by  design:  Help- 
seeking by  beginning  teachers.  Journal  of  Teacher  Educa- 
tion, 43  (3),  214-221. 

Thies-Sprinthall,  L.  (1986).  A collaborative  approach  for 
mentor  training:  A working  model.  Journal  of  Teacher 
Education,  37  ( 6),  13-20. 

Veeman,  S.  (1984).  Perceived  problems  of  beginning  teach- 
ers. Review  of  Educational  Research,  54  (2),  143-178. 

Wilkinson,  G.  (1994).  Support  for  individualizing  teacher  in- 
duction. Action  in  Teacher  Education,  16  (2),  52-61. 

Wilson,  B„  & Ireton,  E.  (1995-1996),  Improving  mentor 
teacher  effectiveness.  Rural  Educator,  17  ( 2),  28-30. 


Volume  la  Nutter  4 • Faill997 


Mid-Wtiiem  Educational  Researcher 


1 1 n j 


23 


Index  of  Authors:  1997 


The  Index  of  Authors  and  the  Index  of  Articles  are  alphabetical  listings  of  MWER  articles  from  1997  indicating  the 
issues  where  they  can  be  found.  Abstracts  for  these  articles  can  be  found  on  the  MWERA  Website,  http://www.acs.ohio- 
state.edu/units/education/mwera/contents.htm. 


M.  Kay  Alderman,  University  of  Akron 

Explorations  of  Preservice  Teachers’  Learning  Strategy  Use,  Volume  10,  No. 
2,  Spring  1997 

Charles  C.  Anderson,  Jr„  MWERA  Executive  Officer  (Ret.) 

MWERA:  Promise  and  Fulfillment  (Special  Supplement),  Volume  10,  No,  4, 
Fall  1997 

Thomas  Andre,  Iowa  State  University 

Minds-on  and  Hands-On  Activity:  Improving  Instruction  in  Science  for  All 
Students  (Presidential  Address  1995),  Volume  10,  No.  2,  Spring  1997 

Fulfilling  Its  Promise,  a Content  Analysis  of  20  Years  of  Research  at  MWERA, 
Volume  10,  No.  1,  Winter  1997 

Deborah  L.  Bainer,  The  Ohio  State  University,  Mansfield 

Voices  from  the  Past,  Volume  10,  No.  1,  Winter  1997 

R Kirby  Barrick,  University  of  Illinois  at  Utbana-Champaign 

Examining  What  Should  Be  the  Role  of  an  “Internationalized”  Land  Grant 
Extension  System,  Volume  10.  No.  4,  Fall  1997 

Mary  Bendixon-Noe,  The  Ohio  State  University,  Newark 

Mentoring:  Help  or  Hindrance?  (Research  Alive),  Volume  10,  No,  4,  Fall 
1997 

Susan  M.  Brookhart,  Duquesne  University 

A Field-Based  Introduction  to  Urban  Education  at  the  Middle  School,  Vol- 
ume 10,  No.  2,  Spring  1997 

Josue  Cruz.  University  of  South  Florida 

Problems  Related  to  Participants’  Roles  and  Programmatic  Goals  in  Student 
Teaching  Supervision,  Volume  10,  No.  4,  Fall  1997 

Roberta  A.  Fuller,  University  of  South  Florida 

Elementary  Teachers*  Pedagogical  Content  Knowledge  of  Mathematics, 
Volume  10.  No.  2,  Spring  1997 

Carmen  Giebelhaus,  University  of  Dayton 

Mentoring:  Help  or  Hindrance?  (Research  Alive),  Volume  10,  No.  4,  Fall 
1997 

Gary  Griffin,  University  of  Arizona 

Top  10  Issues  Facing  Teacher  Education,  Volume  10,  No.  1,  Winter  1997 

Christine  S.  Halon,  The  Ohio  State  University,  Mansfield 

Voices  from  the  Past,  Volume  10,  No.  1,  Winter  1997 

Mary  M.  Kennedy,  Michigan  State  University 

How  Teachers  Connect  Research  and  Practice,  Volume  10,  No.  1,  Winter 
1997 

Thomas  R Knapp,  The  Ohio  State  University,  Columbus 

Some  Cautions  Concerning  Inferences  about  Proportions,  Differences  Be- 
tween Proportions,  and  Quotients  of  Proportions,  Volume  10.  No.  4, 
Fall  1997 


Laura  Lipsett,  The  Ohio  State  University,  Columbus 
Problems  Related  to  Participants’  Roles  and  Programmatic  Goals  in  Student 
Teaching  Supervision,  Volume  10,  No.  4,  Fall  1997 

Barbara  G.  Ludwig,  Ohio  State  University  Extension 
Examining  What  Should  Be  the  Role  of  an  “Internationalized”  Land  Gram 
Extension  System,  Volume  10,  No.  4,  Fall  1997 

Gregory  J.  Marchant,  Ball  State  University 

Top  10  Issues  Facing  Teacher  Education,  Volume  10,  No.  1,  Winter  1997 

Ronald  N.  Marso,  Bowling  Green  State  University 
Effectiveness  Testing  Practices,  Volume  10,  No.  1,  Winter  1997 

Sharon  McNeely,  MWERA  President 

Schedules  and  Plans  and  Things  You  Should  Know,  Volume  10,  No.  1,  Win- 
ter 1997 

Fred  L,  Pigge,  Bowling  Green  State  University 
Effectiveness  Testing  Practices,  Volume  10,  No.  1,  Winter  1997 

Hema  Rama na than,  Butler  University 

Problems  Related  to  Participants’  Roles  and  Programmatic  Goals  in  Student 
Teaching  Supervision,  Volume  10,  No.  4,  Fall  1997 

Richard  J.  Reynolds,  Connecticut  State  University 
Educational  Reform  Through  the  Implementation  of  National  Standards:  A 
Response,  Volume  10,  No.  1,  Winter  1997 

Doug  Smith,  Coastal  Carolina  University 

Problems  Related  to  Participants’  Roles  and  Programmatic  Goals  in  Student 
Teaching  Supervision,  Volume  10,  No.  4,  Fall  1997 

Theresa  Strand,  MWERA  Archivist/Historian 

MWERA:  Promise  and  Fulfillment  (Special  Supplement),  Volume  10,  No.  4, 
Fall  1997 

Mary  R Sudzina,  University  of  Dayton 

From  Tourists  to  Citizens  in  the  Gass  room:  An  Interview  with  H.  Jerome 
Freiberg  (Conversations  in  Education),  Volume  10,  No.  2,  Spring  1997 

Hak  P.  Tun,  National  Taiwan  Normal  University 
Some  Cautions  Concerning  Inferences  about  Proportions,  Differences  Be- 
tween Proportions,  and  Quotients  of  Proportions,  Volume  10,  No.  4, 
Fall  1997 

Joseph  Watras,  University  of  Dayton 

Dismantling  Desegregation  (Book  Review),  Volume  10,  No.  2,  Spring  1997 

Loretta  Wilkinson,  Northeast  Ohio  Universities  College  of  Medicine 
Explorations  of  Preservice  Teachers’  Learning  Strategy  Use,  Volume  10,  No. 
2,  Spring  1997 

Donald  A,  Williams.  The  Ohio  State  University.  Lima 
Problems  Related  to  Participants*  Roles  and  Programmatic  Goals  in  Student 
Teaching  Supervision,  Volume  10,  No.  4,  Fall  1997 


Index  of  Articles:  1997 


Dismantling  Desegregation  (Book  Review) 

Joseph  Watras,  University  of  Dayton 
Volume  10,  No.  2,  Spring  1997 

Educational  Reform  Through  the  Implementation  of  National  Standards:  A 
Response 

Richard  J.  Reynolds,  Connecticut  State  University 
Volume  10,  No.  1,  Winter  1997 

Effectiveness  Testing  Practices 

Ronald  N.  Marso,  Bowling  Green  State  University 
Fred  L.  Pigge,  Bowling  Green  State  University 
Volume  10,  No.  1,  Winter  1997 

Elementary  Teachers’  Pedagogical  Content  Knowledge  of  Mathematics 
Roberta  A.  Fuller,  University  of  South  Florida 
Volume  10,  No.  2,  Spring  1997 


Examining  What  Should  Be  the  Role  of  an  “Internationalized”  Land  Grant 
Extension  System 

R.  Kilby  Barrick,  University  of  Illinois  at  Uibana-Champaign 
Barbara  G.  Ludwig,  Ohio  State  University  Extension 
Volume  10,  No.  4,  Fall  1997 

Explorations  of  Preservice  Teachers’  Learning  Strategy  Use 
M.  Kay  Alderman,  University  of  Akron 
Loretta  Wilkinson,  Northeast  Ohio  Universities  College  of  Medicine 
Volume  10,  No.  2,  Spring  1997 

A Field-Based  Introduction  to  Urban  Education  at  the  Middle  School 
Susan  M.  Brookhart,  Duquesne  University 
Volume  10,  No.  2,  Spring  1997 

From  Tourists  to  Citizens  in  the  Gassroom:  An  Interview  with  H.  Jerome 
Freiberg  (Conversations  in  Education) 

Mary  R.  Sudzina,  University  of  Dayton 
Volume  10,  No.  2,  Spring  1997 


24 


Mid  Wcstern  Educational  Researcher 


Volume  10,  Number  4 • Fall  1997 


EFFECTIVE  1997 


Mid-Western  Educational  Researcher 

Call  for  Manuscripts 


Co-Editors 

Deborah  L.  Bainer 

The  Ohio  State  University , Mansfield 

Gene  A.  Kramer 
American  Dental  Association 

Richard  M.  Smith 
Rehabilitation  Foundation,  IncJ 
Marianjoy  Rehabilitation  Hospital 


Consulting  Editors 

Ayres  G.  D’Costa 
The  Ohio  State  University 

Susan  M.  Brookhart 
Duquesnc  University 

John  R.  Surber 

University  of  Wisconsin,  Milwaukee 


MWER  Publications 
Deborah  L.  Bainer 

The  Ohio  Slate  University,  Mansfield 
1680  University  Drive 
Mansfield,  Ohio  44906 

MWER  Subscriptions 

Jean  W.  Pierce 
Department  EPCSE 
Northern  Illinois  University 
DcKalb,  Illinois  60115 


The  Mid-Western  Educational  Researcher  is  a scholarly  journal  that  publishes 
research-based  articles  addressing  a full  range  of  educational  issues.  The  journal  also 
publishes  literature  reviews,  theoretical  and  methodological  discussions  that  make  an 
original  contribution  to  the  research  literature,  and  feature  columns.  There  are  four 
issues  of  the  journal  published  annually. 

The  journal  is  now  accepting  manuscripts  for  review  and  possible  publication  in 
1997  and  beyond.  Manuscripts  are  submitted  to  blind  reviews  by  at  least  two  re- 
searchers with  knowledge  of  the  literature  in  the  appropriate  area.  Furthermore,  the 
editors  will  review  the  manuscript  and  make  the  final  decision.  The  review  process 
requires  approximately  three  months. 

Manuscripts  are  accepted  from  faculty,  students,  and  professionals  working  in 
non-educational  settings.  Membership  in  the  MWERA  is  not  required  in  order  to 
submit  a manuscript  for  review.  The  editors  encourage  the  submission  of  revised 
papers  that  have  been  presented  at  the  annual  meetings  of  the  MWERA,  AERA,  and 
other  professional  organizations. 

Submit  four  (4)  copies  of  the  manuscript  with  a cover  letter  to  Deborah  L.  Bainer 
(see  address  in  left  margin).  Manuscripts  should  conform  to  the  style  and  format 
described  in  the  Publication  Manual  of  the  American  Psychological  Association , 4th 
edition.  All  manuscripts  should  be  typed,  double  spaced,  on  8 1/2  x 11  paper  with  1 
1/2  inch  margins  on  all  sides.  An  abstract  of  less  than  100  words  should  accompany 
the  manuscript.  The  author’s  name  and  affiliation  should  appear  on  the  title  page 
only.  Submissions  typically  are  less  than  20  pages  in  length.  If  the  manuscript  is 
accepted  for  publication,  the  author(s)  will  be  asked  to  provide  a disk  file  (WP  5. 1 or 
higher  on  a 3 1/2  inch  high  density  IBM  formatted  disk)  as  well  as  a printed  copy  of 
the  final  version.  Please  note  that  the  editors  reserve  the  right  to  make  minor  modifi- 
cations in  order  to  produce  a concise  and  clear  article. 

Questions  regarding  the  journal  or  the  submission  of  feature  columns  should  be 
directed  to  the  editors. 

Deborah  L.  Bainer  (419)  755-4287  bainer.  1 @osu.edu 
Gene  A.  Kramer  (3 1 2)  440-2684  kramerg@ada.org 
Richard  M.  Smith  (630)  462-4102  jomea@rfi.org 


Index  of  Articles:  1997  ( conL  ) 


Fulfilling  Its  Promise,  a Content  Analysis  of  20  Years  of  Research  at  MWERA 
Thomas  Andre,  Iowa  State  University 
Volume  10,  No  1,  Winter  1997 

How  Teachers  Connect  Research  and  Practice 

Mary  M.  Kennedy,  Michigan  State  University 
Volume  10,  No.  1.  Winter  1997 

Mentoring:  Help  or  Hindrance?  (Research  Alive) 

Mary  Bcndixon-Noc,  The  Ohio  Slate  University.  Newark 
Carmen  Gicbelhaus.  University  of  Dayton 
Volume  10,  No.  4,  Fall  1997 

Minds-on  and  Hands-On  Activity:  Improving  Instruction  m Science  for  All 
Students  (Presidential  Address  1995) 

Thomas  Andre,  Iowa  State  University 
Volume  10.  No.  2,  Spring  1997 

MWERA.  Promise  and  Fulfillment  (Special  Supplement) 

Charles  C.  Anderson,  Jr.,  MWERA  Executive  Officer  (Ret ) 
Theresa  Strand,  MWERA  Archivist/Historian 
Volume  10,  No.  4,  Fall  1997 

Problems  Related  to  Participants'  Roles  and  Programmatic  Goals  in  Student 
Teaching  Suprrvision 

Josuc  Cruz.  University  of  South  Florida 


Laura  Lipsctt,  The  Ohio  State  University.  Columbus 
Hema  Ramanathan,  Butler  University 
Doug  Smith,  Coastal  Carolina  University 
Donald  A.  Williams.  The  Ohio  Stale  University.  Lima 
Volume  10,  No.  4,  Fall  1997 

Schedules  and  Plans  and  Things  You  Should  Know 
Sharon  McNcely,  MWERA  President 
Volume  10,  No.  !,  Winter  1997 

Some  Cautions  Concerning  Inferences  about  Proportions,  Differences  Be- 
tween Proportions,  and  Quotients  of  Proportions 

Thomas  R.  Knapp,  The  Ohio  State  University,  Columbus 
Hak  P.  Tam,  National  Taiwan  Normal  University 
Volume  10.  No.  4,  Fall  1997 

Top  10  Issues  Facing  Teacher  Education 

Gary  Griffin,  University  of  Arizona 
Gregory  J.  Marchant,  Ball  Slate  University 
Volume  10,  No.  1.  Winter  1997 

Voices  from  the  Past 

Deborah  L Bainer,  The  Ohio  State  University,  Mansfield 
Christine  S llalon.  The  Ohio  Slate  University,  Mansfield 
Volume  10,  No.  I,  Winter  1997 


T • H • E 

OHIO 

SPUE 

UNIVERSITY 


BULK  RATE 
U.S  POSTAGE 
PAID 

COLUMBUS  OHIO 
PERMIT  NO. 711 


The  Ohio  State  University 
2500  Kenny  Road 
Columbus,  Ohio  43210 


SUSAN  VOELKEL 
P0°B0*S134SER!C/CRESS 

J8&J®:E8vSi5325 


118  7 


v::‘  *'"/  ’'v:  Oh/^G^er  \ 

Xooat^iriAin^'Ipfra^t^  ' 

^■aiiiiit^ 

/'  VilBe' <^mpuf feiati^es 

. . ., Gfam^  * ; * * ;'  ’:: ' :-  '■".■•■••/''•'-• 

Iow^  State  & a.brc^jbasttf  international  University  pf  science  and ^ technology  with 
. : iSiG^-sfa^  State^.^d  120  olher  nations . Ttie-bitth- 

wiag&inp.  ’;• 

; libWa  Stote  fan{ced  first  among  U;Sy Universities  in  the  numterp^licenses  opfions 

executed  in  1995*  Iowa  State  has  received  more  R&D  TOGawardsfor  research  innovation 
than  .a:Jl  but  one  other  udiverstty  in  theU.S.  In  l?96r97.  sj^nsdr^^^ng-troeived  -for  . 
research  andeducauona}  programs  at  Iowa  State  totaled  $t90.9  million;  $12Q.2  million 
i was received  for research alone. 

At  the  founding  of  Iowa  State  University  in  1869,  the  .President,  Adonijah  Welch, 
created  a professorship  in  the  “science  and  art  of  teaching.”  Iowa  State,  thereby,  became 
the  first  institution  in  America  to  offer  teacher  education  courses  for  credit  on  a sustained 
basis  as  part  of  a four  year  bachelor’s  degree  program. 

Today,  the  College  of  Education  is  striving  to  become  the  best  college  of  education  at 
a land-grant  university.  More  than  1,700  undergraduate  students  and  400  graduate  stu- 
dents are  enrolled  in  die  college.  More  than  100  full-time  faculty  provide  a strong  faculty- 
student  ratio  in  the  college’s  four  departments. 

The  College  is  home  to  the  Center  for  Technology  in  Learning  and  Teaching,  the 
National  K-12  Foreign  Language  Resources  Center,  and.  the  Institute  for  Excellence  in 
Science  Education, 


Information  for  Contributors  to  the  Mid-Western  Educational  Researcher 

The  Mid-Western  Educational  Researcher  accepts  rcscarch-bascd  manuscripts  that  would  appeal  to  a 
wide  range  of  readers.  All  materials  submitted  for  publication  must  conform  to  the  language,  style,  and  format  of  the 
Publication  Manual  of  the  American  Psychological  Association,  4th  ed.,  1994 
(available  from  Order  Department,  American  Psychological  Association,  P.O.  Box  2710,  Hyattsville,  MD  20784). 

Four  copies  of  the  manuscript  should  be  submitted  typed  double-spaced  (including  quotations  and  references)  on 
872  x 1 1 paper.  Only  words  to  be  italicized  should  be  underlined.  Abbreviations  and  acronyms  should  be  spelled  out  when 
first  mentioned.  Pages  should  be  numbered  consecutively,  beginning  with  the  page  after  the  title  page. 

Manuscripts  should  be  less  than  20  pages  long.  An  abstract  of  less  than  100  words  should  accompany  the  manuscript. 

The  manuscript  will  receive  blind  review  from  at  least  two  professionals  with  expertise  in  the  area  of  the  manuscript. 

The  author's  name,  affiliation,  mailing  address,  telephone  number,  c-mail  address  (if  available),  should  appear  on  the  title  page 
only.  Efforts  will  be  made  to  keep  the  review  process  to  less  than  four  months.  The  editors  reserve  the  right  to  make  minor 
changes  in  order  to  produce  a concise  and  clear  article. 

The  authors  will  be  consulted  if  any  major  changes  are  necessary. 

Manuscripts  should  be  sent  with  a cover  letter  to: 

Deborah  L Bainer,  MWER  Co-Editor 

1680  University  Drive,  Ohio  State  University  at  Mansfield,  Mansfield,  OH  44906 

The  Mtd  Western  Educational  Xt scorcher  (tSSN  M56-3W7)  ii  published  quarterly  by  the  MklWestcm  Educational  Research  Aiiociauon  through  The  Ohio  Sutc  University. 
The  Summer  issue  aervr*  is  the  annul  meeting  program  Non-profit  postage  paid  ai  Columbus,  Ohln,  with  permission  of  the  College  of  Education,  Nancy  Zimpher,  Dean 
POSTMASTER  Send  address  change  in  Jean  W.  Pierce.  Dept  EPCSE,  Northern  Illinois  University.  DcKalb,  tL  60115. 


RFST  rnpv  M/All  ARl  F 


Co-Editors 

Deborah  L.  Bainer 
The  Ohio  State  University, 
Mansfield 

email:  bainer.10osu.edu 

Gene  A.  Kramer 
American  Dental  Association 
email:  kramerg@ada.org 

Richard  M.  Smith 
Rehabilitation  Foundation , Inc. 
email:  jomea@tfi.org 


Editorial 
Advisory  Board 

Thomas  Andre 
Iowa  State  University 

Josue  Cruz 

University  of  South  Florida 

Charlene  Czemiak 
University  of  Toledo 

Mary  Ann  Flowers 
Cleveland  Stat$  University 

Tom  Ganser 

University  of  Wisconsin  - Whitewater 

Kenneth  A.  Kiewra 
University  of  Nebraska,  Lincoln 

Sharon  McNeely 
Northeastern  Illinois  University 

Isadora  Newman 
University  of  Akron 

\ 

A,  William  Place 
University  of  Dayton 

Joan  T.  Timm 

University  of  Wisconsin-Oshkosh 

Benjamin  Wright 
University  of  Chicago 


Layout  and  design 

Judy  E.  Tcska 
JET  Desktop  Solutions 


jykn>WESTERN= 

Educational 

Researcher 

■ " Volume  1 1 , No.  1 Winter  1 998 


Violence  Goes  to  School 
Jack  Levin,  Northeastern  University 
2 

The  Legal  Context  of  Sexual  Harassment  In  Education 
Robert  J.  Shoop , Kansas  State  University’ 

8 

Conference  Highlights 
Thomas  S.  Parish,  Kansas  State  University' 

18 

President's  Report 
Kim  K.  Metcalf  Indiana  University 
20 

Invitation  for  Proposals  for  1998  Annual  Meeting 
21 

Diversity  Issues  in  Educational  Research 
James  B.  Boyer,  Kansas  State  University 
25 

Learning  About  Sex:  The  Missing  Paradigms 
and  Challenges  to  Educational  Researchers 
Sharon  McNeely,  Northeastern  Illinois  University 
29 

The  Role  of  Communication  in  Providing 
Leadership  for  School  Restructuring 
Theodore  J.  Kowalski,  Ball  State  University 
32 

Technology  and  Teaching  in  the  Communications  Age 
Molly  Herman  Baker,  Western  Illinois  University 

41 

The  Mid-Western  Educational  Research  Association 
Gift  Membership 
43 


MWER  Publication  Address 
Deborah  L.  Bainer 

The  Ohio  State  University,  Mansfield 
1680  University  Drive 
Mansfield,  OH  44906 
Phone:  (419)  755-4287 
Fax  (419)755-4367 
email,  baincr.l@osu.edu 


MWERA  Membership  Information 

Jean  W.  Pierce 
Dept.  EPCSE 

Northern  Illinois  University 
DeKalb,  1L  60115 
Phone:  (815)  753-8470 
Fax:  (815)753-9250 
email  P30JWPl@mvs.cso.mu  cdu 


Mid*We$ttm  Educational  Researcher 


Volume  II,  Number  1 • Winter  1998 


4 j M 


nircT  rnov  avaii  adit 


Keynote  Address 

Violence  Goes  to  School 


Jack  Levin 

Northeastern  University 

Abstract 

The  growing  problem  of  juvenile  violence  has  found  its  way  into  all  of  our  institutions,  including  our 
schools.  More  and  more  school  administrators  report  having  to  deal  with  violence  on  an  everyday  basis 
and  having  to  suspend  students  for  carrying  weapons  or  being  involved  in  violent  confrontations.  In 
response , many  observers  have  suggested  solutions  that  are  politically  expedient , but  simply  won  't  work . 
They  fail  to  address  the  question  of  what  makes  violence  so  appealing  to  so  many  youngsters , in  the  first 
place.  Without  providing  healthy  alternatives  to  violence,  all  the  training  programs,  counseling,  and 
therapy  will  have  little  effect  on  our  crime  rate.  We  need  a cultural  revolution  at  the  grass-roots  level. 


During  the  last  few  weeks  alone,  the  headlines  have  been 
filled  with  reports  of  hideous  crimes  committed  by  teenag- 
ers. A 16-ycar-old  boy  in  Pearl,  Mississippi  fatally  stabs  his 
mother  and  then  goes  on  a shooting  spree  at  school  where  he 
kills  his  former  girlfriend  and  another  student.  A 15-year- 
old  boy  in  a suburb  of  Boston  leaves  98  stab  wounds  in  his 
43-year-old  neighbor,  the  mother  of  his  best  friend.  A 15- 
year-old  boy  in  Southern  New  Jersey  kills  an  1 1 -year-old 
child  who  was  going  door-to-door  selling  candy.  And  a 14- 
year-old  Florida  boy  shoots  his  sister  simply  because  she 
talked  on  the  phone  too  long. 

Twenty-five  or  thirty  years  ago,  such  crimes  would  have 
seemed  extraordinary  not  only  for  their  extreme  brutality  or 
senseless  motivation,  but  also  for  their  rare  occurrence.  In 
1967,  if  a teenager  had  murdered  his  sister  because  she 
wouldn’t  let  him  use  the  phone,  we  would  have  been  talking 
about  it  for  six  months.  In  1997,  the  same  offense  is  re- 
garded as  the  crime  of  the  week.  We  shake  our  heads  in 
dismay  and  then  move  on  to  the  next  horrific  offense.  Sadly 
enough,  the  most  brutal  and  hideous  crimes  involving  our 
teenagers  arc  now  viewed  as  commonplace  or  expected. 

And  there  is  some  reality  behind  this  perception.  In  ur- 
ban and  not-so-urban  areas  around  the  country,  anxieties  con- 
cerning violent  crime  have  been  reinforced  by  a soaring  crime 
rate  and  by  the  growing  participation  of  juveniles  in  the  most 
serious  criminal  offenses.  From  1985  to  1994,  for  example, 
the  rate  of  murder  committed  by  teenagers,  ages  14- 1 7,  actu- 
ally increased  more  than  170  percent.  For  15-year-old  boys, 
the  increase  was  an  incredible  212  percent  (Fox,  1996). 
Younger  and  younger  children  now  have  more  dangerous 
weapons  in  their  hands,  more  dangerous  drugs  in  their  bodies, 
and  a cavalier  attitude  toward  human  suffering. 

Actually,  the  problem  of  dcsensitization  to  violence  is 
even  worse  than  the  dreadful  statistics  concerning  juvenile 
crime  might  suggest.  While  relatively  few  of  our  youngsters 
are  committing  hideous  murders — about  1 percent  is  respon- 
sible for  more  than  30  percent  of  all  homicides — they  are 
being  tolerated — perhaps  even  honored — by  their  friends  and 
classmates.  Millions  of  teenagers  may  not  be  able  to  shoot 
or  stab  someone  themselves,  but  they  are  fully  capable  of 
looking  on  as  others  do  so. 


Several  years  ago,  a teenager  in  Milpitas,  California  mur- 
dered his  14-year-old  girlfriend  and  then  returned  to  the  scene 
with  a dozen  classmates  to  show  them  the  corpse.  One 
student  covered  the  body  with  leaves  to  keep  it  from  being 
discovered;  others  threw  rocks  at  it.  None  of  them  con- 
tacted the  police.  This  episode  became  the  basis  for  a film 
in  the  1980s  entitled  River  s Edge. 

More  recently.  Attorney  Marsha  Kazarosian  filed  a suit 
against  the  Winnecunnet,  New  Hampshire  school  district  on 
behalf  of  the  families  of  the  three  youngsters  convicted  in 
the  murder  of  Greg  Smart  in  Derry,  New  Hampshire. 
Kazarosian  claimed  that  Pam  Smart’s  love  affair  with  her 
1 5 year  old  student  was  made  possible  because  she  was  neg- 
ligently unsupervised  by  the  Winnecunnet  High  School  ad- 
ministration— that  somebody  in  charge  should  have  been 
keeping  a watchful  eye  on  Smart. 

Whether  or  not  school  officials  should  have  known,  it 
appears  that  they  may  have  been  the  only  ones  at 
Winnecunnet  High  who  didn’t.  Statements  made  during  the 
course  of  the  police  investigation  indicate  clearly  that  at  least 
one  month  before  the  Derry  police  finally  broke  the  case, 
the  corridors  of  Winnecunnet  High  were  already  abuzz  with 
rumors  implicating  the  three  students  and  their  teacher.  Yet 
nobody  bothered  to  inform  an  adult. 

More  incredibly,  statements  later  made  to  law  enforce- 
ment officials  indicate  that  students  at  Winnecunnet  High 
were  talking  about  Greg  Smart’s  murder  for  two  months 
before  it  actually  occurred.  With  a simple  phone  call,  any 
one  of  them  might  have  prevented  a murder.  But  nobody 
wanted  to  “snitch”  or  “tattle”  on  a classmate.  Everybody 
was  concerned  abcut  being  rejected  by  friends.  So  they  all 
kept  quiet  and  let  the  murder  plot  proceed  according  to  plan 
(Levin,  1993). 

The  impact  of  juvenile  violence  has  been  felt  in  every 
one  of  our  institutions,  including  our  schools.  Some  35,000 
teenagers  go  to  school  each  day  carrying  a handgun.  Al- 
most half  of  all  high  school  students  report  that  their  class- 
males  carry  weapons;  and  about  40  percent  report  that  gangs 
are  present  in  their  school  (Blumstcin,  1 995). 
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More  and  more  principals  report  having  to  deal  with 
violence  on  an  everyday  basis  and  having  to  suspend  or  ex- 
pel students  for  carrying  weapons  or  being  involved  in  vio- 
lent confrontations.  More  and  more  school  administrators 
are  attempting  to  counteract  violence  with  some  combina- 
tion of  a law  enforcement  strategy  including  metal  detectors 
and  security  personnel  as  well  as  a conriict  resolution  pro- 
gram. And  more  and  more  principals  and  teachers  consider 
violence  prevention  a priority  for  their  schools.  According 
to  a study  I recently  conducted  of  schools  in  five  urban  school 
systems,  even  the  elementary  schools  are  feeling  the  impact 
of  student  violence  in  a major  way.  They  too  are  dealing 
with  violence  on  an  everyday  basis;  they  too  are  offering 
conflict  resolution  programs  in  response  to  episodes  of  vio- 
lence between  students  and  are  expelling  students  for  carry- 
ing weapons  (Noguera,  1995;  Levin  and  Johnson,  1997). 

At  least  some  part  of  the  violence  problem  in  schools 
around  the  country  is  linked  to  racial  tensions.  Between 
August  31  and  September  18,  1990,  pollster  Louis  Harris 
set  out  to  determine  the  views  of  a nation-wide  sample  of 
students  regarding  the  state  of  racial  and  ethnic  tensions  in 
America.  Harris’s  staff  talked  with  a cross-section  of  1865 
high  school  students  who  were  attending  the  10th,  1 1 th,  and 
1 2th  grades  in  public,  parochial,  and  private  schools  around 
the  country  (Levin  and  McDevitt,  1993). 

The  pollster’s  findings  paint  a rather  bleak  picture  of 
race  relations  among  American  youth  of  the  1990s.  Appar- 
ently, confrontations  between  individuals  of  different  races 
and  religions  have  become,  to  use  Harris’s  words,  “com- 
monplace” in  the  nation’s  high  schools.  More  than  half  of 
the  students  interviewed  claimed  that  they  had  witnessed 
racial  confrontations  either  “very  often”  or  “once  in  awhile.” 
One  in  four  reported  having  personally  been  a target  of  such 
an  incident.  Yet,  only  30  percent  of  all  students  said  that 
they  were  prepared  to  intervene  to  stop  or  even  to  condemn 
a confrontation  based  on  racial  hatred.  On  the  contrary,  al- 
most half  admitted  that  they  would  either  join  in  the  attack 
or,  at  the  very  least,  agreed  that  the  group  being  attacked 
was  getting  what  it  deserved  (Levin  and  McDevitt,  1993). 

The  findings  of  a recent  survey  of  all  1 ,570  elementary, 
middle,  and  secondary  public  schools  in  Los  Angeles  County 
also  support  the  view  that  youthful  violence  is  connected 
with  race  relations.  Thirty-seven  percent  of  these  schools 
had  encountered  incidents  of  hate-motivated  violence  over 
the  period  of  a year.  As  expected,  students  in  middle  and 
high  schools  were  particularly  likely  to  have  experienced 
hate  violence,  with  a response  rate  of  47%  and  42%  respec- 
tively. Somewhat  more  surprising  was  the  finding  that  34% 
of  the  elementary  schools  had  also  had  violent  episodes  based 
on  hate  (Levir  and  McDevitt,  1993). 

Reducing  Juvenile  Violence 

The  American  Psychological  Association  (APA),  re- 
cently made  a number  of  recommendations  most  of  which 
focus  on  changing  the  psychological  condition  of  our  young- 


sters. According  to  the  APA  Commission’s  report,  the  vio- 
lent kids  watch  too  much  television,  learn  aggressive  habits 
early  in  life,  and  handle  frustration  by  lashing  out  at  others. 
They  have  trouble  learning  social  cues,  are  desensitized  to 
violence,  and  lack  self-esteem. 

As  a remedy,  the  psychologists  suggested,  among  other 
things,  that  television  networks  carry  fewer  violent  programs 
during  the  hours  when  children  watch,  that  the  schools  teach 
their  students  to  manage  anger,  and  that  family  members 
stop  fighting  one  another. 

Although  very  much  worth  considering,  I would  argue 
that  the  suggestions  proposed  by  the  APA’s  Commission  fall 
just  a little  short.  Specifically,  they  fail  to  address  the  ques- 
tion of  what  makes  violence  so  appealing  to  so  many  young- 
sters, in  the  first  place.  Why  is  it  that,  in  many  quarters  around 
the  country,  semi-automatic  rifles  have  replaced  35mm  cam- 
eras, leather  jackets,  and  CD  players  as  status  symbols  of 
choice?  And,  why  has  serving  a year  behind  bars  become  a 
rite  of  passage  in  some  inner-city  neighborhoods? 

Without  providing  healthy  alternatives  to  violence,  all 
the  training  programs,  counseling,  and  therapy  we  can  mus- 
ter won’t  have  a profound  effect  on  our  crime  rate.  Whether 
we  like  it  or  not,  many  teenagers  benefit — or  at  least  believe 
that  they  benefit — from  being  deviant  and  destructive.  In  a 
single  violent  episode,  they  are  able  to  impress  their  friends, 
make  money,  receive  career  training,  feel  powerful,  protect 
themselves,  and  find  acceptance  among  their  peers.  The 
most  violent-prone  teenagers  aren’t  getting  along  at  home, 
aren’t  making  it  at  school,  and  can’t  find  a decent  job.  In 
violence,  they  feel  something  they  never  felt  before — they 
feel  special,  they  feel  important  and  wanted. 

A couple  of  years  ago,  I appeared  on  a television  talk 
show  with  three  Nazi  skinheads,  young  men  who  wanted  to 
feel  powerful  and  dominant,  but  who  were  totally  unsophisti- 
cated with  respect  to  understanding  Nazi  ideology.  Angry 
and  hate-filled,  they  wore  Nazi  uniforms  and  other  symbols 
of  power.  It  occurred  to  me  that  these  three  youngsters  could 
just  as  easily  have  joined  a gang  or  have  become  members  of 
a cult.  They  were  marginal  youngsters  who  wanted  to  feel 
successful,  wanted  to  feel  important,  but  couldn’t  seem  to  make 
it  in  any  middle  class  way.  So  they  terrorized  vulnerable 
people,  just  as  other  troubled  teenagers  find  it  entertaining  to 
drop  boulders  through  the  windshields  of  oncoming  cars,  to 
spray  bullets  into  crowds,  or  to  break  into  apartments  and 
automobiles  in  order  to  terrorize  their  occupants. 

Jack  McDevitt  and  I ( 1 993)  have  found  that  the  major- 
ity of  hate  crimes  reported  to  the  police — crimes  against  in- 
dividuals because  they  are  different  in  terms  of  race,  religion, 
sexual  orientation,  or  disability  status — arc  committed  by 
groups  of  teenaged  boys  for  the  thrill,  the  excitement— to 
feel  something  that  they  believe  is  lacking  in  their  own 
lives — a sense  of  power  and  control.  In  the  same  way  that 
some  young  men  get  together  on  a Saturday  night  to  play  a 
game  of  cards,  groups  of  teenaged  boys  gather  to  destroy 
property  or  to  bash  minorities.  They  look  merely  to  have 


some  fun  and  stir  up  a little  excitement. ..but  at  someone  else’s 
expense.  They  enjoy  the  exhilaration  and  the  thrill  of  mak- 
ing someone  else  suffer. 

For  a while,  Americans  were  discussing  whether  we 
should  try  caning  our  kids,  the  way  it  is  done  in  Singapore. 
Legislation  to  introduce  caning  as  an  official  criminal  jus- 
tice response  to  teenage  violence  is  pending  in  at  least  a few 
states.  Well,  American  youngsters  are  already  comparing 
the  size  of  their  bullet  wounds;  if  we  were  to  institute  can- 
ing, I’m  afraid  our  kids  would  be  pulling  down  their  pants  to 
show  off  the  welts  on  their  buttocks — sort  of  a red  badge  of 
courage.  What  seems  to  be  a severe  punishment  in  Singapore 
may,  in  the  cultural  context  of  the  United  States,  turn  out  to 
be  a reward. 

Or,  take  jurisdictions  in  which  parents  are  held  crimi- 
nally responsible  for  their  teenagers  delinquency.  In  Flint, 
Michigan,  for  example,  parents  can  be  fined  a thousand  dol- 
lars if  their  seventeen-year  old  children  are  caught  smoking 
cigarettes  in  public.  Of  course,  mommy  and  daddy  ought  to 
be  held  accountable  for  the  destructive  behavior  of  their  pre- 
adolescent  youngsters.  But  Two  things  bother  me  about  any 
policy  that  punishes  the  parents  for  their  teenagers  trans- 
gressions. First,  it  sends  the  wrong  message  to  teenagers 
who  are  all  too  eager  to  avoid  responsibility  for  what  they 
do  wrong.  And  second,  it  sets  up  the  possibility  of  dramati- 
cally increased  levels  of  domestic  homicide.  In  many  cases, 
when  we  speak  of  children,  we  are  really  talking  about  physi- 
cally mature  youngsters  who  are  fully  capable  of  having  their 
way  with  their  parents.  Two  skinhead  brothers  in  Pennsyl- 
vania recently  murdered  their  mother,  father,  and  1 1 year 
old  brother,  after  their  parents  wouldn’t  let  them  drive  the 
family  car.  One  of  the  murdering  youngsters  was  a 15  year 
old  boy  who  also  happened  to  be  6 foot  5 and  weighed  245 
pounds.  Rather  than  make  mommy  and  daddy  the  super 
cops  of  society — at  the  very  time  when  the  family  is  at  risk 
of  going  the  way  of  Jurassic  Park — we  should  be  giving  sup- 
port, assistance,  and  encouragement  to  parents  everywhere. 
Let’s  get  them  involved  once  again  in  the  lives  of  their  teen- 
agers— but  not  because  they  might  otherwise  be  punished. 

Uniforms  seem  to  make  a difference — at  least  in  the 
opinions  of  principals  who  have  tried  them.  They  level  so- 
cial class  differences  in  dress;  they  make  it  easier  to  spot 
intruders;  and,  at  least  for  a short  period  of  time,  they  elimi- 
nate gang  distinctions.  But  these  distinctions  apparently  soon 
reappear,  just  as  soon  as  gang  members  discover  that  they 
can  Find  other  ways  to  communicate  their  membership.  The 
research  so  far  does  not  seem  to  support  the  effectiveness  of 
uniforms  as  a method  of  fighting  school  violence. 

Of  course,  conflict  resolution  programs,  especially  if  they 
are  started  very  early  in  elementary  schools,  make  at  least 
some  difference — perhaps  an  importan id i (Terence — in  stem- 
ming the  tide  of  violence.  Even  if  the  results  of  such  pro- 
grams cannot  be  generalized  to  non-school  settings,  they  are 
as  important  as  metal  detectors  and  security  personnel  as  an 
effort  to  control  the  school  day  for  children  and  teachers  who 


deserve  a safe  environment  in  which  to  learn.  By  the  way, 
recent  evidence  suggests  that  the  positive  effects  of  conflict 
resolution  programs  are  very  frequently  generalized  to  inter- 
actions after  classes  and  outside  of  the  school  environment. 

But  no  matter  how  effective,  such  programs  will  not 
make  the  big  difference.  Conflict  resolution  programs,  for 
example,  aim  at  reducing  the  traditional  forms  of  violence 
and  conflict  that  develop  between  teenagers  and  children. 
The  problem  is  that  the  must  troublesome,  most  marginal 
students  will  not  be  persuaded  by  peer  mediation  or  pro- 
grams designed  to  teach  them  to  manage  their  anger.  Their 
problems  are  structural  in  origin  and  will  require  a struc- 
tural change  in  response. 

In  many  jurisdictions,  there  are  simply  no  alternative  pro- 
grams designed  for  students  who  are  expelled  because  they 
are  violent  at  school.  Instead,  these  violent- prone  and  alien- 
ated youngsters — the  very  children  and  teenagers  who  are  re- 
sponsible for  committing  the  most  heinous  crimes  of  all — are 
left  to  walk  the  streets  idle,  bored,  and  unsupervised.  They 
may  no  longer  be  an  immediate  threat  in  the  context  of  the 
school  environment,  but,  in  the  long  run,  they  will  become 
even  more  threatening  to  everyone,  including  themselves. 

As  for  the  Commission’s  recommendation  that  broad- 
casters provide  programs  that  counter  violence,  I’m  afraid 
that  it  simply  won’t  work.  True,  children  spend  too  much  of 
their  time  watching  television — on  average,  four  or  five  hours 
daily.  It  is  also  true  that  much  of  what  they  view  on  the  tube 
is  violent  and  desensitizing.  In  fact,  the  average  child  grows 
up  observing  more  than  30,000  murders  on  TV,  more  than 
100,000  acts  of  violence,  not  to  mention  what  he  or  she  sees 
in  R-rated  slasher  films  and  in  violent  video  games. 

The  V-chip  strategy  for  limiting  children’s  access  to  vio- 
lent television  sounds  good  in  theory.  Parents  will  now  be 
able  to  eliminate  electronically  the  most  offensive  network 
programs  from  their  children’s  after-school  viewing  options. 
Unfortunately,  the  V-chip  will  not  work,  and  it  sends  the 
wrong  message  to  adults.  By  installing  this  bit  of  high-tech 
wizardry  in  their  TV  sets,  they  can  continue  to  ignore  their 
unsupervised  children  after  school. 

In  his  State  of  the  Union  address,  President  Clinton 
voiced  his  support  for  V-chip  technology  and  urged  the  tele- 
vision industry  to  adopt  the  measures  taken  years  ago  by 
motion  picture  producers.  Yet,  the  motion  picture  business 
has  been  far  more  offensive  than  the  networks  when  it  comes 
to  filling  our  youngsters’  heads  with  tasteless  images  of  hu- 
man destructiveness.  In  fact,  acts  of  violence  are  now  rou- 
tinely depicted  as  graphically  as  possible  on  the  screen, 
without  regard  for  how  they  may  affect  impressionable  young 
viewers.  In  one  motion  picture  after  another,  children  are 
treated  to  disgusting  scenes  of  decapitation  and  dismember- 
ment. Victims  are  shown  with  their  brains  literally  blown 
apart,  their  heads  missing,  their  fingers  sliced  off,  and  their 
intestines  exposed.  What  is  more,  many  of  these  films  are 
available  as  videotapes  for  rent,  escaping  the  ability  of  a V- 
chip  to  eliminate  them  from  children's  viewing. 
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Some  concerned  parents  and  lobbying  groups  have 
praised  the  rating  system  employed  by  the  motion  picture  in- 
dustry (G,  PG,  PG-13,  R,  NC-17,  and  X),  a voluntary  code 
that  was  adopted  in  the  1960s  in  order  to  placate  concerned 
parents.  Yet,  it  is  the  rating  system  itself  that  has  inspired  the 
producers  of  motion  pictures  to  introduce  more  and  more  gra- 
tuitous scenes  of  human  destruction  and  suffering,  not  to  en- 
hance the  plot,  but  just  to  attract  teenagers  who  tend  to  spend 
freely  on  entertainment.  Without  such  gory  details,  their  films 
might  get  a PG  or  even  a G rating  and  be  shunned  by  most 
ten-year-old  boys  who  refuse  to  go  to  “kids’  movies.” 

Ironically,  the  films  most  likely  to  contain  graphic  scenes 
of  violence  are,  under  the  voluntary  code  of  the  motion  pic- 
ture industry,  ostensibly  off  limits  to  movie-goers  under  17 
years  of  age,  unless  they  are  accompanied  by  an  adult.  Be- 
cause the  code  is  rarely  enforced,  however,  the  majority  of 
the  audience  for  the  most  grotesque  of  these  films  is  often 
comprised  of  unsupervised  children  who  are  thrilled  by  the 
prospect  of  seeing  unlimited  quantities  of  blood  and  guts. 
Thus,  the  industry’s  rating  system  has  provided  a standard  of 
consumer  decision-making,  not  for  parents,  but  for  their  un- 
der-age children  who  search  the  newspaper  advertisements 
for  a film  that  contains  large  doses  of  sex,  violence,  and  gore. 

Now  we  have  done  for  television  what  has  been  so  di- 
sastrous for  motion  pictures.  Home-alone  teenagers  can 
turn  to  the  TV  Guide  to  find  their  favorite  programs — those 
with  the  equivalent  of  an  R rating.  In  the  meantime,  it  will 
take  years  before  their  parents  trade  in  their  sets  for  one 
containing  a V-chip.  And,  within  six  months,  mommy  and 
daddy  will  have  forgotten  how  to  program  the  V-chip  on 
their  set  before  leaving  for  work  or  will  have  given  in  to 
their  complaining  teenagers’  constant  demands.  Remember 
all  the  VCRs  blinking  in  homes  around  the  country?  Well, 
they’re  still  blinking  12-12-12-12. 

Once  again,  the  question  involves  providing  healthy 
alternatives.  What  will  bored  and  alienated  teenagers  do 
when  they  are  not  watching  TV?  It  is  doubtful  that  they  will 
instead  read  the  classics  or  take  up  chess.  Rather  than  worry 
so  much  about  what  our  children  are  watching,  we  might  be 
more  concerned  about  who  is  watching  our  children. 

It’s  not  that  television  is  so  powerful.  It’s  that  our  other 
institutions — our  churches  and  synagogues,  our  neighbor- 
hoods, our  schools,  our  universities,  and  our  families — have 
become  so  weak  on  the  issue  of  supervising  youngsters. 

Japanese  television  is  much  more  violent  than  its  Ameri- 
can counterpart;  yet  the  level  of  street  violence  in  Japanese 
cities  is  extremely  low.  One  reason  is  that  Japanese  tradi- 
tional culture  continues  to  be  quite  powerful  even  among 
young  people.  Another  reason  is  that  Japanese  television  is 
hardly  ever  used  as  a baby-sitter,  the  way  that  it  is  in  the 
United  States.  In  Japan,  children  who  watch  violent  pro- 
grams are  viewing  with  adults — their  parents  and  their  grand- 
parents. They  have  adults  around  to  monitor,  to  guide,  to 
interpret,  to  explain. 


If  we  were  really  smart,  we  would  begin  now  to  inves*. 
as  much  in  our  young  people  as  we  invest  in  the  stock  mar- 
ket. We  must  intervene  as  early  as  possible  in  the  lives  of 
children  who  are  troubled,  not  because  we  fear  they  will 
grow  up  to  be  Jeffrey  Dahmers,  but  simply  because  it  is  the 
right  thing  to  do  and  because  it  will  be  effective  in  the  long 
run.  If  we  were  smart,  we  would  repair  our  nation’s  play- 
grounds, put  lifeguards  at  neighborhood  swimming  pools, 
build  decent  community  centers,  and  make  sure  that  kids 
have  summer  and  after-school  jobs.  For  youngsters  who  arc 
otherwise  unsupervised  and  idle,  we  would  provide  quality 
day  care  and  after  school  programs. 

To  an  increasing  extent,  city  high  schools  do  offer  an 
array  of  after  school  programs  including  intramural  athlet- 
ics, drama,  art,  music,  and  student  government.  Unfortu- 
nately, such  programs  and  activities  are  virtually  absent  from 
grades  K through  5,  leaving  many  younger  children  without 
opportunities  for  wholesome  experiences  and  activities  in 
the  afternoon.  Moreover,  after-school  high  school  and 
middle  school  programs  in  large  cities  are  usually  restricted 
to  students  who  are  in  academic  good  standing,  haven’t  been 
troublesome  in  the  classroom,  have  economic  resources,  and 
can  find  their  own  transportation  home  (Levin  and  Johnson, 
1997).  In  other  words,  they  exclude  the  impoverished,  alien- 
ated, and  rebellious  students — the  very  students  who  are  in 
greatest  need  of  supervision. 

It  took  20  or  30  years  to  get  to  the  point  where  violence, 
in  some  cities,  seems  out  of  control.  It  will  probably  take  at 
least  a decade  to  get  us  going  firmly  in  the  opposite  direc- 
tion. Try  telling  that  to  our  governors,  senators,  and  repre- 
sentatives who  come  up  for  re-election  every  two,  four,  or 
six  years.  They  look  for  politically  expedient  short  term 
answers,  even  if  they  won’t  work.  They  emphasize  three 
strikes  and  you’re  out;  boot  camps;  uniforms,  curfews;  the 
death  penalty;  holding  parents  criminally  responsible  for  their 
teenagers  violations  of  the  law,  and  dismantling  the  juvenile 
justice  system.  These  are  policies  that  might  make  Ameri- 
cans feel  more  secure,  but  they  will  do  little  more. 

Take  something  as  simple  as  curfews.  They  sound 
great — get  the  kids  off  the  streets  after  eleven  or  twelve,  so 
they  won’t  hurt  one  another.  Well,  cities  like  San  Antonio 
have  tried  curfews,  with  almost  no  effect  at  all.  The  prob- 
lem is  that  only  10  percent  of  all  serious  crimes  committed 
by  under-age  teenagers  arc  committed  after  1 1 pm  and  be- 
fore 6 am.  Almost  50  percent  of  all  juvenile  crimes  (not  to 
mention  premarital  pregnancies)  arc  committed  between  2 
and  7 in  the  afternoon — after  school  and  before  dinner — or 
should  I say  before  mommy  and  daddy  come  home  from 
work  (Fox,  1996). 

And  many  of  our  youngsters,  lacking  in  support  sys- 
tems— and  Im  talking  about  even  those  youngsters  who  grow 
up  in  middle-class  areas — feel  that  they  arc  on  their  own. 
Their  parents  may  be  divorced;  both  of  their  parents  may 
hold  full  time  jobs;  or  they  may  grow  up  in  a single-parent 
household  And,  when  they  come  home  from  school,  ten) 
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many  of  our  youngsters  are  literally  alone  or  with  a group  of 
friends  who  are  unsupervised.  Twenty  years  ago,  at  least 
some  of  the  neighbors  would  have  been  home,  peering 
through  the  blinds  to  keep  an  eye  on  the  block.  Not  now; 
not  in  most  neighborhoods — everybody  is  working,  includ- 
ing the  neighbors. 

So  fifty  seven  percent  of  all  teenagers  and  children  now 
grow  up  without  full  time  parental  supervision — Forty  nine 
percent  under  the  age  of  six.  Of  course,  some  of  them  do 
have  a healthy  alternative — quality  daycare,  after-school  ac- 
tivities, summer  jobs,  community  centers,  athletic  programs. 
But  many  others  do  not.  So  they  end  up  raising  themselves 
(Fox,  1996). 

We  used  to  hear  about  elderly  residents  in  high  crime 
areas  who  virtually  become  prisoners  in  their  own  homes. 
To  avoid  crime,  they  double  lock  their  doors  and  stay  inside 
their  apartments  after  dark,  afraid  to  venture  out  on  the  streets 
under  any  condition.  Instead,  they  watch  television.  In  fact, 
TV  becomes,  in  some  cases,  the  only  friend  they  have. 

Well,  this  same  pattern  is  now  occurring  among  teenag- 
ers in  high  crime  neighborhoods.  It’s  called  street  survival 
skills;  but  what  it  means  is  that  more  of  our  youngsters  are 
staying  off  the  streets  in  order  to  survive;  they  come  home 
from  school  every  day,  double  lock  their  doors,  and  watch 
television  until  their  parents  come  home  from  work. 

The  Future  of  Juvenile  Violence 

Based  on  demographics  alone,  we  are  in  trouble.  The 
children  of  the  baby  boomers  will  shortly  join  the  violence- 
prone  age  group — those  who  are  in  their  late  teens  and  early 
twenties  and  who  commit  a disproportionate  share  of  vio- 
lent crimes.  Over  the  course  of  the  next  decade,  the  number 
of  teenagers,  15-19,  will  increase  by  15  percent.  If  we  are 
not  effective  now  in  our  efforts  to  reduce  the  scourge  of  teen- 
age violence,  we  may  look  back  at  the  1990s  as  the  lull  be- 
fore the  crime  storm. 

At  the  same  time,  allow  me  in  closing  to  give  you  at 
least  a little  bit  of  good  news.  Believe  it  or  not,  the  murder 
rate  has  been  coming  down  in  many  of  our  major  cities.  Now, 
let's  not  kid  ourselves  into  believing  that  we’ve  conquered 
the  crime  problem.  Things  are  by  no  means  great  in  the  crime 
department,  but,  in  many  places,  they  are  getting  better.  A 
drop  in  the  murder  arrest  rate  over  the  last  two  or  three  years 
is,  at  the  very  least,  a good  sign.  We  may  not  be  totally  out 
of  the  woods  yet,  but  we  can*at  least  sec  sunlight  through  the 
branches. 

Part  of  the  explanation  for  the  decrease  in  serious  crime 
is  probably  demographic.  The  76  million  baby  boomers  have 
matured  into  middle  age  and  out  of  the  crime-prone  age 
group.  Rather  than  commit  murder  and  aggravated  assault, 
they  have  graduated  into  such  lower-risk  white  collar  of- 
fenses as  fraud  and  embezzlement. 

Another  factor  involves  a beefed  up  criminal  justice  sys- 
tem, putting  more  and  more  police  officers  between  citizens 


and  criminals.  In  New  York  City  and  Houston,  Texas,  for 
example,  zero-tolerance  policing  has  taken  more  and  more 
offenders  off  the  streets  and  out  of  the  reach  of  innocent 
victims.  William  Bratton,  when  he  was  still  New  York’s 
Police  Commissioner  attributed  the  success  of  his  crime- 
fighting efforts  to  a get-tough  policy  that  locks  away  street 
criminals  long  before  they  have  had  the  opportunity  to  com- 
mit serious  offenses.  Of  course,  his  policies  are  now  also 
being  blamed  for  the  rise  in  excessive  force  complaints 
against  New  York’s  Finest.  Many  principals  have  adopted 
the  same  zero-tolerance  policy  regarding  students  who  carry 
weapons  to  school. 

But  the  most  important  factor  in  declining  murder  rates 
in  our  major  cities  may  have  nothing  to  do  with  policies, 
population  or  prisons.  Americans  everywhere,  at  the 
grassroots  level  and  up,  are  just  beginning  to  recognize  that 
they  can  make  the  difference  in  the  crime  rate.  At  the  grass 
roots  level,  they  are  working  to  repair  the  moral,  social,  and 
economic  damage  done  to  our  youngsters  and  to  take  the 
glamour  out  of  destructive  behavior. 

Fed  up  with  crime,  ordinary  citizens  are  enthusiastically 
addressing  the  issue  of  violent  crime  and,  in  the  process,  are 
re-defining  it.  Everywhere  you  look,  you  find  groups  and 
organizations  not  unlike  this  one  focusing  on  violence  in 
conferences,  lectures,  keynote  speeches,  and  workshops. 
Moreover,  taking  their  cue  from  growing  popular  sentiment, 
local  institutions  have  sponsored  a number  of  interesting 
programs  aimed  at  local  youngsters — churches  running  ath- 
letic programs  and  gun-buyback  programs,  companies  pro- 
viding more  after-school  jobs  with  a future,  college  students 
going  into  inner-city  schools  to  do  tutoring,  mentoring,  and 
peer-mediation,  universities  providing  scholarships  to  young- 
sters in  the  local  community,  and  teachers  and  parent  groups 
volunteering  to  supervise  after-school  activities. 

Parallels  can  be  found  in  our  changing  attitudes  toward 
cigarette  smoking.  Prior  to  the  Sergeant  General's  Report 
in  1968,  smoking  was  widely  regarded  as  fashionable  and 
stylish.  But  more  than  twenty  five  years  later,  the  campaign 
has  discredited  smoking  and  stigmatized  smokers.  Hope- 
fully, the  same  may  soon  happen  to  individuals  who  have  a 
propensity  for  violence. 

Of  course,  although  the  anti-smoking  campaign  reduced 
the  consumption  of  cigarettes  among  adults,  it  essentially 
failed  to  convert  young  people.  In  1997,  an  additional  4000 
teenagers  continue  to  take  up  the  smoking  habit  everyday. 

In  the  same  way,  teenagers  aren’t  likely  to  be  touched 
by  a cultural  revolution  that  asks  that  they  become  less  vio- 
lent and  destructive.  Many  youngsters  don’t  think  about 
long-term  consequences — whether  about  contracting  lung 
cancer  or  going  to  prison.  Indeed,  teenagers  are  likely  to 
feel  invincible  and  therefore  immune  from  the  impact  of  their 
own  violent  behavior. 

But  unlike  smoking  campaigns,  the  cultural  revolution 
in  attitudes  toward  violence  is  being  aimed  not  at  teenagers 
at  all,  but  directly  at  their  parents,  their  teachers,  their  clergy, 
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their  neighbors,  their  government  representatives — at  adult 
members  of  society  who  are  (or  should  be)  responsible  for 
dealing  with  teenagers.  This  is  important  because  our  young- 
sters will  change  only  to  the  extent  that  society’s  response  to 
them  changes  first. 

Teenagers  who  have  been  routinely  ignored,  unsuper- 
vised, and  left  to  fend  for  themselves  must  discover  that  their 
parents  and  teachers  care.  Youngsters  who  join  gangs  and 
carry  weapons  to  school  must  be  guided  and  counseled  more 
and  more  by  clergy,  social  workers,  and  probation  officers. 
For  the  first  time  in  their  young  lives,  our  teenagers  will  feel 
important,  they  will  feel  special,  because  somebody  cares 
what  happens  to  them.  And  that  will  make  all  the  differ- 
ence, for  all  Americans  everywhere  who  want  to  feel  secure 
in  their  own  schools,  homes  and  neighborhoods. 
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is  taking  place  on  the  campus  and  some  is  taking  place  in 
the  courts.  The  current  uncertainty  about  the  legal  status  of 
sexual  harassment  is  an  example  of  the  complex  process  of 
translating  a new  value  into  new  rules  for  behavior. 

Legal  Interpretation  of  Sexual  Harassment 

Sexual  harassment  is  any  unwelcome  behavior  of  a 
sexual  nature  that  interferes  with  a persons  work  or  educa- 
tion. The  term  “unwelcome”  indicates  the  action  or  behav- 
ior was  unsolicited  and  nonreciprocal.  In  other  words,  the 
person  witnessing  or  being  affected  by  the  behavior  didn’t 
“ask  for”  or  invite  the  behavior.  For  example,  wanted  kiss- 
ing, touching,  or  flirting,  is  not  sexual  harassment. 

“Behavior  of  a sexual  nature”  includes  virtually  any 
conduct  that  refers  to  sex.  Such  conduct  can  include  using 
profane  language  or  telling  off-color  jokes.  It  includes  us- 
ing sexist  terms  such  as  “babe”  or  “bitch,”  or  “bimbo”  or 
making  comments  about  body  parts.  But,  it  can  also  in- 
clude what  some  may  consider  to  be  “terms  of  endearment” 
such  as  “honey,”  “baby  ” “darling,”  etc.  Behavior  of  a sexual 
nature  includes  leering  and  ogling,  and  without  question, 
any  kind  of  unwanted  touching  such  as  patting,  hugging, 
and  pinching.  Finally,  any  request  for  sexual  favors  in  re- 
turn for  benefits  meets  the  criteria  established  for  sexual 
harassment. 

Although  the  concept  of  sexual  harassment  is  not  com- 
pletely settled  in  law  or  fully  understood  by  society  as  a 
whole,  courts  have  clearly  and  consistently  affirmed  that  the 
workplace  and  the  classroom  must  be  free  from  sexual  ha- 
rassment. While  not  legally  required  to  do  so,  the  courts 
tend  to  look  to  the  Equal  Employment  Opportunity  Com- 
mission (EEOC)  for  guidance  on  matters  relating  to  sexual 
harassment.  In  1988  the  EEOC  issued  a document  to  all 
field  offices  entitled  Policy  Guidance  on  Current  Issues  of 
Sexual  Harassment . The  document  outlined  the  behavior 
that  constitutes  sexual  harassment.  The  guidelines  reminded 
field  personnel  that  sexual 

harassment  is  a form  or  subset  of  sexual  discrimination 
and  is  therefore  prohibited  by  Title  VII  of  the  1964  Civil 
Rights  Act. 

The  EEOC  drew  upon  a substantial  body  of  judicial 
reasoning  in  holding  that  Title  VII  affords  the  right  to  work 
in  an  environment  free  from  discriminatory  intimidation,  ridi- 
cule, and  insult.  The  student’s  workplace  is  school,  and 
consequently  students  are  afforded  this  same  right. 

Over  the  past  ten  years  most  sexual  harassment  cases 
have  been  based  upon  the  EEOC  Guidelines  on  Discrimi- 
nation Because  of  Sex.  According  to  these  guidelines,  un- 
welcome sexual  advances,  requests  for  sexual  favors,  and 
other  verbal  or  physical  conduct  of  a sexual  nature  is  sexual 
harassment  if; 

• submission  to  such  conduct  is  made  either  explicitly  or 

implicitly  a term  or  condition  of  an  individual’s  em- 
ployment, 


• submission  to  or  rejection  of  such  conduct  by  an  indi- 
vidual is  used  as  the  basis  for  employment  decisions 
affecting  such  individual,  or 

• such  conduct  has  the  purpose  or  effect  of  unreasonably 
interfering  with  an  individual’s  work  performance  or 
creating  an  intimidating,  hostile,  or  offensive  working 
environment. 

The  first  two  subsections  of  the  EEOC  guidelines  de- 
fine quid  pro  quo  harassment.  The  third  subsection  describes 
hostile  environment  sexual  harassment.  A subset  of  the  hos- 
tile work  environment  is  known  as  sexual  favoritism. 

Quid  pro  quo , environmental,  and  sexual  favoritism 
sexual  harassment  regularly  occur  on  school  and  university 
campuses.  Although  all  three  are  forms  of  discrimination, 
and  it  is  sometimes  difficult  to  distinguish  between  the  cat- 
egories, it  is  important  to  do  so  because  schools  and  univer- 
sities are  held  to  different  standards  of  liability  for  each. 
Often  these  forms  overlap  or  occur  simultaneously.  How- 
ever, each  is  a distinct  category  and  provides  for  a separate 
complaint  or  cause  of  action.  The  following  is  an  overview 
of  each  category  of  sexual  harassment. 

Quid  Pro  Quo 

Quid  pro  quo  is  a Latin  term  that  means,  “you  do  some- 
thing for  me  and  I’ll  do  something  for  you.”  In  the  context  of 
sexual  harassment  of  educational  employees  or  students,  quid 
pro  quo  may  include  an  offer  of  special  treatment  such  as 
awarding  a better  grade,  letter  of  reference,  promotion  or 
merit  raise  in  return  for  sexual  favors.  It  can  also  be  a threat 
of  retaliation.  For  example,  quid  pro  quo  occurs  if  a teacher 
or  pi  jfessor  threatens  to  lower  a grade  or  refuses  to  write  a 
letter  of  recommendation  or  a principal  or  department  chair 
threatens  to  withhold  a recommendation  for  promotion  or  ten- 
ure if  a sexual  request  is  rejected.  Quid  pro  quo  also  takes 
place  if  a teacher  or  professor  threatens  a student  with  some 
penalty  if  the  student  does  not  consent  to  have  a sexual  rela- 
tionship with  the  teacher  or  professor.  One  critical  aspect  of 
quid  pro  quo  is  that  courts  hold  institutions  liable  for  even  a 
single  incident.  In  quid  pro  quo  sexual  harassment  the  depri- 
vation of  educational  benefits,  once  such  deprivation  is  proven, 
allows  the  victim  to  ask  the  court  to  provide  relief. 

Quid  pro  quo  sexual  harassment  is  the  easiest  type  of 
harassment  to  recognize  and  has  received  more  attention  from 
the  media  and  consequently  it  is  better  understood  than  other 
forms  of  sexual  harassment.  In  cases  of  quid  pro  quo  the 
institution  is  generally  held  liable  even  if  it  had  no  knowl- 
edge of  the  specific  behavior.  The  Ci  vil  Rights  Act  of  1 99 1 
permits  an  award  of  compensatory  and  limited  punitive  dam- 
ages against  private  employers.  However,  public  employ- 
ers are  only  liable  for  compensatory  damages. 

Although  quid  pro  quo  sexual  harassment  frequently 
occurs  and  the  consequences  are  devastating,  hostile  edu- 
cational environment  is  the  most  prevalent  and  misunder- 
stood form  of  sexual  harassment. 
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Hostile  Educational  Environment 

Any  sexually-oriented  conduct  or  any  sexually-oriented 
atmosphere  that  is  intimidating  or  offensive  to  a reasonable 
person,  can  be  construed  as  creating  a hostile  educational 
environment.  In  the  workplace  this  behavior  is  called  hos- 
tile work  environment  sexual  harassment,  in  a school  or  uni- 
versity setting  I refer  to  it  as  a hostile  educational 
environment.  This  concept  is  sometimes  confusing  because 
men  and  women  often  perceive  the  very  same  behavior  in 
quite  different  ways.  What  a man  might  consider  innocu- 
ous, a woman  might  consider  blatantly  offensive.  It  is  im- 
portant to  remember  that  courts  now  tend  to  favor  the  victim’s 
point  of  view. 

One  critical  dimension  of  the  hostile  educational  envi- 
ronment category  is  that  sexual  harassment  can  occur  even 
though  the  victim  does  not  suffer  any  loss  of  economic  or 
tangible  benefits.  Unlike  quid  pro  quo , hostile  educational 
environment  requires  a consistent  pattern  of  behavior.  A 
single  event  does  not  necessarily  constitute  a violation.  In 
order  for  a behavior  to  be  considered  to  have  created  a hos- 
tile educational  environment,  it  must  be  “sufficiently  perva- 
sive and  severe.” 

What  Constitutes  A Hostile  Educational 
Environment 

A hostile  environment  in  an  educational  setting  is  es- 
sentially the  same  as  it  is  in  other  workplace  settings.  In  the 
school  or  university  setting  the  hostile  educational  environ- 
ment theory  is  based  on  the  assumption  that  the  relationship 
between  the  student  and  the  school  and  the  subordinate  and 
the  supervisor  is  very  significant  and  that  students  and  sub- 
ordinates should  be  protected  from  psychological  as  well  as 
physical  abuse.  Each  student  or  employee  should  be  able  to 
come  to  class  or  work  free  from  fear  and  free  from  harm. 

It  is  important  to  remember  that  the  person  who  creates 
a hostile  environment  docs  not  have  to  have  formal  power. 
Therefore,  co-workers  and  fellow  students  can  crate  a hos- 
tile educational  environment  for  each  other.  It  is  also  pos- 
sible for  a subordinate  to  create  a hostile  environment  for  a 
supervisor  and  for  a student  to  create  a hostile  environment 
for  a faculty  member. 

Sexual  Favoritism 

A third  type  of  sexual  harassment  is  actually  a subset  of 
environmental  sexual  harassment.  Sexual  favoritism  is  also 
(airly  easy  to  identify.  It  occurs  when  a student  or  employee 
receives  benefits  as  a result  of  his  or  her  submission  to  sexual 
advances  or  requests  for  sexual  favors.  The  victims  of  the 
harassment  may  .he  the  other  students  or  employees  who  arc 
treated  unfairly  because  they  arc  not  objects  of  the  romantic 
interest  of  a supervisor.  In  the  workplace,  this  type  of  sexual 
harassment  has  resulted  in  successful  law  suits  brought  on 
behalf  of  qualified  persons  who  were  denied  employment 
opportunities  or  benefits.  However,  courts  have  required  proof 
of  the  sexual  relationship,  not  merely  rumors  or  innuendos. 


Courts  have  yet  to  offer  consistent  views  on  how  to  treat  sexual 
harassment  cases  in  which  a student  is  favored  by  a teacher 
who  has  a romantic  interest  in  him  or  her. 

Issue  of  Intent 

Some  people  are  confused  about  the  role  that  intent  plays 
in  determining  whether  or  not  sexual  harassment  has  taken 
place.  Faculty  members  who  have  been  accused  of  sexually 
harassing  students  often  reply  that  they  did  not  intend  to 
embarrass,  or  that  they  were  only  teasing.  They  apparently 
assume  that  this  is  some  how  a defense  against  the  impact  of 
their  actions.  Many  people  who  have  been  accused  of  sexual 
harassment  admit  that  they  committed  the  behavior  but  con- 
tend that  they  did  not  intend  the  behavior  to  be  offensive. 
This  argument  demonstrates  a lack  of  understanding  of 
sexual  harassment.  The  behavior  does  not  have  to  be  sexual 
in  nature.  Nor  is  the  intent  of  the  harasser  relevant.  It  is  the 
impact  of  the  action  that  determines  whether  or  not  sexual 
harassment  has  taken  place. 

In  order  for  a behavior  to  be  considered  to  have  created 
a hostile  educational  environment,  four  elements  must  exist. 

• First,  the  harassment  must  be  based  on  a person’s  sex. 

• Second,  the  behavior  must  be  unwelcome  to  the  vic- 
tim. The  victim  must  not  have  solicited  or  incited  the 
offensive  behavior,  and  the  victim  must  regard  the  con- 
duct as  undesirable  or  offensive. 

• Third,  the  offensive  behavior  must  be  sufficiently  se- 
vere or  pervasive  to  alter  conditions  of  the  learning  or 
working  climate  to  interfere  with  a person’s  ability  to 
work  learn,  or  partake  in  the  opportunities  offered  by 
the  institution  by  creating  a hostile  educational  envi- 
ronment. One  off-color  joke  or  comment  will  usually 
not  be  considered  to  be  sexual  harassment. 

• Fourth,  in  order  for  a school  or  university  to  be  liable 
for  sexual  harassment,  it  must  have  known  or  should 
have  known  of  the  harassment  and  failed  to  take  prompt, 
effective,  remedial  action.  Because  the  school  board 
or  university  is  expected  to  control  the  campus  envi- 
ronment, it  is  held  responsible  for  sexual  harassment. 

Title  VII 

Title  VII  of  the  Civil  Rights  Act  of  1964  as  amended 
by  the  Equal  Employment  Opportunity  Act  of  1 972,  the  Preg- 
nancy Discrimination  Act  of  1978  and  the  Civil  Rights  Act 
of  1991  prohibits  private  employers,  state  and  local  govern- 
ments, and  educational  institutions  employing  more  than  15 
individuals  from  discriminating  on  the  basis  of  race,  color, 
religion,  sex  or  national  origin  in  all  aspects  of  employment. 
It  docs  not  cover  students,  other  than  those  employed  by  the 
institution.  The  1972  amendments  permit  employees  and 
applicants  to  file  suit  in  federal  district  court  if  they  arc  not 
satisfied  with  the  employers  disposition  of  their  complaints. 
This  act  covers  all  aspects  of  employment  including  hiring 
and  firing;  compensation,  assignment  or  classification  of 
employees;  transfer,  promotion,  layoff  or  recall;  job  adver- 
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tisements;  recruitment;  testing;  use  of  company  facilities; 
training  and  apprenticeship  programs;  fringe  benefits;  pay, 
retirement  plans  and  disability  leave;  or  other  terms  and 
conditions  of  employment..  As  amended  in  1991,  it  allows 
plaintiffs,  including  those  alleging  sexual  harassment,  to 
sue  for  monetary  damages.  This  act  allows  recovery  of  com- 
pensatory damages  only  in  cases  of  intentional  discrimina- 
tion, and  punitive  damages  only  against  non-public 
employers  who  act  with  malice  or  reckless  indifference.  The 
damages  are  currently  capped  depending  on  the  number  of 
employees,  with  a maximum  of  $300,000.  Title  VII  also 
prohibits  retaliation  against  a person  who  files  a charge  of 
discrimination,  participates  in  an  investigation  or  opposes 
an  unlawful  employment  practice. 

In  1986,  the  Supreme  Court  relied  on  EEOC  guidelines 
when  it  unanimously  held  in  Meritor  Savings  Bank , FSB  v. 
Vinson 6 that  both  quid  pro  quo  and  hostile-environment  sexual 
harassment  are  a subset  of  sex  discrimination  and  are  action- 
able under  Title  VII.  Unwelcome  sexual  advances,  requests 
for  sexual  favors,  and  other  verbal  or  physical  conduct  of  a 
sexual  nature  constitutes  sexual  harassment  when  submission 
to  or  rejection  of  this  conduct  explicitly  or  implicitly  affects 
an  individual's  employment,  unreasonably  interferes  with  an 
individual's  work  performance  or  creates  an  intimidating, 
hostile  oroffensive  work  environment.  According  to  EEOC, 
sexual  harassment  can  occur  in  a variety  of  circumstances, 
including  but  not  limited  to  the  following: 

• The  victim  as  well  as  the  harasser  may  be  a woman  or  a 
man.  The  victim  does  not  have  to  be  of  the  other  sex. 

• The  harasser  can  be  the  victim's  supervisor,  an  agent  of 
the  employer,  a supervisor  in  another  are,  a co-worker, 
or  a non-employee. 

• The  victim  does  not  have  to  be  the  person  harassed  but 
could  be  anyone  affected  by  the  offensive  conduct. 

• Unlawful  sexual  harassment  may  occur  without  eco- 
nomic injury  to  or  discharge  of  the  victim. 

• The  harasser’s  conduct  must  be  unwelcome. 

Harris  v.  Forklift  Systems,  Inc. 

Although,  by  all  accounts,  the  number  of  sexual  harass- 
ment cases  is  rapidly  increasing,  Harris  v.  Forklift  Systems, 
I?ic.\  was  only  the  U.S.  Supreme  Court’s  second  decision 
on  this  issue.  Although  the  Court  did  not  provide  the  hoped 
tests  for  hostile  work  environment  claims,  it  did  clearly  warn 
employers  that  sexual  harassment  will  not  be  tolerated.  This 
case  raised  the  question  of  whether  employees  alleging  sexual 
harassment  on  the  job  must  prove  psychological  injury  in 
order  to  collect  damages  under  Title  VII.  Although  Harris 
had  shown  that  her  boss  subjected  her  to  “a  continuing  pat- 
tern of  sex-based  derogatory  conduct,”  the  Sixth  Circuit 
Court  of  Appeals  dismissed  the  case.*  The  Court  said  she 
was  unable  to  prove  that  the  abuse  affected  her  “psycho- 
logical well-being.” 

In  a unanimous  decision  the  Supreme  court  reversed 
the  lower  court  decision.  The  Court  held  that  a plaintiff 


charging  sexual  harassment  does  not  have  to  prove  psycho- 
logical harm.  The  Court  reminded  employers  of  the  rules  it 
made  in  1 986  in  Meritor  Savings  Bank  v.  Vinson .9  Accord- 
ing to  the  Court,  “sexual  harassment  is  against  the  law  when 
it  is  sufficiently  severe  or  pervasive  to  alter  the  conditions 
of  the  victim’s  employment  and  create  an  abusive  working 
environment.  The  environment  would  be  considered  abu- 
sive if  a “reasonable  person”  would  find  it  objectionable 
and  the  victim  subjectively  found  it  objectionable.  The  Court 
stated  that,  a mere  utterance  of  an  epithet  which  engenders 
offensive  feelings  does  not  violate  Title  VII.  However,  “Title 
VII  comes  into  play  before  the  harassing  conduct  leads  to  a 
nervous  breakdown.” 

The  Court  stated  that  a jury  can  determine  whether  an 
environment  is  “hostile”  or  “abusive”  only  by  considering 
all  of  the  circumstances  that  effect  an  employees  psycho- 
logical well  being.  These  circumstances  would  include: 

• the  frequency  of  the  discriminatory  conduct; 

• its  severity; 

• whether  it  is  physically  threatening  or  humiliating,  or  a 

mere  offensive  utterance;  and 

• whether  it  unreasonably  interferes  with  an  employee’s 

work  performance. 

This  decision  gave  all  employers  a clear  warning  that 
they  are  responsible  if  they  permit  abusive  or  hostile  work 
environments  to  exist.  By  focusing  attention  on  the  work 
environment  rather  that  the  psychological  make-up  of  the 
victim,  this  decision  will  help  victims  of  sexual  harassment. 

The  Court  stated  that  Title  VII  “bars  conduct  that  would 
seriously  affect  a reasonable  person’s  psychological  well- 
being, but  the  statute  is  not  limited  to  such  conduct.  So  long 
as  the  environment  would  reasonably  be  perceived,  and  is 
perceived,  as  hostile  or  abusive,  there  is  no  need  for  it  also 
to  be  psychologically  injurious.”10 

Civil  Rights  Act  of  1 99  J 

Shortly  after  the  Senate  confirmation  hearings  of  Supreme 
Court  Justice  Clarence  Thomas,  Congress  enacted  the  Civil 
Rights  Act  of  1 99 1 for  the  express  purpose  of  providing  addi- 
tional remedies  under  federal  law  to  deter  unlawful  discrimi- 
nation. By  providing  for  compensatory  and  punitive  damages 
relating  to  punishment  and  providing  a trial  by  jury,  this  act 
actually  encourages  suits  charging  sexual  harassment  and 
should  deter  employees  from  discriminating.  In  addition  to 
the  back  pay,  front  pay,  reinstatement,  and  attorneys’  fees  pre- 
viously available  under  Title  VII,  this  act  authorizes  as  much 
as  $300,000  in  compensatory  damages. 

EEOC 

The  U.S.  Equal  Employment  Commission  (EEOC)  en- 
forces Title  VII. 11  EEOC  provides  oversight  and  coordina- 
tion of  all  federal  regulations,  practices  and  policies  affecting 
equal  employment  opportunity.  EEOC  also  develops  poli- 
cies, writes  regulations,  conducts  outreach  and  education 
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efforts,  and  coordinates  all  federal  issuances  affecting  equal 
employment  opportunity,  and  implements  approved  affirma- 
tive employment  programs. 

If  a person  believes  that  he  or  she  has  been  discriminated 
against  under  the  protections  of  Title  VII,  he  or  she  may  file  a 
charge  of  discrimination  with  EEOC.  Although  the  charge 
can  be  filed  in  writing,  by  phone  or  in  person,  there  are  strict 
time  frames  that  must  be  adhered  to.  In  order  for  EEOC  to 
act  and  to  protect  the  right  to  file  a private  lawsuit  charges 
must  be  filed  with  EEOC  within  1 80  days  of  the  alleged  dis- 
crimination. EEOC’s  policy  is  to  seek  full  and  effective  re- 
lief for  each  and  every  victim  of  employment  discrimination, 
whether  sought  in  court  or  in  conciliation  agreements  before 
litigation,  and  to  provide  remedies  designed  to  correct  the 
discrimination  and  prevent  its  recurrence. 

If  the  evidence  shows  there  is  reasonable  cause  to  believe 
discrimination  occurred,  EEOC  then  attempts  to  persuade  the 
employer  to  voluntarily  eliminate  and  remedy  the  discrimina- 
tion. Monetary  damages  may  also  be  available  to  compensate 
for  future  monetary  loss,  mental  anguish  or  pain  and  suffering, 
and  to  penalize  a respondent  who  acted  with  malice  or  reckless 
indifference.  The  employer  may  also  be  required  to  post  a 
notice  in  the  workplace  advising  employees  that  it  has  com- 
plied with  orders  to  remedy  the  discrimination. 

If  efforts  at  conciliation  fails  EEOC  may  consider  the 
case  for  litigation.  Most  charges  are  conciliated  or  settled, 
making  a court  trial  unnecessary.  However,  EEOC  may  then 
file  a lawsuit  in  federal  district  court  on  behalf  of  the  charg- 
ing party.12  As  a result  of  court  action,  the  EEOC  regula- 
tions on  sexual  harassment  have  been  upheld  as  a lawful 
regulatory  interpretation  of  Title  VII  of  the  Civil  Rights  Act 
of  1964,  and  that  sexual  harassment  is  a violation  of  Title 
IX  of  the  Education  Amendments  of  1972. 

Title  IX 

In  the  late  1960s  and  early  1970s  concerned  educators 
and  students  intensified  the  struggle  against  sex  bias  and 
discrimination  in  our  nations  schools  and  universities.  At 
that  lime  Title  VII  specifically  excluded  educational  institu- 
tions from  its  terms.  An  awareness  of  this  exclusion  and  a 
commitment  to  equity  resulted  in  the  passage  of  Title  IX  of 
the  Education  Amendments  of  1972.  The  legislative  his- 
tory of  Title  IX  makes  it  clear  that  Congress  intended  to 
apply  Title  VII  claims  standards  to  Title  IX. 

Title  IX  of  the  Education  Amendments  of  1972  prohib- 
its discrimination  on  the  basis  of  s^x  in  educational  pro- 
grams or  activities  which  receive  federal  financial  assistance. 
Title  IX  covers  both  employees  and  students  and  virtually 
all  activities  of  a university.  The  prohibition  covers  discrimi- 
nation in  employment  of  professors  and  other  university 
personnel  as  well  as  discrimination  in  admissions,  financial 
aid.  and  access  to  educational  programs  and  activities.  Title 
IX  states:  “ No  person  in  the  United  States  shall  on  the  basis 
of  sex  he  excluded  from  participating  in,  be  denied  the  ben- 


efits of  or  be  subjected  to  discrimination  under  any  educa- 
tion program  or  activity  receiving  federal  financial  assis- 
tance. " In  general,  Title  IX  is  enforced  by  the  Department 
of  Education.  Under  Title  IX  students  may  sue  to  collect 
monetary  damages  from  the  school  or  the  school  may  lose 
federal  funds. 

Elementary  and  secondary  school  students  as  well  as 
university  students  are  protected  by  Title  IX  of  the  Educa- 
tion Amendments  of  1 972.  Title  IX  is  one  of  the  most  sweep- 
ing sex  discrimination  laws  ever  passed.  Although  it  had 
little  early  enforcement,  it  is  now  the  primary  tool  that  de- 
fines equal  educational  opportunity  for  women  in  universi- 
ties. Under  Title  IX,  sexual  harassment  is  defined  as  verbal 
or  physical  conduct  of  a sexual  nature,  imposed  on  the  basis 
of  sex,  by  an  employee  or  agent  of  a recipient  that  denies, 
limits,  provides  different,  or  conditions  the  provision  of  aid, 
benefits,  services  or  treatment  protected  under  Title  IX. 

The  courts  look  to  the  principles  developed  under  Title 
VII  when  they  interpret  Title  IX.  Although  Title  IX  law  has 
evolved  slowly,  it  is  clear  that  sexual  harassment  is  sex  dis- 
crimination under  Title  IX.  In  several  recent  Title  IX  cases, 
the  courts  have  continued  to  clarify  how  Title  VII  standards 
apply  to  Title  IX  claims.13  The  first  federal  case  brought 
under  the  auspices  of  Title  IX  dealt  with  quid  pro  quo , hos- 
tile environment  and  appropriate  grievance  procedures.  In 
Alexander  u Yale  the  plaintiff  alleged  that  she  received  a 
low  grade  because  she  refused  to  cooperate  sexually  with 
her  professor.14  Although  leaving  the  other  issues  unde- 
cided, the  Second  Circuit  confirmed  the  right  to  sue  for  quid 
pro  quo  sexual  harassment.  In  two  1986  cases  federal  courts 
allowed  claims  based  solely  on  the  allegation  of  hostile  work 
environments.15  In  the  1992  case  of  Franklin  v.  Gwinnett 
County  Public  Schools f the  Supreme  Court  ruled  that  a 
teacher  who  sexually  harassed  and  abused  a student  was 
engaging  in  sexual  discrimination.  The  Court  allowed  com- 
pensatory damages  as  a remedy  for  the  intentional  violation 
of  Title  IX. 

Office  for  Civil  Rights 

Title  IX  is  enforced  by  the  Office  for  Civil  Rights  (OCR) 
at  the  U.S.  Department  of  Education.  In  August  of  1996 
OCR  wrote  a letter  to  all  school  administrators  confirming 
the  department’s  position  regarding  sexual  harassment  of 
students  in  our  schools.17  This  letter  was  written  in  response 
to  sexual  harassment  that  occurs  during  school  activities  or 
on  school  grounds  by  faculty  members  against  students  and 
by  students  against  other  students. 

The  letter  reported  that  the  OCR  has  investigated  claims 
of  peer  harassment  since  1989  and  in  appropriate  cases, 
found  schools  liable  under  Title  IX.  OCR’s  position  is  con- 
sistent with  United  States  Supreme  Court  precedents  and 
well  established  legal  principles.  On  march  10,  1997  the 
U.S.  Department  of  Education  published  “Sexual  Harass- 
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ment  Guidance:  Harassment  of  Students  by  School  Employ- 
ees, Other  Students,  or  Third  Parties.”18 

By  issuing  this  guidance  the  U.S.  Department  of  Edu- 
cation has  affirmed  that  the  elimination  of  sexual  harass- 
ment of  students  in  public  schools  and  universities  is  a high 
priority.  This  guidance  was  developed  and  disseminated  as 
a result  of  OCR’s  knowledge  that  a significant  number  of 
students,  both  male  and  female,  have  experienced  sexual 
harassment,  that  sexual  harassment  can  interfere  with  a 
student’s  academic  performance  and  emotional  and  physi- 
cal well-being,  and  that  preventing  and  remedying  sexual 
harassment  in  schools  is  essential  to  ensure  nondiscrimina- 
tory,  safe  environments  in  which  students  can  learn.  This 
guidance  makes  it  perfectly  clear  that  OCR  interprets  Title 
IX  of  the  education  amendments  of  1972  (Title  IX)  as  pro- 
hibiting discrimination  on  the  basis  of  sex  in  education  pro- 
grams and  activities  receiving  federal  financial  assistance. 
This  prohibition  is  based  on  the  fact  that  OCR.  has  long 
recognized  that  sexual  harassment  of  students  engaged  in 
by  school  employees,  other  students,  or  third  parties  is  cov- 
ered by  Title  IX.  OCR’s  policy  and  practice  is  consistent 
with  the  Congress'  goal  in  enacting  Title  IX.  OCR  also 
believes  their  guidance  is  consistent  with  United  States  Su- 
preme Court  precedent  and  well-established  legal  principles 
that  have  developed  under  Title  IX,  as  well  as  under  the 
related  anti-discrimination  provisions  of  Title  VI  and  Title 
VII  of  the  Civil  Rights  Act  of  1964. 

According  to  the  Title  IX  regulation  each  institution 
must  provide  a grievance  procedure  for  sex  discrimination. 
Title  IX’s  protection  against  sexual  harassment  covers  pro- 
spective students,  students,  and  employees  of  programs 
which  are  operated  by  the  university.  Thus  employees,  in- 
cluding student  employees  may  file  under  both  Title  VII  and 
Title  IX.  Title  IX  coverage  also  extends  to  other  programs 
that  receive  significant  assistance  or  are  considered  part  of 
a school’s  curriculum. 

OCR  can  conduct  compliance  reviews  on  its  own  ini- 
tiative, and  is  required  to  conduct  a prompt  investigation 
whenever  a complaint  is  filed.  If  after  an  investigation  is 
conducted  OCR  determines  that  sexual  harassment  has  taken 
place  it  attempts  to  secure  voluntary  compliance  from  the 
institution.  OCR  does  have  the  authority  to  institute  pro- 
ceedings to  suspend  or  tenninate  federal  assistance  or  bar 
future  assistance  but  rarely  does  so.  It  may  also  request  the 
Department  of  Justice  initiate  court  action. 

Unlike  Title  VII  there  is  no  award  cap  placed  on  Title 
IX  awards.  In  the  case  of  a student  complaint,  the  court  may 
award  money  damages  to  cover  such  things  as  pain  and  suf- 
fering, emotional  distress,  attorney’s  fees,  and  the  cost  of 
past,  present  and  future  therapy.  The  court  may  also  re- 
quire the  school  district  or  university  to  initiate  or  change  its 
policy  and  develop  training  programs.  It  may  also  require 
the  school  district  or  university  to  waive  various  time  limits 
for  degree  completion  and/or  provide  tuition  refunds. 


In  the  case  of  an  employee  complaint,  the  court  may  re- 
quire the  school  district  or  university  to  reinstate  or  promote 
the  employee,  pay  back  wages,  etc.  It  may  also  award  money 
damages  to  cover  lost  wages,  attorney  fees  and  therapy. 

Consensual  Relationships 

The  discussion  of  quid  pro  quo  in  the  university  setting 
raises  questions  regarding  consensual  sexual  relationships 
and  is  the  focus  of  much  debate.  Sexual  activity  between 
two  consenting  adults  is  not  specifically  prohibited  by  ei- 
ther Title  VII  nor  Title  IX.  Although  not  illegal  in  the  work- 
place, a number  of  universities  are  developing  policies  that 
attempt  to  regulate  such  behavior  when  it  occurs  between  a 
faculty  member  and  a student. 

As  early  as  1 97 1 courts  began  to  acknowledge  that  there 
were  inherent  problems  associated  with  professor-student 
sexual  relationships.  In  the  case  of  Board  of  Trustees  v. 
Stubblefield iy  the  court  recognized  that,  “Certain 
professions.. .impose  upon  persons  attracted  to  them,  respon- 
sibilities and  limitations  on  freedom  of  action  which  do  not 
exist  in  regard  to  other  callings.  Public  officials  such  as 
...school  teachers  fall  into  such  a category.”  This  court  went 
on  to  say  that,  “The  integrity  of  the  educational  system  un- 
der which  teachers  wield  considerable  power  in  the  grading 
of  students  and  the  granting  or  withholding  of  certificates 
and  diplomas  is  clearly  threatened  when  teachers  become 
involved.in  relationships  with  students.” 

In  1984,  the  Seventh  Circuit  indicated  that  when  deter- 
mining if  a professor  had  engaged  in  sexual  harassment  the 
“conduct  is  not  to  be  viewed  in  the  same  context  as  would 
conduct  of  an  ordinary  ‘person  on  the  street.’  Rather,  it  must 
be  judged  in  the  context  of  the  relationship  existing  be- 
tween a professor  and  his  students  within  an  academic  envi- 
ronment. University  professors  occupy  an  important  place 
in  our  society  and  have  concomitant  ethical  obligations.”20 

Zalk,  Dederich  & Paludi  correctly  identified  the  bot- 
tom line  as  one  of  power,  “...the  faculty  members  have  it 
and  the  student  does  not.”21  This  power  imbalance  must  be 
kept  in  mind  when  discussing  amorous  relationship  policies 
because  even  with  the  consent  of  both  parties  may  be  dam- 
aging to  the  educational  process.  The  stated  purpose  of  con- 
sensual relationship  policies  is  to  protect  students  and  junior 
faculty  members  from  being  exploited  by  senior  faculty 
members.  These  policies  attempt  to  ensure  that  grading 
policies  are  fair  and  that  students  are  not  coerced  into  sexual 
relationships.  The  American  Association  of  University  Pro- 
fessors (AAUP)  cautions  faculty  members  and  staff  against 
entering  romantic  or  sexual  relationships  with  their  students. 
They  also  warn  supervisors  against  entering  such  relation- 
ships with  an  employee.  “Faculty  and  staff  should  be  cau- 
tious in  assuming  professional  responsibilities  for  those  with 
whom  they  have  an  existing  romantic  relationship.”” 

The  policies  that  seem  to  generate  the  least  controversy, 
and  provide  the  least  protection  from  abuse,  arc  those  that  are 
advisory  in  nature.  These  policies  simply  suggest  that  faculty 
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and  students  not  become  romantically  involved.  A few  re- 
quire that  those  faculty  members  or  staff  engaged  in  romantic 
relationships  with  someone  for  whom  they  have  professional 
responsibility  must  report  the  relationship  to  their  superior  so 
that  an  alternate  means  of  performing  the  professional  respon- 
sibility can  be  devised.  A more  controversial  policy  is  one 
that  prohibits  sexual  relationships  between  faculty  and  those 
over  whom  they  have  grading  authority. 

The  policies  that  include  a broad  prohibition  on  sex 
between  faculty  and  students  generate  the  most  controversy. 
These  policies  provide  a great  amount  of  protection  to  stu- 
dents and  protect  the  integrity  of  the  grading  system.  How- 
ever, some  argue  that  they  are  too  stringent  and  substantially 
interfere  with  the  right  of  people  to  become  romantically 
involved  with  the  person  of  their  choice.  Those  who  argue 
against  such  policies  raise  issues  of  individual  rights  to  pri- 
vacy, freedom  of  association,  and  the  civil  right  to  engage  in 
intimate  relationships  without  governmental  interference. 
Keller  and  others  argue  that  “outside  the  instructional  con- 
text, the  presumption  that  an  intimate  faculty-student  rela- 
tionship results  from  coercion  cannot  be  justified.”23  The 
policy  generated  the  most  debate  is  the  one  adopted  by  the 
board  of  trustees  of  Antioch  College,  Yellow  Springs,  Ohio. 
Their  policy  declares  that  sexual  relations  between  faculty 
and  students  are  unacceptable  and  constitute  professional 
misconduct. 

Because  of  the  special  relationship  between  the  univer- 
sity and  the  student,  universities  have  a duty  to  protect  stu- 
dents from  sexual  abuse  by  faculty  members.  Consensual 
relationships  between  faculty  members  and  students  or  be- 
tween senior  faculty  and  junior  faculty  or  between  supervi- 
sors and  subordinates  present  potential  problems  for  the 
university.  These  relations  may  be  based  on  mutual  attrac- 
tion, however  these  people  often  do  not  hold  equal  posi- 
tions of  power.  If  and  when  the  relationship  ends  there  may 
be  charges  of  coercion,  intimidation  or  blackmail. 

Consensual  relationships  also  raise  the  issue  of  fairness. 
If  a consensual  relationship  exists  between  a professor  and 
one  of  his  or  her  students,  it  is  reasonable  for  other  students 
to  wonder  if  their  grade  is  dependent  on  their  personal  rela- 
tionship with  the  professor.  It  is  also  likely  that  the  student 
involved  in  the  relationship  may  come  to  question  his  or  her 
own  academic  abilities.  Universities  may  want  to  explore 
the  possibility  of  developing  policies  covering  consensual 
relationships.  Absent  such  policies,  it  is  unlikely  that  the 
university  will  be  able  to  discipline  a faculty  member  for 
entering  into  a consensual  relationship. 

The  Concept  of  Welcomeness 

In  the  Meritor  decision,  the  U.S.  Supreme  Court  ruled 
that  sexual  harassment  violates  Title  VII  if  it  creates  a hos- 
tile or  offensive  environment  for  the  victim,  regardless  of 
whether  it  threatened  the  individual's  job.  Although  the 
Meritor  decision  was  based  on  Title  VII,  Title  IX  cases  will 
likely  follow  the  same  judicial  reasoning.  In  the  educational 
setting,  this  means  that  in  addition  to  faculty-to-sludent  sexual 


harassment,  student-to-sludent  initiated  unwelcome  sexual 
advances,  requests  for  sexual  favors,  and  other  verbal  or 
physical  conduct  of  a sexual  nature  may  constitute  sexual 
harassment.  This  is  an  unsettled  area,  with  some  courts  stat- 
ing that  schools  are  responsible  for  the  actions  of  third  par- 
ties and  other  circuits  stating  that  schools  are  not  responsible 
for  the  action  of  third  parties.  It  must  be  noted  that  unwel- 
come sexual  attention  toward  a faculty  member  by  a student 
is  also  sexual  harassment. 

Remarks  that  simply  offend  a person’s  feelings  are  usu- 
ally not  considered  to  be  sexual  harassment.  However,  if 
the  offending  behavior  is  severe  or  pervasive  enough  to  ac- 
tually affect  a student’s  educational  environment,  then  it  may 
be  sexual  harassment.  In  this  context  there  is  a clear  differ- 
ence between  welcome  and  voluntary.  For  example,  even 
if  an  alleged  victim  agreed  to  participate  in  sexual  intimacy, 
the  sexual  advances  are  a prohibited  form  of  sexual  harass- 
ment if  it  is  clear  that  the  victim  did  not  desire  to  have  the 
sexual  relationship,  but  capitulated  under  pressure. 

Because  the  1980  EEOC  guidelines  do  not  define  “un- 
welcome,” we  must  look  to  various  court  cases  in  order  to 
understand  the  difference  between  a voluntary  activity  and 
a welcome  activity.  In  the  Meritor  case  the  victim  claimed 
that  she  initially  refused  the  sexual  advances  of  her  supervi- 
sor, but  she  eventually  gave  in  and  engaged  in  sexual  inter- 
course out  of  fear  of  losing  her  job.  The  Supreme  Court 
ruled  that  her  participation  in  a sexual  relationship  did  not 
establish  that  the  relationship  was  truly  consensual  or  wel- 
come. The  Court  ruled  that  “the  fact  that  the  sex-related 
conduct  was  voluntary,  in  the  sense  that  the  complainant  was 
not  forced  to  participate  against  her  will,  is  not  a defense  to 
a sexual  harassment  suit  brought  under  Title  VII.”  Chal- 
lenged conduct  must  be  unwelcome  in  the  sense  that  the  em- 
ployee did  not  solicit  or  incite  it,  and  in  the  sense  that  the 
employee  regarded  the  conduct  as  undesirable  or  offensive. 

Rights  of  Those  Accused  of  Sexual  Harassment 

Schools  and  universities  have  an  affirmative  duty  to 
ensure  a safe  environment  to  learn  and  work.  Sexual  ha- 
rassment seriously  interferes  with  a victim  by  discriminat- 
ing against  him  or  her  on  the  basis  of  sex.  However,  as  with 
most  personnel  issues,  there  are  substantive  and  procedural 
due  process  rights  that  must  be  protected.  As  schools  and 
universities  promulgate  and  enforce  policies  prohibiting 
sexual  harassment  they  must  ensure  that  the  rights  of  both 
the  alleged  victim  and  the  alleged  harasser  are  protected.  In 
a number  of  cases  involving  charges  of  sexual  harassment, 
sanctions  against  the  alleged  harasser  have  been  called  into 
question  because  either  the  policy,  or  the  process  of  investi- 
gation, or  the  type  of  sanction  violated  either  a contractual 
or  due  process  right.24 

The  Intersection  of  Sexual  Harassment  and 
Academic  Freedom 2S 

Any  effort  to  regulate  the  speech  of  students  or  profes- 
sors must  consider  how  to  distinguish  sexual  harassment  from 
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speech  protected  by  the  First  Amendment.  Most  incidents 
of  quid  pro  quo  sexual  harassment  deal  with  the  conduct  of 
the  alleged  harasses  However,  many  incidents  of  hostile 
environment  sexual  harassment  deal  with  speech  that  in  an- 
other context  may  not  be  seen  as  not  obscene,  defamatory, 
“fighting”  words  or  otherwise  disruptive.  However,  speech 
not  involving  vandalism  or  “fighting  words”  present  a more 
difficult  problems  for  university  officials.  MacKinnon  and 
Dworkin  content  that  sexist  speech  is  not  protected  in  the 
workplace.26  They  claim  that  those  who  protect  such  speech 
“value  speech  in  the  abstract.”  Content,  form,  context,  and 
effect  are  the  critical  issues  to  assist  the  university  in  deter- 
mining what  constitutes  sexual  harassment.  The  American 
Association  of  University  Professors  interprets  academic 
freedom  to  mean  that  “[The]  teacher  is  entitled  to  full  free- 
dom in  research  and  in  the  publication  of  results.”27 

To  determine  if  a hostile  working  environment  exists, 
the  US  Supreme  Court  in  Harris  v Forklift  Systems  said  the 
test  is  whether  the  conduct  in  question  is  severe  or  pervasive 
enough  that:  a reasonable  person  would  find  it  created  an 
objectively  hostile  or  abusive  work  environment  that  altered 
the  conditions  of  the  victim’s  employment,  and  the  victim 
perceives  that  the  environment  is  abusive  According  to  the 
Harris  Court , if  the  workplace  is  permeated  with  discrimi- 
natory intimidation,  ridicule,  and  insult  that  is  sufficiently 
severe  or  pervasive  to  alter  the  conditions  of  the  victim’s 
employment,  actionable  sexual  harassment  has  occurred. 
This  court  went  on  to  say  that  conduct  that  alters  work  con- 
ditions includes  that  which  detracts  from  employees’  job 
performance,  discourages  employees  from  remaining  on  the 
job,  or  keeps  them  from  advancing  in  their  careers. 

Conduct  that  is  merely  offensive,  such  as  the  mere  utter- 
ance of  an  epithet  which  engenders  offensive  feelings  in  an 
employee,  is  not  actionable  sexual  harassment.  According  to 
the  Harris  no  one  single  factor  must  be  present  to  find  action- 
able abusive  or  hostile  environment  workplace  sexual  harass- 
ment. Such  harassment  can  only  be  determined  by  looking  at 
surrounding  circumstances  such  as:  a)  The  frequency  of  the 
discriminatory  conduct,  b)  its  severity,  c)  whether  it  is  physi- 
cally threatening  or  humiliating,  or  a mere  offensive  utterance, 
d)  whether  it  unreasonably  interferes  with  an  employee’s  work 
performance,  and  c)  the  effect  on  the  employee’s  psychologi- 
cal well-being,  which  is  relevant  to  whether  the  victim  actually 
found  the  environment  abusive. 

In  examining  questions  of  academic  freedom  in  the  class- 
room it  must  be  remembered  that  academic  free  lorn  does 
not  protect  classroom  speech  that  is  unrelated  to  the  subject 
matter  at  variance  with  the  prescribed  curriculum,  or  in  vio- 
lation of  federal  or  state  anti-discrimination  laws.  Such 
speech  can  be  the  reason  for  discipline  or  termination.28 
Further,  speech  that  disrupts  the  educational  environment  is 
not  protected  by  academic  freedom.  Academic  freedom  is 
not  a valid  defense  for  non-coopcrativc  and  aggressive  be- 
havior. An  institution  can  discipline  a faculty  member  for 
such  actions.29  Academic  freedom  is  also  not  a license  for 
activity  at  variance  with  job-related  procedures  and  require- 
ments, nor  docs  it  encompass  activities  which  are  internally 
destructive  to  the  proper  function  of  the  university  or  dis- 
ruptive to  the  education  program.'0 


In  the  case  of  an  investigation  by  the  EEOC,  the  uni- 
versity does  not  enjoy  a special  privilege,  grounded  in  the 
First  amendment  right  of  academic  freedom,  to  prevent  the 
EEOC,  from  having  access  to  confidential  peer  review  ma- 
terials.31 The  EEOC  and  other  governmental  agencies  may 
regulate  First  Amendment  Rights  if  they  can  demonstrate  a 
compelling  governmental  interest  to  do  so.32  And  the  U.S. 
Supreme  Court  has  previously  determined  that  the  elimina- 
tion of  sex  discrimination,  of  which  sexual  harassment  is  a 
subset,  is  a compelling  governmental  interest.33 

In  a widely  reported  decision  discussing  academic  free- 
dom and  sexual  harassment  allegations,  a federal  district 
court  judge  ruled  in  favor  of  a tenured  professor  on  a mo- 
tion for  a preliminary  injunction  and  enjoined  a public  uni- 
versity from  suspending  him  for  his  sexually  laden  lecture 
comments  that  had  triggered  complaints  from  female  stu- 
dents.34 The  Silva  Court  cited  with  approval  the  test  in 
Mailloux  v Kiley ,35  for  determining  the  validity  of  govern- 
mental regulation  affecting  a teacher’s  classroom  speech. 
Mailloux  said  that  free  speech  does  not  grant  teachers  a li- 
cense to  say  or  write  in  class  whatever  they  may  feel  like 
and  that  the  propriety  of  regulations  or  sanctions  must  de- 
pend on  such  circumstances  as:  a)  the  age  and  sophistica- 
tion of  the  students,  b)  the  relationship  between  teaching 
method  and  valid  educational  objective,  and  c)  the  context 
and  manner  of  presentation. 

Because  the  students  in  the  Silva  case  were  exclusively 
adult  college  students,  the  court  ruled  that  the  classroom 
statements  advanced  the  valid  educational  objective  of  con- 
veying certain  principles  related  to  the  subject  matter  of  the 
course,  and  they  were  made  in  a professionally  appropriate 
manner  as  part  of  the  college  class  lecture.  The  court  further 
found  that  the  University’s  sexual  harassment  policy  was  not 
reasonably  related  to  the  legitimate  pedagogical  purpose  of 
providing  a congenial  academic  environment  because  it  em- 
ployed an  impermissible  subjective  standard  that  failed  to  take 
into  account  the  nation's  interest  in  academic  freedom. 

Defenses  Against  Charges  of  Sexual  Harassment 

Defenses  against  charges  of  sexual  harassment  that  have 
been  successful:  1 ) no  harassment  occurred,  2)  any  advances 
that  took  place  were  solicited,  incited  or  encouraged,  3)  the 
harassment  was  not  sufficiently  severe  or  pervasive  to  alter 
the  conditions  of  employment  and  create  an  abusive  environ- 
ment. Schools  and  universities  are  expected  to  eliminate  sexual 
harassment  if  they  knew  or  should  have  know  of  its  existence. 
Some  universities  have  argued  that  they  had  no  knowledge  of 
the  harassment  and  there  was  a grievance  avenue  for  claims. 
Another  defense  used  is  that  they  took  prompt  remedial  ac- 
tion as  soon  as  they  learned  of  the  situation. 

Conclusion 

Society  and  the  courts  are  asking  school  and  ui  iversity 
officials  to  balance  the  claims  of  freedom  and  responsibility 
on  the  campus.  The  break  down  of  civility  in  our  society  is 
a trend  that  is  evident  at  all  levels  of  education.  Abusive 
language,  sexual  misconduct  and  sexual  assault  are  oeeur- 
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ring  more  and  more  frequently.  Sex  discrimination,  although 
diminishing,  still  persists. 

The  existence  of  sexual  harassment  on  campus  under- 
mines the  integrity  of  education.  I do  not  wish  to  suggest 
that  schools  and  universities  have  been  unresponsive  to  the 
new  realities  of  sexual  harassment.  Many  institutions  have, 
in  recent  years,  made  serious  efforts  to  respond  to  these  ques- 
tions. Many  are  shaping  new  codes  of  conduct.  However 
much  needs  to  be  done  before  schools  and  universities  rees- 
tablish an  environment  of  courtesy  and  civility  necessary  in 
order  for  learning  to  take  place. 

All  schools  and  universities  must  make  preventing  sexual 
harassment  a high  priority.  The  first  step  in  this  process  is  to 
ensure  that  their  is  a clear  written  policy  stating  that  sexual 
harassment  will  not  be  tolerated,  that  all  students  and  em- 
ployees have  the  right  to  study  and  work  free  of  fear,  intimi- 
dation and  harassment.  In  addition  to  defining  sexual 
harassment  these  policies  must  define  the  rights  of  the  vic- 
tims and  accused.  All  employees  and  students  must  know 
what  their  options  are  if  they  perceive  that  they  have  been 
sexually  harassed.  There  also  must  be  a well  designed  griev- 
ance procedure  that  will  deal  with  faculty  and  student  mis- 
conduct. Schools  and  universities  must  ensure  adequate 
training  takes  place  so  that  all  employees  and  students  know 
and  understand  the  policy.  Prompt  and  through  investigat- 
ing protocols  must  be  in  place  and  investigators  must  be 
adequately  trained. 
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dents’ Assessment  of  Consensual  Relationships  With 
Their  Professors:  Ivory  Power  Reconsidered.”  In  Aca- 
demic and  Workplace  Sexual  Harassment:  A Resource 
Manual,  edited  by  M.A.  Paludi  & R.B.  Barickman,  99- 
111.  Albany:  State  University  of  New  York  Press. 


1 o A 


16 


Mid  Western  Educational  Researcher 


Volume  11,  Number  I Winter  1998 
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Conference  Highlights 


Mid-Western  Educational  Research  Association  1997  Conference 

Thomas  S.  Parish,  Prote“am  Chair 
Kansas  State  University 


Well,  the  1997  MWERA  Convention  is  now  a part  of 
history.  The  task  that  remains  is  for  the  highlights  of  the 
meeting  to  be  shared  in  this  short  article.  Sounds  simple, 
but  it  really  isn’t.  You  see,  the  1997  MWERA  Meeting  was 
very,  very  special  to  me  because  of  the  opportunity  I had  to 
work  closely  with  so  many  of  you,  and  for  that  reason  I 
would  like  to  share  some  of  my  thoughts  with  you  regard- 
ing what  I saw,  heard,  and  felt. 

To  begin  with,  each  of  the  division  chairs  worked  dili- 
gently in  order  to  set  up  theirrespective  portions  of  the  pro- 
gram. I cannot  say  enough  about  their  devotion  to  seeing 
their  tasks  through  to  completion,  and  how  well  they  worked 
with  me  to  bring  the  convention  program  together.  I was  so 
positively  impressed  with  their  combined  efforts  that  I dedi- 
cated the  1997  MWERA  Book  of  Abstracts  to  them  in  an 
attempt  to  recognize  them  and  their  endeavors  toward  mak- 
ing the  annual  meeting  a great  success. 

Others,  too,  made  great  efforts  to  make  our  annual  meet- 
ing successful.  First,  and  foremost,  was  Jean  Pierce,  the 
Executive  Officer.  How  fortunate  we  are  to  have  someone 
like  her  who  is  so  personable,  patient,  and  poised.  Through- 
out the  months  of  preparation  for  the  meeting,  and  during 
the  meeting  itself,  she  continually  maintained  a friendly  and 
kind  demeanor.  Truly,  she  deserves  to  be  thanked  for  her 
endless  good  deeds  on  everyone’s  behalf. 


Unfortunately,  space  will  not  permit  me  to  acknowledge 
everyone’s  gracious  contributions,  but  I must  say  that  the 
annual  meeting’s  success  could  not  have  been  possible  with- 
out the  efforts  of  Sharon  McNeely,  Adria  Karl-Weiss,  Kim 
Metcalf,  and  Linda  Bakkan.  Each  of  these  individuals  went 
well  beyond  their  call  of  duty  when  it  came  to  helping  orga- 
nize and  coordinate  our  annual  meeting  that  was  once  again 
held  at  the  Holiday  Inn  at  the  Mart  Plaza  in  Chicago,  Illinois. 

The  1997  Annual  Meeting  of  the  Mid- Western  Educa- 
tional Research  Association  deserves  many  accolades,  and 
for  many  reasons.  First  of  all,  it  had  some  really  wonderful 
invited  speakers.  For  instance,  three  noted  educational 
scholars  shared  their  respective  insights  with  those  in  atten- 
dance at  this  year’s  meeting.  Dr.  Robert  Shoop  provided 
helpful  hints  regarding  how  to  prevent  sexual  harassment 
and  things  we  can  do  in  order  to  avoid  being  sexually  ha- 
rassed, while  Dr.  Jack  Levin  discussed  the  growing  concern 
over  violence  in  every  segment  of  our  society,  including 
our  schools.  Dr.  James  Boyer  then  shared  his  view  of  our 
nation’s  demographic  future,  and  how  research  efforts  need 
to  be  adjusted  so  that  they  will  more  likely  correspond  with 
the  changes  occurring  in  our  society.  All  three  invited  speak- 
ers were  very  well  received,  and  all  three  speakers  indi- 
cated to  me  that  they  were  equally  well  pleased  with  the 
members’  receptivity  to  their  remarks. 
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Besides  the  Association’s  invited  speakers,  many  of  the 
divisions  invited  speakers  too.  Division.A,  for  instance,  had 
two  invited  speakers.  Dr.  Theodore  Kowalski  spoke  on  the 
need  for  enhancing  communication  skills  in  the  context  of 
school  reform,  while  Dr.  Paul  Baker  discussed  the  leadership 
challenge  associated  with  various  school  reform  issues.  Re- 
garding other  divisions’  invited  speakers.  Division  J had  Molly 
Baker  examine  the  technology  currently  in  use  in  higher  edu- 
cation, while  Division  E had  Gloria  Smith  discuss  ways  to 
foster  more  multi  cultural  perspectives  within  education  to- 
day. Finally,  Division  D had  Dr.  James  Impara  describe  ways 
to  set  standards  through  using  Angoff’s  method.  Though  each 
of  these  presentations  were  generally  directed  at  specific  di- 
visional foci,  it  certainly  seemed  that  all  who  attended  these 
sessions  came  away  with  what  they  wanted,  whether  or  not 
they  were  members  of  the  respective  divisions. 

In  addition  to  various  notable  invited  speakers,  the  1997 
MWERA’s  annual  conference  offered  various  special  ses- 
sions that  the  membership  could  also  attend.  For  instance, 
Dr.  Jean  Pierce  pulled  together  two  highly  revered  profes- 
sional panels  in  order  to  consider  two  key  issues  in  educa- 
tion today,  i e.,  (I)  the  effects  of  educational  policies  upon 
the  motivation  of  teachers  and  students,  and  (2)  ways  of  form- 
ing collaborative  partnerships  among  teachers  and  research- 
ers. In  addition,  other  special  sessions  offered  various 
options  ranging  from  meeting  with  the  editors  of  the  Mid- 
Western  Educational  Researcher  to  ways  that  playing  cards 
could  be  used  in  the  teaching  of  statistics. 

MWERA’s  1997  Annual  Conference  was  further  ben- 
efitted  by  other  features  too.  For  instance,  the  round  table 
presentations  seemed  to  be  very  well  attended,  and  certainly 
provided  researchers  with  ample  opportunities  to  explain 


their  findings  to  interested  individuals  via  this  highly  inter- 
active format.  Furthermore,  there  were  certain  intangibles 
that  must  be  cited  too.  Specifically,  it  seemed  as  though 
everyone  really  enjoyed  the  sessions  they  attended,  and  also 
enjoyed  being  with  one  another.  In  fact,  it  seemed  to  me 
that  this  was  more  like  a family  reunion  in  some  respects 
because  of  the  pleasantness  that  seemed  to  prevail  among 
those  who  were  in  attendance  at  the  meeting.  Having  been 
to  meetings  that  were  highly  critical  and  seemed  to  detract 
from  its  presenters,  I was  greatly  pleased  that  this  was  not 
the  case  at  our  conference.  Yes,  everyone  seemed  to  help  or 
share  with  one  another,  and  that  was  an  incredible  plus  for 
me.  So  much  so,  that  I will  never  forget  how  much  I en- 
joyed being  at  this  meeting,  and  I am  already  eager  to  attend 
the  next  one  in  1998. 

Incidentally,  be  sure  that  you  make  your  reservations  at 
the  Holiday  Inn-Mart  Plaza  before  the  deadline  next  year 
since  many  members  are  bringing  their  families  and  friends 
with  them  (in  order  to  attend  our  meeting  and/or  enjoy  the 
sights  associated  with  Chicago’s  loop).  Consequently,  space 
may  once  again  be  very  difficult  to  find  once  the  allotted 
rooms  are  assigned.  So  start  planning  now  to  join  us,  and 
don’t  be  late,  because  our  meeting  is  sure  to  be  great  in  ‘98. 
The  bottom  line,  of  course,  is  that  “U”  are  very  important  to 
US.  In  fact,  we  can’t  even  be  S_CCESSFJL  without  “U”. 
So  contact  Dr.  Jeffrey  B.  Hecht  at  Campus  Box  5900,  Illi- 
nois State  University,  Normal,  Illinois  61790-5900,  if  you 
would  like  to  be  involved  in  any  way  with  next  year’s  excit- 
ing MWERA  Conference.  Jeff  is  the  new  Vice  President  of 
the  association,  and  will  personally  direct  the  development 
of  next  year’s  program. 


Tom  Parish,  Conference  Chair 


Jeff  Hecht,  1998  Conference  Chair 
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President’s  Report 

Kim  K.  Metcalf 
Indiana  University 


On  behalf  of  the  officers  and  Board  of  Directors  of 
MWERA,  let  me  wish  you  a happy  and  safe  1998. 1 hope 
that  this  finds  each  of  you  well  into  a productive  and  re- 
warding academic  year. 

As  many  of  you  know,  MWERA  is  in  the  midst  of  a 
period  of  necessary  change.  Our  colleagues  and  prede- 
cessors have  done  a remarkable  job  of  guiding  us  in  25 
years  of  tremendous  growth.  Through  their  wisdom  we 
are  undoubtedly  among  the  largest  and  most  active  re- 
gional professional  organizations  associated  with  AERA. 
For  most  of  us,  our  professional  “roots”  were  established 
through  MWERA  early  in  our  careers  or  in  graduate 
school.  Personally,  I clearly  remember  my  first  MWERA 
conference  as  a graduate  student.  The  thought  of  pre- 
senting my  own  work  to  a group  of  colleagues,  many  of 
whom  were  among  those  whose  works  I had  read  in  my 
studies,  was  incredibly  intimidating.  However,  from  the 
moment  I arrived  at  the  memorable  Bismark,  I was  struck 
by  the  hospitality  and  support  I felt.  In  fact,  it  was  at  this 
and  future  MWERA  conferences  that  I first  began  to  get 
to  know  my  more  experienced  colleagues  and  mentors 
not  just  as  scholars,  but  as  people  and  friends. 

It  has  been  this  environment  of  professional  and  per- 
sonal support  that  has  helped  MWERA  grow  and  thrive 
over  the  years.  And,  I would  argue,  it  is  this  environment 
that  can  enable  us  to  continue  to  thrive  as  an  active,  valu- 
able professional  organization.  However,  our  task  is  per- 
haps more  difficult  now  than  ever  before.  Our  universities 
and  employers  continue  to  reduce  the  support  they  pro- 
vide for  professional  conference  travel;  graduate  students 
and  early  career  faculty  are  forced  to  make  difficult 
choices  about  the  professional  organizations  they  will  join; 
and  the  professional  benefits  of  conference  participation 
are  valued  less  and  less  in  the  merit,  promotion  and  ten- 
ure process.  Thus,  while  we  are  confident  of  the  quality 
of  our  organization  and  of  the  professional  and  personal 
benefits  it  can  have,  it  is  imperative  that  we  work  harder 
than  ever  to  inform  our  non-members  of  the  benefits  of 
MWERA  membership  and  participation. 

As  an  organization,  we  have  emphasized  the  very  rea- 
sonable cost  of  MWERA  membership  and  of  our  annual 
meeting,  particularly  for  graduate  students.  Certainly, 
there  are  few  if  any  professional  organizations  that  can 
boast  of  such  low  membership  costs.  But  at  a time  when 
our  students  and  early  career  colleagues  are  forced  to 
choose  to  participate  in  only  a small  few  of  the  many  pro- 
fessional organizations  that  they  might,  we  absolutely 
must  ensure  that  MWERA  is  not  only  inexpensive,  but  a 
good  investment  in  their  professional  future.  We  offer 


our  early  career  colleagues  a variety  of  professional  op- 
portunities that  they  are  unlikely  to  be  afforded  through 
most  other  professional  organizations:  an  open,  acces- 
sible, and  supportive  annual  conference,  publication  op- 
portur.  ities  in  our  regional  journal,  almost  immediate 
opportunities  for  becoming  formally  involved  in  the  or- 
ganization through  the  journal,  the  conference,  and  the 
executive  committee,  and  a small,  close-knit  network  of 
established  and  emerging  scholars  throughout  the  midwest 
and  Canada. 

In  spite  of  our  amazingly  affordable  dues  and  the  pro- 
fessional value  we  can  offer,  these  attributes  only  draw  new 
members  when  our  colleagues  and  students  are  aware  of 
them.  I am  confident  that  each  of  us  believes  strongly  in 
the  value  of  our  organization.  We  each  have  our  own  rea- 
sons, but  we  share  a commitment  to  and  love  of  MWERA. 
But,  I wonder  if  we  may  mistakenly  take  for  granted  that 
others  will  see  the  value  of  MWERA  participation  as  eas- 
ily as  we  do.  For  students  and  colleagues  who  are  not  fa- 
miliar with  MWERA,  it  may  be  easy  to  assume  that  their 
limited  professional  time  and  energy  may  be  more  effi- 
ciently invested  in  one  of  the  many  other  organizations  to 
which  they  are  invited.  It  is  up  to  us,  those  who  know 
MWERA  and  who  are  committed  to  its  continued  success, 
to  make  the  personal  contact  with  our  colleagues  that  can 
help  them  see  the  value  of  the  organization. 

During  the  coming  year,  I challenge  each  of  us  strive 
to  promote  MWERA  in  two  ways.  First,  let  us  explicitly 
work  to  make  known  to  our  students  and  colleagues  the 
important  and  unique  benefits  that  MWERA  membership 
can  provide  them.  Let's  help  them  see  the  opportunities 
for  presenting,  publishing,  networking,  and  participating 
that  we  can  provide,  but  that  few  other  professional  orga- 
nizations can.  Second,  let  us  realize  that  we  are  no  longer 
a small  group  of  well  acquainted  friends  who  assume  the 
value  of  our  organization,  who  meet  each  year  as  much 
for  social  as  for  professional  reasons.  In  order  to  remain 
viable,  we  must  accept  that  our  future  depends  on  the  long- 
term and  active  participation  of  young  scholars  who  work 
in  a rapidly  changing,  ever  more  competitive  professional 
context.  While  maintaining  the  supportive,  nurturing 
environment  MWERA  is  known  for,  let  us  continue  to 
improve  the  statpre,  visibility,  and  integrity  of  MWERA. 
Doing  so  will  allow  another  MWERA  to  experience  an- 
other 25  years  of  growth  and  success  and  allow  another 
generation  of  scholars  to  experience  the  same  feelings  of 
collegiality  and  pride  that  we  have  felt  as  members  of 
MWERA. 
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Mid-Western  Educational  Research  Association 

1998  Annual  Meeting  Call  for  Proposals 

PROPOSAL  DEADLINE:  APRIL  1, 1998 

October  14  - 17, 1998  Jeffrey  B.  Hecht,  Program  Chair 

Holiday  Inn  Mart  Plaza,  Chicago,  IL  http://tierlab.ilstu.edu/MWERA-98 


The  1998  Annual  Meeting  of  the  Mid-Western  Educational  Research  Association  (MWERA)  will  return  to  Chicago  with 
an  exciting  program  of  invited  speakers,  focused  workshops,  peer-reviewed  papers  presented  in  a variety  of  session 
formats,  and  activities  for  participants  and  their  families.  The  1998  program  will  feature  speakers  of  interest  to  anyone 
involved  in  education,  with  talks  and  follow-up  small-group  discussions  that  are  sure  to  engage  and  energize. 
Workshops  will  be  scheduled  throughout  the  four-day  meeting,  allowing  attendees  to  participate  in  a wide  range  of 
focused,  longer-term  sessions  on  a variety  of  interesting  topics.  Peer-reviewed  papers  continue  to  form  the  backbone 
of  the  1998  conference,  with  authors/presenters  encouraged  to  consider  a variety  of  presentation  formats:  traditional 
Paper  Presentation  (3-5  papers  per  session  with  a Session  Chair  and  a Session  Discussant),  Roundtable 
Discussion/Poster  (for  heightened  presenter-attendee  interaction),  Symposium  (focusing  on  specific  topics  from  a 
variety  of  perspectives),  Workshop  (longer-term  focused  work  on  a topic  of  interest),  or  Alternative  Format  (with  a range 
of  different  time  lengths  and  interactive  activities).This  year’s  meeting  returns  to  Chicago’s  Holiday  Inn  Mart  Plaza 
featuring  spacious,  comfortable  guest  rooms,  excellent  meeting  facilities,  an  indoor  pool  and  exercise  room,  and  many 
shops  and  restaurants  within  a short,  safe  walk  of  the  hotel.  Chicago's  museums,  planetarium  and  aquarium,  theater 
district,  and  lively  night  life  are  also  just  minutes  from  our  central  hotel  location!  ■ 

Please  accept  this  invitation  to  participate  in  the  1998  Annual  Meeting! 

The  Mid-Western  Educational 
Research  Association  offers 
scholars  and  practitioners, 
researchers  and  instructors,  and 
educators  from  all  levels  and 
perspectives  an  opportunity  to 
share  ideas  with  others  in  a 
supportive  environment  of 
collaboration.  The  MWERA 
meeting  is  where  people  from  all 
over  North  America  come  to  hear 
the  latest  in  educational  thought 
and  progress,  and  to  make  new 
contacts  and  renew  existing 
acquaintances,  in  a spirit  of 
professional  friendship  and 
collegiality! 


General  Information 


The  1998  MWERA  Annual  Meeting  will  be  held  Wednesday,  October  14  through 
Saturday,  October  17,  at  the  Holiday  Inn  Mart  Plaza  in  Chicago,  IHinois.  The  program  will 
consist  primarily  of  presentations,  selected  through  a peer  review  process,  by  divisional 
program  chairpersons.  In  addition,  there  will  be  invited  speakers  and  symposia,  panel 
discussions,  special  sessions  for  graduate  students  and  new  faculty,  a luncheon  and  other 
social  events  open  to  all  attendees. 

Proposals  may  be  submitted  either  on  paper,  or  electronically  over  the  World  Wide  Web. 
AR  proposals  submitted  on  paper  must  be  sent  only  to  the  Program  Chair  at  the  address  given 
below,  and  must  follow  the  Guidelines  for  Submitting  a Proposal  in  this  booklet  Questions 
about  a proposal  or  the  meeting,  whether  submitted  on  paper  or  electronically,  should  also  be 
directed  to  the  Program  Chair. 

Dr.  Jeffrey  B.  Hecht 
MWERA-98  Program  Chair 
Campus  Box  5900 
Illinois  State  University 
Normal,  Illinois  61790-5900 

Office:  (309)438-5585 
e-mail:  MWERA-98@ilstu.edu 

Electronic  proposals  must  be  submitted  using  the  form  available  on  the  meeting  Web 
site.  Proposals  e-mailed  to  the  Program  Chair  will  not  be  processed.  Further,  each  proposal 
should  only  be  submitted  once  in  one  format,  electronic  or  paper.  Specific  instructions  for 
electronic  submission  can  be  found  at  the  meeting  web  site: 

http://tierlab.ilstu.edu/MWERA-98 

Any  educational  professional  may  submit  a proposal  for  MWERA-98,  whether  or  not  that 
person  is  currently  a member  of  MWERA.  All  Annual  Meeting  presenters  must  be  members 
in  good  standing  of  MWERA  (non-mombers  must  join  MWERA  upon  notification  of  proposal 
acceptance).  To  promote  broader  participation  in  the  program  no  one  person  should  appear 
as  a presenter  on  more  than  three  proposals. 

All  proposals,  regardless  of  submission  format  (electronic  or  paper),  must  be  received 
by  the  Program  Chair  no  later  than  the  deadline  of  April  1, 1998.  All  proposals  will  then  be 
sent  to  the  appropriate  Division  Chair,  each  of  whom  coordinate  a number  of  volunteers  in  a 
system  of  blind  (without  author  identification)  review.  Appropriate  criteria,  depending  on  the 
format  and  type  of  scholarly  work  being  presented,  have  been  developed  and  are  used  for  the 
review  process.  These  criteria  include:  (a)  topic  (originality,  choice  of  problem,  importance  of 
issues);  (b)  relevance  of  topic  to  the  Division  and  MWERA  membership;  (c)  contribution  to 
research  and  education;  (d)  framework  (theoretica i/co n ceptual/practical . rationale,  literature 
review,  grounding);  (e)  analyses  and  interpretations  (significance,  implications,  relationship 
of  conclusions  to  findings,  generalizability  or  usefulness);  and  (0  overall  written  proposal 
quality  (clarity  of  writing,  logic,  and  organization). 

Papers  presented  at  MWERA  are  expected  to  present  original  scholarship,  conducted 
by  the  authors),  which  has  not  been  previously  presented  at  any  other  meeting  or  published 
In  any  journal.  Further,  it  is  a violation  of  MWERA  policy  to  promote  commercially  available 
products  or  services  (except  as  Exhibits)  which  go  beyond  the  limits  of  appropriate 
schoiarty/sdentrfic  communication.  Individuals  who  wish  to  display  educationally  related 
products  or  services  are  encouraged  to  contact  Dr.  Sharon  McNeety,  Assistant  Program  Chair 
for  Exhibits,  P.  0.  Box  34421 , Chicago,  Illinois  60634,  (913)  794-2788. 

All  persons  presenting  at  the  1998  Annual  Meeting  are  expected  to  register  for  the 
fyil  meeting.  All  sessions  listed  in  the  program  will  be  open  to  any  registered  meeting 
participant;  however,  enrollment  may  be  limited,  and  a small  additional  fee  required,  for  some 
Workshop  sessions.  Tickets  for  the  Friday  luncheon  and  speaker  are  available  to  all  pre- 
registrants.  Ticket  availability  is  not  guaranteed  for  late  and  on-site  registrants.  Registration 
materials  for  the  1998  Annual  Meeting  will  be  published  in  the  Mtf-Westem  Educational 
Researcher,  on  the  Web  site,  and  can  be  obtained  by  contacting  the  Program  Chair. 

Presenters  whose  papers  have  been  accepted  to  a session  with  a Session  Chair  and/or 
Session  Discussant  are  responsible  for  submitting  a completed  version  of  their  conference 
paper  to  the  Session  Chair  and  Discussant  no  later  than  September  1, 1998.  Papers  not 
available  to  the  Session  Chair  and  Session  Discussant  maybe  dropped  from  the  program. 
Presenters  must  also  provide  complete  copies  of  their  papers  (or  detailed  handouts)  to 
attendees  at  their  sessions.  Overhead  projectors  and  screens  win  be  provided  by  MWERA  In 
most  presentation  rooms.  Presenters  needing  additional  AN  equipment  are  responsible  for 
arranging  such  with  the  hotel  at  the  presenter’s  own  additional  expense. 

MWERA  reserves  the  right  to  reproduce  and  distribute  summaries  and  abstracts  of  all 
accepted  proposals,  Including  making  such  works  available  In  a printed  Program  Abstract 
through  the  meeting’s  World  Wide  Web  site,  and  In  press  releases  promoting  the  Annual 
Metfng  and  the  organization.  As  a condition  of  acceptance  af  authors  of  papers  accepted  to 
the  1996  Annuel  Meeting  expk/t/ygmit  MWERA  the  right  to  reproduce  their  work's  summery 
end/or  attract  to  these  ways.  Such  limited  attribution  does  not  preclude  any  subsequent 


publication  of  the  work  by  the  authors). 

Authors  of  accepted  proposals  assume  the  ethical  and  professional  responsibility  to 
appear  at  the  Annual  Meeting  and  to  participate  In  their  presentation  or  assigned  session. 
When  circumstances  predude  the  authors)  from  doing  so,  it  is  the  responsibility  of  the  author 
to  arrange  a suitable  substitute  and  to  notify  the  Program  Chair  in  advance. 

Divisions 

A - Administration  and  Leadership 

This  division  is  concerned  with  research,  theory,  development,  and  the  improvement  of 
practice  in  the  organization  and  administration  of  education.  The  Sr.  Chair  of  Division 
A is  James  K.  Waiter  from  Texas  A&M  University  - Corpus  Christi,  and  the  Jr.  Chair  is 
Larry  McNeal  from  Illinois  State  University. 

B • Curriculum  Studies 

This  division  Is  concerned  with  curriculum  and  instructional  practice,  theory,  and 
research.  The  Sr.  Chair  of  Division  B is  James  H.  Powell  from  Ball  State  University,  and 
the  Jr.  Chair  is  Jay  Thompson  from  Ball  State  University. 

C - Learning  and  Instruction 

This  division  is  concerned  with  theory  and  research  on  human  abilities,  teaming  styles, 
individual  differences,  problem  solving,  and  other  cognitive  factors.  The  Sr.  Chair  of 
Division  C is  M Cedi  Smith  fmm  Northern  Illinois  University. 

D - Measurement  and  Research  Methodology 

This  division  is  concerned  with  measurement,  statistical  methods,  and  research  design 
applied  to  educational  research.  The  Sr.  Chair  of  Division  D is  James  McCluskey  from 
Central  Michigan  University,  and  the  Jr.  Chair  is  Lany  Henricksen  from  Ball  State 
University. 

E - Counseling  and  Development 

This  division  is  concerned  with  the  understanding  of  human  development,  special 
education,  and  the  application  and  improvement  of  counseling  theories,  techniques,  and 
training  strategies.  The  Sr,  Chair  of  Division  E is  Gabriella  ColdweH  from  Illinois  State 
University,  and  the  Jr.  Is  Eddie  Glenn  from  Illinois  State  University. 

F - History  and  Philosophy 

This  division  is  concerned  with  the  findings  and  methodologies  of  historical  research  in 
education.  The  Sr,  Chair  of  Division  F Is  Beth  Johnson  from  Eastern  Michigan 
University,  and  the  Jr.  Chair  is  Louise  Fleming  from  Ashland  University. 

G • Social  Context  of  Education 

This  division  is  concerned  with  theory,  practice,  and  research  on  social,  moral,  affective, 
and  motivational  characteristics  and  development,  especially  multi  culture)  perspectives. 
The  Sr.  Chair  of  Division  G Is  Mary  Ann  Wham  from  the  University  of  Wisconsin  - 
Whitewater,  and  the  Jr.  Chair  is  Sue  Lenski  from  Illinois  State  University. 

H - School  Evaluation  and  Program  Development 

This  division  is  concerned  with  research  and  evaluation  to  improve  school  practice, 
including  program  planning  and  implementation.  The  Sr.  Chair  of  Division  H is  Isadore 
Newman  from  the  University  of  Akron. 

I • Education  in  the  Professions 

This  division  is  concerned  with  educational  practice,  research,  and  evaluation  in  the 
professions  (e.g.,  medicine,  nursing,  public  health,  business,  law,  and  engineering).  The 
Sr.  Chair  of  Division  I is  Gene  Kramer  from  the  American  Dental  Association,  and  the 
Jr.  Chair  is  Richard  M.  Smith  from  Rehabilitation  Foundation,  Inc. 

J • Postsecondary  Education 

This  division  is  concerned  with  a broad  range  of  issues  related  to  two-year,  four-year, 
and  graduate  education.  The  Sr.  Chair  of  Division  J is  Margaret  Simpson  from  the 
Northwestern  University  Medical  School,  and  the  Jr.  Chair  is  Thomas  J.  Cody  from 
Western  Illinois  University, 

K - Teaching  and  Teacher  Education 

This  division  is  ooncemed  with  theory,  practice,  and  research  related  to  teaching  at  all 
levels  and  in-service  and  pre-service  teacher  education,  including  field  experience 
supervision  and  mentoring.  The  Sr.  Chair  of  Division  K is  Connie  Bowman  from  the 
University  of  Dayton,  and  the  Jr.  Chair  is  Maria  Elena  Gatvez-Martin  from  The  Ohio 
State  University. 


Important  Dates 

Proposal  Submission  Deadline 

April  1, 1998 

Notification  of  Acceptance 

August  1, 1998 

Papers  to  Session  Chairs/Discussants 

September  1, 1998 

Meeting  Registration  and  Hotel  Reservations 

September  15, 1998 

MWERA  1998  Annual  Meeting 

October  14 -17, 1998 

Guidelines  for  Submitting  a Proposal 


Session  Format  Descriptions 

Paper  Presentation 

Paper  sessions  are  intended  to  allow  presenters  the  opportunity  to  make  short 
relatively  formal  presentations  in  which  they  overview  their  papers  to  an  audience.  Three  to 
five  individual  papers  dealing  with  related  topics  are  grouped  into  a single  session  running 
from  1 .5  to  2 hours.  The  presenters)  of  each  paper  is(are)  avowed  approximately  15  minutes 
to  present  the  highlights  of  the  paper.  A single  Session  Discussant  is  allowed  approximately 
1 5 minutes,  following  aH  papers,  for  comments  and  critical  review.  A Session  Chair  moderates . 
the  entire  session.  Presenters  are  expected  to  provide  comptete  copies  of  their  papers  to  all 
interested  audience  members. 

Roundtoble  DHcu»»ion)Po»ter 

Roundtable  Discussion/Poster  sessions  are  intended  to  provide  opportunities  for 
interested  individuals  to  participate  in  a dialogue  with  other  interested  individuals  and  the 
presenters)  of  the  paper.  Presenters  are  provided  a small  table  around  which  interested 
individuals  can  meet  to  discuss  the  paper.  Presenters  may  elect  to  provide  small,  tabletop 
poster-type  displays,  ancillary  handouts,  or  other  tabie-top  A N materials  to  augment  their 
discussions.  Interested  individuals  are  free  to  move  into  and  out  of  these  discussions/posters 
as  they  wish.  Presenters  are  expected  to  make  available  complete  copies  of  the  paper  on 
which  the  roundtable  discussion/poster  was  focused. 

Sympff^ium 

A symposium  is  intended  to  provide  an  opportunity  for  examination  of  specific  problems 
or  topics  from  a variety  of  perspectives.  Symposium  organizers  are  expected  to  identify  the 
topic  or  issue,  identify  and  ensure  the  participation  of  individual  speakers  who  will  participate 
in  the  session,  prepare  any  necessary  materials  for  the  symposium,  and  Chair  the  session. 

It  is  suggested,  though  not  required,  that  the  speakers  or  symposium  organizer  will  provide 
interested  individuals  with  one  (or  more)  papers  relevant  to,  reflective  of,  or  drawn  from  the 
symposium. 

Workshop 

Workshops  are  intended  to  provide  an  extended  period  of  time  during  which  the 
workshop  leader  helps  participants  develop  or  improve  their  ability  to  perform  some  process 
(e.g.  how  to  provide  clinical  supervision,  using  the  latest  features  of  the  Internet,  or  conduct 
an  advanced  statistical  analysis).  Organizers  may  request  from  1.5  to  3 hours,  and  are 
responsible  for  providing  all  necessary  materials  for  participants.  Many  workshops  are 
scheduled  for  Wednesday  afternoon,  although  others  may  be  scheduled  throughout  the 
conference.  Organizers  may,  if  they  wish,  receive  an  honorarium  based  upon  the  number  of 
paid  participants  in  their  workshop  and  the  fee  schedule. 

Alternative  Session 

The  form,  topics,  and  format  of  alternative  sessions  are  limited  only  by  the  imagination 
and  creativity  of  the  organizer.  These  options  are  intended  to  afford  the  most  effective  method 
or  approach  to  disseminating  scholarty  work  of  a variety  of  types.  Proposals  for  alternative 
sessions  win  be  evaluated  on  their  appropriateness  to  the  topic  and  audience,  their  suitability 
to  meet  the  limitations  of  time,  space,  and  expense  for  MWERA,  and  the  basic  quality  or  value 
of  the  topic.  The  organization  of  alternative  sessions  is  responsible  for  all  major  participants 
or  speakers,  developing  and  providing  any  necessary  materials,  and  conducting  or  mediating 
the  session.  Because  a variety  of  approaches  may  be  proposed  within  this  category, 
alternative  session  proposals  should  Indude  a brief  rationale  for  the  alternative  being 
proposed. 

Materials  to  be  Submitted 

The  following  materials  list  applies  to  proposals  submitted  on  paper.  Separate 
guidelines  exist  for  electronically  submitted  proposals  (see  the  Web  site  for  details). 

Proposal  Cover  Sheet 

Six  (6)  copies  typewritten  with  all  items  completed.  Session  descriptors  must  be  chosen 
from  the  list  of  descriptors  provided  (see  table  to  the  right). 

Smcpag 

Six  (6)  copies  of  a two  to  three  page  summary  for  use  in  judging  the  merits  of  the 
proposal.  Summaries  can  be  single-spaced,  but  must  be  typed  on  8.5*  x 11"  paper  In  no 
smaller  than  1 0 point  type  using  1 * margins.  AH  copies  of  the  summary  should  Indude  the  title 
of  the  proposed  session  in  the  upper  left-hand  comer  of  the  first  page.  On  three  of  the 
summaries  onty  include  the  name  of  the  presenter,  with  his  or  her  comptete  mailing  address, 
telephone  and  FAX,  and  e-mail,  in  the  upper  right  hand  comer  of  the  first  page.  Proposals 
which  do  not  meet  these  criteria  may  be  refused  by  the  Program  Chair  without  review. 

Summaries  for  Paper  and  Roundtabte  Dtecirt*k>n/Poittr  proposals  should  explicitly 
address  as  many  of  the  following  as  appropriate,  preferably  in  this  order 

(a)  Objectives,  goals,  or  purposes; 

(b)  Perspectives)  and/or  theoretical  framework; 

(c)  Methods  and/or  techniques  (data  source,  Instruments,  procedures); 

(d)  Results  and  conclusions;  and 

(e)  Educational  and/or  scientific  importance  of  the  work. 

Summaries  for  Symposium,  Workshop,  and  Alternative  Session  proposals  should 
txpficMy  address  as  roeny  of  the  following  as  appropriate,  preferably  in  this  order 

fa)  DescriotiveMaofteesettten- 


(b)  Objective,  goals  and  purposes  of  the  session; 

(c)  Importance  of  the  topic,  issue,  or  problem; 

(d)  Explanation  of  the  basic  format  or  structure  of  the  session; 

(e)  Listing  of  the  Presonter  and  Co-Presenter(s),  with  an  explanation  of  each 
person's  relevant  background  and  role  in  the  session; 

(f)  Anticipated  audience  and  kind  of  audience  involvement 

Abstract 

Three  (3)  copies  of  a 100  - 150  word  narrative  abstract  The  abstracts  of  accepted 
papers  will  be  published  the  MWERA  1998  Annual  Mealing  Abstracts  book,  and  wiH  be 
available  on  the  World  Wide  Web  site.  Abstracts  must  be  typewritten,  single-spaced,  using 
a 12  point  Anal  or  Times  Roman  font  Use  dear,  precise  language  which  can  be  understood 
by  readers  outside  your  discipline.  In  the  upper  left  hand  corder  of  each  abstract  page  type 
the  title  of  the  paper,  and  the  name  and  institutional  affiliations  of  each  author. 

Envelope* 

Four  (4)  stamped,  self-addressed,  business  size  (#10)  envelopes.  These  wiH  be  used 
to  inform  you  of.  (a)  receipt  of  the  proposal  by  the  Program  Chair;  (b)  the  decision  about  your 
paper’s  acceptance;  (c)  your  scheduled  session  time,  Session  Chair,  and  Session 
Discussant  and;  (d)  meeting  registration  and  hotel  reservation  information. 

Sewion  Detcriotorc 


Ability  Grouping 

Educational  Policy 

Performance  Assessment 

Accountability 

Educational  Reform 

Philosophy 

Accreditation 

Elemental  Schools 

Physical  Education 

Achievement 

Equating 

Planning 

Action  Research 

Equity 

Politics 

Adaptive  Testing 

Ethics 

Postsecondary  Education 

Administration 

Ethnicity 

Principals 

Admissions 

Evaluation 

Private  Education 

Adolescence 

Experimental  Design 

Problem  Solving 

Adutt  Education/Development 

Facilities 

Professional  Development 

Affective  Education 

Factor  Analysis 

Program  Evaluation 

Aging 

Faculty  Development 

Psychometrics 

Anthropology 

Familyfrlome  Education 

Qualitative  Research 

Aptitude 

Finance 

Race 

Artificial  Intelligence 

Gay /Lesbian  Studies 

Reading 

Arts  Education 

Gender  Studies 

Research  Methodology 

Aslan  Education 

Generalizability  Theory 

Research  Utilization 

Assessment 

Gifted  Education 

Restructuring 

At-Risk  Students 

Governance 

Retention 

Attitude 

High  Schools 

Rural  Education 

Attribution 

Hispanic  Education 

School/Teacher  Effectiveness 

Bilingual/8  (cultural 

History 

Science  Education 

Black  Education 

Indian  Education 

Self-Concept 

Business  Education 

Indicators/lnformation  Systems 

Soda!  Class 

Career  Development 

Individual  Differences 

Social  Context 

Case  Studies 

Information  Processing 

Social  Processes/Devetopment 

Certification/Ucensure 

Instructional  Design/Development  Social  Studies  Education 

Child  Development 

Instructional  Practices 

Sociology 

Classroom  Management 

Instructional  Technology 

Special  Education 

Classroom  Research 

Intelligence 

Staff  Development 

Clinical  Education 

International  Education/Studies 

Standard  Setting 

Cognition 

Item  Response  Theory  (IRT) 

Statistics 

Cognitive  Processes/Develop 

Language  Comprehension/Devel  Stress/Ccping 

Collaboration 

Language  Processes 

Structural  Modeling 

Community  Colleges 

Lav/legal 

Student  Behavior/Attitude 

Comparative  Education 

Leadership 

Student  Cognition 

Compensatory  Education 

Learning  Environments 

Student  Knowledge 

Comprehension 

Learning  Processes/Strategies 

Student  Teaching 

Computer  Applications 

Life-Span  Development 

Studying 

Computerized  Testing 

Literacy 

Supervision 

Computers  and  Learning 

literature 

Survey  Research 

Conceptual  Change 

Mainstreaming 

Teacher  Assessment 

Constructivism 

Mathematics  Education 

Teacher  Characteristics 

Continuing  Education 

Measurement 

Teacher  Cognition 

Cooperative  Learning 

Media 

Teacher  Education/Devefopment 

Counseling 

Medical  Education 

Teacher  Knowledge 

Counselor  Training/Supervision 

Memory 

Teacher  Research 

Critical  Theory 

Mentoring 

Teaching  Context 

Critical  Thinking 

Meta-^nalysis 

Technology 

Cross-Cultural  Studies 

Metacognition 

Testing 

Curriculum 

Middle  Schools 

Test  Theory/Development 

Data  Analysis 

Military  Education 

Textbooks 

Decision  Making 

Minorities 

Tutoring 

Demography 

Moral  Education/Deveiopment 

Urban  Education 

Desegregation 

Motivation 

Vafidrty/RoliabWty 

Differential  Item  Functioning 

Museum  Education 

Vocabulary 

Dimensionality 

KAEP 

Vocational  Education 

Dropouts 

Networking 

Women's  Issues 

Early  Childhood 

Organization  Theory/Change 

Work 

Economics  of  Education 

Peer  Interaction/Frieodship 

Writing 
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By  submitting  this  proposal  I hereby  certify  that  (1)  this  proposal  has  not  been  previously  submitted  to  MWERA  either  on  paper  or  in  electronic  form; 
(2)  this  submission  has  not  been  previously  published  or  presented  at  any  other  professional  meeting;  and  (3)  if  this  submission  is  accepted  and  placed 
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THE  COMPLETE  PROPOSAL  SUBMISSION  MUST  BE  RECEIVED  BY  THE  PROGRAM  CHAIR  NO  LATER  THAN  APRIL  1 , 19981 


Keynote  Address 


Diversity  Issues  in  Educational  Research 

James  B.  Boyer 
Kansas  State  University 


Educational  research  is  an  ongoing  activity  of  many  whose 
careers  keep  them  in  the  center  of  the  American  academy — 
whether  that  academy  is  a defined  research  institution  or  at 
some  other  level.  While  much  of  the  educational  research  con- 
ducted in  the  United  States  is  associated  with  institutions  of 
higher  education,  there  is  an  increasing  level  of  research  activ- 
ity being  undertaken  in  other  agencies  as  well.  Also,  many  of 
the  institutions  of  higher  education  are  forming  linkages  with 
funding  agencies  (to  include  government  agencies)  and  the 
results  of  their  work  will  continue  to  influence  public  policy 
and  the  ultimate  quality  of  life  in  all  of  America. 

Much  of  the  research  undertaken  by  educational  special- 
ists in  the  past  has  attempted  to  adopt  the  traditional  natural 
sciences  approach  to  discovering  new  knowledge  about  hu- 
mankind. In  some  ways,  this  is  admirable,  because  some  dis- 
ciplines have  been  engaged  in  a particular  design  for 
generations.  Most  of  us  were  socialized  into  the  research  com- 
munity by  something  called  the  scientific  method.  However, 
our  position  raises  questions  about  some  of  the  research  en- 
deavors underway  today.  While  we  applaud  the  funding  pro- 
vided for  this  area  of  educational  activity — and  while  are  happy 
that  agencies  like  the  National  Institute  of  Education  and  oth- 
ers are  there  to  enhance  research  activity,  we  are  concerned 
that  the  limitations  placed  on  the  broad  area  of  educational 
research  may  provide  data  and  images  considered  less  useful 
and  less  accurate  than  some  would  view  them. 

If  one  of  the  major  purposes  of  educational  research  is  to 
improve  the  quality  of  life  for  all  of  us,  then  we  place  our  prior- 
ity with  that  purpose.  Diversity  issues  in  educational  research 
means  expanding  the  research  dimensions,  further  analyzing  the 
research  assumptions,  reviewing  the  research  production  teams, 
re-thinking  the  research  consumption  impact,  and  re-defining 
the  parameters  of  our  work  as  educational  researchers. 

Multicultural  Transformation  of 
Educational  Research 

What  are  the  goals  of  multicultural  research  as  we  ap- 
proach the  21st  century?  Why  should  the  academy  embrace 
multicultural  research  effort  when  the  majority  of  the  partici- 
pants in  the  academy  are  not  representative  of  the  highly  vis- 
ible ethnically  different  populations?  What  ultimate  effect  will 
the  research  community  have  on  the  academy’s  image,  pur- 
pose, and  service  function?  Our  position  is  that  the  academy 
(to  include  the  research  practitioners)  must  recognize  the  chang- 
ing demographics  of  the  United  States  and  execute  its  leader- 
ship and  service  function  with  keen  regard  to  the  emerging 
presence  of  diversity. 

Research  activity  must  be  reflective  of  the  multicultural 
perspective  so  that  it  can  more  directly  result  in  public  policy 
which  is  more  inclusive , and  in  human  service  which  is  more 


culturally  sensitive.  We  continually  call  for  research  which 
underlies  the  quest  for  a society  that  is  nonviolent,  open,  sup- 
portive, inclusive  and  diverse  in  its  framework.  We  are  ur- 
gently calling  for  research  activity  which  is  supportive  of  all 
humanity,  if  indeed,  the  application  is  going  to  be  made  for  all 
humanity. 

Research  activity  in  the  academy  (especially  for  those  of 
us  who  are  identified  as  educational  researchers) — must  be 
more  focused  on  ethnic  identity,  gender  adequacy,  an  under- 
standing of  the  necessity  for  economic  sufficiency  and  a cel- 
ebration of  linguistic  diversity.  Gender  adequacy  involves 
understanding  that  neither  gender  is  better  than  the  other  and 
that  equality  does  not  necessarily  mean  sameness  or  exact  du- 
plication. No  one  should  have  to  make  apologies  for  one’s 
gender,  ethnic  identity,  race,  first  language,  economic  profile, 
or  handicapping  condition  as  a participant  in  the  research  com- 
munity or  in  the  academy. 

James  Montford,  Jr.  (1990),  writing  in  Black  Issues  in 
Higher  Education , asserts  that  institutions  must  make  a com- 
mitment to  diversity  at  every  level,  particularly  at  the  support 
programs  level.  He  writes  that  “the  mission  of  cultural  diver- 
sity means  the  institutionalization  of  a cross-cultural  perspec- 
tive into  curriculum,  programs  and  services  at  the  institution” 
(p.  64).  Further,  he  insists  that  “it  is  incumbent  upon  all  insti- 
tutions of  higher  education  to  move  forward  with  deliberate 
speed  to  develop  draft  proposals  designed  to  address  infusion 
of  cross-cultural  education  into  the  very  fabric  of  higher  learn- 
ing” (p.64). 

Educational  researchers,  particularly  those  of  us  concerned 
with  teaching  and  learning,  with  the  experience  of  participa- 
tion in  the  academy,  and  with  the  ultimate  quality  of  life  for  all 
people — must  now  engage  in  that  transformation.  Such  en- 
gagement means  re-thinking  our  perspective  on  educational 
research. 

To  what  extent  can  we  continue  to  place  almost  all  our 
research  effort  into  one  design,  based  on  one  general  set  of 
assumptions,  and  then  attempt  to  apply  that  to  all  populations — 
whether  they  were  included  in  the  sample  or  not?  Most  pro- 
fessions base  their  practice  on  the  best  available  research 
findings  and  educational  practitioners  are  no  different  in  this 
respect.  The  practice,  however,  can  be  no  more  equitable  than 
the  research  activity  on  which  it  is  based. 

Expanding  the  Research  Dimension 

Multicultural  concerns  include  the  expanded  definition  and 
dimension  of  educational  research.  We  support  both  quantita- 
tive and  qualitative  research  efforts  to  provide  greater  insight 
into  the  academic  endeavor.  Further,  we  support  a new  look  at 
the  following  categories  that  lend  themselves  to  educational 
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research  but  which  arc  rarely  given  serious  attention  by  educa- 
tional practitioners'. 

Historical  research : That  which  builds  a chronology  of 
persons,  groups,  or  issues  not  normally  studied  by  educational 
researchers  in  the  professional  education  research  community.  It 
makes  ample  use  of  the  purposes  of  history — and  some  of  the 
historical  approaches  to  Knowing  and  discovering. 

Descriptive  research : That  which  defines  a reality  and  offers 
findings  which  do  not  readily  lend  themselves  to  quantitative  re- 
porting though  they  may  contribute  much  to  professional  under- 
standing of  teaching,  learning  and  consumer  issues. 

Creative  research : That  which  is  the  result  of  composi- 
tions in  educational  theatre,  music,  art,  drama,  photography,  or 
other  areas  including  poetry. 

In  addition  to  traditional  experimental  research  activity, 
those  categories  may  need  to  be  employed  or  addressed  far 
more  frequently  than  before.  If  diversity  is  the  fundamental 
base  for  educational  effort,  then  it  must  also  be  part  of  the  re- 
search paradigm  and  the  broad  practice. 

Traditional  experimental  research  designs  have  long  had  some- 
thing of  a monopoly  on  the  conduct  of  educational  research.  In  the 
future,  as  we  transform  the  field  of  educational  research, 
multicultural  concerns  will  include  friendly  confrontations  with 
the  assumptions  that  historical,  descriptive,  or  creative  research 
designs  have  equal  merit  in  attempting  to  generate  new  knowledge 
on  which  to  base  professional  practice. 

Additional  Research  Dimensions 

There  are  several  critical  dimensions  of  multicultural  edu- 
cation research  which  the  research  community  (including  ac- 
tion research  teams  in  public  schools)  may  need  to  embrace  in 
order  to  remain  a viable  entity  within  the  American  academic 
framework  for  the  twenty-first  century.  Boyer  (1 992)  cited  the 
following:  (a)  recognizing  racial  and  ethnic  identities,  (b)  un- 
derstanding diversity,  (c)  multiple  learning  environments,  (d) 
relation  of  issues  to  academic  disciplines,  (e)  human  rights,  social 
justice,  and  choice,  and  (f)  inclusion  of  diverse  populations. 

Add  to  these  dimensions  or  concerns  the  continuing  fac- 
tors of  policy,  program,  and  procedures,  and  one  realizes  how 
critical  it  is  for  educational  research  to  expand  its  parameters 
when  discussing  research  production  and  research  findings. 
There  is  agreement  that  those  engaged  in  full-time  educational 
research  have  provided  the  academic  community  with  much 
data.  That  data  guides  the  practice  of  those  “on  the  front  lines” 
of  educational  service  delivery.  No  practice,  however,  can  be 
more  equitable  than  the  research  on  which  it  is  based. 

The  Research  Paradigm  for  Diversity 

Perhaps  no  area  of  the  research  community’s  function  is 
more  complex  than  the  paradigm  or  parameters  of  our  daily 
work  in  research  activity.  In  the  United  States,  we  depend  lieavily 
on  the  academic  research  community  for  information  about  na- 
tional policy  and  program  direction.  Diversity  must  become  part 
of  the  foundational  base  on  which  our  research  work  and  discus- 
sions arc  built.  Diversity,  however,  docs  not  mean  deficit.  Di- 


versity does  not  mean  a stop-gap  for  racially  motivated  crisis. 
Diversity  is  not  a benevolent  act  growing  out  of  a slave-master 
mentality.  Diversity  is  not  a call  just  to  add-on  something  that 
was  never  there  before. 

As  we  approach  the  twenty-first  century,  diversity  means 
embracing  the  age  of  Multicultural,  multi-ethnic  understanding. 
It  means  the  acceptance  of  “consumerism”  and  “academic  re- 
construction.” While  we  have  a spirit  of  self-direction,  let’s  an- 
nounce our  own  re-definition  of  research  activity.  Let’s  announce 
our  new  levels  of  self-reliance  and  allow  others  the  chance  to 
review  our  new  levels  of  “research  self-respect.”  We  will  no 
longer  allow  other  disciplines  to  tell  us  what  is  good  research  or 
poor  research  activity,  production,  or  consumption.  While  we 
must  bring  the  problems  of  public  schools  to  bear  through  our 
work,  we  must  offer  more  functional  solutions  than  we  ever  did 
before. 

We  all  know  that  educational  policy  is  made  through  the 
political  process.  That  is  not  likely  to  change  in  the  foreseeable 
future.  However,  we  have  the  responsibility  to  understand  the 
implications  of  that  process  in  the  educational  research  commu- 
nity. Researchers  in  the  educational  enterprise  must  have  a cul- 
ture sense — that  is,  insight  into  the  dynamics  of  culture,  programs, 
and  feelings  of  social  balance.  What  constitutes  research?  How 
will  it  be  used?  Which  research  functions  and  projects  are  wor- 
thy of  the  academy’s  seal  and  image?  Who  shall  make  these 
decisions?  On  what  basis?  Despite  a tendency  to  favor  research 
parameters  of  the  past,  a stronger  level  of  inclusion  must  be  part 
of  our  research  dimensions  and  research  definitions.  What  is  the 
prevailing  definition  of  educational  research?  Who  created  that 
definition?  If  educational  research  is  designed  to  improve  the 
quality  of  life  for  all  people,  then  which  people  shall  have  a part 
in  describing  that  improvement?  All  the  people — including  those 
who  are  culturally  different  from  the  masses — now  require  a more 
comprehensive  definition. 

Choice  of  Research  Topics 

As  research  topics  are  chosen  by  students  and  faculty,  what 
types  of  topics  are  encouraged ? Which  are  discouraged?  To 
what  extent  are  candidates  encouraged  to  engage  in  research  on 
issues  of  race,  gender,  ethnicity,  bilingualism,  and  economic  ex- 
ploitation? In  the  sciences,  to  what  extent  are  concerns  about 
ethical  issues  investigated?  How,  for  example,  arc  decisions  made 
about  where  toxic  waste  dumps  are  placed?  Or  which  patients 
shall  get  organ  replacements  (transplants)  in  medical  facilities? 
Academic  research,  while  once  much  more  limited,  must  now  be 
deliberate  in  its  concern  for  the  diversity  which  questions  imply. 
How  are  research  topics  chosen?  With  wliich  populations  in 
mind?  Educational  research  must  now  become  more  respon- 
sive to  the  differences  which  help  to  define  us. 

The  Research  Production  Team 

Research  production  is  both  a science  and  an  art.  To  what 
extent  do  researchers  feel  that  all  clients  and  potential  researchers 
must  duplicate  the  patterns  and  techniques  of  past  research? 
Why  must  research  in  one  area  be  acceptable  to  academicians 
in  all  other  areas  or  categories  of  research  activity?  We  can 
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never  escape  the  powerful  influence  of  the  human  perspective. 
Educational  researchers  must  take  the  lead  in  expanding  the 
range  of  topics,  methods,  and  outcomes  to  reflect  the  expanded 
level  of  diversity  in  the  United  States. 

Boyer  (1986)  identified  a distinction  between  authentic  re- 
searchers and  basic  researchers  with  implications  for  the  entire 
Held  of  research  activity.  A- basic  research  team  is  one  which 
does  not  include  a person  about  whom  the  research  is  being  con- 
ducted. In  other  words,  if  an  African  American  research  team 
which  has  no  Caucasian  persons  on  it  attempts  to  conduct  a study 
of  Caucasian  learners,  this  would  be  basic  research. 

Authentic  research  occurs  only  when  the  research  team  or 
principal  investigator  represents  the  profile  of  those  being  used 
as  subjects  in  the  research  design.  When  Native  American  re- 
searchers study  Native  American  students  and  their  learning 
styles,  for  example,  such  persons  bring  insight  to  the  task  which 
others  cannot  bring.  The  Native  American  principal  investiga- 
tor brings  not  only  research  skills  to  the  project,  but  also  a life- 
time of  experience  from  that  population  to  the  research  project. 

Educational  research  has  generally  assumed  that  such  fac- 
tors are  insignificant.  The  position  taken  here  is  that  America 
is  too  diverse  to  have  such  factors  continually  ignored.  To  those 
who  suggest  that  the  presence  of  a Native  American  researcher 
on  a research  team  “contaminates’'  the  quest  for  objectivity  in 
research,  the  premise  of  this  is  to  proclaim  that  the  absence  of 
such  a person  is  actually  the  “contaminating”  factor.  Perspec- 
tive in  research  is  extremely  important.  Authentic  perspective 
is  essential. 

The  Gate-Keeping  Function  of  Refereed  Journals 

With  the  increasing  diversity  of  the  consuming  public,  one 
must  ask  the  major  questions  of  gate-keeping  functions  of  ref- 
ereed journals  as  the  only  acceptable  level  of  dissemination. 
At  the  same  time,  traditional  techniques  may  come  under  ques- 
tion. Are  there  more  ways  to  conduct  research  and  disseminate 
results  than  what  we  now  presently  know  and  depend  upon? 

While  there  may  be  value  in  the  historical  practice  of  blind 
reviews,  there  can  also  be  flaws.  Depending  on  the  publication 
and  the  training,  perspective,  and  inclinations  of  the  editor, 
that  which  gets  published  may  have  all  the  trappings  of  monoc- 
ultural,  monoracial,  poorly  conceptualized  definitions  of  what 
is  academically  respectable. 

Diversity  means  the  presence  of  cultural  difference , not 
cultural  warfare.  It  should  be  remembered  that  no  one  is  de- 
prived of  culture!  Often,  what  we  see  is  a variation  from  what 
is  traditionally  known  by  those  who  are  familiar  with  the  activi- 
ties of  the  educational  research  community. 

Multicultural  Concerns  with  Academic  and 
Social  Research 

All  academic  and  social  research  will  reflect  human  pref- 
erences on  methodology,  design,  and  perspective.  The  very 
choices  made  in  conceptualizing  a research  study  emerge  from 
the  preferences  and  perspectives  of  those  engaged  in  the  study. 
All  findings,  then,  are  proportionately  affected. 


We  see  educational  research  as  an  arm  of  all  academic  and 
social  research  because  of  its  heavy  reliance  on  human  beings 
and  their  mental,  emotional,  intellectual,  and  physical  proper- 
ties. Some  time  ago,  legal  parameters  were  created  to  protect 
subjects  or  learners  from  being  unduly  exploited  in  the  conduct 
of  research.  We  applaud  such  steps,  but  we  are  equally  con- 
cerned with  the  research  team  composition,  the  topics  chosen, 
the  design  of  major  projects,  the  dissemination  of  findings,  and 
the  seemingly  vocal  intent  on  re-stating  the  same  negative  de- 
scriptions of  culturally  different  populations. 

Research  associations  cannot  continue  to  perpetuate  the 
status  quo  when  everything  else  associated  with  a multicultural, 
diverse  population  is  changing.  While  the  educational  research 
community  can  be  commended  for  production  of  new  data,  it 
leaves  much  to  be  desired  in  some  areas  of  research  which  have 
been  under-studied. 

Historical  Perspective  on  Multicultural  Education 

In  the  decade  of  the  1 960s,  much  of  the  research  produced 
which  could  be  under  the  banner  of  diversity  was  growing  out 
of  America’s  efforts  to  desegregate  its  schools  and  other  major 
institutions.  Though  embryonic  in  stage,  its  major  assump- 
tions were  based  on  a compensatory  model.  That  is,  anyone 
who  was  culturally  different  was  assumed  to  be  abnormal,  de- 
ficient, sub-standard,  or  negatively  unique  in  some  way.  In 
describing  economically  poor  populations,  for  instance,  some 
of  the  research  concluded  that  these  learners  were  “culturally 
deprived.”  Little  or  no  effort  was  made  to  find  the  strengths  of 
these  populations. 

In  the  decade  of  the  1 970s,  there  was  a strong  move  on  for 
“competency-based”  research  activity.  The  research  in 
multicultural  education  in  that  decade  was  clearly  embryonic — 
and  a number  of  “profile  studies”  were  completed.  A profile 
study  is  one  which  describes  a given  population  or  a given  aca- 
demic or  social  reality.  For  example,  some  of  that  research 
focused  on  the  “profile”  of  presidents  of  historically  black  col- 
leges. It  was  done  to  establish  a new  realization  of  the  aca- 
demic appropriateness  of  such  a population  within  the  academy. 

In  the  1980s,  much  of  the  reform  movement  impacted 
multicultural  research  studies — and  a clearer  focus  on  the  “in- 
stitutionalization” of  certain  curriculum  issues  characterized 
multicultural  research.  Studies  which  attempted  to  look  at  ex- 
clusions from  the  general  curriculum  and  from  collegiate  stud- 
ies, were  quite  prominent. 

In  the  1990s,  wc  are  in  the  Age  of  Multicultural  Under- 
standings which  gives  greater  attention  (and  respect)  to  the  con- 
sumer. We  have  abandoned  the  “compensatory  model”  or 
philosophy  and  have  embraced  the  idea  of  diversity  in  all  of  its 
dimensions.  For  example,  Anne  Butler’s  1990study,  A Con- 
tent Analysis  of  Education  cmd  Social  Science  Research  Re- 
lated to  Young  African  American  Females , K-12,  attempts  to 
look  inside  the  published  research  for  inclusion  and  treatment 
from  an  equitable  standpoint.  Another  example  would  be 
Veronica  McEachin's  study.  Employee  Training  Programs  on 
Ethnic/Cultural  Diversity  in  Corporations  and  Service  Agen- 
cies: Selected  Case  Studies  ( 1991 ) 
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Areas  of  Needed  Multicultural  Research 

While  much  research  is  underway  within  the  framework  of 

diversity,  there  are  still  areas  in  which  additional  research  needs  to 

be  done.  Following  are  some  critically  needed  areas: 

1 . Studies  on  culturally-influenced  learning  styles  are  needed. 
The  major  published  research  consumed  by  educational 
researchers  tends  to  exclude  this  dimension  in  their  work 
on  learning  styles.  The  work  of  Barbara  Shade,  Janice 
Hale  Benson,  Ricardo  Garcia,  and  Jon  Reyner  made  some 
attempts  to  address  it.  Much  more  needs  to  be  done. 

2.  Studies  on  academic  racism  and  institutional  racism  are 
critically  needed.  While  these  areas  are  not  a high  priority 
for  some,  the  research  community  must  be  willing  to  ad- 
dress them.  Academic  racism  exists  when  the  practices 
associated  with  teaching  and  learning  assume  that  the  tra- 
ditional intellectual  inferiority  or  superiority  of  a student, 
faculty  member,  or  staff  member  is  based  primarily  on  one’s 
race  or  ethnic  identity.  It  reflects  an  imbalance  based  on 
instructional  preference  which  results  in  extremely  lim- 
ited learnings  about  racially  and  ethnically  different  per- 
sons, ideas,  heritages,  or  events.  Institutional  practice  could 
stand  much  more  research.  Diversity  is  assessment  in  an 
aspect  of  this  kind  of  research  which  is  needed. 

3.  Studies  on  authorships  of  required  textbooks  in  colleges 
and  universities,  especially  those  books  used  in  preparing 
educational  practitioners  such  as  teachers,  administrators, 
counselors,  librarians,  and  research  specialists.  Who  are 
the  authors  we’ve  studied  all  of  our  lives?  What  academic 
and  social  history  do  they  bring  to  their  writings?  What 
has  been  the  instructional  practical  and  multi-ethnic  expe- 
riences of  these  authors?  How  much  basic  literature  is 
there  compared  to  authentic  literature? 

4.  Studies  on  cross-racial,  cross-ethnic,  cross-gender  relation- 
ships within  the  academic  context.  This  is  not  limited  to 
issues  such  as  sexual  harassment  or  racial  harassment,  but 
includes  higher  levels  of  ethnic  literacy. 

5.  Studies  on  images  presented  of  various  profiles  within  the 
academic  preparation  of  specialists.  How  limited  is  the 
pool  of  images  presented?  Is  it  deemed  adequate  for  ser- 
vice to  a multicultural,  multi-ethnic  population  of  clients? 

6.  Studies  on  specific  disciplines  in  the  elementary  and  sec- 
ondary curriculum  (sciences,  art,  history,  literature,  math- 
ematics, music,  drama,  English)  for  their  inclusion  of 
multiethnic,  non-sexist  entities.  For  example,  if  an  anthol- 
ogy is  used  for  required  literature,  how  many  of  the  selec- 
tions represent  authorships  and  content  about  the  culturally 
different?  And  how  many  are  female  vs.  male? 


7.  Historical  studies  designed  to  upgrade  the  monocultural, 
historical  dimension  of  the  education  of  teachers  and  hu- 
man service  professionals. 

Summary 

Much  of  academic  research  activity,  particularly  in  educa- 
tion and  the  social  sciences,  has  assumed  a monocultural  audi- 
ence and  a monolingual  readership.  Such  a monocultural, 
Western,  English-speaking,  middle  class,  Eurocentric  perspec- 
tive is  no  longer  adequate  for  our  comprehensive  definition  of  a 
multicultural  population.  Educational  research  in  American 
higher  education  must  transform  itself  for  the  twenty-first  cen- 
tury. However  one  defines  diversity,  the  bottom  line  is  inclusive- 
ness. One  way  to  accomplish  this  is  to  raise  the  hard  questions  of 
how  we  do  things  in  education  research — and  why  we  have  al- 
ways done  them  this  way. 
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Presidential  Address 


Learning  About  Sex:  The  Missing  Paradigms 
and  Challenges  to  Educational  Researchers 

Sharon  McNeely 
Northeastern  Illinois  University 


In  making  this  Presidential  address,  I will  depart  from  some 
of  my  predecessors.  I am  presenting  you  a brief  summary  of 
some  of  my  work  in  progress,  and  sharing  my  thoughts  on  some 
concepts  that  most  educational  researchers  seem  to  be  ignor- 
ing. In  doing  so,  I hope  that  you  will  be  open  to  the  challenges 
that  I am  presenting,  and  start  your  own  reflecting  on  how  best 
all  of  us  can  work  together  to  help  impact  this  field. 

When  I was  doing  volunteer  work  in  high  school,  it  came 
to  my  attention  that  there  were  inadequate  sex  education  mate- 
rials for  the  mentally  challenged  adults  that  I was  working  with. 
They  often  lacked  basic  information  essential  for  sexual  healthy 
relationships.  It  soon  became  apparent  to  me  that  one  of  the 
reasons  they  lacked  the  information  was  because  they  were  typi- 
cally denied  their  sexual  feelings,  and  weren’t  allowed  to  en- 
gage in  sexual  behaviors.  Of  course,  that  didn’t  stop  them,  it 
only  changed  the  outlets  they  choose  forexpressing  their  sexu- 
ality. Over  the  years,  it  became  clear  to  me  that  this  problem 
was  not  isolated  to  this  group.  Most  of  my  peer  group  also 
lacked  good  sexual  information,  and  choose  to  engage  in  sexu- 
ally risky,  unhealthy  behaviors. 

In  the  twenty-five  years  since  I was  in  high  school  not  much 
has  changed.  Educators  still  focus  on  the  major  disciplines  and 
relegate  sexuality  education  to  physical  and  health  education 
segments  provided  to  gender-divided  groups  of  students.  Edu- 
cational researchers  continue  to  focus  on  the  major  disciplines, 
and,  for  the  most  part  ignore  how  we  learn  about  sexuality,  and 
what  techniques  and  methods  are  most  effective  for  sexuality 
education.  Regardless  of  the  small  fluctuations  in  various  sta- 
tistics, United  States  teenagers  have  high  rates  of  pregnancy, 
sexually-transmitted  disease  infestation,  and  engaging  in  health- 
risky  sexual  behaviors. 

I feel  a need  to  take  a moment  here  and  tell  you  that  I am 
not  trying  to  engage  you  in  a “culture  specific’’  or  “value-laden” 
discussion  here.  Let’s  keep  to  what  seem  to  be  some  important 
facts.  Medical  science  tells  us  that  teenage  females  usually  do 
not  have  fully  developed  uteruses.  Given  their  own  nutritional 
needs,  and  body  maturation,  most  female  teens  cannot  provide 
the  compliment  of  nutrients  and  oxygen  that  is  recommended 
for  optimum  fetal  growth.  When  we  add  to  this  the  cross-cul- 
tural concerns  for  supporting  a child,  being  prepared  to  parent, 
and  being  able  to  access  jobs  that  provide  for  professional 
growth,  we  find  most  teenage  parents  severely  disadvantaged 
in  our  society. 

Sexual  science  researchers  tell  us  that  developmentally 
appropriate  sexual  education  which  is  presented  on  an  ongoing 
basis  to  our  children  tends  to  postpone  the  age  of  first  engaging 


in  sexual  activities.  Yet,  few  educators  have  access  to  these 
materials  so  they  can  provide  them  to  the  children.  In  fact,  in 
many  school  districts  and  states,  educators  have  to  be  specially 
certified  to  provide  sexuality  education,  or  to  address  ques- 
tions which  the  children  ask  that  are  related  to  sexuality.  In  all 
other  areas  we  tell  educators  to  encourage  student  questioning 
and  to  help  provide  resources  and  answers  for  students.  Yet, 
when  students  ask  questions  related  to  sexuality,  most  educa- 
tors aren’t  trained  to  provide  the  answers,  and  don’t  know  where 
to  go  to  get  the  answers  and  resources  that  they  need. 

Do  you  remember  the  “just  say  no”  type  of  campaigns  of 
the  1 960’s?  They  focused  first  on  cigarettes,  and  then  on  drugs. 
They  keep  recycling.  Researchers  have  generally  found  such 
campaigns  are  ineffective,  yet,  they  are  now  being  used  when  it 
comes  to  sexuality.  “Say  no  to  sex”  is  often  pushed  at  our  kids. 
As  an  educator,  I can’t  help  but  wonder  at  the  contradictions 
we  give  our  children,  and  be  amazed  if  they  get  the  point  at  all. 
There  seems  to  be  a lot  of  agreement  that  learners  should  feel 
good  about  themselves  to  optimize  their  learning.  Yet,  when 
we  deny  that  our  learners  are  sexual  beings  and  deny  that  should 
feel  good  about  their  sexuality,  we  deny  part  of  their  self-es- 
teem. We  also  deny  the  nature  of  learners.  We  tell  our  educa- 
tors to  build  on  curiosity,  to  encourage  it.  Yet,  when  learners 
are  curious  about  sex  they  are  told  to  “say  no.”  To  make  mat- 
ters worse,  we  are  telling  our  teens  to  “say  no”  at  a time  when 
“no”  means  “yes.”  What  we  forbid  becomes  even  more  a curi- 
osity, more  a desire,  and  more  a challenge  to  master. 

Over  the  past  several  years  I have  been  engaging  in  vari- 
ous lines  of  research  with  the  goals  of  understanding  how  people 
typically  learn  about  sex,  if  current  models  of  learning  apply  to 
learning  about  sex,  and  what  methods  work  best  with  various 
aspects  of  sexual  education.  My  research  has  lead  to  my  devel- 
oping a sense  of  some  of  what  is  needed  in  the  field.  I will  share 
with  you  some  of  the  findings  from  the  field,  and  the  model  for 
sexuality  education  that  I am  working  on. 

^ First,  I have  collected  responses  of  over  10,000  students 
on  my  campus.  These  students  are  typically  non -traditional  in 
that  they  represent  over  100  different  language  backgrounds, 
over  30  different  religions,  and  are  typically  over  25  years  old. 
They  reflect,  to  a large  extent,  the  multicultural  population  which 
lives  in  Chicago.  They  have  shared  their  knowledge,  attitudes, 
behaviors,  and  ways  of  learning.  They  have  taught  me  that  the 
lack  of  sexual  knowledge  is  not  a singularity  to  standard  ethno- 
centric middle  class  America.  Additionally,  despite  the  focus 
on  HFV/AIDS  education,  most  people  are  still  engaging  in 
health-risky  sexual  behaviors.  My  research  shows  that  this  is 
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due  to  the  lack  of  knowledge  across  various  aspects  of  sexual- 
ity, and  the  lack  of  meaningful,  contextual  information.  It  ap- 
pears that  cultural,  and  motivational  factors,  in  addition  to 
learning  styles  and  opportunities  for  exposure  to  information 
arc  important  predictors  for  explaining  learning  and  sexual  be- 
haviors. In  particular,  the  cultural  factors  of  age,  gender,  social 
class,  ethnicity,  language,  social  status,  and  religion  need  to  be 
considered.  The  health  status  of  the  learner  also  seems  to  be 
important.  Those  learners  who  reported  that  they  had  some 
health  problems  seem  to  have  learned  more  about  sex  than  those 
learners  who  did  not  report  such  problems. 

Second,  I have  been  collecting  survey  and  interview  data 
from  adolescents.  Some  of  the  data  has  been  collected  in  middle 
and  high  schools.  Some  of  it  in  health  and  social  service  pro- 
grams for  inner  city  teens.  This  data  includes  self-concept,  risk- 
taking, sexual  knowledge,  and  self-reports  of  their  lives.  Various 
path  and  regression  analyses  have  been  used  to  understand  what 
factors  may  contribute  to  effective  learning  r ;d  engaging  in 
sexually  healthy  behaviors.  These  analyses  have  supported  that 
in  addition  to  the  factors  presented  above,  it  is  important  to 
understand  people’s  risk-taking  propensities,  and  the  percep- 
tions of  risk  that  are  associated  with  various  sexual  behaviors. 
For  instance,  males  and  females  have  different  perceptions  of 
the  risks  associated  with  engaging  in  sexual  relationships.  Males 
report  that  short-term  mating  relationships  pose  few  emotional 
or  physical  risks,  but  are  somewhat  emotionally  risky.  In  con- 
trast, one-night  relationships  are  both  emotionally  and  physi- 
cally risky.  Females  typically  report  just  the  opposite.  One-night 
relationships  pose  some  social  risks,  while  short-term  mating 
relationships  are  seen  as  emotionally  and  physically  risky. 

Also  important  to  understanding  our  challenges  is  to  rec- 
ognize that  different  learners  engage  in  different  sexual  behav- 
iors. Those  who  engage  in  behaviors  that  are  considered 
health-risky  tend  to  have  different  perceptions  of  the  risk  fac- 
tors associated  with  these  behaviors.  They  tend  to  be  risk  tak- 
ers, and  to  differ  in  their  motives  for  engaging  in  sex  (fun, 
challenges,  etc.).  They  report  different  ways  they  learn  about 
sex,  and  have  different  conceptualizations  about  how  they  learn 
about  sex.  They  tend  to  be  more  impulsive,  and  yet  believe 
themselves  to  be  more  reflective. 

Third,  my  various  undergraduate  and  graduate  students 
have  been  followed  through  three  or  more  years  of  post-sec- 
ondary education.  They  have  provided  information  on  the  sta- 
bility of  their  learning  styles  and  ways  of  thinking,  and  on  their 
conceptual  development  processes.  They  lead  me  to  understand 
that  among  adults,  there  is  some  stability  in  the  learning  styles 
of  reficctivity/impulsivity,  concrete/abstract,  and  hands-on/re- 
flcctive.  It  also  is  important  to  distinguish  between  visual  and 
auditoiy  when  it  comes  to  the  type  of  materials.  However,  the 
visual/auditory  styles  seem  to  interact  with  other  styles,  and  arc 
dependent  upon  the  types  of  learning  that  are  presented.  It  also 
seems  that  with  sexual  education  materials  conceptual  change 
and  learning  styles  function  independently. 

Fourth,  I have  conducted  various  analyses  of  sexual  edu- 
cation materials  used  by  the  schools.  The  analysis  which  I am 
going  to  focus  on  here  includes  the  learning  styles  and  methods 


used  within  the  texts,  and  the  appeal  of  the  texts  to  the  students. 
Repeatedly,  when  sexual  education  materials  are  available  (in 
many  schools  they  are  not),  they  rely  on  strictly  print/visual 
materials  that  limit  the  interactiveness  of  the  reader,  and  present 
material  in  an  isolated,  abstract  manner.  Typically,  the  only  in- 
formation presented  in  concrete  forms  is  basic  biology,  and  sta- 
tistical information  concerning  rates  of  infection,  etc.  The  things 
that  we  know  about  incorporating  learning  strategies  and  orga- 
nizing text  in  ways  that  provide  scaffolds  and  allow  learners  to 
use  situational  contexts  are  typically  not  incorporated  into  texts. 

It  should  be  noted  that  the  teens  I have  interviewed  gener- 
ally did  not  report  learning  anything  that  was  meaningful  or 
important  to  them  through  the  use  of  sex  ed  texts.  When  it  comes 
to  learning  about  sex,  both  males  and  females  report  that  friends, 
other  peers,  and  sexual  experimentation  with  others  are  pri- 
mary ways  of  learning  about  sex.  Males  also  report  that  they 
learned  about  sex  through  discussion  with  older  siblings  and 
peer..,  through  listening,  and  through  challenges.  Many  times 
they  engaged  in  hands-on,  active  learning  with  selves  or  others 
because  of  dares  and  challenges  from  others.  On  the  other  hand, 
females  reported  learning  through  reading  popular  magazines 
and  romance  novels,  through  religious  affiliations,  through  re- 
lationships (an  emotionally-tied  partner  taught  them),  and 
through  their  own  fantasies.  Few  teens  report  that  their  parents 
are  good  sources  of  information,  or  that  teachers  at  school  re- 
sponded to  their  questions  about  sex. 

Fifth,  my  work  with  teachers  has  lead  to  my  hosting  focus 
groups,  professional  discussions  at  conferences,  and  other  dis- 
cussion groups  among  teachers.  Teachers  report  that  they  have 
problems  of  students  acting  out  sexual  abuse,  asking  about  sex, 
and  engaging  in  sexual  behaviors  in  the  schools.  Reports  show 
that  sexual  harassment  among  our  students  is  high,  and  teach- 
ers often  report  that  they  see  others  victimized,  and  may  feel 
victimized  themselves.  They  don’t  know  what  to  do,  or  how  to 
respond. 

In  short,  our  “methods”  related  to  sexuality  education  don’t 
match  what  we  know  about  learners  and  learning  processes.  To 
make  matters  worse,  there  are  no  Midwestern  states  that  re- 
quire that  sexuality  education  is  part  of  teacher  education.  Ask 
around  colleges  of  education,  and  most  don’t  have  a sexuality 
education  specialist  on  faculty,  and  most  don’t  offer  a course 
for  pre-service  teachers,  much  less  mandate  such  a course.  Most 
human  development  texts  provide  a cursory  overview  of  the 
field,  usually  focusing  on  biological  aspects,  and  rarely  provid- 
ing information  that  helps  educators  deal  with  critical  issues 
they  face  in  their  classrooms.  In  addition,  most  of  my  colleagues 
who  teach  human  development  are  quick  to  admit  that  they 
ignore  this  aspect  of  the  course,  or  zoom  through  it,  rarely  dis- 
cussing any  of  the  problems  or  issues  that  educators  face  in  the 
classroom.  This  is  confirmed  by  the  teachers  who  report  that 
they  have  never  received  any  training  on  sexual  education. 

Now,  look  among  our  colleagues,  our  membership.  How 
many  educational  researchers  readily  admit  to  studying  and 
researching  aspects  of  sexuality?  How  many  belong  to  groups 
like  the  Society  for  the  Scientific  Study  of  Sexuality,  the  Ameri- 
can Association  of  Sex  Educators,  Counselors  and  Therapists, 
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or  the  Sexuality  Education  Information  Council  of  the  United 
States?  How  many  times  have  you  even  heard  of  sex  ed  re- 
ported at  MWERA  meetings?  In  general,  it  is  pretty  difficult  to 
find  a Division  that  those  of  us  who  do  research  can  use  as  a 
home  within  MWERA.  Worse  yet,  we  don’t  often  feel  at  home 
in  other  organizations,  and  thus,  we  don’t  share  a common  vo- 
cabulary among  sex  educators  and  educational  researchers.  We 
don’t  talk  to  each  other.  Tnus,  sex  educators  don’t  usually  know 
or  use  aspects  of  educational  psychology  and  human  develop- 
mental learning  that  may  be  helpful  for  the  learners.  They  don’t 
know  how  to  do  applied  action  research  in  their  classrooms, 
and  they  don’t  have  contacts  to  have  others  help  them  engage 
in  meaningful  evaluation  of  materials. 

In  short,  I do  not  believe  that  the  current  methods  of  sexual  v 
education  are  working  effectively.  I question  if  the  models,  para- 
digms, and  methods  we  use  to  teach  cognitive  skills,  enhance 
cognitive  learning,  impact  affective  learning,  or  otherwise  lead 
to  new  behaviors  are  effective  for  learning  about  sex.  I think 
that  we  need  anew  model  that  incorporates  the  various  aspects 
I have  talked  about,  always  remembering  that  each  individual 
is  a unique  learner.  When  we  consider  the  age,  gender,  social 
status,  economic  status,  religion,  language,  ethnicity  and  health 
of  the  individual  into  the  model,  and  then  consider  the  risk- 
taking propensities,  perceptions  of  risk,  learning  styles  and 
motives  of  the  individual,  we  should  come  closer  to  understand- 
ing the  factors  that  need  to  be  incorporated  into  building  sexual 
education  materials  and  processes.  When  we  engage  the  sex 
educators  in  open  discussion  about  how  learning  works  in  other 
disciplines,  and  then  study  how  it  works  in  sex  ed,  we  might 
find  that  we  not  only  have  to  expand  our  current  learning  para- 
digms, but  also  make  changes  in  many  of  them. 

Here  are  some  of  our  challenges: 

1 . If  we  are  truly  a profession,  a discipline,  a specialty  in  our 
own  right,  we  must  recognize  all  of  education,  and  be  pre- 
pared to  research  all  areas,  including  sex  ed.  We  cannot 
continue  to  ignore  one  of  our  most  pervasive  societal  is- 
sues and  pretend  that  because  it  is  often  not  a major  disci- 
pline it  does  not  deserve  major  attention.  If  we  had  a quarter 
of  the  studies  on  sex  ed  and  sex  learning  that  we  have  on 
self  esteem,  wc  would  know  a lot  more,  and  be  more  ef- 
fective in  the  ways  our  schools  provide  sex  ed. 

2.  If  we  are  going  to  be  serious  in  our  efforts  to  know  about 
sex  ed,  we  have  to  look  at  the  crisis  our  vocabulary  causes 
in  sex  ed.  We  can’t  talk  about  “sex  ed”  as  just  cognitive  or 
just  affective,  or  just  psychomotor  learning.  Sex  ed  crosses 
all  domains.  Maybe  someday  I’ll  have  converts  to  my  be- 
lief that  sex  ed  requires  its  own  domain,  as  well  as  its  own 
learning  style  vocabulary. 

3.  Yes,  current  vocabulary  among  educational  researchers 
can’t  be  used  by  sex  educators  in  real  ways.  Sex  educators 
can’t  talk,  and  be  taken  seriously,  about  developing  hands- 
on  materials,  taJ.e  home  activities,  group  projects,  experi- 
ential or  experimental  or  cooperative  learning  activities. 


They  are  even  hesitant  to  talk  about  situated  learning,  and 
building  on  curiosity.  After  all,  we  are  dealing  with  educa- 
tors who  have  to  be  aware  that  the  vocabulary  and  meth- 
ods they  use  is  always  scrutinized  by  others.  It  wasn’t  until 
a few  years  ago  that  educators  were  even  allowed  to  use 
the  term  “menstruation”  when  they  taught  sex  ed.  Today, 
most  still  can’t  use  the  other  “M”  word,  masturbation.  Also, 
depending  upon  the  state  they  teach  in,  they  may  not  even 
be  able  to  use  words  like  “condom”  in  the  classroom.  Many 
times,  you  can  find  whole  curriculum  that  don’t  include 
these  words. 

4 . We  have  to  go  to  the  source,  not  expect  the  source  to  come 
to  us.  Until  we  are  all  reading  the  sex  ed  and  sex  research 
journals,  we  are  not  going  to  be  able  to  know  the  problems 
already  faced  in  the  field.  So  far,  we  have  not  been  open  to 
sex  educators.  We  haven’t  invited  them  to  join  us,  and 
haven’t  provided  a means  for  their  voices  to  be  heard  among 
us.  We  need  to  go  to  them.  I can  count  on  one  hand  the 
number  of  educational  researchers  who  routinely  are  in- 
volved in  the  sex  education  field  and  attend  those  profes- 
sional meetings.  If  we  don’t  make  an  effort,  we  can’t  expect 
one  back. 

5.  We  have  to  look  at  our  own  institutions,  whatever  the  level 
of  learner.  Do  we  have  sexual  educators  on  staff?  Is  there 
any  focus  on  teaching  sex  ed,  or  teaching  people  to  teach 
people  to  be  sex  educators?  Do  we  have  courses,  inservices, 
professional  development  opportunities  for  our  sex  edu- 
cators and  teachers  who  need  information  and  resources? 
Do  we  have  the  theory  to  build  upon  the  education? 

I have  to  caution  you  that  if  you  take  my  challenges  seri- 
ously, you  are  in  for  not  only  a lot  of  hard  work,  but  potentially 
a lot  of  challenges  to  your  own  career.  I don’t  recommend  those 
new  to  educational  research  embark  too  deeply  unless  they  have 
the  blessings  of  those  that  have  power  over  their  careers.  I was 
blessed  in  my  pre-professional,  my  graduate  work,  and  my  pro- 
fessional work  with  having  mentors  and  colleagues  who  felt 
that  this  was  an  important  issue,  and  who  “humored”  my  stud- 
ies in  this  area.  However,  I was  always  careful  to  remember 
that  I had  to  do  other  kinds  of  research  when  it  came  time  to 
publish  or  perish.  I learned  that  I had  to  be  careful  in  my  work 
in  this  area,  and  very  serious,  so  that  my  work  might  be  taken 
seriously.  Unfortunately,  the  stigmas  that  sex  has  in  our  society 
often  are  carried  over  to  our  professional  lives,  and  blushing 
colleagues.  This  work  is  typically  not  the  thing  that  gets  shared 
in  hallways  the  ways  other  share  what  they  have  learned. 

However,  there  arc  many  among  us  who  are  far  enough  in 
our  careers  that  we  can  afford  new  challenges,  and  can  stretch 
in  new  directions.  We  can  not  only  expand  our  own  thinking 
into  these  areas,  but  also  bring  along  colleagues.  There  are  many 
challenges,  many  ventures,  many  avenues  awaiting  us  if  we 
choose  to  learn  more  about  learning  about  sex.  I hope  that  you 
will  seriously  consider  my  challenge  and  join  me  in  this  task. 
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The  Role  of  Communication  in  Providing 
Leadership  for  School  Restructuring 

Theodore  J.  Kowalski 
Ball  State  University 

Abstract 

Educational  reform  now  focuses  largely  on  school  restructuring . In  this  context , both  transformational 
leadership  and  cultural  change  paradigms  have  become  critical  issues  for  school  administrators . The 
argument  is  made  that  both  concepts  are  inextricably  linked  to  communication.  Consequently,  leader- 
ship for  change  requires  both  an  adequate  knowledge  base  pertaining  to  leadership  and  organizational 
theory  and  knowledge  and  skill  in  the  area  of  communication  theory.  A research  agenda  for  studying 
communication  in  schools  and  the  inclusion  of  communication  theory  in  the  preparation  of  school  ad- 
ministrators are  recommended . 


During  the  early  1980s,  school  reform  was  character- 
ized by  a seemingly  endless  list  of  intensification  mandates, 
such  as  longer  school  years,  longer  school  days,  and  in- 
creased graduation  requirements.  These  initiatives,  advanced 
by  elected  officials  and  powerful  business  executives,  were 
predicated  on  the  notion  that  higher  levels  of  productivity 
could  be  achieved  by  doing  more  of  the  same  within  the 
existing  structure  of  schooling.  This  strategy  allowed  local 
boards  and  administrators  to  “coast  on  tradition** 
(Danzberger,  Kirst,  & Usdan,  1992,  p.  ix).  In  essence,  these 
local  officials  merely  had  to  implement  and  regulate  ideas 
developed  elsewhere.  But  the  accession  of  school  restruc- 
turing changed  this  condition.  In  the  context  of  decentrali- 
zation, principals  and  superintendents  are  being  asked  to  both 
lead  and  manage  school  and  district  improvement  (Murphy 
& Hallinger,  1987).  As  a result,  their  role  expectations  are 
becoming  more  developmental  than  reactive,  a condition  that 
accentuates  the  symbolic  and  political  frames  of  their  be- 
havior (Bolman  & Deal,  1994). 

The  purpose  of  this  article  is  to  present  the  argument 
that  the  fundamental  means  for  providing  leadership  for 
school  restructuring,  transformational  leadership  and  cul- 
tural change,  are  attenuated  when  administrators  neither 
understand  nor  appreciate  communication  as  a core  element 
in  their  practice.  Further,  the  contention  is  made  that  this 
deficiency  exists  for  most  administrators  because  commu- 
nication theory  has  received  insufficient  attention  in  both 
professional  preparation  and  school-based  research. 

Critical  Elements  of  School  Restructuring 

If  meaningful  school  restructuring  is  to  occur,  the  task 
must  be  addressed  at  two  levels:  a realignment  of  the  school; 
the  need  to  reshape  traditional  power  relationships  between 
public  education  and  its  clientele  (Elmore,  1990;  Conley, 
1993).  Both  assignments  require  transformational  behav- 
iors and  cultural  change  paradigms.  Transformational  lead- 
ership seeks  to  influence  behavior  by  appealing  to  “higher 
ideals  and  moral  values  such  as  liberty,  justice,  equality, 


peace,  and  humanitarianism”  (Yukl,  1989,  p.  210).  Compo- 
nents include  a common  goal  commitment  (both  the  leader 
and  followers  desire  the  same  goal),  the  pursuit  of  higher 
levels  of  morality  (emphasis  on  moral  values  to  govern  be- 
havior), and  a reliance  on  higher-order  needs  (the  leader 
focuses  on  more  advanced  human  needs  when  considering 
motivations)  (Bums,  1978).  In  essence,  transformational 
leaders  seek  to  empower  teachers  and  other  employees  so 
that  collectively  members  of  the  organization  can  eradicate 
existing  unjust,  inequitable,  or  ineffective  conditions  in  their 
cultures  (Kowalski  &Reitzug,  1993).  This  conceptualization 
of  leadership,  however,  has  not  been  dominant  in  either  busi- 
ness (Bennis  & Nanus,  1985)  or  education  (Yukl,  1989). 

Cultural  change  paradigms  are  predicated  on  the  assump- 
tion that  organizational  modifications  are  resisted  either  be- 
cause an  institution’s  culture  is  negatively  disposed  toward 
change  or  because  a specific  initiative  is  incongruous  with 
the  dominant  values  and  beliefs  held  by  those  who  operate 
the  school.  This  approach  to  school  reform  can  be  defined  as 
a revision  of  common  understandings,  occurring  first  at  the 
deepest  level  of  basic  assumptions  and  ultimately  at  the  level 
of  overt  behaviors.  It  is  a process  that  relies  on  transforma- 
tional leadership  styles  to  reshape  the  form  and  content  of  an 
institution’s  symbolic  field  (Mohan,  1993).  In  schools,  ad- 
ministrators are  expected  to  initiate  the  process  by  reading 
the  existing  culture  to  determine  how  fundamental  beliefs  re- 
sult in  positive  or  negative  practices  (Deal  & Peterson,  1990). 
Following  this  diagnostic  stage,  the  leader  promotes  open  and 
democratic  discussions  allowing  members  of  the  culture  to 
determine  the  extent  to  which  modifications  are  necessary. 
These  discussions  become  a forum  for  allowing  members  of 
the  school  family  to  find  common  ground  for  a vision  and  a 
plan  of  action  (Prestine  & Bowen,  1993). 

Since  the  early  1980s,  the  targets  of  educational  reform- 
ers have  shifted  from  students  to  educators  to  schools.  This  is 
evidenced  by  the  fact  that  iterations  of  restructuring,  such  as 
site-based  management,  now  enjoy  center  stage.  Structure 
refers  to  the  formal  ordering  of  roles  in  terms  of  authority,  job 
descriptions,  and  work  assignments;  also  included  are  the  ar- 
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rangements  of  networks  that  affect  formal  and  informal  inter- 
actions (Toth  & Trujillo,  1987).  Restructuring  thus  implies 
the  reshaping  of  these  elements.  In  the  case  of  public  schools, 
advocacy  for  the  process  emanates  from  the  conclusion  that 
centralization  has  encouraged  “lock-step”  programs  that  are 
insensitive  and  unresponsive  to  a changing  world.  As  a re: 
suit,  reform  policy  is  now  heavily  influenced  by  decentraliza- 
tion theory  (the  closer  the  process  of  governance  is  to  those 
affected,  the  more  responsive  it  is  to  real  needs  and  wants). 
The  intent  of  decentralization  is  to  make  schools  less  depen- 
dent on  a hierarchy  of  authority  and  more  inclined  toward 
collegiality  and  shared  authority. 

Because  schools  are  complex  social  systems  in  which 
behavior  is  influenced  by  a network  of  interactions  among 
individuals,  among  formal  and  informal  groups,  and  between 
an  organization  and  its  external  environment  (Kowalski, 
1995b),  effective  decisions  about  education  are  usually  not 
made  unilaterally.  Rather  they  evolve  from  political  actions, 
typically  ending  in  compromise.  Accordingly,  those  who 
have  studied  organizational  change  (e.g.,  Bracey,  1994; 
Murphy,  1991;  Schein,  1996)  often  conclude  that  restruc- 
turing requires  change  agents  who  view  schools  from  a so- 
cial systems  perspective,  i.e.,  leaders  who  see  schools  and 
districts  as  complex  systems  composed  of  interrelated  parts 
that  interact  to  varying  degrees.  With  this  perspective,  one 
is  less  prone  to  suggest  a single  cause  for  the  imperfections 
of  public  education  and  less  inclined  to  believe  that  mean- 
ingful improvement  can  be  produced  by  simply  tinkering 
with  select  institutional  elements.  Philip  Schlechty  (1997) 
wrote,  “Systemic  thinking.requires  us  to  accept  that  the  way 
social  systems  are  put  together  has  independent  effects  on 
the  way  people  behave,  what  they  learn,  and  how  they  learn 
what  they  learn”  (p.  1 34).  As  social  systems,  public  schools 
are  shaped  by  both  formal  structure  and  culture,  by  both 
internal  (within  the  school)  and  external  (community)  po- 
litical transactions.  Therefore,  structural  change  not  sup- 
ported by  cultural  change  eventually  gets  overwhelmed  by 
the  existing  culture  (Schlechty,  1997). 

Among  those  pointing  out  the  importance  of  culture  to 
systemic  change  is  the  noted  psychologist,  Seymour  Sarason 
(1996).  After  studying  failed  reform  efforts  over  the  past 
four  or  five  decades,  he  determined  that  the  “system”  of 
public  education  was  allergic  to  change;  any  effort  to  alter 
one  part  of  a school  was  quickly  obstructed  by  system  wide 
barriers.  He  concluded  that  the  source  of  this  intractability 
was  a pervasive  culture  erected  on  a set  of  assumptions  shared 
by  virtually  all  educators.  He  went  on  to  note  that  this  cul- 
ture evolved  over  time  through  a series  of  political  compro- 
mises between  schools  and  society.  According  to  Sarason, 
it  is  this  macropolitical  relationship  that  makes  it  impossible 
for  us  to  understand  what  goes  on  in  schools  “only  by  rivet- 
ing on  what  goes  on  in  schools”  (p.  2). 

Also  studying  the  effects  of  local  political  pressures  on 
school  district  design,  Jane  Hannaway  (1993)  found  that  even 
in  districts  with  similar  institutional  environments  and  tech- 
nologies, differences  could  be  observed  in  organizational 


design  and  procedures  for  decision  making.  In  summariz- 
ing her  research,  she  concluded,  “The  results  suggest  that 
the  assumption  implicitly  made  by  many  educational  reform- 
ers that  schools  are  free  to  choose  their  organizational  struc- 
ture is,  at  least  to  some  significant  degree,  overdrawn. 
-External  political  pressure  at  the  local  level  appears  to  con- 
strain managerial  arrangements”  (p.  160).  In  essence,  she 
discovered  that  educational  philosophy  and  organizational 
design  are  endogenous  to  local  districts  (Hannaway,  1992). 
Such  findings  suggest  that  neither  structure  nor  culture  are 
manufactured  entirely  by  school  boards,  administrators,  and 
teachers.  Rather  they  are  produced  by  innumerable  internal 
and  external  interactions.  By  focusing  on  the  school  as  a 
social  system,  we  begin  to  comprehend  the  essential  nature 
of  communication  in  both  transformational  leadership  and 
cultural  change  models.  Language  and  its  use  provide  the 
keys  to  understanding  why  things  are  the  way  they  are,  within 
the  school  and  between  the  school  and  its  external  commu- 
nities. In  this  respect,  reshaping  formal  structure  and  insti- 
tutional culture  necessitates  an  appreciation  of  how  schools 
are  affected  by  their  communities  and  in  turn  affect  them 
(Sarason,  1996). 

Unfortunately,  little  research  has  been  done  on  the  spe- 
cific characteristics  of  culture  that  hinder  or  enhance  change 
(Burgess,  1996).  Most  researchers  have  been  preoccupied 
with  finding  relationships  among  phenomena,  and  their  in- 
quiries have  relied  largely  on  positivist  approaches,  Such 
efforts  have  not  provided  a sufficient  picture  of  reality.  In 
order  to  study  behavior  in  a social  systems  context,  forex- 
ample  determining  the  ways  in  which  micro  and 
macropolitical  interest  groups  influence  ideology  and  policy, 
researchers  need  to  use  holistic  paradigms  (Bacharach  & 
Mundell,  1993).  This  alternative  requires  an  understanding 
of  mixed  methodologies  and  a comprehension  of  the  rela- 
tionship between  culture  and  communication. 

The  Relationship  Between  Culture  and 
Communication 

The  relationship  between  culture  and  communication 
may  be  more  expediently  studied  when  both  variables  are 
explained.  Edgar  Schein  (1992)  identified  culture  as  a mul- 
tilevel construct  consisting  of  basic  assumptions , espoused 
values , and  artifacts.  Ihe  basic  assumptions  make  up  the 
deepest  and  most  mental  layer;  here  we  find  the  tacit  beliefs 
educators  hold  about  themselves,  their  relationships  with 
other  people  in  the  school,  and  the  purposes  of  the  school. 
Espoused  values  are  distinguished  by  strategies,  goals,  and 
standards  representing  preferred  behaviors  for  coping  with 
daily  job  requirements.  Artifacts  are  symbolic  manifesta- 
tions of  the  basic  assumptions;  examples  include  language, 
myths,  rituals,  and  ceremonies.  Artifacts  and  espoused  val- 
ues exist  on  or  near  the  surface,  and  thus,  constitute  the  more 
visible  and  identifiable  dimensions  of  culture  (Short  & Greer, 
1997).  By  comparison,  basic  assumptions  are  highly  sub- 
jective and  pose  the  greatest  challenge  to  change  agents. 
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because  identification  typically  requires  extensive  observa- 
tions and  analysis  (Rousseau,  1990). 

School  cultures  are  often  described  quantitatively  on 
the  basis  of  strength,  i.e.,  along  a continuum  ranging  from 
weak  to  strong . Weak  cultures  are  fragmented  and  difficult 
to  discern  because  few  teachers  and  administrators  accept 
common  assumptions  about  professional  responsibility,  stu- 
dent discipline,  and  the  like.  Strong  cultures  are  character- 
ized by  a high  percentage  of  employees  holding  the  same 
assumptions.  In  most  organizations,  including  schools, 
“there  are  often  different  and  competing  value  systems  that 
create  a mosaic  of  organizational  realities  rather  than  a uni- 
form corporate  culture”  (Morgan,  1986,  p.  127).  This  is 
one  reason  why  an  accurate  description  of  a school’s  culture 
is  difficult  to  capture.  While  the  term  strong  cultures  has 
been  linked  to  effective  schools  (e.g.,  Levine  & Lezotte, 
1995),  strength  does  not  indicate  the  quality  of  shared  val- 
ues and  beliefs.  This  attribute  is  more  commonly  described 
along  a continuum  from  positive  to  negative , reflecting  the 
degree  to  which  dominant  assumptions  are  congruous  with 
the  professional  knowledge  base,  encourage  adaptations,  and 
contribute  to  positive  outcomes.  Some  writers  (e.g.,  Mohan, 
1993)  refer  to  cultures  as  being  stable  and  unstable . The 
former  are  characterized  by  clarity  of  purpose  and  vision, 
tendencies  to  view  tradition  with  moderation,  and  leaders 
who  accentuate  the  positive  and  encourage  collective  ac- 
tion; the  latter  are  characterized  by  disagreement  in  core 
values  and  purposes,  high  uncertainty  among  subcultures, 
the  protection  of  tradition  to  avoid  change,  and  low  morale. 


In  organizational  research,  the  ability  to  be  innovative  is 
considered  a positive  attribute  (Burgess,  1996). 

Communication  commonly  has  been  described  as  a loop 
involving  a source,  a receiver,  and  a channel.  This  limited 
perspective  stems  from  the  classical  theory  of  communica- 
tion that  was  articulated  by  Harold  Lasswell  (1948):  “A 
convenient  way  to  describe  an  act  of  communication  is  to 
answer  the  following  questions:  Who..Says  What.in  Which 
Channel.. To  Whom. .With  What  Effects?”  (p.  37).  This 
theory  divides  the  communication  process  into  a series  of 
discrete  parts  that  include  a source,  a message,  a channel,  a 
receiver,  and  feedback  (Pepper,  1994).  This  elementary  view 
was  widely  accepted  because  it  was  easily  understood  and 
readily  assimilated  in  bureaucratic-like  organizations,  i.e., 
the  functions  of  transmitting  information  and  issuing  com- 
mands were  congruous  with  accepted  managerial  responsi- 
bilities in  hierarchies  (Taylor,  1993).  One  of  the  limitations 
of  the  classical  theory  of  communication  relates  to  the  con- 
veyance and  maintenance  of  organizational  culture.  When 
communication  is  treated  merely  as  interaction,  words  are 
judged  to  be  containers  of  thought  and  feelings.  In  truth, 
meaning  is  not  embedded  in  the  content  of  words  but  rather 
the  product  of  a “complex  communicative  process  that  in- 
cludes words,  intentions,  contexts,  histories,  and  attitudes” 
(Pepper,  1994,  p.  9). 

Discussions  of  communication  appearing  in  manage- 
ment literature  have  been  influenced  substantially  by  classi- 
cal theories  of  communication  and  organizations;  that  is  to 
say,  they  usually  focused  on  the  study  of  undesirable  by- 


Table  1 

Common  Communication  Problems  Associated  with  Organizational  Structure  and  Individuals 

Factor  Perceived  Effect 


Size  of  organization 
Reliance  on  a formal  channel 

Hierarchy  of  authority 

Information  Filtering 

Closed  climate 


Poor  listening  skills 

Poor  encoding/decoding  skills 

Lack  of  credibility  or  trust 
Elitism 


Organizational-Based  Problems 

The  larger  the  organization,  the  more  difficult  it  is  to  maintain  effective  communication. 

Attempts  are  made  to  restrict  communication  to  a formal  channel  known  as  the  “chain 
of  command.” 

Because  most  power  and  authority  is  vested  in  a small  number  of  people,  these  indi- 
viduals experience  information  overload  (a  condition  that  reduces  their  effectiveness). 

Because  information  passes  through  a prescribed  channel,  it  gets  filtered  at  each  stage 
of  transmission. 

The  school  or  school  district  discourages  interactions  with  the  community  because 
such  exchanges  are  seen  as  conflict-producing. 

Personal  Problems 

Administrators  are  unable  or  unwilling  to  receive  information. 

Inability  to  structure  messages  appropriately;  inability  to  comprehend  verbal  and  non- 
verbal messages. 

Messages  are  not  accepted  as  being  accurate;  motives  of  administrators  are  questioned. 

Administrators  isolate  themselves,  electing  to  communicate  with  a select  number  of 
powerful  individuals. 
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products  of  bureaucratic  structure  in  the  context  of  discrete 
steps  in  information  exchanges.  For  example,  excessive  lev- 
els of  hierarchy  were  often  deemed  to  produce  undesirable 
communication  outcomes,  such  as  illegitimate  bypassing  and 
reliance  on  informal  channels  (e.g.,  Culbert  & McDonough. 
1985).  Table  1 provides  other  examples  of  organizational 
and  personal  communicative  problems  of  this  type.  While 
these  problems  are  neither  invalid  nor  unimportant,  they 
constitute  a restricted  and  insufficient  perspective  of  orga- 
nizational communication.  As  such,  they  diminish  the  im- 
portance of  communication,  reinforce  erroneous  conclusions 
about  the  connections  between  communication  and  culture, 
and  encourage  modernistic  approaches  to  studying  commu- 
nicative behaviors.  Many  researchers,  for  example,  have 
categorized  organizational  climate  and  culture  as  causal  vari- 
ables while  classifying  communicative  behavior  as  an  inter- 
vening variable.  A proclivity  to  treat  the  relationship  between 
culture  and  communication  in  this  manner  has  been  verified 
by  a macroanalysis  of  communication  research  conducted 
across  all  types  of  organizations;  this  review  found  that  mod- 
ernistic approaches  have  been  far  more  prevalent  than  ei- 
ther naturalistic  or  critical  modes  of  inquiry  (Wert-Gray, 
Center,  Brashers,  & Meyers,  1991).  As  John  Dewey  (1938) 
long  ago  observed. 

The  way  in  which  the  problem  is  conceived  decides 
what  specific  suggestions  are  entertained  and 
which  are  dismissed ; what  data  are  selected  and 
which  are  rejected;  it  is  the  criterion  for  relevance 
and  irrelevancy  of  hypotheses  and  conceptual 
structures,  (p.  138) 

In  this  vein,  a presumed  cause-and-effect  relationship  be- 
tween culture  and  communication  has  limited  our  understand- 
ing of  how  cultures  are  formed  and  how  they  can  be 
transformed. 

More  recently,  enlightened  communication  scholars 
have  provided  a broader  perspective^  organizational  be- 
havior, one  that  views  the  relationship  between  culture  and 
communication  as  reciprocal.  Charles  Conrad  (1994),  for 
example,  wrote,  “Cultures  are  communicative  creations. 
They  emerge  and  are  sustained  by  the  communicative  acts 
of  all  employees,  not  just  the  conscious  persuasive  strate- 
gies of  upper  management.  Cultures  do  not  exist  separately 
from  people  communicating  with  one  another”  (p.  27). 
Stephen  Axley  (1996)  described  the  bond  between  culture 
and  communication  this  way:  “Communication  gives  rise  to 
organizational  culture,  which  gives  rise  to  communication, 
which  perpetuates  culture”  (p.  153).  This  association  im- 
plies that  communication  cannot  be  understood  sufficiently 
by  reducing  it  to  a loop  of  linear  steps  or  by  focusing  re- 
search exclusively  on  the  transmissions  between  senders  and 
receivers  (Katz  & Kahn,  1978).  Instead,  investigators  should 
treat  communication  as  a process  through  which  organiza- 
tional members  express  their  collective  inclination  to  coor- 
dinate beliefs,  behaviors,  and  attitudes.  Put  more  simply,  it 
is  course  of  action  that  people  in  a school  or  district  use  to 
give  meaning  to  their  organizational  lives  by  sharing  per- 


ceptions of  reality.  A negotiated  order  evolves  from  both 
internal  and  external  interactions  among  individuals  and 
groups,  and  this  interplay  occurs  in  the  informal  as  well  as 
formal  organization.  When  viewed  from  this  social  system 
standpoint,  communication  is  a process  that  shapes,  trans- 
mits, and  reinforces  a socially-constructed  culture  (i.e.,  a 
set  of  shared  dimensions  that  form  the  assumptions,  values, 
and  artifacts  of  a particular  organization)  (Mohan,  1993). 

Within  the  framework  of  a cultural  change  model,  prob- 
lem solving  requires  administrators  to  identify  how  individu- 
als perceive  reality  so  this  information  can  be  used  to  erect 
mutual  understandings  about  a school’s  purposes  and  prac- 
tices. This  objective  is  unlikely,  however,  in  situations  where 
administrators  employ  communication  practices,  either  con- 
sciously or  unconsciously,  that  restrict  the  debate  of  values, 
discourage  conflict,  and  limit  access  to  information  (Deetz, 
1992).  Regrettably,  managers  in  many  organizations  con- 
tinue to  treat  information  as  power,  and  they  restrict  access 
to  it  as  a means  of  protecting  personal  power  (Burgess,  1996). 
Superintendents  and  principals  who  fall  into  this  category 
are  incapable  of  actualizing  the  primary  function  of  trans- 
formational leadership — shaping  and  developing  new  norms 
in  the  school  (Carlson,  1996). 

The  reciprocal  relationship  between  culture  and  com- 
munication is  especially  noteworthy  with  respect  to  the  sym- 
bolic frame  of  administration.  When  an  administrator 
appropriately  recognizes  that  organization  does  not  precede 
communication  and  becomes  subsequently  supported  by  it, 
he  or  she  is  more  inclined  to  view  organization  as  an  effect 
of  communication  (Taylor,  1993).  This  changes  our  think- 
ing about  critical  leadership  attributes.  For  example,  cred- 
ibility and  trust  (essential  characteristics  of  leaders  who 
assume  the  role  of  change  agent)  are  not  produced  by  struc- 
ture or  programs;  instead,  they  spring  from  human  interac- 
tions. Unless  leaders  accurately  evaluate  the  effects  of 
communication  on  underlying  assumptions,  and  unless  they 
properly  dissect  the  language  of  a school,  they  probably  can- 
not determine  the  extent  to  which  culture  facilitates  or  ob- 
structs change.  Language  within  an  organization  is  the 
primary  vehicle  through  which  audiences  develop  a sense 
of  order;  the  study  of  language  focuses  on  how  an  institu- 
tion and  its  various  publics  collectively  define  and  partici- 
pate in  organizational  reality  (Toth  & Trujillo,  1987). 

A Call  for  Action 

To  provide  capable  leadership  for  school  restructuring, 
administrators  must  accurately  assess  the  existing  culture 
and  gain  an  understanding  of  how  and  why  it  was  estab- 
lished and  sustained  (Deal  & Peterson,  1990).  The  nexus 
between  culture  and  language  suggest  that  these  tasks  are 
not  achievable  for  administrators  who  lack  an  understand- 
ing of  communication  theory.  Therefore,  two  specific  ac- 
tions are  recommended.  First,  research  on  culture  and 
communication  in  school  settings  should  become  a high  pri- 
ority among  scholars  in  educational  administration.  Tradi- 
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tional  approaches  that  examine  only  select  aspects  of  the 
communication  process,  aspects  such  as  direction  (e.g.,  top- 
down)  and  channels  (formal  and  informal),  fail  to  show  how 
value  orientations  cut  across  organizational  contexts  and 
shape  the  organization’s  culture  (Mohan,  1993).  Second, 
communication  theory  should  be  an  integral  part  of  profes- 
sional preparation  in  school  administration.  This  argument 
was  valid  long  before  school  restructuring  became  a popu- 
lar issue,  because  administrative  work  has  always  centered 
around  interpersonal  relationships.  The  pursuit  of  culture 
change  has  simply  made  the  need  to  study  communication 
theory  more  obvious. 

As  already  suggested,  dominant  perspectives  of  com- 
munication in  schools  have  been  influenced  by  classical 
theory  which  portrays  the  ideal  school  as  tightly  coupled, 
rational,  well-defined,  orderly,  and  logical  (Owens,  1995). 
In  this  utopian  organization,  communication  is  transparent. 
That  is,  it  is  assumed  that  the  “intentions  of  the  message 
sender  can  be  directly  coded  into  explicit  message  language 
or  manifest  content”  (Taylor,  1993,  p.  251).  This  presup- 
poses the  existence  of  a coding-decoding  procedure  allow- 
ing the  sender  and  receiver  to  exchange  the  accurate  and 
complete  meaning  of  a message  through  words.  Based  on 
this  supposition,  a failure  to  communicate  can  be  blamed  on 
one  of  the  following  problems:  (a)  the  coding  procedure  was 
not  properly  used;  (b)  the  sender  did  not  properly  construct 
the  message;  (c)  the  receiver  was  inattentive;  (d)  there  was 
interference  in  transmission  (e.g.,  the  memorandum  got  lost). 
Both  the  supposition  and  simplistic  framework  it  engenders 
disregard  the  significance  of  context  in  information  ex- 
changes (Taylor,  1993), 

Over  time,  we  have  discovered  that  our  schools  are  not 
the  ideal  organizations  proposed  by  classical  theory.  Rather, 
they  are  loosely-coupled  and  composed  of  multiple  subcul- 
tures in  which  ambiguity  and  behavioral  inconsistencies  are 
pervasive.  Behavior  in  them  is  frequently  unpredictable  and 
bewildering.  As  Robert  Owens  noted,  “there  is  often  an 
obvious  disjunction  between  publicly  espoused  values  and 
what  we  do  in  schools”  (p.  10).  When  we  merely  classify 
artifacts  or  identify  espoused  values,  we  usually  capture  a 
limited,  and  frequently  inaccurate  picture  of  culture.  Worse 
yet,  some  administrators  are  inclined  to  ignore  the  percep- 
tions, feelings,  and  emotions  of  other  members  of  the  school 
family  in  assessing  culture.  Instead  they  approach  change 
as  if  their  own  eyes  and  ears  were  sufficient  to  determine 
need  and  direction  (Sharpe,  1996). 

To  reach  the  deepest  levels  of  culture,  and  thus  to  de- 
termine how  communication  influences  behavior  in  schools, 
we  must  rely  on  multidimensional,  multilevel  analyses 
(Mohan,  1993;.  Such  investigations  should  explore  value 
orientations  and  contextual  variables,  especially  with  respect 
to  explaining  how  these  variables  contribute  to  differences 
in  school  cultures  (i.e.,  differences  between  strong  and  weak, 
positive  and  negative,  and  stable  and  unstable  cultures).  This 
form  of  research  requires  interpretive  paradigms  permitting 
us  to  observe,  measure,  and  classify  organizations  from  a 


communication  perspective  (Taylor,  1993).  Interpretivists 
view  reality  as  a subjective  process;  their  goal  is  not  to  de- 
termine the  status  of  the  organization,  rather  they  seek  to 
understand  and  explain  why  a school  is  the  way  it  is.  The 
approach  focuses  on  the  study  of  meaning,  or  put  another 
way,  how  people  make  sense  of  their  world  through  com- 
munication (Wert-Gray  et  al.,  1991).  Schein  (1992),  for  in- 
stance, advocates  studying  culture  through  the  eyes  of  its 
participants  by  engaging  them  in  discussion  centering  around 
five  primary  themes: 

• Relationship  with  the  environment  (What  is  the  pri- 
mary mission  of  the  school?  Whom  do  we  serve? 
What  is  our  relationship  with  the  community?) 

• Reality,  truth,  and  the  basis  for  decisions  (How  do 
members  of  the  organization  determine  if  something  is 
true  or  valid?  What  basic  assumptions  define  reality?) 

• Nature  of  human  nature  (Are  students  inclined  to  do 
good  things?  Are  some  students  predestined  to  fail? 
Are  most  parents  cooperative?) 

• Nature  of  human  activity  (What  assumptions  are  im- 
plicit in  the  problem-solving  techniques  used  in  the 
school?  Should  teachers  make  decisions  alone  or  col- 
lectively? Should  teachers  participate  in  administra- 
tive decisions?) 

• Nature  of  human  relationships  (What  are  the  assump- 
tions about  power  and  authority?  What  social  rela- 
tionships are  acceptable?) 

Accurate  descriptions  of  behavior  in  each  of  these  cat- 
egories are  more  probable  when  the  researcher  has  the  abil- 
ity to  interpret  verbal  and  nonverbal  messages  accurately. 

The  study  of  communication  and  culture  also  can  oc- 
cur in  other  ways.  For  example,  the  researcher  may  concen- 
trate on  the  effects  of  modem  technologies.  The  infusion  of 
new  electronic  devices,  such  as  FAX  machines,  e-mail,  com- 
puters, the  Internet,  and  distance  learning  has  created  po- 
tentialities that  are  both  positive  (e.g.,  increased 
communication)  and  negative  (e.g.,  dehumanized  commu- 
nication). Their  acceptance  and  use  in  schools  also  is  influ- 
enced by  culture.  For  example,  teachers  often  exhibit  an 
unwillingness  to  change  instructional  methods  even  when 
new  technologies  permit  them  to  do  so.  In  another  vein, 
communication-centered  research  can  be  used  to  explore 
moral  and  ethical  issues.  For  instance,  restructuring  prompts 
leaders  to  induce  a reconsideration  of  long-standing  assump- 
tions and  values  or  to  consider  redistributions  of  power  and 
authority.  A range  of  possible  research  topics  is  shown  in 
the  typology  contained  in  Table  2. 

A dearth  of  research  on  communication  in  schools  may 
partially  explain  why  this  topic  has  received  relatively  little 
attention  in  administrator  preparation  programs.  But  ne- 
glect also  appears  to  be  the  product  of  indifference.  Thirty 
years  ago  at  a national  conference  sponsored  by  Project 
Public  Information  and  Stanford  University,  a group  of  schol- 
ars in  school  administration  and  communicarion  theory 
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Table  2 

A Typology  for  Communication  Research  in  Schools 


Focus  Potential  Areas  of  Inquiry 


Institutional  Culture 

• Effects  of  communication  on  shaping  culture 

• Relationship  between  communication  and  culture  (strength,  quality) 

• Communication  among  subcultures  in  schools 

• Use  of  communication  in  socialization,  enculturation 

• Development  of  language  within  a school  culture 

Ethical/Moral  Concerns 

• Leader  influence  on  vision,  goals,  or  ideas 

• Inducing  cognitive  redefinitions,  value  orientations 

• Leader  communicative  behaviors  and  gender  issues 

• Leader  communicative  behaviors  and  the  expression/use  of  power 

• Communication  in  multicultural  contexts 

Organizational  Change 

• Communicating  the  necessity  and  means  for  change 

• Communication  in  “high  support”  and  “high  resistance”  schools 

• Communication  in  periods  of  instability,  crisis 

• Relationship  between  change  strategies  and  communicative  behavior 

• Case  studies  of  successful  and  unsuccessful  change  ventures 

Networks 

• Formal  and  informal  networks 

• Open  and  closed  networks 

• Network  preferences  in  effective  and  ineffective  schools 

Conflict  Resolution 

• Communication  as  a source  of  conflict 

• Inter-  and  intragroup  communication 

• Communicative  behaviors  and  conflict  resolution 

Media  of  Communication 

• Written  versus  oral  communication 

• Electronic  networks 

- effects  on  communicative  behaviors 

- effects  on  accessing  and  using  information 

- effects  on  group  decision  making 

School  Productivity  • Communication  and  administrator  effectiveness 

• Communication  and  employee  effectiveness 

• Communication  and  student  effectiveness 

• Communication  and  community  satisfaction 

Leadership  • Communication  knowledge  base  and  skills  among  school  leaders 

• Leadership  styles  and  communicative  behaviors 

• Language  as  a symbolic  dimension  of  leadership 


joined  forces  to  discuss  the  study  of  communication.  Re- 
cently, the  Journal  of  Educational  Relations  published  a 
monograph  of  that  conference.  A case  for  requiring  admin- 
istrators to  study  communication  was  developed  and  tied  to 
perceived  deficiencies  in  practice.  One  speaker  offered  this 
list  of  reasons  why  educators  communicate  poorly:  (a)  they 
have  a false  impression  of  their  ability  to  communicate;  (b) 
they  are  not  accustomed  to  competing  for  the  public’s  atten- 
tion; (c)  they  operate  in  relative  obscurity  and  are  unpre- 
pared for  the  public’s  interest  and  scrutiny  ; (d)  they  minimize 
the  value  of  outside  opinions;  (e)  they  have  little  communi- 
cation experience  and  almost  no  meaningful  communica- 
tion training  (Christian,  1997).  While  some  of  the 
recommendations  presented  at  that  conference  have  been 


addressed  adequately  by  the  National  School  Public  Rela- 
tions Association,  one  that  has  gone  unheeded  pertains  to 
integrating  communication  theory  into  the  preparation  of 
school  administrators  (Holliday,  1997).  A lack  of  action  in 
this  area  is  especially  disconcerting  in  light  of  mounting 
evidence  that  the  work  of  school  administrators  is  perme- 
ated by  interpersonal  relationships  and  the  use  of  informa- 
tion. Such  evidence  can  be  found  in  reviews  of  change 
literature  (e.g.,  Fullan,  1991;  Hord,  1992),  studies  of  inter- 
personal relationships  between  principals  and  teachers  (e.g., 
Bredeson,  1987;  Rcitzug,  1989;  Martin  & Willower,  1981; 
Willower  & Kmetz,  1982 ),  and  studies  of  the  work  lives  of 
superintendents  (e.g.,  Blumbcrg,  1985;  Kowalski,  1995a). 
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Table  3 

Possible  Themes  for  the  Study  of  Cot , , unication  in  Administrator  Preparation 

Theme  Examples  of  Content 

Communication  Theory  Organizational  Behavior  How  language  and  communication  build  and  sustain  culture;  and 

how  communication  is  used  to  negotiate  order;  the  role  of 
communication  in  organizational  change. 

Community  Relations  Two-way  communication  channels;  encouraging  interaction  with 

the  community  environment;  public  relations;  building  community 
support. 

Communication  and  School  Effects  on  employee  performance;  communication  as  a form  of 

Outcomes  motivation;  effects  on  student  outcomes. 

The  Symbolic  Frame  of  Leader  Behavior  Communication  and  organizational  symbolism;  language  as  form 

of  symbolic  expression;  modeling  desired  changes. 

Modern  Technologies  Potential  benefits  of  modern  technologies;  potential  problems 

related  to  using  modern  technologies  for  communication;  effective 
control  of  modern  technologies. 

Moral/Ethical  Dimensions  Communication  as  an  expression  of  power;  inducing  cognitive  and 

value  changes;  empowerment  and  shared  governance. 

Interpersonal  Relations  Dimensions  of  communication;  conflict  resolution;  open 

communication. 


Communication  is  commonly  addressed  in  courses  on 
school-community  relations  and  public  relations;  some  newer 
textbooks  on  organizational  behavior  in  schools  also  pro- 
vide limited  material  on  the  subject  (e.g.,  Hanson,  1966).  In 
most  instances,  however,  organizational  communication  re- 
ceives only  superficial  treatment.  Rarely  is  the  subject  ex- 
amined thoroughly  in  relation  to  culture  and  the  politics  of 
school  reform.  If  adequate  coverage  is  to  be  provided,  at 
least  seven  themes  need  to  be  addressed;  they  are  outlined 
in  Table  3.  The  scope  of  these  themes  suggests  that  at  least 
one  separate  course  on  communication  and  interpersonal 
relationships  should  be  required  in  professional  preparation. 

Concluding  Comments 

When  the  United  States  moved  from  an  agrarian  to  a manu- 
facturing society  at  the  start  of  the  twentieth  century,  public  edu- 
cation was  reshaped  from  a system  of  largely  one-room  country 
schoolhouses  to  modem  organizations  displaying  many  facets  of 
bureaucracy  and  scientific  management.  The  more  recent  tran- 
sition to  an  information  society,  however,  has  not  yet  produced  a 
parallel  realignment  despite  intense  criticism  and  sustained  calls 
for  educators  to  do  so.  Consequently,  formal  structures  and  cul- 
tures crafted  nearly  100  years  ago  remain  operative  in  a majority 
of  our  public  schools. 

On  the  surface,  the  idea  of  reinventing  schools  from  the 
center  is  appealing  because  it  is  congruous  with  democratic 
governance,  decentralization  theory,  and  professionalism 
(Carlson,  1996).  But  the  goal  also  remains  highly  ambigu- 
ous. Neither  the  means  nor  the  ends  for  restructuring  are 
certain  (Leithwood,  1994).  Nevertheless,  three  critical  facts 
shape  the  reform  mission:  (a)  the  school  has  become  the 
primary  target  for  reform;  (b)  administrators  arc  expected 


to  provide  the  leadership  necessary  for  institutional  renewal; 
(c)  decentralization  theory  has  been  adopted  as  the  concep- 
tual guide  for  change.  As  Kenneth  Leithwood  ( 1994)  accu- 
rately concluded,  these  circumstances  require  commitment 
rather  than  control  strategies.  What  educators  believe  and 
value  is  deeply  situated  in  their  institutional  cultures,  and  it 
is  when  we  start  to  think  about  the  capacity  for  change  within 
a cultural  context  that  communication  emerges  as  a critical 
variable.  Discussing  the  process  of  building  a capacity  for 
change,  Philip  Schlechty  (1997)  offered  a list  of  inhibiting 
factors  that  pertain  to  communication:  a lack  of  communi- 
cation within  schools,  between  schools,  and  between  schools 
and  society;  public  misperceptions  about  educational  pur- 
poses and  practices;  ignoring  the  opinions  of  teachers  who 
seek  to  do  things  differently;  minimal  teacher  input  regard- 
ing student  expectations;  the  lack  of  a centralized  system 
for  disseminating  accurate  information  at  all  levels  of  the 
decision-making  process;  and,  inadequate  opportunities  and 
procedures  for  teachers  to  share  innovative  ideas. 

If  behaviors  in  schools  were  random  rather  than  the  prod- 
uct of  fundamental  assumptions  cutting  across  institutional 
experiences,  cultural  transformations  could  more  easily  be 
achieved  by  simply  replacing  personnel  or  juggling  organi- 
zational charts  (Robbins,  1996).  But  this  clearly  is  not  the 
case.  Even  in  schools  where  there  is  a positive  disposition 
toward  change,  educators  are  likely  to  be  incapacitated  by 
their  lack  of  knowledge.  Seymour  Sarason  (1996)  pessi- 
mistically concluded  that  educators  were  incapable  of  re- 
newing their  own  institutions  because  they  were  ignorant  of 
organizational  culture  and  the  change  process;  and  he  chas- 
tised teachers  and  administrators  for  rarely  reading  profes- 
sional journals  and  books  that  could  enlighten  them  on  these 
topics.  In  his  book.  Leading  Minds , Howard  Gardner  (1995) 
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provides  another  critical  element.  He  agrees  with  the  con- 
tention that  leaders  must  possess  the  technical  knowledge 
associated  with  change,  but  he  goes  on  to  point  out  that  such 
knowledge  is  of  limited  value  if  leaders  do  not  have  the  com- 
munication skills  necessary  to  build  support  for  their  ideas. 

In  the  past  an  indifference  toward  studying  communi- 
cation was  less  debilitating  because  an  imposed  structure, 
supported  by  a culture  that  viewed  schools  as  agencies  of 
stability,  resulted  in  role  expectations  that  were  largely  mana- 
gerial. Today,  conditions  are  clearly  different.  Policymakers 
are  asking  educators  to  venture  into  unfamiliar  and  risky 
territory.  More  precisely,  they  are  asking  administrators  to 
assume  responsibilities  for  which,  at  best,  they  have  been 
marginally  prepared.  Those  of  us  who  educate  practitioners 
have  a moral  and  professional  responsibility  to  address  this 
problem.  At  the  very  least,  we  should  focus  our  research  on 
issues  of  practice  that  relate  to  cultural  transformations,  and 
we  should  provide  our  students  with  a comprehensive  un- 
derstanding of  communication. 
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A couple  of  years  ago,  I was  winding  down  a four-year  ap- 
pointment as  an  instructional  designer,  supporting  faculty  in  their 
efforts  to  leam  how  to  use  technology  in  their  teaching.  In  this 
capacity,  I offered  hands-on  training,  customized  lessons,  and 
individualized  consultation  on  a wide  range  of  technology-re- 
lated topics.  It  was  not  uncommon  for  me  to  spend  two  to  three 
weeks  learning  all  the  ins  and  outs  of  a piece  of  software,  creat- 
ing step-by-step  documentation,  and  building  a database  of  tips, 
tricks,  and  applications  for  its  use  in  the  higher  education  class- 
room. Now  that  I am  in  a tenure-track  teaching  position,  I no 
longer  have  three  weeks  to  leam  anything  (especially  new  soft- 
ware) and  think  up  ways  to  use  it;  it’s  all  I can  do  to  join  my 
colleagues  in  the  on-going  struggle  to  teach,  do  research,  serve 
on  committees,  and  try  to  keep  up.  I tell  you  this  only  because  I 
want  you  to  know  that  I am  not  just  another  “techie”,  but  one 
who  has  been  on  both  the  technology  support  and  faculty  sides 
of  the  fence. 

Today,  I would  like  to  dialogue  with  you  about  this  reality  of 
the  college  professor  and  technology  in  the  ‘90’s.  What’s  hap- 
pening with  technology  at  your  institution?  Why  do  you  think  we 
need  it?  Why  do  you  want  it?  What  makes  implementing  it  in 
your  teaching  so  difficult?  Where  are  you  with  it  personally,  and 
what  tricks  can  we  come  up  with  to  make  it  an  integral,  support- 
ive aspect  of  your  professional  life? 

First,  if  your  institutional  environment  is  anything  like  mine, 
administrators  are  lauding  the  potential  of  technology  and  seek- 
ing funds  to  expand  technology  resources  for  teaching.  In  fact, 
much  of  the  new  money  being  spent  in  higher  education  today  is 
for  technology.  Few  administrators  have  given  much  thought  to 
supporting  faculty  in  finding  ways  to  integrate  the  technology 
effectively  into  teaching,  however.  It’s  just  expected!  Those  with 
more  insight  are  hiring  support  staff  who  often  reach  a small 
minority  of  the  faculty  masses. 

Meanwhile,' there  is  a lot  of  pressure  on  faculty  to  make  the 
technology  ’Svork,”  that  is  improve  teaching,  increase  enrollments 
or  retention,  expand  ways  to  “instruct”  non-traditional  students, 
etc.  A few  faculty  are  excited  about  the  winds  of  change  and 
have  been  first  in  line  to  seek  out  the  college’s  resources  to  break 
new  ground,  in  spite  of  all  the  growing  pains  associated  with 
being  on  the  “(b)leading  edge.” 

The  rest  of  us  range  from  “show'  me  how,  and  I’ll  try”  to 
“who  has  time?  ask  me  next  year”  to  “let  Mikey  do  it  and  than 
I’ll  see”  to  “make  me!”  Some  of  us  are  concerned  about  the 
apparent  emphasis  on  technology  for  its  own  sake,  rather  than 
seeing  it  as  one,  potentially  useful  tool.  Others  feel  the  “tool” 
analogy  supports  tire  adage  that  “When  all  you  have  is  a ham- 
mer, everything  looks  like  a nail.”  A few  bemoan  the  difficulty 
technology  creates  in  keeping  a moral  purpose  to  what  we  do 
in  the  forefront;  how  are  we  going  to  find  happiness  in  all  of 
this?  Added  to  the  pot  are  our  students  who  are  coming  out  of 
high  school  (or  increasingly  out  of  work  environments)  with 
more  technology  skills  than  ever.  They  expect  faculty  in  the 
‘90’s  to  use  technology  if  they  are  up-to-date  in  their  fields. 


Hmmm... maybe  Borg  (Star  Trek)  is  right:  “Resistance  is  futile. 
You  will  be  assimilated.” 

So,  where  are  we  with  all  of  this?  IS  resistance  futile?  In  my 
opinion,  technology  is  not  a passing  fad;  we  CAN  find  ways  for 
it  to  make  a positive  difference  in  our  professional  lives  and  that 
of  our  students;  we  must  find  effective  ways  to  use  it  in  higher 
educadon  for  a large  number  of  legitimate  reasons.  However,  I 
don’t  think  technology  is  an  educational  panacea.  I DO  know 
that  it  is  not  easy  for  faculty: 

• to  carve  out  time  for  exploring  the  multitude  of  available 
options  in  order  to  choose  a match  with  your  level  of  tech- 
nology experience  and  particular  teaching  style. 

• to  identify  cheap,  effortless,  or  feasible  options  to  do  this 
year,  especially  when  our  retention  or  tenure  criteria  do 
not  reward  technology-related  effort. 

• to  find  a meaningful  place  for  technology  within  our  own 
academic  or  teaching  passions. 

• to  develop  confidence  when  the  “big  guns”  are  into  huge 
projects,  lucrative  grants,  or  high-end  applications  of  tech- 
nology. 

• to  overcome  the  frustrations  that  are  inevitable  as  we  try  to 
leam  the  technology  skills  necessaiy  to  implement  our  ideas 
and  deal  with  information  overload. 

• to  work  with  support  staff  who  sometimes  speak  in  “techno- 
babble” or  try  to  take  over  (or  simply  cannot  respond  to 
our  needs  immediately). 

• to  implement  our  ideas  when  the  technology  is  not  readily 
accessible  in  the  classroom  or  not  reliable  when  it  is  there. 

Now,  we  can  continue  to  dwell  on  the  “poor  us”  scenario, 
or  we  can  accept  the  downside  of  it  all  and  rise  above  it  to  focus 
instead  on  the  opportunities  technology  is  affording  us,  espe- 
cially some  practical  ideas  on  how  we  can  make  it  work  FOR 
us,  at  least  in  the  short-run. 

Now  that  most  of  us  have  a computer  on  our  desk  and  e- 
mail  access,  what  are  some  reasons  that  we  might  WANT  tech- 
nology to  be  a part  of  our  professional  lives?  Would  you  agree 
that  we  want: 

• to  be  in  touch  with  colleagues  we  can  be  energized  by  or 
share  information  with? 

• to  access  information  that  we  need  faster  and  easier? 

• to  be  up-to-date  and  effective  in  our  respective  disciplines? 

• to  be  in  touch  with  our  students  who  are  enrolled  at  a dis- 
tance so  that  we  can  easily  exchange  information  and  get 
acquainted? 

• to  relate  to  our  tech-savvy  students? 

• to  be  able  to  reach  students  with  new  instructional  strate- 
gies made  possible,  easier  or  more  interesting  with  tech- 
nology'? perhaps,  even  breathe  new  life  into  courses  taught 
many  times  in  the  past? 

• to  recei  ve  technology  or  other  types  of  perks  that  adminis- 
trators dole  out  periodically? 

• to  have  a diversity  of  ways  to  express  our  ideas? 
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• to  have  grant-writing  and  research-in-teaching  opportunities? 

• to  receive  local  recognition  and  state/regional/national  op- 
portunities to  share  our  technology  experiences? 

• to  avoid  looking  stupid? 

• to  increase  the  opportunity  to  talk  with  upbeat  people  and 
learn  from  colleagues  with  more  experience? 

You  can  probably  think  of  dozens  of  other  reasons  we  might 
want  technology  to  be  present  in  our  professional  environments. 
The  important  thing  is  to  find  a personalized  combination  of 
technology-related  activities  that  will  help  you  learn  about  tech- 
nology in  education  while  serving  your  personal  and  profes- 
sional needs. 

Personalized  combo,  you  say?  The  trick  is  to  take  a quick 
look  at  some  of  the  tips  and  ideas  below  that  I have  practiced 
myself  or  observed  others  do  during  recent  years.  Choose  the 
ones  that  fit  your  time,  interests,  and  readiness  as  far  as  technol- 
ogy is  concerned.  The  main  objective  here  is  to  have  a plan  that 
begins  where  you  are  and  helps  you  move  toward  finding  a 
technology  niche  that  you  can  be  energized  by  and  rewarded 
by.  A niche,  you  say?  Yes.  Give  up  on  the  idea,  for  now,  that 
you  are  going  to  change  the  world  and  do  a project  that  will 
rival  the  “big  guns.”  For  most  of  us,  successful  integration  of 
technology  into  our  professional  lives,  especially  teaching,  be- 
gins with  a plan  that  has  a step-wise  “feel”  to  it.  Beginning  with 
the  development  of  a multimedia  CD-ROM,  for  example,  is 
rarely  wise.  Instead,  consider  one  of  the  following  groups  of 
tips  to  lead  you  to  your  niche. 

Find  a niche:  Getting  Started 

• Locate  the  best  sources  of  help  and  training  available  to 
you  on  campus  or  in  your  community,  as  well  as  a training 
schedule.  Commit  yourself  to  getting  some  training  or  one- 
on-one  consultation. 

• Locate  equipment  and  software  that  are  better  than  your 
own  and  accessible  to  you.  You  might  need  this  for  future 
work. 

• Find  out  what  technology  is  available  in  classrooms  you  can 
use,  and  labs  or  other  locations  your  students  can  use. 

• Buy  a computer  system  at  home  and  purchase  Internet  ac- 
cess from  there. 

• Identify  undergraduate  students  who  might  be  interested  in 
independent  study  with  or  about  technology,  or  graduate  stu- 
dents who  are  tech-savvy  and  enthusiastic  about  using  it  for 
professional  activities  (research,  presentations,  etc.). 

• Team  up  with  persons  who  know  more  than  you  or  have 
more  courage  when  it  comes  to  trying  new  things  with  tech- 
nology, and  network  with  them. 

• Have  lunch  occasionally  with  creative  friends. 

• Use  e-mail  everyday  (and  the  Internet  for  searching  at  least  weekly). 

• Identify  internal  grants,  release  time  possibilities,  and  external 
fund  sources  related  to  your  teaching  and  research  interests. 

Find  a niche:  Streamlining  Office  Management 
(while  building  tech  skills) 

• Learn  how  to  filter  your  e-mail,  create  an  electronic  ad- 
dress book,  and  separate  your  student  e-mail  from  your 
professional  e-mail. 


• Join  a listserv  in  your  discipline,  but  be  callous:  delete 
unread  e-mail  from  listservs. 

• Learn  how  to  do  your  grades  on  a spreadsheet. 

• Find  five  super  Web  sites  in  your  discipline  and  bookmark 
them;  access  weekly  for  updates. 

• Furnish  your  workspace  with  gentle  lighting  and  colorful 
visuals  to  remind  you  (when  you  are  using  high-tech  equip- 
ment) that  you  are  a human  being  in  a high-touch  field, 
focusing  on  information,  communication,  and  relation- 
ships— not  equipment. 

• Read,  rather  than  skip,  articles  in  your  trade  journals  about 
technology  use  in  your  discipline,  about  good  Web  sites  in 
your  field,  about  ways  other  faculty  are  using  technology 
for  teaching  and  learning. 

• Watch  for  technology  humor;  you’  11  need  it! 

Find  a niche:  Putting  a plan  into  motion 

• Inventory  your  current  teaching  philosophy  and  passions, 
your  current  research  or  presentation  plans,  and  the  “hot 
topics”  valued  by  your  department  or  division  this  year. 

• Ask  yourself  “how  can  technology  help  me  do  any  of  this 
(better)?”  If  you  are  very  new  to  technology,  you  may  find 
it  helpful  to  ask  this  question  of  more  experienced  col- 
leagues, friends  at  other  institutions,  technology  or  faculty 
development  support  staff,  or  your  children! 

• Ask  yourself  if  you  are  more  interested  in  teaching  with  tech- 
nology yourself  or  having  your  students  use  it  to  learn. 

• Begin  a log  of  ideas. 

• Consider  the  time  you  want  to  commit  to  this  technology 
“thang”  this  semester  or  this  year,  who  you  can  enlist  to 
collaborate  on  it  with  you  (collaboration  is  much  more 
successful  than  random  “try-its”),  and  your  current  level 
of  experience  using  technology  for  educational  purposes. 

• Evaluate  the  items  on  your  log  and  the  current  demands  on 
your  time:  what  would  you  like  to  try  this  year  that  would 
support  your  current  demands?  what  would  you  like  to 
begin  learning  for  a fresh  idea  next  year? 

• Apply  for  internal  or  external  funding  to  support  a project 
idea  that  excites  you. 

It  is  1997  and  technology  is  affecting  all  aspects  of 
our  lives,  and  the  lives  of  our  students.  We  are  faculty,  em- 
ployed by  institutions  of  higher  learning  who  are  interested  in 
integrating  technology  that  supports  teaching  and  learning.  We 
recognize  both  the  hype,  the  potential,  and  the  challenges  asso- 
ciated with  finding  effective,  efficient,  and  appealing  ways  to 
use  technology  in  our  teaching.  Times  could  be  better,  but  they 
could  also  be  a lot  worse!  “We  must  prepare  ourselves  and  our 
students  for  our  future,  not  our  past.  And  the  future  is  not  what 
it  used  to  be!”  (B.  O.  Barker,  personal  communication,  April, 
1997)  That  means  finding  meaningful  ways  to  bring  technol- 
ogy into  our  professional  lives,  especially  ways  that  impact 
positively  on  our  students.  It  does  not  mean  we  must  give  up 
our  other  passions.  We  must  seek  ways  to  integrate  them  to- 
gether! I hope  some  of  the  ideas  we  have  explored  today  will 
help  you  find  ways  to  do  that  in  your  own  environment.  I invite 
you  to  share  with  me  other  tips  for  accomplishing  the  task  as 
you  discover  them!  Good  luck! 
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Teacher’s  Lives  and  Beliefs : Influences  That  Shape 
the  Teaching  of  U.  S.  History 

Michael  H.  Romanowski 
Ohio  Northern  University 

Abstract 

The  purpose  of  this  study  was  to  examine  the  complex  influences  that  shape  the  teaching  ofU.  S.  history. 
Six  secondary  American  history  teachers  participated  in  interviews  and  classroom  observations  center- 
ing on  factors  that  affect  their  approach  to  the  teaching  of  U.  S . history.  Findings  indicate  that  there  are 
various  influences  that  play  a significant  role  in  determining  the  version  of  U.  S.  history  students  have 
the  opportunity r to  learn.  These  include  teachers'  personal  beliefs  about  religion  and  morality , the 
affect  of  history  professors,  and  teachers'  social  class  and  family  backgrounds.  Several  suggestions  are 
made  as  to  how  teacher  education  programs  can  encourage  pre-service  teachers  to  exc,  nine  the  influ- 
ences that  shape  their  lives,  classrooms,  and  students. 


During  a recent  class  observation,  I was  struck  by  a par- 
ticular statement  made  by  the  student  teacher.  At  the  begin- 
ning of  a lesson  while  passing  out  a handout  on  political  party 
platforms,  the  student  teacher  attempted  to  place  herself  in  a 
neutral  space  by  stating  that  she  neither  favored  nor  opposed 
any  of  the  parties*  positions.  She  informed  the  class  that  her 
views  were  unimportant  and  her  goal  was.simply  to  discuss 
how  the  individual  political  parties  platforms  differed. 

The  lesson  began  and  the  student  teacher  quickly  omit- 
ted the  areas  regarding  the  current  state  of  the  economy  and 
taxes  and  chose  the  abortion  issue  to  start  class  discussion. 
Leading  questions  soon  revealed  this  teacher’s  acceptance 
of  abortion  in  cases  of  rape  and  incest.  Gun  control  was 
next  on  the  agenda,  and  as  the  discussion  progressed,  one 
student  who  opposed  any  type  of  weapons  restrictions  was 
asked  by  the  student  teacher  “how  often  do  you  need  assault 
weapons  to  kill  deer?’*  When  affirmative  action  surfaced, 
the  class  was  introduced  to  a California  case  where  a quali- 
fied white  male  was  refused  admission  to  medical  school 
because  of  the  use  of  quotas.  A personal  experience  was 
introduced  to  further  illustrate  her  point.  Finally,  additional 
issues  such  as  funding  for  the  arts  and  homosexual  rights 
were  dismissed  as  unimportant  and  the  class  moved  to  a vid- 
eotape dealing  with  the  presidential  election. 

Not  bad  for  a brief  lesson.  Powerful  messages  were  com- 
municated to  students  through  interaction  with  their  student 
teacher.  Students  learned  that  abortion  was  acceptable  in  cer- 
tain circumstances;  government  control  of  weapons  was  a good 
thing;  affirmative  action  was  not  working;  and  other  political 
issues  such  as  taxes,  state  of  the  economy,  funding  for  the  arts 
and  homosexual  rights  were  not  important  enough  to  merit 
class  discussion.  More  importantly.,  students  learned  that  the 


Special  appreciation  is  extended  to  those  teachers  who 
shared  their  classrooms  and  life  experiences.  The  author 
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teacher’s  views  are  of  the  highest  value  since  these  views  domi- 
nated the  direction  of  class  discussion.  Although  the  student 
teacher  claimed  to  be  neutral  and  none  of  the  above  messages 
were  listed  in  her  lesson  plan,  these  and  other  messages  did 
nonetheless  flow  predictably  and  consistently  from  her  teach- 
ing and  questioning  strategies. 

Clearly,  this  scenario  confirms  that  the  individual 
teacher’s  “personal  theories  and  beliefs  serve  as  the  basis 
for  classroom  practice  and  curriculum  decision  making” 
(Ross,  Cornett,  & McCutcheon,  1992,  p.  3).  The  manner  in 
which  teachers  experience  and  understand  the  world  plays  a 
significant  role  in  defining,  selecting,  and  organizing  infor- 
mation in  their  classroom.  This,  in  turn,  constructs  the  ver- 
sion of  U.  S.  history  that  students  have  the  opportunity  to 
learn.  In  the  following  discussion,  I address  the  compli- 
cated process  of  teaching  U.  S.  history  in  secondary  class- 
rooms and  the  role  that  teacher’s  lives  and  beliefs  play  in 
shaping  the  U.  S.  history  curriculum. 

The  Role  of  Beliefs  and  Life  Experiences 
in  Teaching 

Few  would  argue  that  teaching  is  not  a complicated  task 
that  is  saturated  with  both  explicit  and  implicit  personal  val- 
ues and  beliefs.  Since  teaching  requires  evaluation,  inter- 
pretation, and  choice,  the  process  is  never  value-free  or 
neutral.  Located  beneath  the  classroom  practice  of  every 
teacher  is  an  elaborate  set  of  beliefs  that  are  interwoven  into 
the  fabric  of  one’s  personal  and  professional  life.  This  be- 
lief system  serves  as  an  organizing  framework  that  estab- 
lishes patterns  of  meaning,  determines  right  and  wrong,  aids 
in  historical  interpretation,  informs  evaluations,  and  more 
or  less  forms  a coherent  picture  or  argument.  These  beliefs 
and  values  guide  teachers’  decisions  regarding  curriculum 
and  instruction. 

This  complex  belief  system  includes  individual  life  phi- 
losophies, habits,  personal  experiences,  and  social  histories, 
all  of  which  permeate  teachers’  understanding  of  their  work, 
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their  students,  the  subject  matter,  and  their  roles  and  respon- 
sibilities as  classroom  teachers.  In  order  to  better  under- 
stand the  role  beliefs  play  in  teaching,  these  systems  “may 
be  conceived  as  minitheories  of  the  mind,  ways  of  charac- 
terizing language  and  behavior. . . they  are  part  of  the  social 
and  cultural  truths  to  which  individuals  try  to  adhere  in  daily 
living”  (Horowitz,  1994,  p.  3).  They  can  be  better  under- 
stood as  “mental  constructions  of  experience”  (Sigel,  1985, 
p.  351)  which  are  organized  into  concepts  that  are  consid- 
ered to  be  true  and  used  to  guide  behavior  (Pajares,  1992). 
Furthermore,  belief  systems  serve  as  an  individual’s  view  of 
reality  that  holds  enough  truth  to  guide  his  or  her  thoughts 
and  behavior  (Harvey,  1986). 

Belief  systems  are  essential  because  not  only  do  they 
shape  the  way  teachers  define  and  understand  physical  and 
social  realities,  but  beliefs  foster  schools  of  thought  and  are 
unavoidably  intertwined  with  knowledge.  Teachers’  beliefs 
have  been  the  center  of  much  research,  and  the  concept  has 
been  labeled  with  a of  variety  terms.  For  example,  Clark 
•(1988)  labels  teachers’  beliefs  “preconceptions  and  implicit 
theorie”  while  Goodman  (1988)  terms  them  the  “teachers’ 
perspectives.”  In  addition,  the  concept  of  “frame”  is  often 
used  to  describe  the  underlying  assumptions  that  influence 
the  teachers’  actions  in  the  classroom  and  their  interaction 
with  subject  matter  (Schon,  1983;  Wyer  and  Srull,  1984; 


Barnes,  1992).  This  refers  “to  the  clustered  set  of  standard 
expectations  through  which  all  adults  organize,  not  only  their 
knowledge  of  the  world  but  their  behavior  in  it.  We  might 
call  them  the  default  settings  of  our  daily  lives”  (Barnes, 
1992,  p.  16). 

It  is  vital  to  understand  that  U.  S.  history  teachers  are 
not  merely  “passive  transmitters  of  knowledge”  (Elbaz,  1981, 
p.  43).  Rather,  each  teacher  brings  his  or  her  own  individual 
experiences,  beliefs,  attitudes,  and  ways  of  looking  at  the 
world  to  the  classroom.  All  teachers  become  “curriculum 
choice  makers”  who  apply  their  beliefs  and  perspectives  in 
making  decisions  about  the  particular  content  that  they  will 
teach  (Ben-Peretz,  1990).  These  pedagogical  decisions  re- 
quire that  teachers  engage  in  “a  dialogue  between  the  text- 
book, their  own  version  of  the  subject  matter,  and  the  class” 
(Gudmundsdottir,  1990,  p.  48).  This  belief  guided  works  to 
select,  organize,  and  frame  materials  to  form  a coherent  pic- 
ture or  argument  of  a particular  content  area  (Wade,  Th- 
ompson & Watkins,  1994).  The  end  result  is  the  manipulation 
of  knowledge  and  curriculum  to  fit  the  individual  teacher's 
orientation  toward  the  subject  matter  (see  Figure  1). 

As  shown  in  Figure  1 , there  are  multiple  influences  that 
play  critical  roles  in  the  dialogue  that  teachers  engage  in 
regarding  students,  instruction,  and  subject  matter.  This  dia- 
logue is  a complex  process  that  continually  constructs  and 
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reshapes  a teacher's  orientation  toward  his  or  her  subject 
matter.  This  orientation  is  then  articulated  to  students  through 
the  teacher’s  voice.  The  concept  of  orientation  can  be  re- 
ferred to  as  “the  specific  ways  in  which  an  individual  looks 
at  the  world”  (Van  Manen,  1977,  p.  211).  Often  described 
as  a world  view,  a “point  of  view,  perspective,  a person’s 
way  of  looking  at  things,  outlook,  standpoint  and  so  on” 
(Van  Manen,  1977,  p.  211),  a person's  orientation  is  com- 
posed of  what  he  or  she  believes  to  be  true,  to  be  valuable, 
and  to  be  real.  As  shown  in  Figure  1 , an  individual’s  orien- 
tation always  surfaces  in  the  classroom  as  the  teacher’s  voice 
or  personal  curriculum. 

Dialogue  occurs  differently  for  every  teacher.  Some 
teachers  consciously  design  an  orientation  while  others  de- 
velop an  orientation  by  default.  For  example,  experienced 
teachers  are  possibly  more  aware  of  these  influences,  more 
attentive  to  the  role  that  their  voices  play  in  the  classroom 
and  therefore  play  an  active  role  in  constructing  their  orien- 
tation. On  the  other  hand,  a novice  teacher’s  orientation 
might  be  shaped  by  default  with  little  consciousness  on  the 
part  of  the  individual.  Hence,  this  teacher  may  believe  that 
he  or  she  is  objective  and  see  little  effect  of  his  or  her  beliefs 
on  the  U.  S.  history  curriculum. 

The  concept  of  voice  has  been  central  to  the  research 
on  teacher  knowledge,  and  it  should  be  noted  that  other  re- 
searchers have  employed  terms  similar  in  meaning,  such  as 
personal  or  teacher’s  perspective,  personal  theory,  implicit 
theory,  personal  practical  knowledge,  personal  curriculum, 
and  teacher’s  lives  (Butt,  Raymond,  & Yamagishi,  1988; 
Clark  & Peterson,  1985;  Connelly  & Clandinin,  1987; 
Gilligan,  1982;  Goodson,  1991;  McDonald,  1988).  This 
type  of  research  centers  on  the  idea  that  teachers  bring  their 
lives  to  the  classroom  and  that  these  lives  are  made  up  of  a 
cluster  of  complex  experiences,  beliefs,  and  worldviews. 
More  importantly,  the  teacher's  life  and  belief  system  are 
instrumental  in  defining,  selecting,  and  organizing  informa- 
tion in  which  students  have  the  opportunity  to  learn. 

The  end  result  of  this  process  is  pedagogical  content 
knowledge  (Gudmundsdottir,  1990).  As  shown  in  Figure  1, 
a teacher's  orientation  played  out  in  the  classroom  surfaces 
as  the  teacher’s  voice  or  personal  curriculum.  This,  in  turn, 
becomes  pedagogical  content  knowledge  which  contains  two 
components,  content  and  pedagogy  (Grossman,  1989; 
Shulman.  1987).  Pedagogical  content  knowledge  is  subject 
matter  that  has  been  reorganized  with  consideration  of  stu- 
dents, pedagogical  strategies,  and  curriculum.  This  reorga- 
nization revolves  around  a teacher’s  orientation  and  includes 
not  only  selecting  and  omitting  knowledge  but  also  adopt- 
ing teaching  methods  that  are  in  line  with  the  knowledge 
they  believe  students  should  learn. 

From  my  own  experiences  talking  with  secondary  so- 
cial studies  teachers  about  the  teaching  of  U.  S.  history,  they 
regularly  introduce  information  about  their  own  lives  and 
heliefs  into  the  discussion.  Their  descriptions  illustrate  how 
important  experiences  and  beliefs  arc  to  the  teaching  pro- 
cess and  how  these  play  a fundamental  role  in  constructing 


their  orientation  toward  U.  S.  history  and  their  interpreta- 
tion of  the  texts  they  teach.  Through  this  interaction  with 
teachers,  it  becomes  evident  that  the  experiences  and  be- 
liefs of  teachers  play  a fundamental  role  in  constructing  their 
orientation  toward  U.  S.  history  and  their  interpretation  of 
the  texts  they  teach.  Therefore,  in  order  to  understand  the 
influences  that  shape  teachers’  approaches  to  the  teaching 
of  U.  S.  history,  we  need  to  know  more  about  teachers’  lives. 
Thus,  this  study  was  designed  to  identify  and  determine  how 
teachers’  personal  beliefs  and  life  experiences  play  a role  in 
shaping  the  manner  in  which  they  teach  American  history. 

Information  Collection  and  Analysis 

The  findings  discussed  in  this  study  are  based  upon  in- 
formation gained  from  a previous  research  study  that  exam- 
ines the  multiple  and  complex  issues  and  influences  that 
shape  the  teaching  of  U.  S.  history  (Romanowski,  1996)  and 
a current  study  which  uses  both  interviews  and  classroom 
observations.  This  research  advances  previous  work  by  pre- 
senting findings  from  interviews  and  classroom  observations 
of  six  secondary  U.  S . history  teachers.  The  data  consists  of 
transcribed  interviews,  transcribed  classroom  observations, 
and  observer’s  notes.  The  participants  are  six  teachers,  five 
men  and  one  woman,  with  an  average  of  sixteen  years  of 
experience  teaching  U.  S.  history  in  ;ix  different  high  schools. 
These  six  schools  districts  are  characterized  as  rural1  with 
student  populations  for  grades  9- 1 2 consisting  of  254,  288, 
301,  375,  886,  and  1134. 

Prior  to  the  initial  interview,  teachers  were  asked  to  re- 
flect upon,  record  notes,  and  provide  examples  of  the  pos- 
sible factors  that  influenced  their  content  selection  and 
teaching  of  U.  S.  history.  Individual  teachers  then  partici- 
pated in  a 50-75  minute  interview.  Each  interview  focused 
on  the  teachers’  conception  of  subject  matter,  the  current 
courses  they  were  teaching,  students  in  the  class,  and  their 
individual  approaches  to  transforming  content  knowledge. 

Every  interview  began  with  a teacher-initiated  conver- 
sation based  on  previous  reflection  and  thoughts  regarding 
teaching.  This  increased  the  chance  that  information  came 
from  the  respondent  rather  than  solely  being  determined  by 
the  researcher’s  questions.  Participants  were  also  asked  to 
supply  examples  from  their  teaching  to  solidify  their  points. 
Based  on  the  information  individual  teachers  presented,  the 
researcher  used  probing  questions  that  extended  the  infor- 
mation and  allowed  additional  questions  to  emerge  from  the 
context.  This  permitted  a more  thorough  understanding  of 
the  respondent’s  opinions  and  the  reasoning  behind  them. 
All  interviews  were  tape  recorded  and  transcribed. 


1 The  high  schools  represented  in  this  study  arc  categorized  by  the 
criteria  used  for  field  experience  and  student  teaching  placement. 
Rural  schools  arc  categorized  by  a student  population  of  less  than 
10  percent  minority  while  city  schools  contain  more  than  10  per- 
cent minority  population. 
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In  order  to  validate  the  interviews,  each  participant  was 
observed  teaching  U.  S.  history  during  several  class  peri- 
ods. In  several  cases,  classrooms  were  videotaped  but  when 
this  was  impossible,  ethnographic  field  notes  were  taken. 
At  the  completion  of  each  observation,  all  participants  were 
interviewed  for  approximately  15-25  minutes.  Each  teacher 
was  then  asked  to  reflect  on  the  lesson  citing  examples  of 
factors  and/or  beliefs  that  might  have  shaped  the  particular 
content  or  approach  to  the  topic.  A brief  dialogue  occurred 
between  teacher  and  researcher  centering  on  information 
from  the  interviews  and  the  observed  lesson. 

Each  analysis  began  by  listening  to  the  taped  conversa- 
tion and  then  carefully  reading  the  interview  transcripts  and 
field  notes.  Based  on  this  reading,  initial  analysis  consisted 
of  coding  the  conversations  using  categories  from  the  theo- 
retical framework  developed  in  the  previous  study2.  These 
four  theoretical  categories  were  particularly  relevant  for  the 
information  and  served  as  a starting  point  for  the  analysis. 
After  close  analysis  of  the  language  that  teachers  use,  their 
• own  reflection  about  teaching,  and  classroom  observations, 
various  implicit  beliefs  and  influences  that  shaping  their 
teaching  emerged  and  were  grouped  into  the  categories  of 
religion  and  morality,  history  professors,  and  social  class 
and  family  (see  Figure  #1).  These  elements  make  up  teach- 
ers’ orientation  toward  their  subject  matter.  Eventually  the 
orientation  surfaces  as  a personal  curriculum  that  creates 
value-laden  impressions  for  students  to  learn. 

Findings  and  Discussion 

The  Impact  of  Beliefs  and  Life  Experiences 

Religion  and  morality.  According  to  the  teachers  in  this 
study,  it  is  clear  that  the  beliefs  they  hold  and  their  life  expe- 
riences play  a significant  role  in  shaping  their  teaching  of  U. 
S.  history.  Since  the  teaching  process  is  an  extremely  value- 
laden endeavor,  teachers  can  never  claim  to  be  morally  neu- 
tral or  value  free.  Whether  one  realizes  this  or  not,  all  teachers 
“cannot  avoid  imparting  values  in  one  way  or  another  in  the 
normal  course  of  their  activities. . . What  we  consider  ‘good,’ 
‘right,’  or  ‘important’  constantly  guides  our  practice,  whether 
consciously  or  not”  (Carbone,  1987,  p.  10). 

In  this  study,  teachers  indicated  that  religion  and  issues 
of  morality  seem  to  be  determining  factors  on  how  they  ap- 
proach various  historical  events.  The  following  dialogue 
demonstrates  one  teacher’s  awareness  of  his  religious  con- 
victions that  surface  in  the  classroom. 


2 This  study  used  the  following  categories:  1)  Community  Ex- 
pectations and  Beliefs;  2)  Student  Beliefs  and  Issues  of  Resis- 
tance; 3)  U.  S.  History  Textbooks;  and  4)  Teacher’s  Voice/Personal 
Curriculum.  For  a further  description  see  Romanowski,  M H. 
(1996).  Issues  and  Influences  That  Shape  the  Teaching  of  U.  S. 
History.  In  J.  Brophy  (Ed.),  Advances  in  Research  on  Teaching. 
VoL  6 . Histoty  Teaching  and  Learning  (pp.  291-312).  Green- 
wich, CT:  JAI  Press. 


Interviewer:  What  other  factors  influences  the  way  you  ap- 
proach U.  S.  history? 

Teacher:  Certainly  my  Christian  faith. . . that  influences  my 
outlook.  I think  it  is  important  to  get  students  to  see  the 
role  that  religion  has  played  in  people’s  lives.  For  ex- 
ample in  Lincoln’s  second  inaugural  address,  he  is  fa- 
mous for  having  said  malice  toward  none  and  charity 
for  all. . . Few  historians  concentrate  on  the  middle  por- 
tion where  he  talks  about  why  the  Civil  War  happened. 

. . he  [Lincoln]  says  that  war  was  proof  of  a just  God 
because  both  sides  prayed  to  the  same  God  and  neither 
prayers  were  answered.  . . Lincoln  espouses  the  view 
that  God  plays  a role  in  history.  . . You  don’t  have  to 
acknowledge  a belief  in  a God  but  obviously  Lincoln 
believed  in  a God  or  he  wouldn’t  have  spoke  in  those 
terms.  I think  my  students  should  be  aware  of  those 
things  and  that  is  not  preaching  a view  of  religion,  its 
just  showing  that  the  founders  were  religious. . . I don’t 
think  I teach  this  but  God’s  hand  is  in  every  great  his- 
torical. This  probably  affects  many  parts  of  my  teach- 
ing. I might  not  be  conscious  of  all  this. 

It  is  evident  that  this  teacher’s  “Christian  upbringing” 
plays  a important  role  in  his  orientation  toward  U.  S.  his- 
tory. Not  only  does  he  acknowledge  the  role  religion  plays 
in  his  pedagogical  decisions  about  Lincoln  and  the  civil  war, 
but  he  is  also  aware  that  his  belief  that  “God’s  hand  is  in 
every  great  historical  event”  might  possibly  shade  his  teach- 
ing of  other  historical  events. 

Although  personal  religious  beliefs  were  not  discussed 
by  each  participant,  all  teachers  in  this  study  expressed  a con- 
cern for  raising  ethical  issues,  discussing  what  is  right  or  wrong, 
or  addressing  morality  within  the  history  curriculum.  The 
following  comments  by  various  teachers  describe  how  issues 
of  right  and  wrong  shape  their  approach  to  U.  S.  history. 

Teacher:  Religious  background  makes  a difference.  What 
you  think  is  morally  right  or  morally  wrong.  The  moral 
judgments  you  are  passing  on  societies  plays  a role  on 
how  you  teach. 

Teacher:  I guess  learning  from  my  dad  the  attitude  of  taking 
care  of  the  poor. . . I think  maybe  this  unselfish  attitude. 
I want  the  kids  to  be  aware  of  this.  Yeah  I bring  this  in. 
You  owe  it  to  get  through  the  curriculum,  you  owe  it  to 
teach  the  course  but  you  also  owe  to  this  dialogue  |on 
moral  issue]. 

It  is  evident  from  these  teachers’  comments  not  only 
that  issues  of  right  and  wrong  influence  their  teaching  of  U. 
S.  history  but  also  the  concern  for  morality  became  evident 
in  several  classroom  observations.  For  example,  one  lesson 
on  the  dropping  of  the  atomic  bomb  centered  on  issues  of 
right  and  wrong  behavior;  a lesson  on  life  in  the  1950’s  raised 
questions  regarding  the  moral  aspects  of  income  distribu- 
tion; and  a lesson  on  the  cold  war  also  encouraged  students 
to  reflect  upon  the  morality  of  decisions  made  at  that  time. 

Exactly  how  teachers’  religious  and  moral  convictions 
affect  their  approach  to  teaching  is  still  not  very  well  undcr- 
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stood,  but  we  can  be  sure  that  all  teachers  impart  morals  and 
values  upon  their  students.  These  examples  demonstrate 
that  the  moral  dimensions  of  teaching  are  inescapable  and 
play  a major  role  in  determining  what  is  considered  legiti- 
mate or  accepted  views  and  understandings  of  U.  S.  history. 
The  teacher’s  decisions  as  to  what  is  morally  appropriate 
shapes  the  teaching  process  by  determining  the  perspectives 
and  knowledge  students  have  access  to. 

History  professors.  All  participants  described  their  own 
schooling  experiences  as  factors  that  influenced  their  teach- 
ing, especially  the  role  of  professors  of  history.  While  in 
college,  when  pre-service  history  teachers  study  the  subject 
matter  that  they  will  eventually  teach  high  school  students, 
they  are  not  simply  learning  a body  of  facts.  As  they  engage 
textbooks  and  class  lectures,  they  are  acquiring  a particular 
understanding  of  the  world. 

Gudmundsdotti:  (1990)  argues  that  after  teachers  have 
forgotten  the  facts  of  U.  S.  history  learned  in  college,  they 
still  retain  value*  laden  impressions.  In  turn,  the  impressions 
play  an  active  role  in  shaping  their  pedagogical  content 
knowledge  and  their  interpretation  of  secondary  U.  S.  his- 
tory textbooks.  These  “value-laden  impressions  become  their 
personal  curriculum,  the  most  hidden  and  least  studied  of 
ail  school  curricula,  yet  it  is  the  slice  of  secondary  educa- 
tion that  is  most  likely  to  remain  with  the  student”  (p.  47). 
The  following  comments  made  by  teachers  demonstrate  how 
these  impressions  not  only  remain  with  these  teachers  but 
play  an  active  role  in  their  current  teaching. 

Teacher:  In  college,  I found  out  that  there  was  another  whole 
history  that  I didn’t  know  existed.  For  a long  time,  I 
resented  that  and  thought,  “Why  do  they  [college  pro- 
fessors] dig  up  all  the  dirt?”  and  “Why  is  there  always 
the  negative?”  Sure  it  affects  me  now.  I feel  compelled 
to  talk  about  some  of  the  lesser  noble  qualities  of  many 
of  our  presidents  and  maybe  other  people.  You  might 
as  well  not  have  them  go  out  of  here  with  a rose  colored 
view  that  is  not  true.  It  just  is  not  true.  . . I certainly 
have  a broader  view  of  history.  There  arc  still  things 
that  I learned  in  college  classes  that  I bring  into  my 
classes  today. 

Teacher:  1 guess  probably  a big  change  for  me  was  going  to 
college  during  the  sixties  and  being  in  the  history  and 
political  science  department.  If  there  was  anybody  down 
there  that  was  not  a liberal  democrat,  I didn’t  meet  any 
of  them  if  they  were  there.  They  [professors]  had  a 
huge  impact  on  me  and  I guess  I could  consider  myself 
more  of  a liberal  ever  since.  They  [professors]  certainly 
had  a huge  impact  on  me  because  it  [college]  totally 
changed  my  way  of  thinking  about  things. 

It  is  evident  that  college  professors  influence  the  teach- 
ing of  secondary  U.  S.  history.  Certainly  the  degree  of  in- 
fluence would  depend  on  both  the  individual  professor  and 
teacher.  Not  only  did  teachers  describe  this  influence  but  it 
became  obvious  in  several  classroom  observations.  For 
example,  one  particular  teacher  described  the  NATO  and 


Warsaw  Pact  by  using  an  example  given  to  him  by  a college 
professor.  He  added  that  this  professor  also  taught  ROTC 
classes  and  that  this  provided  him  with  insight  to  this  topic. 

Social  class  and  family.  According  to  Bourdieu  (1977, 
1984),  human  thought  is  a form  of  socialized  knowledge 
which  is  conditioned  by  cultural  surroundings.  Teachers’ 
epistemologies  reflect  their  cultural  history  and  family  so- 
cial class  background.  Teachers  enter  the  classroom  with  an 
understanding  of  the  world,  subject  matter,  and  school  that 
is  filtered  through  beliefs,  images,  and  myths  which  they 
have  acquired  from  families,  peers,  media,  and  other  life 
experiences. 

Based  on  this  process,  teachers  in  this  study  indicated 
that  the  family  and  social  class  structure  in  which  they  were 
raised  played  an  intricate  role  in  constructing  their  identi- 
ties, thus  maintaining  a significant  role  in  shaping  their  teach- 
ing and  views  toward  various  historical  events.  The 
following  excerpts  demonstrate  how  parents  and  social  class 
upbringing  play  a role  in  their  selection,  organization,  and 
actual  teaching  of  historical  events. 

Teacher:  I think  that  family  influences  and  values  influence 
your  political  views,  social  and  economic  backgrounds. 

. . When  it  comes  to  teaching  the  industrial  revolution 
and  similar  events,  I know  that  I am  pretty  much  a pro- 
labor person.  Why?  I grew  up  in  a working  class  fam- 
ily where  my  father  was  a tire  builder,  my  grandfather 
was  a tire  builder,  I worked  my  way  through  college  a 
member  of  United  rubber  workers.  That  [pro-labor  view- 
point] comes  from  my  family  background  and  that  gets 
brought  into  my  lessons.  For  example,  I would  say  I 
am  rather  opinionated  when  it  comes  to  students  who 
grew  up  in  families  where  their  dads  are  in  manage- 
ment and  don’t  like  unions.  They  [students]  come  in 
here  and  listen  to  me  and  I paint  a nice  rosy  picture  of 
unions  and  what  great  things  they  did  for  the  average 
American  person. 

Teacher:  I try  to  rely  on  strengths  from  experiences  that  I 
have  had.  1 can  relate  back  to  my  family. . . my  family  is 
a blue-collar  family  and  my  dad  never  had  much  until  he 
went  to  work  in  a plant.  He  was  in  UAW  and  as  a kid.  I 
can  remember  the  strikes  and  not  having  much  work  and 
trying  to  take  extra  jobs  to  make  ends  meet  till  the  strike 
was  over.  I can  see  how  my  dad  has  a strong  union  back- 
ground because  he  owes  everything  he  has  to  that  move- 
ment and  the  gains  that  were  provided  for  him.  So  it 
[blue  collar  family  background]  does  influence  how  you 
think  and  I try  to  bring  some  objectivity  to  it  but  yet  you 
have  that  personal  experience. 

Growing  up  in  working  class  families  with  parents  ac- 
tive in  labor  unions,  these  teachers  arc  certainly  aware  of 
how  those  experiences  influence  their  teaching.  Although 
teachers’  examples  were  limited  to  the  teaching  of  the  labor 
union  movement,  each  teacher  understands  how  parental 
influence  based  on  working  class  values  plays  out  in  their 
classrooms.  This  was  especially  evident  during  class  dis- 
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cussion  when  they  address  “white  collar”  or  upper  class  stu- 
dents. Their  professionalism  enables  them  to  be  aware  of 
the  need  for  “objectivity,”  but  as  one  teacher  stated  “you 
have  that  personal  experience”  and  that  personal  experience 
shades  the  presentation  of  labor  unions  and  management. 
Not  only  does  this  aspect  of  their  identities  affect  the  pre- 
sentation of  labor  unions,  it  also  dictated  the  amount  of  time 
spent  on  labor  and  management  issues.  Two  teachers  indi- 
cated that  they  enjoy  and  that  they  spend  significant  time  on 
these  and  related  issues  during  the  school  year,  both  feeling 
that  maybe  they  place  too  much  emphasis  on  this  area. 

Furthermore,  one  teacher  stated  that  “I  often  teach  from 
the  disaffected  point  of  view.  . . I guess  that  is  my  back- 
ground.” This  individual’s  social  class  background  surfaced 
when  he  had  the  opportunity  to  teach  from  what  is  termed 
“bottom  up  history”  where  the  emphasis  is  on  social  history 
or  the  history  from  the  perspective  of  the  “average”  Ameri- 
can. Similar  comments  were  made  by  another  teacher. 

Teacher:  I came  from  a working  class  relatively  poor  back- 
ground and  I think  it  is  important  that  we  understand 
history  from  the  ideas  of  those  who  lived  it,  those  who 
were  a part  of  history,  not  just  necessarily  from  those 
people  writing  from  their  ivory  towers  in  some  fourth 
floor  building  on  some  college  campus.  I often  share 
stories  from  my  parents  and  grandparents  who  were 
hardworking  people. . . you  never  get  rid  of  that  family 
upbringing. 

This  teacher  demonstrates  how  stories  from  the  “com- 
mon people”  and  social  history  are  important  in  his  teach- 
ing. More  importantly,  these  stories  evolve  from  his  own 
life  experiences  growing  up  working  class.  At  times  during 
our  conversations,  this  individual  expressed  some  degree  of 
anger  toward  what  he  termed  “privileged  upper  class”  which 
would  clearly  surface  in  his  classroom. 

Suggestions  for  Teacher  Education 

We  may  not  fully  understand  how  an  individual  teacher's 
orientation  is  constructed,  but  wc  do  know  that  beliefs  and 
life  experiences  play  a significant  role  in  determining  the 
version  of  U.  S.  history  students  have  the  opportunity  to  learn. 
My  findings  suggest  that  a better  understanding  of  these  fac- 
tors and  the  role  they  play  in  shaping  the  social  studies  cur- 
riculum would  help  teachers  to  understand  what  they  do, 
why  they  choose  to  do  it,  and  the  educational  effect  they 
have  on  students.  I suggest  several  ways  that  teacher  educa- 
tion programs  can  help  pre-service  teachers  to  examine  the 
influences  that  shape  the  way  they  see  the  world  and  to  be- 
gin to  understand  how  these  influences  shape  their  individual 
classrooms. 

First,  teacher  education  programs  must  make  opportuni- 
ties for  pre-service  teachers  to  reflect  about  themselves  re- 
garding their  beliefs  and  experiences  and  how  these  play  a 
role  in  their  understanding  of  schools,  teaching,  and  curricu- 
lum. This  type  of  self  analysis  is  vital  since  teaching  “in- 


volves knowing  oneself  well,  one’s  attitudes,  beliefs,  values 
and  prejudices  as  well  as  one’s  underlying  conceptions  of 
knowledge  and  knowing”  (Balaban,  1995,  p.  60).  In  response, 
teacher  education  programs  must  provide  formal  opportuni- 
ties for  students  to  reflect  upon  their  own  schooling  and  life 
experiences  and  determine  their  own  belief  systems  and  how 
these  have  been  constructed.  Balaban  (1995)  argues  that  “fac- 
ing our  biases  openly,  recognizing  our  limits  imposed  by  our 
embeddedness  in  our  own  culture  and  experience,  acknowl- 
edging the  values  and  beliefs  we  cherish,  and  accepting  the 
influence  of  emotions  on  our  actions  are  extraordinary  chal- 
lenges” that  must  be  addressed  by  teachers  (p.  49). 

Second,  it  is  important  for  pre-service  teachers  to  un- 
derstand that  there  are  multiple  ways  of  viewing  content 
knowledge  and  that  these  perspectives  rely  upon  one’s  un- 
derstanding of  the  world.  Teacher  educators  must  provide 
prospective  teachers  with  the  skills  and  knowledge  neces- 
sary to  uncover  the  values  embedded  in  pedagogical  con- 
tent knowk  Ige.  For  example,  this  can  be  accomplished 
through  Schw  \b’s  ( 1 978)  “polyfocal  conspectus.”  This  is  a 
system  of  critical  reflection  of  subject  matter  through  mul- 
tiple perspectives  that  exposes  and  “lifts  out”  the  values  and 
ideologies  embedded  in  the  varying  viewpoints.  Each  per- 
spective is  “studied,  interpreted,  discussed,  and  debated”  (p. 
346).  The  value-laden  perspectives  are  then  compared,  to 
give  prospective  teachers  a sense  of  the  many  possible  in- 
terpretations and  the  strengths  and  weaknesses  of  their  own 
perspective.  Only  when  students  are  exposed  to  multiple 
interpretations  and  the  other’s  perspective  can  they  begin  to 
develop  complex  understandings  of  historical  events. 

Finally,  it  is  important  to  understand  that  although  this 
research  is  limited  to  secondary  social  studies  teachers,  teach- 
ers of  all  levels  must  develop  a critical  eye  when  engaging 
their  subject  matter.  There  must  be  a strong  emphasis  on  the 
foundations  of  education  which  enable  students  to  reflect  upon 
why  they  use  should  not  use  certain  pedagogical  approaches. 
Therefore,  I think  that  it  is  important  to  replicate  this  study 
with  both  middle  school  and  elementary  school  teachers  in 
order  to  better  understand  the  factors  that  shape  teaching  at 
those  levels  and  then  construct  teacher  education  programs 
that  better  fit  the  needs  of  pre-service  teachers. 
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Abstract 

This  exploratory  study  investigated  the  levels  of  reflection  achieved  over  three  quarters  by  graduate 
level  preservice  teachers.  Levels  of  reflection  were  determined  through  analysis  of  their  reflective  jour- 
nal entries  on  readings  and  field  experiences.  A repeated  measures  two  factor  ANOVA  completely  within 
design  was  used  to  systematically  analyze  changes  in  the  level  of  reflection.  Even  without  specific  train- 
ing in  reflection  and  reflective  thinking , some  significant  growth  occurred  in  the  levels  of  reflection  as  a 
result  of  asking  preservice  teachers  simply  to  reflect.  However,  only  one  participant  achieved  the  high- 
est level  of  reflection. 


Efforts  to  study  and  develop  reflection  or  reflective 
thinking  skills  have  been  complicated  by  variations  in  the 
definition  and  use  of  those  terms.  Early  in  this  century,  Dewey 
(1904)  introduced  educators  to  the  concept  of  reflection  by 
describing  it  as  thinking  about  and  reflecting  upon  one’s 
teaching  experience.  He  later  expanded  this  definition,  re- 
ferring to  reflective  thinking  as  “behavior  which  involves 
active,  persistent,  and  careful  consideration  of  any  belief  or 
supposed  form  of  knowledge  in  light  of  the  grounds  that 
support  it  and  further  conclusions  to  which  it  tends”  (Dewey, 
1933,  P.  9). 

According  to  Van  Manen  (1991),  reflection  refers  to  the 
process  by  which  teachers  engage  in  aspects  of  critical  think- 
ing such  as  careful  deliberation  and  analysis,  making  choices, 
and  reaching  decisions  about  a course  of  action  related  to 
teaching.  Ross  (1989)  views  reflection  as  “a  way  of  thinking 
about  educational  matters  that  involves  the  ability  to  make 
rational  choices  and  to  assume  responsibility  for  those  choices” 
(p.  22).  Shulman  ( 1 987)  defines  it  as  “a  process  that  involves 
reviewing,  reconstructing,  reenacting,  and  critically  analyz- 
ing one’s  own  and  the  class’  performance”  (p.  15). 

Reflection  is  currently  viewed  as  an  essential  component 
of  preservice  teacher  education  programs  because  it  is  seen 
as  the  primary  means  by  which  preservice  teachers  become 
thoughtful  about  their  experiences  (Pultorak,  1993).  Being 
reflective  allows  them  to  refine  and  improve  their  teaching. 
By  applying  critical  thinking  skills  such  as  problem-solving, 
decision-making,  and  analysis  from  multiple  perspectives  to 
their  experiences,  preservice  teachers  can  become  more  knowl- 
edgeable about  themselves  and  their  performance  as  profes- 
sionals. Thus,  reflection  is  the  means  by  which  prcservicc 
teachers  may  become  reflective  practitioners.  Reflective  prac- 
titioners are  viewed  as  those  who  link  theory  to  practice,  bal- 
ance learning  and  teaching  styles  with  content,  question  and 
analyze  their  own  practice  from  multiple  perspectives,  make 
decisions  grounded  in  knowledge,  and  evaluate  alternatives 
for  future  applications  (Irwin,  1987;  Reagan,  1993;  Roth, 


1989;  Rust,  1988;Schon,  1987;  Sparks-Langer,  Simmons, 
Pasch,  Colton,  & Starko,  1990). 

Reflective  Abilities 

Several  researchers  consider  reflective  abilities  to  be 
critical  to  the  development  of  preservice  teachers 
(Korthagen  & Verkuyi,  1987;  Richards,  Gipe,  Levitov,  & 
Speaker,  1989;  Ross,  1989;  Roth,  1989;  Rovegno,  1992; 
Tsangaridou  & O’Sullivan,  1994).  However,  there  is,  as 
yet,  no  consensus  in  the  field  on  its  definition.  Reflective 
abilities  seem  to  represent  the  combination  of  reflective 
attitudes  and  cognitive  processes  that  enable  reflection  to 
occur.  It  appears  that  when  an  action,  experience,  or  idea 
stimulates  an  individual  to  become  thoughtful  about  or  to 
reflect  upon  that  experience,  both  reflective  attitudes  and 
cognitive  processes  come  into  play. 

Reflective  attitudes,  which  Boud,  Keogh,  and  Walker 
(1985)  believe  are  an  essential  component  of  reflection, 
are  directly  related  to  the  affective  domain.  Open- 
mindedness,  responsibility  for  actions  and/or  decisions, 
and  wholeheartedness  are  the  three  reflective  attitudes 
that  Dewey  (1933)  initially  identified  and  that  other  re- 
searchers have  more  recently  addressed  (Cruickshank, 
1987;  Goodman,  1984;  Ross,  1989;  Ross  & Hannay, 
1986;  Zeichncr  & Teitelbaum,  1982). 

The  following  cognitive  processes  seem  to  be  in- 
volved in  reflection:  ( 1 ) identifying  dilemmas,  situations 
or  problems  (Boyd  & Fales,  1983;  Ross,  1989;  Rovegno, 
1992);  (2)  describing  and  analyzing  situations  (Boud  et 
al.,  1985;  Boyd  & Fales,  1983;  Cruickshank,  1986a; 
Goodman,  1984;  Ross,  1989;  Roth,  1989;  Shapiro.  1985; 
Sparks-Langer  & Colton,  1991;  Zeichncr  & Liston, 
1987);  (3)  evaluating  information  to  clarify  the  situation 
(Boyd  & Fales,  1983;  Goodman,  1984;  Kolb  and  Fry. 
1975;  Roth,  1989);  (4)  re-examining  experiences  from 
multiple  perspectives  (Boyd  & Fales,  1983;  Boud  el  al., 
1985,  Ross,  1989;  Roth,  1989;  Rovegno,  1992,  Schocn. 


— Vteiw**  lLNwiifatf4~ 1991  - - Mtd-Wesiern  A ^ 9 


1983);  (5)  associating  new  knowledge  with  previous  knowl- 
edge, integrating  new  knowledge  into  existing  schemata,  and 
appropriating  new  knowledge  (Boud  et  al.,1985;  Rovegno, 
1992);  (6)  synthesizing  conflicting  evidence  (Rovegno, 
1992);  (7)  relating  teacher’s  actions  to  student  learning 
(Rovegno,  1992);  (8)  imagining  new  alternatives  (Rovegno, 
1992);  (9)  providing  alternative  explanations  of  a classroom 
event  (Ross,  1989);  (10)  articulating  arguments  based  on 
evidence  (Ross,  1989);  ( 1 1)  solving  problems,  and/or  mak- 
ing decisions  (Boud  et  al.,  1985;  Boyd  & Fales,  1983; 
Cruickshank,  1986b,  Dewey,  1933;  Kolb  & Fry,  1975;  Par- 
sons, 1983;  Roth,  1989;  Rovegno,  1992;  Zeichner  &.  Liston, 
1987);  (12)  making  inferences  and  developing  and  testing 
hypotheses  (Boud  et  al.,  1985;  Boyd  & Fales,  1983; 
Cruickshank,  1986b;  Kolb  & Fry,  1975;  Roth,  1989;Schoen, 
1983;  Sparks-Langer  & Colton,  1991);  and  (13)  understand- 
ing the  ethical  and  moral  consequences  of  teaching 
(Goodman,  1984;  Zeichner  & Liston,  1987). 

Developing  Reflective  Practitioners 

In  order  to  become  reflective  practitioners,  preservice 
teachers  need  to  develop  and  use  reflective  abilities.  As  Kuhn 
(1986)  has  pointed  out,  “the  only  way  to  improve  teachers’ 
thinking  is  to  involve  them  in  it”  (p.  502).  Dewey  (1904) 
emphasized  that  people  should  be  taught  how  to  think  by 
being  involved  in  thinking,  and  that  it  could  be  even  more 
important  to  prepare  preservice  teachers  to  think  about  their 
work  than  to  teach  them  teaching  strategies. 

Reflective  abilities  are  developed  by  “involving  student 
teachers  in  critical,  reflective  thinking  about  their  work” 
(Bolin,  1988,  p.  48)  and  in  a variety  of  reflective  exercises 
(Kuhn,  1986).  Dewey  (1933)  found  that  student  teachers  tend 
to  be  more  reflective  if  the  experiences  upon  which  they  are 
expected  to  reflect  are  real.  Building  on  this  idea,  Roth  (1989) 
suggests  that  in  order  to  develop  reflective  capabilities 
preservice  teachers  need  to  have  opportunities  to  reflect  on 
their  observations  during  field  experiences  and  in  real  school 
settings.  According  to  Bolin  (1988),  this  enables  students  to 
analyze  and  interpret  field  experiences  and  classroom  ob- 
servations with  a different  attitude.  In  addition,  students  also 
discover  assumptions  and  arrive  at  implications  for  class- 
room practice  (Liston  & Zeichner,  1987). 

For  Sparks-Langer  et  al.  (1990),  asking  the  why  ques- 
tion is  essential  for  the  development  of  reflective  thinking 
in  preservice  teachers.  If  students  do  not  understand  why 
something  worked  or  did  not  work,  they  will  have  difficulty 
figuring  out  what  to  do  next.  Along  these  same  lines,  help- 
ing preservice  teachers  describe  what  happened,  why  it  hap- 
pened (its  rationale),  and  how  it  could  be  improved 
encourages  them  to  reflect  (Cruickshank  & Applegate,  1981; 
Roth,  1989;  Van  Manen,  1991;  Smyth,  1989). 

Preservice  teachers  differ  in  their  willingness  and  abili- 
ties to  reflect  about  teaching  (Korthagen  & Verkuyl,  1987; 
Richards  et  al.,  1989;  Ross,  1989).  The  ability  to  reflect  also 
varies  depending  on  the  topic  (Ross,  1989).  In  her  study, 
Ross  (1989)  reported  that  the  students  achieved  higher  lev- 


els of  reflection  when  they  were  able  to  apply  research  find- 
ings and  critiques  of  teacher  effectiveness  research  while 
acknowledging  the  strengths  and  limitations  of  it. 

Richards  et  al.  (1989)  reported  that  some  preservice 
teachers  possess  a natural  ability  to  examine  and  critically 
question  themselves.  Other  studies  suggest  that  preservice 
teachers  can  value  the  role  of  reflection  and  therefore  are 
able  to  improve  the  quality  and  amount  of  reflection 
(MacKinnon,  1987;  Nolan  & Huber,  1982;  Richards  &Gipe, 
1988;  Richert,  1988;Sebran,  1989;  Wildman  & Niles,  1987). 
As  a consequence,  preservice  teachers  can  be  helped  to  de- 
velop or  improve  their  reflective  abilities  (Ross,  1990; 
Teitelbaum  & Britzman,  1991;  Wubbels  & Korthagen,  1990). 
Reflective  practice  thus  may  be  the  means  of  developing 
analytical  abilities  as  well  (Ross,  1989;  Tsangaridou  & 
O’Sullivan,  1994). 

In  contrast,  other  studies  found  that  some  preservice 
teachers  appear  unwilling  to  reflect  and  are  resistant  to  re- 
flective experiences  (Calderhead,  1992;  Richards  et  al., 
1989;  Sebran,  1989;  Zeichner  & Liston,  1987).  Zeichner 
and  Liston  (1987)  believe  that  this  resistance  is  due  to  the 
fact  that  some- preservice  teachers  do  not  value  reflection. 
Richards  et  al.  (1989)  reported  that  some  preservice  teach- 
ers are  unable  to  reflect  about  their  work  because  they  see 
reflective  assignments  as  meaningless  and  because  they  lack 
personal  and  psychological  characteristics  related  to  reflec- 
tive abilities.  These  students  also  seem  to  confuse  reflec- 
tion with  simple  descriptions  of  classroom  events. 

There  appear  to  be  three  factors  related  to  the  develop- 
ment of  reflection  in  preservice  teachers.  These  are:  avail- 
ability of  time  to  reflect  on  a daily  basis,  time  to  actually 
develop  reflective  abilities,  and  a supportive  and  nonthreat- 
ening environment  in  which  reflection  occurs  (Nolan  & 
Huber,  1989;  Richert,  1988;  Sebran,  1989;  Weade,  1987; 
Wildman  & Niles,  1987).  Reflective  abilities  may  also  be 
encouraged  by  implementing  an  indirect  supervisory  style 
during  student  teaching  (Tsangaridou  & O’Sullivan,  1994). 
Training  supervisors  in  the  use  of  an  inquiry  and  reflective 
approach  is  as  vital  as  having  cooperating  teachers  encour- 
age student  teachers  to  question  classroom  practice.  It  is 
also  important  for  student  teachers  to  be  exposed  to,  and 
trained  within,  this  inquiry  and  reflective  approach  if  they 
are  to  become  more  reflective  (Zeichner  & Liston,  1987). 
Troyer’s  study  (1988)  not  only  supports  the  need  for  train- 
ing but  also  suggests  that  training  in  reflection  should  be 
introduced  very  early  in  the  professional  education  compo- 
nent of  teacher  education  programs. 

A Model  of  the  Reflective  Process 

Boud  et  al.  (1985)  aligned  their  “Model  of  Reflection 
in  the  Learning  Process”  (p.  20)  with  Dewey's  (1933)  de- 
scription of  a reflective  activity  process.  They  built  upon 
Dewey’s  concept  of  reflecting  on  experience.  This  model 
has  three  broad  components:  (a)  experiences,  which  arc  the 
antecedent  stimuli  for  reflection;  (b)  reflective  processes; 
and  (c)  outcomes,  which  include  the  consequences  of  be- 
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havior  and  new  actions  taken.  The  experiences  component 
includes  such  things  as  behaviors,  ideas,  and  feelings.  The 
reflective  processes  component  has  three  stages:  (1 ) return- 
ing to  experience,  (2)  attending  to  feelings,  and  (3)  re-evalu- 
ating experience. 

The  first  stage  in  the  reflective  processes  component, 
returning  to  experience , involves  remembering,  reviewing, 
and  reconstructing  one’s  experience.  This  experience  is  de- 
scribed in  detail,  in  written  form,  without  judging.  The 
preservice  teacher  is  expected  to  view  the  experience  from 
different  perspectives.  According  to  Boyd  and  Fales  (1983), 
during  this  stage  the  student  needs  to  be  open  to  new  infor- 
mation (which  Dewey  (1933)  called  “open-mindedness”) 
from  internal  and  external  sources  in  order  to  process  the 
event  from  multiple  perspectives.  This  is  when  intervention 
and  training  can  occur. 

The  second  stage  of  the  reflective  processes  component, 
attending  to  feelings,  is  seen  by  Boud  et  al.  (1985)  as  essen- 
tial to  the  reflective  process.  Feelings  are  viewed  as  promot- 
ing affective  and  cognitive  learning.  Positive  feelings  enhance 
learning,  while  negative  feelings  are  obstacles  to  learning 
and  hinder  reflection.  Therefore,  negative  feelings  need  to 
be  removed  or  transformed  for  learning  to  take  place.  Writ- 
ing can  be  a powerful  means  to  discharge  negative  feelings 
(Rainer,  1980). 

The  third  stage  of  the  reflective  processes  component, 
re-evaluating  experience , is  vital  because  it  includes  asso- 
ciation, integration,  appropriation,  and  validation  which  de- 
termine whether  the  experience  will  become  meaningful  to 
the  individual.  At  this  stage,  resolution  occurs  as  the  indi- 
vidual arrives  at  an  adequate  solution  or  a change  in  per- 
spective (Boyd  & Fales,  1983). 

The  outcomes  component  constitutes  the  end  of  the  re- 
flective process  and  prepares  one  for  a new  experience. 
Therefore,  the  outcome, 

...  may  include  a new  way  of  uoing  something,  the 
clarification  of  an  issue,  the  development  of  a skill 
or  the  resolution  of  a problem.  A new  cognitive  map 
may  emerge,  or  a new  set  of  ideas  may  be  identi- 
fied. The  changes  may  be  quite  small  or  they  may 
be  large.  They  could  involve  the  development  of 
new  perspectives  on  experience  or  changes  in  be- 
havior (Boud  et  al.,  1985,  p.  34). 

Assessing  Reflection 

The  varied  definitions  of  reflection  have  led  research- 
ers to  develop  a variety  of  assessment  tools  for  determining 
to  what  extent,  or  at  what  level,  reflection  is  occurring.  For 
the  purposes  of  this  study,  two  frameworks  were  used  to  as- 
sess the  levels  of  reflection  attained  by  preservice  teachers 
in,  respectively,  reading  journals  and  field  journals. 

Ross’  ( 1 989)  framework,  Criteria  for  Assessing  Levels 
of  Reflection,  was  designed  specifically  to  assess  levels  of 
reflection  on  theory-to-pra  . .icc  papers.  The  framework  uses 
a three-tier  leveling  process  with  subcatcgorics  within  each 
tier.  A summary  of  Ross’  framework  is  presented  in  Tabic  1 . 


Table  1 

A Summary  of  Ross'  Criteria  for  Assessing  Levels  of 
Reflection 

Level  1:  Low 

1.1  give  examples  of  teacher  implementing  or  not  imple- 
menting a finding  from  research; 

1 .2  describe  a teacher’s  practice  as  being  only  partially  con- 
sistent with  research; 

1 .3  agree  with  a position  taken  in  an  article  by  restating  the 
author’s  arguments. 

Level  2:  Moderate 

2. 1 provide  a good  critique  of  practice  from  one  perspective; 

2.2  analyze  in  detail  a teaching  practice; 

2.3  recognize  that  instruction  must  vary  based  on  aims  and 
student  characteristics; 

Level  3:  High 

3. 1 view  things  from  multiple  perspectives; 

3.2  recognize  that  teacher  actions  have  impact  beyond  instruction. 

Using  this  framework,  Ross  ( 1 989)  found  that  students’ 
levels  of  reflection  on  the  different  papers  ranged  from  low 
to  high  (low:  44%,  moderate:  34.4%,  and  high:  2 1 .6%).  She 
explained  that  this  variability  was  mainly  due  to  the  topic 
about  which  the  students  were  reflecting.  Although  she  ac- 
knowledged that  students’  abilities  to  reflect  may  change 
over  time,  her  data  did  not  show  that  levels  of  reflection 
changed  during  a semester-long  course. 

Although  Ross  (1989)  reported  that  most  (78.4%)  of 
the  papers  were  identified  at  Levels  1 (low)  and  2 (mod  r- 
ate),  she  also  noted  that  almost  all  students  demonr.  <ued  a 
high  level  of  reflection  in  some  of  their  papers  Although 
only  22%  of  the  papers  were  rated  at  the  honest  level  of 
reflection,  Ross  suggested  that  undergraduate  preservice 
teachers  can  achieve  the  highest  level  of  reflection  if  they 
are  able  to  view  things  from  multiple  perspectives,  recog- 
nize the  importance  of  making  decisions  based  on  multiple 
factors,  and  are  made  aware  of  the  impact  of  context  on  teach- 
ing. She  concluded  that  “the  ability  to  reflect  about  practice 
does  not  develop  in  one  course”  (p.  30).  She  did  point  out 
that  a single  course  could  introduce  preservice  teachers  to 
reflective  thinking  and  help  them  develop  their  reflective 
abilities. 

Galvez  ( 1 995)  proposed  a framework  for  analyzing  how 
preservice  teachers  progress  in  reflection.  A refined  version 
of  that  framework  which  focuses  on  real  school  classroom 
settings  was  used  for  this  study  (see  Table  2).  Galvez’  frame- 
work is  an  adaptation  of  earlier  frameworks  developed  by 
Ross  (1989)  and  Smith  and  Pape  (1991).  This  adaptation 
was  necessary  because  no  framework  could  be  identified 
that  would  • . «ow  assessment  of  reflection  from  multiple  per- 
spectives on  real  classroom  settings,  even  though  several 
authors  feel  that  viewing  experiences  from  multiple  perspec- 
tives is  critical  in  the  reflective  process  (Boud  el  al.,  1985; 
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Table  2 

Galvez ' Assessment  for  Levels  of  Reflection 

Scale  Levels  of  Reflection 

0 No  mention  of  pedagogical  concepts  or  skills. 

Comments  based  on  self  and  feelings  (Smith  & Pape,  1990). 

1 General  explanation  of  instructional/non-instructional  events  in  terms  of  personal  experiences  without  analyzing  or 
predicting  consequences  based  on  teaching  behavior/performance  (Smith  & Pape,  1990). 

2 Plain  description  of  instructional/non-instructional  events  in  a technical  way  without  analyzing  teaching  performance 
or  the  rationale  behind  it  (Ross,  1989;  Smith  & Pape,  1990). 

3 Focuses  on  only  one  aspect  of  teacher  behavior  and  arrives  at  implication  (Ross,  1 989). 

4 Critiques  teaching  behavior  from  one  perspective,  that  is  from  the  students’  in  terms  of  its  impact  on  students  and 
learning  outcomes  (Ross,  1989)  as  well  as  how  students  behavior  is  addressed. 

5 Analyzes  in  detail  teaching  behavior  from  the  teachers’  perspective  during  instructional  and/or  non-instructional  time. 
Discriminates  between  effective  and  non-effective  instruction  (Ross,  1989). 

Analyzes  how  teachers  handle  misbehavior  in  a very  specific  way  and  arrives  to  implications  about  how  to  deal  with 
similar  situations. 

6 Acknowledges  that  instruction  is  based  on  objectives  and  students’  characteristics  and  that  a variety  of  teaching 
strategies  would  be  used  to  match  the  students’  different  learning  styles  (Ross,  1989). 

Analyzes  students’  progress  and  its  implications  related  to  teaching  behavior,  instruction,  and  students’  characteris- 
tics and  learning  styles. 

7 Evaluates  instructional/non-instructional  events  from  multiple  perspectives. 

“Acknowledges  impact  of  specific  situations  and  contexts  of  learning”  (Smith  & Pape,  1990,  p.  6). 

Provides  recommendations/suggestions  for  improvement  and  for  further  implementation  by  using  if-then-because 
statements  (Smith  & Pape,  1990). 

Boyd  & Fales.  1983;  Ross,  1989).  Galvez’  framework  of- 
fers ratings  on  a zero-  to  seven-  point  scale,  moving  from 
reflections  from  a singular  perspective  to  reflections  from 
multiple  perspectives  (teacher,  student,  parents,  community). 

This  study  was  structured  following  Boud  et  al.’s  ( 1 985) 

Model  of  Reflective  Processes  which  has  three  broad  compo- 
nents: Experiences,  Reflective  Processes,  and  Outcomes.  In 
order  to  be  able  to  assess  the  level  of  reflection,  it  is  first 
important  to  know  what  the  students  are  reflecting  about.  They 
must  describe  something  they  learned  or  something  they  have 
experienced  (Experiences).  Second,  they  must  expand  on  the 
idea  or  experience  by  reconstructing  it,  relating  it  to  other 
personal  experiences  and  feelings,  and  arriving  at  a conclu- 
sion by  associating,  integrating,  appropriating,  and  validating 
that  experience  or  idea  (Reflective  Processes).  Third,  they  must 
arrive  at  an  adequate  solution  or  change  in  perspective  (Out- 
comes). Ross’  (1989)  and  Galvez’  (1995)  frameworks  were 
created  to  assess  the  levels  of  reflection  (Reflective  Processes) 
based  on  an  instructional  event  (Experiences). 

The  purpose  of  this  exploratory  study  was  to  investi- 
gate achieved  levels  of  reflection  over  time  by  preservice 
teachers  when  they  were  asked  simply  to  reflect  on  their  field 
experiences  and  course  content.  The  specific  research  ques- 
tion was: 

What  levels  of  reflection  are  achieved  by  preservice 
teacheis  on  readings  and  field  experiences  and  how  do  the 
levels  of  reflection  vary  over  time? 


Method 

This  study  was  designed  to  explore  changes  in  reflec- 
tive thinking  over  a three-quarter  period  among  preservice 
teachers  who  were  not  trained  in  reflection  or  reflective  think- 
ing. The  investigation  was  accomplished  during  the  middle 
three  quarters  (autumn,  winter,  and  spring)  of  the  five-quar- 
ter graduate  level  teacher  certification  program.  During  their 
first  and  last  quarters  (summer  1995,  summer  1996),  the 
students  were  involved  in  introductory  and  culminating 
courses  respectively.  The  three  quarters  included  in  this 
study,  encompassed  all  methods  courses,  field  experiences, 
and  student  teaching. 

Based  on  the  Boud  et  al.  (1985)  model,  readings  and 
field  experiences  (Experiences)  provided  the  context  for  the 
students’  reflections,  which  were  then  expressed  in  their  jour- 
nal writing  (Reflective  Processes).  The  participants  were  free 
to  implement  their  conclusions  or  alternative  ideas  for  class- 
room instruction  during  field  assignments,  which  included 
student  teaching  (Outcomes). 

Participants 

The  participants  in  this  study  were  2 1 preservice  teach- 
ers in  a graduate  elementary  teacher  certification  program 
at  one  large  midwestern  university.  Four  students  were 
males;  16  were  females.  The  participants  were  at  a typical 
age  for  university  graduate  students  (range  = 22-24  years), 
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with  the  exception  of  four  nontraditional  students  (over  age 
24).  The  participants  were  enrolled  during  autumn  (quarter 
one)  and  winter  (quarter  two)  quarters  in  social  studies,  sci- 
ence, math,  and  language  arts  methods  courses.  The  partici- 
pants were  also  involved  in  one  field  experience  during  each 
of  those  quarters.  Student  teaching  occurred  during  spring 
quarter  (quarter  three). 

Procedures 

The  participants  kept  reflective  journals  as  apart  of  their 
regular  course  work.  Permission  was  granted  to  the  authors 
to  use  the  journal  entries  for  this  study;  however,  the  partici- 
pants were  not  informed  about  the  specific  objectives  of  the 
study. 

During  the  first  class  meeting,  in  quarter  one,  the  par- 
ticipants were  given  a 15-minute  orientation  to  the  journal 
writing  required  for  social  studies  methods.  They  were  told 
that  they  would  be  keeping  two  types  of  journals:  a reading 
journal  for  social  studies,  and  a field  journal. 

Participants  were  told  that  reading  journals  were  to  be 
handed  in,  weekly,  for  five  weeks.  Reading  journals  would 
contain  responses  to  selected  readings  supplemental  to  the 
textbook  in  social  studies.  The  participants  were  asked  to 
talk  about  what  they  had  learned  from  the  readings  that  was 
most  meaningful  and  valuable  to  them  and  to  discuss  ways 
in  which  they  would  be  able  to  incorporate  those  learnings 
into  their  future  teaching. 

For  the  field  journals,  participants  were  told  that  they 
were  to  complete  three  journal  entries,  per  quarter,  for  quar- 
ters one  and  two.  These  were  to  be  handed  in  at  the  end  of 
each  quarter’s  field  experience.  During  quarter  three  (stu- 
dent teaching),  six  journal  entries  were  to  be  written  per  week. 
These  would  be  turned  in  every  other  week  for  eight  weeks. 
The  field  journals  (which  included  both  field  experience  and 
student  teaching)  would  contain  any  instructional  or  non- 
instructional  event  that  caught  their  attention,  a description 
of  it,  and  explanations  of  how  it  could  be  improved 
(Cruickshank,  Kennedy,  Williams,  Holton,  & Fay,  1981;  Van 
Manen,  1991). 

Throughout  the  study,  participants  had  the  freedom,  through 
their  field  journals,  to  address  any  event,  emphasize  any  aspect 
of  it,  state  their  feelings,  and  suggest  how  its  handling  could  be 
improved.  They  were  simply  asked  to  state  what  they  learned, 
and  how  they  would  implement  that  learning  in  the  near  future 
or  use  it  to  improve  a particular  situation. 

Data  Collection 

The  data  (journal  entries)  for  the  readings  were  collected 
as  planned  on  a weekly  basis  for  five  weeks  during  class 
sessions.  Field  experience  journals  were  collected  at  the  end 
of  each  quarter  as  planned;  and  the  student  teaching  jour- 
nals were  collected,  as  planned,  every  other  week  for  eight 
weeks.  The  principal  investigator  collected  the  data. 

From  each  participant,  five  reading  journal  entries  were 
collected  during  each  quarter  for  quarters  or . and  two.  The 
instructor  wrote  simple  evaluative  comments  ^e.g.,  unclear 


please  expand,  good  point)  on  the  journal  entries  and  re- 
turned them  to  the  participants  within  one  week.  Care  was 
taken  to  avoid  prompting  or  leading  students  to  higher  lev- 
els of  reflection.  The  instructor  returned  papers  that  were 
sketchy  and  asked  that  they  be  redone  or  expanded. 

Three  field  experience  journal  entries  were  collected 
during  each  quarter,  for  quarters  one  and  two,  and  24  jou» 
nal  entries  were  collected  for  the  student  teaching  experi- 
ence, quarter  three.  Therefore,  from  each  participant  a total 
of  40  journal  entries  were  collected.  This  included  readings 
and  field  journals.  Each  journal  entry  averaged  from  one- 
half  to  one  typed  page  in  length. 

The  reading  and  field  journal  entries  were  transcribed 
by  two  experienced  secretaries.  Before  the  transcription  took 
place,  in  order  to  ensure  confidentiality,  the  principal  inves- 
tigator coded  each  journal  entry  per  individual,  type  of  jour- 
nal and  quarter,  and  the  name  of  each  participant  was 
removed.  Copies  were  then  made  for  each  rater. 

Data  Analysis 

The  data  were  organized  into  data  sets.  Five  data  sets 
were  created  for  each  participant  as  follows:(  1 ) the  five  read- 
ing journal  entries  for  quarter  one,  (2)  the  five  reading  jour- 
nal entries  for  quarter  two,  (3)  the  three  field  journal  entries 
for  quarter  one,  (4)  the  three  field  journal  entries  for  quarter 
two,  and  (5)  the  24  field  journal  entries  for  quarter  three. 
Each  participant  was  thus  assigned  a total  of  five  ratings.  In 
total,  there  were  105  data  sets  in  this  study. 

The  unit  of  analysis  was  a conceptual  unit,  referred  to 
by  Bainer  and  Cantrell  (1992, 1 993)  as  a reflective  unit.  Each 
conceptual  unit  contained  a single  idea  or  thought  about  a 
particular  topic  or  event.  The  conceptual  units  ranged  from 
a single  sentence  to  a paragraph  in  length,  which  in  some 
cases  represented  the  entire  journal  entry.  The  conceptual 
units  were  identified  by  the  principal  investigator. 

A level  of  reflection  was  assigned  to  each  conceptual  (re- 
flective) unit.  Thus,  one  or  more  levels  of  reflection  were  as- 
signed to  each  journal  entry.  When  there  were  multiple  ratings 
for  a single  journal  entry,  those  ratings  were  averaged  to 
achieve  a single  level  of  reflection.  As  explained  above,  all 
journal  entries  of  a similar  type  (readings  or  field)  per  quar- 
ter, were  organized  into  a single  data  set.  For  each  data  set,  a 
single  overall  level  of  reflection  was  assigned  which  was  de- 
rived by  calculating  the  level  of  reflection  most  frequently 
identified  on  the  journal  entries  within  that  data  set. 

Raters  and  Ratings.  Three  raters  were  trained  in  the 
use  of  two  frameworks  for  assessing  levels  of  reflection: 
Ross  (1989)  and  Galvez  (1995).  This  process  involved  a 
two-day  training  of  three  hours  per  day.  A standard  proce- 
dure was  used  for  training  the  raters  on  each  framework. 
First,  the  framework  was  explained  and  discussed,  focusing 
especially  on  the  criteria  to  be  used  in  assigning  a level  of 
reflection  to  a conceptual  unit  which  could  be  part  of  a jour- 
nal entry  or  a whole  journal  entry,  as  described  above.  Sec- 
ond, the  raters  worked  collaborativcly  to  rate  several 
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conceptual  units  which  were  not  analyzed  as  part  of  this  study. 
Third,  the  raters  assigned  average  ratings  for  journal  entries 
as  needed.  Fourth,  the  raters  assigned  an  overall  rating  to 
the  combined  journal  entries  for  each  data  set.  Fifth,  prac- 
tice ratings  were  compared,  analyzed  and  discussed.  Sixth, 
at  the  end  of  the  final  practice  session,  each  rater  was  given 
several  data  sets  with  journal  entries  to  rate  independently. 
For  the  final  practice  session,  the  inter-rater  reliability  was 
.98  using  Cronbach’s  alpha  (Bloom,  Fischer,  & Orme,  1 995). 

All  data  sets  were  rated  following  a blind  rating  pro- 
cess. The  inter-rater  reliability  was  .95  (Cronbach’s  alpha). 
The  data  sets  were  organized  into  the  two  types  of  journals: 
the  reading  journals  with  two  sets  (quarters  one  and  two)and 
the  field  journals  with  three  sets  (quarters  one,  two,  and 
three).  The  journals  were  then  paired  with  their  respective 
assessment  instruments.  That  is,  reading  journals  were  evalu- 
ated using  Ross'  (1989)  criteria  and  field  journals  were  evalu- 
ated with  Galvez/  ( 1 995)  framework.  The  investigator  then 
coded  each  data  set  (readings:  one  and  two;  field:  one,  two, 
and  three).  To  ensure  that  the  raters  would  not  be  able  to 
identify  quarters,  the  reading  data  sets  from  quarters  one 
and  two  were  combined  into  one  cluster,  and  the  field  data 
sets  from  quarters  one,  two  and  three  were  combined  into 
another  cluster. 

Validity.  Content  validity  and  face  validity  for  each  of 
the  frameworks  were  established  by  having  three  research- 
ers in  the  field  of  teacher  education  examine  the  instruments; 
they  agreed  that  each  of  the  instruments  measured  aspects 
of  teacher  reflection.  After  the  data  were  collected,  a repre- 
sentative sample  of  the  participants  examined  the  two  frame- 
works and  agreed  that  the  content  of  the  instruments  related 
to  the  content  of  their  journals.  After  ratings  of  the  data  were 
completed,  member  check  was  used  to  corroborate  results. 
A representative  sample  (25%)  of  the  participants  were  asked 
to  verify  that  the  ratings  assigned  to  their  data  sets  accu- 
rately reflected  what  they  wrote.  The  one  hundred  and 
five  data  sets  were  analyzed  quantitatively  by  using  a re- 
peated measures  two  factor  ANOVA  completely  within  sub- 


jects design  on  (a)  the  overall  ratings  assigned  to  the  read- 
ing data  sets  rated  with  using  Ross’  (1989)  framework,  and 
(b)  the  overall  ratings  assigned  to  the  Field  data  sets  rated 
with  Galvez’  (1995)  framework.  The  SAS  statistical  pro- 
gram was  used  for  this  analysis. 

Results 

Levels  of  reflection  achieved  by  the  participants  on  the 
readings  data  sets  are  displayed  in  Table  3. 

During  quarter  one,  all  the  ratings  were  at  Ross’  (1989) 
lower  level  of  reflection  (Level  1 ).  During  quarter  two,  while 
many  of  the  ratings  remained  at  the  lower  level  of  reflection 
(Level  1)  there  was  some  movement  to  the  moderate  level 
of  reflection  (Level  2).  This  movement  is  corroborated  by 
the  means  as  well. 

Table  4 summarizes  a repeated  measures  two  factor 
ANOVA  which  was  conducted  to  test  for  completely  within 
subjects  effects  on  selected  readings  on  Ross’  (1989)  levels 
of  reflection. 

This  analysis  revealed  that  the  interaction  between  quar- 
ter one  and  quarter  two  reflections  was  statistically  signifi- 
cant (F(2,  40)  = 7.51,  p < .05)).  A post-hoc  Tuckey  test 
confirmed  the  statistical  significance  at  an  experiment  wise 
error  rate  of  .05.  These  results  indicated  that  Ross’  (1989) 
level  of  reflection  on  the  readings  achieved  in  quarter  two 
was  significantly  higher  than  the  level  of  reflection  achieved 
in  quarter  one. 

Galvez-Martin’s  levels  of  reflection  achieved  by  the  par- 
ticipants on  the  field  data  sets  are  displayed  in  Table  5. 

Some  movement  was  observed  over  the  three  quarters 
towards  higher  levels  of  reflection.  For  purposes  of  clarifi- 
cation, Levels  0.  1 , and  2 were  considered  the  lower  levels, 
Levels  3,  4,  and  5 were  considered  the  intermediate  levels, 
and  Levels  6 and  7 were  considered  the  highest  levels  of 
reflection.  During  quarter  one,  most  of  the  ratings  were  found 
between  the  lowest  (Levels  1 and  2)  and  intermediate  (Level 


Table  3 


Ross'  Levels  of  Reflection  on  Readings  in  Frequencies,  Percentages , and  Means 


Levels 

Quarter  1 

Quarter  2 

R1 

R2 

R3 

Rl 

R2 

R3 

F 

% 

F 

% 

F 

% 

F 

% 

F 

% 

F 

% 

Level  1 

19 

91 

21 

100 

21 

100 

17 

81 

8 

38 

15 

71 

Level  2 

2 

9 

0 

0 

0 

0 

4 

19 

13 

62 

6 

29 

Level  3 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

Totals 

mm 

m 

mm 

mm 

21 

100 

M 

Overall 

1.37 

1.30 

1.30 

1.32 

1.41 

1.78 

SD 

Overall 

0.25 

0.00 

0.00 

0.08 

0.29 

0.43 

R1  = Rater  1 . R2  = Rater  2;  R3  = Ratcr  3;  F = Number  of  Ratings:  % = Percentages 
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Table  4 


A Repeated  Measures  Two  Factor  ANOVA  Completely  Within  on  Selected  Readings 


Source 

df 

SS 

5 

F 

P 

Subjects 

21 

1.43 

Quarter  One  Reflections 

1 

1.98 

1.98 

18.02 

0.0004 

Subjects  by  Quarter 

20 

2.20 

0.11 

Quarter  Two  Reflections 

2 

0.53 

0.26 

3.48 

0.0404 

Subjects  Within 

40 

3.03 

0.08 

Quarter  Reflections  Within 

2 

0.97 

0.49 

7.51 

0.0017* 

Error 

40 

(2.59) 

(0.07) 

Total 

125 

12.73 

Note.  Values  enclosed  in  parentheses  represent  mean  square  errors. 
*p  < .05, 


3)  levels  of  reflection  (Level  1 ).  During  quarter  two,  most  of 
the  ratings  were  found  between  the  lower  (Level  2)  and  in- 
termediate (Levels  3 and  4)  levels  of  reflection.  During  quar- 
ter three,  most  of  the  ratings  were  found  between  the 
intermediate  (Levels  4 and  5)  and  higher  (Level  6)  levels  of 
reflection.  It  was. observed  that  the  ratings  moved  progres- 
sively from  lower  to  intermediate  and  in  some  cases  to  higher 
levels  of  reflection.  Overall,  90%  of  the  participants  gained 
in  levels  of  reflection  from  quarters  one  to  three. 

The  overall  mean  of  reflection  for  quarter  three  (M  = 
4.43)  was  significantly  higher  than  the  means  for  quarters 
one  (M  = 2.59)  and  two  (M  = 2.76).  This  showed  a growth 
over  the  three  quarters  of  two  levels  (see  Table  5). 

Table  6 summarizes  a repeated  measures  two  factor 
ANOVA  which  was  conducted  to  test  for  completely  within 


subjects  effects  on  field  experiences  rated  using  Galvez' 
(1995)  levels  of  reflection. 

This  analysis  revealed  that  the  within  subjects  interac- 
tion between  (a)  quarters  one  and  three,  and  (b)  quarters 
two  and  three  reflections  was  statistically  significant  (F{  4, 
80)  = 12.78,  p < .05)).  A post-hoc  Tuckey  test  confirmed 
that  these  interactions  were  statistically  significant  at  an  ex- 
periment wise  error  rate  of  .05.  The  main  effects  then  re- 
vealed that  most  of  the  cells  were  significantly  different. 
These  results  indicated  that  Galvez'  (1995)  level  of  reflec- 
tion achieved  in  quarter  three  was  significantly  higher  than 
the  level  of  reflection  achieved  in  quarters  one  and  two.  These 
data  indicated  that  journal  entries  based  on  student  teaching 
(quarter  three)  were  written  at  a significantly  higher  level  of 
reflection  than  journal  entries  from  the  field  experiences  dur- 
ing quarters  one  and  two. 


Table  5 

Galvez'  Levels  of  Reflection  on  Field  Experiences  in  Frequencies,  Percentages , and  Means 


Quarter  1 


Quarter  2 


Quarter  3 


Levels 


R1 

R2 

R3 

Rl 

R2 

R3 

Rl 

R2 

R3 

F 

% 

F 

% 

F 

% 

F 

% 

F 

% 

F 

% 

F 

% 

F 

% 

F 

% 

Level 

0 

0 

0 

0 

0 

0 

1 

5 

1 

5 

0 

0 

0 

0 

0 

0 

0 

0 

Level  1 

4 

19 

7 

33 

7 

33 

3 

14 

3 

14 

0 

0 

0 

0 

0 

0 

0 

0 

Level  2 

6 

29 

3 

14 

4 

19 

9 

43 

9 

43 

6 

29 

2 

9 

2 

9 

3 

14 

Level  3 

4 

19 

6 

29 

6 

29 

3 

14 

3 

14 

7 

33 

1 

5 

1 

5 

2 

9 

Level  4 

2 

9 

4 

19 

3 

14 

3 

14 

3 

14 

3 

14 

5 

24 

5 

24 

9 

43 

Level  5 

5 

24 

1 

5 

I 

5 

2 

10 

2 

10 

5 

24 

8 

38 

8 

38 

7 

33 

Level  6 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

4 

19 

4 

19 

0 

0 

Level  7 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

5 

1 

5 

0 

0 

Totals 

21 

100 

21 

100 

21 

100 

21 

100 

21 

100 

21 

100 

21 

100 

21 

100 

21 

100 

M 

2 

L91 

2.48 

2.38 

2.48 

2 

.48 

3 

.33 

i 

4.67 

4. 

67 

3 

.95 

Overall 

2.59 

2.76 

4.43 

SD 

1 

.48 

1.29 

1.24 

1.33 

1 

.33 

1 

.16 

1.28 

1. 

28 

1 

.28 

Overall 

1.21 

1.13 

1.12 

R1  - Rater  I;  R2  = Rater  2;  R3  = Rater  3;  F = Number  of  Ratings;  % = Percentages 
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Table  6 

A Repeated  Measures  Two  Factor  ANOVA  Completely  Within  on  the  Field  Experiences 


Source 

df 

SS 

S 

F 

P 

Subjects 

21 

110.74 

Quarter  Reflections  (One  & Three) 

2 

130.17 

65.09 

20.12 

0.0001 

Subjects  by  Quarter 

40 

129.39 

3.24 

Quarter  Reflections  (Two  & Three) 

2 

0.77 

0.39 

0.77 

0.4707 

Subjects  Within 

40 

20.12 

0.50 

Quarter  Reflections  Within 

4 

19.93 

4.98 

12.78 

0.0001* 

Error 

80 

(31.19) 

(0.39) 

Total 

188 

442.30 

Note . Values  enclosed  in  parentheses  represent  mean  square  errors. 


*p  < .05. 

During  the  data  analysis,  it  was  observed  that  the  jour- 
nals' content  corresponded  to  the  Reflective  Processes  com- 
ponent of  Boud  et  al.’s  (1985)  Model  and  was  the  expected 
outgrowth  of  the  first  component  (Experience).  The  analy- 
sis using  Ross'  ( 1 989)  and  Galvez’  ( 1 995)  frameworks,  pro- 
vided insights  not  only  about  the  level  of  reflection  that  the 
participants  achieved  but  also  about  how  the  level  of  reflec- 
tion varied  across  quarters  (Reflective  Processes).  This  analy- 
sis also  revealed  that  the  journal  entries  did  not  represent 
elements  of  Boud  et  al.’s  third  component  (Outcomes)  even 
though  the  participants  had  opportunities  to  do  so. 

Conclusions 

In  this  study,  preservice  teachers  were  asked  to  partici- 
pate in  reflective  activities,  but  they  were  not  specifically 
trained  in  reflection  or  reflective  thinking.  Over  two  quar- 
ters, even  without  training,  the  average  levels  of  reflection 
on  readings  did  increase  significantly  from  Ross’  (1989)  low- 
est to  moderate  levels  of  reflection,  that  is  from  Level  1 to 
Level  2.  Over  three  quarters,  even  without  training,  the  av- 
erage level  of  reflection  on  field  experiences  did  increase 
significantly  from  Galvez’  (1995)  lowest  to  intermediate  lev- 
els of  reflection,  that  is  from  Level  2 to  Level  4.  These  re- 
sults appear  to  align  with  Dewey  (1904)  and  Kuhn  (1986) 
who  suggest  that,  in  effect,  preservice  teachers  learn  to  re- 
flect by  reflecting. 

There  could  be  several  explanations  for  our  results.  First, 
the  results  may  be  related  to  the  length  of  the  study  (three 
quarters)  which  allowed  sufficient  time  for  changes  to  be 
measured.  A second  possible  explanation  may  be  the  age, 
greater  maturity,  or  experiences  of  some  of  the  participants. 
Third,  some  connection  between  requisite  cognitive  ability 
and  learning  may  have  occurred  during  this  period  that  pro- 
moted a change  in  level  of  reflection. 

Fourth,  the  fact  that  the  level  of  reflection  during  stu- 
dent teaching  (quarter  three)  was  significantly  higher  than 
the  levels  of  reflection  achieved  during  field  experiences 
(quarters  one  and  two)  may  be  related  to  the  nature  of  the 
student  teaching  experience.  That  is,  student  teachers  arc 


totally  involved  in  the  field  experience,  whereas  during  quar- 
ters one  and  two,  the  field  experiences  are  linked  with  meth- 
ods courses  and  there  is  little  involvement  in  classroom 
teaching.  This  explanation  would  lend  support  to  other  re- 
searchers who  have  found  that  the  greatest  growth  in  reflec- 
tion occurs  in  the  field  experiences,  that  is,  in  real  classroom 
settings  (Bolin,  1988;  Dewey,  1933;  Roth,  1989;  Liston  & 
Zeichner,  1987). 

Only  one  participant  in  the  study  demonstrated  the  high- 
est level  of  reflection  (i.e.,  analyzing  teaching  situations  from 
multiple  perspectives,  and  evaluating  and  adjusting  one’s  own 
teaching  performance  in  response  to  children’s  individual 
differences).  Most  participants  achieved  only  intermediate 
levels  of  reflection. 

Explanations  for  these  results  may  include  the  follow- 
ing. First,  they  could  be  due  to  the  lack  of  specific  training 
for  the  participants  in  reflection  and  reflective  thinking.  Sec- 
ond, the  participants  may  not  yet  have  developed  the 
(pre)requisite  cognitive  abilities  that  would  enable  them  to 
move  towards  the  highest  levels  of  reflection.  Third,  there 
may  exist  some  cognitive  processes  related  to  reflection  that 
are  not  adequately  measured  by  the  two  selected  frameworks. 

Our  findings  suggest  that  when  preservice  teachers  are 
given  opportunities  to  reflect  over  time,  many  do  grow  in 
their  level  of  reflection  even  without  specific  training.  How- 
ever, it  seems  clear  from  these  results  that  simply  asking 
preservice  teachers  to  reflect  will  not  turn  them  into  practi- 
tioners who  consistently  reflect  at  the  highest  levels,  at  least 
not  over  a three  quarter  period  of  time. 

In  terms  of  limitations  of  this  study  and  recommenda- 
tions for  future  studies,  this  sample  size  was  small  and  the 
nature  of  the  sample,  being  at  the  graduate  level,  limits  our 
ability  to  generalize  these  findings  to  other  populations.  Fur- 
ther studies  should  be  designed  to  replicate  this  work  with 
undergraduate  preservice  teachers.  A limited  number  of 
frameworks  were  used  to  assess  levels  of  reflection,  and  fu- 
ture studies  should  also  include  other  frameworks  such  as 
Van  Manen’s  (1977)  and  Zeichner  and  Liston’s  (1985),  which 
would  allow  direct  comparison  of  a variety  of  theoretical 
frames.  One  framework  should  also  be  applied  across  differ- 
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ent  types  of  data  (journals)  in  order  to  identify  possible  dif- 
ferences in  achieved  levels  of  reflection. 

Further  empirical  studies  are  needed  to  measure  achieved 
levels  of  reflection  over  a longer  period  of  time.  Such  studies 
would  help  to  determine  whether  the  growth  rate  continues 
when  preservice  teachers  are  given  opportunities  to  reflect, 
but  are  not  given  specific  training  in  reflection.  Related  stud- 
ies are  also  needed  to  investigate  possible  relationships  among 
cognitive  developmental  maturity,  critical  thinking  skills,  and 
achieved  levels  of  reflection  over  time. 
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The  1998  Annual  Meeting  of  the  Mid-Western  Educational  Research  Association  (MWERA)  returns 
to  Chicago  with  an  exciting  program  of  speakers,  workshops,  peer-reviewed  papers,  and  activities  for 
participants  and  their  families.  Three  dynamic  invited  speakers  focus  each  day’s  activities,  with 
peer-reviewed  sessions  forming  the  backbone  of  the  conference.  In  addition,  workshops  will  be 
scheduled  throughout  the  four-day  r\eeting,  allowing  attendees  to  participate  in  a wide  range 
of  focused,  longer-term  sessions  on  a variety  of  interesting  topics.  Attendees  can  choose 
from  a variety  of  session  formats,  including: 


✓ Paper  Presentation  (3-5  papers  per  session  with  a Session  Chair  and  Session  Discussant) 

✓ Roundtable  Discussion/Poster  (for  heightened  presenter-attendee  interaction) 

✓ Symposium  (focusing  on  specific  topics  from  a variety  of  perspectives) 

✓ Workshop  (longer-term  focused  work  cm  a topic  of  interest) 

✓ Alternative  Format  (with  a range  of  different  time  lengths  and  interactive  activities) 

Sessions  have  been  organized  around  the  themes  of  1 1 different  divisions: 


A - Administration  and  Leadership 

B - Curriculum  Studies 

C - Learning  and  Instruction 

D - Measurement  and  Research  Methodology 

E - Counseling  and  Development 

F - History  and  Philosophy 

G • Social  Context  of  Education 

H - School  Evaluation  and  Program  Development 

I - Education  in  the  Professions 

J - Postsecondary  Education 

K - Teaching  and  Teacher  Education 


Chicago’s  Holiday  Inn  Mart  Plaza  will  host  the  1998  annual  conference.  This  wonderful  facility  boasts  spacious, 
comfortable  guest  rooms,  excellent  meeting  facilities,  and  an  indoor  pool  and  exercise  room.  It  is  centrally  located 
to  many  shops  and  restaurants  just  within  a short,  safe  walk  of  the  hotel.  Chicago’s  museums,  planetarium  and 
aquarium,  theater  district,  and  lively  night  life  are  also  just  minutes  from  our  hotel  location! 

The  Mid-Western  Educational  Research  Association  offers  scholars  and  practitioners,  researchers  and  instructors, 
and  educators  from  all  levels  and  perspectives  an  opportunity  to  share  ideas  with  others  in  a supportive  environment 
of  collaboration.  The  MWERA  meeting  is  where  people  from  all  over  the  United  States  come  to  hear  the  latest  in 
educational  thought  and  progress,  and  to  make  new  contacts  and  renew  existing  acquaintances,  in  a spirit  of 
professional  friendship  and  collegjality! 


Invited  Speakers 

to  the 

1998  Annual  Meeting  of  the  Mid-Western  Educational  Research  Associatio 


Dr.  Robert  C.  Albrecht 

Western  Governors  University 

Dr.  Robert  C.  Albrecht  serves  as  the  Chief  Academic  Officer  of  the  Western  Governors  Universit 
of  the  University.  In  the  summer  of  1996  he  had  been  named  as  co-director  of  the  University;  in  1 
Board  of  WGU,  he  was  designated  the  Chief  Academic  Officer.  From  1989  until  1997,  Dr.  Albrecl 
President  of  the  University  of  Colorado,  chiefly  dealing  with  technology  across  the  four  campuses  c 
from  Illinois,  Michigan  and  Minnesota,  where  he  was  awarded  the  Ph.D.  in  American  Studies,  AT 
of  Chicago  and  the  University  of  Oregon.  He  then  served  in  positions  in  academic  affairs  at  the  Ui 
and  the  Montana  University  System  until  1 989.  Dr.  Albrecht’ s publications  include  books  and  jouma 
academic  administration  and  distance  learning. 


"Western  Governors  University:  New  Challenges,  New  Technologies,  New  Univt 


Over  two  years  ago  representatives  of  the  governors  of  sixteen  western  states  met  and  drafted  plans  to  form  the  largest  “vii 
Their  plan  called  for  the  creation  of  a consortium  of  government  and  private  industry  to  form  a new  institution.  This  new 
competencies  in  selected  academic  and  technical  areas,  then  award  degrees  in  the  fields  to  students  who  mastered  these  comp> 
universities,  and  corporations  could  market  qualifying  distance  learning  courses  to  prospective  students,  who  would  then  1 
mix  of  in-person,  traditional  distance  education,  and  Internet-based  forums.  After  two  years  of  preparation,  and  over  $9-milli 
will  open  its  virtual  doors  in  the  next  few  months  to  its  first  on-line  students.  Dr.  Albrecht’s  remarks  at  the  Keynote  address  (1 
through  10:20am)  and  Follow-Up  Discussion  (10:30am  through  1 1 :50am)  will  focus  on  the  aspirations  of  the  competency-b 
being  implemented  by  W GU,  and  the  current  and  future  challenges  facing  both  WGU  and  traditional  institutions  of  higher  e< 
the  operations  and  technolopes  of  WGU,  giving  attendees  a glimpse  into  the  university  of  the  21“  century. 


Dr.  Judith  M.  Gf 

Purdue  Unive 


Dr.  Judith  M.  Gappa  is  the  Vice  President  for  Human  Relations  and  a Professor  of  Educational  Administration  at ' 
University.  She  is  a graduate  of  the  Institute  for  Educational  Management  of  Harvard  University,  after  earning  an  E 
Educational  Administration  from  Utah  State  University.  Dr.  Gappa  spent  two  years  as  a Senior  Associate  in  the  Washingto 
office  of  American  Association  of  Higher  Education  conducting  research  on  a variety  of  topics  including  changing  faculi 
and  responsibilities.  Prior  to  that  she  served  as  an  Affirmative  Action/Equal  Opportunity  Programs  Director  at  Utal 
University  and  an  Associate  Vice  President  for  Faculty  Affairs  at  San  Francisco  State  University.  She  is  the  author  of  ( 
books,  monographs,  articles,  and  research  reports;  is  a member  of  several  editorial  boards  and  higher  education  associat 

- - - - - - - - - 


a frequent  presenter  and  speaker  at  local,  state,  and  national  meetings.  Her  1993  book  titled  The  Invisible  Faculty:  Impro\ 
in  Higher  Education  (co-authored  with  David  W.  Leslie)  is  already  considered  a classic  study  on  the  status  of  part-times  ir 


“The  Academic  Career  in  the  21st  Century : New  Options  for  Faculty” 

The  academic  career  in  the  later  20*  and  early  21*  century  is  changing,  in  response  to  both  internal  and  external  pressures.  T1 
and  universities,  changing  workloads,  and  issues  surrounding  achieving  balance  in  personal  and  professional  lives  are  ma 
different  occupation  that  it  once  was.  One  of  the  most  notable  changes  has  been  that  today  less  than  50%  of  faculty  occup; 
26%  of  all  full-time  faculty  occupying  non-tenurable  positions).  Dr.  Gappa  will  investigate  these  pressures,  and  how  unive: 
with  both  modifications  to  the  traditional  system  of  tenure  and  outright  alternatives  to  tenure,  in  her  Luncheon  Address  (Frida; 
1 :30pm)  and  Follow-Up  Discussion  (Friday,  October  1 6*,  1 :40pm  through  3 :00pm).  She  will  discuss  stopping  the  clock,  post 
incentive  plans  that  are  affecting  tenure-track  faculty.  Dr.  Gappa  will  also  present  other  models  of  full-time  non-tenurable . 
of  these  alternative  employment  arrangements  that  might  make  them  viable  career  options  for  many  people.  Faculty  at  all  sta 
graduate  students  and  new  career  faculty,  will  want  to  attend  to  consider  the  changing  nature  of  the  profession  and  hear  D 
next  decade  9and  beyond)  in  higher  education. 


Dr.  Kim  K.  Metcalf 

Indiana  University 

Dr.  Kim  Metcalf  is  an  Associate  Professor  of  Curriculum  and  Instruction  in  the  School  of  Educal 
currently  serves  as  the  Director  of  the  Junior  Achievement  Center  for  Evaluation.  Dr.  Metcalf  is  a 191 
University,  where  he  received  his  Ph.D.  in  Teacher  Education  and  Educational  Research  and  Evalu 
focused  on  the  relationship  between  instructional/classroom  practices  and desirable  student  outcome 
and  simulated  experiences  in  the  professional  development  of  teachers.  His  work  has  appeared  in 
scholarly  journals  and  has  been  honored  by  several  scholarly  associations,  among  them  The  Ohio  Stai 
of  Teacher  Educators.  He  is  also  a co-author  of  the  chapter  “Training  within  Teacher  Education” 
on  Teacher  Education  and  The  Act  of  Teaching.  Most  recently  Dr.  Metcalf  has  led  a team  of  rese; 
scale  evaluation  of  the  highly  contentious  Cleveland  Scholarship  (Voucher)  Program. 


“ Free  Market  Policies  and  Public  Education:  At  What  (Opportunity)  Cost?” 


The  issue  of  school  choice,  particularly  the  use  of  private  school  tuition  vouchers,  is  among  the  most  contentious  issues  facii 
Importantly,  public  support  and  political  momentum  make  it  likely  that  more  and  more  states  will  implement  programs  wl 
funds  to  send  their  children  to  the  public  or  private  school  of  their  choice.  In  spite  of  or  perhaps  because  of  the  passion  of  tl 
proponents  rely  primarily  on  emotion  to  support  their  positions.  Largely  ignored  are  previous  and  on-going  studies  which 
effects  of  public-private  voucher  programs.  It  is  this  knowledge  base  and  its  implications  for  the  future  not  only  of  vou< 
education  as  well  that  will  be  considered.  Dr.  Metcalf  will  investigate  the  implications  of  vouchers,  and  provide  some  Insij 
the  Cleveland  Scholarship  Program,  at  the  Presidential  Address  (Saturday,  October  17*,  9:30am  through  10:20am). 
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The  1998  annual  conference  is  on  the  World  Wide  Web!  The  URL  is: 

http://tierlab.ilstu.edu/MWERA-98 

This  WWW  site  provides  the  latest  planning,  news  and  information  about  the  conference.  Special  pages  feature 
additional  information  about  the  invited  speakers.  Conference  registration  and  hotel  reservation  details  are  also  on 
the  site,  along  with  links  to  the  many  highlights  the  City  of  Chicago  has  to  offer.  Detailed  conference  scheduling, 
along  with  the  full  text  abstracts  of  accepted  presentations  and  a searchable  database  of  other  program  information, 
is  also  available  to  help  attendees  plan  their  time  at  the  conference  and  in  the  “Windy  City”! 

For  more  information  about  MWERA-98  visit  the  web  site,  or  contact: 

Dr.  Jeffrey  B.  Hecht 
MWERA-98  Program  Chair 
Campus  Box  5900 
Illinois  State  University 
Normal,  Illinois  61790-5900 

e-mail:  MWERA-98@ilstu.edu 
Phone:  (309)  438-5585 


The  Mid-Western  Educational  Research  Association  (MWERA)  is  a non-profit  organization  of  professional 
educational  researchers  primarily  from  states  and  provinces  located  in  the  mid-western  region  of  the  United 
States  and  Canada.  Membership  is  open  to  teachers,  administrators,  graduate  students,  and  educational 
researchers  from  any  school,  college,  or  university;  from  business  or  industry;  or  from  governmental  or 
private  agencies  and  organizations.  Annual  dues  include  a subscription  to  the  Mid-Western  Educational 
Researcher,  the  official  peer-reviewed  journal  of  the  association,  and  a reduced  registration  fee  for  the 
annual  conference.  For  information  about  becoming  a member  of  MWERA,  please  contact: 

Dr.  Jean  W.  Pierce 
EPCSE  Department 
Northern  Illinois  University 
DeKalb,  Illinois  601 15-2854 
e-mail:  jpierce@niu.edu 
Phone:  (815)753-8470 


Conversations  with  Project  Directors 

Reading  Recovery 

Gay  Su  Pinnell,  Carol  Lyons  and  Diane  DeFord 
The  Ohio  State  University 

interviewed  by 

Emily  Rodgers 
The  Ohio  State  University 

Reading  Recovery  is  an  early , short-term  intervention  literacy  program.  It  helps  the  lowest  achieving 
first  grade  children  develop  effective  and  efficient  problem  solving  processes  and  strategies  used  by 
successful  children  in  the  classroom.  The  goal  of  the  program  is  to  bring  those  children  who  are  having 
most  difficulty  developing  literacy  skills  to  a level  of  achievement  at  or  beyond  their  peers.  This  way, 
they  can  participate  in  and  benefit  from  regular  classroom  literacy  instruction. 

Q . Would  you  describe  the  implementation  of  the  Read-  Q : How  has  the  program  grown  in  the  U.S.  since  its 


ing  Recovery  program  in  the  United  States? 

A : Marie  Clay  initiated  the  Reading  Recovery  program  in 
New  Zealand  in  the  1970s  as  a result  of  her  research  into  the 
early  reading  behaviors  of  young  children.  The  program  was 
adopted  nationwide  in  New  Zealand  in  the  early  1980s.  In 
1983  Gay  Su  Pinnell  wrote  a proposal  to  implement  Read- 
ing Recovery  in  six  central  Ohio  public  school  districts.  As 
a result  of  the  positive  outcomes  at  the  end  of  that  pilot  year 
in  1984-1985,  the  state  legislature  agreed  to  fund  Reading 
Recovery  as  a state-wide  program  in  1985-1986.  That  same 
year,  The  Ohio  State  University  mounted  a program  to  train 
Reading  Recovery  teacher  leaders.  There  were  28  people  in 
the  first  training  program. 


Diane  DeFord 


pilot  year  in  1984? 

A : It’s  staggering  how  it  has  expanded.  In  1984 -1985,  the 
program’s  pilot  year,  just  one  school  district  in  Ohio  and  16 
teachers  were  involved.  That  first  year,  1 10  children  were 
served  by  Reading  Recovery.  By  comparison,  99,  617  chil- 
dren were  served  by  the  program  in  the  United  States  in 
1995  - 1996,  nearly  100,000  more  than  the  implementation 
year.  Over  the  last  14  years,  2939  school  districts  involving 
9062  schools  and  14,153  teachers  have  participated  in  the 
.Reading  Recovery  program. 

Q : The  name  “Reading  Recovery”  begs  the  question: 
What  are  children  recovering  from? 

A : There  are  many  ways  the  term  “recovery”  can  be  used. 
The  U.S.  tends  to  think  of  a medical  terminology  before 
other  possible  uses — recovery  from  a disease,  for  example. 
However,  in  New  Zealand  where  the  program  originated, 
“recovery”  is  a nautical  term.  It  means  to  “right  one’s  course” 
and  is  not  to  be  associated  with  the  medical  uses. 

g:  How  have  you  gone  about  securing  funding  for  the 
program? 

A : Initially,  for  the  pilot  year,  funding  was  secured  through 
a combination  of  grants  from  several  foundations.  Follow- 
ing the  pilot  year,  we  received  a grant  from  the  Ohio  De- 
partment of  Education  to  provide  further  training  and  a 
research  grant  from  the  MacArthur  Foundation.  Ongoing 
funding  is  definitely  a concern  because  the  scope  of  our  work 
and  responsibility  have  continued  to  expand  but  the  funds 
have  declined. 

Q : How  is  Reading  Recovery  different  from  traditional 
remedial  reading  programs  where  students  are  pulled 
out  from  their  regular  classrooms  for  extra  help  with 
reading? 

A:  It  is  both  similar  and  different.  It  is  a “pull-out”  pro- 
gram in  that  a teacher  must  work  one-to-one  with  a child, 
and  a quiet  place  insures  the  child’s  ability  to  attend  care- 
fully in  every  lesson.  However,  it  is  an  early  intervention 
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program,  not  a remedial  program.  In  this  sense,  Marie  Clay, 
the  program’s  developer,  wanted  a program  that  would  in- 
tervene early  while  the  least  difference  between  the  child’s 
current  abilities  and  the  average  performing  child  might  be 
made  up  in  a short  program.  Most  children  are  in  Reading 
Recovery  from  12-15  weeks,  although  20  weeks  is  an  out- 
side limit.  This  insures  that  the  child  will  rapidly  achieve 
accelerative  learning,  and  lessen  the  need  for  further  reme- 
dial services.  If,  however,  after  an  intense  program  of  this 
nature  it  is  deemed  that  the  child  would  benefit  from  a longer 
service  program  such  as  special  education  or  more  typical 
remedial  services,  the  child  may  be  referred  to  that  program. 


Gay  Su  Pirtnell 


Q : What  are  the  theoretical  underpinnings  of  Reading 
Recovery  instruction.  Where  does  it  fit  in  the  body  of 
current  research  on  early  reading  and  writing? 

A : The  fundamental  underpinnings  of  Reading  Recovery 
include  35  years  of  research  in  language  learning  which  have 
illustrated  the  theory  of  learning  as  a constructive  process. 
The  early  language  research  demonstrated  that  children  use 
language  to  communicate  meaning.  Marie  Clay’s  early  re- 
search demonstrated  that  young  children  construct  meaning 
as  they  read.  Bruner’s  theory  of  serial  order,  Luria’s  theory 
of  the  complex  brain  functioning  in  speech  and  writing  pro- 
cesses, theories  of  perceptual  and  cognitive  processing  and 
theories  about  phonology  nave  all  contributed  to  Clay’s 
theory  of  text  reading.  Clay’s  theory  of  literacy  acquisition 
incorporates  theories  of  other  scholars  (e.g.  Bruner,  Luria, 
Elkonin,  Goswami,  Bryant,  Smith)  and  stresses  that  during 
acquisition  of  literacy,  the  child  must  learn  what  lo  attend  to 
in  the  text  and  how  to  access  that  information.  She  calls  these 
processes  “divided  attention”. 

The  current  research  on  early  reading  is  changing,  so 
one  of  the  challenges  is  to  keep  up  with  and  incorporate 


current  research  into  the  program.  Differences  in  editions  of 
Clay’s  published  material  reflect  the  theoretical  changes  that 
have  occurred  over  time.  These  theoretical  changes  are  also 
evident  in  the  refinement  of  the  Reading  Recovery  proce- 
dures. The  changes  are  not  haphazard  but  the  result  of  care- 
ful evaluation  over  time.  The  changes  in  Reading  Recovery 
practice  are  gradually  assimilated  through  ongoing  profes- 
sional development  of  teacher  leaders  and  Reading  Recov- 
ery teachers. 

Q : As  program  directors  of  Reading  Recovery,  you  have 
conducted  a considerable  amount  of  research  into  the 
effectiveness  of  the  program.  What  have  been  your  ma- 
jor findings? 

A:  Reading  Recovery  has  been  proven  an  effective  pro- 
gram for  first  grade  children.  In  tests  against  other  one-on- 
one  tutorials,  Reading  Recovery  was  significantly  better 
(Pinnell,  Lyons,  DeFord,  Bryk,  & Seltzer,  1994).  In  1995- 
1996,  we  were  successfully  able  to  bring  57%  of  all  chil- 
dren who  received  Reading  Recovery  lesson,  to  within  the 
average  of  their  class.  This  reference  includes  every  child 
who  received  a Reading  Recovery  lesson  in  the  United  States 
during  that  school  year,  even  if  the  child  received  just  one 
lesson.  Few  programs  have  this  stringent  a requirement,  not 
this  type  of  success. 


Carol  Lyons 


Q : Since  1984,  over  200,000  first  graders  in  North  America 
who  received  a Reading  Recovery  program  reached  the 
average  reading  levels  of  their  peers  in  about  16-20  weeks. 
How  do  you  account  for  this  accelerated  progress? 

A:  There  are  several  factors,  but  the  highly  skilled  decision- 
making of  teachers  is  the  major  influencing  factor.  The  teach- 
ers report  that  ongoing  professional  development  keeps  them 
apprised  of  most  recent  developments,  and  makes  skillful 
teaching  a continuous  pursuit.  In  addition,  there  arc  issues  of 
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implementation  that  can  facilitate  this  program.  For  example, 
a site  needs  an  adequate  number  of  teachers  serving  the  pro- 
portion of  children  in  greatest  need.  This  may  vary  by  site, 
but  usually  10-15%  is  a initial  goal  of  most  schools.  If  a 
school’s  level  of  need  is  20%  and  their  level  of  service  is  only 
5%,  the  effectiveness  of  the  program  may  suffer. 

Q : Since  Reading  Recovery  instruction  has  been  dem- 
onstrated to  be  so  effective,  why  is  it  limited  to  first  grad- 
ers? What  about  older  students  who  are  having  difficulty 
with  reading? 

A:  Reading  Recovery  is  limited  to  first  graders  because 
that  is  when  children  are  most  likely  to  catch  up  to  their 
peers.  You  have  to  put  efficiency  and  economy  in  a preven- 
tion mode,  not  a remediation  mode. 

Can  it  work  with  older  students?  Yes,  but  it  would  take 
longer  than  12  - 20  weeks  of  individual  instruction.  If  you 
took  a Reading  Recovery  teacher’s  understanding  of  the  read- 
ing and  writing  process  and  their  understanding  of  develop- 
ing self-regulatory  behaviors  and  what  that  means,  certainly 
Reading  Recovery  would  work.  You  would  get  improvement 
in  older  students’  ability  to  read.  We  have  two  dissertations 
that  did  this  with  adults.  It’s  not  Reading  Recovery  anymore, 
though.  It’s  taking  the  knowledge  and  some  of  the  proce- 
dures as  well  as  the  rationales  behind  those  procedures  and 
applying  them  to  a different  population. 

Q : In  a recently  published  document,  Learning  Disabili- 
ties — A Barrier  to  Literacy  Instruction  (1995),  the  Inter- 
national Reading  Association  identified  Reading 
Recovery  as  a program  that  reduces  the  number  of  stu- 
dents who  are  labeled  learning  disabled.  Is  there  evidence 
that  Reading  Recovery  can  reduce  the  learning  disabled 
population?  If  so,  how  do  you  account  for  this  effect? 

A:  There  is  research  that  shows  that  it  is  doing  that  (see 
Lyons,  in  press).  But  there  are  problems  collecting  LD  data. 
It’s  not  as  readily  available  because  school  districts  often  do 
not  release  retention  and  LD  referral  data  to  the  public. 

Can  Reading  Recovery  reduce  the  learning  disabled 
population?  Yes,  because  in  our  view  the  children  were 
mislabeled  in  the  first  place.  They  never  had  a learning  dis- 
ability, they  were  instructional^  disabled.  For  example,  if 
the  instructional  approach  is  to  focus  on  learning  letter 
sounds  and  words  in  isolation  then  children  who  are  most  at 
risk  and  who  are  vulnerable  to  instruction  will  rely  on  these 
unproductive  reading  strategies. 

In  1986-1987,  110  children  were  served  by  the  Read- 
ing Recovery  teacher-training  class  in  Ohio.  One  third  of 
these  1 10  children  had  been  labeled  “learning  disabled”.  Yet 
83%  of  them  successfully  completed  the  program  and  were 
reading  at  or  near  the  average  reading  levels  of  their  peers. 

Q : What  do  we  know  now,  13  years  after  the  program 
was  first  implemented  about  the  long  term  effects  of 
Reading  Recovery?  Do  Reading  Recovery  students  main- 
tain their  gains  in  reading  after  first  grade? 


A:  In  early  1998  an  annotated  bibliography  of  follow-up 
studies  on  Reading  Recovery  students  will  be  available.  The 
Ohio  follow-up  study  has  control  groups  (see  Reading  Re- 
covery in  Ohio,  1997).  Three  others  that  come  to  mind,  are 
in  Massachusetts  (see  Reading  Recovery  in  Massachusetts, 
1995-1996);  Texas  (see  Reading  Recovery  in  Texas,  1988- 
1996),  and  New  York  (see  Jaggar,  Smith-Burke,  Ashdown, 
& Simic,  1996).  Each  of  them  used  their  state  assessments 
to  see  how  Reading  Recovery  children,  who  were  discon- 
tinued, do.  They’ve  maintained  their  gains. 

Q : Wilson  and  Daviss,  authors  of  Redesigning  Education , 
have  stated  that  “Reading  Recovery  is  the  best  evidence 
yet  of  the  direct  link  between  good  design  and  educational 
excellence”  (see  Wilson  & Daviss,  1994,  p.76).  Would  you 
comment  on  the  design  of  the  program  and  how  this  is 
linked  to  the  effectiveness  of  Reading  Recovery. 

A:  Because  Reading  Recovery  invests  in  teachers’  profes- 
sional development  (intense  training,  continuous  professional 
development)  and  maintains  a extensive  research  base,  it  is 
able  to  make  each  implementation  an  effective  one.  No 
teacher  is  alone  in  this  program.  The  networks  within  a given 
district,  through  the  teacher  leader  in  the  district,  the  state 
department  in  each  state,  to  the  training  institution,  makes 
this  program  unique. 

Q : Michael  Fullan  has  described  the  challenges  in  bring- 
ing about  long-lasting  change  in  education.  Have  you 
faced  such  challenges  with  implementing  Reading  Re- 
covery? How  have  you  dealt  with  them? 

A ; Every  year,  there  have  been  challenges  related  to  change. 
At  first,  the  challenges  were  local  and  were  related  to  ad- 
ministrative competition,  program  competition,  etc.  We  dealt 
with  them  by  forming  relationships  and  bridges  with  indi- 
viduals. We’ve  found  that  the  most  powerful  way  to  achieve 
collaboration  is  to  establish  a personal  relationship  with  in- 
dividuals and  to  focus  on  what  we  can  do  together.  That 
becomes  more  and  more  difficult  as  the  project  gets  larger. 

There  have  been  challenges  at  every  level  and  in  each 
period  of  growth.  Challenges  such  as  transporting  children 
for  the  “behind  the  glass”  session  shook  everyone  up  in  the 
beginning.  We  no  longer  get  calls  about  that  factor.  Also, 
the  long  term  training  was  just  seen  as  unnecessary.  Now, 
everyone  wants  year  long  training.  Other  challenges  have 
surfaced.  Right  now,  Reading  Recovery  is  caught  up  in  the 
discussion  over  phonics  vs.  whole  language.  The  issues  are 
muddied  because  special  programs  like  Reading  Recovery 
are  being  confused  with  classroom  appioaches  that  include 
all  children.  We  can  not  design  classroom  approaches  based 
solely  on  what  we  have  learned  from  special  education. 
Reading  Recovery  fits  into  that.  We  simply  wouldn’t  want 
all  children  to  have  Reading  Recovery  or  anything  like  it. 

Ollier  challenges  come  from  the  creation  of  bureaucracy, 
even  within  Reading  Recovery,  as  it  grows  larger.  We  are 
always  trying  to  balance  individual  agendas  and  ambitions 
with  the  good  of  the  whole. 
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Education,  and  therefore  any  act  of  teaching,  must  be 
accountable.  So  one  of  the  challenges  is  to  keep  this  system 
accountable  at  every  level,  to  make  necessary  improvements, 
and  to  meet  the  needs  of  children  in  very  diverse  settings. 
Consequently,  while  there  is  a model  of  implementation  and 
national  guidelines  that  all  teachers,  teacher  leaders,  and 
trainers  must  use,  there  also  must  be  a way  to  flexibly  relate 
to  each  new  site,  each  new  teacher,  and  each  new  student  to 
keep  evolving  to  meet  new  demands.  Other  challenges  are 
to  keep  the  public  we  serve  informed,  to  conduct  research  to 
address  important  questions  related  to  program  success,  and 
to  keep  educational  systems  working  together. 
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Abstract 

The  research  literature  indicates  nontraditional  students  in  higher  education  are  different  from  their 
traditional  counterparts.  Understanding  our  university  clientele  is  important  in  being  able  to  meet 
their  needs.  Instructors  are  encouraged  to  analyze  their  teaching  strategies  and  to  incorporate  those 
which  can  further  aid  older  students  in  their  educational  pursuits. 


Terms  the  general  public  may  use  to  describe  a college 
student  could  include  career  directed,  young,  eager,  rebel- 
lious, inquisitive,  partier,  and  idealistic.  While  these  descrip- 
tors may  be  somewhat  accurate,  the  majority  of  the  words 
are  intended  to  describe  only  a portion  of  the  college  popu- 
lation— the  stereotypical  traditional -aged  college  student. 
Movies  and  television  shows  further  depict  college  students 
in  a very  customary  light  according  to  age.  Often,  the  col- 
lege experience  is  seen  as  the  last  time  to  fully  enjoy  life 
without  everyday  realities  coming  into  play.  Increasingly, 
this  picture  is  not  the  reality  for  a large  number  of  college 
students. . . the  nontraditional-aged  persons  attending  insti- 
tutions of  higher  education. 

Nontraditional  students  are  defined  as  those  individuals 
who  are  age  twenty-five  and  older  and  are  either  working  on  a 
bachelor’s  degree  or  post-baccalaureate  non-degree  program 
(Bishop-Clark  & Lynch,  1992;  Beder  & Darkenwald,  1982; 
Breese  & O’Toole,  1994).  They  are  often  referred  to  as  older 
students,  returning  students,  or  adult  students.  The  number  of 
nontraditional  students  in  colleges  and  universities  has  reached 
forty-five  percent  of  all  undergraduate  students  enrolled  in 
higher  education  institutions.  This  is  an  increase  of  seven 
percent  over  the  past  decade  (Rose,  1994;  U.S.  Department 
of  Education,  1994).  It  is  estimated  that  by  the  year  2000, 
over  twenty  million  older  students  will  be  enrolled  (Grottkau 
& Davis,  1987;  Haviland  & Mahaffy,  1985). 

The  nontraditional  student  population  is  a significant 
group  in  undergraduate  programs  in  terms  of  both  numbers 
and  percentage  of  enrollment.  As  these  numbers  continue  to 
increase,  undergraduate  institutions  must  look  at  the  unique- 
ness of  the  adult  learner  and  attempt  to  meet  their  needs.  The 
purpose  of  this  paper  is  to  review  the  research  conducted  on 
nontraditional  students  in  an  attempt  to  help  individuals  bet- 
ter understand  and  work  with  this  large  sector  of  the  higher 
education  population  in  the  classroom. 

Historical  Background 

Prior  to  1940,  adults  sought  out  program  alternatives 
such  as  evening  classes,  special  “adults  only”  offerings,  off- 
campus  programs,  and  correspondence  study  (Kaswomn 


1980).  Colleges  and  universities  during  this  time  focused 
on  the  traditional  16-24  year  old  student.  Two  events  in  the 
past  50  years  have  changed  the  look  of  college  campus  popu- 
lations. First,  in  the  mid- 1 940’s  a shift  toward  nontraditional 
students  in  daytime  undergraduate  education  began  with  the 
enactment  of  the  “GI  Bill”.  Thousands  of  veterans  entered 
daytime  collegiate  programs  accounting  fo:  a total  of  27.6% 
of  the  entire  undergraduate  enrollment  in  the  1945-46  aca- 
demic year  (Kasworm,  1980).  A second  significant  event  in 
undergraduate  programs  occurred  from  1960-72.  It  was  the 
emergence  of  “re-entry  women”.  A “three  fold  gain”  of  non- 
traditional enrollment  was  registered  during  that  time  pe- 
riod by  women  students  who  were  25  to  34  years  of  age. 
Further  the  Women’s  Bureau  of  the  U.S.  Department  of  La- 
bor (1974)  estimated  this  gain  was  probably  exceeded  by 
women  over  35. 

This  growth  in  nontraditional  student  population  has 
continued  in  recent  years.  Contributing  factors  relate  to 
changing  career  and  leisure  expectations,  advances  in  tech- 
nology and  business  operations,  changing  roles  of  men  and 
women  in  society,  and  the  rise  in  consciousness  regarding 
life  quality  (Hall  & Miller,  1989;  Iovacphini,  Hall  & 
Hengstler,  1985). 

Profile  of  the  Nontraditional  Student 

Adult  students  are  a highly  diverse  group  that  don't  eas- 
ily fit  into  a neat  demographic,  homogeneous  profile.  Yet. 
several  studies  have  attempted  to  further  define  characteris- 
tics of  the  nontraditional  student. 

Sewall  (1986)  surveyed  1007  degree  seeking  adults  to 
determine  a profile  of  who  these  nontraditional  students  are. 
Results  showed  that  nearly  three-quarters  of  the  respondents 
were  between  25  and  34  years  of  age.  After  age  35,  women 
were  more  likely  to  enroll  than  men  by  a ration  of  nearly 
three  to  one.  Approximately  two-thirds  of  the  nontraditional- 
aged  students  were  married.  Seventy-four  percent  of  the 
adults  had  children  and  66%  were  employed — 43 °Ii  full  time 
and  23%  part  time.  In  addition,  nearly  two-thirds  had  previ- 
ously attended  a college  or  university  before  dropping  out 
or  not  completing  their  degree  for  some  reason. 
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Differing  results  pertaining  to  age  proportions  were 
found  by  Charmer  (1980)  and  Cross  (1980),  who  revealed 
that  one-half  to  three-quarters  of  the  adult  participants  in 
undergraduate  higher  education  were  over  35  years  of  age. 
Cross  (1981)  also  found  socioeconomic  differences  between 
the  older  and  traditional-aged  students.  Degree  seeking 
adults  typically  come  from  working  class  backgrounds  and, 
for  the  most  part,  are  first  generation  college  students.  Par- 
ents of  the  traditional  college  students  have  tended  to  be 
better  educated  than  parents  of  nontraditional  students. 

The  major  reasons  cited  for  college  entry  by  the  older 
students  ranged  from  developing  a new  career,  wanting  to 
learn,  and  having  the  satisfaction  of  obtaining  a degree.  Al- 
though reasons  varied,  job  and  family  circumstances  accounted 
for  the  majority  of  reasons  cited  for  returning  to  school 
(Sewall,  1986;  Hu,  1985;  Osborne,  Cope  & Johnstone,  1994). 

Typically  the  older  student  attends  college  on  a part  time 
basis.  However,  many  institutions  are  reporting  more  full 
time  adult  students  in  their  programs  (Grace  & Fife,  1987). 

Solomon  and  Gordon  (1981),  and  Bers  and  Smith 
1 1 987),  found  the  desire  to  live  at  home,  the  specializec  ro- 
grams  offered  at  the  institution,  low  tuition,  and  the  avail- 
ability of  financial  aid  were  the  components  considered 
important  by  nontraditional  students  in  selecting  a college. 
Traditional  students  tended  to  indicate  that  the  academic 
reputation  of  the  college  was  important  in  their  selection. 

A significant  portion  of  adult  students  must  cope  with 
dual  responsibilities  of  job  and  family  in  addition  to  attend- 
ing school.  These  factors  play  an  important  role  in  the  older 
student's  decision  to  delay  entry  to  higher  education  and 
frequently  trigger  their  return.  Gustafson  and  Sorgaman 
(1983)  and  Osborne,  Cope  and  Johnstone  ( 1 994)  found  that 
older  students  report  being  more  concerned  about  flexible 
class  scheduling,  child  care  problems,  and  the  need  for  credit 
for  experiential  learning  than  traditional  students.  In  addi- 
tion. nontraditional  students  were  found  to  have  many  of  the 
same  problems  reported  by  their  younger  counterparts:  high 
concern  in  having  too  little  time  for  course  work  and  lack  of 
information  regarding  career  paths.  Due  to  all  these  factors, 
it  is  not  surprising  that  older  students  report  difficulty  in 
integrating  into  student  life  (Bradley  & Cleveland,  1992; 
Vandcrpool  & Brown,  1994). 

As  more  women  enroll  in  higher  education,  new  prob- 
lems have  been  encountered.  Gcrson  (1985)  found  that  non- 
traditional women  experienced  greater  role  gratification  but 
also  encountered  greater  strain  in  their  multiple  roles. 
Robertson  (1991)  reported  that  women  and  men  often  take 
different  routes  when  entering  and  completing  their  programs 
in  postsccondary  education.  Women  are  more  likely  to  have 
more  interruptions  in  their  academic  career  that  arc  attrib- 
uted to  more  diverse  role  demands  and  greater  relationship 
responsiveness  by  women  (Hatch,  1990;  McBride,  1990). 
However,  Breesc  and  O'Toole  (1994)  report  that  women  also 
seek  out  higher  education  as  a coping  mechanism  to  deal 
with  a role  transition  in  their  own  lives.  Examples  of  these 
role  transitions  include:  divorce,  death,  children  leaving 
home,  and/or  the  youngest  child  starting  school.  Perhaps 


not  surprising  is  that  nontraditional  females  reported  a sig- 
nificantly higher  degree  of  dissatisfaction  with  institutional 
climate,  especially  during  their  first  year  (Gustafson  & 
Sorgaman,  1983;  Wilkie  & Thompson,  1993). 

Several  researchers  (Fujita-Starck,  1996;  Morstain  & 
Smart,  1974)  caution  instructors  to  not  heavily  rely  on  adult 
student  demographics  as  their  means  to  understand  this  learner. 
Instead,  they  urge  us  to  analyze  the  nontraditional’s  motiva- 
tion for  attending  higher  education  institutions.  Without  this 
information,  they  say,  erroneous  generalizations  may  be  made. 

The  Nontraditional  Student  in  the  Classroom 

Historically,  American  colleges  and  universilies  focused 
curriculum  programs  and  institutional  mission  on  the  younger 
adult,  16-25  years  of  age.  Older  adult  needs  were  to  be  met 
by  continuing  education  programs.  These  programs  at- 
tempted to  link  together,  the  adult,  the  community  and  the 
university  (Kasworm,  1980). 

Higher  education  for  adults  is  based  on  the  following 
beliefs: 

1 . Adults  arc  capable,  motivated  learners. 

2.  Off-main-campus  and  nontraditional  classroom  settings 
can  provide  effective  learning  experiences. 

3.  University  resources  can  be  relevant  to  adult  and  com- 
munity needs. 

4.  Teaching-learning  strategies  which  recognize  the  unique 
characteristics  of  adults  are  required.  These  strategies 
incorporate  variable  access  and  time  frame  flexibility. 

5.  Adult  students  are  necessary  and  important  to  colleges 
and  the  public.  (Knowles,  1980). 

Not  all  educators  agree  with  these  statements,  as  com- 
mon misunderstandings  are  associated  with  nontraditional 
students.  Kasworm  (1980)  noted  some  university  faculty 
suspected  that  older  students  were  not  as  qualified  for  un- 
dergraduate education  due  to  age,  time  lapse  from  learning 
activities,  or  declining  intellectual  abilities.  These  suspi- 
cions arc  not  supported  by  research.  In  fact,  research  con- 
tradicts these  beliefs. 

The  reality  is  that  adult  students  in  higher  education 
study  more  hours  per  week  than  do  traditional  students 
(Iovacchini,  Hall  & Hengstler,  1985).  This  is  evidenced 
when  grade  point  averages  of  younger  and  older  students  in 
the  same  undergraduate  degree  programs  were  compared 
(Halftner,  1962).  GPA's  of  older  students  were  significantly 
higher  than  the  young  students  in  total  performance.  These 
findings  were  corroborated  by  Ryan  (1972)  and  Darken wald 
and  Novak  (1997),  who  also  found  a positive  relationship 
between  age  and  levels  of  achievement. 

Miller  (1989)  and  Nordstrom  (1989)  reported  that  non- 
traditional students  arc  more  internally  motivated  to  learn, 
prefer  informal  learning,  and  are  more  goal-directed  than 
traditional  students.  Older  students  appear  to  have  “a  moti- 
vation, an  excitement,  and  a love  of  learning"  (Bishop-Clark 
& Lynch,  1992,  p.  114).  This  may  explain  why  nontradi- 
tional students  are  more  prompt  and  regular  in  class  atten- 
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dance  (Glass  & Rose,  1 987)  and  why  they  perceive  the  class- 
room environment  more  favorably  than  traditional  students 
(Stage  & McCaffery,  1992). 

Faculty  who  work  with  older  students  perceive  them  as 
more  motivated,  pragmatic,  self-directed,  goal  oriented,  and 
competent  than  traditional  students  (Beder  & Darkenwald, 
1982;Bodensteiner,  1985;  Pew  Charitable  Trust,  1990;  Raven 
& Jimmerson,  1992).  Jacobs  (1989)  reported  that  nontradi- 
tional  students  were  viewed  as  her  “best  students”  as  “they 
responded,  reacted,  opined,  and  participated  in  the  process  of 
education”  (p.  329).  However,  not  everyone  views  them  as  a 
positive  force  in  the  classroom,  as  some  students  on  a college 
campus  referred  to  adult  students  as  “DAR’s — Damned  Av- 
erage Raisers”  (Jacobs,  1989,  p.  331).  Interestingly,  while 
some  studies  show  that  faculty  members  perceive  differences 
between'nontraditional  and  traditional  students  (Sisco,  1981 ; 
Swift  & Heinrichs,  1987;  Pew  Charitable  Trust,  1990;  Raven 
& Jimmerson,  1992),  other  studies  indicate  faculty  often  feel 
there  is  no  need  to  teach  older  students  differently  from  younger 
students  and  do  not  alter  their  methods  of  teaching  (Galerstein 
& Chandler,  1982;  Conti,  1985;  Gorham,  1985).  This  im- 
plies that  although  instructors  Find  the  nontraditional  group 
better  students,  they  often  do  not  change  their  teaching  to  a 
style  which  may  benefit  adults’  learning. 

The  opinion  that  teaching  adult  students  is  different  from 
teaching  children  is  based  on  a principle  called  andragogy 
(Knowles,  1980).  Andragogy  was  a word  created  by  Euro- 
pean educators,  who  saw  the  need  for  a model  for  adult  learn- 
ers that  was  distinctive  from  pedagogy.  Pedagogy  refers  to 
the  ''rt  and  science  of  teaching  children,  while  andragogy 
refers  to  the  art  and  science  of  teaching  adults.  Assump- 
tions regarding  adult  tha-  are  central  to  the  andragogy  model 
include  that: 

1 . Learners’  self-concept  moves  from  being  a dependent 
personality  toward  being  a self-directed  human  being. 

2.  Learners’  accumulate  a growing  reservoir  of  experience 
that  becomes  an  increasingly  rich  source  of  learning. 

3.  Learners’  readiness  to  learn  becomes  oriented  increas- 
ingly to  the  developmental  tasks  for  their  social  roles. 

4.  Learners’  time  perspective  changes  from  one  of  per- 
sonal application  of  knowledge  to  immediacy  of  appli- 
cation, and  accordingly,  their  orientation  toward  learning 
shifts  from  one  of  subject  centeredness  to  one  of  per- 
formance centeredness. 

5.  Learners’  are  motivated  to  learn  by  internal  factors  rather 
than  external  ones  (Knowles,  1985). 

Andragogy  suggests  a teachers’  role  which  is  more  re- 
sponsive and  less  directive.  The  model  encourages  self-di- 
rected learning  at  high  levels.  The  adult  student  should  have 
input  regarding  content,  methodology,  learning  assessment 
techniques,  etc.  (Gorham,  1982).  Further,  Beder  and 
Darkenwald  ( 1 982)  cited  eight  di ffercnccs  in  teaching  adults 
as  opposed  to  teaching  their  younger  counterparts.  They 
include:  a)  greater  use  of  group  discussion;  b)  less  time  spent 
on  classroom  discipline;  c)  more  variety  of  teaching  tech- 
nique; d)  less  time  spent  on  giving  directions;  c)  more  relat- 
ing of  material  to  life  experiences;  0 more  flexible 


instructional  activities;  g)  more  adjustments  made  in  instruc- 
tional content  in  response  to  student  feedback;  and  h)  less 
emotional  support  provided  to  individual  students. 

Additional  research  on  nontraditional  students  in  col- 
leges and  universities  appears  to  support  many  of  the 
andragogical  principles.  Several  researchers  (Kasworm, 
1980;  Backus,  1984;Birkcy,  1984)  found  that  older  students 
indicated  stronger  preferences  for  dealing  with  theoretical 
problems  and  concerns  and  greater  capacity  for  critical  think- 
ing during  problem  solving.  They  are  more  likely  to  initiate 
interaction  with  the  college  instructor  (Gorham,  1985; 
Bishop-Ciark  & Lynch,  1992)  and  less  likely  to  blindly  ac- 
cept information  without  challenge  (Richter- Antion,  1986). 
Loesche  and  Foley  (1988)  reported  that  nontraditional  stu- 
dents prefer  to  organize  their  own  learning  experiences,  while 
younger  students  indicated  a preference  for  more  teacher 
directed  experiences.  Adult  students  identified  characteris- 
tics of  effective  instructors  who  use  student  centered  experi- 
ences. These  include:  a)  relevance  of  material,  b) 
encouraging  participation,  c)  being  open  to  questions,  and 
d)  showing  concern  for  student  learning  (Donaldson, 
Flannery,  & Ross-Gordon,  1993).  Older  students  also  pre- 
fer realistic,  tangible  learning  situations  (Holtzelaws,  1 980), 
hands-on  practical  examples  and  discussion  (Bishop-Ciark 
& Lynch,  1992)  and  problem-based  learning  (Fiddler  & 
Knoll,  1995). 

In  a 1994  study,  Richardson  that  found  adult  students 
use  what  he  calls  a “deep  approach  or  a meaning  orienta- 
tion” (p.  3 1 8)  towards  coursework.  This  is  in  contrast  to  the 
traditional  student  who  employs  a “surface  approach  or  a 
reproducing  orientation”.  Richardson  (1994)  explains  this 
phenomena  by  pointing  out  that  nontraditional  students  are 
more  motivated  by  intrinsic  goals.  Their  prior  life  experi- 
ences help  promote  the  “deep  approach”  towards  course 
work.  In  contrast,  the  younger  students  develop  a “surface 
approach”  to  learning  while  in  high  school  and  evidently 
carry  this  trait  forward  in  higher  education. 

Conclusions 

As  can  be  seen,  there  are  numerous  differences  between 
traditional  and  nontraditional  students.  Further  while  non- 
traditional students  show  similar  problems  to  traditional  stu- 
dents regarding  lack  of  time  for  course  work,  older  students 
apparently  experience  more  role  diffusion  and  time  con- 
straints due  to  family  and  job  situations. 

Those  who  work  with  both  traditional  and  nontraditional 
students  may  want  to  examine  what  is  currently  being  done 
to  accommodate  the  needs  of  both  age  groups.  Changes 
may  need  to  be  made  to  ensure  that  all  individual  needs  are 
being  met.  Many  articles  written  on  nontraditional  students 
focus  on  changes  involving  support  services  (e.g.  Brendcn, 
1986;  Scholssberg,  Lynch  & Chickcring,  1991:  Bov  a & 
Phillips,  1984;  Rawlins  & Lcnihan,  1982;  Villclla  & Hu. 
1991,  Vandcrpool  & Brown,  1994).  W*  ile  these  compo- 
nents may  be  necessary  in  accommodating  adult  learners, 
little  attention  has  been  given  to  modifying  how  course  con- 
tent is  delivered.  Instructors  of  older  students  need  to  eon 
template  the  theories  of  adult  learning  and  incorporate  those 
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elements  in  their  classrooms.  They  should  include  more 
group  discussions  and  offer  a variety  of  assignments  from 
which  students  can  choose.  Additionally,  research  needs  to 
be  undertaken  to  further  investigate  strategies  that  will  aid 
in  the  knowledge  development  of  nontraditional  individuals 
in  higher  education. 

This  does  not  imply  that  the  needs  of  the  traditional- 
aged  individual  be  forgotten.  Flexibility  seems  to  be  a re- 
current theme  in  trying  to  achieve  maximum  learning  for  all 
students  in  higher  education.  Perhaps  analyzing  the  four 
teaching  strategies  that  have  been  identified  by  Bishop-Clark 
and  Lynch  ( 1 992)  in  creating  a conducive  learning  environ- 
ment for  nontraditional  and  traditional  students  will  aid  us 
in  this  growth.  These  were:  developing  more  personal  con- 
tact with  students;  allowing  students  to  discuss  differences 
between  traditional  and  nontraditional  students;  becoming 
equitable  in  how  each  group  is  approached;  and  increasing 
awareness  of  student  similarities  regardless  of  age. 

As  older  students  continue  to  enter  the  ‘'ivory  tower", 
we,  in  higher  education,  should  commit  ourselves  to  under- 
standing and  modifying  existing  conditions  to  better  serve 
all  students  across  all  ages.  The  university  is  in  part  a busi- 
ness structure.  As  a business,  we  should  be  serving  all  our 
customers  to  the  best  of  our  ability. 
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Abstract 

The  purpose  of  this  study  was  to  evaluate  the  changes  in  the  teacher  efficacy  levels  of  teachers  exposed  to 
an  instructional  model  referred  to  as  FOCUS . The  analysis  revealed  that  a majority  of  the  participants 
had  pre-treatment  efficacy  scores  that  corresponded  to  higher  post-treatment  efficacy  scores,  on  at  least 
one  of  the  fwo  efficacy  scales,  for  the  participants  who  were  exposed  to  the  FOCUS  model.  These  finds, 
although  they  should  only  be  considered  preliminary  due  to  the  nature  of  the  research  design  employed  in 
this  study,  do  suggest  the  need  for  further  study  of  the  FOCUS  model's  impact  on  teacher  efficacy . 


Introduction 

In  some  of  the  earliest  work  on  teacher  efficacy,  the  Rand 
Corporation  researchers  defined  teacher  efficacy  as  “the  ex- 
tent to  which  the  teacher  believes  he  or  she  has  the  capacity  to 
affect  student  performance”  (McLaughlin  & March,  1978,  p. 
84).  Considerable  researcher  effort  has  been  given  to  the  ap- 
propriate conceptualization  and  measurement  of  this  teacher 
efficacy  construct.  As  noted  by  Ross  (1994)  “the  majority  of 
teacher  efficacy  researchers  derive  their  conceptions  from 
Bandura's  ( 1 977)  theory  of  self-efficacy  (p.  3).  Bandura  sug- 
gests that  self-efficacy  consists  of  two  components:  Outcome 
expectations  and  efficacy  expectations.  The  outcome  expec- 
tations are  an  individual's  belief  that  certain  behaviors  will 
produce  particular  outcomes.  On  the  other  hand,  the  efficacy 
expectations  are  an  individual’s  belief  about  his  or  her  own 
ability  to  bring  about  an  expected  outcome. 

Ashton  and  Webb  (1982,  1986)  extended  Bandura’s 
theoretical  framework  of  self-efficacy  to  teachers.  They 
suggested  that  one  of  the  two  components  of  a teacher’s  sense 
of  efficacy  is  a belief  that  certain  actions  undertaken  by  teach- 
ers in  general  will  lead  to  student  learning.  This  type  of 
efficacy,  which  Ashton  and  Webb  (1982)  and  Webb  (1982) 
referred  to  as  teaching  efficacy,  is  close  to  Bandura’s  out- 
come expectations.  The  second  dimension  of  a teacher’s 
sense  of  efficacy,  as  discussed  by  Ashton  and  Webb  (1982), 
is  a teacher’s  belief  that  he  or  she  will  be  able  to  bring  about 
student  learning.  This  dimension,  which  Ashton  and  Webb 
labeled  personal  teaching  efficacy,  relates  to  Bandura’s  effi- 
cacy expectations. 

Gibson  and  Dcmbo  (1984)  developed  an  instrument  that 
would  measure  the  two  dimensions  of  a teacher's  sense  of 
efficacy  that  were  discussed  by  Ashton  and  Webb  (1982). 
Their  work  resulted  in  an  instrument  that  contained  1 6 state- 
ments. The  instrument  could  be  self  administered  with  the 
respondents  reacting  to  each  statement  by  using  a 6-point 


Likert  scale.  Gibson  and  Dembo  stated  that  one  set  of  nine 
statements  that  reflect  the  teacher’s  sense  of  personal  re- 
sponsibility in  student  learning  corresponds  to  Bandura’s  ef- 
ficacy expectations.  The  other  seven  statements  measure  a 
teacher’s  view  concerning  the  limitations  that  teachers  in 
general  encounter  in  their  abilities  to  influence  the  educa- 
tion levels  of  students  because  of  external  factors.  These 
seven  statements  corresponded  to  Bandura’s  outcome  ex- 
pectations. 

A number  of  other  instruments  have  been  designed  by 
researchers  to  measure  a teacher’s  sense  of  efficacy  (Armor, 
Conry-Oseguera,  Cox,  King,  McDonnell,  Pascal,  Pauly.  & 
Zellman,  1976;  Berman,  McLaughlin,  Bass,  Pauly,  & 
Zellman,  1977;  Rose  & Medway,  1981;Guskey,  1988;Riggs 
& Enochs,  1990;  Vitali,  1993).  As  noted  by  Benz,  Bradley, 
Alderman,  & Flowers  (1992),  the  use  of  these  various  in- 
struments has  created  a problem  in  interpreting  the  results 
of  teacher-efficacy  studies,  at  least  insofar  as  drawing  study- 
to-study  conclusions. 

In  spite  of  this  measurement  problem,  considerable  and 
consistent  evidence  exists  that  teacher  efficacy  influences 
teacher  and  student  outcomes  (Ross,  1994).  A number  of 
studies  have  found  relationships  between  efficacy  levels  of 
teachers  and  dimensions  of  current  conceptions  of  good 
teaching  practices.  Riggs  and  Enochs  (1990)  and  Guskey 
(1987)  found  that  teachers  with  high  levels  of  efficacy  were 
more  inclined  to  use  activity-based  methods  and  mastery 
learning,  respectively.  Guskey  (1988)  reported  that  teach- 
ers with  higher  levels  of  efficacy  expressed  more  positive 
attitudes  towards  curriculum  implementation.  A study  by 
Schriver  ( 1 993)  indicated  that  teachers  with  higher  efficacy 
levels  were  more  knowledgeable  of  developmentally  appro- 
priate curricula.  A study  by  Korevaar  (1990)  found  that 
teachers  with  high  personal  teaching  efficacy  scores  were 
more  likely  to  confront  student  management  problems. 
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Other  studies  have  reported  positive  relationships  be- 
tween teacher  efficacy  levels  and  student  cognitive  achieve- 
ment and  affective  growth.  Armor  et  al.  (1976)  reported 
that  teachers’  sense  of  efficacy  was  strongly  and  statistically 
significantly  related  to  students’  increases  in  reading  achieve- 
ment. Ashton  and  Webb  (1986)  reported  that  teaching  effi- 
cacy and  personal  efficacy  were  significantly  related  to 
student  mathematics  and  language  achievement,  respectively. 
Moore  and  Esselman  (1992)  and  Ross  and  Cousins  (1993) 
also  found  significant  positive  relationships  between  teacher 
efficacy  and  student  achievement  in  mathematics. 

A number  of  studies  have  reported  significant  positive 
relationships  between  a teacher’s  sense  of  efficacy  and  the 
students’  affective  development.  Ashton  and  Webb  (1986) 
and  Roeser,  Arbreton  and  Anderman  (1993)  found  that  teacher 
efficacy  was  positively  related  to  student  motivation.  Miskel, 
McDonald  and  Bloom  (1983)  found  a positive  link  between 
teacher  efficacy  and  the  students’  increased  self-esteem  was 
discussed  in  a study  conducted  by  Borton  (1991). 

Since  relationships  have  been  reported  between  the  lev- 
els of  efficacy  expressed  by  teachers  and  their  performances 
as  educators  and  the  academic  performances  of  their  stu- 
dents, an  important  issue  to  investigate  is  whether  teachers’ 
efficacy  levels  can  be  changed  through  educational  programs. 
As  noted  by  Ross  (1994)  in  his  review  of  88  studies  con- 
ducted on  efficacy  of  teachers,  “the  results  of  attempts  to 
change  teacher  efficacy  have  been  mixed”  (p.  17).  Ross 
suggests  that,  as  proposed  by  Vosniadou  and  Brewer  (1987), 
in  order  to  change  efficacy  levels  of  teachers,  a radical  re- 
structuring in  conceptions  about  students,  teachers  and  learn- 
ing may  be  required. 

We  also  believe  that  these  mixed  results  could  be,  at 
least  in  part,  due  to  the  lack  of  testing  for  the  existence  of  an 
interaction  effect  between  the  participants’  pre-treatment 
efficacy  levels  and  the  methods  of  instruction  to  which  the 
participants  were  exposed.  That  is,  the  ability  of  a method 
of  instruction  to  change  a participant’s  efficacy  level  may 
be  affected  by  that  participant’s  pre-exposure  efficacy  level. 
Without  the  use  of  appropriate  analytical  techniques  to  in- 
vestigate this  interaction  effect,  the  ability  of  the  method  to 
change  the  efficacy  levels  of  participants  may  not  be  revealed 
through  the  data  analysis. 

The  purpose  of  this  field  study  was  to  determine  whether 
the  personal  and  teaching  efficacy  data  of  the  participants 
exposed  to  the  instructional  model  called  FOCUS,  which 
was  developed  by  Russell  (1992,  1994),  indicate  that  the 
model  may  have  an  effect  on  the  efficacy  levels  of  partici- 
pants. In  addition,  the  analyses  conducted  in  this  study  placed 
special  emphasis  on  the  interaction  effects  between  the  meth- 
ods of  instruction  and  the  participants’  two  types  of  pre- 
treatment  efficacy  scores. 

Research  Method 

A noncquivalenl  control  group  quasi-experimenlal  de- 
sign, as  discussed  by  Campbell  and  Stanley  (1963),  was 


employed  to  assess  the  ability  of  the  FOCUS  model  to  im- 
pact the  efficacy  levels  of  participants.  The  paradigm  for 
this  design  is  as  follows: 


0,2  Xc  o,  4 

where: 

1.  Ot  2 represents  the  pre-treatment  personal  efficacy  and 
teaching  efficacy  measurements. 

2.  XF  represents  the  participants  exposed  to  the  FOCUS 
method  of  instruction. 

3.  Xc  represents  the  participants  not  exposed  to  the  FO- 
CUS model,  which  constituted  the  Control  Group. 

4.  03  4 represents  the  post-treatment  personal  efficacy  and 
teaching  efficacy  measurements. 

The  68  study  participants,  who  were  part  of  either  the 
Control  Group  or  the  FOCUS  Group,  were  teachers  who 
were  enrolled  in  graduate  level  classes  offered  by  the  Edu- 
cation Department  of  Ashland  University  during  a summer 
term.  Ashland  University  is  located  in  north-central  Ohio, 
which  contains  rural,  suburban,  and  urban  school  systems. 
Twenty-nine  of  the  68  participants  were  not  exposed  to  the 
FOCUS  model  during  or  prior  to  the  summer  term  in  which 
the  study  was  conducted.  These  29  participants,  who  taught 
in  grade  levels  that  ranged  from  kindergarten  to  the  twelfth 
grade,  served  as  the  Control  Group.  The  other  39  partici- 
pants were  exposed  to  the  FOCUS  model  in  a curriculum 
course  during  the  same  academic  summer  term.  These  39 
participants,  who  also  taught  in  grade  levels  that  ranged  from 
kindergarten  through  the  twelfth  grade,  constituted  the  treat- 
ment group.  This  treatment  group  was  referred  to  as  the 
FOCUS  Group. 

As  noted  by  Campbell  and  Stanley  (1963),  “Design  10 
[the  nonequivalent  control  group  design]  should  be  recog- 
nized as  well  worth  using  in  many  instances  in  which  De- 
signs 4,5,  and  6 [true  experimental  designs]  are  impossible” 
(p.  47).  The  manner  in  which  the  groups  were  formed  and 
treated  in  this  study,  however,  requires  one  to  be  aware  of 
certain  internal  validity  problems  that  may  provide  alterna- 
tive explanations  for  any  differences  found  between  the  post- 
treatment  efficacy  levels  of  the  groups.  These  internal 
validity  concerns  include  possible  differences  between  the 
groups  with  respect  to  the  following:  (a)  relevant  character- 
istics of  the  participants  including  pre-treatment  efficacy 
levels,  age,  years  of  experience,  gender,  and  motivation,  (b) 
the  instructors  to  whom  the  groups  were  exposed  during  the 
summer  term  in  which  the  study  was  conducted,  and  (c)  the 
number  and  combination  of  graduate  classes  that  the  par- 
ticipants completed  during  the  summer  term. 

With  respect  to  relevant  characteristics  of  the  partici- 
pants, various  studies  (Anderson,  Greene  and  Loewen.  1988; 
Raudenbush,  Rowan  and  Cheong,  1992;  Beady  and  Hanscll, 
1981;  and  Chester,  1991)  indicated  that  a participant's  gen- 
der, number  of  years  of  experience,  and  age  may  effect  par- 
ticipants’ efficacy  levels.  A summary  statistics  of  these 


Volume  11,  Number  2 Spring  1998 


Mid-Western  Educational  Restarchtr 


1271 


33 


Table  1 

Mean  and  Standard  Deviation  Values  for  Age,  Yerars  of  Experience,  Gender  and  Efficacy  Scores 

Groups 

Variable  Control  Group  FOCUS  Group 


Age3 

Years  of  Experience6 
Gender 

Pretest  Personal  Efficacy  Scores 
Pretest  Teaching*  Efficacy  Scores 


35.4  (7.94) 

10.5  (6.56) 
.55c 

39.31  (7.16) 
23.24  (4.50) 


42.3  (7.56) 
14.2  (7.59) 
.69c 

38.9  (6.93) 
24.71  (4.48) 


"One  educator  in  the  FOCUS  Group  failed  to  indicate  his  or  her  age. 

‘Two  educators  in  the  Control  Group  failed  to  indicate  their  years  of  teaching  experience. 

The  gender  value  represents  the  proportion  of  female  educators. 

The  final  scores  for  one  teacher  in  the  FOCUS  Group  were  identified  as  outliers  and,  therefore,  excluded  from  these 
figures. 


variables  for  the  participants  in  the  Control  and  FOCUS 
Groups  are  contained  in  Table  1 . 

Although  all  of  the  participants  in  this  study  were 
teachers  who  were  enrolled  in  graduate-level  courses,  the 
participants  differed  on  various  characteristics  and  expe- 
riences other  than  their  exposure  to  or  lack  of  exposure  to 
the  FOCUS  model.  Although  the  differences  between 
the  gender  composition  of  the  two  groups  and  the  mean 
pre-treatment  personal  and  teaching  efficacy  scores  were 
not  statistically  significant  at  the  .05  level,  the  differences 
between  the  ages  and  years  of  experience  of  the  partici- 
pants in  the  two  groups  were  statistically  significant.  The 
importance  of  these  differences  were  somewhat  amelio- 
rated by  the  fact  that  subsequent  regression  analyses  re- 
vealed that  age,  years  of  experience,  and  the  two-way 
interaction  effects  between  those  variables  and  the  group 
variable  did  not  account  for  a statistically  significant 
amount  of  unique  variation  in  either  of  the  post-treatment 
efficacy  scores.  These  regression  results,  as  well  as  the  lack 
of  statistically  significant  differences  between  the  groups 
with  respect  to  gender  and  the  mean  pre-treatment  teaching 
and  personal  efficacy  scores,  increases  the  plausibility  of 
the  comparable-groups  assumption.  In  spite  of  this  fact,  it 
is  important  to  note  that  due  to  the  lack  of  control  over  the 
other  internal  validity  concerns,  the  findings  presented  in 
this  study  should  be  considered  as  preliminary. 

The  type  of  participant  included  in  this  study  should  be 
noted  when  evaluating  its  external  validity.  The  68  partici- 
pants in  this  study  were  teachers  who  were  enrolled  as  part- 
time  students  in  graduate  level  classes  offered  by  Ashland 
University,  which  is  located  in  north-central  Ohio.  The  grade 
levels  taught  by  these  participants  ranged  from  kindergar- 
ten to  twelfth  grade. 


Instruments 

As  previously  mentioned,  various  instruments  have  been 
used  to  measure  the  level  of  a participant’s  sense  of  effi- 
cacy. In  this  study,  the  Teacher  Efficacy  Scale,  which  was 
devised  by  Gibson  and  Dembo  (1984),  was  used.  As  indi- 
cated by  the  research  paradigm,  each  educator  who  partici- 
pated in  this  study  completed  the  Teacher  Efficacy  Scale  at 
the  beginning  and  end  of  the  summer  academic  term.  This 
instrument  required  each  participant  to  rate  each  of  1 6 state- 
ments on  a 1 (strongly  disagree)  to  6 (strongly  agree)  scale. 
The  ratings  obtained  from  the  first  nine  statements  were 
summed  to  obtain  a personal  efficacy  score  for  each  partici- 
pant. A high  score  on  these  nine  statements  was  interpreted 
to  mean  that  the  participant  had  a high  level  of  personal  ef- 
ficacy, and  a low  score  would  indicate  that  the  participant 
had  a low  level  of  personal  efficacy.  The  mean  and  stan- 
dard deviation  values  for  the  pre-treatment  personal  effi- 
cacy scores  for  the  participants  in  the  Control  and  FOCUS 
groups  are  listed  in  Table  1. 

The  other  seven  statements  were  used  to  measure  a 
participant’s  teaching  efficacy  score.  Thr  total  score  on  these 
seven  items  for  each  participant  was  subtracted  from  42. 
This  procedure  produced  a teaching  efficacy  score  that  would 
be  high  for  a participant  who  had  a high  level  of  teaching 
efficacy,  and  the  score  would  be  low  for  a participant  who 
had  a low  level  of  teaching  efficacy.  The  mean  and  standard 
deviation  values  for  the  pre-treatment  teaching  efficacy 
scores  for  the  participants  in  the  Control  and  FOCUS  groups 
arc  also  listed  in  Tabic  1 . 

Gibson  and  Dembo  (1984)  reported  in  their  study  that 
an  analysis  of  internal  consistency  reliability  values  produced 
Cronbachs  alpha  coefficient  values  of  .78  and  .75  for  the 


34 


Mtd-Western  Educational  Researcher 


Volume  1 1,  Number  2 Spring  1998 


personal  efficacy  scores  and  teaching  efficacy  scores,  re- 
spectively. An  internal  consistency  analysis  of  the  pre- 
treatment  personal  and  teaching  efficacy  scores  recorded  for 
the  participants  in  this  study  produced  Cronbach  alpha  val- 
ues of  .88  and  .56,  respectively. 

With  respect  to  validity  of  the  personal  and  teaching 
efficacy  scales,  Gibson  and  Dembo  (1984)  stated  that  a 
multitrait-multimethod  analysis  supported  both  convergent 
and  discriminant  validity  of  the  instrument.  Although  an 
analysis  of  the  efficacy  instrument's  validity  was  not  con- 
ducted in  this  study,  it  should  be  noted  that  both  the  validity 
study  conducted  by  Gibson  and  Dembo  and  this  study  in- 
volved teachers. 

Control  and  FOCUS  Groups 

Teachers  who  were  enrolled  in  graduate-level  classes 
and  who  had  never  been  exposed  to  classes  that  specifically 
employed  the  FOCUS  model  as  the  basis  of  instruction 
served  as  the  Control  Group.  Teachers  who  were  enrolled 
in  two  sections  of  a graduate-level  curriculum  course  were 
exposed  to  the  FOCUS  model  of  instruction.  This  course 
was  a survey  course  in  curriculum  development  that  encom- 
passed the  elementary,  the  middle,  and  the  high  school  lev- 
els. These  classes  constituted  the  experimental  group,  which 
was  identified  as  the  FOCUS  Group.  The  participants  in 
the  FOCUS  Group  were  exposed  to  36  hours  of  instruction 
during  a summer  term. 

Participants  in  the  FOCUS  Group  were  exposed  to  a 
relaxed  classroom  environment  where  they  were  treated  as 
valuable  participants  in  the  learning  process.  Each  topic  in 
the  curriculum  course  was  approached  from  a receiver-ori- 
ented perspective  as  suggested  by  Ausubel,  Novak,  and 
Hanesian  (1978).  Once  the  participants’  levels  of  knowl- 
edge were  determined,  course  topics  were  further  explored 
by  using  activities  and  instructional  strategies,  which  were 
designed  to  match  the  participants’  various  learning  styles 
as  described  by  Kolb  (1984),  McCarthy  (1981),  and  Dunn, 
Dunn,  and  Price  (1977).  After  a given  topic  was  explored, 
the  course  facilitator  demonstrated  how  the  various  instruc- 
tional and/or  classroom  management  practices  could  be  used 
in  the  participants’  classrooms.  The  participants  were  then 
asked  to  design  their  own  plans  from  this  information.  In 
addition,  they  were  also  expected  to  write  journal  entries 
throughout  the  course.  The  facilitator  collected  the  journals 
and  gave  feedback  to  the  participants  prior  to  the  next  ses- 
sion. This  activity  allowed  the  participants,  as  well  as  the 
course  instructor,  to  track  their  progress  throughout  the 
course. 

All  of  the  activities  experienced  by  the  participants  in 
the  FOCUS  Group  were  based  on  the  systematic  use  of  the 
FOCUS  behavioral  model  (Russell,  1992,  1994).  Thus,  the 
participants  were  not  only  learning  the  model,  they  were  also 
experiencing  it.  This  exposure  to  the  FOCUS  model  was 
designed  to  enhance  each  participant’s  sense  of  belonging 
and  acceptance.  Since  the  purpose  of  this  article  is  to  report 


on  the  analysis  of  the  post-treatment  efficacy  scores  of  the 
participants  rather  than  provide  the  readers  of  this  article 
with  a detailed  description  of  the  FOCUS  model,  we  en- 
courage them  to  refer  to  Russell  (1992,  1994)  for  a more 
detailed  description  of  the  FOCUS  model. 

Hypotheses 

Even  though  we  believed  that  the  exposure  to  the 
FOCUS  model  would  increase  the  participant’s  levels 
of  personal  and  teaching  efficacy,  we  were  not  willing 
to  assume  that  those  increases  would  be  constant  across 
the  pre-treatment  levels  of  efficacy.  That  is,  when  com- 
pared to  the  Control  Group,  the  gains  in  the  personal 
and  teaching  efficacy  scores  for  the  participants  in  the 
FOCUS  Group  may  not  be  consistent  across  the  range 
of  pre-treatment  scores.  Thus,  it  was  essential  to  test 
for  the  existence  of  pre-treatment-efficacy-scores-by- 
group-interaction  effects.  The  null  hypotheses  that  were 
designed  to  test  for  these  two-way  interaction  effects 
were  as  follows: 

1 Ho:  The  interaction  effect  between  the  pre-treatment  per- 
sonal teaching  efficacy  scores  and  group  membership 
does  not  explain  some  of  the  variation  in  the  post- 
treatment  personal  teaching  efficacy  scores. 

2Ho;  The  interaction  effect  between  the  pre-treatment 
teaching  efficacy  scores  and  group  membership  does 
not  explain  some  of  the  variation  in  the  post-treat- 
ment teaching  efficacy  scores. 

It  should  be  noted  that  these  two  null  hypotheses  did 
not  include  the  ages  and  the  years  of  experience  of  the  par- 
ticipants as  variables  as  well  as  the  two-way  interaction  ef- 
fects between  the  groups  and  each  of  those  variables.  These 
variables  were  not  included  due  to  the  fact  that,  in  prelimi- 
nary analyses,  they  accounted  for  less  than  3%  of  unique 
variation  in  either  cf  the  post-treatment  efficacy  scores,  which 
was  not  statistically  significant.  Thus,  those  variables  were 
excluded  from  the  two  null  hypotheses  and  the  correspond- 
ing statistical  analyses  in  order  to  increase  the  statistical 
power  of  the  analyses  and  to  simplify  the  interpretation  of 
the  results. 

The  two  null  hypotheses  were  statistically  tested  with 
regression  models  (McNeil,  Newman  & Kelly,  1996).  The 
SPSS/PC+  subprogram  REGRESSION  (SPSS,  1990)  was 
used  to  generate  the  regression  analyses  for  these  two  mod- 
els. The  dependent  variable  for  Model  1,  which  was  used  to 
statistically  test  1H0,  consisted  of  the  participants’  post-treat- 
ment personal  efficacy  scores.  This  model  contained  three 
independent  variables.  One  of  the  independent  variables 
included  in  Model  1 consisted  of  the  participants’  pre-treat- 
ment personal  efficacy  scores.  This  variable  was  labeled 
Pre-  Treatment  Personal  Efficacy.  The  second  independent 
variable,  which  was  identified  as  the  Group  variables,  con- 
sisted of  the  values  of  zero  and  one.  A value  of  one  indi- 
cated that  the  participant  was  in  the  FOCUS  Group,  and  a 
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zero  value  meant  that  the  participant  was  in  the  Control 
Group.  The  third  variable  included  in  Model  1 was  formed  by 
multiplying  the  Pre-Treatment  Personal  Efficacy  Scores  vari- 
able by  the  Group  variable.  The  inclusion  of  this  variable,  which 
was  labeled  Pre-Treatment-Personal  Efficacy  X Group,  enabled 
the  difference  between  the  slopes  of  the  regression  lines  of  the 
Control  and  FOCUS  groups  to  be  estimated. 

The  teaching  efficacy  scores  served  as  the  dependent 
variable  in  the  regression  model  used  to  statistically  test  2H0. 
Similar  to  Model  1 , this  model,  which  is  referred  to  as  Model 
2,  included  three  independent  variables.  One  of  these  inde- 
pendent variables  consisted  of  the  participants’  pre-treat- 
ment teaching  efficacy  scores.  This  variable  was  labeled 
Pre-Treatment  Teaching  Efficacy.  A second  independent 
variable  was  the  same  Group  variable  that  was  used  in  Model 
1 . The  third  independent  variable  was  generated  by  multi- 
plying the  Pre-Treatment  Teaching  Efficacy  variable  by  the 
Group  variable.  This  variable,  which  was  labeled  Pre-Treat- 
ment Teaching  Efficacy  X Group,  was  used  to  estimate  the 
difference  between  the  slopes  of  the  regression  lines  for  the 
Control  and  FOCUS  groups. 

The  / values  of  the  regression  coefficients  for  the  Pre- 
Treatment  Personal  Efficacy  X Group  variable  and  the  Pre- 
treatment  Teaching  Efficacy  X Group  variable  were  used  to 
statistically  test  1H0  and  2H0,  respectively.  If  a null  hypoth- 
esis was  rejected,  the  Johnson-Neyman  ( 1 936)  nonsignificance 
region  between  the  two  regression  lines  was  calculated.  It 
should  be  noted  that  Chou  and  Wang  (1992)  suggest  that  the 
Johnson-Neyman  technique  can  be  used  to  make  simultaneous 
inferences  provided  that  the  assumption  of  homogeneity  of 
regression  slopes  was  rejected.  The  Johnson-Neyman 
nonsignificance  regions  were  calculated  by  a program  writ- 
ten by  Fraas  and  Newman  (1997),  which  was  used  in  con- 
junction with  SPSS/PC+  software. 

Table  2 

Regression  Results  for  Model  1 


Variable3 

Pre-Treatment  Personal  X Group 

Pre -Treatment  Personal  Efficacy  Scores 

Grouph 

Constant 


Two  analytical  procedures  used  in  conjunction  with  the 
analyses  of  the  regression  models  should  be  noted.  First, 
since  this  study  involved  the  two  dependent  variables  of 
personal  efficacy  and  teaching  efficacy,  a Bonferroni  cor- 
rected alpha  level  was  used  to  maintain  the  experimentwise 
alph  level  at  the  .05  level.  That  is,  the  alpha  level  for  each  t 
test  used  to  statistically  test  each  interaction  effect  was  set 
at  .025,  which  is  equal  to  .05  divided  by  2.  Second,  before 
each  null  hypothesis  was  tested,  the  data  utilized  in  each 
model  were  tested  for  possible  outlier  values  with  a test  of 
Cook’s  distance  measures  (Neter,  Wasserman  and  Kutner, 

1 985).  As  suggested  by  Neter  et  al.,  the  magnitude  of  Cook's 
distance  measure  for  each  observation  was  declared  an  out- 
lier if  its  corresponding  F value  exceeded  the  50th  percen- 
tile of  the  F distribution  with  numerator  and  denominator 
degrees  of  freedom  of  4 and  64,  respectively.  Any  value 
that  appeared  to  distort  the  regression  analysis  was  reviewed 
for  possible  elimination. 

Results 

The  test  results  of  Cook’s  distance  measures  obtained 
from  Model  1 indicated  that  none  of  the  participants  was 
identified  as  having  scores  that  could  be  considered  as  out- 
lier values.  Thus,  the  data  for  all  68  participants  were  in- 
cluded in  an  analysis  of  Model  1.  The  t test  of  regression 
coefficient  for  the  Pre-Treatment  Personal  Efficacy  X Group 
variable  (r  = -2.44,  p = .0175)  indicated  that  the  difference 
between  the  slopes  of  the  regression  lines  of  the  FOCUS 
and  Control  groups  was  statistically  significant  at  the  .025 
level,  that  is,  1H0  was  rejected  (Table  2).  Thus,  the  differ- 
ences between  the  post- treatment  personal  efficacy  scores 
of  the  FOCUS  and  Control  groups  were  not  constant  across 
the  range  of  pre-treatment  personal  efficacy  scores. 


Model  1 

Regression 

t Test 

Coefficient 

Value 

p Value 

-.538 

-2.44 

.018 

.852 

5.17 

<.001 

25.124 

2.87 

.006 

6.362 

.97 

.338 

R2  = .370 

Adjusted  /?2  = .341 

N = 68 

'The  dependent  variable  consisted  of  the  teachers’  post-treatment  personal  efficacy  scores. 

‘'The  values  for  the  Group  variable  arc  zero  and  one  for  teachers  in  the  Control  and  FOCUS  groups,  respectively. 
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This  interaction  effect  between  the  Pre-Treatment  Per- 
sonal Scores  variable  and  the  Group  variable,  which  is  dia- 
gramed in  Figure  1 , was  disordinal  with  the  regression  lines 
intersecting  at  46.7.  The  regression  line  for  the  FOCUS 
Group  was  higher  than  the  regression  line  for  the  Control 
Group  below  the  pre-treatment  personal  efficacy  score  of 
46.7.  The  regression  line  for  the  Control  Group,  however, 
was  higher  than  the  regression  line  for  the  FOCUS  Group 
for  pre-treatment  personal  efficacy  scores  higher  than  46.7. 


Figure  L Pre-Treatment-Personal-Efficacy-Scores-By- 
Group  Interaction 


The  Johnson-Neyman  confidence  limits  were  calculated 
to  determine  the  nonsignificance  region  between  the  two  re- 
gression lines.  The  upper  limit  for  the  95%  confidence  lim- 
its was  8 1.8  points,  which  was  above  the  maximum  score  of 
54  for  the  personal  efficacy  section  of  the  instrument.  The 
lower  limit  was  40.7  points.  Thus,  the  post-treatment  per- 
sonal efficacy  scores  of  the  participants  in  the  FOCUS  Group 
were  statistically  significantly  higher  than  the  correspond- 
ing scores  of  the  participants  in  the  Control  Group  when 
their  pre-treatment  personal  efficacy  scores  were  less  than 
40.7.  The  post-treatment  personal  efficacy  scores  for  the 
participants  in  the  Focus  and  Control  groups  were  not  sta- 
tistically significantly  different,  however,  when  the  regres- 
sion line  for  the  Control  Group  was  higher  than  the  regression 
line  for  the  FOCUS  Group.  That  is,  the  post-treatment  per- 
sonal efficacy  scores  were  not  statistically  significantly  dif- 
ferent when  the  participants’  pre-treatment  personal  efficacy 
scores  were  greater  than  40.7. 

The  test  results  of  Cook’s  distance  measures  obtained 
from  Model  2 indicated  that  the  data  recorded  for  one  par- 
ticipant had  a distorting  influence  on  the  results  obtained 


from  the  regression  analysis.  A review  of  this  participant’s 
teaching  efficacy  scores  revealed  that  the  scores  changed 
from  the  minimum  score  on  the  pre-treatment  measurement 
to  the  maximum  score  on  the  post-treatment  measurement. 
Since  this  extreme  change  far  exceed  the  change  recorded 
for  any  other  participant,  this  participant’s  data  were  elimi- 
nated from  the  data  set  used  to  statistically  test  2H0.  Thus, 
the  data  for  38  participants,  rather  than  39  participants,  were 
included  in  the  FOCUS  Group  when  2H0  was  tested. 

The  t test  of  the  coefficient  for  the  re-Treatment- 
Teaching-Efficacy  X Group  variable  (r  = 2.742.  p - .008) 
indicated  that  this  interaction  effect  was  statistically  signifi- 
cant at  the  .025  level  (see  Table  3).  As  indicated  by  the  two 
regression  lines  contained  in  Figure  2,  the  interaction  effect 
between  the  pre-treatment  teaching  efficacy  scores  and  the 
groups  was  disordinal.  The  pre-treatment  score  located  at 
the  intersection  point  of  the  two  regression  lines  was  20.7. 
The  regression  line  for  the  Control  Group  was  higher  than 
the  regression  line  for  the  FOCUS  Group  below  the  pre- 
treatment teaching  efficacy  score  of  20.7  points.  The  re- 
gression line  for  the  FOCUS  Group,  however,  was  higher 
than  the  regression  line  for  the  Control  Group  for  pre-treat- 
ment teaching  efficacy  scores  greater  than  20.7. 

The  lower  limit  of  the  95%  Johnson-Neyman  confidence 
limits  for  the  regression  lines  diagramed  in  Figure  2 was 
equal  to  10.0.  It  should  be  noted  that  even  though  10.0  points 
was  above  the  minimum  score  of  7 points  that  a participant 
could  receive  on  this  section  of  the  Teacher  Efficacy  Scale, 
none  of  the  participants  included  in  this  study  had  a score 
below  13  points.  Thus,  none  of  the  participants  had  a score 
below  the  lower  limit  of  the  nonsignificance  region.  The 
upper  confidence  limit  was  equal  to  23.8.  Thus,  the  post- 
treatment  teaching  efficacy  scores  of  the  participants  in  the 
FOCUS  and  Control  groups  were  not  statistically  signifi- 
cantly different  when  their  pre-treatment  teaching  efficacy 
scores  were  below  23.8  points,  except  for  extremely  low 
pre-treatment  scores,  which  no  one  in  the  study  group  re- 
ceived. The  post-treatment  teaching  efficacy  scores  of  the 
participants  in  the  FOCUS  Group  were  statistically  signifi- 
cantly higher  than  the  corresponding  scores  of  the  partici- 
pants in  the  Control  Group,  however,  when  their 
pre-treatment  teaching  efficacy  scores  were  greater  than  23.8. 

To  understand  the  implications  of  the  nonsignificant 
regions  as  well  as  the  significant  regions  for  the  two  sets  of 
regression  lines,  it  is  important  to  note  that  the  location  of 
the  participants’  pre-treatment  efficacy  scores  along  those 
regression  lines.  Twenty-one  of  the  study's  67  (31%)  par- 
ticipants who  were  included  in  both  analyses  had  pre-treat- 
ment efficacy  scores  that  corresponded  to  points  on  the 
regression  lines  where  the  post-treatment  efficacy  scores  of 
the  participants  in  the  FOCUS  Group  were  statistically  sig- 
nificantly higher  than  the  scores  of  the  participants  in  the 
Control  Group  on  both  efficacy  scales.  Twenty-eight  (42%  ) 
of  the  participants  had  pre-term  efficacy  scores  that  corre- 
sponded to  points  on  the  regression  lines  where  the  post- 
term  efficacy  scores  of  the  participants  in  the  FOCUS  Group 
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9 suits  for  Model  2 


Model  2 


Table  3 
Regress  i 


Variable* 

Regression 

Coefficient 

t Test 
Value 

p Value 

Pre-Treatment  Personal  X Group 

.703 

2.742 

.008 

Pre-Treatment  Personal  Efficacy  Scores 

.153 

.790 

.433 

Group* 

-14.569 

-2.339 

.023 

Constant 

19.800 

4.331 

<.001 

R2  = .347 

Adjusted  R2  = .316 

N = 67 

aThe  dependent  variable  consisted  of  the  teachers’  post-treatment  teaching  efficacy  scores. 

bThe  values  for  the  Group  variable  are  zero  and  one  for  teachers  in  the  Control  and  FOCUS  groups,  respectively. 


Figure  2.  Pre-Treatment-Teaching-Efficacy-Scores-By- 
Group  Interaction 


were  statistically  significantly  higher  than  the  scores  of  the 
participants  in  the  Control  Group  on  one  of  the  two  efficacy 
scales.  The  remaining  18  (27%)  participants  had  pre-treat- 
ment efficacy  scores  that  corresponded  to  points  on  the  re- 
gression lines  where  the  post-treatment  efficacy  scores  of 
the  two  groups  were  not  statistically  significantly  different 
on  either  efficacy  scale. 

Thus,  a total  of  73%  had  pre-treatment  efficacy  scores 
that  were  located  at  points  on  the  regression  lines  where 
the  post-treatment  efficacy  scores  of  the  participants  in  the 


FOCUS  Group  were  statistically  significantly  higher  than 
the  post-treatment  efficacy  scores  of  the  participants  in  the 
Control  Group  on  at  least  one  of  the  two  efficacy  scales. 
None  of  the  participants  had  pre-treatment  efficacy  scores 
that  were  located  at  points  on  the  regression  lines  where 
the  post-treatment  efficacy  scores  of  the  participants  in  the 
Control  Group  were  statistically  significantly  higher  than 
the  post-treatment  efficacy  scores  of  the  participants  in  the 
FOCUS  Group  on  either  of  the  two  efficacy  scales. 

Discussion 

The  regression  analysis  of  the  participants’  post-treat- 
ment efficacy  scores  indicated  that  disordinal  pre-treatment- 
efficacy-by-group-interaction  effects  were  present.  The 
investigation  of  these  interaction  effects  was  a critical  ele- 
ment in  the  understanding  of  the  effect  of  the  FOCUS  model 
on  the  efficacy  levels  of  the  participants.  An  analysis  of 
these  disordinal  interaction  effects  revealed  that  a majority 
of  the  participants  (73%)  had  pre-treatment  efficacy  scores 
that  corresponded  to  levels  at  which  the  post-treatment  effi- 
cacy scores  were  statistically  significantly  higher  for  the 
FOCUS  Group  than  the  Control  Group  on  at  least  one  of  the 
two  efficacy  measures.  The  remaining  group  of  participants 
(27%)  had  pre-treatment  ef;  icacy  scores  that  corresponded 
to  points  on  the  regression  lines  where  the  post-treatment 
efficacy  scores  of  the  two  groups  were  not  statistically  sig- 
nificantly different  on  either  of  the  efficacy  scales. 

Thus,  teachers  who  appear  to  benefit  from  exposure  to 
the  FOCUS  model  are  those  participants  with  initial  per- 
sonal efficacy  levels  that  are  average  and  below  average  and 
those  participants  with  initial  teaching  efficacy  levels  that 
are  average  or  above  average.  The  finding  with  respect  to 
the  personal  efficacy  levels  is  not  unexpected  in  light  of 
the  purpose  of  using  the  FOCUS  model  and  the  findings 
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reported  by  Bolinger  (1988).  Bolinger  reported  that  the 
personal  efficacy  increased  in  a training  program  that  pro- 
vided participants  with  effective  teaching  skills.  A goal  of 
the  FOCUS  model  is  to  have  the  participants,  through  ex- 
periences encountered  in  the  class,  become  sensitized  to  the 
different  learning  styles  of  students  and  to  learn  various  peda- 
gogical methods  that  will  increase  the  changes  of  maximiz- 
ing those  students’  academic  achievements.  Thus,  exposure 
to  FOCUS  may  well  increase  a teacher’s  pedagogical  knowl- 
edge and  skill  level.  It  can  be  argued  that  exposing  the  teach- 
ers to  the  FOCUS  model  may  well  have  the  greatest  impact 
on  those  participants  who  had  the  lowest  initial  feelings  of 
being  able  to  affect  the  education  of  their  students,  that  is, 
low  personal  efficacy  levels. 

Possible  reasons  why  participants  with  average  and 
above  average  initial  levels  of  teaching  efficacy  recorded 
the  gains  in  post-term  teaching  efficacy  are  not  as  clear.  One 
possible  explanation  for  that  finding  may  lie  in  the  connec- 
tion between  changes  in  the  participants’  personal  efficacy 
levels  and  their  changes  in  teaching  efficacy  levels.  Investi- 
gation into  such  a connection  may  provide  insight  into  why 
the  participants  with  average  and  above  average  initial  teach- 
ing efficacy  levels  recorded  gains  in  post-treatment  teach- 
ing efficacy  levels  when  they  were  exposed  to  the  FOCUS 
model. 

Keeping  in  mind  the  internal  validity  limitations  of 
this  field  study,  which  were  previously  discussed,  a num- 
ber of  issues  need  to  be  addressed  by  future  research  on 
the  FOCUS  model  and  teacher  efficacy  if  one  is  to  have 
confidence  that  the  FOCUS  model  does  indeed  have  the 
positive  effects  suggested  by  the  results  of  this  study. 
First,  it  is  important  to  determine  if  our  findings  can  be 
replicated  in  studies  which  employ  research  designs  that 
reduce  the  number  of  internal  validity  concerns  contained 
in  this  study.  Second,  future  studies  need  to  determine  if 
the  type  of  changes  in  the  personal  efficacy  and  teaching 
efficacy  levels  of  the  participants  exposed  to  the  FOCUS 
model,  such  as  the  changes  reported  in  this  study,  are  sus- 
tained or  only  temporary.  Third,  future  studies  should 
determine  if  the  changes  in  the  efficacy  levels  of  the  par- 
ticipants exposed  to  the  FOCUS  model  lead  to  changes 
in  the  academic  performances  of  their  students.  Fourth, 
an  investigation  of  the  relationship  between  the  changes 
in  personal  and  teaching  efficacy  may  provide  important 
information  regarding  the  interrelationship  between  such 
changes. 
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As  one  reviews  this  history  of  the  College  of  Education  and  Allied  Professions,  it  becomes  evident  that 
three  factors  influenced  its  history.  First  is  the  focus.  What  stands  out  is  the  consistency  of  the  mission  centered 
on  collaboration  with  local  schools  and  agencies  to  prepare  teachers  for  area  schools  with  an  urban  emphasis. 
Second,  the  college  has  a continuing  succession  of  strong  faculty  who  have  provided  leadership  and  vision. 
Third  is  success  in  faculty  research  and  service. 

From  very  humble  beginnings,  the  College  of  Education  and  Allied  Professions  has  evolved  into  a college 
of  over  4,500  students  spanning  80  programmatic  options  at  four  separate  degree  levels.  It  has  been  recognized 
for  quality  of  instruction  and  cutting  edge  in  programming.  The  faculty,  staff  and  students  of  the  college  are 
proud  of  their  heritage.  By  all  objective  criteria  the  college  has  never  been  stronger  in  terms  of  quality  of  its 
programs,  quality  of  its  faculty,  quality  of  its  students,  support  ffom  the  university,  support  from  the  community, 
sponsored  research,  service  activities  and  national  reputation. 

As  the  new  millennium  is  approaching  the  College  of  Education  and  Allied  Professions  is  poised  to  accept 
the  challenges  of  21st  Century  teacher  preparation.  By  requiring  a strong  liberal  arts  foundation,  coupled  with 
rigorous  teacher  training,  the  College  has  taken  its  place  among  other  distinguished  institutions  that  produce 
tomorrow’s  educational  leaders. 

Mid- Western  Educational  Researcher 

Editors 


Deborah  L.  Bainer 

/ he  Ohio  State  University.  Mansfield 

Gene  A.  Kramer 
American  Denial  Association 

Richard  M.  Smith 
Rehabilitation  Foundation,  Inc. 


MWER  Publications 
Deborah  L.  Bainer 

The  Ohio  State  University,  Mansfield 
1680  University  Drive 
Mansfield,  Ohio  44906 


MWER  Subscriptions 

Jean  W.  Pierce 
Department  EPCSE 
Northern  Illinois  University 
DcKalb,  Illinois  60115 


Call  for  Manuscripts 

The  Mid-Western  Educational  Researcher  is  a scholarly  journal  that  publishes 
research-based  articles  addressing  a full  range  of  educational  issues.  The  journal 
also  publishes  literature  reviews,  theoretical  and  methodological  discussions  that 
make  an  original  contribution  to  the  research  literature,  and  feature  columns.  There 
are  four  issues  of  the  journal  published  annually. 

The  journal  is  now  accepting  manuscripts  for  review  and  possible  publica- 
tion. Manuscripts  are  submitted  to  blind  reviews  by  at  least  two  researchers  with 
knowledge  of  the  literature  in  the  appropriate  area.  Furthermore,  the  editors  will 
review  the  manuscript  and  make  the  final  decision.  The  review  process  requires 
approximately  three  months. 

Manuscripts  are  accepted  from  faculty,  students,  and  professionals  working 
in  non-educational  settings.  Membership  in  the  MWERA  is  not  required  in  order 
to  submit  a manuscript  for  review.  The  editors  encourage  the  submission  of  re- 
vised papers  that  have  been  presented  at  the  annual  meetings  of  the  MWERA, 
AERA,  and  other  professional  organizations. 

Submit  four  (4)  copies  of  the  manuscript  with  a cover  letter  to  Deborah  L. 
Bainer  (see  address  in  left  margin).  Manuscripts  should  conform  to  the  style  and 
format  described  in  the  Publication  Manual  of  the  American  Psychological  Asso- 
ciation , 4th  edition.  All  manuscripts  should  be  typed,  double  spaced,  on  8 1/2  x 
1 1 paper  with  1 1/2  inch  margins  on  all  sides.  An  abstract  of  less  than  100  words 
should  accompany  the  manuscript.  The  author’s  name  and  affiliation  should  ap- 
pear on  the  title  page  only.  Submissions  typically  are  less  than  20  pages  in  length. 
If  the  manuscript  is  accepted  for  publication,  the  author(s)  will  be  asked  to  provide 
a disk  file  (WP  5.1  or  higher  on  a 3 1/2  inch  high  density  IBM  formatted  disk)  as 
well  as  a printed  copy  of  the  final  version.  Please  note  that  the  editors  reserve  the 
right  to  make  minor  modifications  in  order  to  produce  a concise  and  clear  article. 

Questions  regarding  the  journal  or  the  submission  of  feature  columns  should 
be  directed  to  the  editors. 

Deborah  L.  Bainer  (419)  755-4287  bainer.l@osu.edu 
Gene  A.  Kramer  (312)  440-2684  kramerg@ada.org 
Richard  M.  Smith  (630)  462-4102  jomea@rfi.org 


i***********:***************^-^^  ADC  430 
Susan  Voclkcl  9 

PROC  ESSING.ER  IC/CRESS  32 

TO  BOX  1348 

CHARLESTON  WV  25325-1348 


c.  V 


Volume  11,  No.  3 Summer  1998 


Midwestern = 

Educational 

Researcher 


7r-Z.V'C/V 


• Official  Publication  of  the  Mid-Western  Educational  Research  Association 


v^--  -'■■-v-w.  i-V-  5 • 

$§§  4#  --v 

•s-'-iJs  r' 


' S 


Illinois  State  University 


Special  Program  Issue 

October  14  - 17, 1998 
Holiday  Inn  Mart  Plaza,  Chicago,  IL 


Onthe  Cover  _ ; 

DeGarmo  Hall,  home  of  the  College  of  Education  at  Illinois  State  University 

Founded  in  1 857  with  documents  drafted  by  Abraham  Lincoln,  Illinois  State  University 
is  one  of  the  Midwest’s  oldest  institutions  of  higher  education  and  the  first  public 
university  in  the  state.  From  its  beginnings  as  a teachers  college,  Illinois  State  has  served 
as  a model  for  innovative  teacher  and  administrator  preparation,  research  and  service. 
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welcome  to  MW5RA^?! 

On  behalf  of  the  Board  of  Directors,  Officers,  and  the  1998  Program  Committee 
I would  like  to  welcome  you  to  the  1998  Annual  Meeting  of  the  Mid-Western 
Educational  Research  Association.  The  program  for  this  year,  as  in  the  past,  is 
made  up  of  papers  which  have  undergone  a rigorous  peer-review  process.  Many 
volunteers  have  devoted  countless  hours  in  reading,  evaluating,  and 
commenting  on  this  year’s  submissions.  It  is  the  dedication  of  our  membership 
that  allows  MWERA  to  have  a meeting  with  only  the  highest  quality 
presentations! 

This  year  I am  pleased  to  welcome  four  nationally-recognized  individuals  who 
will  share  their  critical  insights  in  each  day’s  invited  addresses.  Our  meeting 
begins  on  Wednesday  evening,  October  14lh,  with  Edward  Hines,  Distinguished 
Professor  of  Education  from  Illinois  State  University,  delivering  the  Kick-Off 
Address.  Hines,  a nationally  recognized  expert  on  higher  education  finance,  will 
share  with  us  recent  changes  in  the  funding  of  higher  education  across  the  50 
states,  where  he  expects  the  funding  of  higher  education  to  go  in  the  next 
decade,  and  what  this  could  mean  to  faculty  and  universities.  Robert  Albrecht, 
Chief  Academic  Officer  at  the  Western  Governors  University,  will  provide  the 
Keynote  Address  on  Thursday  morning,  October  15th.  WGU  is  a ground- 
breaking new  institution  that  is  combining  multi-state  inter-university 
articulations,  distance  education  technologies,  and  traditional  instruction  in  a 
competency-based  model  for  undergraduate  education.  Albrecht  will  talk  about  the  programs  being 
implemented  by  WGU,  and  the  challenges  facing  both  WGU  and  traditional  institutions  of  higher  education  as 
well  all  move  into  the  21s'  century.  The  Thursday,  October  16lh  Luncheon  Address  will  feature  Judith  Gappa, 
Professor  of  Educational  Administration  at  Purdue  University,  speaking  about  changes  to  the  traditional 
academic  career.  Gappa  is  a noted  expert  in  the  forces  molding  the  modem  professoriate,  and  will  share  with  us 
the  most  recent  trends  and  data  on  full-time  non-tenurable  appointments,  “stopping  the  clock”  options,  post- 
tenure review,  and  early  retirement  incentive  plans.  On  Saturday  October  17th  we  will  welcome  our  own  Kim 
Metcalf,  Director  of  the  Junior  Achievement  Center  for  Evaluation  at  Indiana  University  and  the  current 
President  of  MWERA.  Metcalf  has  done  considerable  research  on  issues  related  to  school  choice,  and  will  share 
with  us  the  latest  information  on  voucher  programs  drawn  from  his  most  recent  work  with  the  Cleveland 
Scholarship  Program. 

Member  feedback  has  led  to  several  changes  for  this  year’s  meeting.  More  time  has  been  allotted  to  papers 
within  each  session  slot.  Several  workshops  have  been  scheduled  throughout  the  conference  in  addition  to  four 
pre-conference  workshops  scheduled  on  Wednesday  afternoon.  Roundtable  discussions  and  tabletop  poster 
sessions  have  been  scheduled  on  both  Thursday  and  Friday.  In  addition  to  the  regular  paper  sessions,  12 
additional  tables  have  been  planned  for  moderated  discussions  on  selected  “Hot  Topics”.  Time  has  been  allotted 
on  Thursday  for  participants  to  eat  a quick  lunch  without  missing  any  sessions,  with  the  catered  Luncheon 
scheduled  for  Friday  at  noontime.  Division  meetings  have  also  been  scheduled  throughout  the  conference  to 
allow  participants  to  more  easily  attend  the  division  meetings  of  their  choice.  This  year  I am  also  pleased  to 
welcome  the  participation  of  members  of  the  Illinois  Council  of  Professors  of  Educational  Administration 
(ICPEA).  The  ICPEA  is  co-sponsoring,  with  Division  A,  two  sessions  on  Thursday  afternoon. 

Overall,  this  year’s  meeting  could  be  the  best  yet.  I look  forward  to  seeing  everyone  in  Chicago  in  October! 


Jeffrey  B.  Hecht 
MWERA  Vice-President 
& 1998  Program  Chair 
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The  1998  Annual  Meeting  of  the  Mid-Western  Educational 
Research  Association  will  be  held  from  Wednesday,  Octoocr  14lh 
through  Saturday,  October  17th,  at  the  Holiday  Inn  Mart  Plaza  in 
Chicago,  Illinois.  Registration  and  pre-conference  workshops  will 
begin  early  Wednesday  afternoon,  with  the  Kick-Off  speaker 
starting  the  formal  program  at  8:00pm  that  evening.  Thursday, 
Friday,  and  Saturday  morning  will  consist  of  research  papers 
presented  in  a variety  of  different  formats,  workshops,  invited 
speakers,  meetings,  and  social  events.  The  conference  will 
conclude  following  the  final  sessions  at  Noon  on  Saturday. 

Meeting  Registration  is  expected  of  everyone  participating  in  or 
attending  the  1998  annual  meeting  of  the  Mid-Western 
Educational  Research  Association.  Registrants  are  provided  a 
MWERA-98  Name  Tag,  which  must  be  worn  at  all  times  while  at 
the  conference.  Those  planning  to  attend  MWERA-98  are 
strongly  encouraged  to  pre-register  for  the  conference,  workshops, 
and  to  make  hotel  reservations  as  soon  as  possible.  Pre-registration 
and  hotel  reservations  must  be  received  by  September  22,  1998. 
Registrations  mailed  after  September  22nd  may  not  be  received  in 
time  for  processing,  and  on-site  payment  in  the  form  of  cash  or 
personal  checks  will  be  expected.  If  double-payment  is  later 
determined,  a refund  will  be  issued.  On-site  registration  and  packet 
pick-up  will  be  available  at  the  registration  desk  on  the  14,h  Floor 
of  the  Holiday  Inn  Mart  Plaza  at  the  following  times: 

Wednesday,  October  14,  1 1 :00am  - 5:00pm 
Thursday,  October  15,  8:00am  - 5:00pm 
Friday,  October  16,  8:00am  - 5:00pm 

Membership  in  the  Mid-Western  Educational  Research 
Association  provides  reduced  conference  registration  fees  and  a 
subscription  to  the  Mid-Western  Educational  Researcher , the 
official  MWERA  publication.  Attendees  are  encouraged  to  join. 
Conference  presenters  must  be  paid  members  for  1998. 

MWERA  Publications  are  available  through  pre-registration. 
These  include  the  Directory  of  MWERA  Members  for  $8  and  the 
MWERA  1998  Program  Abstracts  for  $6.  MWERA  lapel  pins  are 
also  available  again  this  year  for  $3.  These  items  may  not  be 
available  at  the  conference  unless  ordered  through  pre-registration. 
If  additional  items  are  available  they  will  offered  for  sale  at  the 
registration  table  by  cash  or  checks  only. 

This  year’s  Exhibit  Hall  will  feature  publishers  and  others 
providing  materials  and  services  to  educators  on  Friday  from 
9:00am  to  4:00pm.  The  Exhibit  Hall  will  be  located  in  the  lobby 
of  the  14,h  Floor  of  the  Holiday  Inn  Mart  Plaza.  This  year  we  will 
have  a sharing  table  for  you  to  bring  job  announcements,  fill  out 
mentor  forms,  and  share  other  information  which  helps  all  of  us. 

Help  evaluate  the  sessions  and  the  annual  meeting!  We  are 
requesting  that  all  Session  Chairs  distribute  evaluation  forms  to 
attendees  at  each  session.  In  your  registration  packet  you  will  also 
receive  a form  to  evaluate  the  meeting  as  a whole.  Please  complete 
these  forms  and  return  them  cither  directly  to  each  Session  Chair, 
or  to  the  Registration  Table  on  the  I4,h  Floor  lobby.  Your 
comments  arc  critical  in  improving  our  meetings. 


Session  Formats 

Paper  Presentation 

Paper  sessions  allow  presenters  the  opportunity  to  make  short, 
relatively  formal  presentations  in  which  they  overview  their  papers 
to  an  audience.  Three  to  five  individual  papers  dealing  with  related 
topics  are  grouped  into  a single  session  lasting  no  longer  than  one 
hour  and  twenty  minutes.  The  presenter(s)  of  each  paper  is(are) 
allowed  10  to  15  minutes  to  present  the  highlights  of  the  paper. 
Some  sessions  will  have  a Session  Discussant  who  will,  following 
all  papers,  provide  comments  and  a critical  review.  A Session 
Chair  moderates  the  entire  session.  Presenters  are  expected  to 
provide  complete  copies  of  their  papers  to  all  interested  audience 
members. 

Roundtable  Discussion/Poster 

Roundtable  Discussion/Poster  sessions  provide  opportunities 
for  interested  individuals  to  participate  in  a dialogue  with  other 
interested  individuals  and  the  presenter(s)  of  the  paper.  Presenters 
are  provided  a small  table  around  which  interested  individuals  can 
meet  to  discuss  the  paper.  Presenters  may  elect  to  provide  small, 
table-top  poster-type  displays,  ancillary  handouts,  or  other  table- 
top  A/V  materials  to  augment  their  discussions.  Interested 
individuals  are  free  to  move  into  and  out  of  these 
discussions/posters  as  they  wish.  Presenters  are  expected  to  make 
available  complete  copies  of  the  paper  to  all  attendees.  Multiple 
roundtable  discussion/poster  sessions  are  simultaneously 
scheduled  in  a common  session  slot  lasting  fifty  minutes. 

Symposium 

A symposium  provides  an  opportunity  for  examination  of 
specific  problems  or  topics  from  a variety  of  perspectives. 
Symposium  organizers  have  identified  the  topic  or  issue  along 
with  individual  speakers  who  will  participate  in  the  session. 
Participants  may  be  provided  with  papers  or  other  handouts 
relevant  to,  reflective  of,  or  drawn  from  the  symposium,  and  may 
be  encouraged  to  participate  in  discussions  and/or  focused 
exercises  as  a part  of  the  symposium’s  activities.  Symposia  are 
typically  schedule  for  one  hour  and  twenty  minutes. 

Workshop 

Workshops  provide  an  extended  period  of  time  during  which 
the  workshop  leader(s)  help  participants  develop  or  improve  their 
ability  to  perform  some  process  (e.g.  how  to  provide  clinical 
supervision,  using  the  latest  features  of  the  Internet,  or  conduct  an 
advanced  statistical  analysis).  Workshops  have  been  scheduled 
throughout  the  conference,  allowing  attendees  the  opportunity  to 
attend  several  workshops  of  their  choosing.  Workshops  are  often 
scheduled  for  a longer  period  of  time  than  other  sessions,  and  may 
involve  the  payment  of  an  additional  fee  and  pre-registration. 

Alternative  Session 

The  form,  topics,  format  and  length  of  time  of  alternative 
format  sessions  arc  limited  only  by  the  imagination  and  creativity 
of  the  session  organizer.  The  prcscnter(s)  of  alternative  sessions 
have  recruited  the  major  participants  or  speakers,  developed  and 
provided  necessary  materials,  and  conduct  or  mediate  the  session 
as  detailed  in  the  program  description. 
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Cov^trtMt  Events  nvui  High  lights 


Edward  Hines  will  open  MWERA-98  at  the  Kick-OffSession  on 
Wednesday  evening  at  8:00pm  in  the  Sauganash  Ballroom  East. 
Hines,  a nationally-recognized  expert  on  finance  in  higher 
education  and  a Distinguished  Professor  of  Education  from  Illinois 
State  University,  will  present  a talk  entitled  “Policy  Research  in 
Higher  Education:  Data,  Decisions,  & Dilemmas’’.  A reception, 
sponsored  by  the  Department  of  Educational  Administration  and 
Foundation  at  Illinois  State  University,  will  follow  his  talk. 

Division  Meetings  have  been  scheduled  conflict-free  throughout 
the  day  on  Thursday  and  Friday.  Participation  in  a division  is  an 
important  part  of  MWERA  membership.  Get  to  know  the  other 
folks  in  the  division  of  your  choice  and  become  active  in  the 
happenings  of  that  division,  including  helping  to  recruit  new 
members  and  plan  next  year’s  conference. 

Robert  Albrecht,  Chief  Academic  Officer  of  Western  Governors 
University,  will  give  the  Keynote  Address  titled  “Western 
Governors  University:  New  Challenges,  New  Technologies,  New' 
University”  on  Thursday  at  9:30am  in  the  Sauganash  Ballroom 
East.  WGU  is  an  innovative  educational  institution  formed  out  of 
the  cooperation  of  many  states  institutions  of  higher  education, 
aimed  at  providing  competency-based  education  through  a 
combination  of  direct  and  distance  education  technologies. 
Albrecht  will  provide  additional  information,  and  be  available  for 
questions,  in  a Follow-Up  session  beginning  at  10:30am  in  the 
Shakespeare  Hotel. 

New  Members  are  encouraged  to  attend  a new'  member  welcome 
session  Thursday  starting  at  10:30am  in  the  American  House. 
Come  meet  other  MWERA  members  both  new  and  old,  and  find 
out  what  this  wonderful  organization  is  all  about. 

The  MWERA  Association  Council  will  hold  its  annual  meeting 
over  lunch  on  Thursday,  beginning  at  Noon  in  the  Sauganash 
Ballroom  East.  All  Association  Council  members  are  expected  to 
attend.  New  Council  Members  and  Officers  should  also  plan  on 
attending  a special  orientation  workshop  scheduled  for  Wednesday 
afternoon  from  3:10pm  to  5:30pm,  conducted  by  current  Past- 
President  Sharon  McNeely. 

Division  E wJl  host  an  Invited  Address  by  Othello  Poulard  from 
the  Center  for  Community  Change  on  Thursday  at  1 :40pm  in  the 
Shakespeare  Hotel.  Poulard’s  talk,  titled  “A  Strategic  Program  to 
Build  Character  and  Self-Esteem  Among  Urban  Adolescents”,  will 
describe  a new  initiative  to  improve  the  educational  opportunities, 
and  outcomes,  of  all  adolescents  in  selected  housing  projects. 

Two  Roundtable  Discussion/Poster  sessions  have  been  scheduled 
for  MWERA-98,  both  running  from  3:10pm  to  4:00pm  on 
Thursday  and  Friday  in  the  Sauganash  Ballroom  East.  Numerous 
interesting  presentations  on  a variety  of  topics  will  take  place 
during  these  times.  In  addition,  several  tables  will  be  hosted  by 
presenters  prepared  to  lead  participants  in  a guided  discussion  of 
today’s  Hot  Topics  in  education!  Organized  by  Tom  Parish, 
MWERA’s  President-Elect,  these  hot  topic  tables  add  a new' 
dimension  to  these  two  sessions! 


The  Editorial  Board  of  the  Mid - Western  Educational  Researcher 
will  meet  on  Thursday  afternoon  at  4: 1 0pm  in  the  Mansion  House. 
All  members  of  the  Editorial  Board  should  attend. 

The  Cracker  Barrel  Social  will  be  held  from  5:30pm  to  7:30pm 
in  the  Wolf  Pre-Function  Room  on  Thursday.  This  informal  event 
offers  a chance  to  relax,  mix,  and  mingle.  A cash  bar  and  muchies 
will  be  provided. 

Everyone  is  encouraged  to  attend  the  annual  Business  Meeting, 
scheduled  on  Friday  from  9:30am  through  10:20am  in  the 
Sauganash  Ballroom  East.  President  Kim  Metcalf  will  preside  over 
an  agenda  of  issues  critically  important  to  the  association.  Your 
input  is  both  needed  and  welcome! 

Judith  Gappa,  Professor  of  Educational  Administration  at  Purdue 
University,  will  deliver  a Luncheon  Address  titled  “The  Academic 
Career  in  the  21st  Century:  New  Options  for  Faculty”  on  Friday 
during  the  catered  luncheon.  Gappa  is  a leading  researcher  on  the 
changing  roles  and  expectations  facing  higher  education  faculty. 
Remember,  you  must  pre-register  for  the  conference  in  order  to  be 
guaranteed  a seat  at  the  Luncheon!  Immediately  following  the 
Luncheon  Gappa  will  provide  a follow-up  address,  and  be 
available  for  questions,  in  the  Lake  House  room  beginning  at 
1 :40pm. 

A Special  Symposium,  titled  “This,  Too,  Shall  Pass:  A 
Symposium  for  Doctoral  Students”  will  take  place  on  Friday 
afternoon  at  4:10pm  in  the  Shakespeare  Hotel.  This  session  is 
aimed  at  helping  all  of  our  current  graduate  students  understand 
the  trials  and  rigors  of  graduate  education,  and  to  provide  hope  - 
along  with  concrete  suggestions  - from  those  who  have  already 
gone  through.  All  current  (and  former)  graduate  students  are 
invited  to  attend. 

The  highlight  of  Friday  evening  will  be  the  President’s 
Reception,  scheduled  from  7:00pm  until  midnight  in  the  Wolf 
Point  Prefunction  Room  ( 1 5(h  floor  of  the  Holiday  Inn  Mart  Plaza). 
Your  host  for  the  evening  will  be  Kim  Metcalf,  the  current 
President  of  MWERA.  This  reception  promises  to  be  a great  time 
with  fine  food,  drink  and  company  for  all! 

Program  Chair  Jeffrey  Hecht  will  be  available  to  listen  to  your 
comments  about  the  1998  Annual  Meeting  at  the  Conference 
Feedback  session  Saturday  morning  starting  at  8:00am  in  The 
Bull’s  Head  room.  This  session  provides  you  with  an  opportunity 
to  elaborate  on  the  comment  forms  from  each  session.  Your 
feedback  will  be  brought  forward  into  the  Conference  Planning 
session  scheduled  for  10:30am  in  the  same  room.  All  Senior  and 
Junior  Division  Chairs  for  the  1999  conference  should  attend  this 
Conference  Planning  session  to  get  a jump  start  on  next  year! 

Kim  Metcalf,  Associate  Professor  from  Indiana  University  and 
President  of  MWERA,  wi II  deliver  the  Presidential  Address  on 
Saturday  at  9:30am  in  the  Merchants  Hotel.  Metcalf  s talk,  titled 
“Free  Market  Policies  and  Public  Education:  At  What 
(Opportunity)  Cost?”,  will  address  the  notion  of  vouchers  for 
public  education. 
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Professional  x^evelopment  Workshops 

M WERA  will  sponsor  a series  of  Professional  Development  Workshops  held  in  conjunction  with  the  Annual  Meeting.  These 
workshops  are  organized  to  meet  specific  training  needs  and  to  transmit  specific  research,  development,  and  evaluation  skills. 
NOTE:  A $10.00  fee  is  charged  for  each  workshop,  and  advance  registration  is  strongly  encouraged.  All  workshops  are  subject  to 
cancellation  for  insufficient  registration.  Workshops  may  be  open  to  on-site  and  same-day  registration,  space  permitting. 


W.  1 510.  AH 


Qualitative-Quantitative  Research 
Methodology:  Exploring  the 

Interactive  Continuum 


Division  H:  School  Evaluation  and  Program  Development 
Wednesday,  3: 10pm  to  5:30pm  — American  House 
CHAIR  Isadore  Newman,  University  of  Akron 
NOTES  Maximum  Enrollment:  20;  Fee:  $10,00 
PRESENTERS 

Isadore  Newman,  University  of  Akron ; Barbara  Moss, 
University  of  Akron 


Qualitative  research  is  being  used  with  increasing  frequency  in  the  social 
sciences.  It  is  important  to  identify  when  it  is  most  appropriate  to  use 
qualitative-quantitative  research  strategies  and  how  this  relates  to  what 
Newman  and  Benz  ( 1 998)  discuss  as  the  artificial  dichotomy.  (They  argue) 
"the  two  approaches  are  neither  mutually  exclusive  nor  interchangeable; 
rather,  the  actual  relationsh  ip  between  the  two  paradigms  is  one  of  isolated 
events  on  a continuum  of  scientific  inquiry."  The  objectives  of  this 
workshop  are:  ( 1 ) to  describe  the  concept  of  the  interactive  continuum;  (2) 
to  discuss  the  concept  of  the  qualitative-quantitative  approach  as  a false 
dichotomy;  (3)  to  discuss  validity  and  legitimation  of  research;  (4)  to 
identify  strategies  to  enhance  validity  and  legitimation;  (5)  to  apply  the 
qualitative-quatitative  approach  to  a variety  of  studies.  Through  the  use  of 
discussion  and  graphic  presentation,  this  workshop  will  demonstrate  how 
research  has  to  be  viewed  as  a holistic  conceptualization  in  the  world  of 
research  inquiry.  It  is  important  for  good  research  to  be  aware  of  a variety 
of  methods  and  validity  enhancement  techniques  associated  with  these 
methods.  This  workshop  will  also  emphasize  the  necessity  that  the  research 
question  dictates  the  selection  of  the  research  methods,  and  the  consistency 
between  the  research  question  and  methods  necessary  for  good  research 
regardless  of  whether  it  is  qualitative  or  quantitative. 


W.1510.BH 


MWERA  Association  Council  and 
Officers  Orientation 


MWERA 

Wednesday,  3:10pm  to  5:30pm  — The  Bull's  Head 
CHAIR  Sharon  L.  McNeely,  Northeastern  Illinois  University 
NOTES  Maximum  Enrollment:  25;  Fee:  N/C 
PRESENTERS 

Sharon  L.  McNeely,  Northeastern  Illinois  University ; Gregoty 
J . Merchant,  Ball  State  University ; Kim  K.  Metcalf 
Indiana  University * 


This  session  will  provide  orientation  for  newly  elected  Association  Council 
members  and  MWERA  officers.  The  session  will  overview  our  By-Laws, 
Policies  and  Procedures,  history,  and  issues  that  all  elected  officials  should 
be  familiar  with  as  they  start  serving  the  Association.  All  members  holding 
elected  positions  within  the  Association  arc  requested  to  attend  this 
session. 


W.  1 5 1 0.LH 


Delivering  Problem-Based  Learning 
Utilizing  a CD-ROM  Enhanced, 
Internet-Based  Delivery  System 


Division  K:  Teaching  and  Teacher  Education 
Wednesday,  3:10pm  to  5:30pm  — Lake  House 
CHAIR  Scott  B.  Wegner , Southwest  Missouri  State  University 
NOTES  Maximum  Enrollment:  20;  Fee:  $10,00 


PRESENTERS 


Scott  B.  Wegner,  Southwest  Missouri  State  University >\  Allan 
Grader , Southwest  Missouri  State  University ; Ken 
Holloway,  Southwest  Missouri  State  University ; Sandra 
Wegner,  Southwest  Missouri  State  University 


Until  recently  the  use  of  Internet  and  its  attendant  technologies  at  the 
university  level  has  been  primarily  been  for  research  and,  in  limited 
capacities,  for  communications.  The  use  of  the  Internet  for  instructional 
delivery,  though  increasing  greatly  every  day,  is  still  a relatively  new 
frontier.  In  this  workshop  presenters,  utilizing  a two-year  pilot  program  as 
a focus,  will  have  participants  explore  the  application  of  Internet  and  CD- 
ROM  technologies  to  problem-based  learning.  Audience  participation  will 
include  using  problem  development  strategies,  storyboarding  content  for 
CD-ROM  support  and  discussion  of  logistical  problems  surrounding 
Internet-Based  delivery  of  instruction. 


Towards  a Better  Understanding  of 

Response  Aberrance  Indices 

Division  D:  Measurement  and  Research  Methodology 

Wednesday,  3: 10pm  to  5:30pm  — Shakespeare  Hotel 
CHAIR  Ayres  G.  D'Costa , The  Ohio  State  University 
NOTES  Maximum  Enrollment:  15;  Fee:  $ 10.00 
PRESENTERS 

Ayres  G.  D'Costa,  The  Ohio  State  University 

This  study  examines  the  five  indices:  Sm,  Infit,  Outfit,  ECI2,  ECI  14,  and 
Lz,  in  terms  of  their  sensitivity  to  Guessing  and  Carelessness  as  measured 
by  two  indices,  Bs  and  Wc,  posed  as  criterion  aberrance  indices.  The 
specific  research  questions  are:  (1 ) What  is  the  nature  of  the  aberrance  that 
each  specific  Index  is  measuring?  Can  the  response  pattern  serve  to 
illustrate  the  nature  of  the  Index?;  (2)  How  is  the  Index  interpreted?  Are 
there  standardized  units  for  interpretation?  Should  standard  cut-offs  be 
used  for  clinical  interpretation?;  (3)  Is  the  Index  unique,  or  is  it  unusually 
correlated  with  another  Index?;  (4)  Can  the  Index  be  interpreted 
independently?  Or  is  its  value  dependent  on  another  measure,  such  as  the 
Total  Score?;  and  (5)  Is  the  Index  independent  of  the  skewness  of  the 
distribution  of  person  ability,  item  difficulty,  or  sample  size,  test  length? 
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Creating,  Training,  and  Sustaining  a 

Mentor  Teacher  Program 

Division  K:  Teaching  and  Teacher  Education 
Thursday,  3:10pm  to  5:30pm  — The  Bull's  Head 
CHAIR  Janet  T.  Bercik , Northeastern  Illinois  University 
NOTES  Maximum  Enrollment:  40;  Fee:  $10.00 
PRESENTERS 

Janet  T.  Bercik,  Northeastern  Illinois  University;  Elaine 
Bilowich,  Maine  East  High  School',  Joanne  Fallon , Maine 
East  High  School ; Judith  Flynn,  Nelson  School ; Harriet 
Johnson-Naden,  Northeastern  Illinois  University ; Patricia 
Lindoerfer,  Mark  Twain  School ; Linda  Merkel,  Walden 
School ; Katherine  Zlogar,  Washington  School 

Mentoring  is  the  "hot  topic"  and  "buzz  word"  that  appears  on  the  lips  of 
educators.  Universities  and  professional  organizations  are  analyzing  how 
they  train  their  novices;  and  states  are  looking  at  and  trying  to  reverse  the 
trend  of  teacher  loss.  The  issue  is  becoming  one  of  how,  when,  and  why 
to  mentor.  These  are  issues  that  Northeastern  Illinois  University  has 
addressed  through  its  collaborative  Goals  2000  Preservice  Teacher 
Education  Program.  Teachers,  students,  and  university  personnel  have 
joined  forces  to  provide  early  support  to  the  preservice  teacher  that  will 
ease  their  acculturation  into  school  systems.  There  is  no  one  specific  w'ay 
to  do  it,  so  general  guidelines  wfere  developed  that  will  help  set  the  stage 
for  the  novice.  These  guidelines  assist  mentor  teachers  in  designing  their 
roles  within  the  school  and  district,  and  with  the  university.  Their  roles  are 
continuously  reevaluated  and  redefined  as  necessary. 


F.  1 340.  AH 


Tricks  of  the  Teaching  Statistics 
Trade 


Division  D:  Measurement  and  Research  Methodology 
Friday,  1:40pm  to  4:00pm  — American  House 
CHAIR  Dennis  W.  Leitner,  Southern  Illinois  University  at 
Carbondale 

NOTES  Maximum  Enrollment:  30;  Fee:  $10.00 
PRESENTERS 

Dennis  W.  Leitner,  Southern  Illinois  University  at 
Carbondale ; Beverly  J.  Dretzke,  University  of  Wisconsin  - 
Eau  Claire ; Schuyler  W.  Huck,  University  of  Tennessee', 
Thomas  R.  Knapp,  The  Ohio  State  University: ; Joel  R. 
Levin,  University  of  Wisconsin  - Madison 


The  objective  of  this  workshop  is  to  share  presenters'  and  participants' 
experiences  in  the  teaching  of  difficult  statistical  concepts.  Useful 
demonstrations/concretizations  which  have  been  found  to  work 
successfully  in  the  classroom  will  be  presented.  The  teaching  and  learning 
of  statistics,  particularly  the  introductory  course,  is  always  difficult.  Many 
members  of  Division  D of  MWERA  teach  an  introductory  course  in 
statistics;  it  is  likely  that  they  would  find  this  workshop  particularly 
attractive.  The  workshop  proper  will  last  for  about  two  hours,  with  no 
more  than  one  and  one-half  hours  devoted  to  the  presenters' 
demonstrations  and  explanations,  leaving  at  least  a half  hour  for 
participants'  contributions  and  discussions.  It  is  anticipated  that  the  give- 
and-take  will  extend  long  after  that  two-hour  session,  however. 


QH33I  Training  Trainers  for  Technology 
Integration:  Beyond  "How  To" 

MWERA 

Saturday,  8:00am  to  9:20am  — Columbian  House 
CHAIR  Sharon  L.  McNeely , Northeastern  Illinois  University 
NOTES  Maximum  Enrollment:  10;  Fee:  $ 10.00 
PRESENTERS 

Sharon  L.  McNeely,  Northeastern  Illinois  University 

As  schools  move  from  a model  of  "technology  training"  which  is  focused 
on  basic  use  to  models  of  professional  development  that  rely  heavily  on 
teachers  being  the  facilitators  or  co-facilitators,  there  is  often  a gap  in  the 
process  which  results  in  ineffective  peer  training.  This  workshop  will 
provide  faciliative  models  to  help  those  that  train  teachers  to  be 
trainers/facilitators  to  work  with  other  teachers  to  promote  effective 
professional  development.  The  workshop  will  especially  focus  on 
examples  of  facilitative  trainings  related  to  technology  integration  in  the 
classroom. 


RjeceptloiA/S  awd  s>ouals> 

Welcome  Social 

Wednesday,  9:30pm  - 1 1:00pm,  Suaganash  Ballroom  East 
Hosted  by  the  Department  of  Educational  Administration 
and  Foundations  at  Illinois  State  University. 

Cracker  Barrel  Social 

Thursday,  5:30pm  - 7:00pm,  Wolf  Point  Prefunction  Room 
A MWERA  tradition! 

President's  Reception 

Friday,  7:00pm  - Midnight,  Wolf  Point  Prefunction  Room 
Hosted  by  Kim  Metcalf,  MWERA  President. 


exhibits 

Ail  registrants  are  encouraged  to  visit  the  Exhibits  in  the  Hallway 
of  the  14,h  Floor  Lobby.  MWERA  is  pleased  to  welcome  back 
many  of  the  firms  which  have  exhibited  with  us  before,  along 
with  several  new  ones!  The  Exhibits  will  be  open  from  9:00am 
to  4:00pm  on  Friday. 


Program,  owthe  (internet 

This  year’s  Annual  Program  is  available  on  the  Internet  at: 

http://tierlab.ilstu.edu/MWERA-98 

The  on-line  program  contains  all  of  the  information  in  the 
printed  program.  In  addition,  users  may  search  the  program  for 
presentations  matching  specific  descriptors,  key  words  in  the  title 
or  abstract  of  the  paper,  or  specific  presenters.  In  addition  full 
text  of  each  presentation's  abstract  is  available  on-line.  This  site 
is  courtesy  of  the  Technological  Innovations  in  Educational 
Research  Laboratory  in  the  Department  of  Educational 
Administration  and  Foundations  at  Illinois  State  University, 
Jeffrey  B.  Hecht,  Principal  Investigator. 
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T&ottrd  of  directors 

Immediate  Past  President 

Sharon  L.  McNeely,  Northeastern  Illinois  University 

President 

Kim  K.  Metcalf,  Indiana  University 

President-Elect 

Thomas  S.  Parish,  Kansas  State  University 

Vice-President 

Jeffrey  B.  Hecht.  Illinois  State  University 

Secretary 

Jennifer  J.  Fager,  Western  Michigan  University 

Member-at-Large 

Mary  Ann  Wham,  University  of  Wisconsin  - Whitewater 
Executive  Officer  (ex  officio) 

Jean  W.  Pierce,  Northern  Illinois  University 
Co-Editors,  Mid-Western  Educational  Researcher  (ex  officio) 
Deborah  L.  Bainer,  The  Ohio  State  University  - Mansfield 
Richard  M.  Smith,  Rehabilitation  Foundation,  Inc . 

Gene  A.  Kramer,  American  Dental  Association 
Vice-President  Elect 

E.  Jane  Williams,  The  Ohio  State  University 

Secretary  Elect 

James  H.  Powell,  Ball  State  University 
Vice-President-Elect  Elect 

Carmen  Giebelhaus,  Ohio  Department  of  Education 

ASSOCXflttoiA,  COU Mil 

1996-  1998 

Robert  Barcikovvski,  Ohio  University 

Corenna  Cummings,  Northern  Illinois  University 

John  Pohlmann,  Southern  Illinois  University 

Marlene  Schommer,  Wichita  State  University 

Rose  Mary  Scott,  University  of  Wisconsin  - Parkside 

Mary  Sudzina,  University  of  Dayton 

Jay  Thompson,  Ball  State  University 

Mary  Ann  Wham,  University  of  Wisconsin  - Whitewater 

1997-  1999 

Mary  Bcndixcn-Noe,  The  Ohio  State  University 
Thomas  Ganser,  University  of  Wisconsin  - Whitewater 
Carmen  Giebelhaus,  University  of  Dayton 
Adria  Karle-  Weiss,  Vanderbilt  University 
Carol  Newman,  University  of  Akron 
A.  William  Place,  University  of  Dayton 
Margaret  Simpson,  Northwestern  Univ  Medical  School 
E.  Jane  Williams,  The  Ohio  State  University 

1998-  2000 

Carolyn  Benz,  Wichita  State  University 

Connie  L.  Bowman,  University  of  Dayton 

Orpha  K.  Duell,  Wichita  State  University 

Bruce  G.  Rogers,  University  of  Northern  Iowa 

Richard  P.  Lipka,  Pittsberg  State  University 

Mary  Sudzina,  University  of  Dayton 

Sharon  E.  Paulson,  Ball  State  University 

Jay  R.  Price,  University  of  Wisconsin  - Stevens  Point 


Pro 0 ra  wl  Co  mmttt ee 

Program  Chair 

Jeffrey  B.  Hecht,  Illinois  State  University 

Associate  Program  Chairs 

Sharon  McNeely,  Northwestern  Illinois  University 
Thomas  S.  Parish,  Kansas  State  University 
Jean  Pierce,  Northern  Illinois  University 

Division  A:  Administration 

James  K.  Waller,  Texas  A <£  M University 
Larry  McNeat,  Illinois  State  University 

Division  B:  Curriculum  Studies 

James  H.  Powell,  Ball  State  University 
Jay  C.  Thompson,  Jr.,  Ball  State  University 

Division  C:  Learning  and  Instruction 

M Cecil  Smith,  Northern  Illinois  University 
Thomas  Pourchot,  Northern  Illinois  University 

Division  D:  Measurement  and  Research  Methodology 

James  J.  McCluskey,  Central  Michigan  University 
Larry  Henriksen,  Ball  State  University 

Division  E:  Counseling  and  Human  Development 

E.  Gabriella  Caldwcll-Miller,  Illinois  State  University 
Eddie  E.  Glenn,  Illinois  State  University 

Division  F:  History  and  Philosophy 

Beth  Johnson,  Eastern  Michigan  University 
Louise  E.  Fleming,  Ashland  University 

Division  G:  Social  Context  of  Education 

Mary  Ann  Wham,  University  of  Wisconsin  - Whitewater 
Susan  J.  Lenski,  Illinois  State  University 

Division  H:  School  Evaluation  and  Program  Development 

lsadore  Newman,  University  of  Akron 
John  W.  Fraas,  Ashland  University 

Division  I:  Education  in  the  Professions 

Gene  A.  Kramer,  American  Dental  Association 
Richard  M.  Smith,  Rehabilitation  Foundation,  Inc . 

Division  J:  Postsecondary  Education 

Margaret  A.  Simpson,  Northwestern  Univ  Medical  School 
Tom  J.  Cody,  Western  Illinois  University 

Division  K:  Teaching  and  Teacher  Education 

Connie  L.  Bowman,  University  of  Dayton 

Maria  Elena  Galvez-Martim  The  Ohio  State  Univ  at  Lima 

Exhibits 

Sharon  McNeely,  Northeastern  Illinois  University 
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Proposal  Reviewers 

The  1998  Program  Committee  wishes  to  express  our  appreciation  to  the  following  individuals  who  donated  their  time  to  assist  in  the 
process  of  reviewing  proposals: 


Shauna  M.  Adams,  University  of  Dayton 

Bernard  Arenz,  University  of  Texas  - El  Paso 

Robert  Atkinson,  University  of  Wisconsin  - Madison 

Charlotte  Batambuze,  Illinois  State  University 

Mary  Bendixen-Noe,  The  Ohio  State  University  - Newark 

Roger  V.  Bennett,  Southwest  Missouri  State  University 

Carol  L.  Bentley,  Northern  Illinois  University 

E.  Gabriella  Caldwell-Miller,  Illinois  State  University 

Cynthia  S.  Campbell,  Southern  Illinois  Univ  at  Carbondale 

Carl  R.  Carlan,  University  of  Texas  - Pan  American 

Russell  N.  Carney,  Southwest  Missouri  State  University 

Margaret  Kelly  Carroll,  Saint  Xavier  University 

Pamela  R.  Clinkenbeard,  Univ  of  Wisconsin  - Whitewater 

Tom  J.  Cody,  Western  Illinois  University 

Susan  R.  Cramer,  COEHS 

Shantill  Cummings,  Illinois  State  University 

Ayres  G.  D'Costa,  The  Ohio  State  University 

Alice  Darr,  University  of  Akron 

Ralph  F.  Darr,  University  of  Akron 

Di miter  M,  Dimitrov,  Kent  State  University 

Beverly  J.  Dretzke,  University  of  Wisconsin  - Eau  Claire 

A.  Gigi  Fansler,  Illinois  State  University 

Marcia  M.  Ferreira,  Wayne  State  University 

John  W.  Fraas,  Ashland  University 

Perry  Gallagher,  Harper  Community  College 

Maria  Elena  Galvez-Martin,  The  Ohio  State  Univ  at  Lima 

Tom  Ganser,  University  of  Wisconsin  - Whitewater 

Eddie  E.  Glenn,  Illinois  State  University 

Rodney  Greer,  Western  Illinois  University 

Edmund  Hansen,  Emporia  State  University 

Brian  R.  Hinrichs,  Illinois  State  University 

Lori  E.  Houghton,  University  of  Missouri  - Columbia 

E.  Peter  Johnsen,  University  of  Kansas 

Laurice  Joseph,  University  of  Dayton 

Deborah  Kalkman,  Northern  Illinois  University 

Larry  Kenney,  University  of  Wisconsin  - Whitewater 

Katie  Kinnucan-Welsch,  University  of  Dayton 

Cheryl  Kish,  Northern  Illinois  University 

Charles  Kline,  Purdue  University 

Kaetlyn  Lad,  Texas  A&M  University  at  Corpus  Christi 


Kevin  C.  Larkin,  American  Dental  Association 

Susan  G.  Locke,  Northern  Illinois  University 

Elizabeth  T.  Lugg,  Illinois  State  University 

R.  Andrew  Lugg,  Illinois  State  University 

Charles  Manges,  Texas  A&M  University  at  Corpus  Christi 

Barbara  N.  Martin,  Southwest  Missouri  State  University 

Kaye  M.  Martin,  Muskingum  College 

Oscar  T.  McKnight,  Ashland  University 

Larry  McNeal,  Illinois  State  University 

Kim  K.  Metcalf,  Indiana  University 

Carole  Newman,  University  of  Akron 

Isadore  Newman,  University  of  Akron 

Thomas  R.  O’Neill,  Amer  Society  of  Clinical  Pathologists 

Thomas  Oldenski,  University  of  Dayton 

George  J.  Petersen,  Southwest  Missouri  State  University 

Thomas  Pickering,  University  of  Southern  Indiana 

Jean  W.  Pierce,  Northern  Illinois  University 

John  T.  Pohlman,  Southern  Illinois  University 

Jay  R.  Price,  University  of  Wisconsin  - Stevens  Point 

Sharon  Pyke,  Northern  Illinois  University 

Dan  Raisch,  University  of  Dayton 

Hema  Ramanathan,  Butler  University 

Michelle  Reed,  The  Ohio  State  University 

James  W.  Reineke,  Winona  State  University 

Jacqueline  C.  Rickman,  Western  Illinois  University 

Adrian  Rodgers,  The  Ohio  State  University 

Linda  J.  Rosenkoetter,  University  of  Akron 

James  A.  Salzman,  Ursuline  College 

William  L.  Sharp,  Southern  Illinois  Univ  at  Carbondale 

Janet  K.  Sheehan-Holt,  Northern  Illinois  University 

Margaret  A.  Simpson,  Northwestern  University  Medical  School 

Kathleen  Sparrow,  Akron  Public  Schools 

Kathryne  M.  Speaker,  College  of  New  Jersey 

Mary  Strum,  Illinois  State  University 

Michael  L.  Supley,  Texas  A&M  University  at  Kingsville 

Sharon  A.  Valente,  Ashland  University 

Suzanne  E.  Wesson,  Hays  Independent  School  District 

Mary  Ann  Wham,  University  of  Wisconsin  - Whitewater 

Stanley  E.  Wigle,  University  of  Tennessee  - Martin 


Explanation  of  Session  Numbers 


example: 


T.OXOO.LH 


The  Evolving  Roles  of  the  Modern  Principal 


T Day  of  Session  W for  Wednesday,  T for  Thursday,  F for  Friday,  and  S for  Saturday 

0800  Time  Session  Begins  Using  a 24  hour  clock:  0800  is  8:00am,  1340  is  1:40pm 

LH  Room  AH  is  American  House,  CH  is  Columbian  House,  LH  is  Lake  House,  MA  is  Mansion  House, 

ME  is  Merchants  Hotel,  SE  is  Sauganash  Ballroom  East,  S\V  is  Sauganash  Ballroom  West, 

SP  is  Shakespeare  Hotel,  SB  is  Steamboat  Hotel,  BH  is  The  Bull's  Head, 

\VS  is  Western  Stage  House,  and  WP  is  the  Wolf  Point  Prefunction  Room 
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CovtftrtMt  ‘Rx^tratloui  cm A Hottl  Reservation 

Attending  MWERA-98  begins  with  a two-step  process:  registering  for  the  conference  and  reserving  a room  at 
the  hotel.  These  two  steps  require  the  completion  of  two  different  forms,  mailed  to  two  different  locations,  with 
different  information  needed  and  deposits.  DO  NOT  SEND  YOUR  CONFERENCE  REGISTRATION  TO 
THE  HOTEL,  OR  SEND  YOUR  HOTEL  RESERVATION  IN  WITH  YOUR  CONFERENCE 
REGISTRATION!  This  can  delay  your  registration/reservation,  or  result  in  your  not  being  registered  for  the 
conference  and/or  not  having  a place  to  stay  in  Chicago. 


Istrfl  tlo la  vs.  on-site  Registration 

MWERA  allows  both  pre-registration  and  on-site  registration;  however,  for  the  following  reasons,  pre- 
registration is  strongly  encouraged.  Pre-registrants  have  first  opportunity  to  enroll  in  Workshops,  to  purchase 
Materials,  and  to  attend  the  catered  Luncheon  on  Friday.  Pre-registration  is  also  less  expensive!  To  pre-register 
for  the  1998  Annual  Meeting  you  must  complete  the  form  on  the  following  page  and  return  it,  with  your  check 
or  money  order  for  payment  in  full,  to  Jean  Pierce,  MWERA's  Executive  Officer. 

Pre-registrations  must  be  postmarked  by  September  22nd  to  qualify  for  the  reduced  rates! 

On-site  registration  will  be  available  at  the  registration  desk  on  the  14th  Floor  of  the  Holiday  Inn  Mart  Plaza 
beginning  at  1 1 :00am  on  Wednesday,  October  14th  and  continuing  though  5:00pm  on  Friday,  October  16th. 

The  dates  of  our  conference  (October  14  - 17,  1998)  are  very  busy  ones  in  the  city  of  Chicago,  with  several 
conventions  and  activities  all  going  on  at  the  same  time.  Hotel  space  will  be  tight,  if  not  completely  unavailable, 
to  those  who  do  not  have  confirmed  reservations.  Our  convention  hotel,  the  Holiday  Inn  Mart  Plaza,  is  holding  a 
block  of  rooms  for  MWERA-98  attendees;  however,  they  will  only  hold  these  rooms  until  September  22nd!To 
ensure  that  you  have  a place  to  stay  please  make  your  reservations  with  the  hotel  early,  since  once  these  rooms 
are  gone  we  cannot  guarantee  housing  anywhere  in  downtown. 


Hotel  Facilities  a net  services 

Adjacent  to  the  Chicago  Merchandise  Mart  and  the  World  Trade  Center  - Chicago,  the  Holiday  Inn  Mart  Plaza 
is  conveniently  located  in  downtown  Chicago,  only  45  minutes  from  Chicago's  O’Hare  and  Midway  airports  and 
just  a short  ride  from  Union  Station.  The  hotel  is  very  close  to  the  entertainment  district  of  River  North, 
Chicago's  most  exciting  neighborhood,  and  the  Loop.  Newly  renovated  guest  and  meeting  rooms  promise  a 
comfortable  stay.  Numerous  dining  spots  are  convenient  to  the  hotel,  as  well  as  the  Inn's  own  attractions: 
Regions,  An  American  Cafe;  Brio,  the  Lounge  with  Attitude;  and  The  Lobby  Bar.  Services  at  the  hotel  include: 
24  hour  bellman  service,  self-service  laundry  (on  the  23rd  floor),  an  attached  parking  facility  with  unlimited 
in/out  privileges  at  a reasonable  rate,  drug  store,  florist,  gift  shop,  U.S.  Post  Office,  FedEx  Office,  Bank,  and  a 
retail  indoor  mall  - the  shops  at  the  Mart.  Hourly  computer  rental,  photocopy,  and  layout  production  services  are 
all  located  within  a short  walk  of  the  hotel. 

MWERA  will  provide  a standard  overhead  projector  in  each  presentation  room  throughout  the  conference. 
Presenters  may  use  this  projector  with  overhead  transparencies  or  computer-projection  systems;  however,  it  is 
up  to  each  presenter  to  either  provide  his  or  her  computer  and  projection  unit  (e.g.,  LCD  plate)  or  to  rent  one 
from  the  hotel.  The  hotel  has  a wide  variety  of  audio-visual  equipment  for  rent.  Contact  the  hotel  directly  well 
before  the  meeting  for  your  needs,  hotel  pricing  and  availability,  and  payment. 
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MWERA-98  Conference  Registration  Form 

October  14-  17, 1998  - Holiday  Inn  Mart  Plaza,  Chicago,  IL 


Your  Name: 


Affiliation: 


Mailing  Address: 


(First  Name) 


(Middle  initial) 


(Last  Name) 


Office  Phone:  ( 

Home  Phone:  ( 

Highest  Degree: 
Area  of  Specialization: 


E-mail: 


Institution  Awarding  Degree: 
MWERA  Division  Preference: 


Is  this  your  first  MWERA  conference?  □ Yes  □ No  If  YES,  how  did  you  learn  about  MWERA?. 


Workshoo  Registration 


Advance  registration  (or  workshops  is  strongly 
encouraged.  All  workshops  are  subject  to  cancellation 
for  insufficient  registration,  and  are  open  to  on-site  and 
same-day  registration  on  a space  permitting  basis  only. 


□ W.1510.AH 


□ W.1510.BH 


□ W.1510.LH 


□ W.1510.SP 


□ T.1510.BH 


□ F.  1340.  AH 


□ S.0800.CH 


$10.00 


$10.00 


$10.00 


$10.00 


$10.00 


$10.00 


Meeting  Registration  By  09/22/98  After  09/22/98 

MWERA  Member  $45.00  $55.00 

Non-Member  $50.00  $60.00 

Student  Member  (see  note  below)  $30.00  $35.00 

Attending  Luncheon  Only  $25.00  $28.00 

TOTAL  Registration  Fee  Enclosed: 


Membership  Dues 

1998  Membership 

1999  Membership 
Life  Membership 


(see  note  below) 


Regular 

$18.00 

$18.00 

$180.00 


Student 

$10.00 

$10.00 

$180.00 


TOTAL  Membership  Dues  Enclosed: 


MWERA-98  Materials 


MWERA  Membership  Directory 
MWERA-98  Program  Abstracts 
MWEFtA  Lapel  Pin 


Total  Workshop  Fees 


Cost  per  Qtv  Total 

$8.00 

$6.00  

$3.00  

TOTAL  Materials  Costs  Enclosed: 
TOTAL  Workshop  Fees  Enclosed: 

TOTAL  AMOUNT  ENCLOSED: 


The  Friday  Luncheon  is  included  in  the  Registration  Fee.  Pleas.e  help  us  plan  for  the  correct  number  of  attendees! 

Will  you  be  attending  the  Friday  Luncheon?  □ Yes  □ No 

Will  you  require  a special  menu?  □ Yes  □ No  If  YES,  please  describe:  

Will  you  be  staying  at  the  Holiday  Inn  Hotel?  QYes  QNo  If  YES,  which  nights  (circle  all  that  apply):  Tue  Wed  Thu  Fri  Sat 

Make  your  check  or  money  order  payable  to  “MWERA"  Register  before  September  22. 1998  to  receive  the  lowest  conference  ratesl 
Persons  applying  for  Student  membership  must  provide  proof  of  student  status  (copy  of  a current  student  ID  or  registration,  or  letter  from  advisor). 
All  presenters  must  register  for  the  meeting  and  be  a current  (1998)  member  of  the  Association.  New  presenters  may  join  using  this  registration. 

Mail  completed  form  and  payment  to 
Dr.  Jean  Pierce 
Northern  Illinois  University 
Department  EPCSE 
DeKalb,  Illinois  60115 
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Holiday  Inn  Mart  Plaza  Hotel  Reservation  Form 

Mid-Western  Educational  Research  Association  Meeting 

October  14 -17, 1998 


Your  Name: 

Company: 
Mailing  Address: 


(First  Name) 


(Middle  Initial) 


(Last  Name) 


Day  Telephone: 


Accommodations  Requested 


Arrival  Date: 
Departure  Date: 
Bed  Type: 
Smoking  Preference: 
Number  of  People: 


Name(s)  of  Roommate(s)  (if  any): 
Special  Needs: 


□ Single  (1  King)  □ Double  (2  Doubles) 

□ Smoking  □ Non-Smoking 


□ Single 

□ Double 

□ Triple 

□ Quad 


($120.00 /night) 
($135.00 /night) 
($150.00 /night) 
($165.00 /night) 


To  confirm  your  reservation , the  hotel  requires  a first  nights  deposit  or  a credit  card  guarantee. 


Method  of  Payment 

□ Check  or  Money  Order 

□ Credit  Card  (indicate  card):  □ MasterCard  □ Visa  □ American  Express  □ Discover  □ Diners  Club 

Credit  Card  Number: 


Name  on  Credit  Card: 


Expiration  Date: 

Signature: 

You  must  cancel  this  reservation  prior  to  6:00pm  on  your  expected  date  of  arrival  to  avoid  billing  on  your  credit  card  for  The  first  night’s  room  and  tax 
or  the  loss  of  your  deposit.  The  above  rates  do  not  include  state  and  focal  taxes.  Automobile  parking  (non-valet)  is  available  at  the  hotel  for  an 
additional  $12  per  day  (plus  taxes)  for  registered  hotel  guests.  Check  in  time  is  3:00pm,  check  out  time  is  Noon.  On  site  luggage  storage  is  available 
for  early  arrival  and  late  check  out.  The  above  group  rates  are  only  guaranteed  until  SEPTEMBER  22, 19981 

Mail,  FAX,  or  telephone  completed  form  and  deposit  information  to 
Holiday  Inn  Mart  Plaza 
350  North  Orleans 
Chicago,  IL  60654 
(312)  836-5000 
FAX:  (312)  222-9508 
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Holiday  Inn  Mart  Plaza 
350  North  Orleans 
Chicago,  IL  60654 
(312)  836-5000 
FAX:  (312)222-9508 


O’Hare  Airport  to  the  Holiday  Inn  (3  Options 


1 . Take  a CTA  train  to  downtown  for  about  S2.50. 
Catch  the  train  in  the  basement  of  Terminal  3.  Take 
the  ‘‘A1’  or  “B”  line.  Get  off  at  the  Clark/Lake  station. 
Transfer  to  the  “Brown”  line  (Ravenswood),  and  take 
this  to  the  Merchandise  Mart. 

2.  Take  the  Continental  Airport  Bus  for  about  S 1 5.00 
one  way  or  $28.00  round  trip.  No  reservations  are 
required  from  the  airport.  See  the  agent  at  the  booth  in 
the  lower  level  baggage  claim  area, 

3.  Take  a cab  for  about  $28.00  one  way.  Wait  in  the  cab 
stand  area.  In  off-hours  a ride  takes  about  30  minutes. 
In  rush  hours  (7-10  am,  3 - 7 pm)  the  ride  could  take 
an  hour  or  more.  Tips  average  1 5 - 20%. 

Midway  Airport  to  the  Holiday  Inn  (3  Options) 


1 . Take  a CTA  train  to  downtown  about  about  $2.50. 
Catch  the  train  at  the  east  end  of  the  airport.  Get  off  at 
the  Clark/Lake  station.  Transfer  to  the  “Brown”  line 
(Ravenswood),  and  take  this  to  the  Merchandise  Mart. 

2.  Take  a Continental  Airport  Bus  for  about  $ 1 1 .00 
one  way  or  $20.00  round  trip.  No  reservations  are 
required  from  the  airport.  See  the  agent  at  the  booth 
for  tickets. 

3.  Take  a cab  for  about  $25.00  one  way.  Wait  in  the  cab 
stand  area.  See  O’Hare  information  above  regarding 
time. 

Driving  and  Parking  Downtown  (3  Options 


1 . From  the  South,  East,  or  West:  Take  1-90/94  (Dan 
Ryan).  Exit  at  Washington  Street  East  (Exit  5 1C). 

Turn  right  onto  Washington.  Go  to  Wacker  Drive  and 
turn  left.  Make  another  left  at  Orleans  Street  and  cross 
over  the  bridge.  The  hotel  is  on  the  left-hand  side. 

2.  From  1-88:  1-88  connects  to  290  (Eisenhower).  Exit  at 
Franklin  Street.  Follow  Frankiin  until  it  turns  into 
Orleans  Street  (just  over  the  river).  The  hotel  is  on  the 
left-hand  side. 

3.  From  the  North,  1-90/94  (Kennedy  Expressway): 
Exit  at  Ohio  Street.  Go  to  Wells  Street  (3rd  light).  Turn 
right,  cross  the  river  and  turn  right  onto  Wacker  Drive. 
Go  one  block,  turn  right  onto  Orleans,  and  cross  the 
bridge.  The  hotel  is  on  the  left-hand  side. 

The  Holiday  Inn  Mart  Plaza  sits  atop  The  Apparel 

Center,  Take  the  Elevators  on  the  first  floor  of  The 

Apparel  Center  to  the  I5lh  Floor  Hotel  Lobby. 
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CMroMloQlzal  Listing  of  'Sessions 

Wednesday,  October  ±4, ±2^2 


W.15IOj\H 


Qualitative-Quantitative  Research  Methodology:  Exploring  the  Interactive  Continuum 

Division  H:  School  Evaluation  and  Program  Development  — Workshop 
Wednesday*  3:10pm  to  5:30pm  — American  House 
Isadore  Newman , University  of  Akron 

Maximum  Enrollment : 20;  Fee:  5 10,00;  Pre-registration  required , on-site  registration  only  if  space  available . 


W.1510.BH 


MWERA  Association  Council  and  Officers  Orientation 

MV/ERA  — Workshop 

Wednesday,  3:10pm  to  5:30pm  — The  Bull's  Head 

Sharon  L.  Me  Neely,  Northeastern  Illinois  University 

Maximum  Enrollment:  25;  Fee:  N/C;  Orientation  for  Association  Council  members  and  MWERA  officers. 


W.15I0.LH 


Delivering  Problem-Based  Learning  Utilizing  a CD-ROM  Enhanced,  Internet-Based 
Delivery  System 

Division  K:  Teaching  and  Teacher  Education  — Workshop 
Wednesday,  3:10pm  to  5:30pm  — Lake  House 

Scott  B.  Wegner , Southwest  Missouri  State  University 

Maximum  Enrollment:  20;  Fee:  $10.00;  Pre-registration  required,  on-site  registration  only  if  space  available. 


W.1510.SP 


Towards  a Better  Understanding  of  Response  Aberrance  Indices 

Division  D:  Measurement  and  Research  Methodology  — Workshop 
Wednesday,  3:10pm  to  5:30pm  — Shakespeare  Hotel 
Ayres  G.  D'Costa,  The  Ohio  State  University 

Maximum  Enrollment:  15;  Fee:  $10.00;  Pre-registration  required , on-site  registration  only  if  space  available. 


W.2000.SE 


Kick-Off  Address 

MWERA  — Invited  Address 

Wednesday,  8:00pm  to  9:30pm  — Sauganash  Ballroom  East 
CHAIR  Jeffrey  B.  Hecht , Illinois  State  University 

PRESENTATION 

Policy  Research  in  Higher  Education:  Data,  Decisions,  & Dilemmas. 

Edward  Hines,  Illinois  State  University 

The  world  of  policy  research  in  higher  education  is  far  removed  from  higher  education, 
itself.  Why  is  this?  What  are  the  consequences  for  the  academy?  For  policymakers?  For 
faculty?  For  researchers?  In  this  presentation,  Edward  Hines  will  identify  trends  in  state 
higher  education  support,  prospects  for  future  funding  of  higher  education  by  state 
governments,  and  implications  for  campus  leaders,  faculty,  and  researchers.  For  40  years 
Grapevine  has  served  as  a national  data  base  of  interstate  higher  education  finance  data. 
Edward  Hines  is  Editor  and  publisher  of  Grapevine  data  at  Illinois  State  University.  In 
addition  to  being  the  Editor  and  publisher  of  Grapevine , Hines  is  a University 
Distinguished  Professor  and  Senior  Associate  in  the  Center  for  Higher  Education  and 
Educational  Finance  at  Illinois  Stale  University.  He  is  widely  known  as  a national  data 
collector  and  commentator  on  higher  education  Finance,  and  has  been  interviewed  on 
national  television  and  public  radio.  His  data  and  accompanying  interviews  have  also 
appeared  in  most  of  the  nation’s  major  newspapers  including  The  New  York  Times , The  Los 
Angeles  Times , The  Chicago  Sun-Times , and  the  Washington  Post . 


W.2IJ0.SI: 


NOTES 


Welcome  Social 

MWERA  — Social 

Wednesday,  9 30pm  to  1 1 :()0pm  — Sauganash  Ballroom  East 

Hosted  by  the  Department  uj  Educational  Administration  and  Foundations  at  Illinois  State  University 
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CMroMloQioal  Listing  of  sessions 

Thursday,  October  ±5,  1^2 

New  Motivation  Research  in  Education 

Division  C:  Learning  and  Instruction  — Paper  Presentation 
Thursday,  8:00am  to  9:20am  — American  House 
CHAIR  Beverly  J . Dretzke , University  of  Wisconsin  - Eau  Claire 

PRESENTATIONS 

Assessment  of  Expectancy-Value  Motivation  Model  using  a Secondary  Analysis  of  the  Longitudinal  Study  of  American  Youth 
(LSAY)  Data.  Thomas  L Pourchot,  Northern  Illinois  University' 

Attributions,  Aspirations,  and  Academic  Confidence:  How  Do  Gifted  Females  Measure  Up?  Darci  M.  Ament,  University'  of 
Wisconsin  - Eau  Claire;  Beverly  J.  Dretzke,  University  of  Wisconsin  - Eau  Claire 
Children’s  Achievement  Motivation  and  Participation  in  Peer  Tutoring.  Linda  D.  Lange , Dickinson  State  University > 


T.0800.BH 


Professionals  and  Children  with  Disabilities 

Division  E:  Counseling  and  Human  Development  — Paper  Presentation 
Thursday,  8:00am  to  9:20am  — The  Bull's  Head 
CHAIR  Eddie  E.  Glenn , Illinois  State  University 

PRESENTATIONS 

An  Investigation  of  the  School  Psychologist's  Role  in  Planning  an  Educational  Program  for  Students  with  Hearing  Impairments. 

Cheryl  J.  Levin,  Loyola  University  of  Chicago;  Ronald  R.  Morgan,  Loyola  University  of  Chicago 
Factors  Affecting  Teacher  Attitudes  Toward  Inclusionary  Educational  Practices.  Robert  G.  Harrington,  University  of  Kansas; 

Renee  Spears,  University  of  Kansas;  Andrea  Stevenson,  University  of  Kansas 
The  Identification  and  Delivery  of  Counseling  Strategies  for  Special  Needs  Students.  Mack  L.  Bowen,  Illinois  State  University 


T.0800.CH 


An  Examination  of  Studies  Involving  Rasch  Measurement  Techniques  and  Research 
Methodology 

Division  D:  Measurement  and  Research  Methodology  — Paper  Presentation 
Thursday,  8:00am  to  9:20am  — Columbian  House 
CHAIR  Bruce  G.  Rogers , University  of  Northern  Iowa 

PRESENTATIONS 

A Many-Faceted  Rasch  Analysis  of  Social  Studies  Performance.  Shawn  M.  Quilter,  Eastern  Michigan  University;  CherC.  Hill, 
State  University  of  West  Georgia 

Determining  the  Multivariate  Assumptions  of  a Four  Dimensional  Instrument  Designed  to  Follow-up  Elementary  and  Secondary 
Level  Graduates  of  Multiple  Teacher  Education  Institutions.  Mohammed  A.  Rahman,  The  Ohio  State  University;  William  E. 
Loadman,  The  Ohio  State  University 

Establishing  BEST  Practices  in  the  State  of  Ohio:  A Rasch  Analysis  of  Nominations.  Anna  Marie  M.  Thomas,  The  Ohio  State 
University ; G wo- Jen  Guo,  The  Ohio  State  University;  William  E.  Loadman,  The  Ohio  State  University 
One  Examination  and  Four  Analyses:  Classical  Test  Theory,  Gencralizability  Theory,  The  BWS1  & Rasch  Measurement 
Compared  & Contrasted.  Anna  Marie  M.  Thomas,  The  Ohio  State  University 
Sensitivity  of  five  Rasch-Model-Based  Fit  Indices  to  Person  and  Item  Aberrances.  Hyunsoo  Seal,  The  Ohio  State  University; 
Ayres  G.  D' Costa,  The  Ohio  State  University;  Thomas  R.  Knapp,  The  Ohio  State  University;  William  E.  Loadman,  The  Ohio 
State  University 


T. 0X00. l.l  I 


The  Evolving  Roles  of  the  Modern  Principal 

Division  A:  Administration  — Paper  Presentation 
Thursday,  8:00am  to  9:20am  — Lake  House’ 

CHAIR  Charles  Manges , Texas  A&M  University  at  Corpus  Christi 

PRESENTATIONS 

An  Examination  of  the  Principal's  Role  in  Managing  the  Paradox  of  State  Mandated  Improvement  and  Accountability.  Jenny  S. 

Tripses , Bloomington  District  <S’7;  Dianne  Ashby,  Illinois  State  University 
Combating  Teacher  Burnout:  The  Role  of  the  Principal.  Barbara  L . Brock,  Creighton  University 

Human  and  Fiscal  Resources  Management  in  the  Local  School  Community:  A View  From  Selected  Schools.  Larry  McNeal, 
Illinois  State  University 

The  Principal's  Role  in  Shaping  Organizational  Culture  in  the  Context  of  School  Improvement  Efforts.  Martin  H Jason . 
Roosevelt  Lh  i i \ vrsi t \ » 
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Examining  Pedagogy  and  Curriculum 

Division  G:  Social  Context  of  Education  — Paper  Presentation 
Thursday,  8:00am  to  9:20am  — Steamboat  Hotel 
CHAIR  Susan  J.  Lenski,  Illinois  State  University 

DISCUSSANT  Mary  Arm  Wham,  University'  of  Wisconsin  - Whitewater 
PRESENTATIONS 

An  Analysis  of  the  Attitudes  of  Daycare  Providers  Toward  Inclusion.  Sheila  F.  Lairson,  Warren  County 1 Bd.  MRJDD\  Barbara  M. 
De  Luca,  University  of  Dayton 

Exchange  City:  The  Effects  of  A Simulated  Economic  and  Civic  Community  on  5th  Grade  Inner-City  Youth.  JaDora  F.  Sailes , 
Indiana  University ■ 

Predicting  and  Attributing  for  Test  Scores:  Successful-Unsuccessful  College  Students.  Peter  J.  Brady , Clark  State  Community 
College 

Teacher's  and  Student's  Perceptions  of  a Conflict  Mediation  Program.  Barbara  N.  Martin , Southwest  Missouri  State  University 


T.08OO.SP 


Professional  Development:  Suggested  Models 


Division  H:  School  Evaluation  and  Program  Development  — Paper  Presentation 
Thursday,  8:00am  to  9:20am  — Shakespeare  Hotel 
CHAIR  Carole  Newman , University'  of  Akron 

DISCUSSANT  Alice  Da  rr.  Uni  versity  of  A kron 
PRESENTATIONS 


A Research-Based  Literacy  Training  Model  Linking  Teacher  Learning  and  Student  Achievement.  E.  Jane  Williams , The  Ohio 
State  University : Pat  Gordon , Hedges  Elementary  School 

Project  PREPARE:  Collaborating  for  Professional  Development  and  School  Improvement.  M.  A.  Garmon,  Western  Michigan 
University ; Troy  V.  Manage , Western  Michigan  University 
Service  Learning:  How  Does  That  Fit  in  my  Course?  Bonnie  Dunwoody , Saint  Mary’s  College 


Special  Education  and  Inclusion 

Division  K:  Teaching  and  Teacher  Education  — Paper  Presentation 
Thursday,  8:00am  to  9:20am  — Western  Stage  House 
CHAIR  Rose  Mary ■ Scott , University * of  Wisconsin  - Parks ide 

DISCUSSANT  Richele  O’Connor,  Wright  State  University 
PRESENTATIONS 

Teachers'  Attitudes  Toward  Inclusive  Education.  H.  Keit  Cochran,  Missouri  Southern  State  College 

The  Relationship  Between  Time  Included  in  a General  Education  Classroom  and  the  Self-Concepts  of  Learning  Disabled  and 
Mentally  Retarded  Students.  Stanley  E.  Wigle . University  of  Tennessee  - Martin\  Donald  F.  DeMoulin,  University  of 
Tennessee -Mar tin 

The  Special  Education  Competencies  of  Special  Educators.  Stanley  E.  Wigle , University-  of  Tennessee  - Martin',  Daryl  J.  Wilcox, 


Division  Meetings  have  been  scheduled 
throughout  the  day  on  both 
Thursday  and  Friday! 

Get  involved  in  the  division(s)  of  your  choice. 

Attend  divisions  meetings  and  become  an  active  part  of  MWERA! 
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T.0930.SH 


Keynote  Address 

MWERA  — Invited  Address  — 

Thursday,  9:30am  to  10:20am  — Sauganash  Ballroom  East 
CHAIR  Jeffrey  B.  Hecht,  Illinois  State  University 

PRESENTATION 

Western  Governors  University:  New  Challenges,  New  Technologies,  New 
University. 

Robert  C.  Albrecht,  Western  Governors  University 

Over  two  years  ago  representatives  of  the  governors  of  sixteen  western  states  met  and 
drafted  plans  to  form  the  largest  “virtual  university"  yet  conceived.  Their  plan  called  for 
the  creation  of  a consortium  of  government  and  pri\  ate  industry  to  form  a new  institution. 

This  new  partnership  would  list  specific  competencies  in  selected  academic  and  technical 
areas,  then  award  degrees  in  the  fields  to  students  who  mastered  these  competencies. 

Participating  colleges,  universities,  and  corporations  could  market  qualifying  distance 
learning  courses  to  prospective  students,  who  would  then  take  these  courses  in  an  eclectic 
mix  of  in-person,  traditional  distance  education,  and  Internet-based  forums.  After  two  years 
of  preparation,  and  over  $9-million  dollars  in  fund  raising,  WGU  will  open  its  virtual  doors 
in  the  next  few  months  to  its  first  on-line  students.  Albrecht’s  remarks  at  the  Keynote 
address  and  Follow-Up  Discussion  will  focus  on  the  aspirations  of  the  competency-based, 
distance  education  model  being  implemented  by  WGU,  and  the  current  and  future 
challenges  facing  both  WGU  and  traditional  institutions  of  higher  education.  He  will  also 
overview  the  operations  and  technologies  of  WGU,  giving  attendees  a glimpse  into  the 
university  of  the  21sl  century. 

Robert  C.  Albrecht  serves  as  the  Chief  Academic  Officer  of  the  Western  Governors  University,  heading  the  Colorado  office  of  the 
University.  In  the  summer  of  1996  he  had  been  named  as  co-director  of  the  University;  in  1997  at  the  first  meeting  of  the  Board  of  WGU, 
he  was  designated  the  Chief  Academic  Officer.  From  1989  until  1997,  Albrecht  served  as  the  Associate  Vice  President  of  the  University 
of  Colorado,  chiefly  dealing  with  technology  across  the  four  campuses  of  the  University.  After  degrees  from  Illinois,  Michigan  and 
Minnesota,  where  he  was  awarded  the  Ph.D.  in  American  Studies,  Albrecht  taught  at  the  University  of  Chicago  and  the  University  of 
Oregon.  He  then  served  in  positions  in  academic  affairs  at  the  University  of  Northern  Colorado  and  the  Montana  University  System  until 
1989.  Albrecht’s  publications  include  books  and  journal  articles  in  American  literature,  academic  administration  and  distance  learning. 


T.  1030.  AH 


CHAIR 

NOTES 


New  Member  Welcome 

MWERA  — Meeting 

Thursday,  10:30am  to  1 1 :50am  — American  House 

Mary*  Ann  Wham , University  of  Wisconsin  - Whitewater 

All  new  and  existing  MWERA  members  are  invited  to  this  new  member  welcome  session.  Come  and  meet  each  other, 
and  get  to  know  what  this  wonderful  organization  is  all  about ! 


T.  1 030.  mi 


Technology  and  its  Impact  upon  Curriculum 

Division  B:  Curriculum  Studies  — Paper  Presentation 
Thursday,  10:30am  to  1 1:50am  — The  Bull’s  Head 
CHAIR  James  H . Powell , Ball  State  University 

DISCUSSANT  Laurie  Thomas , Ball  State  University 
PRESENTATIONS 

An  Analysis  of  Attitudes  of  Fourth-Grade  Students  Toward  the  Classroom  Computer.  Ulrike  B.  Blair,  University  of  Dayton; 
Barbara  M . De  Luca,  University  of  Dayton 

Learning  Strategies  for  Coping  with  Computer  Technology  in  a Distance  Learning  Environment.  Nancy  G.  Saunders,  Ball  State 
University 

Technological  Stumbling  Blocks  for  Schools:  Readiness,  Revenue,  and  Integration.  Brad  E.  Oliver,  Ball  State  University ; Jay  C. 
Thompson,  Jr.,  Ball  State  University 


T.1030.CII 


Division  E Business  Meeting 

Division  E:  Counseling  and  Human  Development  — Meeting 
Thursday,  10:30am  to  11:50am  — Columbian  House 
SR.  D1V  CHAIR  E.  Gabriella  Caldwell-Millcr , Illinois  State  University 
JR.  DIV  CHAIR  Eddie  E.  Glenn , Illinois  State  University' 
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New  Trends  in  Administrator  Preparation  Programs 

Division  A:  Administration  — Paper  Presentation 
Thursday,  10:30am  to  1 1 :50am  — Lake  House 
CHAIR  Roger  V.  Bennett , Southwest  Missouri  State  University 

PRESENTATIONS 

A Collaborative  Model  Between  University  and  Practicing  Administrators  to  Create  a Geographically-Based  Administrative 
Preparation  Program.  Robert  A.  Ludwig,  Bowling  Green  State  University ; Marcia  Salazar-Valentine,  Bowling  Green  State 
University ; Eugene  T.  Sanders,  Bowling  Green  State  University 

Benefits  and  Shortcomings  of  Entry-Level  Administrator  Mentoring  Programs:  The  First-Year  Principal’s  Perspective.  George  B. 
Simon  11,  Bethel  Local  School 

Developing  Emotional  Intelligence:  A Key  Component  in  the  Preparation  of  Aspiring  Administrators.  Charles  Manges,  Texas 
A&M  University  at  Corpus  Christi 

Field-Based  Principal  Preparation  Program:  An  Ongoing  Study  of  Its  Effectiveness.  Randall  L.  Turk , Wichita  State  University 

Division  F Business  Meeting 

Division  F:  History  and  Historiography  — Meeting 
Thursday,  10:30am  to  1 1 :50am  — Mansion  House 
SR.  DIV  CHAIR  Beth  Johnson,  Eastern  Michigan  University 
JR.  DIV  CHAIR  Louise  E.  Fleming,  Ashland  University 

Field  Experience  Sites 

Division  K:  Teaching  and  Teacher  Education  — Paper  Presentation 
Thursday,  1 0:30am  to  1 1:50am  — Steamboat  Hotel 
CHAIR  Carole  Newman,  University  of  Akron 

DISCUSSANT  Carole  Newman,  University  of  Akron 
PRESENTATIONS 

A Comparison  of  Two  Dichotomous  Field  Experience  Sites:  Perspectives  of  a Pre-Service  Teacher.  Joe  D . Nichols,  Indiana 
University  - Purdue  Univ  at  Fort  Wayne;  Shelley  A.  Sorg,  Indiana/Purdue  University 
Comparison  of  Field  Experiences  in  India  and  the  U.S..  Hema  Ramanathan,  Butler  University 
Profile  of  a Successful!  PDS.  Rick  A,  Breault,  University  of  Indianapolis 

Follow-up  Discussion  from  the  Keynote  Address 

MWERA  — Invited  Address 
Thursday,  10:30am  to  1 1 :50am  — Shakespeare  Hotel 
PRESENTATIONS 

Follow-up  Discussion  to  the  Keynote  Address:  "Western  Governors  University:  New  Challenges,  New'  Technologies,  New 
University".  Robert  C.  Albrecht,  Western  Governors  University 

Preparing  Teachers  to  use  Contextual  Teaching  and  Learning  Strategies 

Division  K:  Teaching  and  Teacher  Education  — Symposium 
Thursday,  1 0:30am  to  1 1 :50am  — Western  Stage  House 
CHAIR  Jean  W.  Pierce,  Northern  Illinois  University 

PRESENTATIONS 

Contextual  Teacher  Preparation  at  Alvemo  College.  Maty  Diez,  Alverno  College 

Learning  Society  Guidelines  for  Teacher  Preparation  and  Contextual  Teaching:  Do  They  Match?  Sandra  Gibbs,  National  Council 
of  Teachers  of  English 

Problem  Based  Learning  as  an  Attribute  of  Contextual  Teaching  and  Learning.  Jean  W.  Pierce,  Northern  Illinois  University 
Self  Regulation  and  Metacognition  as  Attributes  of  Contextual  Teaching  and  Learning.  John  Borkowski,  University  of  Notre 
Dame 

The  Role  of  Context  in  the  Preparation  of  Teachers  - Messages  from  Cognitive  Research.  Ralph  Putnam,  Michigan  State 
University 

MWERA  Association  Council  Meeting 

MWERA  — - Meeting 

Thursday,  12:00pm  to  1:30pm  — Sauganash  Ballroom  East 
PRESIDENT  Kim  K.  Metcalf  Indiana  University 

NOTES  All  Mid - Western  Educational  Research  Association  Council  Members  and  Officers  should  attend . Luncheon  will  be 

served . 
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School  Violence  and  Adolescent  Suicide 

Division  A:  Administration  — Symposium 
Thursday,  1:40pm  to  3:00pm  — American  House 
CHAIR  Barbara  N.  Martin , Southwest  Missouri  State  University 

PRESENTATION 

School  Violence  and  Adolescent  Suicide:  A Discussion  About  Their  Reduction  in  Schools.  Kathryne  M.  Speaker , College  of  New 
Jersey ; Roger  V.  Bennett,  Southwest  Missouri  State  University *;  George  J.  Petersen,  Southwest  Missouri  State  University ; 
Jane  Wolfle,  Bowling  Green  State  University 

Teacher  Training 

Division  K:  Teaching  and  Teacher  Education  — Paper  Presentation 
Thursday,  1:40pm  to  3:00pm  — The  Bull's  Head 
CHAIR  Dan  Raisch , University  of  Dayton 

DISCUSSANT  Dan  Raisch , University > of  Dayton 
PRESENTATIONS 

A Comparison  of  Contextual  Teacher  Preparation  Student  Teachers  with  Traditionally  Prepared  Student  Teachers.  Nadine  M. 
Killmer,  Iowa  State  University ; Kathy  R.  Connor,  Iowa  State  University 

A Study  of  Four  Model  Urban  Early  Childhood  Programs:  Implications  for  Teacher  Training.  Lenore  P.  Wineherg,  University  of 
Wisconsin  - Oshkosh 

The  State  of  Public  Education  in  the  United  States:  Teacher  Education  Students'  Perspectives.  Larry » D.  Cross,  Governors  Stare 
University: ; Kathleen  Giuntoli,  Governors  State  University ; Glenna  L.  Howell,  Governors  State  University ; Elizabeth  J. 
Johnson,  Governors  State  University >;  Karen  M.  Peterson,  Governors  State  University 

Methods  in  Educational  History  Research 

Division  F:  History  and  Historiography  — Paper  Presentation 
Thursday,  1 :40pm  to  3:00pm  — Columbian  House 
CHAIR  Doug  A,  Feldman  n,  Indiana  University 

PRESENTATIONS 

Application  of  Oral  History  Methods  to  Recover  Informal  Policy  Implementation.  Lee  S,  Duemer . The  University'  of  Iowa 

Figures  of  Speech  as  a Tool  for  Constructing  Educational  History.  Dawn  Clark ; Beth  Johnson,  Eastern  Michigan  University 

Using  Autobiography  to  Promote  Reflective  Thinking.  Louise  E.  Fleming,  Ashland  University 


NOTES 


Should  Administrators  be  ’Virtually’  Prepared?  Developments  in  Educational 
Administration 

Division  A:  Administration;  ICPEA  — Symposium 
Thursday,  1 :40pm  to  3:00pm  — Lake  House 

Special  session  sponsored  by  the  Illinois  Council  of  Professors  of  Educational  Adminstration. 


Division  B Business  Meeting 

Division  B:  Curriculum  Studies  — Meeting 
Thursday,  l :40pm  to  3:00pm  — Mansion  House 
SR.  DIV  CHAIR  James  H.  Powell , Ball  State  University 
JR.  DIV  CHAIR  Jay  C.  Thompson,  Jr Ball  State  University 


Engaging  the  Learner:  Technology  in  Postsecondary  Education 

Division  J:  Postsccondary  Education  — Paper  Presentation 
Thursday,  1 :40pm  to  3:00pm  — Steamboat  Hotel 
CHAIR  Rodney  Greer , Western  Illinois  University 

DISCUSSANT  Margaret  A.  Simpson , Northwestern  University  Medical  School 
PRESENTATIONS 

Assessing  the  Classroom  Environment  of  the  Virtual  Classroom.  Susan  M.  Powers,  Indiana  State  University;  Michaelecn  Davis, 
Indiana  State  University ; Eileen  Torrence,  Indiana  State  University 
Postsecondary  Giftedness,  Learning  Disabilities  and  the  Engaged  Learning  Model.  Tom  J . Cody,  Western  Illinois  University : 
Jacqueline  C.  Rickman,  Western  Illinois  University 
Students1  Perspectives  in  a VVeb-Bascd  Distance  Education  Course.  Noriko  Hum,  Indiana  University 
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A Strategic  Program  to  Build  Character  and  Self-Esteem  Among  Urban  Adolescents 

Division  E:  Counseling  and  Human  Development  — Invited  Address 
Thursday,  1:40pm  to  3:00pm  — Shakespeare  Hotel 
CHAIR  Eddie  E.  Glenn , Illinois  State  University 

PRESENTATION 

A Strategic  Program  to  Build  Character  and  Self-Esteem  Among  Urban  Adolescents.  Othello  Poulard,  Center  for  Community 
Change 

Mentoring 

Division  K:  Teaching  and  Teacher  Education  — Symposium 
Thursday,  1:40pm  to  3:00pm  — Western  Stage  House 
CHAIR  Marcia  Sheridan , Indiana  University  - South  Bend 

PRESENTATION 

Critical  Issues  in  Mentoring  and  Mentoring  Programs  for  Teachers.  Tom  Ganser,  University  of  Wisconsin  - Whitewater:  Deborah 
L.  Bainer , The  Ohio  State  University  - Mansfield ; Mary  Bendixen-Noe,  The  Ohio  State  University  - Newark ; Barbara  L. 
Brock,  Creighton  University ; Carmen  Giebelhaus,  Ohio  Department  of  Education ; Charles  Kent  Runyon , Pittsburg  (Kansas) 
State  University:  Anne  D' Antonio  Stinson,  University  of  Wisconsin  - Whitewater 


CHAIR 

NOTES 


Creating,  Training,  and  Sustaining  a Mentor  Teacher  Program 

Division  K:  Teaching  and  Teacher  Education  — Workshop 
Thursday,  3:10pm  to  5:30pm  — The  Bull's  Head 
Janet  T Bercik , Northeastern  Illinois  University 

Maximum  Enrollment:  40;  Fee:  $10.00;  Pre-registration  required,  on-site  registration  only  if  space  available. 


Illinois  Council  of  Professors  of  Educational  Administration  Business  Meeting 

Division  A:  Administration;  ICPEA  — Meeting 
Thursday,  3:10pm  to  4:00pm  — Lake  House 


TABLE 

TABLE 

TABLE 

TABLE 

TABLE 

TABLE 

TABLE 

TABLE 

TABLE 

TABLE 

TABLE 

TABLE 

TABLE 

TABLE 


Roundtable  Discussion/Poster  Session  #1 

MWERA  — Roundtable  Discussion/Poster 

Thursday,  3: 1 0pm  to  4:00pm  — Sauganash  Ballroom  East 

1 * Hot  Topics  Discussion:  Can  Faculty  Evaluations  be  Customized  to  meet  Everyone's  Needs?  Steven  J.  Blatt, 
University  of  Dayton:  Thomas  Pickering.  University  of  Southern  Indiana 

2 * Hot  Topics  Discussion:  How  Can  We  Make  Special  Education  More  Special?  Gloria  Ann  Dye,  Washburn 
University:  Kevin  Davis,  Southeast  Kansas  Education  Service  Center 

3 * Hot  Topics  Discussion:  The  Gender  Question:  How  Can  We  Teach  to  It?  P.  Kay  Duncan,  Emporia  State 
University:  Kathleen  Sparrow,  Akron  Public  Schools 

4 * Hot  Topics  Discussion:  What  Advances  are  Forseen  in  the  21st  Century?  Diana  M.  Hunn , University  of  Dayton: 
Thomas  Andre,  Iowa  State  University 

5 * Hot  Topics  Discussion:  What  will  be  the  Role  of  the  Media  in  Educating  the  Masses  (in  the  2 1 st  Century)?  James 
J.  McCluskev,  Central  Michigan  University:  Susan  M.  Powers,  Indiana  State  University 

6 * Hot  Topics  Discussion:  Will  the  Drop-Out  Rates  Drop  Off  in  the  Future?  Daniel  Lynch , University  of  Wisconsin  - 
Oshkosh:  Judy  Jackson  May,  Bowling  Green  State  University 

7 A Case  Study  of  Adoption,  Diffusion  and  Optimal  Uses  of  Computers  for  Instruction  at  a Small  College.  Alan  C. 
Hucth,  University  of  Dayton 

8 A Program  Evaluation  of  an  HIV/AIDS  Prevent,'  . Outreach  Pilot  Project  in  Havana,  Cuba.  David  E.  Victorson , 
Indiana  University 

9 Are  Differences  Between  Nontraditional  and  Traditional  College  Students  in  Memory  Transfer  Suggesting 
Classroom  Segregation?  Paul  D.  Shuler.  Oklahoma  State  University 

10  At-risk  Students  Learn  Facts  though  Higher-Order  Instruction:  An  Oxymoron.  Sandra  Gee,  DuPage  County  (IL) 
Regional  Office  of  Education:  Matt  DiCintio,  Elmhurst  College 

1 1 Attitudes  Toward  Learning  Community  Courses.  Albert  M.  Bugaj,  University  of  Wisconsin  - Marinette 

12  Forgiveness  Education  and  the  Psychological  Well-Being  of  Clergy.  Preston  C.  Fan  Loon 

13  lie  Said  She  Said:  Reflections  on  a Team  Teaching  Experience.  Gary  T.  Daytncr,  Indiana  University ; Rhonda 
Meyer , Indiana  University- Bloomington 

14  High  Stakes  for  UnRcliable  Assessments?  Marta  J . Coleman,  Gunnison  High  School  and  Western  State  College: 
Jennifer  J,  Eager,  Western  Michigan  University 
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TABLE  15 

TABLE  16 
TABLE  17 

TABLE  18 


TABLE  19 
TABLE  20 


Improving  Attending  Physicians1  Teaching  Skills  Through  Clinical  Supen/ision.  Elizabeth  A.  Wilkins-Canter,  Rush 
University 

Perry:  Fact,  Fiction,  and  Outcomes  Assessment.  Gordon  P.  Brooks , Ohio  University 

Protocol  Materials:  Passing  Fad  or  an  Idea  Whose  Time  Has  Finally  Come?  Linda  M.  Holloway,  Indiana  University 
Judith  Longfield,  Indiana  University 

Diversity  in  Higher  Education:  A Review  of  the  Literature  Focusing  Upon  Administrators.  Ernest  E.  Gibson, 
Governors  State  University ; Burton  A.  Collins,  Governors  State  University ; Larry'  D.  Cross.  Governors  State 
University >\  David  E.  Suddick,  Governors  State  University 

Teaching  Preservice  Educators  About  Paraeducators.  Mary  E . Drechtrah,  University  of  Wisconsin  - Oshkosh 
The  Development  of  a Rating  Scale:  Documentation  and  Nongraded,  Multiage  Programs.  Richele  O'Connor . 
Wright  State  University 


Ways  to  Enhance  Students1  Self-Concepts 

Division  E:  Counseling  and  Human  Development  — Symposium 
Thursday,  4: 1 0pm  to  5:30pm  — American  House 
CHAIR  Eddie  E.  Glenn , Illinois  State  University 

PRESENTATION 

Ways  to  Enhance  Students'  Self-Concepts.  Thomas  S.  Parish.  Kansas  State  University : Donald  A.  Boyd,  Special  Educational 
Resource  Center,  Joycelyn  G.  Parish,  Orkand  Corporation 

Mid-Western  Educational  Researcher  Editorial  Board  Meeting 

MWERA  — Meeting 

Thursday,  4:10pm  to  5:30pm  — Columbian  House 
NOTES  All  Mid-Western  Educational  Researcher  Editorial  Board  Members  should  attend. 

Mid-Western  Educational  Researcher  Editorial  Board.  Deborah  L . Bainer,  The  Ohio  State  University  - Mansfield ; Thomas  Andre, 
Iowa  State  University: ; Josue  Cruz,  University  of  South  Florida ; Charlene  Czerniak,  The  University  of  Toledo:  Maty  Ann 
Flowers’,  Tom  Ganser,  University  of  Wisconsin  - Whitewater,  Kenneth  A.  Kiewra,  University  of  Nebraska  - Lincoln',  Gene  A. 
Kramer,  American  Dental  Association’,  Sharon  L.  McNeelv,  Northeastern  Illinois  University ; Isadore  Newman,  University  of 
Akron ; A.  William  Place,  University  of  Dayton:  Richard  M . Smith,  Rehabilitation  Foundation  Inez,  Joan  T.  Timm,  University 
of  Wisconsin  - Oshkosh ; Benjamin  Wright,  University  of  Chicago 

Response  to  the  Virtual  University:  What  are  Traditional  Institutions  to  Do? 

Division  A:  Administration;  ICPEA  — Symposium 
Thursday,  4:10pm  to  5:30pm  — Lake  House 
CHAIR  Brad  Colwell , Southern  Illinois  University 

NOTES  Special  session  sponsored  by  the  Illinois  Council  of  Professors  of  Educational  Adminstration. 

PRESENTATION 

Response  to  the  Virtual  University.  Brad  Colwell.  Southern  Illinois  University : Dianne  Ashby,  Illinois  State  University:  Jeffrey  B. 
Hecht,  Illinois  State  University:  Patricia  H.  Klass,  Illinois  State  University:  Cynthia  Waltershausen,  Western  Illinois 
University 

Division  J Business  Meeting 

Division  J:  Postsecondary  Education  — Meeting 
Thursday,  4:10pm  to  5:30pm  — Mansion  M'*.vse 
SR.  DIV  CHAIR  Margaret  A.  Simpson , Northwestern  University  Medical  School 
JR.  DIV  CHAIR  Tom  J . Cody,  Western  Illinois  University 


Perspectives  on  Supervision 

Division  A:  Administration  — Paper  Presentation 
Thursday,  4:10pm  to  5:30pm  — Steamboat  Hotel 
CHAIR  George  J.  Petersen,  Southwest  Missouri  State  University 

PRESENTATIONS 

New  Teacher  Induction.  Gan'  W.  Robinson,  Ball  State  University 

Selected  Methods  for  Making  Continuous  Improvement  a Reality.  Douglas  J.  Coutts,  Indiana  Purdue  University  - Fort  Wayne 
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Policy  Issues:  What  is  Driving  Education  in  the  '90s 

Division  A:  Administration  — Paper  Presentation 
Thursday,  4: 10pm  to  5:30pm  — Shakespeare  Hotel 
CHAIR  Brian  R.  Hinrichs,  Illinois  State  University 

PRESENTATIONS 

Decision  Making  in  the  Urbana  Public  Schools.  Nicole  K . Roberts,  University  of  Illinois 

Revisiting  School  District  Demographics  As  Predictors  of  School  Achievement.  Rich  Hofmann , Miami  University 
The  Establishment  Clause  and  Education:  Has  the  Rhenquist  Court  Sounded  the  Death  Knell?  Elizabeth  T.  Lugg , Illinois  State 
University ; R.  Andrew  Lugg , Illinois  State  University 

The  Notion  Of  School  Community  And  What  It  Means  For  Education.  Larry  McNeal,  Illinois  State  University 

First-Year  Teaching 

Division  K:  Teaching  and  Teacher  Education  — Paper  Presentation 
Thursday,  4: 10pm  to  5:30pm  — Western  Stage  House 
CHAIR  Hema  Ramanathan . Butler  University 

PRESENTATIONS 

A Seven-Year  Multivariate  Longitudinal  Study  of  the  Development  of  Teachers'  Anxiety  about  Teaching  through  Preparation  and 
Early  Teaching  Years.  Ronald  N.  Marso,  Bowling  Green  State  University,  Fred  L.  Pigge,  Bowling  Green  State  University 
First  Year  Teachers:  Strangers  in  Strange  Lands.  Edward  L.  Corley,  Miami  University 

Cracker  Barrel  Social 

MWERA  — Social 

Thursday,  5:30pm  to  7:00pm  — Wolf  Point  Prefunction  Room 
HOST  Kim  K.  Metcalf  Indiana  University 

NOTES  A lite  fare  get  together  for  all  MWERA-98  attendees . Everyone  is  welcome  to  attend! 

Division  K Business  Meeting 

Division  K:  Teaching  and  Teacher  Education  — Meeting 
Thursday,  6:00pm  to  7:00pm  - — Merchants  Hotel 
SR.  D1V  CHAIR  Connie  L . Bowman , University  of  Dayton 
■R.  DIV  CHAIR  Maria  Elena  Galvez-Martin,  The  Ohio  State  University  at  Lima 


A €:30pm  - 7^30pm 
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Chronological  Listing  of  Sessions 

Friday,  October  ±&,  ±j)J)2 

Reorganizing  the  Curriculum 

Division  B:  Curriculum  Studies  — Paper  Presentation 
Friday,  8:00am  to  9:20am  — American  House 
CHAIR  Nancy  G.  Saunders , Ball  State  University 

DISCUSSANT  Laurie  Thomas , Ball  State  University 
PRESENTATIONS 

Developing  and  Teaching  Interdisciplinary  Curricula:  Preparing  Preservice  Teachers  for  Multicultural  Middle  Schools.  Rose 
Mary  Scott,  University  of  Wisconsin  - Parkside 

Re-Examination  of  Classroom  Rules.  Bobby  G.  Malone,  Ball  State  University ; Chetyl  L.  Tietjens,  Ball  State  University 

Sequencing  in  Literature  Instruction.  Guoping  Ma,  Department  of  Instructional  Systems  Technology \ In 

Educational  Reform:  Urban  Education,  Teacher  Development  and  Effectiveness,  and 

Organizational  Theory 

Division  H:  School  Evaluation  and  Program  Development  — Paper  Presentation 
Friday,  8:00am  to  9:20am  — The  Bull’s  Head 
CHAIR  I sadore  Newman,  University  of  Akron 

DISCUSSANT  Sharon  A.  Valente , Ashland  University 
PRESENTATIONS 

Examining  Systemic  Educational  Reform  in  Ohio  from  Diverse  Perspectives:  Ramifications  for  State-Wide  Reform  of  Public 
Education.  William  E.  Loadman,  The  Ohio  State  University ; LeAnn  Derby,  The  Ohio  State  University ; Francine  E.  Michel, 
The  Ohio  State  University ; Joyce  C.  Miller,  The  Ohio  State  University ; Anna  Marie  M.  Thomas,  The  Ohio  State  University 

Teachers  and  Principals  Respond:  School  Staff  Perceptions  about  Ohio’s  Venture  Capital  Restructuring  Effort.  Anna  Marie  M. 
Thomas,  The  Ohio  State  University 

Using  Locally  Developed  Indicators  of  Success  to  Drive  School  Reform.  Joyce  C.  Miller,  The  Ohio  State  University: ; LeAnn 
Derby,  The  Ohio  State  University •;  Francine  E.  Michel,  The  Ohio  State  University ; Anna  Marie  M.  Thomas,  The  Ohio  State 
University 


Constructing  and  Analyzing  Ordered  Response  Survey  Data 

Division  I:  Education  in  the  Professions  — Alternative  Format 
Friday,  8:00am  to  9:20am  — Columbian  House 

CHAIR  Gene  A.  Kramer , American  Dental  Association 

NOTES  The  objective  of  this  alternative  session  is  to  provide  graduate  students  and  junior  faculty  with  an  opportunity ’ to 

develop  skills  in  designing  and  analyzing  ordered  response  survey/questionnaire  instruments.  The  session  will  be 
based  on  the  Rasch  rating  scale  model  as  an  analytic  tool  and  the  design  implications  that  this  tool  necessitates . 
The  importance  of  theoretical  models  of  the  underlying  construct  in  item  design  will  demonstrated.  The  format  of 
this  session  will  be  ir  tructional  in  nature . The  presenters  will  discuss  the  theory  related  to  the  design  and  analysis 
of  survey  data  and  use  a common  example  to  illustrate  the  important  points.  This  example  is  based  on  a 78  item 
questionnaire  that  u-as  designed  to  measure  the  health  of  elementary'  school  partnerships.  Each  presenter  will  have 
30  minutes  to  present  each  topic.  Following  each  topic  there  will  be  time  for  a discussion  of  the  topic  by  the 
participants. 

PRESENTATIONS 

Constructing  and  Analyzing  Ordered  Response  Survey  Data.  Richard  M.  Smith,  Rehabilitation  Foundation  Inc.:  Deborah  L. 

Bainer,  The  Ohio  State  University  - Mansfield 


I .ONOO.l. II 


Division  G Business  Meeting 


Division  G:  Social  Context  of  Education  — Meeting 
Friday,  8:00am  to  9:20am  — Lake  House 
SR.  DIV  CHAIR  Mary  Ann  Wham,  University  of  Wisconsin  - Whitewater 
JR.  DIV  CHAIR  Susan  J.  Lenski,  Illinois  State  University 
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Division  C Business  Meeting 

Division  C:  Learning  and  Instruction  — Meeting 
Friday,  8:00am  to  9:20am  — Mansion  House 
SR.  D1V  CHAIR  M Cecil  Smith , Northern  Illinois  University 
JR.  DIV  CHAIR  Thomas  L.  Pourchot , Northern  Illinois  University 


F.OXOO.SB 


This,  Too,  Shall  Pass:  A Symposium  for  Doctoral  Students 

Division  A:  Administration  — Symposium 
Friday,  8:00am  to  9:20am  — Steamboat  Hotel 
CHAIR  Thomas  Oldenski,  University  of  Dayton 

PRESENTATION 

Coping  Strategies  for  Doctoral  Students.  Kaetlyn  Lad,  Texas  A&M  University  at  Corpus  Christi\  George  J.  Petersen,  Southwest 
Missouri  State  University ; William  L.  Sharp,  Southern  Illinois  University  at  Carbondale\  James  K.  Walter , Texas  A&M 
University  at  Corpus  Christi 


F.0X00.SP 


Student  Teaching 

Division  K:  Teaching  and  Teacher  Education  — Paper  Presentation 
Friday,  8:00am  to  9:20am  — Shakespeare  Hotel 
CHAIR  James  A.  Salzman , Ursuline  College 

DISCUSSANT  James  A . Salzman , Ursuline  College 
PRESENTATIONS 

A Comparison  of  Special  Education  Student  Teaching  Handbooks  With  CEC  Standards  for  Practicum  Experiences.  Daryl  J. 

Wilcox,  Wayne  State  College ; Stanley  E.  Wigle,  University  of  Tennessee  - Martin 
Student  Teaching:  How  Stressful  Is  It?  Elizabeth  A,  Wilkins-Canter,  Rush  University ; Audrey  T.  Edwards , Eastern  Illinois 

University ; Kenny  O.  McDougle,  Pittsburg  State  University ; Hema  Ramanathan , Butler  University,  Alice  Young,  Morehead 
State  University 


F.OXOO.WS 


Action  Research 

Division  K:  Teaching  and  Teacher  Education  — Symposium 
Friday,  8:00am  to  9:20am  — Western  Stage  House 
CHAIR  Jennifer  J.  Pager,  Western  Michigan  University 

PRESENTATION 

Action  Research  in  Undergraduate  Teacher  Education:  A Professional  Disposition.  Jennifer  J.  Fager,  Western  Michigan 
University ; Allison  J . Young,  Western  Michigan  University 


F.0930.SE 


Business  Meeting 

MWERA  — Meeting 

Friday,  9:30am  to  10:20am  — Sauganash  Ballroom  East 
PRESIDENT  Kim  K . Metcalf  Indiana  University 


F.  1030.  AH 


Promising  Research  in  Elementary  Education 

Division  C:  Learning  and  Instruction  — Paper  Presentation 
Friday,  10:30am  to  I 1 :50am  — American  House 
CHAIR  Mary  Ann  Wham , University  of  Wisconsin  - Whitewater 

DISCUSSANT  Pamela  R.  Clinkenbeard , University  of  Wisconsin  - Whitewater 
PRESENTATIONS 

Assessment  Practices  of  Elementary  Teachers.  Leah  D.  Adams.  Eastern  Michigan  University ; Bess  Kypros,  Madonna  University ; 
Shannon  McNair,  Oakland  University 

is  There  Anything  But  a Problem?  Classroom  Research  in  Middle  School  Problem-Based  Learning.  Sara  M.  Sage,  Indiana 
University  South  Bend : Michele  Micetich,  Illinois  Mathematics  and  Science  Academy:  Louise  Robb,  Barrington  Middle 
School 

Parent  Perspectives  on  the  Roles  of  Teacher  and  Student  in  the  Elementary  Classroom.  Marianne  M.  Hawks,  Indiana  University 
Results  of  Using  Writing  Tasks  to  Enhance  Fourth-Grade  Children’s  Acquisition  of  Fraction  Knowledge.  Janet  M.  Sharp , Iowa 
State  University 
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Evaluation  of  the  Cleveland  Choice  Program 

Division  H:  School  Evaluation  and  Program  Development  — Symposium 
Friday,  10:30am  to  1 1 :50am  — The  Bull's  Head 
CHAIR  Kim  Metcalf, \ Indiana  University 

PRESENTATIONS 

Evaluation  of  the  Cleveland  Choice  Program:  Lessons  for  Educational  Policy  and  Evaluation.  Kim  K.  Metcalf  Indiana 
University ; William  Boone,  Indiana  University ; Todd  L.  Chilton , Indiana  University ; Patty  Muller,  Indiana  University ; 
Francis  Rogers,  Ohio  Department  of  Education 


l\  1030. Cl  I 


Division  D Business  Meeting 

Division  D:  Measurement  and  Research  Methodology  - 
Friday,  10:30am  to  1 1:50am  — Columbian  House 
SR.  DIV  CHAIR  James  J.  McCluskey , Central  Michigan  University ' 
JR.  DIV  CHAIR  Larry  Henriksen , Ball  State  University 


Meeting 


r.  1030.1. 1 1 


Educating  Asian-American  Students:  Trends  and  Issues 

Division  E:  Counseling  and  Human  Development  — Invited  Address 
Friday,  10:30am  to  1 1:50am  — Lake  House 
CHAIR  Eddie  E.  Glenn , Illinois  State  University 

PRESENTATION 

Educating  Asian-American  Students:  Trends  and  Issues.  Ming-Gon  John  Lian,  Illinois  State  University 1 


F.  1030.  VI A 


Division  A Business  Meeting 

Division  A:  Administration  — Meeting 
Friday,  10:30am  to  1 1 :50am  — Mansion  House 
SR.  DIV  CHAIR  James  K.  Walter , Texas  A&M  University  at  Corpus  Christi 
JR.  DIV  CHAIR  Larry  Me  Neal,  Illinois  State  University 


F.1030.SB 


Teacher  Knowledge 

Division  K:  Teaching  and  Teacher  Education  — Paper  Presentation 
Friday,  10:30am  to  1 1 :50am  — Steamboat  Hotel 
CHAIR  Marcia  M.  Ferreira , Wayne  State  University » 

DISCUSSANT  Doug  A.  Feldmann , Indiana  University 
PRESENTATIONS 

Characteristics  of  Constructivist  Teachers.  Susan  J.  Lenski,  Illinois  State  University,  Mary*  Ann  Wham,  University  of  Wisconsin  - 
Whitewater 

Teacher-Researchers:  One  Year  Later.  James  A.  Salzman,  Ursuline  College ; Donna  Snodgrass,  South  Euclid/Lyndhurst  Schools 
Toward  a Professional  Discourse  Community.  Robert  S.  Burroughs,  University  of  Cincinnati ; Martha  Hendricks-Lee,  University 
of  Cincinnati,  Tammy  Roe,  University  of  Cincinnati 


F.1030.SP 


Career  Paths:  Navigating  the  Quagmire 

Division  J:  Postsecondary  Education  — Paper  Presentation 
Friday,  10:30am  to  1 1:50am  — Shakespeare  Hotel 
CHAIR  Charles  Kline , Purdue  University* 

DISCUSSANT  Tom  J,  Cody , Western  Illinois  University 
PRESENTATIONS 

Classroom  Assessment  in  Postsecondary  Education.  Susan  M . Brookhart,  Duquesne  University' 

The  Influence  of  a Senior  Faculty  and  Junior  Faculty  Mentoring  Program  on  Teaching.  Michael  J . Siegel  Indiana  University: 
John  Hayek,  Indiana  University * 

Writing  Support  Group:  An  Avenue  to  Seeking  Promotion  and  Tenure  Shauna  M.  Adams,  University  of  Dayton:  Connie  L. 
Bowman , University  of  Dayton:  Laurice  Joseph,  University  of  Dayton:  Katie  Kinnucan-Welsch,  University  of  Dayton:  Maty 
Ellen  Seen \ Univesity  of  Dayton 
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Problem-Based  Learning 

Division  K:  Teaching  and  Teacher  Education  — Symposium 

Friday,  10:30am  to  1 1:50am  — Western  Stage  House 
CHAIR  Dennis  J ’.  Kirchen , Dominican  University 

PRESENTATION 

Problem-Based  Learning:  Recommendations  from  Research  in  Diverse  Domains.  Jean  W.  Pierce,  Northern  Illinois  University ; ' 
Jolie  Burns,  Northern  Illinois  University ; Kenneth  Eineke,  Northern  Illinois  University ; Janet  Pariza,  Northern  Illinois 
University ; Brunnehilde  Rapoo,  Northern  Illinois  University 

Luncheon  Address  ........  _ 

MWERA  — Invited  Address 

Friday,  12:00pm  to  1:30pm  — Sauganash  Ballroom  West 
CHAIR  Jeffrey  B , Hecht , Illinois  State  University 

NOTES  Luncheon  registration  and  ticket  required  for  entrance. 

PRESENTATION 

The  Academic  Career  in  the  21st  Century:  New  Options  for  Faculty. 

Judith  M.  Gappa,  Purdue  University 

The  academic  career  in  the  later  20lh  and  early  2 1 sl  century  is  changing,  in  response  to  both 
internal  and  external  pressures.  The  decentralization  of  colleges  and  universities,  changing 
workloads,  and  issues  surrounding  achieving  balance  in  personal  and  professional  lives  are 
making  the  professorate  a much  different  occupation  that  it  once  was.  One  of  the  most 
notable  changes  has  been  that  today  less  than  50%  of  faculty  occupy  tenure-track  positions 
(with  26%  of  all  full-time  faculty  occupying  non-tenurable  positions).  Judith  Gappa  will 
investigate  these  pressures,  and  how  universities  are  responding  to  them  with  both 
modifications  to  the  traditional  system  of  tenure  and  outright  alternatives  to  tenure,  in  her 
Luncheon  Address  and  Follow-Up  Discussion.  She  will  discuss  stopping  the  clock,  post- 
tenure review,  and  retirement  incentive  plans  that  are  affecting  tenure-track  faculty.  Gappa 
will  also  present  other  models  of  full-time  non-tenurable  appointment,  and  the  features  of 
these  alternative  employment  arrangements  that  might  make  them  viable  career  options  for 
many  people.  Faculty  at  all  stages  of  their  careers,  including  graduate  students  and  new 
career  faculty,  will  want  to  attend  to  consider  the  changing  nature  of  the  profession  and 
hear  Gappa’s  predictions  for  the  next  decade  (and  beyond)  in  higher  education. 

Judith  M.  Gappa  is  a Professor  of  Educational  Administration  at  Purdue  University.  She  is  a graduate  of  the  Institute  for  Educational 
Management  of  Harvard  University,  after  earning  an  Ed.D.  in  Educational  Administration  from  Utah  State  University.  Gappa  spent  two 
years  as  a Senior  Associate  in  the  Washington,  D.C.  office  of  American  Association  of  Higher  Education  conducting  research  on  a variety 
of  topics  including  changing  faculty  roles  and  responsibilities.  Prior  to  that  she  served  as  an  Affirmative  Action/Equal  Opportunity 
Programs  Director  at  Utah  State  University  and  an  Associate  Vice  President  for  Faculty  Affairs  at  San  Francisco  State  University.  She 
is  the  author  of  over  28  books,  monographs,  articles,  and  research  reports;  is  a member  of  several  editorial  boards  and  higher  education 
associates,  and  a frequent  presenter  and  speaker  at  local,  state,  and  national  meetings. 


CHAIR 

NOTES 


Tricks  of  the  Teaching  Statistics  Trade 

Division  D:  Measurement  and  Research  Methodology  — Workshop 
Friday,  1 :40pm  to  4:00pm  — American  House 

Dennis  W.  Leitner ; Southern  Illinois  University  at  Carbondale 

Maximum  Enrollment:  30:  Fee:  $10*00:  Pre-registration  required . on-site  registration  only  if  space  available . 


Examining  Technology  Uses  in  Schools 

Division  C:  Learning  and  Instruction  — Paper  Presentation 
Friday,  1:40pm  to  3:00pm  — The  Bull’s  Head 
CHAIR  Jay  R.  Price , University  of  Wisconsin  - Stevens  Point 

DISCUSSANT  Margaret  Bailey , Northern  Illinois  University 
PRESENTATIONS 

Big  is  Better:  Multimedia  in  Kindergarten.  James  W.  Reincke,  Winona  State  University 

Problems,  Prospects,  and  Possibilities  for  Literacy  Education  and  the  Internet.  Doug  A.  Feldmann , Indiana  University 
The  "It  Won’t  Let  Me"  Phenomenon:  An  Ethnomethodological  Study  of  Students  Blaming  Computers.  Ld/ie.s.™  P.  Dennen, 
Indiana  University 
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A View  of  the  Modern  Superintendency:  Success  or  Failure 

Division  A:  Administration  — Paper  Presentation 
Friday,  1 :40pm  to  3:00pm  — Columbian  House 
CHAIR  Kaetlyn  Lad , Texas  A&M  University » at  Corpus  Christi 

PRESENTATIONS 

A Three  State  Examination  of  School  Board  Evaluation  of  Superintendents:  Assessment  or  Assassination.  James  K.  Walter , Texas 
A& M University > at  Corpus  Christi ; George  J.  Petersen,  Southwest  Missouri  State  University »;  William  L.  Sharp,  Southern 
Illinois  University  at  Carbondale 

Perceived  Effects  of  Living  in  the  School  District  Where  One  is  Superintendent.  Norman  L.  Sommers , Ashland  University ;; 

George  Bowdouris,  Ashland  University 

Perceptions  of  School  Superintendents  on  Their  Own  Success.  William  L.  Sharp,  Southern  Illinois  University'  at  Carbondale ; 
James  K.  Walter,  Texas  A&M  University ' at  Corpus  Christi 

Superintendent  Experiences  Using  Construction  Management  in  Indiana.  Theodore  J.  Kowalski,  Ball  State  University',  John  T. 
Coopman,  Eastbrook  Community  Schools 


F.  1340.LH 


Follow-up  Discussion  from  the  Luncheon  Address 

MWERA  — Invited  Address 
Friday,  1 :40pm  to  3:00pm  — Lake  House 
PRESENTATION 

Follow-up  Discussion  to  the  Luncheon  Address:  ’The  Academic  Career  in  the  21st  Century:  New  Options  for  Faculty'1.  Judith  M. 
Gappa,  Purdue  University 


f.  1 340. Via 


Division  H Business  Meeting 

Division  H:  School  Evaluation  and  Program  Development 
Friday,  1:40pm  to  3:00pm  — Mansion  House 
SR.  DIV  CHAIR  Isadore  Newman , University  of  Akron 
JR.  DIV  CHAIR  John  W.  Fraas , Ashland  University 


Meeting 


F.  1 340.SB 


Leadership  Perspectives 

Division  A:  Administration  — Symposium 
Friday,  1 :40pm  to  3:00pm  — Steamboat  Hotel 
CHAIR  Thomas  S.  Parish,  Kansas  State  University' 

PRESENTATION 

The  Many  Perspective  of  Leadership:  Within  M-WERA  and  Beyond.  Thomas  S.  Parish,  Kansas  State  University ",  Kenneth  A . 
Kiewra,  University'  of  Nebraska  - Lincoln',  Gregoiy  J.  Marchant,  Ball  State  University",  Sharon  L.  McNeely,  Northeastern 
Illinois  University',  Kim  K.  Metcalf  Indiana  University 


F.  I340.SP 


Assessment  of  Cognition  and  Metacognition 

Division  C:  Learning  and  Instruction  — Paper  Presentation 
Friday,  1 :40pm  to  3:00pm  — Shakespeare  Hotel 
CHAIR  Orpha  K.  Duell,  Wichita  State  University 

DISCUSSANT  Thomas  L.  Pourchot,  Northern  Illinois  University 
PRESENTATIONS 

Dynamic  Testing  Across  Ethnic  Groups.  Ronna  F.  Dillon,  Southern  Illinois  University  at  Carbondale 

Education  in  Business:  An  Application  from  MAC  Tools.  Jennifer  A.  Wilson,  The  Ohio  State  University"  William  E.  Loadman, 
The  Ohio  State  University 

Enhancing  Metacognitivc  Skills  Through  Learning  Contracts.  Linda  II.  Chiang,  Anderson  University 

Examining  Epistemological  Beliefs  Across  Domains  With  a Novel  Assessment  Approach.  Marlene  A.  Schommer.  Wichita  State 
Uni  vers  i tv 
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Diversity 

Division  K:  Teaching  and  Teacher  Education  — Paper  Presentation 
Friday,  1 :40pm  to  3:00pm  — Western  Stage  House 
CHAIR  Mary  Bendixen-Noe , The  Ohio  Stale  University  - Newark 

DISCUSSANT  Carol  L Bentley 
PRESENTATIONS 

Preservice  Teachers'  Learning  about  Diversity:  The  Influence  of  Their  Existing  Racial  Attitudes  and  Beliefs.  M.  A , Garmon , 
Western  Michigan  University ; Linda  M Anderson,  Michigan  State  University 
The  Teaching  of  Educational  Psychology:  Comparisons  Across  Student,  Instructor,  and  Course  Variables.  Elizabeth  J.  Johnson, 
Governors  State  University;  Bruce  R,  Ketcher \ Governors  State  University ; Stacy  D.  Saxon,  Loyola  University  Chicago ; 
Penny  Shnay,  Governors  State  University 


F.  I5I0.SE 


Roundtable  Discussion/Poster  Session  #2 

MWERA  — Roundtable  Discussion/Poster 

Friday,  3:10pm  to  4:00pm  — Sauganash  Ballroom  East 


TABLE  1 * Hot  Topics  Discussion:  How  Can  We  Get  Students  Psyched  Up  About  Educational  Psychology?  Daniel  Lap si ey. 

Ball  State  University;  Orpha  K.  Duel!,  Wichita  State  University 

TABLE  2 * Hot  Topics  Discussion:  Is  Elementary  Education  Really  So  Elementary?  Karen  Dutt-Doner,  University  of  New 

England;  Richard  P.  Lipka,  Pittsberg  State  University 

TABLE  3 * Hot  Topics  Discussion:  Who  Isn't  "At-Risk"  of  being  "At-Risk".  Joycelyn  G . Parish,  Orkand  Corporation;  Lisa 

Johnson,  Special  Education  Resource  Center 

TABLE  4 * Hot  Topics  Discussion:  Why  do  Students  do  Better  in  the  Classes  they  Like?  Jimes  R . Necessary;  Beverly 

Klecker,  Eastern  Kentucky  University 

TABLE  5 * Hot  Topics  Discussion:  Will  Kids  ever  Measure  Up  to  our  Expectations?  John  Crawford,  Millard  Public  Schools; 

John  Surber,  University  of  Wisconsin  - Milwaukee 

TABLE  6 * Hot  Topics  Discussion:  Will  the  United  States  ever  be  a Truly  Bilingual  Society?  Sunya  T.  Collier,  Georgia  State 

University;  Socorro  Herrera,  Kansas  State  University 

TABLE  7 Action  Research  and  Its  Impact  on  a Pre-Service  Teacher.  Jay  R . Price , University  of  Wisconsin  - Stevens  Point 

TABLE  8 An  Analysis  and  Description  of  Post-Secondary  Education  Testing  Policies  of  States  Within  the  North  Central 

Association  of  Colleges  and  Schools  Area.  Burton  A.  Collins,  Governors  State  University;  Larry  D.  Cross, 
Governors  State  University;  Ernest  E.  Gibson,  Governors  State  University ; David  E.  Suddick,  Governors  State 
University 

TABLE  9 An  Exploration  of  Traditional  and  Alternative  HIV/AIDS  Prevention  Outreach.  David  E . Victorson,  Indiana 
University;  Thomas  C.  Anderson,  Indiana  University 

TABLE  10  Becoming  a Scientist-Practitioner  of  Peace  Education:  Linking  Theory  and  Practice.  Carrie  L.  Hill , Indiana 
University;  Jonathan  Plucker,  Indiana  University 

TABLE  1 1 Best  Practices  Pertaining  To  Performanced-Based  Salary  Adjustment  Processes.  W.  Dene  E.  Andrews,  Indiana  State 
University 

TABLE  12  Configural  Frequency  Analysis.  Francine  E.  Michel,  The  Ohio  State  University;  Joyce  C Miller,  The  Ohio  State 
University;  Sunanta  Viragoontavan,  The  Ohio  State  University;  Kim  Yonghee,  The  Ohio  State  University 

TABLE  13  Congruence  of  Teacher  and  Administrator  Self-Efficacy  with  Professional  Development  Opportunities.  Scherie  E . 
Lampe,  University  of  Wisconsin  - Oshkosh 

TABLE  14  Developing  Building  Level  Technology  Mentors.  Susan  R . Cramer,  COEHS ; Steve  Rose,  COEHS,  UW  Oshkosh; 
Henry * Winterfeldt,  COEHS,  UW  Oshkosh 

TABLE  1 5 Service  Learning  in  Teacher  and  Counselor  Education:  An  Examination  of  a Collegiate  Tri-Level  Mentoring  Model. 

Thomas  C.  Anderson,  Indiana  University;  Hui  Hui  Chen,  Indiana  University;  Ana  Estevez,  Indiana  University;  Brad 
Hubbard,  Indiana  University;  Polly  Hughes,  Indiana  University 

TABLE  16  Expressing  Their  Lives:  How  College  Students  Learn  to  Make  Art.  Patricia  A.  James,  University  of  Minnesota 

TABLE  17  Formative  Experiments:  A New  Methodology  of  Research.  Susan  J . Lenski,  Illinois  State  University 

TABLE  1 8 New  Program  Choices  in  Teacher  Education:  Student  Perspectives.  Shauna  M.  Adams,  University  of  Dayton;  Susan 
A/.  Ferguson,  University  of  Dayton 

TABLE  19  The  Effects  of  Note-Construction  on  Test-Taking.  Andrew  D.  Katayama,  Southern  Illinois  University  at 

Edwardsvillc;  Steven  M.  Crooks,  Southern  Illinois  University ; Brian  L.  Dowd,  Southern  Illinois  University;  Tammy 
R.  Ramirez,  Southern  Illinois  University 

TABLE  20  The  Relationship  Between  Attachment.  Cognitive  Complexity,  and  Empathy  in  Adulthood.  Todd  L.  Chilton, 

Indiana  University 
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F.  !()]<).  AH 


Factors  in  the  Self-Development  of  Children 


Division  E:  Counseling  and  Human  Development  — Paper  Presentation 
Friday,  4: 1 Opm  to  5:30pm  — American  House 
CHAIR  E.  Gabriella  Caldwell- Miller,  Illinois  State  University 1 

PRESENTATIONS 


Does  Play  Make  Young  Children  More  Creative?  E . Peter  Johnsen,  University > of  Kansas 

Gender  Role  Traditionality  in  Students  of  Intact  and  Single-Parent  Families.  Michael  L.  Slavkin,  Indiana  University 
Relation  of  Gender,  Social  Support  and  Self-Efficacy  to  Science  Career  Consideration  of  High  School  Students.  Soonhwa  Yoo , 
The  Ohio  State  University ; Ayres  G.  D'Costa,  The  Ohio  State  University > 


Assessment 

Division  K:  Teaching  and  Teacher  Education  — Paper  Presentation 
Friday,  4:10pm  to  5:30pm  — The  Bull's  Head 
CHAIR  Mary  B.  Campbell , St.  Xavier  University 

DISCUSSANT  Larry  Kenney,  University  of  Wisconsin  - Whitewater 
PRESENTATIONS 

Classroom  Assessment  Practices  of  Ohio  Teachers.  Craig  A:  Mertler,  Bowling  Green  State  University 

Inservice  Teachers'  Perceptions  of  Educational  Assessment.  Shawn  M.  Quilter,  Eastern  Michigan  University: ; Cher  C.  Hill,  State 
University  of  West  Georgia 


Issues  in  Diversity  Education 

Division  G:  Social  Context  of  Education  — Paper  Presentation 
Friday,  4: 1 Opm  to  5:30pm  — Columbian  House 
CHAIR  Mary  Ann  Wham,  University  of  Wisconsin  - Whitewater 

DISCUSSANT  Joan  T.  Timm,  University  of  Wisconsin  - Oshkosh 
PRESENTATIONS 

A Qualitative  Study  of  African  American  High  School  Students  Participating  in  a Precollege  Preparatory  Program.  JaDora  F. 
Sailes,  Indiana  University 

Diversity  Education  for  Preservice  Teachers:  Strategies  and  Attitude  Outcomes,  Karen  M.  Peterson,  Governors  State  University : 
Larry  D.  Cross,  Governors  State  University",  Glenna  L.  Howell,  Governors  State  University",  Elizabeth  J.  Johnson.  Governors 
State  University 

Perceptions  pf  Diversity:  The  Case  of  Southeastern  Louisiana  University.  Celina  V.  Echols , Southeastern  Louisiana  University 
Socio-Cultural  Barriers  to  Kenyan  Girls'  Education:  Gender  Discrimination  and  Sexual  Violence  in  Secondary  Schools.  Kate  L. 
Webster,  University  of  Chicago 


Comparing  Statistical  Analytical  Tools  and  Structures  in  Real-World  Data  Sets 

Division  D:  Measurement  and  Research  Methodology  — Paper  Presentation 
Friday,  4: 10pm  to  5:30pm  — Lake  House 
CHAIR  Dimiter  M.  Dimitrov,  Kent  State  University J 

PRESENTATIONS 

A Comparison  of  Radical  Basis  Function  Artificial  Neural  Networks  with  Multiple  Regression.  John  C.  Duncan,  Kent  State 
University 

A Comparison  of  Seven  Robust  Estimators  of  Location  Using  Real  Data  Sets.  Lori  F.  Rothenberg,  Wayne  State  University ; 
Shlomo  S.  Sawilowsky,  Wayne  State  University 

Methods  of  Stastical  Analysis  of  Standardized  Test  Scores.  Patricia  D.  Erickson,  Northeastern  Illinois  University 
Precision  Efficacy  Analysis  For  Regression,  Gordon  P.  Brooks,  Ohio  University • 


IIOIO.MA 


Division  I Business  Meeting 


Division  I:  Education  in  the  Professions  — Meeting 
Friday,  4:10pm  to  5:30pm  — Mansion  House 
SR.  D1V  CHAIR  Gene  A.  Kramer,  American  Dental  Association 
JR.  D1V  CHAIR  Richard  M.  Smith,  Rehabilitation  Foundation  Inc . 
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Accountability  and  Responsibility  in  Evaluation  and  Assessment 

Division  H:  School  Evaluation  and  Program  Development  — Paper  Presentation 
Friday,  4: 10pm  to  5:30pm  — Steamboat  Hotel 
CHAIR  Ralph  F.  Darr,  University'  of  Akron 

DISCUSSANT  Janet  K.  Sheehan-Holt,  Northern  Illinois  University 
PRESENTATIONS 

Graphical  Representations  of  Data:  Iowa  COGAT,  Ohio  Proficiency,  and  SB  55.  Donna  Snodgrass.  South  Euclid/ Lyndhurst 
Schools ; James  A.  Salzman,  Ursuline  College 

Longitudinal  Patterns  of  Schools  Success  Among  Academically  High  and  Low  Risk  Tenth  Graders.  Philip  A.  Griswold,  Ashland 
University,  Jeffrey  W.  Patterson.  Ashland  City  Schools 

The  Relationship  Between  Humor  (Terperament)  and  Course  Evaluation.  Donna  R.  Waechter,  University  of  Akron;  Isadora 
Newman,  University  of  Akron ; Linda  J.  Rosenkoetter,  University • of  Akron 
The  Responsibility  of  Educational  Researchers  and  Program  Evaluators  to  Make  Appropriate  Decisions  about  Type  I Error  Rates: 
A Suggested  Approach.  I sadore  Newman,  University  of  Akron;  John  W,  Fraas,  Ashland  University 

Gender  Issues:  A Challenge  for  the  New  Millenium 

Division  A:  Administration  — Paper  Presentation 
Friday,  4:10pm  to  5:30pm  — Shakespeare  Hotel 
CHAIR  Elizabeth  T.  Lugg , Illinois  State  University 

PRESENTATIONS 

Barriers  and  Coping  Strategies  Identified  by  Female  Superintendents  in  Indiana.  Theodore  J.  Kowalski,  Ball  State  University; 
Judy  G.  Stouder,  Ball  State  University 

The  Silent  Voices  of  Women  in  Academe,  Speak.  Marylyn  T.  Oldham,  Miami  University 


Instructional  Concerns:  Education  in  Flux 

Division  A:  Administration  — Paper  Presentation 
Friday,  4;  1 0pm  to  5:30pm  — Western  Stage  House 
CHAIR  R . Andrew  Lugg,  Illinois  State  University 

PRESENTATIONS 

Computer  Use  in  Schools:  Perceptions  of  Teachers  and  Administrators.  William  L.  Sharp , Southern  Illinois  University  at 
Carbondale 

District  CEOs  as  Instructional  Leaders.  George  J.  Petersen,  Southwest  Missouri  State  University' 

Student  Leadership  Style  Effectiveness.  Brian  R.  Hinrichs,  Illinois  State  University 

Teaming  in  K-12  Schools:  How  It  Affects  the  Educational  Process  and  Relationships  of  Students  and  Staff.  Randall  L . Turk, 
Wichita  State  University r 

President's  Reception  ® 

MWERA  — Social  ^ 

Friday,  7:00pm  to  12:00am  — Wolf  Point  Prefunction  Room  V 

HOST  Kim  K . Metcalf  Indiana  University • \ 

NOTES  Everyone  is  invited  to  come  and  have  a good  time ! 


t 


i 


% 


7:00pm  to  Midnight 
Wolf  Point 
Prefunction  Room 
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Chronological  Listing  of  sessions 

.Saturday,  October  l J-,  ±552  ■ 


S.OSOO.AIf 


Classroom  Management 

Division  K:  Teaching  and  Teacher  Education  — Paper  Presentation 
Saturday,  8:00am  to  9:20am  — American  House 
CHAIR  Steven  J.  Blatt , University  of  Dayton 

DISCUSSANT  Lenore  P.  Wineberg , University  of  Wisconsin  - Oshkosh 
PRESENTATIONS 

A Five-Styles  Teacher  Discipline  Model.  Daniel  R.  Tomal,  Concordia  University 

Teachers'  Reflections  on  Classroom  Management.  Sadegul  Akhaba,  University  of  Cincinnati ; ArifAltun , University  of  Cincinnati 


S.OSOO.BH 


CHAIR 

NOTES 


Conference  Feedback 

MWERA  — Meeting 

Saturday,  8:00am  to  9:20am  — The  Bull’s  Head 
Jeffrey  B.  Hecht , Illinois  State  University 

Come  and  provide  feedback  about  this  year's  conference , and  help  to  plan  next  year's  meeting! 


S.OXOOXH 


CHAIR 

NOTES 


Training  Trainers  for  Technology  Integration:  Beyond  "How  To" 

MWERA  — Workshop 

Saturday,  8:00am  to  9:20am  — Columbian  House 

Sharon  L.  McNeely , Northeastern  Illinois  University 

Maximum  Enrollment:  10;  Fee:  $10.00;  Pre-registration  required , on-site  registration  only  if  space  available. 


S.OXOO.l.H 


A Dimension  of  Studies  Involving  Measurement  of  Student  Perceptions,  Assessment,  and 
Student  Knowledge 

Division  D:  Measurement  and  Research  Methodology  — Paper  Presentation 
Saturday,  8:00am  to  9:20am  — Lake  House 
CHAIR  Thomas  R . O'Neill , American  Society'  of  Clinical  Pathologists 

PRESENTATIONS 

Comparing  Two  Methods  of  Eliciting  Knowledge  Structures  in  Statistics.  Mark  A.  Earley,  University  of  Toledo 
Developing  a Measurement  Instrument  to  Study  Student  Perceptions  of  Good  College  Teaching  from  a Cross-Cultural 
Perspective.  Wang  Aim  in.  Miami  University 

Graphic  Organizers:  An  Alternative  Objective  Item  Format  for  Reading  Assessment?  Mark  R.  Pomplun . University  of  Kansas: 
Phillip  Rhea,  Wichita  Public  Schools 

Item  Analysis:  Teaching  the  Vocabulary.  Bruce  G.  Rogers.  University  of  Northern  Iowa 


S’.  0X00,  M A 


Sources  of  Stress  and  Success  for  Teachers  and  Professors 

Division  E:  Counseling  and  Human  Development  — Symposium 
Saturday,  8:00am  to  9:20am  — Mansion  House 
CHAIR  E . Gabriella  Caldwell- Miller,  Illinois  State  University 

PRESENTATION 

Sources  of  Stress  and  Success  for  Teachers  and  Professors.  Thomas  S.  Parish.  Kansas  State  University:  James  J.  McCluskey, 
Central  Michigan  University:  James  R.  Necessary 
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Evaluating  Schedules  and  Texts 

Division  B:  Curriculum  Studies  — Paper  Presentation 
Saturday,  8:00am  to  9:20am  — Merchants  Hotel 
CHAIR  Nancy  G.  Saunders , Ball  State  University 

DISCUSSANT  James  H.  Powell,  Ball  State  University  ' 

PRESENTATIONS 

Process  Portfolios  as  a Means  for  Formative  and  Summative  Evaluation  of  Student  Work  in  Visual  Arts.  John  H.  V/alker,  Illinois 
State  University 

The  Westfield  3x5  Plan:  A Novel  Approach  to  Alternative  Scheduling.  Juan  C.  Judikis,  Ball  State  University',  Bob  Brower, 
Westfield  High  School',  Bobby  G.  Malone,  Ball  State  University' 

What  U.S.  History  Textbooks  Fail  to  Tell  Students  About  Religion  and  Faith.  Michael  H.  Romanowski,  Ohio  Northern  University 


Program  Evaluation:  Four  Practical  Examples 

Division  H:  School  Evaluation  and  Program  Development  — Paper  Presentation 
Saturday,  8:00am  to  9:20am  — Shakespeare  Hotel 
CHAIR  John  W.  Fraas , Ashland  University 

DISCUSSANT  Ralph  F.  Darr , University  of  Akron 
PRESENTATIONS 

An  Evaluation  of  a High  School's  Block  Schedule.  Gregory  J.  Marchant,  Ball  State  University ; Sharon  E.  Paulson,  Ball  State 
University 

The  Impact  of  A PDS  Internship/Student  Teaching  Program  on  the  Self-Efficacy,  Stages  of  Concern,  and  Role  Perceptions  of 
Preservice  Teachers:  The  Evaluation  of  a Goals  2000  Program.  Carole  Newman,  University  of  Akron;  Michelle  Lenarz,  The 
University  of  Akron',  Barbara  Moss,  University  of  Akron ; Isadore  Newman,  University  of  Akron 

Transforming  Teaching  and  Learning  Through  the  Technology  Teacher  Leader  Corps.  Judy  L.  VanVoorhis,  Ohio  School  net', 

Sheila  J.  Ellenberger,  Muskingum  College ; Dorothy  J.  Erb,  Marietta  College ; Suzy  Green . Ohio  University 

Using  Alumni  Satisfaction  Information  For  Continuous  Program  Improvement.  Darin  T.  Allen,  University  of  Wisconsin  - 
Madison',  Michael  J.  Subkoviak,  University  of  Wisconsin  - Madison',  Charlene  E.  Tortorice,  University’  of  Wisconsin  - 
Madison ; Craig  S.  Wells,  University  of  Wisconsin  - Madison 

Presidental  Address 

MWERA  — Invited  Address 
Saturday,  9:30am  to  10:20am  — Merchants  Hotel 
CHAIR  Jeffrey  B.  Hecht,  Illinois  State  University 

PRESENTATION 

Free  Market  Policies  and  Public  Education:  At  What  (Opportunity)  Cost? 

Kim  K.  Metcalf  Indiana  University 

The  issue  of  school  choice,  particularly  the  use  of  private  school  tuition  vouchers,  is  among 
the  most  contentious  issues  facing  education  in  the  U.S.  today.  Importantly,  public  support 
and  political  momentum  make  it  likely  that  more  and  more  states  will  implement  programs 
which  allow  parents  to  use  state  funds  to  send  their  children  to  the  public  or  private  school 
of  their  choice.  In  spite  of,  or  perhaps  because  of  the  passion  of  the  debate,  both  advocates 
and  proponents  rely  primarily  on  emotion  to  support  their  positions.  Largely  ignored  are 
previous  and  on-going  studies  which  provide  insight  into  the  likely  effects  of  public-private 
voucher  programs.  It  is  this  knowledge  base  and  its  implications  for  the  future  not  only  of 
voucher  programs,  but  for  public  education  as  well  that  will  be  considered.  Kim  Metcalf 
will  investigate  the  implications  of  vouchers,  and  provide  some  insights  from  his  current 
work  on  the  Cleveland  Scholarship  Program. 

Kim  Metcalf  is  an  Associate  Professor  of  Curriculum  and  Instruction  in  the  School  of 
Education  at  Indiana  University.  He  currently  serves  as  the  Director  of  the  Indiana.Center 
for  Evaluation.  Metcalf  is  a 1989  graduate  of  The  Ohio  State  University,  where  he  received 

his  Ph.D.  in  Teacher  Education  and  Educational  Research  and  Evaluation.  Metcalfs  work  has  focused  on  the  relationship  between 
instructional/classroom  practices  and  desirable  student  outcomes,  and  on  the  use  of  alternative  and  simulated  experiences  in  the 
professional  development  of  teachers.  His  work  has  appeared  in  a variety  of  professional  and  scholarly  journals  and  has  been  honored  by 
several  scholarly  associations,  among  them  The  Ohio  State  University  and  the  Association  of  Teacher  Educators.  He  is  also  a co-author 
of  the  chapter  “Training  within  Teacher  Education"  in  the  Handbook  of  Research  on  Teacher  Education  and  The  Act  of  Teaching.  Metcalf 
currently  leads  a team  of  researchers  conducting  a broad  scale  evaluation  of  the  highly  contentious  Cleveland  Scholarship  (Voucher) 
Program. 
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Reading,  Writing  and  Arithmetic:  Analyzing  Proficiency,  Ability  and  Cognitive  Styles 

Division  D:  Measurement  and  Research  Methodology  — Paper  Presentation 
Saturday,  10:30am  to  1 1 :50am  — American  House 
PRESENTATIONS 

Analysis  of  Growth  Rates  in  Longitudinal  Designs:  Are  Multiple  Waves  of  Data  Preferred?  Susan  G.  Locke,  Northern  Illinois 
University ; Janet  K.  Sheehan-Holt,  Northern  Illinois  University 
Partial  Credit  Analysis  of  Mathematics  Items  from  the  Ohio  Off-Grade  Proficiency  Tests.  Dimiter  M.  Dimitrov,  Kent  State 
University 

Relating  Essay  Scores  and  Cognitive  Style  of  the  Reader.  Clinton  I.  Chase,  Indiana  University 

Using  IRT  Created  Models  of  Ability  in  Standard  Setting.  June  E.  Smith,  University  of  Nebraska',  James  C.  Impara,  University  of 
NE  - Lincoln,  Ed.  Psych  Dept.;  Barbara  S.  Plake,  University  ofNE  - Lincoln,  Ed.  Psych  Dept. 


CHAIR 

NOTES 


Conference  Planning 

MWERA  — Meeting 

Saturday,  10:30am  to  1 1 :50am  — The  Bull's  Head 
E.  Jane  Williams,  The  Ohio  State  University 

Come  and  help  plan  next  year's  conference.  All  division  chairs  for  the  1999  conference  should  attend. 


The  Impact  of  Curricular  Change  on  Students’  Thinking 

Division  B:  Curriculum  Studies  — Paper  Presentation 
Saturday,  10:30am  to  1 1:50am  — Columbian  House 
CHAIR  Brad  E.  Oliver , Ball  State  University 

PRESENTATIONS 

Common  Experiences  in  a Human  Environment  as  a Source  for  the  Dialogical  Classroom.  William  L.  Chandler,  University  of 
Wisconsin  - Whitewater;  Mike  Nelson,  University  of  Wisconsin- Whitewater 
Evaluating  Supplemental  Program  Implementation  Through  Measurements  of  Students'  Critical  Thinking  Skills  and  Writing 
Ability.  David  W.  Moffett,  Indiana  University 

The  Impact  of  Curriculum  Change  on  Students'  Learning  and  Their  Career  Preference.  Wang  Aimin,  Miami  University;  Michael 
Eckert,  Miami  University 

Learning  Environments  and  Instructional  Practices  in  Postsecondary  Education 

Division  J:  Postsecondary  Education  — Paper  Presentation 
Saturday,  10:30am  to  1 1 :50am  — Lake  House 
CHAIR  Juan  C.  Judikis , Ball  State  University 

DISCUSSANT  Jacqueline  C.  Rickman , Western  Illinois  University 
PRESENTATIONS 

Examining  the  Educational  Outcomes  of  Preservice  Teachers.  Lemuel  W.  Watson,  Illinois  State  University 
Predicting  the  Social  Commitments  of  College  Students:  An  Individual  Difference  Perspective.  Ellen  Lavelle.  University  of  South 
Dakota 

The  Symphony  of  Change:  Harmony  or  Discord  in  a College  of  Education.  Christine  K.  Sorensen,  Northern  Illinois  University; 
Nina  Dorsch,  Northern  Illinois  University;  Cheryl  Kish,  Northern  Illinois  University;  Alfonzo  Thurman,  Northern  Illinois 
University;  Donna  L.  Wiseman,  Northern  Illinois  University 


Teacher  Preparation  and  Development 

Division  C:  Learning  and  Instruction  — Paper  Presentation 
Saturday,  10:30am  to  1 1 :50am  — Mansion  House 
CHAIR  Sharon  Pyke 

DISCUSSANT  James  W.  Reineke , Winona  State  University 
PRESENTATIONS 

Classroom-Based  Narratives:  Teachers  Reflecting  on  Their  Own  Teaching  Stories.  Ana  G.  Serafin,  Northeastern  Illinois 
University;  Ernestine  Riggs,  North  Central  Regional  Educational  Laboratory 

Correlates  of  a New  Measure  of  Ames’  TARGET  Model  with  Aspects  of  Collaborative  Learning.  William  J.  Gnagey,  Illinois 
State  University;  Sue  Peters,  Illinois  State  University 

Pre-service  Teachers'  Classroom  Assessment  Practices:  An  Investigation  into  the  Factor(s)  that  Contributc(s)  to  the  Discrepancy 
Between  Measurement  Instruction  and  its  Practical  Implementation.  Cynthia  S.  Campbell,  Southern  Illinois  University  at 
Carbondale 

Teaching  Educational  Psychology:  A Report  on  the  Results  of  an  Ongoing  Research  Project.  Ronald  R.  Morgan.  Loyola 

University  of  Chicago;  Clare  Coco,  Loyola  University  of  Chicago;  Elizabeth  J.  Johnson,  Governors  State  University;  Stacy 
D.  Saxon,  Loyola  University  Chicago 
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Issues  Impacting  Education:  Which  is  the  Cart  and  Which  is  the  Horse? 

Division  A:  Administration  — Paper  Presentation 
Saturday,  10:30ani  to  1 1:50am  — Merchants  Hotel 
CHAIR  A.  William  Place,  University  of  Dayton 

PRESENTATIONS 

Educational  Administrative  and  Governmental  Leadership  Regarding  Collaboration  and  Satisfaction  with  an  Alternative 
Educational  Environment.  Eugene  T.  Sanders,  Bowling  Green  State  University ; Thomas  Christie , Bowling  Green  State 
University ; Brenda  Kallio,  Bowling  Green  State  University 

Parental  Voices:  Circular  Hopelessness.  Celeste  M.  Baldwin , Bowling  Green  State  University',  Judith  Jackson,  Bowling  Green 
State  University 

Substance  Abuse  Policies  in  Ohio  Schools.  William  R.  Hughes , Ashland  University 


S.1030.SB 


Media  and  Technology 


Division  K:  Teaching  and  Teacher  Education  — Paper  Presentation 
Saturday,  10:30am  to  1 1 :50am  — Steamboat  Hotel 
CHAIR  Carmen  Giebelhaus , Ohio  Department  of  Education 

PRESENTATIONS 


Videotape:  A Tool  for  Critical  Inquiry  and  Experimentation.  Sunya  T.  Collier,  Georgia  Stc.  ? University 
Web-based  Case  Studies:  Infusing  Technology  into  Teacher  Education.  Sean  J.  Smith,  Bowling  Green  State  University ! 


S.  1 030.SP 


Investigations  in  Educational  History 


Division  F:  History  and  Historiography  — Paper  Presentation 
Saturday,  10:30am  to  1 1:50am  — Shakespeare  Hotel 
CHAIR  Louise  E.  Fleming , Ashland  University 

DISCUSSANT  Louise  E.  Fleming , Ashland  University 
PRESENTATIONS 


A Unique  Institution  for  a Unique  Population:  The  Finlandssvensk  and  the  Folk  High  School.  Katherine  M.  Brown , Loyola 
University  of  Chicago 

Julius  Rosenwald  and  the  University  of  Chicago:  Portrait  of  a Trustee.  Peter  M.  Ascoli,  Spertus  Institute  of  Jewish  Studies 
The  Academic  Career  of  Thomas  J.  "Stonewall"  Jackson.  Kenny  O.  McDougle , Pittsburg  State  University 
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CT0SS-I l/w(ex  to  S>t£,S>lD\A,  sponsors 


Division  A:  Administration 

T.0800.LH  / The  Evolving  Roles  of  the  Modem  Principal 
T.1030.LH  / New  Trends  in  Administrator  Preparation  Programs 
T.  1340. AH  / School  Violence  and  Adolescent  Suicide 
T.1340.LH  / Should  Administrators  be  'Virtually*  Prepared? 

Developments  in  Educational  Administration 
T.1510.LH  / Illinois  Council  of  Professors  of  Educational 
Administration  Business  Meeting 
T.1610.LH  / Response  to  the  Virtual  University:  What  are 
Traditional  Institutions  to  Do? 

T.  1610. SB  / Perspectives  on  Supervision 
T.  1610.SP  / Policy  Issues:  What  is  Driving  Education  in  the  '90s 
F.0800.SB  / This,  Too,  Shall  Pass:  A Symposium  for  Doctoral 
Students 

F.1030.MA  / Division  A Business  Meeting 
F.1340.CH  / A View  of  the  Modem  Superintendency:  Success  or 
Failure 

F.  1340. SB  / Leadership  Perspectives 

F.  1610.SP  / Gender  Issues:  A Challenge  for  the  New  Millenium 
F.  1610.WS  / Instructional  Concerns:  Education  in  Flux 
S.  1030. ME  / Issues  Impacting  Education:  Which  is  the  Cart  and 
Which  is  the  Horse? 


Division  B:  Curriculum  Studies 

T.  1030.BH  / Technology  and  its  Impact  upon  Curriculum 
T.1340.MA  / Division  B Business  Meeting 
F. 0800.  AH  / Reorganizing  the  Curriculum 

S. 0800. ME  / Evaluating  Schedules  and  Texts 
S.  1 030. CH  / The  Impact  of  Curricular  Change  on  Students' 
Thinking 


Division  C:  Learning  and  Instruction 

T.0800.AH  / New  Motivation  Research  in  Education 
F.0800.MA  / Division  C Business  Meeting 
F.  1030. AH  / Promising  Research  in  Elementary  Education 
F.1340.BH  / Examining  Technology  Uses  in  Schools 
F.  1340.SP  / Assessment  of  Cognition  and  Metacognition 

S.  1030.MA  / Teacher  Preparation  and  Development 

Division  D:  Measurement  and  Research 
Methodology 

W.  1 5 1 0.SP  / Towards  a Better  Understanding  of  Response 
Aberrance  Indices 

T. 0800.CH  / An  Examination  of  Studies  Involving  Rasch 

Measurement  Techniques  and  Research  Methodology 
F.1030.CH  / Division  D Business  Meeting 
F.  1340.  AH  / Tricks  of  the  Teaching  Statistics  Trade 
F.1610.LH  / Comparing  Statistical  Analytical  Tools  and 
Structures  in  Real-World  Data  Sets 

S.0800.LH  / A Dimension  of  Studies  Involving  Measurement  of 
Student  Perceptions,  Assessment,  and  Student  Knowledge 
S.  1030. AH  / Reading,  Writing  and  Arithmetic:  Analyzing 
Proficiency*  Ability  and  Cognitive  Styles 


Division  E:  Counseling  and  Human  Development 

T.0800.BH  / Professionals  and  Children  with  Disabilities 
T.  1030. CH  / Division  E Business  Meeting 
T.  1340.SP  / A Strategic  Program  to  Build  Character  and  Self- 
Esteem  Among  Urban  Adolescents 
T.  16 10.  AH  / Ways  to  Enhance  Students'  Self-Concepts 
F.1030.LH  / Educating  Asian- American  Students:  Trends  and 
Issues 

F.  1 6 1 0.  AH  / Factors  in  the  Self-Development  of  Children 

S.0800.MA  / Sources  of  Stress  and  Success  for  Teachers  and 
Professors 


Division  F:  History  and  Historiography 

T.  1030.MA  / Division  F Business  Meeting 
T.I340.CH  / Methods  in  Educational  History  Research 
S.1030.SP  / Investigations  in  Educational  History 


Division  G:  Social  Context  of  Education 

T.0800.SB  / Examining  Pedagogy  and  Curriculum 
F.0800.LH  / Division  G Business  Meeting 
F.1610.CH  / Issues  in  Diversity  Education 

Division  H:  School  Evaluation  and  Program 
Development 

W.  15 10. AH  / Qualitative-Quantitative  Research  Methodology: 
Exploring  the  Interactive  Continuum 
T.0800.SP  / Professional  Development:  Suggested  Models 
F.0800.BH  / Educational  Reform:  Urban  Education,  Teacher 
Development  and  Effectiveness,  and  Organizational  Theory 
F.I030.BH  / Evaluation  of  the  Cleveland  Choice  Program 
F.  1 340. MA  / Division  H Business  Meeting 
F.  16 10. SB  / Accountability  and  Responsibility  in  Evaluation  and 
Assessment 

S. 0800.SP  / Program  Evaluation:  Four  Practical  Examples 

Division  I:  Education  in  the  Professions 

F.0800.CH  / Constructing  and  Analyzing  Ordered  Response 
Survey  Data 

F.  1610. MA  / Division  I Business  Meeting 

Division  J:  Postsecondary  Education 

T.  1340. SB  / Engaging  the  Learner:  Technology  in  Postsecondary 

Education 

T.  1 6 1 0.M A / Division  J Business  Meeting 
F.1030.SP  / Career  Paths:  Navigating  the  Quagmire 
S.1030.LH  / Learning  Environments  and  Instructional  Practices 
in  Postsecondaiy  Education 
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Division  K;  Teaching  and  Teacher  Education 

W.  1 5 1 0.LH  / Delivering  Problem-Based  Learning  Utilizing  a 
CD-ROM  Enhanced,  Internet-Based  Delivery  System 
T.0800.WS  / Special  Education  and  Inclusion 
T.1030.SB/  Field  Experience  Sites 

T.l  030.  WS  / Preparing  Teachers  to  use  Contextual  Teaching  and 
Learning  Strategies 
T.l  340. BH  / Teacher  Training 
T.1340.WS  / Mentoring 

T.1510.BH  / Creating,  Training,  and  Sustaining  a Mentor 
Teacher  Program 
T.1610.WS  / First-Year  Teaching 
T.  1800. ME  / Division  K Business  Meeting 
F.0800.SP  / Student  Teaching 
F.0800.WS  / Action  Research 
F.1030.SB  / Teacher  Knowledge 
F.1030AVS  / Problem-Based  Learning 
F.1340.WS/  Diversity 
F.  1 6 1 0.BH  / Assessment 

S. 0800. AH  / Classroom  Management 
S.  1030. SB  / Media  and  Technology 


MVVERA 

W.1510.BH  / MWERA  Association  Council  and  Officers 
Orientation 

W. 2000.SE  / Kick-Off  Address 
W. 2130.SE  / Welcome  Social 
T.0930.SE  / Keynote  Address 
T.  1 030.  AH  / New  Member  Welcome 
T.I030.SP  / Follow-up  Discussion  from  the  Keynote  Address 
T.  1 200.SE  / MWERA  Association  Council  Meeting 
T.  1 5 1 0.SE  / Roundtable  Discussion/Poster  Session  # 1 
T.1610.CH  / Mid-Western  Educational  Researcher  Editorial 
Board  Meeting 

T.  1730.WP  / Cracker  Barrel  Social 
F. 0930.SE  / Business  Meeting 
F.  1200.SW  / Luncheon  Address 

F.  1340.LH  / Follow-up  Discussion  from  the  Luncheon  Address 
F.  1 5 10.SE  / Roundtable  Discussion/Poster  Session  #2 
F.I900.WP  / President's  Reception 

5.0800. BH  / Conference  Feedback 

5.0800. CH  / Training  Trainers  for  Technology  Integration: 
Beyond  "How  To" 

S. 0930. ME  / Presidential  Address 
S.1030.BH  / Conference  Planning 


subject  ivuitK 


Accountability 

T.0800.LH.  F.1510.SE.  F.1610.SB 

Achievement 

T.0800.AH,  F.  1 5 lO.SF.  S 1030.CH 

Action  Research 

F.0800.  WS 

Adaptive  Testing 

F.1340.SP 

Administration 

T.0800.L/I.  T.1030.LH,  T.  1340.AH, 
T.1610.L11.  T.  1610. SB,  F.1340.C1I. 
F.1340.SB,  FI610.SP , F.1610.WS, 

S. 1030 ME 

Adult  Education/Development 

T.  I510.se.  S.0800.CH.  S.  1030.SP 

Aging 

T.  15  w.se 

Arts  Education 

F.15W.SE.S.0800.MF 

Asian  Education 

T.1030.SB,  F.  10 30. LI l 

Assessment 

T.Q8QO.BH.  T.l 51 0 SE.  F 1030  A H. 
F.1030.SP.  F1340.C11.  F 15lO.SE . 
F.  1610  BH.  F.  1610. SB,  S.0S00  1.11, 

S.  0800  SP,  S.  1 030.  SI  A 
At-Risk  Students 

T. OSOOBll,  T.0800.SB,  T.l 340  AH. 
T.  1510.SE,  F15I0.SE.  F.1610CH . 
F.1610.SB,  S.  1030.  ME 

Attitude 

T.OSOO.BH.  T 0800  It'S.  T 1340.BH, 
T.l 5I0.SE.  F 1340  SP.  F 1610  BH. 
F.1610C11 


Attribution 

T.0800.AH,  T. 0800. SB 

Bilingual/Bicultural 

F1030.LH.F1510.se 

Black  Education 

F.  1610.C11 

Business  Education 

F.1340.SP 

Career  Development 

T.0800.SB,  F.  1340.C11.  F.  16 10. AH. 

F.1610.SP 

Case  Studies 

T1510.SE.  T.l 610. SP,  T.1610.WS.  S.0800.LH. 
S.1030.MA,  S.1030.SP 

Certification/Licensure  • 

F.  1510.SE 

Child  Development 

F1510.SE.  F.1610.AH 
Classroom  Management 

T0800.SB,  F.0800. AH,  S.0800  AH. 

S.  1030.  ME 

Classroom  Research 

T0800.AH,  T.  1340. SB.  T.1510.SE, 

F.  1030. AH.  F.  1510.SE.  S. 0800  All. 

S.  1030.MA 

Cognition 

F.  1 340. SP.  S.  1030  CH 

Cognitive  Processes/Development 

T. I030.WS.  T1510.SE,  F.1510.SE 

Collaboration 

T.0800.SP.  T.l 030. Ml.  T.1030.SB. 

T 1340  BH.  T.  1510.BH,  T.  1510.SE. 

T 1610. SP,  F.1030.SB.  F.1030SP, 

F.I6I0MS,  S.0800  SP,  S.1030  1.11 

Community  Colleges 

.V  1030.L11 


Comparative  Education 

T.1030.SB.  F.1610.CH 
Computer  Applications 
T.1610.SB,  F.1340.AH 
Computers  and  Learning 

T.l 030. BH.  T.1340.SB.  T1510.SE, 
F.1340.BH.  F.1610.WS,  S.1030.SB 
Conceptual  Change 
T1510.se  F1510.SE 
Constructivism 

F.  1030.SB.  F.  1030.  WS.  F 1510.SE 
Continuing  Education 
T.1030.LH 

Cooperative  Learning 

5.1030. MA 
Counseling 

W.1510.SP,  T.OSOO.BH,  F1510.SE, 
F.1610.AH 

Counselor  Training/Supervision 

T.l  510  SE 

Critical  Theory 

T.1340.CH 

Critical  Thinking 

S.  1030.  CH,  S.  1030.SB 

Cross-Cultural  Studies 

T1510.SE.S0800.LH 

Curriculum 

T. l 030. BH.  F.0800.A11.  F./510SE. 

5.1030.  CH 
Data  Analysis 

F.  1340. AH,  F.1610.LH . F.16I0.SB 
Decision  Making 

T.1340.CH,  T.1610.SP 
Demography 
T.  1610.SP 
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Dropouts 

TI510.SE 

Early  Childhood 

T.0800.SB.  F.  16 10. AH 
Economics  of  Education 
T.0800.SB,  S.  1 030.SP 
Educational  Policy 

IV.2000.SE.  T.1610.SP.  F.1510.SE.  S.0800.SP. 

S. 1030.ME 

Educational  Reform 

T. 0800.CH.  T.0800.LH.  T.0800.SP. 

T.  1340. AH,  T.1340.BH . T.1510.SE . 

T.1610.SP.  F.0800.BH 

Elementary  Schools 

T.0800.SB.  F.1030.AH.  F1510.SE . 

S.  1030.  ME 

Ethnicity 

• T1510.SE.  S.1030.SP 

Evaluation 

T1510.SE,  F.1340.CH.  F.1610.SB. 

S. 0800.ME 

Facilities 

F.1340.CH 

Faculty  Development 

T. 0800.SP . T.1510.SE.  F.1030.SP,  F.1340.WS 

Finance 

W.2000.SE.  T.0800.LH . F.1340.CH 

Gender  Studies 

T.0800.AH.  T1510.SE.  F.1610.AH. 
F.1610.CH.F.1610.SP 

High  Schools 

T.1510.SE.  S.  0800. ME.  S.0800.SP.  S.1030.ME 

History 

T1340.CHS.1030.SP 

Indicators/Information  Systems 
T.  1610.  SB.  F.  0800.  BH 
Individual  Differences 

F.1340.SP 

Information  Processing 

F.1340.SP 

Instructional  Design/Development 

T.  1 340.SB.  F.0800.AH 

Instructional  Practices 

iV.l510.LH . T.1030.LH.  T.1340.SB. 

T.l 510.SE.  F.1340.WS.  F.1610.BH. 
F.1610.CH  F.1610.WS.  S.1030.MA 
Instructional  Technology 

W.1510.LH  T.1340.SB,  F.0800.AH. 

F.l  3 40.  BH,  S.0800.SP 

Intelligence 

T1030.LHF.1340.SP 
International  Education/Studies 
S.1030.SP 

Item  Response  Theory  (IRT) 

iV.1510.SP,  T.0800.CH.  F.0800.CH, 

S.  1030. AH 

Language 

Comprehension/Development 

F.1030.LH 

Law/Legal 

T. 1610.SP 

Leadership 

T.0800.LH.  T.1030.LH.  F 1340.SB. 

F.1610.  iVS 

Learning  Environments 

T1510.SE.  F.1030.AH,  S.  1030.LH. 
S.1030.MA,  S.  1030. ME 


Learning  Processes/Strategies 

T.  1030.BH,  T.l 030. IVS.  F.  1030.AH, 

F.  1030.  IVS.  F.  1510.SE.  S.1030.LH 

Literacy 

T.0800.SP,  F.1340.B11.  S.1030.C11 
Mathematics  Education 
F.  1030.  AH 
Measurement 

T.0800.CH,  T. 0800. IVS.  T1510.SE. 

F.0800.CH,  S.0800.LH,  S.  1030. AH 

Media 

T.1510.SE 

Medical  Education 

T.1510.SE 

Mentoring 

T.1030.LH,  T.  1340. IVS,  T.1510.B11. 

F.  1030.SP.  S.  1 030.MA 

Metacognition 

T.1030.WS.  F.1340.SP 

Middle  Schools 

F. 0800. AH,  F.103Q..4H.  S.1030.CH 

Minorities 

F.0800.AH.  F.1340.WS.  F.1510.SE. 

S. 1030.ME 

Moral  Education/Development 

T. 1510.SE,  F.1510.SE 

Motivation 

T.0800.AH.  T1610.AHF1030.iVS. 

5.0800. MA 

Networking 

F. 0800. SB 

Organization  Theory/Change 
F.  0800.  BH,  S.l  03 0.  LH 
Peer  Interaction/Friendship 
F.0800.SB,  F.I610.CH 
Performance  Assessment 

T.0800.CH,  F.1030.SB.  F1510.SE, 

F.1610.SB.  S.1030.AH 

Politics 

IV.1510.BH 

Postsecondary  Education 

IV.2000.SE.  T.0800.SB.  T.0800.SP,  T.l 340. SB. 
T.  1510.SE.  F.  1030.SP.  F.  1510.SE. 

5. 0800.  ME.  S 1030.LH 

Principals 

T.0800.LH.  T.1030.L11 

Problem  Solving 

iV.1510.BH,  iV.1510.LH.  T.1030MS. 
F1030.AH 

Professional  Development 

T.0800.SP.  T.  10 30. SB.  T.l 340. US.  T1510.SE. 
T.1610.WS,  F.0800.SP.  F.1340.SB 
Program  Evaluation 

T.0800.SB.  T1510.SE,  F.0800  BH.  S.0800.SP 

Psychometrics 

W.1510.SP.  T.0800  CH  S.0800  ill 

Qualitative  Research 

T.1340.CH,  T.  1 34 OS B.  F.1030.8B. 

F.1030.SP.  F.1340.BH  F1510.SE. 

5.0800.  ME,  S 1030.MA 

Race 

F.1340  IKS'.  F 1610.CH  F.1610.SP 

Reading 

F1510.SES.1030.MA 

Research  Methodology 

W.1510.AH.  T.OSOO.CH,  F.15WSE. 

F.1610. Hi.  S.  1 030. All 

Restructuring 


T0800.LH.S1030.LH 
School/Teacher  Effectiveness 
F.0800.AH,  F.0800.BH.  F.1340.BH 
Science  Education 

S.  1030.  CH 

Self-Concept 

T. OSOO.iVS.  T.1610.AH 

Social  Class 

T.1610.SP 
Social  Context 
F.  1510.SE 

Social  Processes/Development 

T.0800.SB.  T.1510.SE.  F.1610.AH, 

5.0800.  M A 

Social  Studies  Education 

T.0800. CH,  S.0800.ME 

Special  Education 

T.0800.BH.  T.0800.1VS,  T.1510.SE.  F.0800.SP 

Staff  Development 

T.0800. LH.  T.1610.SB.  F.0800.BH.  F1510.SE 

Standard  Setting 

T.0800.  iVS.  F.0800.SP.  F.  1510.SE.  S 1030.AH 

Statistics 

T.0800. CH,  F.1340. A11.  F.1610.LH, 

F.1610. SB.  S.0800. LH,  S.1030.AH 

Stress/Coping 

F.0800.SB,  F.0800.SP,  s.osoo.ma 

Student  Behavior/Attitude 

F.1610.  CH 

Student  Cognition 

F.1510.SE,  S.0800.LH 

Student  Knowledge 

5.0800.  LH 

Student  Teaching 

F.0800.SP,  S.1030.MA 

Supervision 

iV.1510.BH.  T.l 510.SE  T.1610.SB 

Survey  Research 

F.0800.CH.  S.0800.LH,  s 0800.SP 
Teacher  Assessment 

S. l  030. LH 

Teacher  Characteristics 

T. 1030.SB.  T.1610.WS.F.0800MS. 
F.1030.SB.  F.1030.SP . S.0800.AH 

Teacher  Cognition 
T.l 030.  IVS.  F.l 510.SE 
Teacher  Education/Development 
T.OSOO.CH.  T.0800.iVS.  T.1030.SB. 
T.1030.iVS.  T.1340.BH,  T.1340JVS. 

T.  1510.  BH,  T1510.SE.  T.1610.  iVS. 
F.0800.SP.  F1030.AH.  F.1030.SB, 

F.1340.  iVS,  F.l 510.SE  F.16I0.B11. 

S. 0800. SP.  S.1030.SB 

Teacher  Knowledge 

T. 1340.BH . T.1340.CH.  F.1030.SB 

Teacher  Research 

T.l 340. BH,  F.Q800MS.  F 1510.SE 
Teaching  Context 
T.l 030  SB 
Technology 

T.  1030.BH.  T.l 340 SB.  T.HilQ.LH. 

F 1340  BH.  F 1510  SE  F.l 6 10  IVS, 

S.  08 00.  CH,  S.  1 03  ( i.  SB 

Test  Theory/Development 

T 0800  CH 

Testing 

T0800  CH.  F.l 030  All.  S 0800  LH. 
S.J030.AH 
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Textbooks 

S.  0800.  ME 

Urban  Education 

F.1610.CH,  S. 1030. ME 


Adams,  Leah  D..  F./030.AH 
Adams,  Shauna  M..  F.1030.SP.  F.I5I0.SE 
Aimin,  Wang.  s.osoo.LH . SJ030.CH 
Akbaba,  Sadegul.  s.osoo.ah 
Albrecht,  Robert  C..  t.0930.se . T.I030.SP 
Allen,  Darin  T..  S.0800.SP 
Altun,  Arif,  s.osoo.ah 
Ament,  Darci  M..  T08O0.au 
Anderson,  Linda  M..  FJ340.WS 
Anderson,  Thomas  C.  T.I5I0.SE.  F.15WSE 
Andre,  Thomas.  Tl5W.SE.  Tf6io.cn 
Andrews,  W.  Dene  E..  F.I5I0SE 
Ascoli,  Peter  M..  S.1030.SP 
Ashby,  Dianne,  tmsoo.lh.  t.16W.lh 
Bailey,  Margaret  F.1340.BH 
Bainer,  Deborah  L..  T.1340.WS.  Ti6io.cn 

F.0800.CH 

Baldwin,  Celeste  M..  S 1030.ME 
Bendixen-Noe,  Mary,  T.1340.WS.  FJ340.WS 
Bennett,  Roger  V..  T./030.LH.  T1340.AH 
Bentley,  Carol  L..  F.f340.ws 
Bercik,  Janet  T..  T.isio.BU 
Bilowich,  Elaine,  t.isio.bh 
Blair,  Ulrike  B..  T.1030.BH 
Blatt,  Steven  J..  T.1510.SE . S. 0800  AH 
Boone,  William.  F.1030.BH 
Borkowski,  John.  T.1030.WS 
Bowdouris,  George.  F.1340.CH 
Bowen,  Mack  L„  t.osoo.bh 
Bowman,  Connie  L,.  t.isoo.me.  F/030.SP 
Boyd,  Donald  A..  T 16W.au 
Brady,  Peter  J«.  t.osoo.sb 
Breault,  Rick  A.  T.1030SB 
Brock,  Barbara  L..  T.0800.LI1.  T.1340.WS 
Brookhart,  Susan  M..  F1030.SP 
Brooks,  Gordon  P..  T.1510.SE.  F.loio.LH 
Brower,  Bob.  S.0800.ME 
Brown,  Katherine  M..  S.1030.SP 
Bugaj,  Albert  T.1510SE 
Burns,  Jolie.  F.1030.WS 
Burroughs,  Robert  S..  F.1030.SB 
Caldwell-Miller,  E.  Gabriella.  TW30CH. 

T.1610.AH.  F.I610.AH 
Campbell,  Cynthia  S..  S.1Q3Q.MA 
Campbell,  Mary  B..  F.16W.BH 
Chandler,  William  L..  .V.  1030.cn 
Chase,  Clinton  L.  s 1030.au 
Chen,  Hui  H,.  TJ5f0.SE 
Chiang,  Linda  IL.  F.1340.SP 
Chilton,  Todd  L..  f 1 030  mi.  r 1510  sf 
Christie,  Thomas,  s.  iu3o  ME 
Clark,  Dawn.  TJ340.cn 
Clinkenbeard,  Pamela  R*;  F 1030  Alt 


Women's  Issues 

F.15/0.SF . F.1610.CH.  F.1610.SP 


Participant  index 

Cochran,  H.  Keit.  T.0800.WS 

Coco,  Clare.  S.W30.MA 

Cody,  Tom  J..  T.1340.SB.  T.1610.MA. 

F.1030.SP 

Coleman,  Marta  J..  T1510.SE 
Collier,  Sunya  T..  FJ510.SE.  S.1030.SB 
Collins,  Burton  A..  F.1510.SE 
Colwell,  Brad.  T.1610.LH 
Connor,  Kathy  R..  T.1340.BH 
Coopman,  John  T„  F.I340.CH 
Corley,  Edward  L..  T.1610.WS 
Coutts,  Douglas  J..  T.16WS8 
Crader,  Allan.  iv.l5lo.Lll 
Cramer,  Susan  R..  F.1510.SF 
Crawford,  John.  F.1510.SE 
Crooks,  Steven  M..  FJ510.SE 
Cross,  Larry  D..  T.1340.BH.  F.1510.SE. 

F161Q.CH 

Cruz,  Josue.  T.itw.CH 
Czerniak,  Charlene.  T.ioio.CH 
D'Costa,  Ayres  G..  W.1510.SP,  T.osoo.cii. 

F.1610.AH 

Darr,  Alice.  T.osoo.SP 

Darr,  Ralph  F..  F.1610.SB.S.0800.SP 

Davis,  Kevin.  TJ510.SE 

Davis,  Michaeleen,  T.1340.SB 

Daytner,  Gary  T„  TI510.SE 

De  Luca,  Barbara  M..  tMjOO.Sb,  tio30.ii/i 

DeMoulin,  Donald  F.,  r.osou.ws 

Dennen,  Vanessa  P..  f.luo.bh 

Derby,  LeAnn,  FM8OO.BH 

DiCintio,  Matt  T.1510.SE 

Diez,  Mary.  T.1030.WS 

Dillon,  Ronna  F..  F.1340.SP 

Dimitrov,  Dimiter  M,.  F.loio.LH.  SJ030.au 

Dorsch,  Nina.  S.1030.LH 

Dowd,  Brian  L.t  F.1510.SE 

Drechtrah,  Mary  E..  tj5W.se 

Dretzke,  Beverly  J..  T0800.AH.  f.isao.ah 

Duell,  Orpha  K..  F.1340.SP . F.1510SE 

Duemer,  Lee  S..  T.1340.CH 

Duncan,  John  C.  F./610.U1 

Duncan,  P.  Kay.  TJ5io.SE 

Dunwoody,  Bonnie,  t.osou.sp 

Dutt-Doner,  Karen.  EJ5iu.SE 

Dye,  Gloria  A..  Ti5io.SE 

Earley,  Mark  A..  s.osoo.LH 

Echols,  Celina  V*.  F 1610.CU 

Eckert,  Michael.  SJ030.cn 

Edwards,  Audrey  T..  Fosoo  SP 

Eineke,  Kenneth.  f./u3oavs 

Ellenberger,  Sheila  J..  s os 00  sp 

Erb,  Dorothy  J..  s.usuo.sp 
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Writing 

F1030.SB.SJ030.CH 


Erickson,  Patricia  D..  F.16W.LH 
Estevez,  Ana.  TJ5io.SE 
Fager,  Jennifer  J..  T.1510.SE.  F.0800.WS 
Fallon,  Joanne.  T.1510.BH 
Feldmann,  Doug  A..  T.1340.CH.  FJ030.SB. 

F.1340.BH 

Ferguson,  Susan  M..  F.1510.SE 
Ferreira,  Marcia  ML.  F.1030.SB 
Fleming,  Louise  E..  T.1030.MA.  T.1340.CH. 

S.1030.SP 

Flow’ers,  Mary  A..  T./610.CH 

Flynn,  Judith.  T.ISIO.BH 

Fraas,  John  W..  F.I340.MA,  F.16I0.SB. 

S. 0800.SP 

Galvez-Martin,  Maria  E.,  T.1800.ME 
Ganser,  Tom.  T.1340.WS . T.1610.CH 
Gappa,  Judith  M..  F.1200.SW.  F.1340.LH 
Garmon,  M.  A..  T.0800.SP.  F.1340.WS 
Gee,  Sandra.  TJ5I0.SE 
Gibbs,  Sandra.  T.I030.WS 
Gibson,  Ernest  E..  F.I510.SE 
Giebelhaus,  Carmen.  T.1340.WS.  S.W30.SB 
Giuntoli,  Kathleen.  T.1340.BH 
Glenn,  Eddie  E..  TM800.BH . T.I030.CH. 

T. I340.SP.  T.1610.AH.  F.1030.LH 
Gnagey,  William  J..  SJ030.MA 
Gordon,  Pat.  T.0800.SP 
Green,  Suzy.  S.0800.SP 
Greer,  Rodney.  T.1340.SB 
Griswold,  Philip  A..  FJ610.SB 
Guo,  Gwo-Jen.  T.0800.CH 
Hara,  Noriko.  T.1340.SB 
Harrington,  Robert  G.,  T.0800.BH 
Hawks,  Marianne  M,.  F.1030.AH 
Hayek,  John.  F.1030.SP 

Hecht,  Jeffrey  B..  W.2000.SE.  W.2130.SE. 

T.0930.SE.  T.1610.LH . FJ200.SW. 

S.0800.BH.  S.0930.ME 
Hendricks-Lee,  Martha.  F.1030.SB 
Henriksen,  Larry.  F.1030.CH 
Herrera,  Socorro.  fj5W.se 
Hill,  Carrie  L..  FJ5io.SE 
Hill,  Cher  C.  T.0800.CH.  F.1610.BU 
Hines,  Edward.  W.2000.SE 
Hinrichs,  Brian  R..  T.16WSP.  f 1610.WS 
Hofmann,  Rich.  T.i6io.sp 
Holloway,  Ken.  1v.15io.LH 
Holloway,  Linda  M..  T1510.SE 
Howell,  Glenna  L..  T.I340.BH.  FJ610.CU 
Hubbard,  Brad.  T1510.SE 
Huck,  Schuyler  W..  r 1 340  ah 
Hueth,  Alan  C.  Ti5i0.SE 
Hughes,  Polly,  t. I510.se 
Hughes,  William  R.,  sjo3QME 
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Hunn,  Diana  ML.  T.I5I0.SE 
Impara,  Janies  C..  S.1030.AH 
Jackson,  Judith.  SJ030.ME 
James,  Patricia  A..  F.15I0.SE 
Jason,  Martin  H.,  T.0800.LH 
Johnsen,  E.  Peter.  F.I610.AH 
Johnson,  Beth.  Z.1030.MA.  T.1340.CH 
Johnson,  Elizabeth  J.,  Z.1340.BH. 

F.1340.WS.  F.1610.CH,  S.1030.MA 
Johnson,  Lisa,  f.i 510.se 
Johnson-Naden,  Harriet  T.1510.BH 
Joseph,  Laurice.  F.1030.SP 
Judikis,  Juan  C..  S.0800.ME . S.1030.LH 
Kallio,  Brenda.  S.1030.ME 
Katayama,  Andrew  D.,  F.I510.SE 
Kenney,  Larry.  F.1610.BH 
Ketcher,  Bruce  R..  F.1340.WS 
Kiewra,  Kenneth  A..  T.1610.CH.  F.1340.SB 
Killmer,  Nadine  M..  T.1340.BH 
Kinnucan-Welsch,  Katie.  F.1030.SP 
Kirclien,  Dennis  J.,  F.1030.WS 
Kish,  Cheryl.  SJ030.LH 
Klass,  Patricia  H..  T.1610.LH 
Klecker,  Beverly.  F.15I0.SE 
Kline,  Charles.  F.1030.SP 
Knapp,  Thomas  R..  T.0800.CH.  F.1340.AH 
Kowalski,  Theodore  J..  F.1340.CH. 

F.1610.SP 

Kramer,  Gene  A..  T.1610.CH.  F.0800.CH. 

F.1610.MA 

Kypros,  Bess.  F.1030.AH 
Lad,  Kaetlyn.  F.0800.SB.  F.1340  cm 
Lairson,  Sheila  F.,  t.osoo.sb 
Lampe,  Scherie  E..  F1510.SE 
Lange,  Linda  D,.  T.0800.AH 
Lapsley,  Daniel.  F.1510.SE 
Laveile,  Ellen.  S.1030.LH 
Leitner,  Dennis  W..  F.1340. ah 
Lenarz,  Michelle.  S. 0800. SP 
Lenski,  Susan  J..  T.OSOO.SB . F.080Q.LH. 

F.1030.SB,  F.I 510.SE 
Levin,  Cheryl  J..  T.0800.BH 
Levin,  Joel  R..  F.1340.AH 
Lian,  Ming-Gon  J.,  F.1030.LH 
Lindoerfer,  Patricia.  r.isio.BH 
Lipka,  Richard  P..  F.15W.SE 
Load  man,  William  E.,  T.osoo.CH, 

F.0800.BH,  F.1340.SP 
Locke,  Susan  G..  S.1030.AH 
Longfield,  Judith.  T1510.SE 
Ludwig,  Robert  A.,  z.i 030.il  1 
Lugg,  Elizabeth  T..  Z.I610.SP,  FI610.SP 
Lugg,  R.  Andrew'.  Z.1610.SP.  F.1610  ws 
Lynch,  Daniel.  Z1510.SE 
Ma,  Guoping.  F.0800.AH 
Malone,  Bobby  G.,  fosoo.ah.  s.osoo.me 
Manges,  Charles,  T.osoo.LH.  T.1030.LH 
Marchant,  Gregory  J..  W.15W.BH, 

F.i 340. SB,  S.0800SP 
Mariage,  Troy  V..  T.0800.SP 
Marso,  Ronald  N„  Z.1610.WS 
Martin,  Barbara  N„  Z.0800.SB.  Z1340.au 


May,  Judy  J..  T.1510.SE 
McCluskey,  James  J..  Z.1510.SE, 
F.1030.CH,  S.0800.MA 
McDougle,  Kenny  O..  f.osoo.sp,  S.1030.SP 
McNair,  Shannon.  F.1030.A11 
McNeal,  Larry.  T.0800.LH,  T.1610.SP. 
F.1030.MA 

McNeely,  Sharon  L.,  1v.15io.BH,  ZI610.CH. 

F.I 340. SB,  S.0800.CH 
Merkel,  Linda.  T.1510.BH 
Mertler,  Craig  A..  FI610.BH 
Metcalf,  Kim  K.,  iv.1510.bh,  Z.1200.SE. 
Z.1730.WP . F.1030.BH.  F.0930.SE. 

F.1340.SB.  F.1900.WP.  S.0930.ME 
Meyer,  Rhonda,  Z15W.SE 
Micetich,  Michele.  F.  1030.AH 
Michel,  Francine  E..  F.08Q0.BH,  F.1510.SE 
Miller,  Joyce  C..  F0800.BH.  F.1510.SE 
Moffett,  David  W„  S.1030.CH 
Morgan,  Ronald  R..  Z.0800.BH.  S.1030.MA 
Moss,  Barbara.  1v.15w.AH,  S.0800.SP 
Muller,  Patty.  F.1030.BH 
Necessary,  James  R.,  F.J5J0.SE, 
S.0800.MA 

Nelson,  Mike.  s.  1030.CH 
Newman,  Carole,  z.osoo.sp.  T.1030.SB, 
S.0800.SP 

Newman,  Isadore.  iv.isio.AH,  zi6io.cn. 

F.0800.BH,  F.I 340. MA.  F.I 6 10. SB, 

S.0800.SP 

Nichols,  Joe  D..  Z.W30.SB 
O’Connor,  Richele.  Z.0800.WS.  T.1510.SE 
O'Neill,  Thomas  R..  S.0800.LH 
Oldenski,  Thomas.  F.0800.SB 
Oldham,  Marylyn  T..  F.16W.SP 
Oliver,  Brad  E..  Z.1030.BH,  S.1030.CH 
Parish,  Joycelyn  G..  F15W.SE,  T.16W.AH 
Parish,  Thomas  S..  T.1610.AH,  F.1340.SB, 

5.0800. MA 

Pariza,  Janet  F.1030.WS 
Patterson,  Jeffrey  W..  F.16W.SB 
Paulson,  Sharon  E..  S.0800.SP 
Peters,  Sue.  S.1030.MA 
Petersen,  George  J..  T.  1340.au  T.1610.SB, 
F.0800.SB,  F.1340.CH,  F.1610.WS 
Peterson,  Karen  M.,  T.1340.BH.  F.1610.CH 
Pickering,  Thomas,  Z15W.SE 
Pierce,  Jean  W,.  Z1030.WS,  F.1030.WS 
Pigge,  Fred  L„  Z.1610.WS 
Place,  A.  William.  Z.1610.CH.  S.1030.ME 
Plake,  Barbara  S..  S.1030.AH 
Plucker,  Jonathan.  F15W.SE 
Pomplun,  Mark  R..  S.0800.LH 
Poulard,  Othello.  T.1340.SP 
Pourchot,  Thomas  L..  zosooah, 

F.0800.MA.  F.1340.SP 

Powell,  James  H..  ZW30.BH.  T.1340.MA. 

5.0800. ME 

Powers,  Susan  M.  Z1340SB,  z 1510SE 
Price,  Jay  R..  F.1340.BH.  f 15W.se 
Putnam,  Ralph.  Z.1030.WS 
Pyke,  Sharon.  S.1030.MA 
Quiltcr,  Shawn  M.,  z.osoo  ci l,  F 1610  mi 


Rahman,  Mohammed  A..  Z.0800.CH 
Raisch,  Dan.  Z.1340.BH 
Ramanathan,  Hema,  Z.1030.SB,  Z.1610.WS, 
F.0800.SP 

Ramirez,  Tammy  R„  F.1510.SE 
Rapoo,  Brunnehilde.  F.iOSO.ws 
Reineke,  James  W..  F.1340.BH.  s.1030.ma 
Rhea,  Phillip.  S.0800.LH 
Rickman,  Jacqueline  C..  Z.1340.SB. 
S.1030.LH 

Riggs,  Ernestine.  S.1030.MA 
Robb,  Louise.  F.1030.AH 
Roberts,  Nicole  K..  Z.1610.SP 
Robinson,  Gary  W.,  Z.1610.SB 
Roe,  Tammy.  F.1030.SB 
Rogers,  Bruce  G..  Z.0800.CH.  S.0800.LH 
Rogers,  Francis,  F.1030.BH 
Romano wski,  Michael  H..  S.0800.ME 
Rose,  Steve,  F.1510.SE 
Rosenkoetter,  Linda  J..  f.ioio.sb 
Rothenberg,  Lori  F..  F.I610.LH 
Runyon,  Charles  K..  Z.1340.WS 
Sage,  Sara  M..  F.1030.AH 
Sailes,  JaDora  F.,  Z.0800.SB,  F.1610.CH 
Salazar-Valentine,  Marcia.  Z.1030.LH 
Salzman,  James  A..  F.OSOO.SP,  F.1030.SB, 
F.1610.SB 

Sanders,  Eugene  T..  Z1030.LH.S.1030.ME 
Saunders,  Nancy  G.,  Z.1030.BH,  F.0800.AH, 
S.  0800.  ME 

Sawilow'sky,  Shlomo  S..  F.1610.LH 
Saxon,  Stacy  D..  F.1340.WS.  s.1030.ma 
Schommer,  Marlene  A,.  F.1340.SP 
Scott,  Rose  Mary,  z.osoo.ws,  f.osoo.ah 
Seery,  Mary  Ellen.  F.1030.SP 
Seol,  Hyunsoo.  z.osoo.ch 
Serafin,  Ana  G..  S.1030.MA 
Sharp,  Janet  M„  F.1030.AH 
Sharp,  William  L..  F.0800.SB,  F.i 340.cn, 
F.1610.WS 

Sheehan-Holt,  Janet  K„  F.1610.SB, 

S.  1030.  AH 

Sheridan,  Marcia.  7 \l340.ws 
Shnay,  Penny.  F.1340.WS 
Shuler,  Paul  D..  Z15W.SE 
Siegel,  Michael  J..  F.W30.SP 
Simon  II,  George  B..  Z1030.LH 
Simpson,  Margaret  A..  Z.1340.SB, 
Z1610.MA 

Slavkin,  Michael  L..  F.1610.AH 
Smith,  June  E..  S.  1030.au 
Smith,  M Cecil.  F.osoo  ma 
Smith,  Richard  M,.  Z1610.CH,  F.osoo.CH, 
F.1610.MA 

Smith,  Sean  J..  S.W30.SB 
Snodgrass,  Donna.  F.1030.SB,  F.1610.SB 
Sommers,  Norman  L„  F.1340.CH 
Sorensen,  Christine  K ,.S  1030.LH 
Sorg,  Shelley  A..  Z 1030  SR 
Sparrow,  Kathleen.  Z.I 5lo.SE 
Speaker,  Kathryne  M..  Z1340.A11 
Spears,  Renee.  z.osoo.BH 
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Stevenson,  Andrea,  T.0800.BH 
Stinson,  Anne  D.,  TJ340.WS 
Stouder,  Judy  G..  F.16I0.SP 
Subkoviak,  Michael  J.,  S.0800.SP 
Suddick,  David  E.,  FJ5io.SE 
Surber,  John,  FJ5W.SE 
Thomas,  Anna  Marie  M*.  T. 0800. CM. 
F.0800.BH 

Thomas,  Laurie.  TJ030.BH,  F.0800.AH 
Thompson,  Jr.,  Jay  C.  TJ030.BH. 
TJ.UQ.MA 

Thurman,  Alfonzo,  SJ030.IJI 
Tietjens,  Cheryl  L..  F.0800.AH 
Timm,  Joan  T„  ti6W.cn.  FJ6I0.cn 
Tomal,  Daniel  R..  S.OSOO.AH 
Torrence,  Eileen,  T.I340.SB 
Tortorice,  Charlene  E.,  SMOO.SP 
Tripses,  Jenny  S..  T.OSOO.lh 


Turk,  Randall  L.,  Tl030.LH.FJ6l0.ws 
Valente,  Sharon  A..  F.0800.BH 
Van  Loon,  Preston  C..  T.1510SE 
VanVoorhis,  Judy  L..  S.0800.SP 
Victorson,  David  E.,  TJ510.SE.  FJ5io.SE 
Viragoontavan,  Sunanta.  FJ5io.SE 
VVaechter,  Donna  R..  F.1610.SB 
Walker,  John  H..  S.0S00  ME 
Walter,  James  K„  F.0800.SB.  f.1030.ma, 

F.  I340.CH 

Waltershausen,  Cynthia.  T.1610.LH 
Watson,  Lemuel  W..  SJ030.LH 
Webster,  Kate  L..  F.1610.CH 
Wegner,  Sandra,  1v.15iO.LH 
Wegner,  Scott  B..  W.15W.U1 
Wells,  Craig  S..  S.08Q0.SP 
Wham,  Mary  A..  T.OSOG.SB.  T.1030.AH . 

F.0800.LH.  F .1030. AH.  F.  1030. SB. 


F.1610.  CH 

Wigle,  Stanley  E.,  T.0800.WS.  F.0800.SP 
Wilcox,  Daryl  J..  T.0800.WS.  F.0800.SP 

Wilkins-Canter,  Elizabeth  A..  T.1510.SE. 
F.0800.SP 

Williams,  E.  Jane.  T.0800.SP,  S.1030.BH 
Wilson,  Jennifer  A..  F.1340.SP 
Wineberg,  Lenore  P..  T.1340.BH,  S.08Q0.AH 
Winterfeldt,  Henry.  FJ510.SE 
Wiseman,  Donna  L.(  S.1030.LH 
Woltle,  Jane,  T.1340.AH 
Wright,  Benjamin.  T.1610.CH 
Yonghee,  Kim.  F.1510.SE 
Yoo,  Soonhwa.  F.1610.AH 
Young,  Alice,  fmoo.sp 
Young,  Allison  J..  F.0800.  ws 
Zlogar,  Katherine.  T.1510.BH 


Address  v>irtdcom  of  Participants 


Adams,  Leah  D.  ted_adams@online.emich.edu 

Eastern  Michigan  University,  Department  of  Teacher  Education,  234 
Boone  Hall.  Ypsilanti.  Mi,  48197 

Adams,  Shaun  a M.  adams@keiko.udayton.edu 

University  of  Dayton,  Department  of  Teacher  Education.  300  College 
Park,  Dayton.  OH.  45469-0525 

Aimin,  Wang  wanga@muohio.edu 

Miami  University,  118  McGuffcy  Hall.  Miami  University,  Oxford,  OH, 
45056 

Akbaba,  Sadegul  akbabasl@email.uc.edu 

University  of  Cincinnati,  2930  Scioto  St.  #506,  Cincinnati,  OH,  45220 

Albrecht,  Robert  C. 

Western  Governors  University,  8080  East  10th  Place,  Aurora,  CO,  80010 

Allen,  Darin  T,  dtallenl@students.wisc.edu 

University  of  Wisconsin  - Madison.  1 15  Education  Building,  1000  Bascom 
Mall,  Madison.  W|,  53706-1398 
Altun,  Arif 

University  of  Cincinnati 

Ament,  Darci  M.  dretzkbj@uwec.edu 

University  of  Wisconsin  - Eau  Claire,  Department  of  Psychology.  Eau 
Claire,  W|,  54701 

Anderson,  Linda  M. 

Michigan  State  University 

Anderson,  Thomas  C.  tcanders@indiana.edu 

Indiana  University.  332  Wilmington  Court,  Bloomington.  IN,  47401 

Andre,  Thomas  tandre@iastate.edu 

Iowa  State  University,  Department  of  Psychology.  W]  12  Lagomarcino, 
Arnes,  I A,  5001 1-3180 

Andrews,  W.  Dene  E.  ESANDREW@BEFAC.1NDSTATE.EDU 

Indiana  State  University,  Curr-lnst/Media  Tech  Dept.,  Terre  Haute,  IN. 
47809 

Arenz,  Bernard  barenz@utep.edu 

University  of  Texas  - El  Paso,  College  of  Education  B .ilding  TED.  El 
Paso.  TX.  79968 

Ascoli,  Peter  M.  Pascoli@aol.com 

Spertus  Institute  of  Jewish  Studies.  5^44  S.  Kmibark  Avc  , Chicago,  IL. 
60637 

Ashby,  Dianne 

Illinois  State  University 

Atkinson,  Robert  ralkins@students.wisc.cdu 

University  of  Wisconsin  - Madison.  Department  of  Educational 
Psychology,  1025  West  Johnson  Street,  Madison.  Wl,  53706 

Bailey,  Margaret 

Northern  Illinois  University 


Bainer,  Deborah  L.  bainer.l@osu.edu 

The  Ohio  State  University  - Mansfield.  1680  University  Dnve,  Mansfield, 
OH,  44906 

Baldwin,  Celeste  M.  celestebaldwin@svmc.org 

Bowling  Green  State  University,  512  Education  Bldg.,  Bowling  Green, 

OH,  43403 

Batambuze,  Charlotte 

Illinois  State  University,  Campus  Box  5910.  Normal.  1L,  61790-5910 

Bendixen-Noe,  Mary 

The  Ohio  State  University  - Newark 

Bennett,  Roger  V.  r\>b0 12j@wpgate.smsu.edu 

Southwest  Missouri  State  University,  College  of  Education,  901  South 
National  Avenue,  Springfield,  MO,  65804 

Bentley,  Carol  L. 

Northern  Illinois  University,  91 1 South  Halsted  Street.  Chicago,  IL,  60620 

Bercik,  Janet  T.  j-bercik@neiu.edu 

Northeastern  Illinois  University,  1521  Lake  Avc.,  Whiting.  IN,  46394 

Bilowich,  Elaine 

Maine  East  High  School,  Maine  Twp.  207 

Blair,  Ulrike  B.  deluca@udayton.edu 

University  of  Dayton.  School  of  Education,  c'o  Barbara  Dc  Luca,  Dayton, 
OH.  45469-1510 

Blatt,  Steven  J.  sblatt@udayton.edu 

University  of  Dayton,  300  College  Park.  Department  of  Communications, 
Dayton,  OH,  45469-0525 

Boone,  William 

Indiana  University 

Borkowski,  John 

University  of  Notre  Dame,  Department  of  Psychology,  1 14B  Haggcr  Hall, 
Notre  Dame,  IN,  46556 
Bowdouris,  George 
Ashland  University 

Bowen,  Mack  L.  mlbowen@iistu.edu 

Illinois  Stale  University,  Department  of  Special  Education,  Campus  Box 
5901,  Normal.  IL,  61790 

Bowman,  Connie  L.  bowman@keiko.udayton.edu 

University  of  Dayton.  300  College  Park.  Dayton.  OH.  45469-0525 

Boyd,  Donald  A. 

Special  Educational  Resource  Center 

Brady,  Peter  J.  bradyp@clark.cc. oh. us 

Clark  State  Community  College,  PO  Box  570,  Springfield,  OH,  45501 
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Brea ult,  Rick  A.  Breault@facstajfMindy.edu 

University  of  Indianapolis,  1400  E.  Hanna  Ave.,  Indianapolis,  IN,  46227- 
3697 

Brock,  Barbara  L.  bbrock@creighton.edu 

Creighton  University,  Education  Department,  2500  California  Piaza, 

Omaha,  NE,  6817S 

Brookhart,  Susan  M.  brookhart@duq3.cc.duq.edu 

Duquesnc  University,  School  of  Education,  600  Forbes  Avenue, 

Pittsburgh,  PA,  15282 

Brooks,  Gordon  P.  gordo_b@ameritech.net 

Ohio  University,  601  Courtland  Lane,  Pickcrington,  OH,  43147 

Brower,  Bob 

Westfield  High  School 

Brown,  Katherine  M.  kbrown5@orion.it.luc.edu 

Loyola  University  of  Chicago,  1041  Ridge  Road,  Wilmette,  IL,  60091 

Bugaj,  Albert  M.  abugaj@mvc.edu 

University  of  Wisconsin  - Marinette,  750  West  Bay  Shore  St.,  Marinette, 

Wl,  54143-4299 

Burke,  Key 

Skylight  Training  and  Publishing 

Burns,  Jolie 

Northern  Illinois  University,  10104  S.  California,  Evergreen  Park.  IL, 

60805 

Burroughs,  Robert  S.  Robert.Burroughs@uc.edu 

University  of  Cincinnati,  Box  2 1 0002,  Cincinnati,  OH,  4522 1 -0002 

Bush,  Lynn 

Saint  Xavier  University 

Caldwell-Miller,  E,  Gabr\e\\?gccaldw@aca dcomp.cmp. ilstu.edu 
Illinois  State  University,  Counselor  Education  Program,  Campus  Box 
5910,  Normal,  IL,  61790-5910 

Campbell,  Cynthia  S.  ccampbel@siu.edu 

Southern  Illinois  University  at  Carbondalc,  Mail  Code  4618,  Carbondalc, 

IL.  62901-4618 

Campbell,  Mary  B. 

St.  Xavier  University,  3700  West  1 03rd  Street,  Chicago,  IL,  60655 

Carlan,  Carl  R. 

University  of  Texas  - Pan  American,  College  of  Education,  1200  West 
University  Drive,  Edinburg,  TX,  78539-2999 
Carney,  Russell  N.  rnc20I@wpgate.smsu.edu 

Southwest  Missouri  State  University,  Psychology  Department,  901  South 
National,  Springfield,  MO,  65804 
Carroll,  Margaret  K. 

Saint  Xavier  University,  12738  Maple,  Blue  Island,  IL,  60406 

Chandler,  William  L.  chandleb@mvwvcLx.uww.edu 

University  of  Wisconsin  - Whitewater,  Department  of  Curriculum  and 
Instruction,  Whitewater,  WI,  53190 

Chang,  Ni  changn@uwwvax.uww.edu 

University  of  Wisconsin  - Whitewater,  Department  of  Curriculum  and 
Instruction,  800  W.  Main  St.,  Whitewater,  WI,  53190 
Chase,  Clinton  I.  chase@indiana.edu 

Indiana  University,  405  S.  Meadowbrook,  Bloomington,  IN,  47401 

Chen,  Hui  H. 

Indiana  University 

Chiang,  Linda  H.  lhchiang@anderson.edu 

Anderson  University,  1 100  East  Fifth  Street,  Anderson,  IN,  46012-3495 

Chilton,  Todd  L.  tchilton@indiana.edu 

Indiana  University,  Department  of  Counseling  and  Educ  Psychology,  2201 
East  Seventh  Street,  Bloomington,  IN,  47408 

Christie,  Thomas 

Bowling  Green  State  University 

Clark,  Dawn 

11901  Hunters  Creek  Court,  Plymouth,  Ml,  48167 

Clinkenbeard,  Pamela  R.  clinkcnp@mvwvax.uww.edu 

University  of  Wisconsin  - Whitewater,  800  West  Main  Street.  Whitewater. 
Wl,  53190-1790 

Cochran,  H,  Keit  cochran-k@mail.mssc.edu 

Missouri  Southern  State  College,  Department  of  Psychology,  3950  East 
Newman  Road,  Joplin.  MO.  64801 


Coco,  Clare  ccoco@orion.it.luc.edu 

Loyola  University  of  Chicago,  821  Ridge  Road  Unit  2E,  Wilmette,  IL, 
60091-2445 

Cody,  Torn  J.  TJ-Cody@wiu.edu 

Western  Illinois  University,  1 University  Circle,  SON  Horrabin  Hall, 

Macomb,  IL,  61455 

Coleman,  Marta  J.  mjcoleman@tomichi.ghs.gunnison.kI2.co.us 

Gunnison  High  School  and  Western  State  College,  800  West  Ohio, 

Gunnison,  CO,  81230 

Collier,  Sunya  T.  scollier2@gsu.edu 

Georgia  State  University,  5 18  College  of  Education.  30  Pryor  Street, 

Atlanta,  GA,  30303 

Collins,  Burton  A, 

Governors  State  University,  College  of  Education,  University  Park,  IL, 

60466 

Colwell,  Brad  bcolwell@siu.edu 

Southern  Illinois  University,  Department  of  Ed  Admin  and  Higher 
Education,  Carbondalc,  IL,  62901-4606 
Connor,  Kathy  R. 

Iowa  State  University 

Coopman,  John  T. 

Eastbrook  Community  Schools 

Corley,  Edward  L.  datwin49@infinet.com 

Miami  University,  Department  of  Educational  Leadership,  350  McGuffey 
Hall,  Oxford,  OH,  45056 

Coutts,  Douglas  J.  coutts@ipfw.edu 

Indiana  Purdue  University  - Fort  Wayne,  School  of  Education.  NF  240  F, 
2101  Colcsium  Blvd.  East,  Fort  Wayne,  IN,  46805-1499 
Crader,  Allan 

Southwest  Missouri  State  University 

Cramer,  Susan  R.  cramer@uwosh.edu 

COEHS,  University  of  Wisconsin  - Oshkosh,  800  Algoma  Blvd,  Oshkosh, 
WI,  54901 

Crawford,  John 

Millard  Public  Schools,  5606  South  147th  Street,  Omaha,  NE,  68137 

Crooks,  Steven  M. 

Southern  Illinois  University 

Cross,  Larry  D.  l-cross@govst.edu 

Governors  State  University,  University  Parkway.  University  Park,  IL, 

60466 

Cruz,  Josue  jcruz@tempest.coedu.usf.edu 

University  of  South  Florida,  1 1506  Norval  Place,  Temple  Terrace,  FL, 

33617 

Cummings,  Shantill 

Illinois  State  University,  Campus  Box  5910,  Normal,  IL,  61790-5910 

Czerniak,  Charlene  cczerni@uoft02.utoledo.edu 

The  University  of  Toledo,  College  of  Education.  2801  West  Bancroft 
Street,  Toledo,  OH,  43606 

D’Costa,  Ayres  G.  dcosta.l@osu.edu 

The  Ohio  State  University.  5422  Teak  wood  Court,  Columbus,  OH,  43229 

Darr,  Alice 

University  of  Akron,  715  Doramor  Street,  Kent,  OH 

Darr,  Ralph  F. 

University  of  Akron,  715  Doramor  Street,  Kent,  OH.  44240 

Davis,  Josephine  B.  93barry>davis 

Western  Michigan  University,  1020  Weaver  Ave.,  Kalamazoo,  MI,  49006 

Davis,  Kevin  kdavis22@aol.com 

Southeast  Kansas  Education  Service  Center,  3 107  West  21st  Street, 

Topeka.  KS,  66604 

Davis,  Michaeleen 

Indiana  State  I tniversity 

Daytner,  Gary  T.  gdaytncr@indiana.edu 

Indiana  University,  402 ID  Wright  Education  Building,  201  N.  Rose  Ave, 
Bloomington.  IN.  47405 

De  Luca,  Barbara  M. 

University  of  Dayton 

DcMoulin,  Donald  F. 

University  of  Tcnncsscc-Martin 
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Dennen,  Vanessa  P.  vdennen@indiana.edu 

Indiana  University,  1200  Rolling  Ridge  Way,  Apt.  1205,  Bloomington,  IN, 
47403 

Derby,  LeAnn 

The  Ohio  State  University 
DiCintio,  Matt 
Elmhurst  College 
Diez,  Mary’ 

Alvemo  College,  Department  of  Education,  3401  South  39th  Street,  P.O. 

Box  343922,  Milwaukee,  WI,  53234 

Dillon,  Ronna  F.  rdillon@siu.edu  or  DrRDillon@aol.com 
Southern  Illinois  University  at  Carbondalc.  Dept,  of  Educ.  Psychology  and 
Spec.  Educ.,  Mailcode  4618,  Carbondale,  IL,  62901 
Dimitrov,  Dimiter  M.  ddimitrov@educ.kent.edu 

Kent  State  University,  507  White  Hall,  College  of  Education,  Kent,  OH, 
44242-0001 
Dorsch,  Nina 

Northern  Illinois  University 

Dowd,  Brian  L. 

Southern  Illinois  University 

Drechtrah,  Mary  E.  Drecktrm@uwosh.edu 

University  of  Wisconsin  - Oshkosh,  800  Algoma  Blvd.,  Oshkosh,  WI, 

54901 

Dretzke,  Beverly  J.  dretzkbj@uwec.edu 

University  of  Wisconsin  - Eau  Claire.  Department  of  Psychology,  Eau 
Claire,  WI,  54702-4004 

Duel!,  Orpha  K. 

Wichita  State  University,  322  Hubbard,  Box  123,  Wichita,  KS,  67260- 
0123 

Duemer,  Lee  S.  lee-duemer@uiowa.edu 

The  University  of  Iowa,  College  of  Education,  N442  Lindquist  Center, 

Iowa  City,  IA.  52242 

Duncan,  John  C.  jduncan@tech.kent.edu 

Kent  State  University,  i 1 0 1 Temple  Trail,  Stow,  OH,  44224 

Duncan,  P.  Kay  duncanpk@emporia.edu 

Emporia  State  University,  1200  Commercial,  Emporia,  KS,  66801-5087 

Dunwoody,  Bonnie  dunwoody@saintmaiys.edu 

Saint  Mary’s  College,  Box  20  Madcleva  Hall,  Notre  Dame,  IN,  46556- 
5001 

Dutt-Doner,  Karen 

University  of  New  England,  1 1 Hills  Beach  Road.  Biddeford,  MA,  04005 

Dye,  Gloria  A. 

Washbum  University,  3329  S.W.  Oak  Parkway,  Topeka,  KS.  66614 

Earley,  Mark  A.  Markstat98@aol.com 

University  of  Toledo,  5916  Rcwyck  Drive,  Toledo,  OH,  43614 

Echols,  Celina  V.  cechols@selu.edu 
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Rodgers,  Adrian  rodgers.50@osu.edu 
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Rogers,  Bruce  G.  Bruce.Rogers@uni.edu 
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Runyon,  Charles  K. 

Pittsburg  (Kansas)  State  University 

Sage,  Sara  M.  ssage@iusb.edu 
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Seol,  Hyunsoo 
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Rehabilitation  Foundation  Inc.,  2102  Timbcrlanc,  Wheaton.  IL,  60187 

Smith,  Sean  J.  seanj@bgnet.bgsu.edu 
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University  of  Kansas 
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University  of  Kansas 
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University  of  Wisconsin  - Whitc\sater 
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Subkoviak,  Michael  J. 
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Suddick,  David  E. 

Governors  State  University 

Supley,  Michael  L. 

Texas  A&M  University  at  Kingsville,  P.  O.  Box  610,  Kingsville,  TX, 
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Surber,  John 

University  of  Wisconsin  - Milwaukee,  Box  413,  Department  of 
Educational  Psychology,  Milwaukee.  WI,  53201 
Thomas,  Anna  Marie  M. 
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The  Ohio  State  University,  310  Ramseyer  Hall,  29  West  Woodruff, 
Columbus,  OH,  43210 
Thomas,  Laurie 
Ball  State  University 
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Ball  State  University,  Teachers  College  915.  Department  of  Educational 
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Northern  Illinois  University 
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Ball  State  University 

Timm,  Joan  T.  timm@vaxa.cis.uwosh.edu 

University  of  Wisconsin  - Oshkosh,  Department  of  Educational 
Foundations,  800  Algoma  Avenue,  Oshkosh,  WI,  54901 
Tomal,  Daniel  R.  crfiomaldr@crf.cuis.edu 

Concordia  University,  7400  Augusta,  River  Forest,  IL,  60305-1499 

Torrence,  Eileen 

Indiana  State  University 

Tortorice,  Charlene  E. 

University  of  Wisconsin  - Madison 

Tripses,  Jenny  S.  jtripses@dave-world.net 

Bloomington  District  87,  2 Rcmi  Court,  Bloomington,  IL,  61704 

Turk,  Randall  L.  turk@wsuhub.uc.twsu.edu 

Wichita  Slate  University,  1845  Fairmont,  Wichita,  KS,  67260-0142 

Valente,  Sharon  A.  svalente@ashland.edu 

Ashland  University,  16D  Miller  Hall,  Ashland,  OH,  44805 

Van  Loon,  Preston  C 

204  Pine  Drive,  Orangeville,  IL,  61060 

VanVoorhis,  Judy  L.  MC_JUDY@OMERESA.OHlO.GOV 
Ohio  Schoolnet,  205  N.  Seventh  Street,  Zanesville,  OH,  43701 
Victorson,  David  E.  dvictors@indiana.edu 

Indiana  University,  3093  East  Amy  Lane,  Bloomington,  IN,  47408 
Viragoontavan,  Sunanta 
The  Ohio  State  University 

Waechter,  Donna  R.  Waechter@JX.netcom.com 

University  of  Akron,  4496  Lahm  Drive,  Akron,  OH,  44319 

Walker,  John  H.  jwalker@oratmail.cfa.ilstu.edu 

Illinois  St3tc  University,  Department  of  Art,  Campus  Box  5620,  Normal, 

IL,  61790-5620 
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Texas  A&M  University  at  Corpus  Christi,  FC  2 19  6300  Ocean  Drive, 
Corpus  Christi,  TX.  78412 

Waltershausen,  Cynthia 

Western  Illinois  University,  Dcparmcnt  of  Ed  Admin  and  Supervision, 
Macomb,  IL,  61455 
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Illinois  State  University,  332  DcGarmo  Hall,  Campus  Box  5900,  Normal, 
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University  of  Chicago,  6121  S.  Woodlawn  Ave.,  Chicago,  IL,  60637 
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Southwest  Missouri  State  University 

Wegner,  Scott  B.  sbw85IJ@wpgate.smsu.cdu 

Southwest  Missouri  State  l 'mxerxits,  #8  Monroe  Hall.  901  South  National. 
Springfield,  MO,  (>5804 
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Wells,  Craig  S. 

University  of  Wisconsin  * Madison 

Wesson,  Suzanne  E.  swesson@gte.net 

Hays  Independent  School  District,  4800  Jack  C.  Hays  Trail,  Buda,  TX, 
78610 

Wham,  Mary  A.  whamm@uwwvax.uww.edu 

University  of  Wisconsin  - Whitewater,  Department  of  Curriculum  and 
Instruction,  800  West  Main  Street,  Whitewater,  WI,  53 1 90 

White,  Mark 

Northern  Illinois  University 

Wigle,  Stanley  E.  swigle@utm.edu 

University  of  Tennessee  - Martin,  240  Gooch  Hall,  Martin,  TN,  38238 
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Wayne  State  College,  Dept,  of  Education,  1111  Main  St.,  Wayne,  NE, 

68787 
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Rush  University,  Department  of  General  Surgery,  1653  West  Congress 
Parkway,  Chicago,  IL,  60612-3833 

Williams,  Don  williams.776@osu.edu 

The  Ohio  State  University,  948  Annagladys,  Woethington,  OH,  43085 
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The  Ohio  State  University,  ELLI  Research,  1929  Kenny  Road,  Suite  100, 
Columbus,  OH,  43210 


Wilson,  Jennifer  A.  wilson.618@osu.edu 

The  Ohio  State  University,  310  Ramseyer  Hall,  29  W.  Woodruff  Ave., 
Columbus,  OH,  43210 

Wineberg,  Lenore  P.  Wineberg@uwosh.edu 

University  of  Wisconsin  - Oshkosh,  COEHS  N/E  504,  Oshkosh,  WI, 

54901 

Winterfeldt,  Henry 

COEHS,  UW  Oshkosh 
Wiseman,  Donna  L. 

Northern  Illinois  University 
Wolfle,  Jane 

Bowling  Green  State  University 

Wright,  Benjamin  mesa@uchicago.edu 

University  of  Chicago,  5835  Kimbark  Avenue,  Chicago,  IL,  60637 
Yonghee,  Kim 

The  Ohio  State  University 

Yoo,  Soonhwa  yoo.33@osu.edu 

The  Ohio  State  University,  310  Ramseyer  Hall,  29  W.  Woodruff  Ave., 
Columbus,  OH,  43210-1177 
Young,  Alice 

Morehead  State  University 
Young,  Allison  J. 

Western  Michigan  University 

Zlogar,  Katherine 

Washington  School,  East  Maine  District  63 


Call  for  Editors 

Mid-Western  Educational  Researcher 

Journal  of  the  Mid-Western  Educational  Research  Association 

Proposals  are  currently  being  sought  for  the  Editorship  of  the  Mid-Western  Educational  Researcher.  The  Researcher  is  the  quarterly 
publication  of  the  Mid-Western  Educational  Research  Association,  with  the  summer  issue  of  each  year  serving  as  the  annual  meeting 
program.  The  journal  serves  the  dual  function  of  providing  MWERA  members  with  timely  information  about  the  organization  and  of 
providing  a vehicle  for  dissemination  of  scholarly  work  in  education  or  education  related  fields.  This  dual  mission  reflects  the  growth 
and  change  of  the  organization  itself  in  recent  years. 

The  three-year  appointment  of  the  current  editorial  team  will  expire  in  October,  1999.  The  appointment  of  the  next  editor  or  editorial 
team  will  be  from  October,  1999  through  October,  2002.  However,  it  is  anticipated  that  selection  of  the  new  editorial  staff  will  be 
made  in  sufficient  time  to  allow  the  new  staff  to  work  with  the  existing  staff  during  much  of  the  1998-99  year.  Proposals  are  sought 
from  individuals  and  teams  interested  in  assuming  responsibility  for  the  operation  and  direction  of  the  Researcher  for  a three-year 
period.  The  format  for  proposals  is  open,  but  each  proposal  should  include  at  least  the  following: 

(1)  Name,  institutional  affiliation,  address,  telephone  and  FAX  numbers,  and  e-mail  address  of  each  member  of  the  proposed 
editorial  team; 

(2)  A vision  statement  indicating  the  editorial  team’s  intended  goals  for  the  journal,  and  an  explanation  of  how  this  vision 
reflects  the  membership,  perspectives,  and  direction  of  MWERA; 

(3)  A proposed  plan  for  promoting  this  vision;  and 

(4)  An  explanation  of  the  expertise  and  qualifications  of  the  editorial  team  which  are  likely  to  encourage  the  continued 
improvement  and  development  of  the  Researcher. 

Proposals  should  be  submitted,  no  later  than  October  l,  1998,  to  the  President  of  MWERA,  Dr.  Kim  Metcalf,  at: 

Dr.  Kim  Metcalf,  Director 
Indiana  Center  for  Evaluation 
Smith  Research  Center,  Suite  1 74 
2805  East  10th  Street 
Bloomington,  Indiana  47408 

Questions  maybe  directed  to  Ms.  Rebecca  Gross,  Administrative  Assistant,  at  (812)  855-4438,  FAX  (812)  856-5890,  or  e-mail: 
iuice@indiana.cdu. 
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On  the  Cover 

Teachers  Collbg^  Ball. State  University,  is  Accredited  by  the  National  Council  for  the 
Accreditation  of  Teacher  Education  (NCATE)  and  is  a member  df  The  New  Holmes  Part- 
nership.  The  College  is  committed  to  demonstrating  excellence  in  P- 12  education,  and  to 
preparing  outstanding  professional  educators  and  human  service-  providers,  supporting  their 
induction  and  continuing  education,  promoting  research  and  development  in  their  fields, 
and  influencing  policy  to  enhance  their  efforts. 

Teachers  College  seeks  to  fulfill  this  mission  through  the  development  and  provision  of 
outstanding  programs  for  the  preparation  of  professional  educators  and  human  service  pro- 
viders, an  institutional  system  of  performance  assessment  for  professional  educators,  sig- 
nificant and  meaningful  experimentation  and  innovation,  exemplary  demonstration  and 
research' opportunities  for  P-12  education  professionals,  outstanding  models  for  professional 
development  schools  and  collaborative  school  renewal  efforts,  high  quality  programs  and 
services  for  exceptional  learners  and  individuals  with  special  needs,  an  array  of  educational 
and  human  resource  services  aimed  at  improving  the  quality  of  life  for  citizens,  strategies 
for  effective  and  appropriate  uses  of  technology,  meaningful  international  and  multicultural 
experiences  and  opportunities,  and  an  outstanding  and  diverse  faculty  of  teacher-scholars. 

Teachers  College  programs  are  designed  to  produce  professional  educators  and  human 
service  providers  who  understand  the  content  of  their  disciplines,  understand  the  develop- 
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Abstract 

This  study  utilized  the  World  Wide  Web  and  a “ Class  Page"  to  evaluate  interaction  strategies  in  a 
distance  education  setting . Participants  were  primarily  elementary  school  teachers  f/i=  47  graduate 
students ) who  completed  sur\*ey  instruments  concerning  their  participation  on  the  “ Class  Page ”,  inter- 
actions with  both  the  instructor  and  other  students,  and  utilization  of  linked  Web  resources . An  initial 
survey  regarding  students1  computer  literacy  skills  and  usage  proficiencies  was  followed  by  seven  addi- 
tional surveys  which  focused  upon  l,Page  ” use  and  interaction  patterns . Among  the  findings  were: 
student  views  regarding  the  value  of  getting  to  know  fellow  classmates  shifted  from  zero  percent  (Week 
2)  to  88  percent  (Week  15);  students  judging  they  were  able  freely  to  express  their  views  went  from  11 
percent  (Week  2)  to  91  percent  (Week  15 J.  Increases  were  also  noted  concerning  student  out-of  class 
participation , enjoyment  using  the  Internet , use  of  e-mail,  and  appreciation  of  the  distance  environment 
tools  for  encouraging  involvement  and  interaction.  Although  many  students  questioned  the  usefulness 
of  the  “ Page  ” at  the  beginning  of  the  semester,  the  final  survey  found  all  students  viewed  the  "Page"  as 
beneficial.  Analysis  of  the  data  found  both  interaction  and  class  involvement  were  greatly  enhanced 
through  the  “ Class  Page  " and  the  Web  based  tools  which  supported  the  "Page"  in  this  distance  educa- 
tion environment. 


Introduction 

The  Internet,  specifically  the  World  Wide  Web,  has  the 
potential  to  reinforce  and  enhance  university  teaching  and 
learning.  It  is  beginning  to  have  a massive  impact  upon  fac- 
ulty and  students  on  many  college  campuses.  Jeffrey  R.  Young 
reported  in  the  Chronicle  of  Higher  Education  that  UCLA 
“will  provide  a Web  page  for  every  course  in  its  largest  unit, 
the  College  of  Letters  and  Science",  by  the  beginning  of  the 
upcoming  Fall  1997  Semester.  This  promise  “amounts  to  a 
revolution  in  the  way  the  university  views  the  Internet'’ 
(Chronicle  of  Higher  Education , August  1 , 1997). 

Much  of  the  hype  behind  this  clamor  has  been  based 
upon  reported  early  successes  of  Web  class  pages.  As  a 
result,  some  colleges  and  administrators  have  concluded 
such  pages  should  become  universal  because  the  utiliza- 
tion benefits  of  this  powerful  communication  strategy  have 
been  so  obvious.  The  easy  access  to  information  and  learn- 
ing activities  provided  through  the  Web  create  a newly  de- 
fined learning  environment.  The  dynamic  and  pervasive 
nature  of  Web  technologies  make  the  prospect  of  gaining 
access  to  information,  communication,  and  learning  through 
this  format  an  educational  transformation  that  is  just  begin- 
ning to  emerge. 

The  example  from  UCLA  is  common  at  many  universi- 
ties; however,  these  developments  raise  questions  such  as: 
What  data  have  been  collected  regarding  both  learning  ef- 


fectiveness and  student  experiences  utilizing  Web  based  tech- 
nologies? What  strategies  arc  planned  to  assist  technophobic 
faculty  in  developing  the  requisite  skills  to  develop  learner 
focused  Web  pages?  What  type  of  technical  support  is  needed 
to  develop  dynamic  interactive  uses  of  the  Web?  Does  the 
Internet  provide  the  educational  promise  that  seems  so  real? 
Will  this  technology  stimulate  faculty  and  students  to  teach 
and  learn  in  different  ways?  Can  learning  communities  be 
developed  and  sustained  utilizing  this  technology? 

Purpose  and  Methodology 

Educational  theorists  have  long  claimed  that  effective 
learning  is  enhanced  by  the  active  involvement  of  the  learner 
(sec:  Rotter,  1954;  Rogers.  1969;  Astin,  1984;  Holmberg, 
1989;  and  Johnson  & Johnson,  1994).  If  learning  requires 
interaction  among  learners,  then  educators  need  to  develop 
and  assess  strategies  that  encourage  interaction  in  the  edu- 
cational setting.  It  is  critical  to  plan  for  interactivity  in  a 
distance  education  setting  in  which  one  way  video  with  two 
way  audio  is  utilized  as  the  delivery  system,  as  was  the  case 
in  this  study  environment.  The  specific  focus  of  this  study 
was  a distance  education  classroom  that  utilized  the  World 
Wide  Web  and  a “Class  Page"  designed  and  developed  for 
a specific  graduate  level  course  in  Curriculum. 

The  purpose  of  the  study  was  to  collect  data  regarding 
the  impact  of  utilizing  an  asynchronous  “Class  Page”  to  en- 


hance:  ( I)  interaction  between  the  instructor  and  students, 
(2)  interaction  between  students  and  peers  at  different  sites, 
and  (3)  student  utilization  of  Web  resources  provided  through 
the  "Class  Page”. 

The  participants  were  primarily  elementary  school 
teachers  (47  graduate  students)  enrolled  in  a television  course 
entitled  "Elementary  School  Curriculum”  (EdCur  6 1 0)  dur- 
ing the  Spring  Semester.  1997.  Data  were  collected  through 
the  use  of  survey  instruments  developed  to  determine  par- 
ticipants’ perceptions  and  actions  regarding  the  ‘‘Class  Page” 
and  their  interactions  with  both  the  instructor  and  other  stu- 
dents enrolled  in  the  class.  An  electronic  Web  compatible 
survey  software,  "inQsit”,  developed  by  the  University  Com- 
puting  Services  at  Ball  State  University,  was  utilized  to  col- 
lect data  through  the  "Class  Page”  itself.  This  resource 
provided  a wide  array  of  survey  and  questionnaire  options: 
Instruments  using  Likert  type  scales,  semantic  differential 
formats,  single  word  responses,  short  answer  responses,  and 
essay  responses  were  used  to  collect  the  data. 

A series  of  time  dated  surveys  (eight  totally)  were  ad- 
ministered during  die  semester.  Data  collected  from  these 
surveys  were  compiled  and  reported  in  raw  numbers  and  per- 
centages rounded  to  the  nearest  whole  number.  The  resulting 
frequency  and  interaction  patterns  were  used  to  interpret  the 
responses  and  activities  attributed  to  the  "Class  Page”. 

Why  Create  a '‘Class  Page”? 

The  "Class  Page”  was  designed  and  developed  to  in- 
crease student  interaction  in  a typical  distance  learning  en- 
vironment. The  development  process  was  a team  effort  which 
involved  multiple  campus  units:  the  University  Computing 
Services,  the  Teleplex,  the  University  Library,  and  the  De- 
partment of  Educational  Leadership.  The  individuals  from 
these  units  who  worked  on  this  team  possessed  varied  and 
unique  skills  that  were  essential  to  the  creation  and  utiliza- 
tion of  an  interactive  "Class  Page”. 

As  consumers  of  television  most  adults  have  learned  to 
be  passi-  c in  response  to  this  medium,  i.e.  we  view  and  do 
not  expect  to  be  engaged  in  dialogue  with  cither  the  pre- 
senter or  the  topic.  To  combat  this  existing  learned  behav- 
ior, the  "Page”  was  designed  to  promote  active  student 
involvement  in  the  learning  process  both  prior  to  coming  to 
the  class  and  during  the  live  broadcast  itself. 

Students  taking  classes  at  off-campus  sites  do  not  have 
the  resource  advantages  of  those  on  campus.  To  minimize 
this  problem,  a multitude  of  instructional  resources  was  pro- 
vided on  the  "Class  Page”.  For  example,  the  University  Li- 
brary was  on  the  Web  and  electronically  linked  to  every 
college  and  university  library  in  the  state.  Adding  this  link 
made  access  feasible  for  each  distance  site  student  to  an\ 
higher  education  library  in  the  state.  Several  other  library 
links  such  as  the  Library  of  Congress,  a virtual  reference 
library,  and  several  Internet  libraries  were  established  to 
promote  accessibility  and  minimize  travel  time  for  securing 
resources.  Numerous  Web  links  were  added  to  promote 


additional  resource  opportunities  for  students,  c.g.  sites  of 
on-line  journals  and  magazines,  specific  content  areas,  state 
and  federal  government  education  agencies,  museums,  pro- 
fessional organizations,  children’s  resources,  teacher  re- 
sources, and  multiple  search  engines  were  linked  for  students 
to  explore  and  to  utilize  in  preparing  for  class. 

A specific  goal  of  the  "Class  Page”  was  to  establish  a 
forum  for  students  to  exchange  ideas,  experiences,  and  suc- 
cesses. This  was  accomplished  through  the  creation  of  user 
friendly  pages  that  enabled  the  students  to  post  ideas  di- 
rectly on  the  Web  by  providing  information  on  a brief  form, 
typing  messages,  and  clicking  the  "post”  button.  Three  pages 
utilized  this  process:  (1)  "Motivation  Ideas.”  a page  where 
students  posted  ideas  found  to  be  valuable  learning  activi- 
ties for  elementary  students,  i.c.  classroom  successes;  (2) 
"Projects,”  a page  where  students  posted  their  work  on  a 
project  where  peers  could  develop  knowledge,  provide  as- 
sistance, and  share  experiences  as  the  individual  or  group 
worked  on  the  activity;  and  (3)  “Discussion  Area,”  a modi- 
fied newsgroup  format  where  students  could  discuss  class 
topics  and  respond  to  the  views  of  their  classmates  prior  to 
the  class  meeting  when  the  topic  was  discussed.  Students 
could  post  questions  or  follow-up  discussion  items  follow- 
ing the  class.  Each  of  these  public  areas  was  put  on  the  Web 
for  consumption  by  the  instructor,  graduate  assistants,  and 
class  members. 

A private  forum  was  needed  for  student  exchanges  with 
the  instructor,  graduate  assistants,  and  class  peers  as  well  as 
with  working  class  groups.  A post  office  was  established 
with  e-mail  addresses  which  linked  class  members  to  each 
other  privately.  To  personalize  the  post  office,  a small  indi- 
vidual photo  icon  was  added  to  individual  e-mail  links.  This 
aspect  of  the  “Class  Page”  was  not  monitored  by  the  in- 
structor; however,  feedback  from  many  students  indicated 
that  this  was  a valuable  aspect  of  the  communication  pro- 
cess and  one  that  was  used  extensively  in  dialogue  with  peers, 
instructor  and  graduate  assistants.  The  instructor  typically 
received  e-mail  from  tv/o-thirds  of  the  class  members  weekly. 
During  the  semester  all  distant  site  students  communicated 
with  the  instructor  through  this  process. 

The  instructor  prepared  a "Class  Questions”  page  as  a 
way  of  stimulating  student  thought  about  specific  topics  prior 
to  class.  This  also  encouraged  and  assisted  the  students  in 
their  class  preparation.  Students  were  encouraged  to  dia- 
logue with  other  students  in  the  "Discussion  Area”  before 
the  class  regarding  their  experiences  and  thoughts  on  the 
topic.  The  instructor  also  provided  a "Class  Handouts”  page. 
This  page  included  links  to  Web  sites  and  resources  that 
pertained  to  the  topic  and  handouts  which  were  scanned  and 
put  on  the  Web  site  for  student  use.  These  were  designed  to 
assist  the  student  in  locating  resources  on  the  topic.  They 
could  also  be  used  for  the  weekly  written  critiques  regard- 
ing the  topic  or  area  being  discussed.  Both  the  "questions  " 
and  the  "handouts”  were  designed  to  enhance  class  prepara- 
tion and  to  make  time  spent  in  class  more  interesting  and 
valuable. 
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One  of  the  planned  purposes  of  this  teaching  / learning 
experience  was  to  model  instructional  technology  and  its 
uses  for  teachers  and  schools.  Dr.  Albert  Schweitzer  elo- 
quently expressed  this  concept  several  years  ago  when  he 
stated:  “Modeling  isn’t  the  best  way  to  teach.  It  is  the  only 
way  to  teach.”  Classroom  teachers  and  elementary  schools 
need  to  be  exposed  to  alternative  teaching  and  learning  styles. 
It  is  essential  these  be  modeled  in  the  university  distance 
learning  environment.  The  old  adage  “we  teach  as  we  were 
taught”  may  be  all  too  accurate;  however,  we  need  not  per- 
petuate the  “talking  head”  syndrome  in  distance  education. 
To  establish  a learning  community  in  the  distance  education 
environment  it  is  essential  to  think  about  the  models  utilized 
in  presenting  the  course  content. 

The  “Class  Page”  was  created  to  accomplish  the  fol- 
lowing goals: 

• to  increase  classroom  interaction 

• to  provide  instructional  resources 

• to  establish  a communication  forum 

• to  supplement  class  preparation 

• to  create  a user  friendly  site,  and 

• to  model  instructional  technology 

The  overarching  goal  in  the  developmental  process  was 
simple.  The  instructor  wanted  what  every  teacher  wants — 
student  involvement  and  engagement  in  learning!  The  chal- 
lenge was  to  create  a dynamic,  interactive  learning  commu- 
nity in  a distance  education  environment. 

Data  Relative  to  the  Utilization  of  the  “Class  Page” 

At  the  beginning  of  the  semester  students  were  surveyed 
regarding  their  computer  literacy  skills  and  usage  patterns. 
These  data  were  critical  to  the  success  of  the  project  since 
computer  skills  were  essential  to  the  effective  use  of  Web 
based  technologies.  Initially  70%  of  the  population  reported 
they  had  a personal  computer  in  their  home;  92%  had  a com- 
puter available  at  work.  Both  were  used  primarily  in  word 
processing  tasks.  However,  only  57%  of  the  available  com- 
puters had  Internet  access.  The  prime  Internet  provider  was 
America  On-line  (19%  of  the  total  population);  these  data 
were  of  value  later  because  during  the  semester  the  only 
provider  that  consistently  had  problems  in  actively  enabling 
students  to  use  the  sites  and  post  ideas  to  the  class  Web  site 
were  students  using  the  AOL  service.  This  could  be  ex- 
plained in  part  due  to  the  heavy  traffic  found  on  this 
provider’s  service,  but  the  system  interfaces  and  early  soft- 
ware did  not  support  the  interactivity  available  through  the 
“Class  Page”.  Only  54%  of  the  students  had  previously  used 
electronic  mail.  Eight  percent  (8%)  of  the  students  enrolled 
in  the  class  used  the  Internet  on  a regular  basis;  yet,  only 
one  in  three  students  had  used  the  Internet  more  than  once 
prior  to  this  class.  Fifty-seven  per  cent  (57%)  had  never 
performed  an)  function  on  the  Internet.  The  overwhelming 
majority  of  those  enrolled  did  not  have  familiarity  with 
newsgroups,  chat  rooms,  or  search  engines.  Only  5%  of  the 


population  described  themselves  as  being  “very  skilled”  in 
using  this  resource.  When  asked  if  computer  training  would 
be  helpful,  72%  responded  in  the  affirmative;  and  86%  re- 
quested help  in  using  the  Internet.  When  asked  “which  com- 
puter-related area(s)  do  you  anticipate  will  be  a challenge”: 
27%  indicated  finding  an  available  Internet-linked  computer; 
14%  thought  personal  lack  of  computer  skills  would  be  a 
problem;  22%  expressed  discomfort  with  computer  use;  43% 
expressed  concern  about  getting  help  with  computer  related 
problems;  and  30%  did  not  anticipate  the  above  areas  would 
be  a challenge. 

The  above  data,  combined  with  additional  data  not  re- 
ported here,  confirmed  an  erroneous  assumption;  we  had 
over-assumed  both  skill  levels  and  experiences  in  our  popu- 
lation. This  challenge  was  perceived  as  an  opportunity  to 
provide  valuable  experiences  and  skills  to  a group  of  pro- 
fessional educators  and  thereby  enhance  their  classroom  ef- 
fectiveness. 

The  survey  administered  following  the  first  two  weeks 
of  class  confirmed  our  optimism  regarding  the  student  per- 
spective of  viewing  this  as  an  opportunity.  Using  a five  point 
scale  from  “strongly  disagree”  to  “ strongly  agree”,  85%  of 
the  students  agreed  or  strongly  agreed  they  would  learn  new 
computer  skills  using  the  “Class  Page”.  Almost  four  of  ev- 
ery five  students  (79%)  indicated  they  enjoyed  exploring 
the  resources  available  on  the  “Class  Page”.  Seventy-one 
per  cent  (71%)  strongly  agreed  exploring  the  Internet  was 
an  enjoyable  new  experience. 

Frustration  was  also  expressed  with  the  new  expecta- 
tion associated  with  using  this  resource.  Students  did  not 
see  the  “Class  Page”  as  a way  to  get  to  know  fellow  class- 
mates (no  one  “agreed”  or  “strongly  agreed”  with  this  state- 
ment), and  few  saw  the  “Page”  as  a vehicle  to  discuss  class 
content  (29%  “agreed”  or  “strongly  agreed”).  Only  11% 
“agreed”  it  was  a vehicle  to  express  their  views.  This  early 
feedback  indicated  we  desperately  needed  tu  teach  the  stu- 
dents to  utilize  the  “Page”  as  a learning  and  communicating 
resource.  In  spite  of  these  frustrations  83%  of  the  students 
provided  specific  examples  of  content  or  ideas  that  were 
helpful  to  them  in  the  initial  classes.  In  other  words,  class 
meeting  time  was  conforming  to  or  exceeding  their  expecta- 
tions. This  was  not  a surprise  as  this  was  familiar  territory 
for  the  students  based  upon  their  previous  class  experiences. 

Initial  attempts  by  students  to  utilize  the  Web  technolo- 
gies pointed  out  specific  problem  areas.  An  early  determi- 
nation was  made  to  avoid  as  many  frustration  areas  with  the 
“Page”  as  possible  for  the  students.  The  first  attempt  to  use 
e-mail  was  only  marginally  successful,  as  most  students  at 
the  distance  sites  did  not  know  the  personal  password  for 
their  VAX  account  through  the  University  computing  sys- 
tem to  access  e-mail.  In  fact,  most  of  these  students  had  not 
previously  used  the  campus  computing  system.  The  “Dis- 
cussion Area”  was  originally  an  external  newsreader  pro- 
gram and  students  without  previous  experience  using  such 
technologies  struggled.  Rather  than  spend  time  trying  to 
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make  what  had  been  proposed  work,  new  solutions  were 
created;  early  technical  failures  were  rapidly  discontinued. 
The  University  Computing  Services  personnel  contributed 
many  hours  of  work  to  make  needed  changes  and  to  create 
user-friendly  applications.  Ultimately  Web  based  e-mail  was 
developed  to  correct  the  first  problem,  the  second  problem 
was  changed  by  developing  a Web  based  newsreader.  These 
early  frustrations  were  intimidating  for  some  students  and 
probably  slowed  their  willingness  to  engage  in  interaction 
through  the  “Page’*. 

As  the  semester  progressed,  more  students  engaged  in 
utilizing  the  “Class  Page”  as  a learning  resource.  At  six 
weeks,  58%  of  the  students  indicated  they  were  secure  in 
their  use  of  the  “Page”;  62%  acknowledged  it  encouraged 
out-of-class  participation;  and  two  of  three  students  reported 
they  enjoyed  exploring  the  Internet  through  the  “Page”.  Half 
of  the  students  reported  they  found  additional  class  resources 
through  the  web  sites  posted  on  the  “Page”,  and  77%  re- 
ported they  were  using  e-mail  to  correspond  with  fellow  stu- 
dents. 

By  the  10th  and  1 1th  week  the  feedback  on  the  utiliza- 
tion of  the  “Page”  was  becoming  increasingly  positive.  Three 
of  every  five  students  reported  the  distance  learning  setting 
encouraged  class  involvement.  Over  three  of  four  students 
(76%)  indicated  the  “Discussion  Area”  on  the  “Page”  was 
encouraging  the  examination  of  important  topics;  83%  of 
the  respondents  stated  they  were  gaining  important  computer 
competencies;  86%  reported  the  “Page”  was  user  friendly. 
Regarding  the  earlier  reported  fear  of  personal  technical 
problems,  91%  reported  they  thought  the  University  sup- 
port provided  was  very  good  or  excellent.  Other  aspects  of 
the  “Page”  were  designed  to  encourage  interactivity,  and 
respondents  reported  course  “handouts”  as  very  good  or 
excellent  (72%);  “class  questions”  were  stimulating  for 
thought  and  discussion  (78%  );  the  notice  board  was  keep- 
ing them  informed  (84%);  the  linked  Web  sites  were  pro- 
viding valuable  educational  resources  (81%);  and  the 
usefulness  of  the  “Page”  was  judged  as  valuable  (80%). 
More  than  four  of  every  five  students  (83%)  gave  examples 
of  actions  they  had  taken  to  make  the  “Page”  valuable  to 
them  in  oui-ot-class  activities. 

A survey  administered  during  the  13th  week  of  the  se- 
mester found  that  66%  of  the  students  were  regularly  using 
the  “Page”  to  interact  with  classmates.  Only  6 % reported 
they  “strongly  agreed”  with  the  statement  “1  am  frustrated 
when  using  the  ‘Class  Page'."  When  asked  about  concerns, 
two  students  expressed  continuing  frustrations  with  estab- 
lished class  expectations,  and  five  described  concerns  that 
would  be  analyzed  as  positive:  c.g.,  “I  have  cnjo>cd  this 
class.  Sorry  for  the  delay  in  the  submission  of  . . and  “I 
am  always  concerned  with  keeping  up  with  class  assignments, 
but  so  far  it  hasn't  been  a big  problem.”  Seventy-two  per 
cent  (72%)  of  the  respondents  provided  specific  examples 
of  concepts  or  ideas  they  found  helpful  from  using  the  “Page” 
and  attending  class  during  the  previous  week. 


The  final  class  survey,  a required  Faculty  / Course  As- 
sessment Form,  was  administered  during  the  15th  week  of 
the  semester.  Several  questions  were  repeated  on  this  Form 
to  determine  if  changes  had  occurred  in  student  perceptions 
regarding  the  “Class  Page”  and  the  way  it  was  used.  The 
respondents  (62%)  reported  that  interactions  on  the  “Page” 
stimulated  critical  thinking.  Eighty-five  per  cent  (85%) 
deemed  the  resources  on  the  “Class  Page”  to  be  relevant  to 
course  objectives  and  their  learning;  and  77%  judged  the 
“Page”  helped  achieve  course  purposes.  When  judging  the 
expectations  of  students  using  the  “Page”  82%  reported  this 
was  appropriate  to  their  current  level  of  development.  Over 
nine  of  every  ten  students  (91%)  indicated  they  felt  free  to 
express  “ideas,  judgments,  and  questions”. 

The  fundamental  purpose  behind  the  development  of 
this  technology  was  to  increase,  interaction.  Eighty-eight 
per  cent  (88%)  of  the  students  reported  interactions  with 
other  students  as  very  helpful  in  mastering  course  concepts 
and  competencies.  One  hundred  per  cent  (100%)  indicated 
peer  interaction  was  very  helpful.  However,  when  asked 
what  role  the  “Page”  played  in  the  process  of  increasing  in- 
teraction only  50%  judged  it  to  be  very  helpful.  One  third 
of  the  respondents  were  undecided  or  had  no  opinion  on 
this.  One  can  only  speculate  how  individuals  at  varied  sites 
would  interact  with  individuals  at  other  sites  without  the  tech- 
nologies provided  through  the  “Page”.  One  additional  item 
asked  if  “Page”  participation  encouraged  the  student  to  ap- 
ply concepts  and  competencies  beyond  the  context  of  the 
distance  education  classroom;  86%  reported  this  indeed  was 
the  case.  Analysis  of  written  responses  to  open  ended  ques- 
tions found  that  only  one  respondent  failed  to  give  examples 
regarding  the  value  of  using  the  “Page”  during  the  semester. 

Summary 

In  the  distance  education  environment  it  is  critical  for 
the  instructor  to  focus  upon  pre-planned  interaction  strategy 
components  to  enhance  involvement  and  learning.  The  ab- 
sence of  such  planned  learner  engagement  will  potentially 
result  in  the  one  way  delivery  of  instructor  lecture  informa- 
tion with  little  student  interaction  with  either  the  instructor 
or  other  students.  One  of  the  persistent  criticisms  of  dis- 
tance education  has  been  that  the  instructional  approach  used 
too  often  has  involved  what  has  been  called  the  “talking  head” 
syndrome  approach,  i.c.  .^formation  is  provided  with  very 
little  exchange  between  students  and  instructor.  An  alterna- 
tive to  address  this  concern  must  consider  ways  to  increase 
learner  efficacy  through  greater  student  involvement  (Bates, 
1995;  Sayers,  1996). 

This  study  involved  the  use  of  current  Web  technolo- 
gies combined  with  the  creation  of  a user-friendly  set  of  tools 
to  enable  the  distance  education  classroom  to  become  more 
interactive.  .ic  course  was  designed  and  delivered  with 
the  goal  of  enhancing  interaction  through  the  utilization  of  a 
“Class  Page”  accessed  on  the  World  Wide  Web.  This  “Page” 
was  developed  to  promote  numerous  opportunities  for  slu- 
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dents  to  become  actively  involved  in  both  course  content 
and  interaction  with  the  instructor  and  class  peers. 

Data  were  collected  during  the  course  of  the  semester 
to  develop  understandings  regarding  the  potential  impact  and 
use  of  the  developed  “Page"  upon  both  involvement  and 
interaction  on  the  part  of  the  students.  The  evidence  col- 
lected regarding  student  behavioral  changes  relative  to  in- 
teraction during  the  semester  was  dramatic.  The  impact  of 
the  “Page"  upon  both  interaction  and  learning  was  substan- 
tiated. Multiple  items  can  be  used  for  illustrative  purposes. 
When  students  were  asked  about  their  views  regarding  the 
value  of  getting  to  know  fellow  classmates,  perceptions 
shifted  from  0%  (Week  2 survey)  to  889 k (Week  1 5 survey). 
An  increasing  number  of  students  judged  they  were  freely 
able  to  express  their  views  (11%  Week  2,  to  91%  Week  15). 
Increases  were  also  noted  across  the  semester  in  questions 
about  out  of  class  participation,  enjoyment  using  the  Internet, 
use  of  e-mail,  and  perceptions  regarding  the  distance  envi- 
ronment tools  encouraging  involvement  and  interaction. 

At  the  beginning  of  the  term  many  of  the  students  had 
questions  or  concerns  about  the  potential  usefulness  of  the 
“Page";  the  final  survey  found  that  all  (100%)  viewed  the 
“Page"  as  useful.  The  electronic  monitoring  of  the  “Page" 
use  found  continued  increase  in  use  through  the  fifth  week 
of  class,  and  maintained  consistent  use  on  the  part  of  stu- 
dents from  the  sixth  week  of  the  term  through  the  end  of  the 
semester.  Following  completion  of  the  class,  over  half  of 
the  enrolled  students  requested  they  be  permitted  to  con- 
tinue using  the  resources  on  the  “Page";  this  indeed  was  grati- 
fying remembering  the  concerns,  fears,  and  minimal  Internet 
skills  which  existed  at  the  beginning  of  the  semester.  The 
only  aspect  of  the  “Page"  which  was  not  made  available  fol- 
lowing the  end  of  semester  was  the  e-mail  post  office  as  this 
area  needed  to  be  reestablished  for  subsequent  students  en- 
tering the  class  the  following  semester. 

The  “Class  Page"  was  developed  and  used  to  create  a 
valuable  connecting  bridge  that  finked  instruction  with  tech- 
nology. The  utilization  of  this  resource  greatly  enhanced 
interaction  and  contributed  to  the  successful  learning  results 
which  emerged  from  this  distance  education  classroom.  The 
successes  which  resulted  were  based  upon  the  team  support 
provided  through  the  collaboration  of  dedicated  University 
Computing  Services  personnel,  supportive  University 


Teleplex  personnel,  and  exceptional  graduate  assistants.  As 
a result,  students  enrolled  in  the  distance  education  class, 
those  collaborating  to  make  the  technology  and  instruction 
effective,  and  the  University  community  benefitted.  The 
initial  goal  to  enhance  distance  education  classroom  inter- 
action utilizing  the  Web  was  realized.  This  learning  experi- 
ence produced  a positive  impact  not  only  in  the  distance 
education  classroom,  but  also  in  the  broader  context  of  an 
emerging  University  focus  upon  technological  tools  and 
opportunities  to  assist  instructional  delivery. 
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Abstract 


This  qualitative  study  examined  student  responses  toward  an  interactive  Internet  site  supplementing  a 
multimedia  graduate  level  distance  learning  course  at  Ball  State  University.  The  course , “Elementary 
School  Curriculum,  ” was  taught  in  a studio  classroom  and  transmitted  to  five  distant  sites  in  Indiana. 
Technology  included  two-way  audio  signals  and  one-way  video  signals  for  in-class  interaction  and  an 
Internet  World  Wide  Web  site  for  out-of-class  interaction.  Qualitative  evidence  collection  techniques 
included  focus  group  inten'iews,  telephone  interviews,  and  eight  survey  instruments.  Analysis  of  stu- 
dents' responses  to  the  Internet  site  focused  on  coping  strategies  developed  by  students  to  manage  the 
stresses  and  benefits  of  their  computer  involvement.  Students  reported  strategies  for  managing  per- 
sonal resources,  the  computer  environment,  self  and  others.  Predominant  themes  in  student  reactions 
included  concerns  associated  with  communication  issues,  with  computer  involvement,  and  with  com- 
puter and  Internet  access.  Benefits  most  frequently  identified  were  the  sense  of  empowerment  and  the 
satisfaction  of  sharing  a space  with  fellow  classmates.  Implications  drawn  include  the  value  of  modera- 
tor leadership,  the  importance  of  a face-to-face  encounter,  the  challenge  of  the  on-line  text-based  me- 
dium, the  influence  of  learning  and  temperament  styles,  and  the  development  of  computer-supported 
collaborative  learning  opportunities 


Introduction 

The  distance  learning  environment  has  long  -sen  a chal- 
lenge and  a concern  for  educators  who  base  their  pra . . ices  upon 
the  learning  theories  of  Piaget,  Rotter  and  Vygotsky.  Tension 
between  practice  and  theory  results  from  the  lack  of  ractivity 

characteristic  of  the  distance  learning  setting.  Interactivity  de- 
scribes the  manner  in  which  the  learner  dialogues  with  the  self, 
with  the  course  material,  and  with  others  during  a learning  ac- 
tivity (Baker-Albaugh,  1993).  It  is  the  interpersonal  dialogue 
with  others  so  critical  for  productive  learning  that  is  typically 
absent  in  the  distance  learning  classroom.  The  benefits  of  this 
interactivity  among  learners  include  increases  in  learning  ef- 
fectiveness (Bates,  1993),  higher  levels  of  cognitive  process- 
ing (Garrison,  1993),  and  development  of  collaborative  and 
cooperative  learning  skills  (Bergc,  1995).  Recognition  of  these 
student-related  benefits  resulting  from  interpersonal  interaction 
has  stimulated  the  development  and  application  of  interactive 
technologies  in  the  field  of  distance  learning. 

Emerging  computer  technologies  are  capable  of  facilitating 
an  interpersonal  dimension  within  the  distance  learning  environ- 
ment. Currently,  computers  are  a technological  application  widely 
used  for  distance  course  delivery  (Wells,  1992).  Computers  are 
not  commonly  used  as  a means  for  providing  interactive,  inter- 
personal communication  within  distance  learning  courses  car- 
ried by  other  media  (Mason  and  Kavc,  1989).  Harasim  ( 1992) 
stated  computers  can  potentially  "contribute  to  a sense  ol  com- 
munity within  the  group,  forging  a social  bond  that  can  offer 


important  motivational  and  cognitive  benefits  with  the  learning 
activities”  (p.  iii).  To  achieve  these  motivational  and  cognitive 
benefits,  distance  educators  today  must  design,  develop,  and 
deliver  interactive  learning  opportunities  using  computer  tech- 
nologies. The  use  of  computer  technologies,  when  combined 
witli  other  complimenting  media,  can  provide  the  distance  learner 
with  a balanced,  productive,  and  interactive  learning  environ- 
ment (Bates,  1995;  Eastmond,  1995;  Nipper,  1989)  and  facili- 
tate flexible  interpersonal  communication  among  learners 
independent  of  time  and  space  (Paulsen,  1992). 

A recognized  authority  on  distance  education,  Anthony 
Bates  has  stated:  "Interaction  between  the  learner  and  other 
learners ...  is  possibly  the  most  important  form  of  interaction 
for  many  learners,  but  it  has  tended  to  be  neglected  in  distance 
education”  (1990,  p.  6).  Recognition  of  this  neglect  has 
prompted  distance  educators  to  find  new  ways  to  provide  for 
the  social  and  intellectual  needs  of  their  students.  In  this  study, 
student  responses  toward  one  such  attempt  to  provide  for  the 
interactive,  interpersonal  needs  of  learners  in  a distance  class- 
room were  examined.  The  purpose  of  this  study  was  to  de- 
scribe student  attitudes  toward  the  social  and  intellectual 
interaction  with  class  members  on  an  Internet  site  designed  to 
supplement  a multimedia  distance  learning  experience. 

Methodology  and  Theoretical  Framework 

Uic  purpose  of  qualitative  descriptive  research  is  to  ob- 
serve, describe,  and  explain  events  or  phenomena.  The  pur- 
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pose  of  this  study  was  to  describe  a specific  phenomenon  within 
a specific  situation.  The  phenomenon  was  the  computer-medi- 
ated communication  among  students;  the  situation  was  the  in- 
teractive computer  environment  of  a distance  learning  setting. 
Because  this  research  was  qualitative,  phenomenon-centered, 
and  situation-specific  it  is  a case  study  (Merriam,  1988).  There- 
fore, the  research  design  incorporates  case  study  assumptions 
and  methodology. 

The  goal  of  a qualitative  case  study  is  to  understand  the 
meaning  of  observed  experiences.  From  a constructivist  view- 
point, the  qualitative  researcher  assumes  the  existence  of  mul- 
tiple realities  that  result  from  personal  interactions  and 
perceptions.  The  researcher  seeks  to  understand  the  subjective 
phenomenon  of  perceptions  through  an  inductive  process  of 
building  concepts,  propositions  and  theories  (Denzin  & Lin- 
coln, 1994).  The  purpose  of  this  case  study  was  inductively  to 
understand  and  describe  student  attitudes  toward  the  social  and 
intellectual  interaction  with  class  members  on  an  Internet  site. 
In  doing  so,  the  researcher  was  the  primary  instrument,  able  to 
respond  to  the  context,  adapt  techniques  to  the  circumstances, 
and  process,  clarify,  and  summarize  evidence  as  it  was  col- 
lected (Guba  & Lincoln,  1981). 

Within  the  constructivist  perspective,  this  study  was  based 
upon  a theoretical  foundation  of  Piaget,  Rotter,  and  Vygotsky. 
A fundamental  assumption  of  Piaget’s  cognitive  theory  is  that 
the  learner  is  necessarily  active  (Crook,  1 996).  Building  upon 
that  concept,  Julian  Rotter  ( 1 954),  in  his  Social  Learning  Theory , 
established  the  assumption  that  meaningful  learning  occurs  in 
a social  environment,  through  social  interactions  with  other 
people.  In  1978,  cultural  theorist  Vygotsky  proposed  that  all 
cognitive  functions  are  first  experienced  in  the  public  forum  of 
social  interaction.  He  stated:  “All  higher  functions  originate  as 
actual  relationships  between  human  individuals”  (Vygotsky. 
1978,  p.  57). 

Upon  this  theoretical  foundation,  collaborative  learning 
theories  are  based.  The  collaborative  learning  theories  of 
Johnson  and  Johnson  (1975)  and  Slavin  (1989)  provided  the 
theoretical  rationale  for  this  study.  Collaborative  learning  re- 
quires the  dynamic  participation  of  individuals  working  together 
to  construct  knowledge.  Knowledge  construction  occurs 
through  social  and  intellectual  interaction  with  peers  and  ex- 
perts. Howard  Gardner,  etal.  (1996)  stated  that,  because  of  the 
distributed  nature  of  intelligence,  productive  learning  occurs 
only  in  conjunction  with  other  humans  and  objects.  “Most  pro- 
ductive human  work  takes  place  when  individuals  arc  engaged 
in  meaningful  and  relatively  complex  projects  which ...  involve 
interaction  with  other  persons:  mentors  and  teachers, ...  peers 
and  experts, ...  teams  of  collaborators”^.  224).  The  interac- 
tive Internet  site  included  in  this  distance  learning  environment 
was  developed  to  enable  and  support  the  active  and  collabora- 
tive engagement  of  learners  in  a meaningful  and  complex  learn- 
ing environment. 

The  setting  for  this  study  was  a distance  learning  graduate 
level  course  offered  by  the  Educational  1 eadership  . 'epartmeni 
of  Ball  State  University,  Muncic,  Indiana.  The  course,  ’‘El- 
ementary School  Curriculum  ” was  offered  Spring  semester  of 


1 997  and  taught  in  a studio  classroom  in  the  Ball  Communica- 
tions Building.  The  course  was  transmitted  via  the  Indiana 
Higher  Education  Telecommunications  System  to  five  distant 
sites  in  Indiana.  Class  participants  included  13  in-sludio  stu- 
dents, 24  off  site  students,  two  graduate  assistants  and  a pro- 
fessor. The  technology  supporting  the  course  included  two-way 
audio  signals  and  one-way  video  signals  in-class  instruction 
and  interaction,  and  an  Internet-based  World  Wide  Web  site 
forout-of-class  interaction. 

The  World  Wide  Web  site,  created  specifically  for  this 
course,  was  housed  on  the  Ball  State  University  server  and  was 
accessible  through  any  Internet- linked  personal  computer.  This 
“Class  Page”  offered  the  following  services  and  interactive 
learning  opportunities: 

• an  e-mail  Post  Office,  with  photographs  of,  and  links  to, 
all  class  members,  instructors,  and  technical  support  per- 
sonnel; 

• a Discussion  Area,  for  out-of-class  discussion  among  stu- 
dents on  topics  relating  to  course  material  and  assignments; 

• Project  Reports  and  Motivational  Ideas — sections  that  re- 
quired students  to  post  course  assignments  for  the  mutual 
benefit  of  class  members; 

• Cool  Class  Web  Sites — a resource  section  for  educators, 
linking  the  “Class  Page”  to  hundreds  of  educational  Web 
sites; 

• BSU  Resource  Links — a resource  section  for  class  par- 
ticipants linking  the  “Oass  Page”  to  Ball  State  University 
Web  sites; 

• a Notice  B oard,  for  posti  ng  weekly  announcements  of  cam- 
pus and  class  events,  and  reminders  of  class  assignments 
and  schedules; 

• a Class  Survey  section,  hosting  a biweekly  class  partici- 
pant survey; 

• a Class  Handouts  section  for  delivering  course  materials 
and  providing  links  to  Web  sites  especially  relevant  to  the 
week's  topic; 

• a Class  Questions  section,  providing  questions  for  out-of- 
class reflection  and  discussion  regarding  the  course's  topic 
for  the  week;  and 

• general  class  information  sections:  “Class  Page”  Introduc- 
tion, Syllabus.  Technical  Tips,  Professor  Profile,  Gradu- 
ate Assistant  Profiles,  Visiting  Scholar  Profile,  and  Support 
Crew  Member  Profiles. 

Because  the  “Class  Page”  was  created  to  facilitate  interac- 
tion among  class  members  of  “Elementary  School  Curriculum,” 
participation  on  this  Web  site  was  required.  Expectations  for 
participation  were  clearly  stated  at  the  onset  of  the  course 

In  this  descriptive  study,  a nir  -or  (4 qualitative  evidence 
collection  techniques  were  employed.  Focus  group  interviews 
were  conducted  with  civ  s memheis  mid  semester.  Telephone 
interviews  were  conducted  with  class  members  one  week  after 
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the  semester’s  end.  Eight  survey  instruments  were  adminis- 
tered, and  included  the  following:  a pre-course  short  answer 
self-assessment  of  computer  skills;  six  Likert  scale  and  short 
answer  surveys  housed  on  the  “Class  Page;”  and  an  overall 
course  evaluation  administered  during  the  last  class.  This  evi- 
dence was  then  analyzed  and  conclusions  were  drawn. 

Findings 

To  help  describe  the  population  of  this  study,  a survey — 
“Self-Assessment  of  Computer  Skills” — was  administered  to 
students  attending  the  first  full  class  of  the  graduate  level  course, 
“Elementary  School  Curriculum.”  This  self-assessment  re- 
vealed students’  attitudes  toward,  and  frequency  of,  computer 
use  that  importantly  impacted  this  study.  For  example,  whereas 
70  percent  of  the  students  in  the  course  owned  a computer  and 
92  percent  had  access  to  a computer  at  their  workplace,  only 
30  percent  reported  feeling  comfortable  using  a computer.  Also, 
although  57  percent  of  the  students  had  computers  with  Internet 
access,  70  percent  reported  having  never,  or  only  once,  used 
the  Internet.  Three  students,  of  the  37  enrolled,  reported  feel- 
ing comfortable  using  the  Internet  and  only  two  students  re- 
ported feeling  competent  to  obtain  Internet  resources.  Less 
than  30  percent  of  the  students  reported  feeling  somewhat  skilled 
using  a windows  environment  and,  thankfully,  95  percent  re- 
ported feeling  at  least  somewhat  skilled  at  word  processing. 

The  evidence  in  this  study  was  collected  from  interviews 
and  surveys  over  a period  of  sixteen  weeks.  Students  enrolled  in 
“Elementary  School  Curriculum”  were  required  to  complete  a 
computer-based  survey  during  the  second,  fourth,  sixth,  eighth, 
tenth,  and  twelfth  week  of  the  course.  Focus  group  interviews 
were  conducted  during  week  eight;  telephone  interviews  were 
conducted  during  week  sixteen.  An  end-of-semester  course  evalu- 
ation was  completed  by  students  during  the  last  class  session. 

The  evidence  collected  was  categorized  into  cognitive  and 
affective  strategies  used  by  students  to  manage  the  course  re- 
quirement of  participation  in  the  Internet-based  “Class  Page.” 
The  cognitive  strategies  included  management  of  personal  re- 
sources, such  as  time,  effort  and  money,  and  management  of 
the  computer  environment,  such  as  text-based  communication 
and  Internet  information  overload.  The  affective  strategics  in- 
cluded the  management  of  self,  such  as  self-confidence,  self- 
direction  and  self- efficacy,  and  the  management  of  others,  such 
as  interpersonal  networking,  and  giving  and  receiving  emotional 
support. 

The  cognitive  strategy  of  personal  resource  management 
was  evident  as  students  chose  how  best  to  spend  their  limited 
resources  of  time,  effort,  and  money  to  meet  the  course  require- 
ment of  “Class  Page”  participation.  The  limitations  of  time 
were  often  mentioned  by  students  in  this  course.  The  amount 
of  time  spent  in  locating  an  Internet-linked  computer,  access- 
ing and  exploring  the  “Class  Page”  environment,  and  fulfilling 
the  “Class  Page*'  course  requirements  was  a constant  concern 
for  most  class  participants.  One  student  admitted,  Til  be  hon- 
est. If  I had  known  how  much  time  this  computer  stuff  was 
going  to  take,  I would  have  picked  another  class.  I don’t  have 


time  to  be  running  around  looking  for  a computer,  then  trying 
to  figure  all  this  stuff  out.”  At  week  ten,  63  percent  of  the 
students  reported  continuing  difficulties  coping  with  lack  of 
time  and  computer  availability.  Nevertheless,  many  students 
developed  coping  strategies  for  managing  their  time.  One  stu- 
dent shared,  “I  simply  told  myself — Tami,  you  have  one  hour 
to  do  everything  you  need  to  do  on  the  “Class  Page”  before 
class  tomorrow.  Get  with  it.”  Another  student  remarked,  “I 
don’t  see  what  the  big  deal  is.  So,  you  block  out  time  and  tell 
your  family,  ‘I’m  not  here.  I am  in  cyberspace.’  You  close  the 
door  and  log  on.” 

Learners’  efforts  also  needed  to  be  managed.  By  week 
fifteen,  76  percent  of  the  students  reported  feeling  the  effort 
invested  in  the  “Class  Page”  had  enabled  them  to  achieve  the 
course’s  purpose,  had  stimulated  critical  thinking,  and  had  en- 
couraged them  to  apply  course  concepts  beyond  the  classroom. 
One  student  stated,  “You  know,  you  get  out  of  a class  what  you 
put  into  it.  When  I saw  the  ‘Class  Page’  requirement  I told 
myself  that  this  was  a course  I needed.  I was  really  willing  to 
put  in  the  effort  to  learn  about  computers  and  the  Internet.” 

Students  reported  a number  of  strategies  for  managing  their 
effort.  One  student  approached  effort  management  by  clarifying 
basic  course  requirements  and  the  effort  investment  of  classmates. 
She  shared,  “Well,  my  friends  and  I got  onto  the  Discussion  Area 
together  after  a few  weeks  of  class  to  see  if  anyone  else  had 
posted  stuff.  We  looked  at  the  names  and  it  was  the  same  five 
names,  so  we  thought — Okay,  we’re  in  the  majority  of  people. 
So  we  didn’t  feel  a big  urge  to  get  into  the  Discussion  Area.  We 
figured  we  had  enough  to  do.  I’ll  be  honest,  I’m  not  making  the 
effort  unless  I have  to.”  Another  student  was  less  successful:  “I 
just  get  overwhelmed  and  stay  on-line  for  hours  hardly  knowing 
where  to  turn  next.  I want  to  do  my  best,  but  I don't  know  how  to 
do  that.  I mean,  how  much  does  he  want?  How  much  effort  do 
I need  to  invest  to  get  an  A?” 

A number  of  students  chose  to  invest  financial  resources 
in  computer  equipment  and  Internet  access  to  save  time  and 
effort.  One  student  enthused,  “I  am  so  computer  challenged! 
This  course  forced  me  to  get  with  it.  I mean,  I went  out  and 
bought  everything  I needed — computer,  modem,  access — the 
whole  shot.  Now  I am  poor,  but  it  was  worth  every  penny.  It 
has  saved  me  hours  of  travel,  of  waiting,  of  fooling  around  on 
strange  computers.  My  whole  family  has  benefited!”  By  con- 
trast, one  student  complained,  “I  resent  having  to  buy  Internet 
access  for  $25  a month  when  I’m  already  paying  for  this  class. 
And  just  because  I can’t  find  a computer  that  isn’t  already  busy 
with  someone  else  playing  on  the  Internet.  So,  now  I have  a 
connection,  but  it’s  going  as  soon  as  the  class  is  over!”  By 
week  ten,  25  percent  of  the  students  reported  a continuing  con- 
cern with  computer  costs. 

The  personal  resources  of  time,  effort  and  money  were 
guarded,  examined  and  spent  by  students  to  meet  the  require- 
ments of  this  course.  Management  of  these  personal  resources 
was  one  cognitive  strategy  reported  by  the  students  of “Elemctv 
tary  School  Curriculum.” 
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A second  cognitive  strategy,  that  of  computer  environment 
management,  was  evident  as  students  were  challenged  to  com- 
municate in  a text-only  context  and  to  handle  the  task  of  navi- 
gating the  Internet.  Student  responses  at  week  two  illustrate 
the  extent  of  this  management  challenge:  79  percent  of  the  en- 
rolled students  said  that  Internet  exploration  would  be  a new 
experience  for  them,  and  92  percent  expected  to  learn  new  com- 
puter skills  through  “Class  Page”  participation. 

The  text-based  nature  of  the  “Class  Page”  offered  some 
students  the  opportunity  to  improve  writing  skills.  One  student 
shared,  “Internet  communicating  was  easy!  I put  a couple  of 
ideas  out  on  the  Discussion  Area.  You  know,  it  is  rather  intimi- 
dating to  put  a thought  out  there  on  the  Internet  for  the  whole 
world  to  see  and  to  know  that  my  sentences  sound  awful  and 
I’m  probably  misspelling  a bunch  of  words.  But  I decided — 
too  bad!  I was  going  to  do  it!  I knew  the  embarrassment  would 
force  me  to  write  better.  Ha!”  Another  student  said,  “You  know, 

I would  read  my  writing  after  I sent  it  and  it  would  always 
sound  so  stupid  to  me.  But  then,  I would  screw  up  my  courage 
and  tiy  writing  something  again.  This  time  I would  work  harder 
at  my  writing.  I actually  think  I’m  better  at  writing  now.” 

Other  students  were  more  intimidated.  One  student  con- 
fided, “I  just  can’t  write.  I like  to  read  what  others  write.  But  I 
can’t  do  it  myself.  I mean — what  are  the  readers  thinking? 
What  is  their  expression  when  they  read  my  idea?”  Another 
student  responded,  “The  ‘Class  Page’  is  okay  for  those  people 
who  like  to  stick  their  necks  out,  who  talk  in  class  and  always 
have  an  opinion.  They  are  just  that  way.  But  I’m  not.  I'm  not 
going  to  write  anything  down  that  I’m  not  forced  to.”  By  week 
eight,  while  66  percent  of  the  students  reported  gaining  com- 
puter competencies  from  “Class  Page”  participation,  only  31 
percent  agreed  that  writing  competencies  had  been  gained.  5 1 
percent  of  the  students  stated  that  the  “Class  Page”  experience 
had  not  helped  them  learn  to  write  important  concepts. 

The  wealth  of  resources  available  on  the  Internet  also  re- 
quired management.  This  management  task  was  expedited  by 
the  Internet  links  provided  in  “Cool  Class  Web  Sites.”  Sev- 
enty-seven percent  of  the  students  reported  that  a major  advan- 
tage of  the  “Class  Page”  was  its  Internet  resource  links.  As  one 
student  stated,  “Without  the  Cool  Class  Web  Sites  I would  have 
been  lost.  I spent  many  happy  hours  exploring  links  from  the 
“Class  Page”  and  beyond.  It  was  so  helpful  to  have  a starting 
place.  Of  course  I did  have  to  manage  to  make  my  way  around 
the  net  after  leaving  the  “Class  Page.”  But,  little  by  little,  I 
learned.  It  just  took  time.”  By  week  four,  students  were  ac- 
tively exploring  the  “Class  Page,”  with  88  percent  of  the  stu- 
dents completing  the  survey,  and  70  percent  posting  assignments. 
By  week  fifteen,  90  percent  of  the  students  reported  using 
Internet  resources  other  than  those  on  the  “Class  Page.”  One 
student  shared,  “I  managed  the  infoglut  by  bookmarking  cool 
sites,  printing  worthwhile  articles  to  share  with  classmates,  keep- 
ing my  eye  on  the  time,  and  keeping  control  of  my  curiosity. 
You  know,  without  control,  you  can  go  crazy  on  the  Internet 
and  never  leave  it!”  Another  student  stated,  “At  the  beginning 
I was  really  serious  about  the  whole  thing  and  spent  a lot  of 
time  on  it.  Bo*  lately  I’ve  only  done  things  that  are  helpful  to 


me.  I’ve  learned  to  manage  the  ‘Class  Page’  and  the  Internet 
for  my  benefit  and  convenience.” 

By  week  ten,  44  percent  of  the  students  considered  the  “Class 
Page”  a worthwhile  supplement  to  “Elementary  School  Curricu- 
lum.” By  week  fifteen,  95  percent  stated  that  “Class  Page”  ac- 
tivities were  relevant  to  the  stated  objectives  of  the  course.  As 
one  student  commented,  ‘V_.  first  I was  grousing  around,  com- 
plaining that  I didn’t  have  the  time  or  energy  to  bother  with  com- 
puter stuff.  Then  my  husband  took  me  in  hand.  He  said — ‘Look, 
you ’re  a teacher.  So,  what’s  more  important  to  teach.... The  Span- 
ish Civil  War  or  computer  skills?  And  how  are  you  going  to 
teach  computer  skills  if  you  don’t  have  them  yourself?’  So  he 
bought  a computer  and  hooked  us  up  to  the  Internet.  It  hasn’t 
been  easy,  but  it  has  been  fun!  I mean,  what  a resource!  And 
how  to  manage  it?  Wow,  I’m  still  working  on  that!” 

Students’  cognitive  strategies  for  coping  with  the  course 
requirement  of  “Class  Page”  participation  included  manage- 
ment of  both  personal  resources  and  the  computer  environment. 
Most  students  became  successful  managers;  some  did  not. 
Computer  comfort  and  competency  influenced  students’  suc- 
cess in  the  “Class  Page”  context. 

The  affective  strategy  of  self-management  included  con- 
trolling self-confidence,  encouraging  self-direction  and  recog- 
nizing self-efficacy.  Students  spoke  much  about  their  feelings 
related  to  the  “Class  Page.”  At  week  two  of  the  course,  63 
percent  of  the  students  reported  feelings  of  anxiety  concerning 
their  computer  competency.  A'  the  same  time,  79  percent  ex- 
pected to  enjoy  using  the  “Class  Page.”  Thus,  at  the  onset  of 
the  course,  students  were  tempering  their  feelings  of  inadequacy 
with  positive  expectations.  As  one  student  shared,  “I  knew  I 
was  in  big  trouble.  What  did  I know  about  computers?  Noth- 
ing. But  I’ve  been  in  pickles  before  and  I’d  seen  my  way  out.  I 
knew  that,  with  hard  work  and  a little  luck,  I could  figure  out 
what  I was  doing  before  anyone  realized  how  little  I knew!” 

By  week  ten,  44  percent  of  the  students  were  still  con- 
cerned with  their  computer  competency,  53  percent  wanted 
classmate  support,  and  47  percent  needed  instructor  encour- 
agement. Nevertheless,  only  1 3 percent  of  the  students  were 
now  frustrated  with  the  “Class  Page,”  55  percent  felt  secure 
while  on  the  “Class  Page,”  and  8 1 percent  felt  free  to  express 
their  personal  opinions  on  the  “Claes  Page.”  Comments  such 
as  “I’m  over  my  computerphobia!”  and  “The  fear  is  gone!”  and 
“My  computer  anxiety  has  eased  a bit!”  describe  students  who 
coped  with  a threatening  environment  by  managing  their  self- 
confidence.  One  student  shared,  “I  have  never  been  on  a com- 
puter. I have  never  been  on  the  Internet.  All  my  life  I have 
been  totally  intimidated  by  it.  Now  I can  actually  click  on  some- 
thing and  get  it!  I told  myself  I could  do  it,  and  I did!” 

Not  all  students  were  so  successful  managing  their  self- 
confidence.  One  student  confided,  “I  have  never  been  on  the 
Internet  before  and  I was  really  scared  of  going  on  it.  So,  I 
haven't.  I just  can't  do  it,  so  I get  my  friends  to  do  my  surveys 
and  collect  class  questions  and  post  things  for  me.  I just  can't.” 
Another  complained,  “I’m  really  upset.  If  I had  known  that  I 
would  have  to  do  computers  I wouldn't  have  signed  on.  My 
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friends  said  they  would  help  me  but  they  haven't.  So  what  am 
I supposed  to  do?"  Thus,  self-confidcnce  was  both  a condition 
and  an  approach  that  could  be  managed.  Some  students  were 
more  adept  at  developing  and  applying  self-confidence  than 
others. 

Management  of  self-direction  was  another  affective  strat- 
egy used  by  many  students.  Self-direction  was  illustrated  by 
students’  willingness  and  ability  to  make  choices  that  led  to 
their  successful  course  completion.  For  example,  one  student 
commented.  “This  is  my  life.  This  is  my  degree.  If  I take  a 
course  that  requires  that  I stretch  and  learn  new  things,  then  I 
need  to  meet  that  head  on.  Whining  about  it  is  degrading.  lean 
choose  to  learn.  My  fear  does  not  need  to  dictate  my  actions." 
By  week  eight.  83  percent  of  the  students  had  found  the 
university’s  technical  computer  assistance  an  excellent  resource. 
Seventy-seven  percent  rated  the  “Class  Page"  Notice  Board 
and  Class  Questions  as  excellent  for  keeping  them  informed 
and  for  stimulating  thought.  Thus,  students  were  choosing  to 
become  actively  involved  with  the  “Class  Page"  in  order  to 
meet  both  in-class  and  out-of-class  participation  requirements. 

The  affective  strategy  of  self-management  included  man- 
aging self-efficacy — the  sense  of  personal  control  over  one's 
environment.  As  students  moved  from  week  one  through  week 
fifteen  of  “Elementary  School  Curriculum  " a sense  of  increas- 
ing control  was  evident  in  student  responses.  Whereas  at  week 
two,  63  percent  of  the  students  reported  feeling  anxious  about 
the  “Class  Page,”  by  week  ten  55  percent  reported  feeling  se- 
cure and  7 1 percent  reported  successfully  using  the  “Class  Page" 
on  a consistent  basis.  By  week  fifteen,  95  percent  of  the  stu- 
dents felt  the  challenges  presented  in  the  course,  including  par- 
ticipation on  the  “Class  Page,"  were  appropriate  to  their  level 
of  development.  As  one  student  explained,  “It's  an  issue  of 
control,  isn't  it?  When  you  feel  like  the  master  of  your  own 
work,  you  feel  successful,  empowered.  At  first  the  “Class  Page" 
scared  me.  Now  that  I have  struggled  with  it  and  mastered  it,  I 
feel  terrific — like  I can  take  on  the  world!"  This  sense  of  con- 
trol inspired  one  student  to  comment.  “I  have  really  liked  this 
class.  What  a challenge.  What  an  accomplishment.  I'd  rec- 
ommend it  to  anyone!"  By  week  twelve,  75  percent  of  the 
students  stated  they  would  recommend  this  class  to  friends  and 
co-workers,  89  percent  concluded  they  had  enjoyed  the  class, 
and  64  percent  felt  secure  in  their  use  of  the  “Class  Page." 

Not  every  student  developed  a sense  of  self-efficacy.  One 
student  shared,  “I  can’t  cope.  I know  I’m  supposed  to  be  the 
boss.  I mean,  I can  always  pull  the  plug,  turn  the  computer  off. 
But  it  scares  me.  So  I stay  away.  My  friends  do  my  surveys 
and  post  my  ideas.  I can't."  Another  student  confessed,  “When 
I sit  at  a computer  I'm  at  its  mercy."  Thus,  whereas  some  stu- 
dents assertively  took  control  of  the  computer  environment, 
others  were  controlled  by  it. 

With  each  self-management  strategy — self-confidence, 
self-direction,  and  self-efficacy — assertiveness  and  a sense  of 
purpose  produced  more  positive  tesults.  One  student  summed 
it  up  b\  saying.  “I  just  take  myself  in  hand.  I tell  myself — stop 
whining  and  start  working.  Self-defeating  talk  is  a dead-end 
road." 


A second  affective  strategy  described  by  students  for  cop- 
ing with  the  “Class  Page"  participation  requirement  was  the 
management  of  others.  This  management  approach  included 
interpersonal  networking  and  the  giving  and  receiving  of  emo- 
tional support.  The  “Class  Page"  was  specifically  designed  to 
support  the  interpersonal  dimension  of  the  distance  learning 
environment.  Interestingly,  the  majority  of  students  did  not 
view  the  “Class  Page"  as  a vehicle  for  developing  relationships 
among  fellow  classmates.  At  week  four,  53  percent  of  the  stu- 
dents strongly  disagreed  with  the  statement  that  the  “Class  Page" 
was  useful  to  get  to  know  fellow  classmates  and  47  percent 
were  undecided.  By  week  six,  only  21  percent  of  the  students 
had  participated  in  a discussion  on  the  “Class  Page."  By  week 
eight,  49  percent  of  the  students  strongly  disagreed  that,  through 
the  “Class  Page,"  students  had  become  acquainted  with  a fel- 
low classmate,  and  by  week  twelve,  79  percent  still  had  not 
participated  in  a “Class  Page"  group  discussion.  By  the  end  of 
class,  although  90  percent  of  the  students  felt  free  to  express 
their  ideas  and  opinions  on  the  “Class  Page,"  only  a handful 
had  done  so  in  the  discussion  area. 

Despite  this  low  participation  rate,  the  “Class  Page"  im- 
portantly contributed  to  the  interpersonal  networking  among 
the  class  participants.  Comments  such  as  “Oh,  I tackled  that 
'Class  Page'  problem  with  Janet.  It's  so  much  more  fun  with 
two !"  and  “My  friends  from  our  site  ordered  pizza  and  went  to 
Laurie's  house  after  class.  We  wanted  to  try  to  figure  out  the 
‘Class  Page'  assignment!"  were  common.  Although  interper- 
sonal interactions  on  the  “Class  Page"  were  not  highly  valued, 
the  relationships  that  developed  as  a result  of  the  “Class  Page" 
participation  requirement  were.  As  one  student  disclosed,  “Well, 

I felt  kind  of  guilty,  but  I went  over  to  Dawn's  to  get  help  post- 
ing my  project.  When  I got  there,  there  was  Jennifer  and  Kathy. 
They  needed  help,  too!  So  we  had  a computer  party  and  got  all 
our  work  done!"  Another  student  explained,  “The  guys  at  my 
site  didn’t  bother  with  the  Discussion  Area  on  the  ‘Class  Page.’ 
We  just  discussed  among  ourselves,  and  enjoyed  that  a lot.  We 
did  post  our  assignments,  we  shared  information  off  the  Web, 
and  we  spent  a lot  of  time  together  in  class  and  on  our  comput- 
ers. In  fact,  I email  them  all  the  time." 

The  giving  and  receiving  of  emotional  support  among  class 
participants  was  a second  strategy  in  the  management  of  oth- 
ers. This  emotional  support  has  been  illustrated  by  many  of  the 
comments  already  quoted.  Student  responses  were  peppered 
with  expressions  of  appreciation  for  the  care  and  encourage- 
ment of  fellow  classmates.  As  one  student  exclaimed.  “I  don’t 
know  what  I would  have  done  without  Jane!  She  was  so  en- 
couraging!” Another  shared,  “I  feel  lucky  to  have  been  at  a 
site  with  such  nice  people.  They  took  the  time  to  care  about 
each  other.  When  I was  so  afraid  of  the  computer,  they  talked 
me  through  it.  Wc  grew  very  close." 

Although  at  week  eight  interactions  among  class  members 
on  the  “Class  Page"  were  rated  poor  by  31  percent  of  class 
participants  and  good  by  only  29  percent,  student  comments 
illustrated  that  the  “Class  Page”  provided  the  impetus  for  de- 
veloping supportive  interpersonal  relationships  among  class 
members.  The  two  affective  strategics  used  by  students  to  handle 
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the  “Class  Page”  environment — the  management  of  self  and 
the  management  of  others — enabled  interpersonal  growth, 
which  was,  in  turn,  enabled  by  the  “Class  Page”  environment. 
These  affective  strategies,  in  combination  with  the  cognitive 
strategies  described,  enabled  students  to  successfully  complete 
the  “Elementary  School  Curriculum”  course  requirements. 

Reflections  on  the  Findings 

A number  of  cognitive  and  affective  strategies  were  ap- 
plied by  graduate  students  enrolled  in  the  distance  learning 
course,  “Elementary  School  Curriculum,”  to  cope  with  the 
course  requirement  of  participation  on  an  Internet-based  “Class 
Page.”  These  strategies  included  management  of  personal  re- 
sources, management  of  the  computer  environment,  manage- 
ment of  self,  and  management  of  others. 

Imbedded  in  these  strategies  were  a number  of  common 
themes.  The  predominant  themes  included  three  stressors  and 
two  benefits.  The  stressors  most  frequently  alluded  to  were 
concerns  associated  with  communication  issues,  with  computer 
involvement,  and  with  computer  and  Internet  access.  The  ben- 
efits most  frequently  referred  to  were  the  sense  of  empower- 
ment and  the  satisfaction  of  having  a shared  space,  a common 
ground,  with  fellow  classmates. 

These  five  themes,  both  stressors  and  benefits,  were  re- 
ferred to  by  students  who  had  successfully  managed  the  “Class 
Page”  participation  requirement,  as  well  as  those  students  who 
had  opted  out  of  “Class  Page”  interaction.  Because  of  their 
centrality  to  the  findings,  the  five  themes  provide  a framework 
for  the  following  discussion. 

Discussion 

Five  themes  that  warrant  further  discussion  and  consider- 
ation include  three  stressors  and  two  benefits.  The  stressors 
most  frequently  alluded  to  were  the  anxiety  over  communica- 
tion issues,  the  stress  associated  with  computer  involvement, 
and  stresses  relating  to  computer  and  Internet  access.  The  ben- 
efits most  frequently  referred  to  were  the  sense  of  empower- 
ment and  the  satisfaction  of  having  a shared  space,  a common 
ground,  with  fellow  classmates. 

The  context  for  this  study  was  a distance  learning  experi- 
ence which  included  an  Internet-based  “Class  Page”  to  increase 
the  probability  of  student-student  interaction.  Because  of  this 
on-line  component  of  the  course,  students  were  given  the  op- 
portunity to  interact  whenever,  wherever  and  with  whomever 
they  chose.  The  theoretical  rationale  for  designing  the  on-line 
course  component  was  based  on  the  collaborative  learning  theo- 
ries of  Johnson  and  Johnson  ( 1975)  and  Slavin  ( 1989).  These 
theories,  and  supporting  research,  contend  that  peer  interaction 
within  an  educational  setting  is  a critical  variable  for  cognitive 
development.  Peer  interaction  includes  supporting  one  another 
in  knowledge  building,  information  sharing,  social  communi- 
cation, and  problem  solving.  To  provide  peer  interaction  within 
the  distance  learning  setting,  theorist  Keegan  (1986)  stressed 
that  distance  educators  must  provide  means  for  overcoming 


the  limitations  of  the  text-based  environment,  the  difficulties  of 
no  heard  or  seen  language,  and  the  absence  of  immediate  feed- 
back. These  challenges  were  associated  with  student-felt  anxi- 
ety over  computer-based  communication  issues. 

The  on-line  environment  can  facilitate  the  sharing  of  ideas 
and  reflections,  the  building  of  understandings,  and  a common, 
archived  transcript  of  discussions.  While  many  students  thrive 
within  the  on-line  environment,  others  shrink  from  it  in  fear. 
This  writing  apprehension  (Velayo,  1994)  or  communication 
anxiety  (Harasini,  1990)  was  evident  in  this  study,  as  students 
remarked  that  the  feeling  of  speaking  to  empty  space  when 
writing  on-line  prevented  them  from  speaking  at  all.  The  op- 
portunity to  see  the  work  of  others  and  to  compare  their  ideas 
to  those  of  their  classmates  caused  them  great  anxiety.  The 
personal  risk  of  sharing  an  idea  with  no  guarantee  of  response 
was  often  beyond  their  coping  capacity.  Students  overwhelmed 
by  communication  anxiety  chose  non-participation.  Students’ 
effectiveness  in  the  use  of  self-management  strategies  impacted 
their  degree  of  communication  anxiety. 

Communication  anxiety  was  not  uncommon  (Feenberg, 
1989;  Walther  and  Burgoon,  1992).  The  text-based  nature  of 
the  medium  placed  a premium  on  skills  of  written  expression 
and  analysis,  advantaging  the  highly  motivated,  often  educa- 
tionally privileged  learner  (Nipper,  1 989).  The  benefits  of  the 
medium  included  a reduction  of  discriminatory  communica- 
tion patterns  based  on  race,  gender  and  physical  features 
(Walther,  1992),  a less  authoritarian  approach  to  learning  and 
teaching  (Nipper,  1989),  and  more  available  time  for,  and  con- 
trol over,  communication  (Harasim,  1989).  Disadvantages  of 
this  text-dependent  environment  included  a dependency  upon 
a peer  response  in  an  asynchronous  context  (Feenberg,  1989) 
and  the  need  to  express  oneself  clearly  and  analytically  only 
through  written  messages. 

There  are  means  to  minimize  the  communication  anxiety 
caused  by  using  a text-based  medium.  A moderator  can  be- 
come involved  in  student  interactions,  shaping  a positive,  sup- 
portive social  environment,  and  responding  to  each  contribution 
with  sensitivity  (Harasim,  Hiltz,  Teles  and  Turoff,  1995).  The 
course  instructor  can  acknowledge  each  participant  and  recog- 
nize student  growth  (Berge,  1995).  Use  of  humor,  wise  ques- 
tioning, and  group  management  (Davie,  1989)  can  be  used  to 
establish  a non-threatening  environment.  The  effort  required 
to  include  all  class  participants  is  often  rewarded  by  group  co- 
hesiveness and  individual  learner  growth. 

The  “Class  Page”  Web  site  in  this  study  was  developed  to 
overcome  the  social  distance  between  students.  Although  tech- 
nology cannot  substitute  for  instructors,  technical  tools  can  be 
used  to  facilitate  learning.  How  much  learning  takes  place  de- 
pends upon  the  willingness  of  the  student  to  actively  partici- 
pate in  the  learning  process.  Successful  learning  in  this  context 
required  that  students  lake  initiative  for  their  own  learning  and 
growth  by  developing  computer  skills  needed  to  interact  on  the 
course’s  Internet-based  Web  site.  Because  of  stress  related  to 
computer  use.  some  students  in  this  study  were  unable  or  un- 
willing take  this  initiative. 
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The  condition  of  being  or  feeling  computerphobic  (Rosen 
and  Maguire,  1990).  technostresscd  (Hedberg  and  McNamara. 
1989),  or  technophobic  (Kinzie,  Delacourt  and  Powers.  1994) 
was  described  as  a stressor  by  some  study  participants  as  inhib- 
iting, and  occasionally  prohibiting,  their  ‘'Class  Page”  activi- 
ties. This  stress  was  bound  to  students’  effectiveness  in 
managing  self,  others,  and  the  computer  environment. 

Computerphobia  has  been  described  as  making  people  feel 
“uncomfortable,  self-conscious,  and  inefficient"  (DeLoughry. 

1 993.  p.  A25 ) when  they  encounter  computers.  Through  a meta- 
analysis,  Rosen  and  Maguire  { 1990)  found  that  writers  in  em- 
pirical literature  have  predicted  that  “between  one-fourth  and 
one-half  of  all  college  students,  business  people,  and  school 
students  may  be  ‘computerphobic"*  (p.  184).  Recent  research- 
ers have  found  computer  anxiety  can  be  tempered  by  educa- 
tional experiences  with  computers  (Kinzie,  et  al.,  1994)  and 
such  experiences  contribute  to  student  competence  and  confi- 
dence with  computers  (Delcourt  and  Kinzie,  1993). 
Mareoulides  (1988)  and  Rosen.  Sears  and  Weil  (1987)  have 
demonstrated  computer  experience  as  one  of  the  best  predic- 
tors of  computer  anxiety. 

A number  of  educational  approaches  have  been  suggested 
for  overcoming  debilitating  attitudes  toward  computer  partici- 
pation. Thorough  training  and  continuing  support  in  computer 
use  (Velayo,  1994).  emotionally  supportive  leadership  within 
the  computer  environment  (Kerr,  1986),  and  developing  rela- 
tionships through  face-to-face  meetings  (Waggoner,  1992)  are 
strategies  suggested  in  the  literature.  In  this  study,  all  three  of 
these  strategies  were  used.  The  Assistant  Director  for  Univer- 
sity Computing  Services,  Ball  State  University,  dialogued  with 
class  participants  during  weekly  class  sessions  for  the  first  six 
weeks  of  the  course.  He  was  available  via  email  24  hours  a day 
and  was  perceived  as  competent  and  helpful.  Supportive  lead- 
ership within  the  computer  environment  was  provided  by  the 
course  professor  and  two  graduate  assistants.  Two  day-long 
facc-to-facc  class  sessions  were  included  in  the  course  sched- 
ule. In  spite  of  these  strategics,  some  students  remained  anx- 
ious and  w'crc  unwilling  to  participate  on  the  “Class  Page  " 

Access  issues  created  stress  for  many  class  participants  in 
“Elementary  School  Curriculum."  O vci  30  percent  of  the  stu- 
dents mentioned  lack  of  computer  or  Internet  accessibility  as 
roadblocks  to  full  participation  on  the  “Class  Page."  Time  limi- 
tations aggravated  the  issue  of  computer  accessibility.  Students 
reported  having  little  time  to  search  out  an  Internet-linked  com- 
puter, to  travel  to  the  located  computer,  and  to  actively  partici- 
pate on  the  “Class  Page."  Both  Burge  (1994)  and  Kearsely. 
Lynch  and  Wiser  (1995)  reported  similar  results.  McConnell 
(1990)  found  students  fell  they  had  wasted  time  and  experi- 
enced unreasonable  frustrations  when  seeking  out  and  commu- 
nicating through  computers. 

A number  of  researchers  have  reported  that  peripheral 
members  of  organizations  ha\  c more  access  to  w ork  and  social 
activities  through  the  use  of  computer  technologies  (Harasim. 
1990;  Hartman.  Neuwarth.  Kicslei.  Spioull, Cochran,  Palmquist 
and  Zubrow,  1995;  Hull.  Sproull,  and  Kieslcr,  1989).  In  con- 


trast, students  in  this  study  reported  feeling  like  “outsiders"  due 
to  their  lack  of  “Class  Page"  participation.  They  perceived  that 
lack  of  accessibility  pushed  them  to  the  periphery  of  class  ac- 
tivities. Rumble  (1989)  found  that  personal  computers  have 
become  commonplace  in  our  society.  Even  so,  Olson  (1988) 
cautioned  that,  if  w'c  are  to  develop  the  computer  as  a wide- 
ranging  resource  for  learners,  we  must  be  cautious  that  their 
use  does  not  amplify  patterns  of  disadvantage.  The  value  of 
mediating  access  difficulties  by  providing  course  content  via  a 
variety  of  media  and  by  including  opportunities  for  face-to- 
face  interaction  in  the  distance  learning  setting  should  not  be 
overlooked  (Eastmond,  1995;  Nipper,  1989). 

If  learning  is  viewed  as  a social  process,  then  provision  of 
interactive  communication  technologies  is  critical  for  the  pro- 
ductive distance  learner.  In  the  distance  learning  environment, 
the  process  of  developing  a community  of  scholars  is  depen- 
dent upon  open  access  to  the  provided  interactive  technolo- 
gies. The  technology  provided  in  this  study  w'as  an  interactive, 
Internet-based  Web  site  available  to  all  students  through  Internet- 
connected  personal  computers.  This  “Class  Page"  was  avail- 
able 24  hours  a day,  seven  days  a week.  It  provided  access  to 
peers  and  experts  at  any  time  and  any  place.  Unfortunately,  the 
convenience  of  the  “Class  Page"  was  irrelevant  to  a number  of 
students.  Due  to  restraints  of  work,  family,  and  limited  per- 
sonal resources,  some  students  found  the  lack  of  computer 
accessibility  a major  source  of  stress. 

Empowerment  w'as  a theme  which  threaded  through  stu- 
dent experiences  and  attitudes  in  this  study.  The  productive 
use  of  all  four  coping  strategies  reported  in  the  findings  re- 
sulted in  feelings  of  empowerment  and  control.  Collaborative 
learning  theories  emphasize  student  responsibility  for  learning. 
The  on-line  “Class  Page"  environment  offered  students  oppor- 
tunities for  active  thought  and  analysis,  and  required  that  stu- 
dents take  the  initiative  for  their  ow-n  learning  and  growth. 

In  a study  of  learners’  perceptions  of  computer 
conferencing,  Burge  (1994)  concluded  that  students  felt  em- 
powered in  a computer  climate  that  was  emotionally  support- 
ive, intellectually  challenging,  information-rich,  and  interactive 
with  peers  and  experts.  Hiltz.  ( 1 993)  found  that,  within  a com- 
puter context,  students  excelled  w'ho  were  in  control  of  their 
effort  and  their  learning  environment.  Harasim  (1989)  observed 
that  the  asynchronous  nature  of  the  on-line  environment  facili- 
tated self-directed  learning  and  expanded  learner  control  over 
the  interactive  environment,  contributing  to  learner  effective- 
ness (see  also  Mason  and  Kaye,  1990).  Class  participants 
reported  feeling  empowered  by  the  increase  of  learner  respon- 
sibility and  control  in  the  on-line  environment  of  the  “Class 
Page.** 

A sense  of  participating  in  a shared  space  in  w'hich  learn- 
ers contributed  and  received  support,  resources,  and  informa- 
tion was  described  as  a “Class  Page"  benefit  by  many  students. 
Comments  such  as  "We're  on  a level  playing  field"  and  “It's  a 
common  ground  where  we  can  meet  as  equals"  and  “All  the 
resouices  are  available  to  all  of  us"  expressed  the  appreciation 
felt  lor  the  democratic  nature  of  the  “Class  Page."  Participat- 
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ing  in  this  shared  context  where  resources  were  equally  avail- 
able to  all  learners  increased  students’  commitment  to  the  “Class 
Page”  and  strengthened  their  social  bonds  to  one  another.  This 
shared  space  provided  a context  for  collective  thinking,  for  re- 
source access,  and  for  social  and  intellectual  exchanges. 

This  concept  of  shared  space  did  not  guarantee  equal  par- 
ticipation and  interaction.  It  was  found  that  only  students  who 
effectively  employed  the  coping  strategies  of  management  of 
self,  of  others,  and  of  the  computer  environment  viewed  the 
“Class  Page”  as  shared  space  or  common  ground.  Active  par- 
ticipation on  the  “Class  Page”  developed  a sense  of  member- 
ship in  a community  of  scholars. 

Both  Hiliz  (1993)  and  Harasim  (1987)  found  participa- 
tion rates  in  an  on-line  classroom  increasing  as  students  be- 
came more  involved  with  each  other  and  with  the  course 
material;  Nipper  (1989)  and  Eastmond  (1995)  did  not.  To  en- 
courage on-line  participation  and  the  development  of  a shared 
space,  Eastmond  (1995)  recommended  the  provision  of  strong 
moderator  leadership.  Nipper  (1989)  cautioned  that,  in  order 
to  maintain  a focus  on  educational  issues,  on-line  participation 
within  the  shared  space  required  daily  instructor  attention.  The 
on-line  “Class  Page”  environment  in  this  study  was  intention- 
ally designed  to  encourage  participation  and  the  perception  of 
a shared  space.  Strong  leadership  was  provided  and  the  educa- 
tional focus  was  maintained.  Those  students  who  found  the 
“Class  Page”  a common  meeting  ground,  where  equal  standing 
was  credited  to  all,  were  successfully  managing  the  on-line  en- 
vironment. 

Five  themes  intertwined  through  the  cognitive  and  affec- 
tive strategies  employed  by  students  to  cope  with  the  Internet- 
based  “Class  Page”  participation  requirement  of  the 
“Elementary  School  Curriculum”  course.  Of  these  five  themes, 
three  were  described  as  stressors:  anxiety  over  communication 
issues,  the  stress  associated  with  computer  involvement,  and 
stresses  relating  to  computer  and  Internet  access.  Two  themes 
were  described  as  benefits:  the  sense  of  empowerment  and  the 
satisfaction  of  having  a shared  space  for  social  and  intellectual 
interaction.  The  distance  learning  context  of  this  study  in- 
cluded an  Internet-based  “Class  Page,”  designed  to  increase 
the  probability  of  interaction  among  students.  The  effective- 
ness of  the  coping  strategics  developed  and  employed  by  stu- 
dents within  this  learning  context  importantly  impacted  their 
overall  satisfaction  with,  and  success  in,  the  “Class  Page”  en- 
vironment. 

Implications  for  Practice  and  Research 

Highlighted  briefly  are  five  implications  for  practice  and 
research:  the  value  of  moderator  leadership,  the  importance  of 
a faec-to-facc  encounter,  the  challenges  of  the  on-line  text-based 
medium,  the  influence  of  learning  and  temperament  styles,  and 
the  development  of  computer-supported  collaborative  learn- 
ing opportunities.  To  meet  the  goal  of  student-student  interac- 
tion in  an  on-line  environment,  the  involvement  of  a discussion 
area  moderator  is  recommended.  The  primary  role  of  the  mod- 


erator is  to  create  and  support  a positive  intellectual  and  emo- 
tional climate  for  the  interactive  learning  environment. 

Moderating  computer  discussions  requires  skill,  sensitiv- 
ity, and  persistence.  Fcenberg  (1989)  recommended  using 
weaving  comments  to  summarize  a discussion’s  main  themes, 
giving  credit  to  those  contributing  original  thoughts.  Davie 
(1989)  drew  attention  to  the  use  of  leading  and  refocusing  ques- 
tions, Hiltz  (1993)  suggested  that  requiring  student  participa- 
tion may  be  the  only  option  for  maintaining  active  dialogue. 
Moderating  discussions  involves  the  management  of  partici- 
pant identity,  the  environment’s  social  tone  and  attitude,  and 
the  development  of  student  text-based  communication  skills. 
The  challenge  of  moderating  the  social  dynamics  of  on-line 
discussions  was  highlighted  by  Fecnberg.  who  cautioned,  “Fail- 
ures and  breakdowns  occur  at  the  social  level  far  more  often 
than  at  the  strictly  technical  level”  ( 1989,  p.  28). 

Although  often  awkward  to  provide,  as  well  as  to  attend,  the 
face-to-face  encounter  for  distance  learning  classmates  has  been 
found  to  enhance  the  participant’s  overall  learning  experience 
(Femback  and  Thompson.  1995:  Rhcingold,  1993).  The  facc- 
to-face  opportunity  places  the  distance  learning  classroom  in 
context,  clarifies  expectations,  and  initiates  learning  activities. 
During  face-to-face  discussions,  class  members  can  learn  about 
network  design,  initiate  relationships,  and  practice  their  techni- 
cal skills.  The  instructor  has  the  opportunity  to  develop  personal 
contacts  with  class  participants  that  are  helpful  later,  when  on- 
line reassurance  and  advice  is  required.  Learners  who  have  had 
face-to-facc  encounters  are  more  likely  to  communicate  effec- 
tively on-line  because  the  personal  meeting  “has  provided  a num- 
ber of  contextualizing  cues  that  would  otherwise  be  absent  from 
discussions  held  exclusively  within  the  framework  of  a computer 
conference”  (Mason  and  Kaye,  1989,  p.  20). 

The  text-based  nature  of  the  on-line  environment  has  been 
described  as  impersonal,  limiting,  and  sterile  (Fecnberg,  1989). 
as  well  as  reflective,  explicit,  and  information-rich  (Harasim, 
1989).  For  educators  to  effectively  improve  an  educational 
experience  by  including  a text-based  on-line  environment,  the 
computer  context  must  be  carefully  designed. 

One  of  the  primary  cognitive  benefits  of  text-based  inter- 
action is  the  opportunity  for  reflective  communication.  The 
computer  environment  can  support  the  “process  of  articulating 
thoughts  into  written  speech  [involving]  deliberate  analytical 
action”  (Vygotsky,  1962,  p.  99).  It  offers  the  student  the  option 
to  reflect  upon  and  edit  one's  on-line  discussion  response. 
Reflection  influences  attentiveness,  not  only  to  the  content,  but 
to  the  quality  of  the  written  message.  The  educational  opportu- 
nities provided  by  this  on-line  characteristic  should  not  be  over- 
looked by  distance  educators. 

The  information-rich  medium  of  the  on-iinc  environment 
is  both  a boon  and  a bane.  The  boon  to  students  is  the  wealth  of 
information  available  on  the  Internet.  Although  this  informa- 
tion-rich source  must  be  managed,  its  potential  for  providing 
learner  resources  is  tremendous,  'flic  bane  to  students  is  that 
this  rich  resource  is  combined  with  archived  transcripts  of  ev- 
ery discussion,  comeisation,  and  interaction  held  within  the 
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class  context.  If  expectations  are  not  carefully  managed  for  the 
on-line  classroom,  this  information-rich  resource  can  fast  be- 
come incomprehensible  and  overwhelming.  Proactive  resource 
management  strategies  are  required  to  control  the  on-line  dis- 
tance learning  environment. 

The  influence  of  learning  styles  and  temperaments  upon 
the  distance  learner’s  educational  experience  is  fertile  ground 
for  further  research.  Most  research  done  to  date  has  focused 
on  the  psychological  factors  affecting  learners  in  traditional 
settings.  Few  studies  have  been  found  that  describe  or  test  the 
affect  of  psychological  factors  upon  the  distance  learner.  Atman 
(1988),  in  a study  of  the  relationship  between  psychological 
type  and  goal  accomplishment  among  distance  learners,  sug- 
gested a theoretical  advantage  for  distance  learners  classified 
as  extroverts,  intuitives,  thinkers,  and  judgers  by  the  Myers 
Briggs  Type  Indicator.  Ehrman  (1990)  discussed  major  learn- 
ing style  models  and  speculated  upon  the  applicability  to  dis- 
tance education  research.  Distance  education  is  an  expanding 
educational  context  that  offers  a number  of  unique  research 
opportunities.  The  relationship  between  learner  characteris- 
tics and  the  distance  learning  environment  is  one  such  opportu- 
nity. 

Development  of  computer-supported  collaborative  learn- 
ing opportunities  should  continue  as  a research  priority  for  dis- 
tance learning  providers.  During  the  1990s,  progress  toward 
providing  accessible  interpersonal  interaction  on-line  has  moved 
rapidly.  Interactive  on-line  systems  have  been  developed,  tested 
and  marketed.  This  trend  must  continue  to  receive  institutional 
support  in  order  to  provide  distance  learners  with  interpersonal 
opportunities  for  growth  and  development.  Harasim,  et  al.  stated 
that  on-line  education  “based  on  global  interactivity,  collabo- 
rative learning,  and  lifelong  access  to  educational  activities  and 
resources  ...  engenders  new  ways  of  working,  studying,  and 
problem-solving”  ( 1 995.  p.  278).  Access  to  such  an  education 
will  enable  learners  to  meet  the  challenges  of  the  information 
age  in  the  twenty-first  century. 


Recommendations  for  improvement  of  practice  included 
the  suggestion  that  strong  moderator  leadership  be  provided 
for  the  interactive  discussion  area  of  the  “Class  Page.”  The 
value  of  an  initial  face-to-face  encounter  for  distance  classmates 
was  discussed  and  the  educational  benefits  of  the  text-based 
on-line  environment  were  examined.  Suggestions  for  future 
research  included  the  need  for  studying  the  impact  of  student 
learning  styles  and  temperaments  in  distance  learning  environ- 
ments and  the  continuing  need  for  innovative  computer-sup- 
ported collaborative  learning  opportunities. 

Educators  today  are  being  challenged  to  appropriate  and 
adapt  emerging  communication  technologies  to  enrich  our  dis- 
tance learning  environments.  By  designing  and  implementing 
an  interactive,  interpersonal  dimension  for  the  distance  learn- 
ing environment,  educators  provide  an  equitable  and  potent 
educational  opportunity  for  learners  at  a distance. 
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Abstract 

Although  the  majority ' of  web  based  educational  tools  of  today  are  unremarkable , are  sometimes  diffi- 
cult to  access  and  are  not  completely  reliable , there  is  a mounting  push  for  students  and  faculty  to  use 
these  tools.  The  formidable  technical  challenges  that  confront  students  and  faculty  attempting  to  imple- 
ment these  technologies  often  quickly  overshadows  the  more  fundamental  question — how  should  exist- 
ing and  future  technologies  be  used  in  the  teaching  and  learning  process?  Assuming,  for  example,  that 
a given  piece  of  technology  could  be  implemented  universally  without  difficulty  and  perform  exactly  as 
expected \ what  is  the  impact?  Having  made  fair  and  unbiased  evaluations  concerning  a given  technol- 
ogy, important  questions  regarding  implementation  remain.  For  those  that  have  resigned  themselves  to 
providing  course  material  via  the  web,  a common  question  for  both  educational  institutions  as  well  as 
individual  faculty  is  if  now  is  the  best  time  to  begin.  One  workable,  logical  progression  path  involves 
using  a four-step  process.  The  foundation  of  this  process  begins  with  experimentation,  moves  to  de- 
ployment from  templates,  then  to  redeveloping  pages  based  on  need  and  student  feedback,  and  finally  to 
using  this  experience  in  innovation  specifically  tailored  to  the  class  needs. 


Introduction 

For  many  educators,  the  prospect  of  integrating  tech- 
nologies such  as  the  World  Wide  Web  into  the  educational 
process  is  likely  reminiscent  of  their  early  experiences  with 
classroom  filmstrip  projectors:  setup  was  often  awkward  and 
difficult,  there  were  always  elusive  technical  problems  with 
audio  or  video,  content  was  sometimes  less  than  remark- 
able, and  students'  attentions  were  typically  less  than  undi- 
vided. In  a like  manner,  the  often-heard  criticisms  of 
yesterday’s  filmstrip  could  well  be  made  against  today’s  most 
frequently  seen  educational  Web  implementations.  Yet,  the 
broad  and  evolving  success  of  the  Web  in  education  shows 
no  signs  of  slowing.  Although  haunting  images  of  melting 
celluloid  and  exploding  projector  bulbs  no  doubt  remain, 
the  siren  song  of  the  Web  continues  to  grow  louder  from 
every  direction.  The  push  to  create  Web-based  educational 
tools  from  university  administrators,  technologically  aware 
students,  the  mass  media,  and  competing  institutions  has 
become  one  that  can  no  longer  be  set  aside. 

When  Web  technologies  were  first  beginning  to  emerge, 
speculation  abounded  over  the  tremendous  implications  these 
held  for  distance  education.  As  the  veil  was  pulled  away 
however,  formablc  issues  concerning  real-world  feasibility 
and  actual  student  enrichment  through  this  high  technology 
begin  to  emerge.  Roadblocks  such  as  prohibitive  cost,  in- 
adequate human  resources,  and  a steep  technical  learning 


curve  have  been,  and  often  continue  to  remain,  barriers  to 
serious  educational  Web  development. 

Preceding  the  more  practical  (or  tactical)  issues  facing 
the  development  of  Web  technologies  in  education,  there 
arc  more  fundamental  questions  concerning  if,  when,  and 
how  these  technologies  should  be  used  in  distance  educa- 
tion or  in  any  formal  teaching  and  learning  model.  Before 
choosing  between  moderated  and  open  newsgroups  forex- 
ample,  it  may  be  necessary  to  ask  what  effect  newsgroup 
technology  itself  has  on  the  social  aspects  of  the  learning 
process.  Asked  another  way;  presuming  all  the  technology 
works  exactly  asJntended,  is  the  learning  process  being  en- 
hanced as  a result  of  the  technology  use  in  ways  that  are 
meaningful  and  significant? 

Examining  the  practical  roadblocks  commonly  faced  in 
educational  technology  integration  in  the  light  of  fundamental 
philosophical  issues  provides  a methodology  for  determin- 
ing appropriate  educational  applications  of  the  World  Wide 
Web  in  today’s  teaching  and  learning  environment.  We  are 
then  drawn  to  ask:  Do  electronic  discussion  forums  provide 
students  with  an  enhanced  level  of  communication  that  con- 
tributes significantly  to  the  learning  experience?  Are  mod- 
erated or  open  discussions  better  suited  for  classroom 
discussion?  Is  creating  a class  Web  page  useful  or  even 
appropriate  when  it  is  known  that  not  all  students  will  have 
a reasonable  level  of  access?  How  will  students  with  dis- 
abilities, such  as  visual  impairments,  access  the  electronic 
resources  made  available  to  other  students? 
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Is  Now  the  Appropriate  Time  to  Begin  Focusing  on 
Web  Development? 

The  growing  tide  of  technological  development  in  edu- 
cation has  left  little  doubt  as  to  whether  institutions  as  a whole 
(and  hence  the  instructors  teaching  for  them)  can  avoid  inte- 
gration of  the  Internet  into  their  curriculum.  Yet  presently 
the  total  ratio  of  classes  on  the  Web  is  small  when  compared 
to  the  total  number  of  classes  offered,  suggesting  that  while 
some  institutions  have  rapidly  embraced  Web  development, 
many  others  have  delayed  resource  commitment.  A wide 
array  of  reasons,  sometimes  compelling,  are  advanced  as  a 
rationale  for  delaying  the  investment  in  or  development  of 
Web  pages  and  their  related  technologies: 

• Developing  resources  on  the  Web  may  be  an  important 
task,  however  there  are  other  compelling  demands  for 
an  instructor's  time.  Realistically,  even  an  extraordi- 
nary amount  of  effort  expended  on  Web  development 
may  not  bear  fruit  for  some  time. 

• Past  advances  in  technology  have  resulted  in  improved 
Web  development  tools  that  do  in  only  a few  hours  what 
would  have  taken  weeks  or  months  just  a short  time  ago. 
As  technology  is  constantly  moving  ahead,  similar  future 
advances  in  the  tools  of  tomorrow  will  again  likely  reduce 
the  amount  of  time  it  takes  to  create  pages  and  similarly 
increase  the  quality  of  the  work  product  created. 

• No  central  Web  publishing  site  is  available.  Without  a 
central  publishing  site,  faculty  find  it  nearly  impossible 
to  publish  a Web  page  because  of  the  problems  inher- 
ent to  hosting  a Web  server. 

• Neither  appropriate  funding  nor  trained  support  staff 
are  presently  available  to  assist  with  new  web  develop- 
ment technologies.  Delaying  development  may  allow  a 
funding  window  to  become  available  and  permit  train- 
ing for  support  staff. 

• Those  who  wait  to  develop  their  sites  will  be  able  to 
build  upon  the  successes  and  learn  from  the  mistakes  of 
early- adopters  investing  large  amounts  of  time  and  other 
resources  in  today's  Web  development. 

• Students  do  not  yet  have  Internet  access.  This  creates 
an  unfair  advantage  for  those  who  do  presently  have 
access  as  well  as  unfairly  excluding  those  who  do  not. 

While  the  above  listed  reasons  could  be  cited  in  a wide 
variety  of  circumstances,  there  are  good  reasons  for  indi- 
vidual faculty  and  for  the  institution  as  a whole  to  look  past 
them  and  move  forward  with  Web  development.  Adminis- 
trative perceptions  regarding  early  development  of  Web 
pages  for  education  must  be  realistic  and  carefully  managed 
for  a successful  initial  implementation.  Rewarding  early 
technology  adopters,  remaining  open  to  alternate  directions 
in  the  face  of  short  term  successes  or  failures,  discontinuing 
fast-failures  of  dead-end  technology,  and  providing  funding 
for  low-cost  trial  runs  arc  examples  of  administrative  sup- 


port that  can  save  an  initial  Web  development  effort.  Fac- 
ulty participation  in  this  initial  stage  of  development  is  cru- 
cial; administrators  that  fail  to  involve  faculty  at  the 
beginning  will  have  difficulty  procuring  enthusiastic  sup- 
port later  when  buy-in  is  essential.  Even  where  there  are 
seemingly  compelling  reasons  to  delay  Web  development, 
there  are  advantages  to  moving  forward  even  if  on  a reduced 
scale.  Some  important  reasons  for  moving  ahead  with  de- 
velopment include: 

• The  Web  can  be  an  exciting  and  challenging  area  for 
both  students  and  instructors.  Any  creative  work  takes 
time,  and  many  instructors  find  great  personal  and  pro- 
fessional reward  from  the  time  they  invest  in  Web  and 
related  technological  development. 

• The  fact  that  technology  continues  to  advance  and  that 
today’s  Web-publishing  procedures  seem  tedious  and 
perhaps  even  arcane  serves  to  suggest  that  eventual  re- 
placement is  likely.  Technology  will  always  be  advanc- 
ing, however  delaying  development  may  only  result  in 
having  to  deal  with  a similar  set  of  problems  later. 

• Until  very  recently,  an  absolute  prerequisite  of  Web  page 
development  was  the  setup  of  a large,  centralized  insti- 
tutional Web  server  where  faculty  could  publish  their 
pages.  Without  access  to  a centralized  Web  server,  a 
faculty  member  had  no  way  to  publish  Web  pages  or 
otherwise  share  them  with  students.  While  the  central- 
ized Web  server  remains  the  generally  preferred  method 
of  publishing  instructional  Web  pages,  it  is  now  fea- 
sible to  host  a Web  page  without  access  to  such  re- 
sources. Today,  the  faculty  member’s  personal  computer 
is  generally  sufficient,  provided  it  connects  to  the 
Internet  and  has  reasonable  computing  power. 

• If  there  is  very  little  money  available  at  an  institution- 
wide level  today,  there  is  an  even  smaller  likelihood 
that  sidestepping  technologies  such  as  the  Web  will  later 
result  in  greater  availability  of  funds.  Technologies  have 
evolved  to  the  point  that  the  large  investments  once 
needed  to  get  started  with  Web  page  hosting  and  devel- 
opment arc  no  longer  necessary.  Building  a small  site 
using  only  an  existing  personal  computer  connected  to 
the  Internet  requires  an  investment  as  small  as  fifty  dol- 
lars. Such  low-cost  solutions  include  PC  Web  server 
software  and  page  editing  tools  for  Web  creation,  pub- 
lishing. and  ongoing  site  maintenance. 

• No  matter  when  a person  decides  to  learn  about  technol- 
ogy, there  will  be  a learning  curve  and  mistakes  are  prob- 
able before  polished  results  come  together.  Waiting  for 
another  person  to  make  all  the  mistakes  only  delays  valu- 
able learning  experiences  that  will  have  to  be  faced  in 
one  form  or  another  at  some  point.  There  are  no  substi- 
tutes for  personal  experience  with  technology. 

• All  students,  including  students  with  disabilities,  must 
have  adequate  access  for  the  technology  to  be  feasible. 
Most  institutions  have  on-site  public  computer  labs. 
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which  are  available  to  enrolled  students  without  addi- 
tional cost.  Students  in  distance  education  programs 
are  generally  required  to  have  access  to  a computer  for 
electronic  access  prior  to  enrollment; 

• Today's  students  do  not  have  the  luxury  of  waiting 
months  or  years  for  Web  technologies  to  become  more 
convenient  for  their  schools,  their  instructors,  or  for 
themselves.  Learning  to  use  today’s  available  technol- 
ogy is  as  much  a part  of  the  learning  process  as  the  sub-  . 
ject  matter  the  underlying  pages  are  intended  to  promote. 
Even  when  considering  the  rapid  rate  of  change,  learn- 
ing about  the  technologies  currently  available  can  only 
help  prepare  the  student  and  the  instructor  for  the  tech- 
nologies yet  to  come.  Software  developers  know  that 
their  products  can  be  complex,  and  attempt  to  build  upon 
previous  releases  so  that  the  client’s  knowledge  of  the 
previous  version  may  be  directly  applied. 

It  would  be  impossible  to  consider  all  of  the  reasons  why 
universities  and  faculty  members  either  start  or  delay  Web 
development.  After  carefully  considering  the  factors  unique 
to  each  situation,  decisions  about  how  to  use  these  technolo- 
gies in  course  development  must  ultimately  rest  with  the  indi- 
vidual course  instructor.  It  will  be  the  faculty  member  who 
will  be  primarily  responsible  for  the  creation,  focus,  content, 
design,  and  upkeep  of  the  class  Web  page.  Once  the  decision 
to  move  forward  with  a Web  page  is  made,  an  appropriate 
starting  point  for  development  must  be  identified. 

Logical  Progression  Paths 
for  Educational  Web  Development 

A typically  recurring  theme  for  initial  Web  page  devel- 
opment is  that  instructors  should  start  very  small  with  a ba- 
sic design  that  may  be  quickly  completed.  Small  group  or 
individualized  instruction  with  good  follow-up  and  quick, 
demonstrable  results  are  crucial  during  this  initial  stage.  For 
example,  many  course  page  design  workshops  being  done 
for  faculty  emphasize  initial  page  design,  creation  and  pub- 
lication during  a one  or  two  hour  session.  A second  course, 
offered  perhaps  a few  days  later,  then  builds  upon  the  first 
session  by  providing  additional  instruction  to  create  easily 
enhanced  functionality. 

During  and  after  the  initial  training,  instructors  need  to 
have  continued  access  to  the  same  level  of  software  and  hard- 
ware initially  used  during  training.  Ongoing  support  should 
include  access  to  personal  computers  that  arc  properly  con- 
nected and  configured  with  a standard  set  of  utilities  sup- 
ported by  the  institution.  A non-public  practice  environment, 
and  ongoing  access  to  technical  support  staff  who  are  able 
to  resolve  technical  issues  that  will  inevitably  arise,  arc  also 
crucial.  Once  instructors  begin  to  develop  web  building  skills 
using  the  training  that  they  have  received,  defining  a longer- 
term  logical  progression  path  will  help  faculty  move  toward 
independent  development. 


Planned  phases  of  Web  development  extrapolated  from 
naturally  progressive  steps  of  learning  are  familiar  to  the 
instructor’s  environment  and  will  provide  the  most  comfort- 
able, creative,  and  productive  development  atmosphere.  For 
example,  rather  than  extending  the  process  of  initial  devel- 
opment through  an  entire  semester  to  develop  a comprehen- 
sive set  of  Web  pages,  developing  an  initial  brief  page  in  the 
month  before  the  target  class  begins  may  be  more  benefi- 
cial, A small  low-cost  initial  page  provides  the  instructor 
with  an  initial  test-bed  to  accept  peer  and  student  feedback, 
while  keeping  the  initial  focus  on  a page  that  can  be  easily 
changed  as  well  as  fundamentally  redesigned.  While  the 
actual  phases  of  development  are  often  heavily  dependent 
on  the  instructor’s  individual  environment  and  supported 
development  tools,  a useful  model  for  logical  progression 
might  include  the  following  steps: 

Phase  One:  Experimentation 
Phase  Two:  Template 
Phase  Three:  Redevelopment 
Phase  Four:  Innovation 

These  phases  could  be  set  out  formally  set  out  as  part  of 
a structured  training  program,  or  informally  as  an  on-line 
series  of  tutorials.  Whether  these  phases  implemented  as 
part  of  a structured  training  program  or  as  general  guide- 
lines, their  function  is  essentially  the  same.  Each  of  these 
phases  brings  the  instructor  closer  to  the  goal  of  a Web  page 
that  serves  needs  of  the  students  in  the  class  in  an  informa- 
tive, interesting,  and  professional  manner. 

Experimentation 

In  the  initial  stage  of  Web  page  development,  experi- 
mentation is  of  primary  importance.  Page  authors  must  feel 
free  to  investigate  the  tools  they  are  using  without  fear  of 
harming  production  data,  their  machines,  the  central  server, 
or  any  other  component  in  this  environment.  This  phase  of 
initial  experimentation  and  discovery  also  should  be  offered 
in  an  private  environment  in  order  to  prevent  the  anxiety 
that  initially  exists  when  Web  pages  arc  published  for  the 
world  to  see. 

Experimentation  is  also  very  important  because  today’s 
advanced,  feature-rich  Web  development  tools  require  a 
considerable  amount  of  open  investigation  before  the  power 
of  their  functions  becomes  readily  apparent  and  can  be  used 
with  skill.  Once  instructors  have  become  confident  with  the 
technology,  the  next  step,  using  templates  in  Web  develop- 
ment, can  begin. 

Template  Development 

One  of  the  apparent  problems  instructors  have  design- 
ing Web  pages  is  getting  started  with  an  initial  design  from  a 
blank  screen.  What  is  the  theme  of  the  page?  How  is  infor- 
mation organized  for  easy  navigation?  What  kind  of  infor- 
mation is  displayed  or  collected?  How  do  other  instructors 
use  the  Web  to  teach  their  classes?  Fortunately,  using  the 
course  template  as  a starting  point  resolves  each  of  these 
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issues.  The  course  template  usually  involves  a predefined 
skeleton  or  “shell"  which  the  instructor  can  modify  provided 
the  content  meets  established  university  guidelines.  Selec- 
tion of  specific  starting  templates  may  vary  by  department, 
course,  or  individual  instructor. 

Course  templates  often  are  designed  in  a degree  of  lev- 
els, starting  with  simple  text  and  graphics  and  progressing 
in  complexity  through  demonstrations  of  some  of  the  more 
advanced  functions  of  the  server.  The  best  approach  may 
be  to  steer  the  beginning  instructor  toward  a more  basic  tem- 
plate, later  introducing  the  advanced  functions  of  the  server 
using  a “toolkit"  approach.  Keeping  the  initial  design  focus 
on  basic  functions  allows  instructors  to  build  a solid  foun- 
dation without  the  concerning  themselves  w'ith  the  complexi- 
ties advanced  server  functions  inherently  bring. 

Redevelopment 

Instructors  may  move  very  quickly  between  redevelop- 
ment and  innovation,  especially  if  their  initial  experimenta- 
tion and  use  of  templates  has  given  them  a high  comfort 
level.  The  process  of  redevelopment  includes  two  major 
goals.  First,  instructors  begin  to  look  beyond  the  “cook- 
book" approach  of  the  template  to  develop  pages  more  re- 
flective of  their  own  teaching  style  and  course  development 
needs.  Secondly,  the  instructor  will  generally  attempt  to 
recreate  many  of  the  course  functions  and  concepts  within 
the  web  page.  For  example,  essential  course  concepts  con- 
tained in  outlines,  lecture  notes,  and  results  of  classroom 
discussions  are  likely  to  be  reproduced  in  Web  form.  Im- 
portant administrative  functions  such  as  practice  quizzes, 
course  calendars,  and  discussion  areas  are  advanced  ex- 
amples that  may  require  advanced  design  preparation  and 
support,  as  they  require  user  interactivity  as  opposed  to  dis- 
playing static  information. 

Finally,  knowing  about  the  opportunity  for  a “redevel- 
opment" from  ihe  start  allows  the  instructor  to  operate  less 
critically  in  the  initial  phases  of  development.  From  this 
point  of  view,  the  redevelopment  phase  can  be  marketed  to 
faculty  as  a time  to  reexamine  what  has  been  created  up  to 
this  point  and  switch  direction  if  appropriate. 

Innovation 

Innovation  provides  the  gateway  for  unlimited  high-end 
Web  development  and  brings  the  development  cycle  full 
circle.  Moving  past  templates  and  page  redesign,  innova- 
tion is  concerned  with  development  at  the  next  level,  often 
encompassing  interactive  pages  that  engage  student  input 
and  interaction. 

Before  instructions  advance  into  these  areas  however, 
it  is  important  that  they  receive  ongoing  guidance  in  under- 
standing the  difference  between  technological  innovation, 
and  educational  innovation  however.  While  there  is  no 
bright  line  separating  the  two,  looking  at  new  technologies 
from  a critical  viewpoint  will  help  eliminate  poor  techno- 
logical choices  that  serve  more  to  demonstrate  technologi- 


cal wizardry  than  contributing  to  the  teaching  and  learning 
process.  What  may  first  appear  to  be  “innovation"  may  fore- 
stall an  otherwise  successful  development  effort;  embracing 
new  technology  too  quickly  or  without  proper  planning  leads 
to  dead-ends  that  make  recovery  difficult.  For  example,  a 
reasonably  complete  and  well  organized  course  page  may 
quickly  become  bogged  down  by  excessively  large  and  cum- 
bersome graphics,  unnecessary  use  of  movies  or  other  high- 
bandwidth  applications,  and  tools  requiring  students  to 
download  and  configure  advanced  “plug-ins"  before  the  page 
can  be  seen.  The  danger  is  that  using  the  leading  edge  tech- 
nology does  not  necessarily  produce  leading  edge  students; 
technologies  should  be  selected  based  on  an  impartial  evalu- 
ation of  how  they  engage  the  learner  opposed  to  other  less 
complicated  and  universally  compatible  solutions.  The  de- 
velopment tools  and  resources  that  promise  the  most  excit- 
ing web  development  opportunities  cannot  be  applied 
successfully  unless  their  use  is  part  of  a larger  institutional 
plan  which  provides  for  their  large-scale  integration.  For 
example,  at  the  present  time  connecting  Web  pages  to  data- 
bases stored  on  mainframes  or  other  iarge  computing  sys- 
tems requires  extensive  setup  of  back-end  facilities  by 
dedicated  computer  professionals. 

How  can  new  technologies  be  effectively  integrated 
while  avoiding  these  pitfalls?  One  successful  approach  has 
been  to  develop  a supported  “toolkit"  of  higher-end  sup- 
ported tools  which  instructors  rnay  use  to  develop  advanced 
page  functions.  The  “toolkit"  approach  is  an  effective  way 
of  introducing  new  technologies  which  heading  off  rogue 
directions  that  can  slow  the  development  process.  When 
instructors  are  ready  to  venture  past  templates  towards  in- 
novative pages  of  their  own  design,  providing  them  with  a 
set  of  advanced  tools  which  have  been  tested  and  are  sup- 
ported within  the  organization.  For  example,  new  graphics 
design  packages  that  can  be  used  to  create  three-dimensional 
images  arc  becoming  widely  available  and  have  advanced 
to  the  point  that  they  are  not  prohibitively  difficult  to  use. 
Developing  a workable  support  strategy  for  all  of  the  avail- 
able packages  however  would  be  impossible.  Even  attempt- 
ing to  support  the  top  ten  packages  would  likely  be  a 
tremendous  drain  on  institutional  resources  given  the  dis- 
parity between  the  various  packages.  In  contrast  however, 
selecting  the  best  one  or  two  packages  and  making  them 
readily  available  to  instructors  as  part  of  a supported  toolkit 
provides  a more  workable  solution.  As  instructors  justifi- 
ably demand  greater  support  for  functionality,  the  toolkit 
can  be  expanded  to  include  appropriate  resources  to  fill  those 
needs  without  overextending  the  support  staff.  Advanced 
workshops  and  introductory  training  for  these  supported 
packages  then  becomes  more  manageable.  In  order  for  a 
the  “toolkit"  approach  to  work  effectively,  institutional  sup- 
port staff  must  take  an  active  role  in  supporting  the  products 
included  in  toolkit  as  well  keeping  the  toolkit  updated  to 
reflect  advances  in  technology  and  required  additional  func- 
tionality. 
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Conclusion 

The  World  Wide  Web  has  become  and  will  likely  remain 
an  increasingly  important  medium  for  supplementing  and  even 
delivering  course  content.  Although  the  Web  we  have  today 
is  the  product  of  very  recent  technologies,  many  of  the  prob- 
lems educators’  face  in  effectively  using  the  Web  today  par- 
allel the  problems  experienced  using  the  “new”  technologies 
over  ten  years  ago.  Overcoming  the  many  potential  road- 
blocks that  stand  in  the  way  of  successful  Web  development 
requires  educators  to  work  in  close  cooperation  with  the  ad- 
ministrators and  technologists  responsible  for  developing  the 


underlying  infrastructure  that  makes  the  Web  possible.  Not- 
withstanding the  many  reasons  propounded  for  delaying  de- 
velopment, now  is  the  time  to  move  forward  even  if  on  a small 
scale.  Once  the  decision  ha-;  been  made  to  move  forward 
planning  deployment  using  the  naturally  progressive  steps  of 
experimentation,  use  of  the  template,  redevelopment,  and  in- 
novation will  provide  instructors  with  a comfortable  and  pro- 
ductive development  environment.  Using  the  “toolkit” 
approach  for  bringing  new  technologies  into  the  development 
environment  will  help  head  off  rogue  directions  while  pro- 
viding a manageable  support  path. 
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Abstract 


Radical  advancements  in  Internet  technology  over  the  last  decade  have  created  endless  opportunities  to 
expand  the  realm  of  the  elementary  classroom . The  World  Wide  Web  (WWW),  e-mail \ Newsgroups , and 
Internet  Relay  Chat  (IRC)  are  four  of  the  most  prominent  utilizations  of  Internet  technology.  This  paper 
demonstrates  how  one  mid-western,  suburban  elementary  classroom  has  enhanced  its  curriculum  and 
improved  classroom  interaction  by  maximizing  Internet  technology  In  addition  to  reviewing  the  merits 
of  this  case  study , the  reader  will  also:  (a)  be  presented  with  a rationale  for  utilizing  Internet  technol- 
ogy with  existing  curricula,  (b)  examine  the  current  debate  on  the  issue  of  networking  schools,  (c) 
compare  and  contrast  the  pros  and  cons  of  utilizing  Internet  technology  in  elementary'  classrooms,  and 
(d)  consider  the  coalescence  of  curriculum  and  technology.  An  overview  regarding  the  current  applica- 
tion of  Internet  technology  in  an  elementary  setting  highlights  its  true  benefits:  students  conducting 
research  on  a topic  of  interest,  communication  and  collaborative  projects  between  students  around  the 
world,  and  the  opportunity1  for  students  to  publish  original  work. 


Technology  and  Cognition 

Tremendous  enthusiasm  presently  exists  toward  the  net- 
working of  school  classrooms  and  the  coalescence  of  curricu- 
lum and  technology.  While  many  critics  have  labeled  this 
current  educational  trend  as  nothing  more  than  an  “expensive 
infatuation  with  the  Internet”  (Banks  & Renwich,  1997),  oth- 
ers view  this  emerging  technology  as  an  opportunity  to  moti- 
vate students  to  participate  in  the  learning  process. 

Over  the  years,  educational  theorists  have  recognized 
the  role  technology  plays  in  fostering  human  intelligence. 
David  Olson  (1976)  noted  that  “intelligence  is  not  some- 
thing we  have  that  is  immutable:  it  is  something  we  cultivate 
by  operating  %vith  a technology,  or  something  we  create  by 
inventing  a new  technology.”  This  view  can  be  summarized 
by  saying  that  the  role  of  technology  is  to  act  as  both  an 
extension  of,  and  a stimulus  io,  human  cognition  (Sewell, 
1995),  Seymour  Papert’s  work,  culminating  in  his  influen- 
tial book  Mindstorms , visualized  a role  for  computers  and 
technology  that  emphasized  “breaking  down  the  barriers  that 
frequently  exist  between  differing  areas  of  the  curriculum, 
as  revolutionizing  the  nature  of  learning,  and  as  lowering 
the  threshold  of  the  abstract”  (Papert,  1980). 

If  the  current  application  of  Internet  technology  is  only 
viewed  by  the  elementary  teacher  as  a means  of  providing 
remediation  and  enrichment,  a tremendous  opportunity  to 
challenge  young  mind’s  will  be  lost.  “Classroom  computers 
can  change  children's  minds,  but  to  do  so  they  need  to  be 
used  by  teachers  who  do  not  view  computers  as  surrogate 
teachers  so  much  as  tools  with  which  their  own  educational 
goals  can  be  reached”  (Underwood  & Underwood,  1990). 


Nora  Sabelli,  of  the  National  Science  Foundation,  said 
it  best:  “The  Net’s  main  value  will  be  breaking  the  isolation 
of  the  classroom  by  allowing  children  to  talk  to  experts,  ex- 
change ideas,  and  tap  into  real  time  information”  (Kronholz, 
1997).  This  attitude  reflects  a growing  rationale  toward  uti- 
lizing such  technology  in  an  elementary  setting.  Without 
doubt,  Internet  technology  has  the  potential  to  serve  as  the 
mediating  factor  between  the  learning  environment  and  the 
acquisition  of  human  intelligence. 

Case  Study  of  a Mid- Western 
Suburban  Elementary  School 

A case  study  was  conducting  during  the  1996-1997 
school  year  in  a rapidly  growing  mid-western,  suburban  el- 
ementary school.  The  case  study  specifically  examined  a 
fifth  grade  classroom  that  was  utilizing  Internet  technology 
to  complete  a variety  of  classroom  projects.  The  school 
selected  for  this  study  is  one  of  six  elementary  schools  net- 
worked to  both  a middle  school  and  high  school  within  the 
school  district.  The  school  district  budgeted  and  completed 
a massive  capital  improvement  project  that  involved  net- 
working all  of  the  school  buildings.  This  project  included 
the  purchase  of  a network  file  server,  as  well  as,  contracting 
the  installation  of  Fiber  optic  cable  between  all  buildings 
within  the  district.  The  school  examined  in  this  study  was 
outfitted  with  two,  thirty-unit  computer  laboratories  that  uti- 
lize Macintosh  Power  PCS.  Both  laboratories  were  equipped 
for  Internet  applications,  in  addition  to  providing  an  Internet 
connection  for  each  classroom  computer  (one  per  room). 

A survey  conducted  at  the  beginning  of  the  school  year 
revealed  that  sixty-four  percent  of  the  students  assigned  to 
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this  classroom  had  previous  experience  with  the  Internet. 
Forty-three  percent  indicated  that  they,  had  access  to  the 
Internet  in  their  home,  while  only  twenty-five  percent  of  this 
group  indicated  that  they  had  previously  used  the  Internet  to 
complete  research  on  a school  project.  Eleven  percent  of 
the  students  from  this  classroom  indicated  that  they  had  no 
prior  knowledge  of  the  Internet  and  were  being  introduced 
to  Internet  technology  for  the  first  time. 

The  teacher  involved  with  this  case  study  received  ex- 
tensive training  in  educational  technology  as  a pre-service 
teacher.  However,  the  pre-service  training  was  void  of  any 
Internet  experience.  The  teacher  indicated  that  Internet  ex- 
perience was  acquired  through  personal  interest,  beginning 
with  the  teacher's  enrollment  through  an  Internet  Service 
Provider  (ISP)  in  October  of  1995.  Since  that  time,  the 
teacher  had  completed  some  formalized  training  related  to 
Internet  technology. 

Some  of  the  applications  observed  during  the  study  in- 
cluded: (a)  utilizing  a variety  of  Internet  search  engines  to 
retrieve  biographical  information  on  notable  individuals  of 
the  twentieth  century,  (b)  downloading  a variety  of  images 
to  be  printed  in  color  and  later  displayed  in  a student  project, 
(c)  accessing  weather  satellite  images  to  make  predictions 
regarding  the  daily  weather  forecast,  (d)  linking  to  a variety 
of  educational  sites  that  provided  specific  information  re- 
garding both  social  studies  and  science  topics  (e.g.,  Colo- 
nial America,  global  warming,  etc.),  and  (e)  sending  and 
retrieving  e-mail  (e.g.,  electronic  pen  pals).  Prior  to  being 
allowed  to  utilize  any  Internet  application,  students  had  to 
complete  a school  permission  slip  (that  was  signed  by  a par- 
ent) acknowledging  that  the  school  district’s  policy  regard- 
ing Internet  access  had  been  reviewed  with  the  child. 

Tremendous  enthusiasm  was  noted  in  regard  to  students 
completing  research  on  assigned  topics.  Many  students,  who 
earlier  demonstrated  a dislike  for  completing  research,  were 
extremely  active  in  the  retrieval  of  information  related  to  a 
specific  topic  being  discussed  in  class.  A small  percentage 
of  students  found  the  exercise  to  be  frustrating  and  opted  for 
a more  conventional  approach  to  completing  their  research 
(i.e.,  utilizing  an  encyclopedia). 

While  the  overall  effectiveness  of  applied  Internet  tech- 
nology is  inconclusive  in  this  case  study,  there  were  several 
positive  benefits  noted.  The  majority  of  students  were  ac- 
tively engaged  in  research  for  an  extended  period  of  time. 
Students  displayed  an  ability  to  work  independently  of  the 
teacher,  requiring  only  minimal  assistance  while  conducting 
“Web”  searches.  Finally,  students  were  able  to  incorporate 
much  of  the  information  gained  from  their  Internet  search 
into  a final  written  report  (i.e.,  a biography  of  a notable  per- 
son from  the  twentieth  century). 

The  Current  Debate  on  Internet  Technology 

The  debate  over  networking  schools  and  providing 
Internet  access  to  all  students  is  complicated  by  a number  of 
political  and  economical  issues.  President  Clinton  recently 


escalated  the  debate  by  committing  fifty-seven  million  dol- 
lars toward  “technology  literacy  grants”,  aimed  at  assisting 
poor  school  districts  tuat  lack  the  fiscal  resources  required 
to  “hard  wire”  their  buildings.  The  Clinton  Administration 
has  also  pressured  the  Federal  Communications  Commis- 
sion (FCC)  to  “establish  a 2.25  billion-dollar  Universal  Ser- 
vice Fund,  which  will  link  schools  across  the  country  to  the 
Internet  beginning  in  1998”  (Associated  Press,  1997).  Presi- 
dent Clinton  has  further  promulgated  Internet  access  in 
schools  by  encouraging  school  districts  to  consider  volun- 
teer labor  as  an  alternative  to  contracting  the  labor  required 
to  hard  wire  a building.  Clinton  views  such  a community 
effort  as  “an  old-fashioned  bam  raising  [when]  neighbor  joins 
with  neighbor  to  do  something  for  the  good  of  the  entire 
community”  (McAllister,  1997). 

Critics  are  quick  to  point  out  that  regardless  of  the  amount 
of  money  offered  through  federal  and  state  agencies,  the 
Internet  will  remain  only  a promise,  and  not  the  panacea  that 
people  predict.  Critics  point  to  a National  Study  conducted 
by  the  Rand  Corporation  of  Santa  Monica,  California.  The 
Rand  Corporation  study  concluded  there  was  no  significant 
evidence  to  justify  “networking”  all  of  the  nation’s  schools 
and  that  computers  as  a whole  “remain  marginal  contributors 
in  most  schools”.  Sandra  Banks  and  Lucille  Renwich  ( 1 997) 
noted  three  obstacles  to  achievement:  (a)  a high  price  tag, 
(b)  lack  of  teacher  training,  and  (c)  no  consensus  on  best  use. 
In  a June  8,  1997  article  appearing  in  the  Los  Angeles  Times , 
Banks  and  Renwich  noted  that  only  a small  percentage  of 
successful,  Internet  equipped  schools  exist.  One  such  school, 
Blackstock  Junior  High  School  in  Ventura  County,  California 
has  shown  tremendous  success  in  student  achievement  attrib- 
uted directly  to  the  coalescence  of  technology  and  curricu- 
lum. This  success  is  marred  by  the  tremendous  cost  associated 
with  their  success.  For  example,  Blackstock  Junior  High 
School  invested  three  billion  dollars  over  a ten-year  period. 
During  thi*  time,  teachers  were  given  a year  off  to  receive 
training  in  the  appropriate  application  of  Internet  technology 
and  the  school’s  curriculum  was  completely  overhauled  to 
included  Internet  requirements.  To  maintain  their  success, 
the  Blackstock  Junior  High  School  currently  operates  with  a 
technology  budget  in  excess  of  $380,000  a year  (Banks  and 
Renwich,  1997). 

The  outcome  of  this  debate  is  undecided.  Many  lead- 
ers in  the  field  of  education  question  whether  the  enormous 
cost  to  provide  the  hardware  required  for  Internet  technol- 
ogy is  really  worth  the  investment.  Adding  to  the  enormous 
price  tag  is  the  realization  that  only  five  percent  of  current 
funding  goes  toward  training  teachers  in  the  use  of  this  tech- 
nology. Only  eighteen  states  presently  require  pre-service 
teachers  to  receive  training  in  Internet  technology,  and  of 
these  eighteen,  only  five  require  that  veteran  teachers  re- 
ceive training  prior  to  renewing  their  teaching  license  ( Wall 
Street  Journal,  1997).  Without  conclusive  evidence  on  the 
effectiveness  of  Internet  technology  in  the  elementary  class- 
room, many  educators  question  whether  money  is  being 
wasted  on  an  expensive  experiment.  Nevertheless,  Stuart 
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Biegel,  Professor  of  Education  and  Information  Studies  at 
the  University  of  California,  Los  Angeles  (UCLA),  poses 
an  interesting  question:  “It  is  a step  into  the  unknown,  no 
question  about  it.  So  the  question  is,  do  we  take  the  step  or 
do  we  sit  back  and  let  somebody  else  do  it?”  (Banks  and 
Renwich,  1997). 

Biegel’s  remarks  demonstrate  the  reality  that  supersedes 
any  debate.  Internet  technology  is  here  to  stay.  It  will  con- 
tinue to  work  its  way  into  the  elementary  classroom  and  cur- 
riculum. Rather  than  wasting  time  debating  its  cost 
effectiveness  or  its  merit  as  an  instructional  tool,  the  debate 
should  be  muted  in  favor  of  developing  this  emerging  tech- 
nology into  an  effective  teaching  tool. 

Implications  for  the  Future 

A review  of  educational  research  leads  one  to  conclude 
that  the  true  obstacle  to  realizing  successful  integration  of 
Internet  technology  and  elementary  curricula  lies  in  the  fact 
that  “past  staff  development  programs  have  not  focused  on 
the  specific  instructional  computer  skills  needed  by  teachers 
to  integrate  the  Internet  into  classrooms”  (O’Donnell,  1996). 

In  the  book,  Integrating  Computer  Into  the  Classroom , 
Edith  O’Donnell  notes  the  need  for  “a  new  philosophy”.  This 
new  philosophy  must  fulfill  three  purposes:  (a)  recognize 
that  just  placing  computers  with  Internet  access  into  class- 
rooms is  not  adequate  for  integration,  (b)  recognize  that 
teachers  wish  to  integrate  Internet  technology,  but  do  not 
know  how,  and  (c)  recognize  that  present  in-service  pro- 
grams are  inadequate  for  widespread  integration  of  Internet 
technology  into  the  classroom.  Teachers  must  gain  the  nec- 
essary instructional  strategies  to  go  beyond  hands-on  com- 
puter skills  to  teacher-driven  instructional  strategies  that 
provide  confidence  and  enthusiasm  to  inspire  utilization  of 
Internet  technology  in  a whole  class  environment 
(O’Donnell,  1996). 

Summary 

The  marriage  of  Internet  technology  and  elementary 
curricula  holds  the  potential  to  change  the  way  students  look 
at  learning.  Teachers  and  their  students  need  to  move  from 
planned  learning  to  authentic  experiences;  Internet  technol- 
ogy provides  the  means  by  which  wc  can  influence  that 
change.  Internet  technology,  properly  applied,  holds  the 
potential  to  help  students  not  only  to  prepare  and  complete 
assignments,  but  integrates  experience  and  subject  matter. 
Used  properly,  the  Internet  can  act  as  a stimulus  for  the  dis- 
cussion and  exchange  of  ideas.  The  Internet  can  also  pro- 
vide for  individualized  instruction,  an  ideal  that  educators 
continually  advocate.  Finally,  the  Internet  encourages 
interactivity,  promoting  active  learning  between  students  of 
all  ages  and  abilities.  The  Internet  is  not  just  a technology 
for  presenting  material  to  be  learned,  nor  is  it  just  an  outlet 
for  students  to  express  themselves,  although  both  of  these 
are  roles  the  Internet  can  fulfill.  It  is  both  these  and  more. 


While  the  utilization  of  Internet  technology  shows  no 
more  promise  than  conventional  teaching  methods  (with  re- 
gard to  academic  achievement)  in  the  elementary  classroom, 
the  appropriate  application  of  Internet  technology  can  be 
responsive  to  differing  learner  characteristics,  can  provide 
authentic  opportunities  for  application,  and  can  motivate 
students  to  learn. 
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Abstract 

College  faculty'  can  minimize  valuable  time  and  resources  invested  in  inappropriate  technologies  by 
staying  in  step  with  technological  progress.  A "future  proof  ” approach  to  technology  recognizes,  and 
welcomes  small  failures,  considering  them  part  of  the  ongoing  process  of  absorbing  technology  into  the 
learning  process.  "Future  proofing  " attempts  to  understand  the  factors  that  influence  and  impact 
technology  upon  learners.  The  factors  that  comprise  the  concept  of  "future  proofing  ” include : 

(1 ) market  dominance  solutions;  based  on  a strong  market  presence  this  often  proves  to  be  the  single 
greatest  factor  in  decision  making; 

( 2 ) ease  of  use;  users  of  technology  prefer  simplicity  over  functionality; 

(3)  the  best-practice  approach;  since  technology  is  a delivery • medium,  proven  successful  teaching 
and  learning  practices  are  likely  to  work  when  technology  is  added; 

(4)  technology  non-reliance:  users  should  avoid  relying  too  heavily  on  the  expertise  of  technical  gurus; 

(5)  least  cost :free  software  should  be  rigorously  reviewed  and  users  should  plan  on  receiving  limited 
or  no  technical  support,  since  software  freely  available  may  disappear  or  fall  victim  to  program- 
mer neglect;  and 

(6)  best  guess-roulette:  creative  and  effective  solutions  evolve  from  combinations  of  technology  only 
possible  from  experimentation. 


Introduction 

The  use  of  technology  has  the  potential  of  being  the 
greatest  single  change  agent  effecting  learners.  A major 
problem  individuals  often  encounter  is  choosing  the  “cor- 
rect” technology.  Faculty  are  faced  with  a multitude  of 
equally  compelling  technologies  having  the  promise  of  be- 
ing the  ultimate  solution — today!  The  problem  is  not  the 
lack  of  technical  solutions  available  to  solve  problems,  it  is 
knowing  where  the  rest  of  world  is  heading  with  technol- 
ogy. Ignorance  with  respect  to  where  technology  is  heading 
can  force  countless  hours  of  working  and  reworking  solu- 
tions to  the  point  that  a paradigm  shift  deadlock  will  bring 
to  a halt  all  creativity  and  productivity.  Time  is  forever  lost 
retooling  thought  processes  and  skills,  not  to  mention  the 
hard  costs  of  revamping  hardware  and  software.  Unless  one 
is  fortunate  to  have  unlimited  resources  available  to  forge 
new  directions,  it  makes  sense  to  stay  technically  in-sync- 
step  with  the  rest  of  the  world;  only  then  is  it  financially 
viable  for  vendors  to  build  solutions  to  your  fingertips. 

This  begs  the  question,  how  doc.,  one  determine  where 
the  rest  of  the  world  is  heading?  Do  you  determine  the  most 
popular  technology  by  number  of  solutions  sold?  Do  you 
determine  direction  based  upon  the  ease  of  use  of  the  tech- 
nology? Do  you  rely  on  colleagues?  Do  you  seek  insight 


from  local  technical  gurus?  Do  you  seek  to  minimize  your 
perceived  risk  by  working  with  free  or  nearly  free  solutions. 
Or,  do  you  spin  the  roulette  wheel  of  technology  only  to  find 
out  you  are  playing  Russian  roulette? 

Purpose 

If  you  do  not  know  where  you  are  going,  then  any 
technological  road  will  get  you  there.  The  purpose  of  this 
paper  is  to  explore  approaches  that  can  help  one  avoid  in- 
vesting valuable  time  and  resources  into  technologies  that 
may  lead  into  dead-end  streets  that  discourage  learners  from 
pursuing  knowledge  through  technology.  All  too  often,  tech- 
nical solutions  are  chosen  to  solve  immediate  needs  with 
little  attention  given  to  the  critical  evaluation  of  how  best  to 
integrate  and  leverage  investments  in  existing  infrastructures. 
To  create  technical  life-long  learners  every  effort  must  be 
made  to  avoid  frustrating  learners  with  short-term  techno- 
logical solutions.  One  sure  way  to  discourage  learners  is  to 
prevent  them  from  building  upon  their  existing  knowledge 
base  as  they  progress  to  the  next  level.  The  rate  of  change  in 
technology  today  demands  a tactical  approach  that  antici- 
pates and  welcomes  change.  As  new  technologies  arc  intro- 
duced, the  capacity  for  change  must  be  planned  from  the 
beginning  or  the  learner  will  not  be  able  to  carry  forward  the 
skills  learned  from  previous  experiences. 

mi 
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How  to  “Future  Proof’ 


The  future  is  most  difficult  to  predict.  Technology  is 
encroaching  into  every  facet  of  modern  life.  The  rapid  change 
of  technology  can  create  a stranglehold  on  decision-making 
ability  of  the  average  teacher.  Why  would  technophobic 
teachers  ever  make  decisions  concerning  the  use  technology 
when  the  threat  of  totally  starting  over  holds  a death  grip  on 
their  careers?  Time  is  limited  and  failures  are  unavoidable. 
The  only  way  to  proceed  is  to  develop  a “future  proof’  ap- 
proach to  technology  that  recognizes  and  welcomes  failure 
as  the  tool  to  help  chisel  away  toward  a solution  that 
seamlessly  absorbs  technology  into  the  learning  process. 
Small  failures  can  and  should  be  recognized  for  what  they 
are;  small  nudges  guiding  an  individual  to  the  best  imple- 
mentation of  technology. 

“Future  proofing”  is  an  art,  not  science;  it  can  not  guar- 
antee immunity  from  failure.  However  it  can  provide  a ca- 
reer insurance  policy  that  inhibits  the  policyholder  from 
making  catastrophic  decisions  with  respect  to  the  implemen- 
tation of  technology.  Each  step  in  the  “future  proofing”  pro- 
cess can  be  individually  analyzed  to  clarify  the  critical 
components  that  makes  that  step  unique  in  the  process. 

Using  the  above  question,  “how  does  one  determine 
where  the  rest  of  the  world  is  heading?”,  and  spin  off  ques- 
tions that  logically  follow,  an  will  attempt  will  be  made  to 
identify  the  major  factors  in  the  “future  proofing”  process. 
Knowing  how  to  “future  proof’  requires  an  examination  of 
the  factors  that  serve  as  the  basis  for  this  concept.  Any  fac- 
tor alone  has  the  power  to  swage  the  final  determination  of 
how  best  to  prepare  for  the  future. 

Factor  I:  Market  Dominance 

Depending  on  the  degree  of  market  dominance,  solutions 
based  on  a strong  market  presence  often  prove  to  be  the  single 
greatest  factor  in  decision-making.  As  a user  of  technology,  it 
would  be  a relief  to  know  there  arc  other  individuals  coping 
with  the  exact  same  technical  issues;  there  is  safety  in  num- 
bers. For  example,  Microsoft  Word  is  the  dominant  word  pro- 
cessing software  package  in  the  world  today.  If  another  vendor 
ever  attempted  to  challenge  Microsoft’s  dominance,  they  would 
have  to  develop  solutions  which  provide  compelling  reasons 
to  switch.  In  an  attempt  to  sway  Word  users  to  another  soft- 
ware platform,  a vendor  would  develop  migration  strategies 
to  facilitate  the  conversion  of  Word  documents  to  a new  for- 
mat. If  you  were  using  a word  processing  package  that  had 
little  or  no  market  presence,  then  vendors  would  not  be  as 
willing  to  spend  time  or  resources  developing  migration  strat- 
egies. On  a purely  financial  self-interest  basis,  vendors  will 
develop  and  tailor  solutions  that  meet  the  needs  of  the  great- 
est number  of  users. 

When  it  is  not  possible  to  clearly  identify  a market  leader, 
it  would  make  sense  to  choose  a technology  path  allowing 
greatest  freedom  for  migration  in  the  future.  For  example, 
the  Web  browser  war  between  Microsoft  and  Netscape  for 
Web  market  dominance  can  be  described  as  a virtual  tie.  In 


this  situation  it  would  be  w ;sc  to  determine  the  common  tech- 
nology between  the  two  vendors’  solutions  and  select  a strat- 
egy allowing  for  a flexible  migration  path  in  the  future.  If 
this  instance,  if  one  were  developing  Web-based  solutions, 
it  makes  sense  to  develop  pages  that  arc  non-proprietary; 
pages  that  adhere  to  the  Hyper  Text  Markup  Language 
(HTML)  standard.  At  a later  date,  once  it  is  obvious  who 
the  market  leader  is,  web  pages  should  be  able  to  be  folded 
into  the  vendor  solution  with  little  trouble. 

Factor  2:  Ease  of  Use 

Ease  of  use  issues  arc  related  to  the  KIS  (Keep  It  Simple) 
principle.  Given  the  choice,  users  of  technology  would  gladly 
surrender  functionality  in  favor  of  simplicity.  The  simplest 
technical  problem  can  quickly  become  an  insurmountable 
barrier,  preventing  the  teaching  and  learning  process  from 
occurring  productively.  Technologists  and  educators  must 
be  brought  together  and  focus  their  energies  on  keeping  the 
complexities  from  getting  in  the  way  of  learning. 

Strive  for  the  highest  common  denominator  in  technol- 
ogy and  functionality  without  sacrificing  the  message.  To 
achieve  the  highest  common  denominator,  a conscious  ef- 
fort must  made  to  avoid  using  technologies  that  place  the 
learner  on  the  “bleeding  edge”.  More  often  then  not,  the 
appeal  to  include  flashing  gizmos  is  often  too  compelling  to 
resist  and  quickly  becomes  the  focus  of  problems  that  cre- 
ate unnecessary  barriers  to  the  teaching  and  learning  pro- 
cess. For  example,  the  use  of  plug-ins  and  helper  applications 
for  Web  based  applications  create  instant  configuration  prob- 
lems for  learners  as  they  try  to  adapt  their  browsers  to  the 
latest  and  greatest  technology  possible.  Stay  far  enough 
behind  the  bleeding  edge  of  the  technology  curve  to  provide 
the  highest  functionality  possible  with  minimum  user  frus- 
tration and  confusion.  If  you  can  not  delivery  the  message, 
you  are  failing  the  learner. 

Factor  3:  Best  Practice  Approach 

Successful  teaching  and  learning  practices  that  have 
worked  in  the  past  are  good  indicators  of  what  may  work  in 
the  future  when  technology  is  added.  Technology  in  most 
situations  is  just  a delivery  medium,  the  message  often  re- 
mains the  same.  What  has  changed  is  how  the  message  is 
delivered  and  way  the  learner  interacts  with  the  new  me- 
dium. Technology  in  itself  is  not  the  means  to  create  techni- 
cal life  long  learners,  it  is  how  the  technology  is  applied  to 
the  learning  process  that  counts!  Technology,  properly  ap- 
plied, has  the  potential  of  creating  new  pathways  to  dynami- 
cally engage  the  learner. 

The  converse  is  also  true;  poorly  applied  technology 
can  discourage  the  learner  and  make  the  learning  process 
much  worse  than  if  nothing  were  done  at  all. 

In  real  life  situations,  unexpected  failures  often  arise 
when  applying  new  technology  to  traditional  education  pro- 
cesses. What  really  matters  is  how  you  apply  the  technol- 
ogy. Failures  are  part  of  the  struggle  and  should  be  used  as 
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learning  opportunities  to  gain  a better  understanding  of  how 
to  refine  the  best  practice  approach  to  create  technical  life- 
long learners.  We  must  constantly  reevaluate,  inquire,  and 
collaborate  on  new  approaches  for  the  application  of  tech- 
nology to  learning,  or  we  will  never  fully  realize  the  poten- 
tial technology  has  to  offer.  Continual  experimentation  and 
evaluation  of  the  application  of  technology  to  learning  will 
reveal  how  best  to  combine  proven  learning  practices  with 
new  technology  innovations.  The  application  of  technol- 
ogy is  a work-in-progress,  constantly  changing  and  evolv- 
ing. Determine  what  has  worked  successfully  in  the  past 
and  investigate  ways  to  use  the  dynamic  nature  of  technol- 
ogy to  refine  and  improve  desired  learning  approaches. 

Factor  4:  Technical  Non-Reliance 

Avoid  relying  too  heavily  on  the  expertise  of  technical 
gurus.  Too  often  their  focus  is  purely  technical  based,  and 
the  solutions  offered  are  too  complex  to  have  any  tangible 
benefit  to  learners.  Technical  applications  for  the  sake  of 
technology  sizzle  are  surely  going  to  frustrate  and  change 
the  focus  from  learner  based  solutions  to  excesses  in  frus- 
tration. Always  temper  the  advice  from  technical  people 
with  questions  like:  What  will  this  give  me  when  I am  fin- 
ished? How  long  will  it  take  to  implement?  Who  do  I call 
when  I have  problems?  How  much  does  this  cost? 

Input  from  technical  experts  is  absolutely  necessary  in  the 
development  of  technical  lifelong  learners.  However,  a little 
technical  input  can  mutate  what  was  a learning  opportunity  to  a 
computer  science  project  where  programming,  software  instal- 
lation and  complex  configurations  are  required.  Constant  evalu- 
ation of  the  initial  goal  must  occur  to  guarantee  the  application 
of  technology  is  improving  the  learning  process. 

Factor  5:  Least  Cost 

The  success  of  the  World  Wide  Web  (WWW)  can  di- 
rectly be  attributed  to  software  that  has  been  freely  available 
on  the  Internet.  Mosaic,  Netscape  and  Internet  Explorer  are 


examples  of  free  WWW  browsers  that  have  revolutionized 
the  delivery  of  information.  The  initial  lure  of  assembling 
learning  solutions  using  free  or  nearly  free  software  should 
be  rigorously  reviewed  before  foundational  decisions  are  made 
effecting  future  directions.  Software  freely  available  today, 
may  instantly  disappear  or  fall  victim  of  programmer  neglect. 
When  assembling  free  software,  plan  on  receiving  limited  or 
no  technical  support  from  the  author  or  vendor. 

Factor  6:  Best  Guess — Roulette 

The  best  guess  approach  often  leads  to  failure;  but  by 
eliminating  possible  solutions  one  can  work  toward  the  cor- 
rect solution(s),  one  failure  at  a time.  This  approach  can  be 
costly  in  terms  of  human  resources  as  well  as  hard  costs  in 
computing  equipment.  As  illogical  as  this  approach  may 
seem,  innovative  applications  of  technology  can  emerge  from 
experimenting  with  varied  and  dissimilar  learning  technolo- 
gies. Creative  and  effective  solutions  evolve  from  combi- 
nations of  technologies  only  possible  from  experimentation. 

Summary 

The  “future  proofing’"  concept  is  a learner-based  strat- 
egy designed  to  help  faculty  keep  pace  in  the  rapidly  chang- 
ing world  of  technology.  Unanticipated  change  can  result 
when  one  is  not  aware  of  technological  solutions  and  their 
potential  impact  on  learning.  Staying  abreast  of  technology 
requires  an  investment  of  time  and  the  capacity  to  accept 
failure  as  a positive  influence.  Realizing  technology  has 
become  an  integral  component  of  the  educational  process; 
technology  awareness  and  skills  are  absolutely  essential  for 
faculty  and  learners  to  be  prepared  for  the  2 1 sl  century.  “Fu- 
ture proofing”  is  an  approach  to  understanding  the  factors 
that  influence  technology,  and  hence,  the  impact  technology 
has  on  learners.  As  new  technologies  enter  the  education 
scene,  always  keep  the  focus  on  learning.  Is  the  technical 
enhancing  the  learning  process? 


Don’t  Miss  MWERA— 98 

The  1998  Annual  Meeting  will  be  held  October  14  - 17,  at  the  Holiday  Inn  Mart  Plaza  in 
Chicago.  Pre-registration  must  be  post  marked  by  September  22,  1998. 

The  Annual  Meeting  program  is  available  on  the  Internet  at: 

http://tierlab.ilstu.edu/MWERA-98 

Hotel  group  rates  are  only  guaranteed  until  September  22, 1998.  See  the  summer  Program 
Issue  of  the  Mid-Western  Educational  Researcher  for  registration  forms. 
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Observation  of  Instruction  via.  Distance  Learning: 
The  Need  for  a New  Evaluation  Paradigm 
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Brad  E.  Oliver 
Nancy  G.  Saunders 
Jay  C.  Thompson,  Jr. 

Ball  State  University 

Abstract 


Technology  as  a tool  used  to  enhance  instruction  must  be  viewed  in  its  proper  perspective.  Instruction 
via  distance  learning  is  an  excellent  example.  Instruction  must  be  appropriate  for  the  intended  audi- 
ence, and  must  be  observed  and  evaluated  within  the  expectations  of  criteria  used  for  evaluating  effec- 
tive teaching.  Traditional  criteria  may  be  appropriate  for  evaluating  regular  classroom  instruction,  but 
not  appropriate  for  distance  learning  instruction.  Criteria  such  as  “ wait  time  and  questioning  tech- 
niques, ” are  well  documented,  but  were  derived  through  tedious  observation  and  recordings  of  repeti- 
tive behaviors  within  a regular  classroom.  As  an  administrator  or  evaluator  obser\‘es  in  a classroom 
where  instruction  is  being  delivered  via  television,  consideration  must  be  given  for  adaptations  that 
must  be  made  for  observing  the  distance  learning  classroom.  Observation  training  in  the  distance 
learning  classroom  will  be  tedious , but  new  examples  and  innovative  ways  of  documenting  teaching 
behaviors  are  needed.  The  authors  present  a case  for  the  development  of  new  criteria  for  evaluating 


distance  learning  instruction. 

Introduction 

Paradigms  used  in  the  observation  and  evaluation  of  regu- 
lar classroom  teaching  may  not  be  applicable  when  observing 
instruction  via  distance  learning.  The  body  of  knowledge 
gleaned  from  the  research  on  effective  teaching  when  applied 
to  teaching  on  television  may  simply  not  fit.  At  the  very  least, 
teacher  behaviors  tried  and  tested  in  a regular  classroom  will 
need  modification  if  they  are  to  be  successful  in  distance  learn- 
ing. This  is  especially  true  when  the  teaching  is  to  be  per- 
formed in  a one-way  video  mode.  In  this  mode,  the  student 
must  assume  more  of  the  responsibility  for  learning.  Teaching 
on  television  is  usually  conducted  in  a one-way  video — two- 
way  audio,  or  two-way  interactive  video  format.  This  article 
deals  with  the  key  issues  that  are  essential  to  quality  instruction 
via  distance  learning.  As  teaching  and  learning  address  the  ur- 
gency of  the  technological  explosion,  compatible  accommoda- 
tions must  be  made  for  impending  changes. 

Instruction  via  distance  learning  needs  close  scrutiny  and 
critical  evaluation  as  it  holds  the  potential  to  change  teaching 
and  learning.  Although  the  costs  may  be  prohibitive,  the  im- 
pact for  teachers  and  learners  is  far  too  great  to  ignore.  It  is  not 
a panacea;  neither  should  it  be  dismissed  with  an  attitude  of 
this  too  shall  pass! 

Observation  in  the  Distance  Education  Environment 

Distance  education  is  a distinguished  system  of  education, 
distinguished  from  other  educational  forms  by  its  separation  in 
both  time  and  place  and  by  its  teaching  and  learning  acts 
(Rumble,  1989).  The  teacher  is  a very  important  clement  in  the 


educational  process,  whether  in  a traditional  classroom  or  in  a 
distance  education  setting.  One  of  the  ways  to  determine  the 
effectiveness  of  instruction  conducted  on  a distance  learning 
system  might  be  to  observe  and  document  the  characteristics 
and  behaviors  of  distance  learning  instructors  for  comparison 
to  the  teaching  behaviors  found  in  the  research  on  effective 
teaching.  Specific  teaching  behaviors  such  as  providing  effec- 
tive praise  (Brophy,  1 98 1 ),  use  of  advance  organizers  (Ausubel, 

1 960)  or  frequency  of  reviews  (Cruickshank,  1 986)  might  serve 
as  starting  places.  Questions  about  effective  teaching  might 
include  inquiry  into  interaction  such  as:  1 ) how  often  does  the 
instructor  initiate  interaction  with  each  student,  2)  how  often 
do  the  students  initiate  interaction  with  the  instructor,  3)  how 
much  wait  time  does  the  instructor  give  a student  responding  to 
a question,  4)  how  often  does  the  instructor  use  advance  orga- 
nizers, or  5)  how  much  time  docs  the  instructor  spend  in  re- 
viewing previous  lessons?  Questions  like  these  might  be  more 
useful  in  an  observation  instrument  for  teaching  on  television 
than  an  instrument  normally  used  in  a regular  classroom.  An 
analysis  of  the  amount  of  teacher  dialogue  compared  to  the 
amount  of  student  dialogue  or  a determination  of  how  much  of 
the  interaction  the  teacher  initiated  and  how  much  the  students 
initiated  might  also  prove  beneficial  (Barker,  1988). 

Several  studies  assessing  student  attitudes  toward  media 
and  technology  in  the  distance  learning  environment  have  been 
conducted  (Allen,  1995,  Bangpibob,  1995,  and  Bozik,  1995). 
Adult  attitudes  toward  instructional  technologies  arc  positive 
(Dillon,  Haynes  & Price,  1990);  however,  other  studies  indi- 
cate student  attitudes  are  influenced  by  their  familiarity  with 
the  technologies  employed  (Riddle,  1990,  Smith  & McNeils, 
1993).  Teachers  and  learners  must  realize  computers  arc  not 
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inherently  interactive.  They  provide  an  excellent  environment 
for  discussion,  but  they  are  only  interactive  if  students  partici- 
pate responsively  and  regularly  (Eastmond,  1995).  Kinzie, 
Dclcourt  and  Powers  (1994)  found  attitudes  are  important  pre- 
dictors of  success  and  are  critical  areas  for  future  examination. 
Distance  learning  students  express  a need  to  know  classmates 
and  a desire  to  interact  with  someone  else  in  class  (Egan  & 
Sebastian,  1993).  The  practice  most  often  mentioned  by  stu- 
dents in  a description  of  outstanding  electronic  teaching  prac- 
tices was  the  practice  of  providing  for  student-to-student  and 
instructor-to-student  interaction  (Western  Cooperative  for  Edu- 
cational Telecommunication,  1995).  Clearly,  an  examination 
of  instructional  effectiveness  must  consider  an  assessment  of 
student  attitudes  toward  the  learning  delivery  system. 

Teaching  strategics  and  course  design  influence  student  atti- 
tudes in  a distance  learning  environment.  Students  are  positive 
toward  interactive  teaching  methods  (Burge,  1994);  however,  their 
attitudes  toward  the  impact  of  technological  difficulties  are  nega- 
tive (Riddle,  1990).  Saba  and  Shearer  ( 1994)  found  students  felt 
connected  and  satisfied  in  a computer-facilitated  interactive  video 
classroom,  yet  felt  isolated  from  the  main  class  and  saw  them- 
selves as  passive  observers  in  a video-only  classroom.  Keegan’s 
comment  might  serve  as  a summation:  Interactive  learning  envi- 
ronments have  proven  difficult  to  design  and  deliver;  however, 
current  instructional  emphases  must  consider  new  interactive  tech- 
nologies if  transactional  distance  between  learners  and  instruc- 
tors is  to  be  bridged  (Keegan,  1993). 

The  one-way  video — two-way  audio  format  necessitates 
conveying  of  information  where  the  nonverbal  dimension  of 
teaching  is  missing  for  the  most  part  (the  student  can  see  the 
teacher,  but  the  teacher  cannot  see  the  student).  The  role  of  the 
teacher  is  radically  altered.  The  teacher  must  make  illustra- 
tions by  describing  or  by  creating  verbal  pictures  for  the  stu- 
dents. Pinney’s  research  (1969)  found  that  without  the 
opportunity  to  see  the  student,  the  teacher  must  prepare  the  stu- 
dents in  such  a way  that  they  assume  more  responsibility  for 
their  own  learning.  Usually,  there  is  no  opportunity  for  imme- 
diate clarification  as  one  would  do  in  a normal  classroom  set- 
ting. This  represents  a major  adjustment  if  the  teacher  uses  a 
research  based  teaching  approach. 

Preparing  the  students  to  learn  is  an  essential  element  in 
effective  teaching.  The  beginning  of  the  class  is  an  important 
time.  First  impressions  tend  to  have  lasting  effects,  and  teach- 
ing at  the  beginning  of  the  period  might  be  much  more  influen- 
tial than  the  instruction  taking  place  later.  The  beginning  of  class 
is  one  of  the  most  critical  teachable  moments.  The  teacher  must 
take  this  into  account  and  work  diligently  to  get  the  students 
ready  to  learn  (Hunter,  1 982). 

Whether  one  uses  Hunter's  anticipatory  set  or  some  other 
term,  how  the  teacher  addresses  learning  at  the  beginning  of  the 
class  period  is  extremely  important.  If  this  thinking  were  ex- 
tended throughout  the  duration  of  a particular  course  then  one 
would  be  well  advised  to  model  the  appropriate  behaviors  early 
in  the  school  year  or  semester.  Opportunities  to  teach  through 
modeling  are  greater  at  this  time  because  lules  and  procedures 
are  amenable  to  change  (Doyle,  1986). 


Setting  the  stage  for  learning  when  one  is  teaching  on  tele- 
vision becomes  much  more  demanding  of  the  teacher  in  terms 
of  details  that  must  be  addressed.  The  flow  of  instruction  must 
be  planned  in  advance  with  materials  and  other  strategies  that 
do  not  require  student  interaction  during  the  class  period.  The 
teacher  must  prepare  visuals  to  illustrate  processes  that  he/she 
might  use  to  enhance  learning.  With  the  student  role  in  learn- 
ing largely  dependent  on  the  learner,  the  teacher  will  encounter 
difficult  problems  if  the  student  has  a motivation  problem.  This 
is  true  for  any  type  of  teaching  situation,  but  teaching  via  dis- 
tance learning  formats  tends  to  exaggerate  the  problem.  Per- 
haps a more  realistic  approach  for  observing/planning  and 
organization  for  instruction  over  a one-way  video — two-way 
audio  format  would  be  to  examine  the  materials  themselves 
and  try  to  determine  the  intent  of  the  teacher.  Observation  could 
then  discern  if  the  teacher's  intent  were  effectively  reached. 
While  preparation  for  teaching  without  anticipating  student  in- 
teraction may  be  necessary,  the  teacher  would  be  well  advised 
to  plan  for  student  interaction  as  much  as  possible.  This  may 
necessitate  class  assignments  where  the  students  are  required 
to  interact  with  each  other  via  computers,  or  telephone  or  with 
materials  the  teacher  has  provided.  Either  way,  the  preparation 
for  such  occurrences  will  greatly  enhance  the  chances  for  them 
to  actually  materialize.  In  seme  distance  learning  situations, 
teachers  use  chat  rooms  or  newsgroups  where  the  students  in- 
teract via  the  computer  between  the  times  classes  meet.  When 
students  log  on,  their  messages  are  recorded  and  the  teacher  is 
able  to  make  some  assessment  as  to  how  much  interaction  is 
actually  occurring. 

Effective  teaching  includes  modeling  on  the  part  of  the 
teacher.  When  one  is  observing  instruction  on  television,  an 
appropriate  behavior  might  be  to  look  for  the  teacher’s  illustra- 
tions or  demonstrations,  or  modeling  behaviors  as  they  are  dis- 
played for  the  students  who  sit  in  the  studio  where  the  televised 
teaching  takes  place.  Interviews  with  T.  Wiedmer  & J.C.  Th- 
ompson, Jr.,  university  teachers  who  have  taught  on  television, 
verify  that  students  have  the  advantage  of  the  verbal  and  non- 
verbal dimensions  of  the  teaching  act  and  are  able  to  discern 
and  communicate  more  clearly  than  those  at  distance  sites  (Per- 
sonal Communication,  Spring,  1997).  Thus  a criterion  for  ob- 
serving teaching  on  television  might  be  to  determine  how  well 
the  teacher  utilizes  the  students  who  are  present  at  the  program- 
ming site  for  demonstrating  teaching  points  he/she  wants  to 
make.  How  does  one  observe  for  overlapping  behaviors  on  the 
part  of  the  teacher  on  television?  One  suggestion  might  be  for 
the  teacher  at  the  beginning  of  the  class  to  start  a review  session 
by  directing  a question  to  the  entire  class;  take  the  roll,  or  pass 
out  papers  (perhaps  through  a fax  machine)  while  the  students 
are  thinking  about  the  answer  (wait  time),  then  call  on  a student 
whom  the  teacher  thinks  will  answer.  By  utilizing  strategies 
like  this,  the  teacher  can  conduct  the  review  and  take  care  of 
housekeeping  chores  at  the  same  time.  The  stage  is  set  for  the 
students  to  think  about  their  answers  and  compare  them  to  the 
one  given  by  the  student  called  upon.  In  this  way,  unvoiced 
misunderstandings  or  incorrect  answers  can  be  corrected  with- 
out visibility  or  embarrassment.  On  television  this  leaching 
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situation  will  need  to  be  modified  to  utilize  the  students  who 
are  in  the  studio  to  model  the  behaviors  sought  by  the  teacher. 

Modeling  behaviors  that  teach  desired  outcomes  might  be 
observed  as  intentional  or  unintentional  on  the  part  of  the  teacher. 
How  the  teacher  models  respect  for  the  students  in  the  class 
sets  the  stage  for  how  the  students  treat  each  other.  In  an  at- 
tempt to  explore  the  impact  of  invitational  teaching  practices 
on  underachieving  and  apathetic  teacher  education  students, 
Lange  (1988)  found  a positive  correlation  between  the  invita- 
tional teaching  techniques  and  increased  positive  experience 
for  each  student  in  the  study.  This  study  was  an  overt  attempt 
to  look  at  positive  model  ing  behaviors  and  their  impact  on  stu- 
dents who  were  disenchanted  with  their  choice  of  a career.  Stu- 
dents do  not  easily  discern  intentions  unless  the  teacher  exhibits 
overt  behaviors.  Overt  teacher  behaviors  that  are  designed  to 
enhance  student  motivation  and  attitude  should  be  included  in 
any  evaluation  paradigm  of  teaching  on  television. 

A research  based  teaching  model  indicates  the  need  to 
check  for  understanding.  In  the  one-way  video — two-way  au- 
dio format,  opportunity  to  check  for  understanding  might  not 
be  as  applicable  at  the  moment  the  teacher  needs  it  as  it  would 
be  in  the  regular  classroom.  The  teacher  therefore  must  make 
opportunities  for  this  crucial  step  in  the  teaching  process.  Stu- 
dent interaction  in  distance  learning  situations  is  often  accom- 
plished via  telephone  or  computer  via  telephone  lines.  If  the 
students  are  to  utilize  the  telephone  to  interact  from  distant  sites, 
elapsed  time  may  be  dependent  upon  the  number  of  lines  ac- 
cessible to  the  students.  Further,  responsive  telephone  calls  by 
students  may  consume  so  much  time  that  the  question  or  com- 
ment becomes  out  of  place  in  the  sequence  of  interactive  events. 
Without  the  opportunity  to  check  for  understanding  at  the  most 
opportune  time,  the  teacher  may  not  be  as  aware  of  the  student's 
comprehension  of  the  content  or  processes  being  taught  and 
may  be  unable  to  adjust  the  instruction  for  optimal  learning. 

Programs  which  permit  only  selected  on-line  classes  to 
call  in  can  hardly  pretend  to  be  interactive  when  a majority  of 
their  students  are  simply  watching  a one-way  TV  instructional 
program  that  does  not  allow  them  to  call-in,  ask  questions,  or 
make  comments.  Another  factor  is  whether  or  not  students  at  a 
receiving  site  would  be  able  to  be  on-line  with  students  at  other 
receiving  sites  at  the  same  time,  thereby  enabling  not  only 
teacher/student  interaction  but  also  student/student  interaction 
(Barker,  1988). 

Effective  use  of  time  is  a variable  necessary  for  successful 
teaching;  however,  when  one  observes  teaching  on  television, 
there  is  the  realization  that  the  use  of  time  must  be  evaluated 
differently.  When  the  teacher  asks  a question,  three  to  five 
seconds  of  wait  time  is  well  documented  in  the  literature  (Rowe, 
1996),  but  this  is  not  realistic  in  a distance  learning  classroom 
An  adjusted  expectation  might  well  be  as  long  as  ten  seconds 
or  an  adjusted  definition  of  wait  time  might  be  developed  to 
include  student/teacher  interaction  via  telephone.  The  obvious 
question  arises,  however,  that  if  wait  time  must  be  extended, 
how  does  a teacher  cover  the  necessary  learning  material  needed 
in  the  course?  Or,  if  the  teacher  adjusts  and  makes  decisions  to 


concentrate  on  more  essential  elements  of  the  content,  who 
participates  in  the  decision  as  to  what  is  essential?  These  are 
typical  of  the  decisions  teachers  have  to  make  (Hunter,  1982), 

Interviews  with  teachers  who  have  taught  on  television  in- 
dicate it  is  not  possible  to  process  material  initially,  but  teachers 
adjust  over  time  and  tend  to  acclimate  to  the  demands  of  teach- 
ing on  television.  With  practice  and  experience,  improvement 
can  take  place.  Strategies  drawn  from  the  research  literature  that 
might  be  applicable  here  include:  1 ) repeating  content  three  or 
more  times  alspaced  inte  rials  results  in  content  retention  (Jersild, 

1 928);  2)  Proactive  markers  such  as  “look  at  this",  “watch  me", 
or  “now  get  this"  increase  retention  also  (Ehrensberger,  1945; 
Petrie.  1963;  and  Maddox  and  Hoole,  1975). 

Teaching  in  a distance  learning  format  that  is  one-way 
video — two  way  audio  presents  a different  situation  from  that 
of  the  normal  classroom.  A study  of  communication  always 
includes  a discussion  of  how  much  of  a spoken  message  is  re- 
ceived and  decoded  through  the  nonverbal  gestures  or  nuances 
that  accompany  it.  Estimates  range  as  high  as  93%  of  a spoken 
message  is  received  nonverbally.  Teaching  on  television  in  a 
passive  one-w'ay  video  system  mandates  that  the  teacher  must 
convey  information  or  processes  in  a medium  that  restricts  the 
nonverbal  dimension  of  the  communication  process.  In  ob- 
serving teaching,  it  is  common  to  view  a series  of  communica- 
tion exchanges  that  result  in  teacher  and  student  behaviors  that 
can  be  codified.  The  observation  may  be  accurate  only  to  the 
extent  that  the  observer  has  the  opportunity  to  summarize  the 
complete  exchange.  In  observing  teaching  in  a distance  learn- 
ing format,  the  observer  will  not  have  access  to  complete  ver- 
bal and  nonverbal  exchanges  and  may  have  to  extrapolate  or 
hypothesize  occurred.  This  raises  the  potential  for  differential 
and/or  erroneous  interpretation. 

The  role  of  the  student  in  distance  learning  is  quite  differ- 
ent from  that  of  a live  classroom.  The  student  must  cope  with 
the  technology  to  be  able  to  participate  in  class  assignments. 
Students  must  assume  more  responsibility  for  their  own  learn- 
ing. Perhaps  this  is  the  greatest  real  gain.  Collaboration  with 
the  teacher  to  increase  learning  is  essential  in  any  learning  situ- 
ation. However,  when  the  medium  is  a passive  learning  format 
like  distance  learning,  both  the  teacher  and  the  learner  must 
exert  more  effort.  Precision  of  language  used  by  the  teacher 
when  a concept  is  introduced  and  defined  is  important,  but  when 
examples  and  non-examples  are  given,  it  becomes  critical.  It 
should  be  noted  that  concepts  arc  attained  more  completely 
when  both  examples  and  non-examples  are  provided  (Tennyson, 
Woodley,  and  Merrill,  1972). 

Learning  is  enhanced  when  the  teacher  states  each  con- 
cept, law,  or  rule  clearly.  'This  might  be  accomplished  by  defin- 
ing or  stating  the  components,  explaining  in  a language  from 
which  the  students  can  profit  or  in  such  a way  as  to  allow  the 
students  to  demonstrate  either  by  example  or  analogy.  When 
students  have  opportunities  for  guided  and  independent  prac- 
tice, achievement  is  enhanced  (Klausmcicr,  1976).  In  1979 
Anderson,  Evertson,  and  Brophy  found  a strong  correlation 
between  the  number  of  minutes  spent  in  guided  practice  (where 
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a large  number  of  questions  were  asked)  and  achievement.  They 
also  found  a positive  correlation  between  student  achievement 
and  the  number  of  responses,  suggesting  interactive  student 
practice  at  a brisk  pace.  Rosenshine  and  Stevens  (1986)  found 
that  correctives  and  a high  percentage  of  correct  responses  pro- 
vided during  guided  practice  are  essential.  The  question  then 
becomes:  How  does  the  teacher  give  guided  practice  in  a dis- 
tance teach  ing/leaming  format? 

Independent  practice  used  to  extend  content  that  has  already 
been  taught  is  a sound  research  based  teaching  practice.  It  usu- 
ally involves  two  stages:  1 ) working  on  the  first  few  examples  or 
questions,  and  2)  when  students  have  mastered  the  material  and 
are  working  on  reinforcement  (Samuels,  1981).  In  the  first  stage, 
instruction  is  focused  on  the  teacher's  behavior  and  is  usually  a 
direct  instructional  situation.  An  ineffective  teaching  behavior 
that  is  often  observed  when  students  ask  questions  about  mate- 
rial that  has  just  been  presented  is  that  the  teacher  often  repeats 
the  first  example  that  was  used  to  explain  the  concept.  Not  only 
is  the  example  repeated,  it  is  often  repeated  more  slowly,  loudly 
or  precisely.  This  practice  is  ineffective  because  the  teacher  is 
emphasizing  an  example  that  the  student  did  not  understand  the 
first  time  it  was  presented.  It  is  exacerbated  by  the  fact  that  the 
teacher  repeats  it  slowly  and  often  more  loudly  as  if  to  empha- 
size that  the  fault  lies  with  the  student  and  not  the  example.  It  is 
the  wise  and  skilled  teacher  who  recognizes  this  situation  and 
shifts  to  another  example  while  assuming  the  responsibility  for 
the  student  not  understanding.  Frayer  (1970)  found  that  a few 
well-chosen  examples  were  better  than  numerous  examples  and 
the  number  of  examples  that  a teacher  uses  may  not  be  as  signifi- 
cant as  the  quality^  of  examples  given. 

In  a distance  learning  format,  the  teacher  will  be  hard 
pressed  to  incorporate  independent  practice  while  the  lesson  is 
being  taught.  Learning  then  entails  work  or  practice  beyond  the 
classroom.  Teaching  on  television  can  be  greatly  enhanced  by 
use  of  computer-assisted  interaction.  Riel  (1993)  found  com- 
puter-mediated communication  raised  cross-cultural  awareness. 
Social  interaction  is  increased  (Johnson-Lcnz&  Johnson-Lenz, 

1 993),  writing  skills  arc  enhanced  (Paulsen,  1 992),  knowledge 
construction  and  thinking  arc  facilitated,  and  independent  learn- 
ing strategics  arc  developed  (Mason  & Kaye,  1989).  How- 
ever, lack  of  visual  cues  can  also  inhibit  depth  of  communication 
(Selfe  & Meyer,  1991).  From  these  studies  an  evaluation  of 
teaching  on  television,  especially  when  the  evaluator  is  trying 
to  assess  independent  practice,  clearly  must  attempt  to  assess 
activities  that  occur  beyond  the  classroom  and  between  times 
when  the  class  meets.  Interaction  between  students  outside  the 
classroom  may  be  a direct  refection  of  the  teacher's  action 
during  classtime. 

Summary 

Instruction  via  distance  learning  is  a widespread  practice 
among  educational  institutions.  It  is  utilized  for  upper  level 
classes  at  the  high  school  level  to  provide  opportunities  for 
students  who  plan  to  pursue  higher  levels  of  study.  Colleges 
and  universities  use  distance  learning  for  a variety  of  instruc- 


tional purposes  from  delivering  classes  within  state  borders  and 
between  states  nationwide  to  video  conferencing  that  might  have 
international  hookups.  The  explosion  of  technology  has  served 
to  remove  the  barrier  of  distance  for  access  to  learning.  The 
speed  with  which  electronic  signals  can  transmit  information 
has  permeated  nearly  all  areas  of  society;  education  is  no  ex- 
ception. Technology  is  here  to  stay  and  its  implications  for  in- 
struction stagger  the  imagination. 

An  issue  of  distance  learning  that  must  be  considered  is 
the  quality  of  the  instruction  and  learning  that  takes  place.  The 
research  on  evaluating  instruction  via  distance  learning  formats 
has  been  largely  confined  to  analyses  of  self-reported  data  from 
participants.  Careful  observation  with  well  researched  criteria 
are  needed  to  evaluate  the  effectiveness  of  distance  learning 
instruction.  The  research  on  effective  teaching  is  a body  of 
knowledge  that  has  been  accumulated  largely  in  traditional  class- 
rooms. The  distance  learning  site  is  not  a traditional  classroom 
as  far  as  teaching  and  learning  are  concerned,  and  the  tradi- 
tional criteria  utilized  for  observing  and  evaluating  teaching 
arc  not  appropriate  for  observing  and  evaluating  instruction  via 
distance  learning.  As  evaluators  use  die  results  of  research  on 
effective  teaching  and  apply  them  to  distance  learning  instruc- 
tion, modifications  of  existing  criteria  need  to  be  made.  There 
is  also  a need  for  new  criteria  that  are  more  compatible  with 
distance  learning  environments. 

Student  attitudes  toward  learning  are  especially  important 
for  success  in  a distance  learning  situation.  The  teacher  and  learner 
must  possess  a degree  of  confidence  and  comfort  with  the  tech- 
nology. When  the  nonverbal  dimension  of  teaching  is  missing, 
the  preparation  for  instruction  is  different  and  must  focus  more 
on  created  visual  images  rather  than  direct  observation. 
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